c1b919ec4774e2aaff28a98949240c9fd9903ee4
Condition maxSlotsPerGpu Behavior OptimizeModelStr 0 Bypass: non-shared temporary engine 1 GPU 1 Single slot, no round-robin >1 GPU, VRAM < 24 GB 1 Round-robin: 1 slot per GPU >1 GPU, VRAM >= 24 GB -1 Elastic: on-demand slot growth
Description
No description provided
13 MiB
Languages
C
55.3%
C++
43.4%
Python
0.5%
CMake
0.3%
Objective-C++
0.2%
Other
0.2%