13180921c904bd493b31412f7f0600b23dfec3de
Two-pass slot acquisition in runInferenceFromPool: Pass A picks an idle slot whose deviceIndex matches the input GpuMats' resident device (zero-copy dispatch); Pass B falls back to plain round-robin, where runInference migrates the inputs via the pinned-host two-hop copy. Callers that prepare frames on GPU A no longer pay the ~1 ms/frame PCIe migration when a same-GPU slot is idle, while spillover to the other GPU under load still works. Input residency is queried outside the slot mutex via cudaPointerGetAttributes (cheap driver lookup). Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Description
No description provided
13 MiB
Languages
C
55.3%
C++
43.4%
Python
0.5%
CMake
0.3%
Objective-C++
0.2%
Other
0.2%