GpuMemoryGuard: scale VRAM safety margin to card size
The margin was a fixed 768 MiB — 3% of a 24 GiB compute card but 19% of a 4 GiB card (RTX A400), where free VRAM never clears it, so CanLoad() refused every engine and UnderPressure() skipped every frame. Now total/8 clamped to [192, 768] MiB: cards >= 6 GiB keep exactly the old margin, only small cards change. ANSCENTER_GPU_MARGIN_MB / SetMargin() still override (0 = auto). Refusal log now reports total VRAM alongside free, which is what made this diagnosable. Verified on the A400 test PC: detector + recognizer load and match. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This commit is contained in:
@@ -818,9 +818,10 @@ bool Engine<T>::loadNetwork(std::string trtModelPath, const std::array<float, 3>
|
||||
std::cerr << "[GpuMemGuard] REFUSING engine load on GPU "
|
||||
<< m_options.deviceIndex << ": need ~"
|
||||
<< (buffer.size() / (1024 * 1024)) << " MiB + "
|
||||
<< (ANSCENTER::GpuMemoryGuard::Margin() / (1024 * 1024))
|
||||
<< (ANSCENTER::GpuMemoryGuard::MarginFor(totalVRAM) / (1024 * 1024))
|
||||
<< " MiB margin, only " << (freeVRAM / (1024 * 1024))
|
||||
<< " MiB free. Reduce concurrent engines/cameras or batch size."
|
||||
<< " MiB free of " << (totalVRAM / (1024 * 1024))
|
||||
<< " MiB total. Reduce concurrent engines/cameras or batch size."
|
||||
<< std::endl;
|
||||
return false;
|
||||
}
|
||||
|
||||
Reference in New Issue
Block a user