nghianguyen and Claude Opus 4.8
da9d922498
ANSFR: gate recognizer batch size by GPU VRAM
...
Batch-4 was tuned for 8 GB GPUs; its TRT workspace (~54 MiB per batch
unit) crowds out the other engines on smaller cards. VramCappedBatch
keeps the configured batch on 8 GB-class cards and up (threshold
7.5 GiB — 8 GB cards report ~8188 MiB) and drops to single-face batches
below that: identical results, multi-face frames just run sequentially,
~160 MiB freed on a 4 GB RTX A400. Also caps the legacy 8/32 LoadEngine
profile, whose .b32 engine (~1.7 GB workspace) would be fatal on small
cards. Initialize() and OptimizeModel() share the same call so their
profiles cannot drift.
Small cards rebuild the recognizer engine once (filename loses the .b4
suffix); 8 GB+ machines keep their cached engines unchanged.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com >
2026-08-21 10:44:22 +10:00
nghianguyen
3a527d2dad
Remove locks
2026-04-24 17:10:29 +10:00
nghianguyen
e2bf17289d
Fix model extract race issue to all classes
2026-04-24 12:19:54 +10:00
nghianguyen
6135649835
Use yuv and fix FR to use batch 4
2026-04-22 17:11:17 +10:00
nghianguyen
a0d5c81814
Update
2026-04-22 16:52:40 +10:00
nghianguyen
fc47a42c6a
Use yuv and fix FR to use batch 4
2026-04-22 16:01:44 +10:00
nghianguyen
97d814936d
Enable log information. Disable NPU in U9
2026-04-21 15:48:27 +10:00
nghianguyen
7e772f76bc
Improve ANSCV
2026-04-21 09:26:02 +10:00
nghianguyen
3418090042
- Remove ALPR_OD Tracker and voting system.
...
- Disable debugview
2026-04-19 23:15:50 +10:00
nghianguyen
51fe507dfd
Fix unregister issue
2026-04-19 14:47:29 +10:00
nghianguyen
2de11c4b0c
Fix: remove the leak protection entirely
2026-04-18 20:51:50 +10:00
nghianguyen
8e60126c4c
Fix mutex lock issues (OCR and FR)
2026-04-13 20:38:40 +10:00
nghianguyen
0a8aaed215
Add CPU/GPU gate and support new ANSALPR using OCR
2026-04-12 17:16:16 +10:00
nghianguyen
69787b0ff0
Fix AMD and OpenVINO
2026-04-08 13:45:52 +10:00
nghianguyen
a4a8caaa86
Fix mixed UTF16 issue (LabVIEW) and fix ANSFR for Intel
2026-04-08 08:47:10 +10:00
nghianguyen
6d792ee4c0
Support unicode to get users/user APIs
2026-04-06 17:02:42 +10:00
nghianguyen
091a61d2be
Fix Window search path for ANSLIB
2026-04-06 08:31:26 +10:00
nghianguyen
98681f4da6
Use CPU resize before upload to GPU to remove PCIe bottleneck
2026-04-04 22:29:08 +11:00
nghianguyen
6fb09830c5
Fix NV12 crash issue when recreate camera object
...
(new structure) does not work
2026-04-03 14:51:52 +11:00
nghianguyen
6c6d1c0e0b
Fix issue that generate two or more objects with the same LP numbers/user name in the same image frame
2026-04-01 08:01:22 +11:00
nghianguyen
ccfc5964d4
Support UTF8 to UTF16 LE.
...
Support Unicode helper
Fix ANSFR to show 2 same faces in 1 image
2026-03-31 21:52:47 +11:00
nghianguyen
70be68d0fc
Support UTF8 to UTF16 LE
2026-03-31 14:10:21 +11:00
nghianguyen
0c24096c80
Support return Unicode escapes
2026-03-30 22:50:07 +11:00
nghianguyen
c1b919ec47
Fix setting GPU behaviour:
...
Condition maxSlotsPerGpu Behavior
OptimizeModelStr 0 Bypass: non-shared temporary engine
1 GPU 1 Single slot, no round-robin
>1 GPU, VRAM < 24 GB 1 Round-robin: 1 slot per GPU
>1 GPU, VRAM >= 24 GB -1 Elastic: on-demand slot growth
2026-03-30 09:59:09 +11:00
nghianguyen
6861de8fb4
Organise the dependencies
2026-03-29 14:10:05 +11:00
nghianguyen
8a2e721058
Refactor project structure
2026-03-28 19:56:39 +11:00