6 Commits

Author	SHA1	Message	Date
Alex Bezdieniezhnykh	e9a44e368d	autoconvert tensor rt engine from onnx to specific CUDA gpu	2025-04-24 16:30:21 +03:00
Alex Bezdieniezhnykh	e798af470b	read cdn yaml config from api ... automate tensorrt model conversion in case of no existing one for user's gpu	2025-04-23 23:20:08 +03:00
Alex Bezdieniezhnykh	277aaf09b0	throttle reimplemented	2025-04-17 09:16:34 +03:00
Alex Bezdieniezhnykh	0c66607ed7	failsafe load dlls ... add user config queue offsets throttle improvements	2025-04-17 01:19:48 +03:00
Alex Bezdieniezhnykh	ca1682a86e	add gps matcher service	2025-04-14 09:50:34 +03:00
Alex Bezdieniezhnykh	6429ad62c2	refactor external clients ... put model batch size as parameter in config	2025-03-24 00:33:41 +02:00