Commit Graph

8 Commits

Author SHA1 Message Date
Alex Bezdieniezhnykh 24442869c0 fix queue update 2025-05-02 17:45:30 +03:00
Alex Bezdieniezhnykh 472ed6533e fix hardware service 2025-05-02 13:25:33 +03:00
Alex Bezdieniezhnykh e9a44e368d autoconvert tensor rt engine from onnx to specific CUDA gpu 2025-04-24 16:30:21 +03:00
Alex Bezdieniezhnykh e798af470b read cdn yaml config from api
automate tensorrt model conversion in case of no existing one for user's gpu
2025-04-23 23:20:08 +03:00
Alex Bezdieniezhnykh 277aaf09b0 throttle reimplemented 2025-04-17 09:16:34 +03:00
Alex Bezdieniezhnykh 0c66607ed7 failsafe load dlls
add user config queue offsets
throttle improvements
2025-04-17 01:19:48 +03:00
Alex Bezdieniezhnykh ca1682a86e add gps matcher service 2025-04-14 09:50:34 +03:00
Alex Bezdieniezhnykh 6429ad62c2 refactor external clients
put model batch size as parameter in config
2025-03-24 00:33:41 +02:00