mirror of
https://github.com/azaion/annotations.git
synced 2026-04-22 11:26:31 +00:00
Alex Bezdieniezhnykh
62 lines
1.8 KiB
Markdown
62 lines
1.8 KiB
Markdown
<h2>Azaion AI</h2>
|
|
|
|
<p>
|
|
Azaion AI is a worker written on cython (c-compilable python) which listens to socket and rabbit queue.
|
|
It accepts commands om a format:
|
|
|
|
- CommandType: Inference / Load
|
|
- Filename
|
|
|
|
And correspondingly do inference or just load encrypted file from the API.
|
|
Results (file or annotations) is putted to the other queue, or the same socket, depending on the command source.
|
|
</p>
|
|
|
|
<h2>Installation</h2>
|
|
|
|
<h3>Install libs</h3>
|
|
https://www.python.org/downloads/
|
|
|
|
Windows
|
|
|
|
- [Install CUDA](https://developer.nvidia.com/cuda-12-1-0-download-archive)
|
|
|
|
Linux
|
|
```
|
|
sudo apt install nvidia-driver-535
|
|
|
|
wget https://developer.download.nvidia.com/compute/cudnn/9.2.0/local_installers/cudnn-local-repo-ubuntu2204-9.2.0_1.0-1_amd64.deb
|
|
sudo dpkg -i cudnn-local-repo-ubuntu2204-9.2.0_1.0-1_amd64.deb
|
|
|
|
sudo cp /var/cudnn-local-repo-ubuntu2204-9.2.0/cudnn-*-keyring.gpg /usr/share/keyrings/
|
|
sudo apt-get update
|
|
sudo apt-get -y install cudnn nvidia-cuda-toolkit -y
|
|
nvcc --version
|
|
```
|
|
|
|
|
|
<h3>Install dependencies</h3>
|
|
Make sure that your virtual env is installed with links to the global python packages and headers, like this:
|
|
```
|
|
python -m venv --system-site-packages venv
|
|
```
|
|
This is crucial for the build because build needs Python.h header and other files.
|
|
|
|
```
|
|
python -m pip install --upgrade pip
|
|
pip install --upgrade huggingface_hub
|
|
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121
|
|
pip install ultralytics
|
|
|
|
pip uninstall -y opencv-python
|
|
pip install opencv-python cython msgpack cryptography rstream
|
|
```
|
|
In case of fbgemm.dll error (Windows specific):
|
|
|
|
- copypaste libomp140.x86_64.dll to C:\Windows\System32
|
|
|
|
|
|
<h3>Build</h3>
|
|
```
|
|
python setup.py build_ext --inplace
|
|
```
|