Files
annotations/Azaion.AI/README.md
T
Alex Bezdieniezhnykh fb11622c32 rewrite inference and file loading to cython
Step 1: can compile
2025-01-15 16:43:56 +02:00

64 lines
1.8 KiB
Markdown

<h2>Azaion AI</h2>
<p>
Azaion AI is a worker written on cython (c-compilable python) which listens to socket and rabbit queue.
It accepts commands om a format:
- CommandType: Inference / Load
- Filename
And correspondingly do inference or just load encrypted file from the API.
Results (file or annotations) is putted to the other queue, or the same socket, depending on the command source.
</p>
<h2>Installation</h2>
<h3>Install libs</h3>
https://www.python.org/downloads/
Windows
- [Install CUDA](https://developer.nvidia.com/cuda-12-1-0-download-archive)
Linux
* ```
sudo apt install nvidia-driver-535
wget https://developer.download.nvidia.com/compute/cudnn/9.2.0/local_installers/cudnn-local-repo-ubuntu2204-9.2.0_1.0-1_amd64.deb
sudo dpkg -i cudnn-local-repo-ubuntu2204-9.2.0_1.0-1_amd64.deb
sudo cp /var/cudnn-local-repo-ubuntu2204-9.2.0/cudnn-*-keyring.gpg /usr/share/keyrings/
sudo apt-get update
sudo apt-get -y install cudnn nvidia-cuda-toolkit -y
nvcc --version
```
<h3>Install dependencies</h3>
```
Make sure that your virtual env is installed with links to the global python packages and headers, like this:
python -m venv --system-site-packages venv
This is crucial for the Build because build needs Python.h header and other files.
python -m pip install --upgrade pip
pip install --upgrade huggingface_hub
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121
pip install git+https://github.com/airockchip/ultralytics_yolov8.git
- or
pip install ultralytics
pip install cython
pip uninstall -y opencv-python
pip install opencv-python
pip install msgpack
```
* fbgemm.dll error (Windows specific)
```
copypaste libomp140.x86_64.dll to C:\Windows\System32
```
<h3>Build</h3>
```
python setup.py build_ext --inplace
```