mirror of
https://github.com/azaion/annotations.git
synced 2026-04-22 13:26:30 +00:00
move python inference to Azaion.Inference folder
This commit is contained in:
@@ -0,0 +1,58 @@
|
||||
<h2>Azaion AI</h2>
|
||||
|
||||
<p>
|
||||
Azaion AI is a worker written on cython (c-compilable python) which listens to socket and rabbit queue.
|
||||
It accepts commands om a format:
|
||||
|
||||
- CommandType: Inference / Load
|
||||
- Filename
|
||||
|
||||
And correspondingly do inference or just load encrypted file from the API.
|
||||
Results (file or annotations) is putted to the other queue, or the same socket, depending on the command source.
|
||||
</p>
|
||||
|
||||
<h2>Installation</h2>
|
||||
|
||||
<h3>Install libs</h3>
|
||||
https://www.python.org/downloads/
|
||||
|
||||
Windows
|
||||
|
||||
- [Install CUDA](https://developer.nvidia.com/cuda-12-1-0-download-archive)
|
||||
|
||||
Linux
|
||||
```
|
||||
sudo apt install nvidia-driver-535
|
||||
|
||||
wget https://developer.download.nvidia.com/compute/cudnn/9.2.0/local_installers/cudnn-local-repo-ubuntu2204-9.2.0_1.0-1_amd64.deb
|
||||
sudo dpkg -i cudnn-local-repo-ubuntu2204-9.2.0_1.0-1_amd64.deb
|
||||
|
||||
sudo cp /var/cudnn-local-repo-ubuntu2204-9.2.0/cudnn-*-keyring.gpg /usr/share/keyrings/
|
||||
sudo apt-get update
|
||||
sudo apt-get -y install cudnn nvidia-cuda-toolkit -y
|
||||
nvcc --version
|
||||
```
|
||||
|
||||
|
||||
<h3>Install dependencies</h3>
|
||||
1. Install python with max version 3.11. Pytorch for now supports 3.11 max
|
||||
|
||||
Make sure that your virtual env is installed with links to the global python packages and headers, like this:
|
||||
```
|
||||
python -m venv --system-site-packages venv
|
||||
```
|
||||
This is crucial for the build because build needs Python.h header and other files.
|
||||
|
||||
```
|
||||
python -m pip install --upgrade pip
|
||||
pip install opencv-python cython msgpack cryptography rstream pika zmq pyjwt pyinstaller tensorboard
|
||||
```
|
||||
In case of fbgemm.dll error (Windows specific):
|
||||
|
||||
- copypaste libomp140.x86_64.dll to C:\Windows\System32
|
||||
|
||||
|
||||
<h3>Build</h3>
|
||||
```
|
||||
python setup.py build_ext --inplace
|
||||
```
|
||||
Reference in New Issue
Block a user