Linux

CUDA

Compatible with NVIDIA graphic cards:

conda install conda-forge::cuda-runtime=12.6.3 conda-forge::cudnn=9.3.0.75

TensorRT

Suitable for high performance NVIDIA graphic cards:

pip install tensorrt==10.6.0 --extra-index-url https://pypi.nvidia.com

ROCm

Compatible with AMD graphic cards:

curl --output amdgpu-install-6.3.1.deb https://repo.radeon.com/amdgpu-install/6.3.1/ubuntu/jammy/amdgpu-install_6.3.60301-1_all.deb

dpkg --install amdgpu-install-6.3.1.deb

conda install conda-forge::rocm-smi=6.1.2

OpenVINO

Compatible with Intel graphic cards:

conda install conda-forge::openvino=2024.5.0