Linux

CUDA

Compatible with NVIDIA graphic cards:

conda install conda-forge::cuda-runtime=12.8.1 conda-forge::cudnn=9.8.0.87

TensorRT

Suitable for high performance NVIDIA graphic cards:

pip install tensorrt==10.9.0.34 --extra-index-url https://pypi.nvidia.com

ROCm

Compatible with AMD graphic cards:

curl --output amdgpu-install-6.4.0.deb https://repo.radeon.com/amdgpu-install/6.4.0/ubuntu/jammy/amdgpu-install_6.3.60301-1_all.deb

dpkg --install amdgpu-install-6.4.0.deb

conda install conda-forge::rocm-smi=6.1.2 conda-forge::gcc=14.2.0

OpenVINO

Compatible with Intel graphic cards:

conda install conda-forge::openvino=2025.1.0