Linux

CUDA

Compatible with NVIDIA graphic cards:

conda install conda-forge::cuda-runtime=12.6.3 conda-forge::cudnn=9.3.0.75

TensorRT

Suitable for high performance NVIDIA graphic cards:

pip install tensorrt==10.7.0 --extra-index-url https://pypi.nvidia.com

ROCm

Compatible with AMD graphic cards:

apt install rocm
conda install python=3.10 conda-forge::rocm-smi=6.1.2

OpenVINO

Compatible with Intel graphic cards:

conda install conda-forge::openvino=2024.5.0

Last updated