Linux

CUDA

Compatible with NVIDIA graphic cards:

conda install conda-forge::cuda-runtime=12.4.1 conda-forge::cudnn=9.2.1.18

TensorRT

Suitable for high performance NVIDIA graphic cards:

pip install tensorrt==10.6.0 --extra-index-url https://pypi.nvidia.com

ROCm

Compatible with AMD graphic cards:

apt install rocm
conda install python=3.10 conda-forge::rocm-smi=6.1.2

OpenVINO

Compatible with Intel graphic cards:

conda install conda-forge::openvino=2024.3.0

Last updated