The NVIDIA CUDA® Deep Neural Network library (cuDNN) is a GPU-accelerated library of primitives for deep neural networks.
Build instructions for those who are curious
$ wget https://developer.download.nvidia.com/compute/cudnn/redist/cudnn/linux-x86_64/cudnn-linux-x86_64-9.8.0.87_cuda12-archive.tar.xz
$ cd /mnt/nasapps/production
$ tar xf cudnn-linux-x86_64-9.8.0.87_cuda12-archive.tar.xz
$ mv cudnn-linux-x86_64-9.8.0.87_cuda12-archive/ 9.8.0-cuda12
$ wget https://developer.download.nvidia.com/compute/cusparselt/redist/libcusparse_lt/linux-x86_64/libcusparse_lt-linux-x86_64-0.7.1.0-archive.tar.xz
$ tar xf libcusparse_lt-linux-x86_64-0.7.1.0-archive.tar.xz
$ mv libcusparse_lt-linux-x86_64-0.7.1.0-archive/lib/* /mnt/nasapps/production/cudnn/9.8.0-cuda12/lib/
$ mv libcusparse_lt-linux-x86_64-0.7.1.0-archive/include/* /mnt/nasapps/production/cudnn/9.8.0-cuda12/include