To install a GPU-enabled cluster there are few mandatory steps to prepare in advance.
Please follow this guide from NVIDIA to install the pre-requisites:
https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html#install-guide
Once you completed the pre-req's you may install everything with the following command:
k3ai apply nvidia-gpu