Skip to content

Files

Latest commit

30f4b1e · Jan 24, 2025

History

History
This branch is 97 commits behind ModelCloud/GPTQModel:main.

chat

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
Jan 24, 2025
Jan 24, 2025
Jan 24, 2025

Chat CLI

Usage

./run.sh --gpu_id <GPU_ID> --model_path <MODEL_PATH>

--gpu_id: Specifies the GPU ID to use. This maps to the CUDA_VISIBLE_DEVICES environment variable.

--model_path: The file path to the chat model. This must point to a valid model directory or file.