Skip to content

Latest commit

 

History

History
6 lines (2 loc) · 415 Bytes

File metadata and controls

6 lines (2 loc) · 415 Bytes

BigDL-LLM INT4 Optimization for Large Language Model on Intel GPUs

You can use optimize_model API to accelerate general PyTorch models on Intel GPUs. This directory contains example scripts to help you quickly get started using BigDL-LLM to run some popular open-source models in the community. Each model has its own dedicated folder, where you can find detailed instructions on how to install and run it.