Popular repositories Loading

1. onnxruntime onnxruntime Public

   Forked from microsoft/onnxruntime

   ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

   C++

2. neural-compressor neural-compressor Public

   Forked from intel/neural-compressor

   Intel® Neural Compressor (formerly known as Intel® Low Precision Optimization Tool), targeting to provide unified APIs for network compression technologies, such as low precision quantization, spar…

   Python

3. transformers transformers Public

   Forked from huggingface/transformers

   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

   Python

4. streaming-llm streaming-llm Public

   Forked from mit-han-lab/streaming-llm

   Efficient Streaming Language Models with Attention Sinks

   Python

5. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

6. ipex-llm ipex-llm Public

   Forked from intel-analytics/ipex-llm

   Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, Phi, MiniCPM, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc,…

   Python