Repositories list

• flashinfer

  Public
  FlashInfer: Kernel Library for LLM Serving

  gpucudajit+ 4pytorchllm-inferenceflash-attentionlarge-large-models

  Cuda

  •

  Apache License 2.0

  •185•1.8k•63•9•Updated Jan 24, 2025Jan 24, 2025

• flashinfer-nightly

  Public
  FlashInfer Nightly

  MIT License

  •2•7•1•1•Updated Jan 23, 2025Jan 23, 2025

• llm-based-compression

  Public
  Jupyter Notebook

  •0•2•0•0•Updated Jan 10, 2025Jan 10, 2025

• whl

  Public
  Pre-built wheels for flashinfer python package.

  HTML

  •0•0•0•0•Updated Jan 3, 2025Jan 3, 2025

• flashinfer-ai.github.io

  Public
  Project website of FlashInfer project

  SCSS

  •2•0•0•0•Updated Dec 19, 2024Dec 19, 2024

• web-data

  Public
  Apache License 2.0

  •0•0•0•0•Updated Sep 2, 2024Sep 2, 2024

• debug-print

  Public
  Debug print operator for cudagraph debugging

  Cuda

  •0•10•0•0•Updated Aug 2, 2024Aug 2, 2024

• llvm-project

  Public
  The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.

  Other

  •13k•0•0•0•Updated Apr 21, 2024Apr 21, 2024

• candle

  Public
  Minimalist ML framework for Rust

  Rust

  •

  Apache License 2.0

  •1k•0•0•0•Updated Mar 7, 2024Mar 7, 2024