Skip to content

Pull requests: vllm-project/vllm

New pull request New
380 Open 4,471 Closed
380 Open 4,471 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[v1][WIP] Metrics & Stats prototype
#10651 opened Nov 26, 2024 by rickyyx • Draft
2
[Core] Integrate Fastsafetensor loader for loading model weights ci/build documentation Improvements or additions to documentation
#10647 opened Nov 26, 2024 by manish-sethi • Draft
1
Check bnb_4bit_quant_storage for bitsandbytes
#10642 opened Nov 25, 2024 by mgoin Loading…
1
[V1] VLM - Support running the mm_mapper preprocessor in the frontend process frontend needs-rebase
#10640 opened Nov 25, 2024 by alexm-neuralmagic Loading…
@alexm-neuralmagic
11
[Frontend] don't block event loop in tokenization (preprocess) in OpenAI compatible server frontend
#10635 opened Nov 25, 2024 by tomeras91 Loading…
12
[Misc] Allow LoRA to adaptively increase rank and remove possible_max_ranks
#10623 opened Nov 25, 2024 by JinhyunBang Loading…
5
[core] improve cpu offloading implementation
#10609 opened Nov 24, 2024 by youkaichao • Draft
6
[Core][Bugfix] Use correct device to initialize GPU data during CUDA-graph-capture
#10608 opened Nov 24, 2024 by IdoAsraff Loading…
1
[fix] Correct num_accepted_tokens counting ready ONLY add when PR is ready to merge/full CI is needed
#10604 opened Nov 24, 2024 by KexinFeng Loading…
5
[Misc]Further reduce BNB static variable
#10597 opened Nov 24, 2024 by jeejeelee • Draft
2 tasks
2
[Interleaved ATTN] Support for Mistral-8B
#10591 opened Nov 23, 2024 by patrickvonplaten Loading…
6
[Kernel] Remove hard-dependencies of Speculative decode to CUDA workers ready ONLY add when PR is ready to merge/full CI is needed
#10587 opened Nov 23, 2024 by xuechendi Loading…
12
[WIP] V1 LoRA support needs-rebase
#10579 opened Nov 22, 2024 by varun-sundar-rabindranath • Draft
5
[Core] Update to outlines > 0.1.4 ci/build
#10576 opened Nov 22, 2024 by russellb • Draft
3
[ Kernels ] [ AMD ] Add Fused MoE Configs
#10574 opened Nov 22, 2024 by robertgshaw2-neuralmagic • Draft
1
[V1] Refactor model executable interface for multimodal models
#10570 opened Nov 22, 2024 by ywang96 Loading…
14 tasks done
@DarkLight1337
10
[Hardware][Intel-Gaudi] Enable LoRA support for Intel Gaudi (HPU)
#10565 opened Nov 22, 2024 by SanjuCSudhakaran Loading…
4
[Model] Added GLM-4 series hf format model support vllm==0.6.4
#10561 opened Nov 22, 2024 by sixsixcoder Loading…
4
[Benchmark] Benchmark structured output with datasets
#10557 opened Nov 22, 2024 by xuechendi Loading…
4
[Docs] Add dedicated tool calling page to docs documentation Improvements or additions to documentation
#10554 opened Nov 21, 2024 by mgoin Loading…
5
[Misc] Enable vLLM to Dynamically Load LoRA from a Remote Server frontend
#10546 opened Nov 21, 2024 by angkywilliam Loading…
7
[Distributed] Tensor Parallel RMSNorm
#10542 opened Nov 21, 2024 by tlrmchlsmth • Draft
2
Add Sageattention backend
#10532 opened Nov 21, 2024 by flozi00 Loading…
3
[core] overhaul memory profiling and fix backward compatibility needs-rebase
#10511 opened Nov 21, 2024 by youkaichao Loading…
1
8
Turn on V1 for H200 build ci/build perf-benchmarks
#10505 opened Nov 21, 2024 by simon-mo Loading…
1
ProTip! Exclude everything labeled bug with -label:bug.