Skip to content

Pull requests: sgl-project/sglang

New pull request New
58 Open 2,121 Closed
58 Open 2,121 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

added amd_configure.md to references
#3275 opened Feb 3, 2025 by zstreet87 Loading…
1 of 4 tasks
Update server args doc
#3273 opened Feb 3, 2025 by simveit • Draft
support blockwise fp8 matmul kernel
#3267 opened Feb 3, 2025 by yizhang2077 Loading…
4 tasks
2
Update metrics documentation
#3264 opened Feb 2, 2025 by binarycrayon Loading…
2 of 4 tasks
7
Draft of updated doc for sampling params.
#3260 opened Feb 2, 2025 by simveit • Draft
feat: Support Qwen 2.5 vl
#3258 opened Feb 2, 2025 by mickqian Loading…
3 of 4 tasks
1
[Docs] add quantization docs
#3253 opened Feb 1, 2025 by yinfan98 Loading…
4 tasks
2
[ROCm] Enable Fused MLA Triton kernel for DeepSeekV3
#3237 opened Jan 31, 2025 by lcskrishna • Draft
@HaiShaw
docs(references/deepseek): current section links
#3225 opened Jan 31, 2025 by guspan-tanadi Loading…
4 tasks
Add support for nvidia modelopt fp8 kv cache
#3223 opened Jan 30, 2025 by Edwardf0t1 Loading…
1 of 4 tasks
Online serving benchmarks of real datasets for hierarchical KV caching
#3211 opened Jan 30, 2025 by PanJason Loading…
5 tasks
@xiezhq-hermann
Specify torch==2.5.1 in pyproject.toml
#3210 opened Jan 30, 2025 by merrymercy Loading…
add support instructions for AMD GPUs
#3208 opened Jan 29, 2025 by Beichen-Ma Loading…
2 of 4 tasks
4
feat: Support Janus-pro
#3203 opened Jan 29, 2025 by mickqian Loading…
3 of 4 tasks
@yizhang2077
5
Draft support for reasoning_content in API
#3202 opened Jan 29, 2025 by tot0 Loading…
4 tasks
Fixing a typo engine.py
#3193 opened Jan 28, 2025 by didier-durand Loading…
Add deepseek_v3 fused gate
#3191 opened Jan 28, 2025 by NovTi Loading…
@ispobock @BBuf @zhyncs
20
Add logit bias into the SGLang interface.
#3187 opened Jan 27, 2025 by cinjon Loading…
4 tasks
17
[Feature] Rewrite Sampling Parameter #3165
#3185 opened Jan 27, 2025 by tongyu0924 Loading…
Initial Enablement of CI on MI300
#3168 opened Jan 27, 2025 by saienduri Loading…
@HaiShaw @saienduri
2
[Feature] Define backends and add Triton backend for Lora
#3161 opened Jan 27, 2025 by Fridge003 Loading…
4 tasks done
Apply sgl w8a8 fp8 kernel high priority
#3148 opened Jan 26, 2025 by HandH1998 Loading…
@ispobock @zhyncs
2
[MOE] Try to optimize moe align block size multiblocks cuda kernel
#3137 opened Jan 26, 2025 by yiakwy-xpu-ml-framework-team • Draft
8 tasks
2
fix: Fix deprecated max_tokens param in openai ChatCompletionRequest
#3122 opened Jan 25, 2025 by mickqian Loading…
3 of 4 tasks
10
Add EngineFragment
#3120 opened Jan 25, 2025 by fzyzcjy Loading…
4 tasks
ProTip! Type g i on any issue or pull request to go back to the issue listing page.