Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bugfix] revert #8491 #163

Closed
wants to merge 35 commits into from
Closed

[Bugfix] revert #8491 #163

wants to merge 35 commits into from

Conversation

dtrifiro
Copy link

Revert "[Bugfix] Bind api server port before starting engine (vllm-project#8491)"

this causes the http server to always error out:

ERROR:    [Errno 98] error while attempting to bind on address ('0.0.0.0', 8000): address already in use

Isotr0py and others added 30 commits September 13, 2024 06:35
@Isotr0py
[CI/Build] Enable InternVL2 PP test only on single node (vllm-project…
9b4a3b2 
…#8437)
@youkaichao
[doc] recommend pip instead of conda (vllm-project#8446)
cab69a1
@jeejeelee
[Misc] Skip loading extra bias for Qwen2-VL GPTQ-Int8 (vllm-project#8442
06311e2 
)
@youkaichao
[misc][ci] fix quant test (vllm-project#8449)
a246912
@DarkLight1337
[Installation] Gate FastAPI version for Python 3.8 (vllm-project#8456)
ecd7a1d
@youkaichao
[plugin][torch.compile] allow to add custom compile backend (vllm-pro…
0a4806f 
…ject#8445)
@DarkLight1337
[CI/Build] Reorganize models tests (vllm-project#7820)
a84e598
@Isotr0py
[Doc] Add oneDNN installation to CPU backend documentation (vllm-proj…
f57092c 
…ect#8467)
@njhill
[HotFix] Fix final output truncation with stop string + streaming (vl…
18e9e1f 
…lm-project#8468)
@simon-mo
bump version to v0.6.1.post2 (vllm-project#8473)
9ba0817
@jikunshang @yma11
[Hardware][intel GPU] bump up ipex version to 2.3 (vllm-project#8365)
8517252 
Co-authored-by: Yan Ma <[email protected]>
@charlifu
[Kernel][Hardware][Amd]Custom paged attention kernel for rocm (vllm-p…
1ef0d2e 
…roject#8310)
@SUDA-HLT-ywfang @DarkLight1337
[Model] support minicpm3 (vllm-project#8297)
8a0cf1d 
Co-authored-by: DarkLight1337 <[email protected]>
@youkaichao
[torch.compile] fix functionalization (vllm-project#8480)
a36e070
@youkaichao
[torch.compile] add a flag to disable custom op (vllm-project#8488)
47790f3
@WoosukKwon
[TPU] Implement multi-step scheduling (vllm-project#8489)
50e9ec4
@chrisociepa
[Bugfix][Model] Fix Python 3.8 compatibility in Pixtral model by upda…
3724d5f 
…ting type annotations (vllm-project#8490)
@Isotr0py
[Bugfix][Kernel] Add IQ1_M quantization implementation to GGUF kern…
fc990f9 
…el (vllm-project#8357)
@ElizaWszola @dsikka
[Kernel] Enable 8-bit weights in Fused Marlin MoE (vllm-project#8032)
a091e2d 
Co-authored-by: Dipika <[email protected]>
@lewtun
[Frontend] Expose revision arg in OpenAI server (vllm-project#8501)
837c196
@njhill
[BugFix] Fix clean shutdown issues (vllm-project#8492)
acd5511
@sasha0552
[Bugfix][Kernel] Fix build for sm_60 in GGUF kernel (vllm-project#8506)
781e3b9
@ProExpertProg
[Kernel] AQ AZP 3/4: Asymmetric quantization kernels (vllm-project#7270)
5d73ae4
@youkaichao
[doc] update doc on testing and debugging (vllm-project#8514)
2759a43
@kevin314
[Bugfix] Bind api server port before starting engine (vllm-project#8491)
47f5e03
@simon-mo
[perf bench] set timeout to debug hanging (vllm-project#8516)
5478c4b
@simon-mo
[misc] small qol fixes for release process (vllm-project#8517)
5ce45eb
@joerunde
[Bugfix] Fix 3.12 builds on main (vllm-project#8510)
cca6164 
Signed-off-by: Joe Runde <[email protected]>
@simon-mo
[refactor] remove triton based sampler (vllm-project#8524)
546034b
@alex-jw-brooks
[Frontend] Improve Nullable kv Arg Parsing (vllm-project#8525)
1c1bb38 
Signed-off-by: Alex-Brooks <[email protected]>
@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Sep 17, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: dtrifiro

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@dtrifiro dtrifiro mentioned this pull request Sep 17, 2024
Merged
@openshift-merge-robot
Copy link

PR needs rebase.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@dtrifiro
Copy link
Author

Opened upstream instead

@dtrifiro dtrifiro closed this Sep 17, 2024
Xaenalt pushed a commit that referenced this pull request Sep 18, 2024
@kzawora-intel
Revert "Allocate blocks from id=1 for HPU (#160)" (#163)
37ca17f 
This reverts commit b43c7f9.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@NickLucche NickLucche Awaiting requested review from NickLucche

@Xaenalt Xaenalt Awaiting requested review from Xaenalt

Assignees
No one assigned
Labels
approved needs-rebase
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.