Fix vLLM local inference

[jieguangzhou]

Description

Related Issues

Checklist

• Is this code covered by new or existing unit tests or integration tests?
• Did you run make unit-testing and make integration-testing successfully?
• Do new classes, functions, methods and parameters all have docstrings?
• Were existing docstrings updated, if necessary?
• Was external documentation updated, if necessary?

Additional Notes or Comments

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (34830a7) 80.33% compared to head (7e5527a) 80.43%.
Report is 1383 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1670      +/-   ##
==========================================
+ Coverage   80.33%   80.43%   +0.09%     
==========================================
  Files          95      118      +23     
  Lines        6602     8358    +1756     
==========================================
+ Hits         5304     6723    +1419     
- Misses       1298     1635     +337     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.