Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

✨ vLLM Backend integration #42

Open
wants to merge 19 commits into
base: parfeniukink/features/deepsparse-backend
Choose a base branch
from
Open

✨ vLLM Backend integration #42

wants to merge 19 commits into from

Commits on Aug 30, 2024

  1. 🚚 Better naming is provided 

    * backend/test_openai_backend.py -> backend/test_openai.py
* backend/test_deepsparse_backend.py -> backend/test_deepsparse.py
    Dmytro Parfeniuk committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    5e93c1f View commit details
    Browse the repository at this point in the history

  2. ✨ vllm backend integration is added 

    not tested
    Dmytro Parfeniuk committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    cea679e View commit details
    Browse the repository at this point in the history

  3. ✅ vllm tests are skipped if platform is not Linux

    Dmytro Parfeniuk committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    440d4be View commit details
    Browse the repository at this point in the history

  4. 📌 vLLM python version is increased to 3.12

    Dmytro Parfeniuk committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    1a715a6 View commit details
    Browse the repository at this point in the history

  5. 📌 vllm dependency is skipped if platform IS NOT Linux

    Dmytro Parfeniuk committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    14f4c42 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2024

  1. 🚧 WIP

    Dmytro Parfeniuk committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    6e30870 View commit details
    Browse the repository at this point in the history

  2. 🚧 WIP

    Dmytro Parfeniuk committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    b0c0acb View commit details
    Browse the repository at this point in the history

  3. dummy.data.openai is removed

    Dmytro Parfeniuk committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    9f431ea View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. WIP Docker tests

    Dmytro Parfeniuk committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    832b316 View commit details
    Browse the repository at this point in the history

  2. removed tmp file

    Dmytro Parfeniuk committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    3d8c80f View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. Dockerfile remove COPY

    Dmytro Parfeniuk committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    7836d45 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. 🚧 WIP

    Dmytro Parfeniuk committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    defe53d View commit details
    Browse the repository at this point in the history

  2. dockerfile is improved

    Dmytro Parfeniuk committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    9071358 View commit details
    Browse the repository at this point in the history

  3. tests are comlete

    Dmytro Parfeniuk committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    59e4cc6 View commit details
    Browse the repository at this point in the history

  4. docker testing guide is added

    Dmytro Parfeniuk committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    bd76806 View commit details
    Browse the repository at this point in the history

  5. 💚 Code quality is provided

    Dmytro Parfeniuk committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    92c8819 View commit details
    Browse the repository at this point in the history

  6. Dockefile improved. Removed unused parts

    Dmytro Parfeniuk committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    e25be2f View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. ✅ tests are fixed

    Dmytro Parfeniuk committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    809694c View commit details
    Browse the repository at this point in the history

  2. 🐳 --platform is removed from Dockerfile

    Dmytro Parfeniuk committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    78b78ed View commit details
    Browse the repository at this point in the history