Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[VitisAI] Int4 support #22850

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

[VitisAI] Int4 support #22850

wants to merge 1 commit into from
+80 −8

Conversation

BoarQing
Copy link
Contributor

@BoarQing BoarQing commented Nov 15, 2024 •
edited
Loading

Description

  1. Add support for throwing error when hardware is not supported for VitisAI.
  2. Add support for unloading VitisAI EP.
  3. Add API for Win25.

Motivation and Context

This is requirement for Win25

@BoarQing BoarQing force-pushed the int4_support branch 4 times, most recently from 6182f6e to c6788f3 Compare December 4, 2024 03:42
@BoarQing BoarQing force-pushed the int4_support branch 3 times, most recently from c3590af to 7daf90e Compare December 14, 2024 10:51
@BoarQing BoarQing changed the title Int4 support [VitisAI] Int4 support Dec 14, 2024
@BoarQing BoarQing marked this pull request as ready for review December 14, 2024 10:53
@BoarQing
Copy link
Contributor Author

@jywu-msft I have accumulated a few things due to the slow progress of VitisAI open source. Could you review this? This is required for Win25 Release.

@jywu-msft
Copy link
Member

/azp run Linux CPU CI Pipeline, Linux CPU Minimal Build E2E CI Pipeline, Linux GPU CI Pipeline, Linux GPU TensorRT CI Pipeline, Linux OpenVINO CI Pipeline, MacOS CI Pipeline, ONNX Runtime Web CI Pipeline, onnxruntime-binary-size-checks-ci-pipeline, Linux QNN CI Pipeline

@azure-pipelines Azure Pipelines
Copy link

Pull request contains merge conflicts.

@jywu-msft
Copy link
Member

/azp run Windows ARM64 QNN CI Pipeline, Windows CPU CI Pipeline, Windows GPU TensorRT CI Pipeline, Windows x64 QNN CI Pipeline, orttraining-linux-ci-pipeline, orttraining-linux-gpu-ci-pipeline

@azure-pipelines Azure Pipelines
Copy link

Pull request contains merge conflicts.

@jywu-msft
Copy link
Member

/azp run Big Models, Linux Android Emulator QNN CI Pipeline, Windows GPU CUDA CI Pipeline, Windows GPU DML CI Pipeline, Windows GPU Doc Gen CI Pipeline

@azure-pipelines Azure Pipelines
Copy link

Pull request contains merge conflicts.

@BoarQing
Copy link
Contributor Author

/azp run Big Models, Linux Android Emulator QNN CI Pipeline, Windows GPU CUDA CI Pipeline, Windows GPU DML CI Pipeline, Windows GPU Doc Gen CI Pipeline

Hi, I have resolved the conflect.

@jywu-msft
Copy link
Member

/azp run Linux CPU CI Pipeline, Linux CPU Minimal Build E2E CI Pipeline, Linux GPU CI Pipeline, Linux GPU TensorRT CI Pipeline, Linux OpenVINO CI Pipeline, MacOS CI Pipeline, ONNX Runtime Web CI Pipeline, onnxruntime-binary-size-checks-ci-pipeline, Linux QNN CI Pipeline

@jywu-msft
Copy link
Member

/azp run Windows ARM64 QNN CI Pipeline, Windows CPU CI Pipeline, Windows GPU TensorRT CI Pipeline, Windows x64 QNN CI Pipeline, orttraining-linux-ci-pipeline, orttraining-linux-gpu-ci-pipeline

1 similar comment
@jywu-msft
Copy link
Member

/azp run Windows ARM64 QNN CI Pipeline, Windows CPU CI Pipeline, Windows GPU TensorRT CI Pipeline, Windows x64 QNN CI Pipeline, orttraining-linux-ci-pipeline, orttraining-linux-gpu-ci-pipeline

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 4 pipeline(s).

1 similar comment
@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 4 pipeline(s).

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 9 pipeline(s).

@jywu-msft
Copy link
Member

@BoarQing please fix lint error https://github.com/microsoft/onnxruntime/actions/runs/12369885814/job/34542672292?pr=22850

@BoarQing
Copy link
Contributor Author

@BoarQing please fix lint error https://github.com/microsoft/onnxruntime/actions/runs/12369885814/job/34542672292?pr=22850

Hi, I wasn't aware of the lint update that caused the lint error. I am sorry about it. The lint issue is resolved now.

@jywu-msft
Copy link
Member

/azp run Linux CPU CI Pipeline, Linux CPU Minimal Build E2E CI Pipeline, Linux GPU CI Pipeline, Linux GPU TensorRT CI Pipeline, Linux OpenVINO CI Pipeline, MacOS CI Pipeline, ONNX Runtime Web CI Pipeline, onnxruntime-binary-size-checks-ci-pipeline, Linux QNN CI Pipeline

@jywu-msft
Copy link
Member

/azp run Windows ARM64 QNN CI Pipeline, Windows CPU CI Pipeline, Windows GPU TensorRT CI Pipeline, Windows x64 QNN CI Pipeline, orttraining-linux-ci-pipeline, orttraining-linux-gpu-ci-pipeline

@jywu-msft
Copy link
Member

/azp run Big Models, Linux Android Emulator QNN CI Pipeline, Windows GPU CUDA CI Pipeline, Windows GPU DML CI Pipeline, Windows GPU Doc Gen CI Pipeline

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 4 pipeline(s).

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 9 pipeline(s).

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 5 pipeline(s).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@BoarQing @jywu-msft