Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

disable the EP context embed model by default in session option #23070

Merged
merged 1 commit into from
Dec 12, 2024

Conversation

HectorSVC
Copy link
Contributor

change the default value for session option ep.context_embed_mode to 0 to avoid the model loading memory overhead

…0 since it avoid the model loading memory overhead
@HectorSVC HectorSVC added ep:OpenVINO issues related to OpenVINO execution provider ep:TensorRT issues related to TensorRT execution provider ep:VitisAI issues related to Vitis AI execution provider ep:QNN issues related to QNN exeution provider labels Dec 11, 2024
@HectorSVC HectorSVC merged commit ebb968d into main Dec 12, 2024
95 checks passed
@HectorSVC HectorSVC deleted the sess_option_embed_mode_default_value branch December 12, 2024 01:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ep:OpenVINO issues related to OpenVINO execution provider ep:QNN issues related to QNN exeution provider ep:TensorRT issues related to TensorRT execution provider ep:VitisAI issues related to Vitis AI execution provider
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants