Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Transformer model CUDA EP align with CPU on corner case #9889

Merged
merged 2 commits into from
Feb 3, 2022

Conversation

wangyems
Copy link
Contributor

Description: Describe your changes.
In some transformer models the cuda op sometimes takes input with no data.
This may be one of the normal cases(unlikely though) and should not throw any errors(like cpu does).
return Status::OK after output type and shape is determined.

Motivation and Context

@wangyems wangyems merged commit bb09acf into master Feb 3, 2022
@wangyems wangyems deleted the wangye/layernorm2 branch February 3, 2022 20:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Optimization changes the graph so it cannot run on Cuda
3 participants