Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Skip fuse_mm_elementwise fusion with model output in the middle #1000

Closed
wants to merge 1 commit into from
Closed

Skip fuse_mm_elementwise fusion with model output in the middle #1000

wants to merge 1 commit into from

Commits on Apr 19, 2024

  1. Skip fuse_mm_elementwise fusion with model output in the middle (face… 

    …bookincubator#1000)

Summary:

`fuse_mm_elementwise` transformation fuses linear patterns into single ops. As a result, all intermediate outputs in the pattern are eliminated. In a special case when one or more of those intermediate outputs are model outputs, this leads to those model outputs vanishing after the fusion. Here we add skipping the fusion when one of the intermediate outputs in the detected pattern is a model output.

Reviewed By: mengyingdu

Differential Revision: D56340320
    @aakhundov @facebook-github-bot
    aakhundov authored and facebook-github-bot committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    7b7ce77 View commit details
    Browse the repository at this point in the history