Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

register custom op for flash attn and use from torch.ops #7536

Merged
merged 18 commits into from
Aug 16, 2024
Merged

register custom op for flash attn and use from torch.ops #7536

merged 18 commits into from
Aug 16, 2024

Commits on Aug 14, 2024

  1. register

    @youkaichao
    youkaichao committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    8649a5b View commit details
    Browse the repository at this point in the history

  2. use

    @youkaichao
    youkaichao committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    c2c8ca6 View commit details
    Browse the repository at this point in the history

  3. use

    @youkaichao
    youkaichao committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    679b18a View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2024

  1. manually mutate all

    @youkaichao
    youkaichao committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    94a39cc View commit details
    Browse the repository at this point in the history

  2. manually mutate all tensors

    @youkaichao
    youkaichao committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    bdbbe76 View commit details
    Browse the repository at this point in the history

  3. add tests

    @youkaichao
    youkaichao committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    5b64f2d View commit details
    Browse the repository at this point in the history

  4. add tests

    @youkaichao
    youkaichao committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    9d97f7b View commit details
    Browse the repository at this point in the history

  5. change import

    @youkaichao
    youkaichao committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    506eed5 View commit details
    Browse the repository at this point in the history

  6. update tests

    @youkaichao
    youkaichao committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    d9105aa View commit details
    Browse the repository at this point in the history

  7. change args

    @youkaichao
    youkaichao committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    f827ad3 View commit details
    Browse the repository at this point in the history

  8. change import

    @youkaichao
    youkaichao committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    f0fe288 View commit details
    Browse the repository at this point in the history

  9. rename

    @youkaichao
    youkaichao committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    8c322b0 View commit details
    Browse the repository at this point in the history

  10. fix register fake

    @youkaichao
    youkaichao committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    755dbaf View commit details
    Browse the repository at this point in the history

  11. add opcheck

    @youkaichao
    youkaichao committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    fc2a4c2 View commit details
    Browse the repository at this point in the history

  12. fix alibi_slopes

    @youkaichao
    youkaichao committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    495d2f0 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2024

  1. update mutates_args

    @youkaichao
    youkaichao committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    76c5cec View commit details
    Browse the repository at this point in the history

  2. add schema tests

    @youkaichao
    youkaichao committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    45bb131 View commit details
    Browse the repository at this point in the history

  3. reduce number of heads to avoid OOM

    @youkaichao
    youkaichao committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    ee8d426 View commit details
    Browse the repository at this point in the history