Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix the initialization of the cache when we have multi gpu #33303

Merged
merged 12 commits into from
Sep 13, 2024
Merged

Fix the initialization of the cache when we have multi gpu #33303

merged 12 commits into from
Sep 13, 2024

Commits on Sep 4, 2024

  1. init cache multi-gpu

    @SunMarc
    SunMarc committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    2381f30 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. Update src/transformers/generation/utils.py 

    Co-authored-by: Joao Gante <[email protected]>
    @SunMarc @gante
    SunMarc and gante authored Sep 5, 2024
    Configuration menu
    Copy the full SHA
    080bc81 View commit details
    Browse the repository at this point in the history

  2. switch to execution device map

    @SunMarc
    SunMarc committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    011bf49 View commit details
    Browse the repository at this point in the history

  3. naming more consistant

    @SunMarc
    SunMarc committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    4bcefd5 View commit details
    Browse the repository at this point in the history

  4. fix

    @SunMarc
    SunMarc committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    ef89cf6 View commit details
    Browse the repository at this point in the history

  5. mutually exclusive device

    @SunMarc
    SunMarc committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    8cdff4f View commit details
    Browse the repository at this point in the history

  6. added an integration example

    @SunMarc
    SunMarc committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    fdccf82 View commit details
    Browse the repository at this point in the history

  7. remove useless check

    @SunMarc
    SunMarc committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    1c08706 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. suggestion from joao + typing

    @SunMarc
    SunMarc committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    74af9c6 View commit details
    Browse the repository at this point in the history

  2. fix couple of typo and add test

    @SunMarc
    SunMarc committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    6bb5daa View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. revert check

    @SunMarc
    SunMarc committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    61f5baa View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into init-multi-gpu-cache

    @SunMarc
    SunMarc committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    b426e7b View commit details
    Browse the repository at this point in the history