Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

shampoo optim support #1919

Open
wants to merge 9 commits into
base: main
Choose a base branch
from
Open

shampoo optim support #1919

wants to merge 9 commits into from

Commits on Sep 18, 2024

  1. wip shampoo optim support

    @winglian
    winglian committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    eb3eab3 View commit details
    Browse the repository at this point in the history

  2. additional grafting config types and basic example doc

    @winglian
    winglian committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    52e6249 View commit details
    Browse the repository at this point in the history

  3. fixes

    @winglian
    winglian committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    5334d0f View commit details
    Browse the repository at this point in the history

  4. remove accidental duplidcated line

    @winglian
    winglian committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    05f61a0 View commit details
    Browse the repository at this point in the history

  5. ensure epsilon is cast to float

    @winglian
    winglian committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    84dad0b View commit details
    Browse the repository at this point in the history

  6. fix casting of optim args

    @winglian
    winglian committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    69a2938 View commit details
    Browse the repository at this point in the history

  7. ddp shampoo

    @winglian
    winglian committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    beaee36 View commit details
    Browse the repository at this point in the history

  8. setup precision config for bf16

    @winglian
    winglian committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    992ea51 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. shampoo checkpoint save workaround

    @winglian
    winglian committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    17330c0 View commit details
    Browse the repository at this point in the history