Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[LoRA] allow loras to be loaded with low_cpu_mem_usage. #9510

Merged
merged 32 commits into from
Oct 9, 2024
Merged

[LoRA] allow loras to be loaded with low_cpu_mem_usage. #9510

merged 32 commits into from
Oct 9, 2024

Commits on Sep 24, 2024

  1. allow loras to be loaded with low_cpu_mem_usage.

    @sayakpaul
    sayakpaul committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    d66b858 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. Merge branch 'main' into low-cpu-mem-usage-lora

    @sayakpaul
    sayakpaul authored Sep 25, 2024
    Configuration menu
    Copy the full SHA
    979b949 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into low-cpu-mem-usage-lora

    @sayakpaul
    sayakpaul authored Sep 25, 2024
    Configuration menu
    Copy the full SHA
    019b257 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. add flux support but note https://github.com/huggingface/diffusers/pu… 

    …ll/9510\#issuecomment-2378316687
    @sayakpaul
    sayakpaul committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    9a22fc8 View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2024

  1. resolve conflicts.

    @sayakpaul
    sayakpaul committed Sep 28, 2024
    Configuration menu
    Copy the full SHA
    c1e987a View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. Merge branch 'main' into low-cpu-mem-usage-lora

    @sayakpaul
    sayakpaul authored Oct 7, 2024
    Configuration menu
    Copy the full SHA
    109949c View commit details
    Browse the repository at this point in the history

  2. low_cpu_mem_usage.

    @sayakpaul
    sayakpaul committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    b87eec8 View commit details
    Browse the repository at this point in the history

  3. fix-copies

    @sayakpaul
    sayakpaul committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    d4a1fbf View commit details
    Browse the repository at this point in the history

  4. fix-copies again

    @sayakpaul
    sayakpaul committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    5c831cc View commit details
    Browse the repository at this point in the history

  5. tests

    @sayakpaul
    sayakpaul committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    1131e3d View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. Merge branch 'main' into low-cpu-mem-usage-lora

    @sayakpaul
    sayakpaul authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    aa81605 View commit details
    Browse the repository at this point in the history

  2. _LOW_CPU_MEM_USAGE_DEFAULT_LORA

    @sayakpaul
    sayakpaul committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    3c1acf0 View commit details
    Browse the repository at this point in the history

  3. _peft_version default.

    @sayakpaul
    sayakpaul committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    c45c664 View commit details
    Browse the repository at this point in the history

  4. version checks.

    @sayakpaul
    sayakpaul committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    23fe79e View commit details
    Browse the repository at this point in the history

  5. version check.

    @sayakpaul
    sayakpaul committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    b57bc3a View commit details
    Browse the repository at this point in the history

  6. version check.

    @sayakpaul
    sayakpaul committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    c18e2eb View commit details
    Browse the repository at this point in the history

  7. version check.

    @sayakpaul
    sayakpaul committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    2e13836 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'main' into low-cpu-mem-usage-lora

    @sayakpaul
    sayakpaul authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    bf38333 View commit details
    Browse the repository at this point in the history

  9. require peft 0.13.1.

    @sayakpaul
    sayakpaul committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    efa33e3 View commit details
    Browse the repository at this point in the history

  10. explicitly specify low_cpu_mem_usage=False.

    @sayakpaul
    sayakpaul committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    83701de View commit details
    Browse the repository at this point in the history

  11. docs.

    @sayakpaul
    sayakpaul committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    e88fb06 View commit details
    Browse the repository at this point in the history

  12. transformers version 4.45.2.

    @sayakpaul
    sayakpaul committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    28007f4 View commit details
    Browse the repository at this point in the history

  13. update

    @sayakpaul
    sayakpaul committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    ba5576c View commit details
    Browse the repository at this point in the history

  14. fix

    @sayakpaul
    sayakpaul committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    48641dc View commit details
    Browse the repository at this point in the history

  15. empty

    @sayakpaul
    sayakpaul committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    0ab1d44 View commit details
    Browse the repository at this point in the history

  16. better name initialize_dummy_state_dict.

    @sayakpaul
    sayakpaul committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    ca5a1d5 View commit details
    Browse the repository at this point in the history

  17. Merge branch 'main' into low-cpu-mem-usage-lora

    @sayakpaul
    sayakpaul authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    1c45329 View commit details
    Browse the repository at this point in the history

  18. doc todos.

    @sayakpaul
    sayakpaul committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    95534e6 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2024

  1. Apply suggestions from code review 

    Co-authored-by: Steven Liu <[email protected]>
    @sayakpaul @stevhliu
    sayakpaul and stevhliu authored Oct 9, 2024
    Configuration menu
    Copy the full SHA
    cf4917c View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into low-cpu-mem-usage-lora

    @sayakpaul
    sayakpaul authored Oct 9, 2024
    Configuration menu
    Copy the full SHA
    8f5b0e1 View commit details
    Browse the repository at this point in the history

  3. style

    @sayakpaul
    sayakpaul committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    8ffe3be View commit details
    Browse the repository at this point in the history

  4. fix-copies

    @sayakpaul
    sayakpaul committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    a4eaa42 View commit details
    Browse the repository at this point in the history