Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: mesh topology, distributed all layers. #136

Merged
merged 30 commits into from
Nov 21, 2024
Merged

feat: mesh topology, distributed all layers. #136

merged 30 commits into from
Nov 21, 2024

Commits on Nov 11, 2024

  1. graph network, init.

    @b4rtaz
    b4rtaz committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    9d509cb View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. graph network, first version.

    @b4rtaz
    b4rtaz committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    ce477a6 View commit details
    Browse the repository at this point in the history

  2. packet alignment.

    @b4rtaz
    b4rtaz committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    104eade View commit details
    Browse the repository at this point in the history

  3. so_rcvbuf

    @b4rtaz
    b4rtaz committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    46257d2 View commit details
    Browse the repository at this point in the history

  4. pin thread.

    @b4rtaz
    b4rtaz committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    459c07d View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2024

  1. delete so_rcvbuf

    @b4rtaz
    b4rtaz committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    d2a5919 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into feat/graph-network

    @b4rtaz
    b4rtaz committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    8672137 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into feat/graph-network

    @b4rtaz
    b4rtaz committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    1bfe175 View commit details
    Browse the repository at this point in the history

  4. fix benchmark.

    @b4rtaz
    b4rtaz committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    de1bc09 View commit details
    Browse the repository at this point in the history

  5. debug worker.

    @b4rtaz
    b4rtaz committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    c6ba2d0 View commit details
    Browse the repository at this point in the history

  6. missing stdexcept.

    @b4rtaz
    b4rtaz committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    a899911 View commit details
    Browse the repository at this point in the history

  7. missing cassert.

    @b4rtaz
    b4rtaz committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    c2e8e6d View commit details
    Browse the repository at this point in the history

  8. F

    @b4rtaz
    b4rtaz committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    1e4ab97 View commit details
    Browse the repository at this point in the history

  9. distributed wcls.

    @b4rtaz
    b4rtaz committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    d36e942 View commit details
    Browse the repository at this point in the history

  10. delete buffer.

    @b4rtaz
    b4rtaz committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    e059b6d View commit details
    Browse the repository at this point in the history

  11. reduce ram usage during load.

    @b4rtaz
    b4rtaz committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    0fabc54 View commit details
    Browse the repository at this point in the history

  12. debug.

    @b4rtaz
    b4rtaz committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    89c1406 View commit details
    Browse the repository at this point in the history

  13. fix bug.

    @b4rtaz
    b4rtaz committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    537fee2 View commit details
    Browse the repository at this point in the history

  14. improve matmul in final step.

    @b4rtaz
    b4rtaz committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    842b6f7 View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2024

  1. fix dllama-api.

    @b4rtaz
    b4rtaz committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    62da126 View commit details
    Browse the repository at this point in the history

  2. fix build.

    @b4rtaz
    b4rtaz committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    c743d98 View commit details
    Browse the repository at this point in the history

  3. deleted grok1.

    @b4rtaz
    b4rtaz committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    ca6598a View commit details
    Browse the repository at this point in the history

  4. fix mixtral build.

    @b4rtaz
    b4rtaz committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    7c351dd View commit details
    Browse the repository at this point in the history

  5. fix build.

    @b4rtaz
    b4rtaz committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    4f8087e View commit details
    Browse the repository at this point in the history

  6. fix: test

    @b4rtaz
    b4rtaz committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    c61ac19 View commit details
    Browse the repository at this point in the history

  7. delete --kv-cache-storage arg.

    @b4rtaz
    b4rtaz committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    6e5824a View commit details
    Browse the repository at this point in the history

  8. fix build.

    @b4rtaz
    b4rtaz committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    a42d2e1 View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2024

  1. fix requirements.txt

    @b4rtaz
    b4rtaz committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    dffc23d View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2024

  1. reduce transfer size per token.

    @b4rtaz
    b4rtaz committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    c2c2fa0 View commit details
    Browse the repository at this point in the history

  2. fixed sockets.

    @b4rtaz
    b4rtaz committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    d4dba97 View commit details
    Browse the repository at this point in the history