Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(perf): add (provision, build, run) tooling #163

Merged
merged 102 commits into from
May 26, 2023
Merged

feat(perf): add (provision, build, run) tooling #163

merged 102 commits into from
May 26, 2023

Commits on Mar 16, 2023

  1. WIP readme with thoughts

    @MarcoPolo
    MarcoPolo committed Mar 16, 2023
    Configuration menu
    Copy the full SHA
    a26aada View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2023

  1. Add example data

    @MarcoPolo
    MarcoPolo committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    ac3bba3 View commit details
    Browse the repository at this point in the history

  2. Fix example data

    @MarcoPolo
    MarcoPolo committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    dcd44bf View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2023

  1. Extend example data

    @MarcoPolo
    MarcoPolo committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    cd66695 View commit details
    Browse the repository at this point in the history

  2. Add dashboard link

    @MarcoPolo
    MarcoPolo committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    b75cb3b View commit details
    Browse the repository at this point in the history

  3. Update readme

    @MarcoPolo
    MarcoPolo committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    343b2e5 View commit details
    Browse the repository at this point in the history

  4. Update readme

    @MarcoPolo
    MarcoPolo committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    3e45f54 View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2023

  1. Remove wrong schema file

    @MarcoPolo
    MarcoPolo committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    8d94c83 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2023

  1. feat: add basic provision script for client and server perf 

    See `perf/README.md`.
    @mxinden
    mxinden committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    22bb337 View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2023

  1. Check in .terraform.lock.hcl

    @mxinden
    mxinden committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    2d36ba1 View commit details
    Browse the repository at this point in the history

  2. Spin up server in us-west-1 and client in us-east-1

    @mxinden
    mxinden committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    7fa9f82 View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2023

  1. feat: introduce runner

    @mxinden
    mxinden committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    9361069 View commit details
    Browse the repository at this point in the history

  2. fix(.gitignore): don't include public keys

    @mxinden
    mxinden committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    7358746 View commit details
    Browse the repository at this point in the history

  3. Minor refactorings

    @mxinden
    mxinden committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    8545b01 View commit details
    Browse the repository at this point in the history

  4. Small addition to perf readme

    @mxinden
    mxinden committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    2abcf7b View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2023

  1. Introduce download and upload benchmarks

    @mxinden
    mxinden committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    4f2d7f9 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2023

  1. Add Go impl

    @MarcoPolo
    MarcoPolo committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    f0e98f6 View commit details
    Browse the repository at this point in the history

  2. Run client in host network

    @mxinden
    mxinden committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    16dfcc1 View commit details
    Browse the repository at this point in the history

  3. Add Golang docker image to runner

    @mxinden
    mxinden committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    32699db View commit details
    Browse the repository at this point in the history

  4. fix(go): only print final result to stdout

    @mxinden
    mxinden committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    2f3c425 View commit details
    Browse the repository at this point in the history

  5. fix(go): use si units (i.e. here s)

    @mxinden
    mxinden committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    c9f12ec View commit details
    Browse the repository at this point in the history

  6. Provide server peer id to client

    @mxinden
    mxinden committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    99b2f46 View commit details
    Browse the repository at this point in the history

  7. Use entrypoint convention and provide secret key seed

    @mxinden
    mxinden committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    43500ef View commit details
    Browse the repository at this point in the history

  8. Update to latest container images

    @mxinden
    mxinden committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    e0fa1f4 View commit details
    Browse the repository at this point in the history

  9. Remove stray println

    @MarcoPolo
    MarcoPolo committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    4f207d6 View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2023

  1. Seed Go secret key from command line and fix server invocation

    @mxinden
    mxinden committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    8229e2b View commit details
    Browse the repository at this point in the history

  2. Start server image based on client image

    @mxinden
    mxinden committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    9038224 View commit details
    Browse the repository at this point in the history

  3. Set new golang image

    @mxinden
    mxinden committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    7ab94c8 View commit details
    Browse the repository at this point in the history

  4. Bump UDP receive buffer

    @mxinden
    mxinden committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    2433338 View commit details
    Browse the repository at this point in the history

  5. Update to latest rust image using tokio

    @mxinden
    mxinden committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    2480f04 View commit details
    Browse the repository at this point in the history

  6. chore: update the link to the interop dashboard [skip ci]

    @github-actions @MarcoPolo
    github-actions[bot] authored and MarcoPolo committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    e5d6b55 View commit details
    Browse the repository at this point in the history

  7. fix(versions): disable webrtc tests (libp2p#160) 

    This commit disables the WebRTC tests for rust-libp2p v0.50.0 and v0.51.0 and
chromium-js v0.41.0 and v0.42.0. Neither of these support the new
`/webrtc-direct` (see
multiformats/multiaddr#150 for
context on rename).

The missing support is blocking libp2p/rust-libp2p#3688
namely to upgrade to using `/webrtc-direct`. (Note that this is only blocking
CI. Users can already use `/webrtc-direct` with the latest released
rust-libp2p.)

We will backport `/webrtc-direct` support to the rust-libp2p `v0.51.0` interop
binary and then re-enable it here.

Instead of disabling the versions with missing support for `/webrtc-direct` we
could as well patch our interoperability test logic. For the sake of simplicity,
I am proposing simply disabling the versions for now.
    @mxinden @MarcoPolo
    mxinden authored and MarcoPolo committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    ab88ee6 View commit details
    Browse the repository at this point in the history

  8. chore: update the link to the interop dashboard [skip ci]

    @github-actions @MarcoPolo
    github-actions[bot] authored and MarcoPolo committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    f29026c View commit details
    Browse the repository at this point in the history

  9. Fix: Correctly abort process on timeout (libp2p#162) 

    * Pass in abort controller signal

* Rearrange
    @MarcoPolo
    MarcoPolo committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    87be6b7 View commit details
    Browse the repository at this point in the history

  10. chore: update the link to the interop dashboard [skip ci]

    @github-actions @MarcoPolo
    github-actions[bot] authored and MarcoPolo committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    aa227bf View commit details
    Browse the repository at this point in the history

  11. Sanitize name before saving to compose file (libp2p#164)

    @MarcoPolo
    MarcoPolo committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    61ad33a View commit details
    Browse the repository at this point in the history

  12. chore: update the link to the interop dashboard [skip ci]

    @github-actions @MarcoPolo
    github-actions[bot] authored and MarcoPolo committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    31349d3 View commit details
    Browse the repository at this point in the history

  13. Cache images slightly differently (libp2p#165)

    @MarcoPolo
    MarcoPolo committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    e7728b6 View commit details
    Browse the repository at this point in the history

  14. chore: update the link to the interop dashboard [skip ci]

    @github-actions @MarcoPolo
    github-actions[bot] authored and MarcoPolo committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    70169e6 View commit details
    Browse the repository at this point in the history

  15. Update readme

    @MarcoPolo
    MarcoPolo committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    5ad7338 View commit details
    Browse the repository at this point in the history

  16. Always build when doing npm run start

    @MarcoPolo
    MarcoPolo committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    31c6da5 View commit details
    Browse the repository at this point in the history

  17. Save benchmark results

    @MarcoPolo
    MarcoPolo committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    2ce3daa View commit details
    Browse the repository at this point in the history

  18. Add implementation

    @MarcoPolo
    MarcoPolo committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    95cc2af View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2023

  1. Change to m5n.8xlarge with 25 Gbit 

    Had to change to us-west-2 as m5n.8xlarge was not available in us-west-1.
    @mxinden
    mxinden committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    ce6f969 View commit details
    Browse the repository at this point in the history

  2. Update to latest rust container image

    @mxinden
    mxinden committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    bbde59e View commit details
    Browse the repository at this point in the history

  3. Add changes for zig-libp2p

    @MarcoPolo
    MarcoPolo committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    7baa39c View commit details
    Browse the repository at this point in the history

  4. Test 100MiB

    @MarcoPolo
    MarcoPolo committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    0a8c201 View commit details
    Browse the repository at this point in the history

  5. Add **very** basic Go HTTPS implementation

    @mxinden
    mxinden committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    5d01b2a View commit details
    Browse the repository at this point in the history

  6. Fix versions.ts adding sha256: to other images

    @mxinden
    mxinden committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    d559bb3 View commit details
    Browse the repository at this point in the history

  7. Update rust to set tcp nodelay on server

    @mxinden
    mxinden committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    0dbdf2d View commit details
    Browse the repository at this point in the history

  8. fix(https): don't randomize before write

    @mxinden
    mxinden committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    32bcc2a View commit details
    Browse the repository at this point in the history

  9. fix(go-libp2p-perf): return error

    @mxinden
    mxinden committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    2cceb89 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2023

  1. Update versions.ts

    @MarcoPolo
    MarcoPolo committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    fc32953 View commit details
    Browse the repository at this point in the history

  2. Add hack

    @MarcoPolo
    MarcoPolo committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    41ec5fe View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2023

  1. Build and transfer docker image

    @mxinden
    mxinden committed Apr 24, 2023
    Configuration menu
    Copy the full SHA
    8c58889 View commit details
    Browse the repository at this point in the history

  2. Remove server entry point in favor of --run-server flag

    @mxinden
    mxinden committed Apr 24, 2023
    Configuration menu
    Copy the full SHA
    9686211 View commit details
    Browse the repository at this point in the history

  3. Allow ICMP to test MTU

    @mxinden
    mxinden committed Apr 24, 2023
    Configuration menu
    Copy the full SHA
    760b241 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' of https://github.com/libp2p/test-plans into pe… 

    …rf-terraform
    @mxinden
    mxinden committed Apr 24, 2023
    Configuration menu
    Copy the full SHA
    02d5c2b View commit details
    Browse the repository at this point in the history

  5. Move perf-dashboard to perf/dashboard

    @mxinden
    mxinden committed Apr 24, 2023
    Configuration menu
    Copy the full SHA
    efe7f6e View commit details
    Browse the repository at this point in the history

  6. Adjust single connection benchmark behavior

    @mxinden
    mxinden committed Apr 24, 2023
    Configuration menu
    Copy the full SHA
    75d7634 View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2023

  1. Commit benchmark-results.json

    @mxinden
    mxinden committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    274e62b View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2023

  1. Don't ignore unit

    @mxinden
    mxinden committed Apr 28, 2023
    Configuration menu
    Copy the full SHA
    6dfb186 View commit details
    Browse the repository at this point in the history

  2. Measure connection establishment + 1 byte round trip latencies

    @mxinden
    mxinden committed Apr 28, 2023
    Configuration menu
    Copy the full SHA
    a265a2d View commit details
    Browse the repository at this point in the history

  3. Fix units

    @mxinden
    mxinden committed Apr 28, 2023
    Configuration menu
    Copy the full SHA
    0732aa8 View commit details
    Browse the repository at this point in the history

  4. Fix unit again

    @mxinden
    mxinden committed Apr 28, 2023
    Configuration menu
    Copy the full SHA
    618805c View commit details
    Browse the repository at this point in the history

Commits on May 1, 2023

  1. Rename ssh key from mxinden to perf

    @mxinden
    mxinden committed May 1, 2023
    Configuration menu
    Copy the full SHA
    c2831cc View commit details
    Browse the repository at this point in the history

  2. Pass IP and not multiaddr to client binary

    @mxinden
    mxinden committed May 1, 2023
    Configuration menu
    Copy the full SHA
    fb214bc View commit details
    Browse the repository at this point in the history

Commits on May 4, 2023

  1. Build on machines & run outside of Docker 

    - Build binaries on remote machines. This e.g. enables Mac users to use the
  tooling without additional steps.
- Don't use Docker to run perf binaries. Instead run the binaries right away.
  Removes a layer of potential performance degradation.
    @mxinden
    mxinden committed May 4, 2023
    Configuration menu
    Copy the full SHA
    00cd434 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2023

  1. fix(perf/https): use duration Seconds()

    @mxinden
    mxinden committed May 8, 2023
    Configuration menu
    Copy the full SHA
    d1b7d00 View commit details
    Browse the repository at this point in the history

  2. fix(perf/go-libp2p): use duration Seconds()

    @mxinden
    mxinden committed May 8, 2023
    Configuration menu
    Copy the full SHA
    17a0d1d View commit details
    Browse the repository at this point in the history

  3. fix: use uint64 for command line flags

    @mxinden
    mxinden committed May 8, 2023
    Configuration menu
    Copy the full SHA
    1f87937 View commit details
    Browse the repository at this point in the history

  4. Move schema tool and remove test data

    @mxinden
    mxinden committed May 8, 2023
    Configuration menu
    Copy the full SHA
    14cde8c View commit details
    Browse the repository at this point in the history

  5. Remove commented out code

    @mxinden
    mxinden committed May 8, 2023
    Configuration menu
    Copy the full SHA
    6ef0d6c View commit details
    Browse the repository at this point in the history

  6. Improve perf/README

    @mxinden
    mxinden committed May 8, 2023
    Configuration menu
    Copy the full SHA
    b21af98 View commit details
    Browse the repository at this point in the history

  7. Replace RSA with eliptic curve

    @mxinden
    mxinden committed May 8, 2023
    Configuration menu
    Copy the full SHA
    fa41f02 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2023

  1. Increase iterations and commit results

    @mxinden
    mxinden committed May 10, 2023
    Configuration menu
    Copy the full SHA
    e1d6810 View commit details
    Browse the repository at this point in the history

Commits on May 11, 2023

  1. Document command line flags in perf/README

    @mxinden
    mxinden committed May 11, 2023
    Configuration menu
    Copy the full SHA
    2964b82 View commit details
    Browse the repository at this point in the history

  2. Remove perf/dashboard

    @mxinden
    mxinden committed May 11, 2023
    Configuration menu
    Copy the full SHA
    1498fc1 View commit details
    Browse the repository at this point in the history

  3. Remove --n-times flag 

    Dead code as of now. Potentially to be reintroduced in future iterations.
    @mxinden
    mxinden committed May 11, 2023
    Configuration menu
    Copy the full SHA
    909217e View commit details
    Browse the repository at this point in the history

  4. Rename rust-libp2p v0.51 to v0.52 

    Version on rust-libp2p `perf` branch changed in the meantime.
    @mxinden
    mxinden committed May 11, 2023
    Configuration menu
    Copy the full SHA
    0e7c64e View commit details
    Browse the repository at this point in the history

  5. Add rust-libp2p v0.52-quinn based on upstream quinn 

    Uses libp2p/rust-libp2p#3454
    @mxinden
    mxinden committed May 11, 2023
    Configuration menu
    Copy the full SHA
    6fa2b00 View commit details
    Browse the repository at this point in the history

Commits on May 12, 2023

  1. Add quic-go v0.34

    @mxinden
    mxinden committed May 12, 2023
    Configuration menu
    Copy the full SHA
    9ed7f1a View commit details
    Browse the repository at this point in the history

Commits on May 15, 2023

  1. simplify code for the HTTPS perf impl

    @marten-seemann
    marten-seemann committed May 15, 2023
    Configuration menu
    Copy the full SHA
    d6a7cd1 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2023

  1. Run ping and iperf and commit results

    @mxinden
    mxinden committed May 17, 2023
    Configuration menu
    Copy the full SHA
    eff32de View commit details
    Browse the repository at this point in the history

  2. Move rust-libp2p quinn from being different version to different impl… 

    …ementation
    @mxinden
    mxinden committed May 17, 2023
    Configuration menu
    Copy the full SHA
    8ff591f View commit details
    Browse the repository at this point in the history

Commits on May 18, 2023

  1. fix(quic-go): use upstream 

    With quic-go/perf#5 and
quic-go/perf#4 one can use the upstream implementation directly.
    @mxinden
    mxinden committed May 18, 2023
    Configuration menu
    Copy the full SHA
    9b3d61a View commit details
    Browse the repository at this point in the history

Commits on May 19, 2023

  1. Have rsync adhere to .gitignore

    @mxinden
    mxinden committed May 19, 2023
    Configuration menu
    Copy the full SHA
    a91159b View commit details
    Browse the repository at this point in the history

  2. Change implementation output format 

    - Makes emited values self-describing.
- Ensures accounting of connection establishment.
- Allows differentiation in subsequent data analysis.
    @mxinden
    mxinden committed May 19, 2023
    Configuration menu
    Copy the full SHA
    c5de2c7 View commit details
    Browse the repository at this point in the history

  3. Update benchmark-results.json

    @mxinden
    mxinden committed May 19, 2023
    Configuration menu
    Copy the full SHA
    b1408bd View commit details
    Browse the repository at this point in the history

  4. Fix field names

    @mxinden
    mxinden committed May 19, 2023
    Configuration menu
    Copy the full SHA
    ce94834 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2023

  1. fix(go-libp2p): use tls only 

    Use TLS only instead of both TLS and Noise. Removes the additional
multistream-select security protocol negotiation. Thus makes it easier to
compare with TCP+TLS+HTTP/2
    @mxinden
    mxinden committed May 23, 2023
    Configuration menu
    Copy the full SHA
    388886f View commit details
    Browse the repository at this point in the history

  2. List results last 

    Makes the JSON easier to read.
    @mxinden
    mxinden committed May 23, 2023
    Configuration menu
    Copy the full SHA
    23ed486 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2023

  1. fix(runner): trust ssh host key

    @mxinden
    mxinden committed May 24, 2023
    Configuration menu
    Copy the full SHA
    fd8a878 View commit details
    Browse the repository at this point in the history

  2. fix(go-libp2p): don't wait for identify round trip

    @mxinden
    mxinden committed May 24, 2023
    Configuration menu
    Copy the full SHA
    e1a49da View commit details
    Browse the repository at this point in the history

  3. fix(quic-go): update to latest upstream

    @mxinden
    mxinden committed May 24, 2023
    Configuration menu
    Copy the full SHA
    89302ef View commit details
    Browse the repository at this point in the history

  4. Udate benchmark results json

    @mxinden
    mxinden committed May 24, 2023
    Configuration menu
    Copy the full SHA
    c05e6d6 View commit details
    Browse the repository at this point in the history

  5. fix(go-libp2p): don't wait for identify when dialing

    @mxinden
    mxinden committed May 24, 2023
    Configuration menu
    Copy the full SHA
    9ad921e View commit details
    Browse the repository at this point in the history

  6. Add comments

    @mxinden
    mxinden committed May 24, 2023
    Configuration menu
    Copy the full SHA
    71fde9d View commit details
    Browse the repository at this point in the history

  7. Parse --server-address in client mode

    @mxinden
    mxinden committed May 24, 2023
    Configuration menu
    Copy the full SHA
    28c590b View commit details
    Browse the repository at this point in the history

  8. Log building implementations on servers

    @mxinden
    mxinden committed May 24, 2023
    Configuration menu
    Copy the full SHA
    d2d1c2b View commit details
    Browse the repository at this point in the history

  9. fix(go-libp2p): use NewWithoutDefaults to disable Noise

    @mxinden
    mxinden committed May 24, 2023
    Configuration menu
    Copy the full SHA
    f6b968a View commit details
    Browse the repository at this point in the history

Commits on May 25, 2023

  1. Commit latest results

    @mxinden
    mxinden committed May 25, 2023
    Configuration menu
    Copy the full SHA
    2cca4a0 View commit details
    Browse the repository at this point in the history