Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature: inbuilt benchmarks #10

Open
omeh-a opened this issue Mar 5, 2023 · 1 comment
Open

Feature: inbuilt benchmarks #10

omeh-a opened this issue Mar 5, 2023 · 1 comment
Labels
enhancement New feature or request

Comments

@omeh-a
Copy link
Member

omeh-a commented Mar 5, 2023

Currently, ipbench only has the inbuilt capability to run single tests. This is not terribly useful. At TS we get around this with big scripts which run the tests and assemble the data.

To foreign users, this is one of the big hurdles that prevents ipbench from being useful straight out of the gate. Competing ip benchmarking programs are all capable of running complete benchmarks "right out of the box". Even for us here, there are different scripts used by different members and this creates lots of needless complexity and frustration.

Goal: premade benchmarks either as:
a. A set up easy to use, understand and extend scripts
b. A core feature of ipbench -> e.g. ipbench --bench latency-throughput

@omeh-a
Copy link
Member Author

omeh-a commented Mar 20, 2023

It would make a lot more sense to bundle this functionality into a separate program called something like ipbench-test - this way the philosophy of the core ipbench system remains unchanged. This would be useful for debugging too - especially if #11 was combined into this functionality. E.g. to run a sanity check on new features, ipbench-test --localtest might locally spin up a tester daemon + controller and target a local echo server silently.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant