Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adds system benchmarks command #1232

Merged
merged 42 commits into from
Jun 22, 2023
Merged
Show file tree
Hide file tree
Changes from 31 commits
Commits
Show all changes
42 commits
Select commit Hold shift + click to select a range
9baf15d
Refactor benchmark command to make it easier to extend
marc-gr Apr 4, 2023
e66cb0e
Add new command and read config
marc-gr Apr 17, 2023
6471a04
Set up service and generator
marc-gr Apr 20, 2023
2c1ca74
Improve policy creation and add docker service deployer
marc-gr Apr 20, 2023
7e9431d
Bump es api version
marc-gr Apr 22, 2023
3ecb122
Add new options
marc-gr Apr 22, 2023
8c7317a
Add new reportable types
marc-gr Apr 22, 2023
1365b73
Collect and report summary metrics
marc-gr Apr 22, 2023
18907a7
Add documentation
marc-gr Apr 24, 2023
eb81501
Add system benchmark test
marc-gr Apr 24, 2023
2a212ee
Save report file
marc-gr Apr 24, 2023
a23cf93
Ensure all data is generated previous to agents being assigned
marc-gr Apr 24, 2023
5b8685f
Save file indented
marc-gr Apr 24, 2023
7a00403
Update readme
marc-gr Apr 24, 2023
6248280
Lint
marc-gr Apr 24, 2023
c2a739c
Make test faster
marc-gr Apr 24, 2023
c31f346
Go back to 7.17 client
marc-gr Apr 24, 2023
100ab02
fix tests
marc-gr Apr 24, 2023
a562da9
Change comments
marc-gr Apr 24, 2023
c40e3f4
Add monitoringenabled option
marc-gr Apr 24, 2023
db19c61
Update report.go
marc-gr Apr 24, 2023
4c6c957
Merge remote-tracking branch 'upstream/main' into system-benchmarks
marc-gr May 11, 2023
8bb217f
Delete outputs.go from kibana
marc-gr Jun 12, 2023
0f14a26
Rename reports payload property
marc-gr Jun 12, 2023
6216dbc
Remove pkg/errors from ingest, kibana, and servicedeployer
marc-gr Jun 12, 2023
fa40496
Amend const and comment
marc-gr Jun 12, 2023
678f402
Avoid overriding configs unadvertedly
marc-gr Jun 12, 2023
73d321c
Change byte replace to strings.Replacer
marc-gr Jun 12, 2023
07867cc
Undo change in report benchmark command
marc-gr Jun 12, 2023
94f8fd4
Merge remote-tracking branch 'upstream/main' into system-benchmarks
marc-gr Jun 12, 2023
fc37e66
Use policy template name to generate input name
marc-gr Jun 12, 2023
c992308
Fix readme
marc-gr Jun 20, 2023
eaf6b75
Add corpora file to report
marc-gr Jun 20, 2023
6e3009e
Cleanup corpora generated data
marc-gr Jun 20, 2023
44d40e7
Merge remote-tracking branch 'upstream/main' into system-benchmarks
marc-gr Jun 20, 2023
42cb4a0
Fix lint error
marc-gr Jun 20, 2023
d226d8d
Fix test package format
marc-gr Jun 20, 2023
83b46b7
Fix lint errors
marc-gr Jun 20, 2023
e6cce98
Fix processor error return
marc-gr Jun 20, 2023
6052777
Merge remote-tracking branch 'upstream/main' into system-benchmarks
marc-gr Jun 22, 2023
2538ae5
Rename folder to accomodate to spec
marc-gr Jun 22, 2023
223e1ac
Add prefix check
marc-gr Jun 22, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 14 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -100,6 +100,12 @@ These benchmarks allow you to benchmark any Ingest Node Pipelines defined by you

For details on how to configure pipeline benchmarks for a package, review the [HOWTO guide](./docs/howto/pipeline_benchmarking.md).

#### System Benchmarks

These benchmarks allow you to benchmark an integration end to end.

For details on how to configure system benchmarks for a package, review the [HOWTO guide](./docs/howto/system_benchmarking.md).

### `elastic-package benchmark generate-corpus`

_Context: package_
Expand All @@ -116,6 +122,12 @@ _Context: package_

Run pipeline benchmarks for the package.

### `elastic-package benchmark system`

_Context: package_

Run system benchmarks for the package.

### `elastic-package build`

_Context: package_
Expand Down Expand Up @@ -324,11 +336,11 @@ The report will show performance differences between both runs.
It is formatted as a Markdown Github comment to use as part of the CI results.


### `elastic-package report benchmark`
### `elastic-package report pipeline-bench`

_Context: package_

Generate a benchmark report comparing local results against ones from another benchmark run.
Generate a pipeline benchmark report comparing local results against ones from another benchmark run.
marc-gr marked this conversation as resolved.
Show resolved Hide resolved

### `elastic-package service`

Expand Down
Loading