Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Pepr Load Test ( Reconcile()-based ) Nightly CI #1431

Closed
2 of 3 tasks
btlghrants opened this issue Nov 18, 2024 · 2 comments
Closed
2 of 3 tasks

Pepr Load Test ( Reconcile()-based ) Nightly CI #1431

btlghrants opened this issue Nov 18, 2024 · 2 comments
Assignees
@btlghrants
Labels
Testing Testing
Milestone
v0.40.0

Comments

@btlghrants
Copy link
Collaborator

btlghrants commented Nov 18, 2024 •
edited
Loading

Request

Add a nightly CI job to test Pepr controller's resource usage under moderate load.

Background

Relates #1350

Follow on work to run the new load test scripts in CI, nightly.

Definition of done

  • A nightly CI workflow
  • Workflow result includes artifacts containing load test data files & generated graphs
  • ( nope --> ) test graph displayed as part of $GITHUB_STEP_SUMMARY (if possible).
@btlghrants btlghrants added Testing Testing and removed tech-debt labels Nov 18, 2024
@btlghrants btlghrants moved this from 🆕 New to 🏗 In progress in Pepr Project Board Nov 18, 2024
@btlghrants btlghrants added this to the v0.40.0 milestone Nov 18, 2024
@btlghrants btlghrants self-assigned this Nov 18, 2024
@btlghrants btlghrants mentioned this issue Nov 18, 2024
Merged
5 tasks
cmwylie19 pushed a commit that referenced this issue Nov 18, 2024
@btlghrants
test: run load test nightly (#1434)
f4aa736 
## Description

Workflow config to run the Pepr Load Tests nightly.

## Related Issue

Relates to #1431

## Type of change

- [ ] Bug fix (non-breaking change which fixes an issue)
- [ ] New feature (non-breaking change which adds functionality)
- [x] Other (security config, docs update, etc)

## Checklist before merging
- [x] Unit,
[Journey](https://github.com/defenseunicorns/pepr/tree/main/journey),
[E2E Tests](https://github.com/defenseunicorns/pepr-excellent-examples),
[docs](https://github.com/defenseunicorns/pepr/tree/main/docs),
[adr](https://github.com/defenseunicorns/pepr/tree/main/adr) added or
updated as needed
- [x] [Contributor Guide
Steps](https://docs.pepr.dev/main/contribute/#submitting-a-pull-request)
followed
@btlghrants btlghrants mentioned this issue Nov 18, 2024
Merged
5 tasks
cmwylie19 pushed a commit that referenced this issue Nov 18, 2024
@btlghrants
test: updated artifact retention (#1435)
4a89bb0 
## Description

Updates artifact retention period.

## Related Issue

Relates to #1431

## Type of change

- [ ] Bug fix (non-breaking change which fixes an issue)
- [ ] New feature (non-breaking change which adds functionality)
- [x] Other (security config, docs update, etc)

## Checklist before merging
- [x] Unit,
[Journey](https://github.com/defenseunicorns/pepr/tree/main/journey),
[E2E Tests](https://github.com/defenseunicorns/pepr-excellent-examples),
[docs](https://github.com/defenseunicorns/pepr/tree/main/docs),
[adr](https://github.com/defenseunicorns/pepr/tree/main/adr) added or
updated as needed
- [x] [Contributor Guide
Steps](https://docs.pepr.dev/main/contribute/#submitting-a-pull-request)
followed
@btlghrants
Copy link
Collaborator Author

btlghrants commented Nov 19, 2024 •
edited
Loading

Load test ran overnight and has generated an appropriate dataset + graph: https://github.com/defenseunicorns/pepr/actions/runs/11906627631

Have a snag on trying to get the graph png to render in GH UI via the $GITHUB_STEPS_SUMMARY facility though: because the only persistent place the png lives is as a workflow artifact, and GH only exposes artifacts as .zips, I can't link to it as an image directly (i.e. '', or '<img src=''" />').

Also, looks like GH won't honor data URIs so I can't seem to find a way to sneak the picture into the output markdown, so... going to call this one as done as it can be. Going to have to chat other ideas about for easily-accessible graphs through with the team.

@btlghrants btlghrants moved this from 🏗 In progress to 👀 In review in Pepr Project Board Nov 19, 2024
@btlghrants btlghrants mentioned this issue Nov 19, 2024
Merged
5 tasks
btlghrants added a commit that referenced this issue Nov 19, 2024
@btlghrants
test: double load test load volume (#1443)
6ac06d9 
## Description

Make the load tests _go harder_; trying to see a GC cycle in resulting
graph.

## Related Issue

Relates to #1431 

## Type of change

- [ ] Bug fix (non-breaking change which fixes an issue)
- [ ] New feature (non-breaking change which adds functionality)
- [x] Other (security config, docs update, etc)

## Checklist before merging
- [x] Unit,
[Journey](https://github.com/defenseunicorns/pepr/tree/main/journey),
[E2E Tests](https://github.com/defenseunicorns/pepr-excellent-examples),
[docs](https://github.com/defenseunicorns/pepr/tree/main/docs),
[adr](https://github.com/defenseunicorns/pepr/tree/main/adr) added or
updated as needed
- [x] [Contributor Guide
Steps](https://docs.pepr.dev/main/contribute/#submitting-a-pull-request)
followed
@btlghrants btlghrants mentioned this issue Nov 19, 2024
Merged
5 tasks
btlghrants added a commit that referenced this issue Nov 19, 2024
@btlghrants
test: more load (#1445)
74c2707 
## Description

Bumping the load test intensity again.

## Related Issue

Relates to #1431

## Type of change

- [ ] Bug fix (non-breaking change which fixes an issue)
- [ ] New feature (non-breaking change which adds functionality)
- [x] Other (security config, docs update, etc)

## Checklist before merging
- [x] Unit,
[Journey](https://github.com/defenseunicorns/pepr/tree/main/journey),
[E2E Tests](https://github.com/defenseunicorns/pepr-excellent-examples),
[docs](https://github.com/defenseunicorns/pepr/tree/main/docs),
[adr](https://github.com/defenseunicorns/pepr/tree/main/adr) added or
updated as needed
- [x] [Contributor Guide
Steps](https://docs.pepr.dev/main/contribute/#submitting-a-pull-request)
followed
@cmwylie19
Copy link
Collaborator

done in #1445

@github-project-automation github-project-automation bot moved this from 🏗 In progress to ✅ Done in Pepr Project Board Nov 20, 2024
@btlghrants btlghrants mentioned this issue Nov 21, 2024
Merged
5 tasks
github-merge-queue bot pushed a commit that referenced this issue Nov 21, 2024
@btlghrants
test: overlay requests/second onto load test graph (#1470)
3d6c811 
## Description

Based on some team conversation, this PR adds a plot of the "requests
per second" on top of the watcher load test memory graph.

## Related Issue

Relates to #1431 

## Type of change

- [ ] Bug fix (non-breaking change which fixes an issue)
- [ ] New feature (non-breaking change which adds functionality)
- [x] Other (security config, docs update, etc)

## Checklist before merging
- [x] Unit,
[Journey](https://github.com/defenseunicorns/pepr/tree/main/journey),
[E2E Tests](https://github.com/defenseunicorns/pepr-excellent-examples),
[docs](https://github.com/defenseunicorns/pepr/tree/main/docs),
[adr](https://github.com/defenseunicorns/pepr/tree/main/adr) added or
updated as needed
- [x] [Contributor Guide
Steps](https://docs.pepr.dev/main/contribute/#submitting-a-pull-request)
followed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@btlghrants btlghrants

Labels
Testing Testing
Projects
Pepr Project Board
Archived in project
Milestone
v0.40.0
Development

No branches or pull requests
2 participants
@cmwylie19 @btlghrants