Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make sure rabbitmq set up properly and test env allows reproducibility #825

Merged

Conversation

ikavgo
Copy link
Contributor

@ikavgo ikavgo commented Jun 19, 2022

See rabbitmq/cluster-operator#959

Unfortunately docker doesn't give enough isolation/reproducability and kernel's fs.max-fds makes into containers. Which means our tests/samples can't run on arbitrary systems - i.e. test env not sealed. Please take a look inside linked operator issue.

TODO: Let's decide what are the good values for samples and performance cluster.

cc @coro

Changes

  • 🐛 Limit ERL_MAX_PORTS explicitly, since host's fs.fd-max leaks into containers.

/kind bug

Release Note

Limit ERL_MAX_PORTS explicitly in tests, since host's fs.fd-max leaks into containers. the values provided in samples might be too concervative, please adjust to the taste. 

@knative-prow knative-prow bot added kind/bug Categorizes issue or PR as related to a bug. do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. size/S Denotes a PR that changes 10-29 lines, ignoring generated files. approved Indicates a PR has been approved by an approver from all required OWNERS files. labels Jun 19, 2022
@codecov
Copy link

codecov bot commented Jun 19, 2022

Codecov Report

Merging #825 (6173c52) into main (ef40a92) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #825   +/-   ##
=======================================
  Coverage   71.71%   71.71%           
=======================================
  Files          40       40           
  Lines        2599     2599           
=======================================
  Hits         1864     1864           
  Misses        667      667           
  Partials       68       68           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ef40a92...6173c52. Read the comment docs.

@coro
Copy link

coro commented Jun 21, 2022

This change looks correct from the operator's point of view, and is the workaround that we recommend in rabbitmq/cluster-operator#959. We can't prevent the host from leaking into the RabbitMQ Pods on an operator level, so it's down to the user to limit the max ports on their system via the very widely-used override interface.

@gabo1208
Copy link
Contributor

gabo1208 commented Jun 22, 2022

Also:

  • test/e2e/config/rabbitmqvhost
  • test/performance source and brokers
  • samples/

should be updated right? and the .mds so the user have a doc reference on why this (?)

@ikavgo ikavgo force-pushed the fix-test-service-templates branch from b16320f to 6173c52 Compare June 24, 2022 11:54
@knative-prow knative-prow bot added size/L Denotes a PR that changes 100-499 lines, ignoring generated files. and removed size/S Denotes a PR that changes 10-29 lines, ignoring generated files. labels Jun 24, 2022
@ikavgo
Copy link
Contributor Author

ikavgo commented Jun 24, 2022

Added more. Decided to keep performance tests as is, since 1) they work 2) it's hard to predict what makes sense here, since folks likely would want to play with concurrency parameter.

@ikavgo ikavgo changed the title WIP: Make sure rabbitmq set up properly and test env allows reproducibility Make sure rabbitmq set up properly and test env allows reproducibility Jun 24, 2022
@knative-prow knative-prow bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jun 24, 2022
@ikavgo ikavgo requested review from gab-satchi and gabo1208 and removed request for gab-satchi June 24, 2022 12:10
Copy link
Contributor

@gab-satchi gab-satchi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@knative-prow knative-prow bot added the lgtm Indicates that a PR is ready to be merged. label Jun 24, 2022
@knative-prow
Copy link

knative-prow bot commented Jun 24, 2022

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: gab-satchi, ikvmw

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@knative-prow knative-prow bot merged commit 5a7e3ff into knative-extensions:main Jun 24, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. kind/bug Categorizes issue or PR as related to a bug. lgtm Indicates that a PR is ready to be merged. size/L Denotes a PR that changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants