-
Notifications
You must be signed in to change notification settings - Fork 2.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Integration tests for docker mode #335
Conversation
Signed-off-by: Simarpreet Singh <[email protected]>
Signed-off-by: Simarpreet Singh <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Almost looks good to me! You will add a setting of CircleCI in a dedicated PR, right? Or, we can add it to this PR.
Signed-off-by: Simarpreet Singh <[email protected]>
5680cd8
to
0bc1c75
Compare
Signed-off-by: Simarpreet Singh <[email protected]>
…rity/trivy into integration-tests-docker-engine
04c8e0d
to
f875ef8
Compare
Signed-off-by: Simarpreet Singh <[email protected]>
f875ef8
to
8a9293a
Compare
Signed-off-by: Simarpreet Singh <[email protected]>
Signed-off-by: Simarpreet Singh <[email protected]>
Signed-off-by: Simarpreet Singh <[email protected]>
…rity/trivy into integration-tests-docker-engine
@knqyf263 I added four different versions of docker setups here 923bd79 keep in mind each of them takes on average ~4min to complete. I picked these versions because they are evenly spaced in the supported versions list. Maybe we can add more? Keep in mind we're only limited to 4x jobs running in parallel on circleci. Currently it's 1 for unit test and 4 for integration-tests that get run on each push. Also there's a 2500 credit limit (not sure how this actually boils down). |
Interestingly enough you can see some of the docker versions currently fail with the version of the client we're using 😰 https://circleci.com/workflow-run/61cb32c7-de96-4cdc-a34a-5b12b50d92cc One example:
|
Hmm... It's weird as the test passes with 17.03.0-ce. I wonder if the maximum client is not implemented in 17.03.0-ce. So, our integration tests may work only with 18.09.03 in CircleCI. For now, it seems better that we give up running integration tests with multiple Docker Engine and just run them with 18.09.03. |
…uasecurity/trivy into integration-tests-docker-engine
* wip: run trivy after adding image Signed-off-by: Simarpreet Singh <[email protected]> * integration: Add an integration test for docker mode Signed-off-by: Simarpreet Singh <[email protected]> * integration: Add error checks for docker_engine_test Signed-off-by: Simarpreet Singh <[email protected]> * circleci: add specific docker version Signed-off-by: Simarpreet Singh <[email protected]> * circleci: add specific docker version Signed-off-by: Simarpreet Singh <[email protected]> * docker_engine_test: Add a sad path Signed-off-by: Simarpreet Singh <[email protected]> * circleci: Add docker_version by param Signed-off-by: Simarpreet Singh <[email protected]> * circleci: Add more docker versions Signed-off-by: Simarpreet Singh <[email protected]> * test(integration): remove old docker versions * chore(ci): add requires Co-authored-by: Teppei Fukuda <[email protected]>
* wip: run trivy after adding image Signed-off-by: Simarpreet Singh <[email protected]> * integration: Add an integration test for docker mode Signed-off-by: Simarpreet Singh <[email protected]> * integration: Add error checks for docker_engine_test Signed-off-by: Simarpreet Singh <[email protected]> * circleci: add specific docker version Signed-off-by: Simarpreet Singh <[email protected]> * circleci: add specific docker version Signed-off-by: Simarpreet Singh <[email protected]> * docker_engine_test: Add a sad path Signed-off-by: Simarpreet Singh <[email protected]> * circleci: Add docker_version by param Signed-off-by: Simarpreet Singh <[email protected]> * circleci: Add more docker versions Signed-off-by: Simarpreet Singh <[email protected]> * test(integration): remove old docker versions * chore(ci): add requires Co-authored-by: Teppei Fukuda <[email protected]>
…apters test: add tests for aws sns tf adapters
This PR introduces integrations tests for docker mode.
Addresses #325
Signed-off-by: Simarpreet Singh [email protected]