You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe what should be investigated or refactored
The current e2e tests are large and require a certain amount of knowledge of Zarf and its code base to run. After spending some time getting the tests to run as a new Zarf user I have identified some friction points which could easily be addressed.
The dependencies documentation does not specify that Docker and buildx are required dependencies. While it could be assumed that most people will have Docker installed, they may not have buildx installed.
The tests assume, unless run in appliance mode that access to a Kubernetes cluster is properly configured. A check exists but it does not seem to do anything as it does not check the error. This results in errors much later, which wastes time and becomes harder to decipher.
It would be nice to have a minimal test run documented to make it easy to verify that the e2e tests can run, as it would take a long time for all the tests to run completely.
A lot of these tests seem to have little impact on each other, even those that are running against a cluster. While some test cases are marked to run in parallel some are not. This should probably be explored further to speed up test runs.
It could be good to move the test images from Docker Hub to GHCR to reduce the risk of rate limiting occurring when running the e2e locally multiple times in a day.
The text was updated successfully, but these errors were encountered:
Describe what should be investigated or refactored
The current e2e tests are large and require a certain amount of knowledge of Zarf and its code base to run. After spending some time getting the tests to run as a new Zarf user I have identified some friction points which could easily be addressed.
https://github.com/defenseunicorns/zarf/blob/0fa217351e6b75e4f5b18df6e3096797ee767b8c/site/src/content/docs/contribute/testing.mdx?plain=1#L13-L15
https://github.com/defenseunicorns/zarf/blob/0fa217351e6b75e4f5b18df6e3096797ee767b8c/src/test/common.go#L57-L62
It would be nice to have a minimal test run documented to make it easy to verify that the e2e tests can run, as it would take a long time for all the tests to run completely.
A lot of these tests seem to have little impact on each other, even those that are running against a cluster. While some test cases are marked to run in parallel some are not. This should probably be explored further to speed up test runs.
It could be good to move the test images from Docker Hub to GHCR to reduce the risk of rate limiting occurring when running the e2e locally multiple times in a day.
The text was updated successfully, but these errors were encountered: