Set up e2e tests

[jperl]

Resolves #216

To Do

• set up CI
• add test attributes & update tests

[jperl]

@markphelps This is a WIP PR, I will follow up shortly with the remaining TODOs. I started with two basic e2e tests, creating a flag and create a segment.

I am also recording a video as I set it up, in case you are interested in the process. This is the first video https://www.youtube.com/watch?v=Wa6MFqrf0Nc

[jperl]

Pt. 2 of the setup video: https://www.youtube.com/watch?v=5r8k14MT-O0

It now runs the tests against the docker image in CI.

You can download or watch a video of the tests in the artifacts.

I will work on updating the ui to have test attributes tomorrow.

[markphelps]

This is amazing. Thank you @jperl and I love the videos. What screen capture program do you use?

[jperl]

We built playwright-video which uses Chrome DevTools screencast to collect the images, and ffmpeg to construct the video.

[jperl]

@markphelps I updated the front end to have test attributes where needed to improve the selectors. QA Wolf will automatically find these attributes and use them as selectors.

The tests pass locally, but the GitHub action needs to run the latest code instead of the latest docker for them to pass.

[jperl]

What screen capture program do you use?

I probably misunderstood this :). The youtube videos I livestream with OBS.

[markphelps]

@jperl awesome thank you so much for your hard work! will check it out this evening and merge

When you say:

The tests pass locally, but the GitHub action needs to run the latest code instead of the latest docker for them to pass.

Do you mean that the current Docker image doesnt the required dependencies that you install here?

[markphelps]

@all-contributors please add @jperl for test and code

[allcontributors]

@markphelps

I've put up a pull request to add @jperl! 🎉

[jperl]

Do you mean that the current Docker image doesnt the required dependencies that you install here?

No, rather the GitHub action currently spins up the docker image instead of running the server and front end from the latest code, and the tests run against that. That should be easy to change.

[markphelps]

Oh gotcha. Yah i'll fix that this weekend. Thanks again for adding these tests!!!

[jperl]

My pleasure. Happy to help adding more just let me know.