Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Explore acceptance testing for SCION Infra servers (and maybe other apps) #1878

Closed
scrye opened this issue Sep 19, 2018 · 0 comments
Closed
Assignees
Milestone

Comments

@scrye
Copy link
Contributor

scrye commented Sep 19, 2018

The goal is to make acceptance testing easy to do for SCION applications, s.t. tests can be quickly added/expanded in the future.

The following should be considered and included in a document describing our acceptance testing methods:

  • How to express the test (e.g., inputs, expected outputs)
  • How to describe the tested system (the systems might be very different; some tests might only need to run a single app, while others need topologies with multiple routers and services)
  • How to drive the test (e.g., bash scripts maybe?)
  • How to run the tested system (e.g., docker might be involved)
  • How to collect data about test results (success/failure, debugging artifacts)
  • How to integrate in CI (if deemed desirable)

While this shares a lot with our current integration tests, we probably need a bit more flexibility for the above.

This is related to #1814 and #1846.

@scrye scrye self-assigned this Sep 19, 2018
@shitz shitz added this to the Sprint #9 milestone Sep 24, 2018
@scrye scrye closed this as completed in 5f0764d Oct 11, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants