Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

spline-test tool #82

Open
Nachtfeuer opened this issue Apr 27, 2018 · 0 comments
Open

spline-test tool #82

Nachtfeuer opened this issue Apr 27, 2018 · 0 comments
Labels
enhancement new feature or an enhancement of an existing feature

Comments

@Nachtfeuer
Copy link
Owner

There's a Bash tool bats but I feel that the spline way with yaml would be more comfortable. That's why to considere following new yaml format for testing Bash code:

suite:
   "Verifying that a == b":
      test: |
          echo "hello"
          test 2 == 3
       verify: |
           assert {{ test.output }} == "hello"
           assert {{ test.exit_code }} == 0

Following features:

  • each test (script) is Bash code
  • each verification (script) is Python code
  • is capable to generate TAP report (useful for Jenkins)
  • tests can be filtered (substr search in title: --filter)
  • individual file or files in a path (recursively) with pattern test*.yaml (and test*.yml) will be fetched
  • running tests randomly by default (adjustable seed supported)
  • should be part of spline and so installed with spline
  • support for model as done for spline yaml
  • support for Jinja2 templating (model and env)
  • tests can run in parallell (--parallel)
@Nachtfeuer Nachtfeuer added this to the Milestone 1.11 milestone Jul 3, 2018
@Nachtfeuer Nachtfeuer added the enhancement new feature or an enhancement of an existing feature label Jul 3, 2018
@Nachtfeuer Nachtfeuer removed this from the Milestone 1.11 milestone Aug 19, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement new feature or an enhancement of an existing feature
Projects
None yet
Development

No branches or pull requests

1 participant