Skip to content

Commit

Permalink
tests: run both eval tests (cli and direct call) for better coverage …
Browse files Browse the repository at this point in the history
…somehow
  • Loading branch information
ErikBjare committed Aug 14, 2024
1 parent cfce130 commit 859efbe
Showing 1 changed file with 1 addition and 3 deletions.
4 changes: 1 addition & 3 deletions tests/test_eval.py
Original file line number Diff line number Diff line change
Expand Up @@ -12,8 +12,6 @@ def test_eval_cli():
result = runner.invoke(
main,
[
"--model",
"openai/gpt-4o",
*test_set,
],
)
Expand All @@ -23,8 +21,8 @@ def test_eval_cli():
assert "correct output" in result.output


# No idea why, but for some reason keeping this leads to better coverage than the above
@pytest.mark.slow
@pytest.mark.eval
def test_eval(test):
"""
This test will be run for each eval in the tests list.
Expand Down

0 comments on commit 859efbe

Please sign in to comment.