You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We should not allow manual CI steps in PRs. Manual tests are anything that requires the user to look at logs, generally identified via a verification tag in yaml files. For an example see #34614 (Test_TC_TSTAT_4_2.yaml has several manual steps in that PR)
Note that existing tests may already be manual so we cannot blanket-check all files. What we want is:
check against files changed in the PR only
allow a bypass label for the check (we could use a github label or for failing files check for some "why it is bypassed" comment in a specific format)
reject any yaml test files that have the text ^\s*verification: in them.
The text was updated successfully, but these errors were encountered:
We should not allow manual CI steps in PRs. Manual tests are anything that requires the user to look at logs, generally identified via a
verification
tag in yaml files. For an example see #34614 (Test_TC_TSTAT_4_2.yaml has several manual steps in that PR)Note that existing tests may already be manual so we cannot blanket-check all files. What we want is:
^\s*verification:
in them.The text was updated successfully, but these errors were encountered: