Run timeout

[bootstraponline]

Use Case

Sometimes tests hang forever due to FTL outages or an issue in the test. Currently Flank only supports a shard level timeout. Run timeouts are enforced at the CI job level. Ideally Flank would be able to timeout a stuck run without relying on the CI timeout.

Feature

flank:
  # The max time this test run can execute before it is cancelled (default: unlimited).
  run-timeout: 60m

Support the same duration format as --timeout.

• 1h, 5m, 200s
• 100 is 100 seconds

After exceeding the the run timeout, Flank should:

• Print a message that says the run timeout has been exceeded
• Cancel any in progress test executions and print a link to those executions on FTL.