Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Rerun failed tests #2092

Merged
merged 7 commits into from
Jul 30, 2021
Merged

feat: Rerun failed tests #2092

merged 7 commits into from
Jul 30, 2021

Conversation

jan-goral
Copy link
Contributor

@jan-goral jan-goral commented Jul 19, 2021

Related to #2083

Test Plan

How do we know the code works?

From repository root, build flank:

. .env
flankScripts assemble flank -d

Run tests:

flank corellium test android run -c="./test_configs/flank-corellium-many.yml"

The execution should finish without errors. The generated JUnitReport.xml should contain 2 types of suites prefixed with:

  • shard - for each shards execution.
  • rerun - for failed test reruns.

New execution graph

Core execution.

TestAndroid.execute

Device sub-execution triggered for each shard or rerun by the Device.Tests task.

TestAndroid.Device.execute

Checklist

  • Documented
  • Unit tested

@github-actions
Copy link
Contributor

github-actions bot commented Jul 20, 2021

Timestamp: 2021-07-29 11:05:13
Buildscan url for ubuntu-workflow run 1078316217
https://gradle.com/s/dy636npw4clws

@jan-goral jan-goral force-pushed the 2083_test_dispatch_flow branch 2 times, most recently from 6b87fe0 to a10761b Compare July 22, 2021 14:48
@mergify
Copy link

mergify bot commented Jul 22, 2021

Title does not follow the guidelines of Conventional Commits.
Please adjust title before merge and use one of following prefix:

  • build - Changes that affect the build system or external dependencies (dependencies update)
  • ci - Changes to our CI configuration files and scripts (basically directory .github/workflows)
  • docs - Documentation only changes
  • feat - A new feature
  • fix - A bug fix
  • chore - Changes which does not touch the code (ex. manual update of release notes). It will not generate release notes changes
  • refactor - A code change that contains refactor
  • style - Changes that do not affect the meaning of the code (white-space, formatting, missing semi-colons, etc)
  • test - Adding missing tests or correcting existing tests and also changes for our test app
  • perf - A code change that improves performance (I do not think we will use it)

@jan-goral jan-goral force-pushed the 2083_test_dispatch_flow branch 8 times, most recently from 19ae3f1 to 4a4ce0f Compare July 23, 2021 18:28
@jan-goral jan-goral changed the title feat: Flaky test support feat: Rerun failed tests Jul 26, 2021
@jan-goral jan-goral force-pushed the 2083_test_dispatch_flow branch from 4a4ce0f to e44503b Compare July 29, 2021 08:50
@jan-goral jan-goral force-pushed the 2083_test_dispatch_flow branch from bdd1623 to fd4dfc6 Compare July 29, 2021 08:58
@jan-goral jan-goral marked this pull request as ready for review July 29, 2021 10:39
@jan-goral jan-goral requested a review from Sloox July 29, 2021 11:00
@mergify mergify bot merged commit e508239 into master Jul 30, 2021
@mergify mergify bot deleted the 2083_test_dispatch_flow branch July 30, 2021 08:17
@github-actions github-actions bot locked and limited conversation to collaborators Jul 30, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants