release_notes.md

v22.05.0

Bug Fixes

• #2255 Check if error is empty before printing (bootstraponline)

Features

• #2250 Exit with code 3 when there are no tests (CristianGM)

v22.04.0

Bug Fixes

• #2189 Adds check for .aab format before querying apkDetails (Xlopec)

Features

• #2241 Use Firebase Test Lab matrix details URL for test matrix webLink (tonybaroneee)

v22.03.0

Bug Fixes

• #2225 Revert jackson upgrade
• #2223 Fix BufferUnderflowException when parsing dex file with Espresso 3.4.0 Fixes #2203
• #2207 Add support for robo-directives

Tests update

• #2185 Update app_many_tests to AndroidX libraries

v21.11.0

Bug Fixes

• #2182 Detect iOS devices as physical (bootstraponline)

Features

• #2176 Support HTTP proxies with credentials. (jdm-square)

v21.09.0

Features

• #2158 Adapt new iOS xml structure (piotradamczyk5)
• #2123 Flank-Corellium metrics (jan-gogo, adamfilipow92)
• #2154 Increase timeout for http request (pawelpasterz)

Bug Fixes

• #2156 Fix flaky flag (pawelpasterz)
• #2151 Merging results for non legacy Android run (piotradamczyk5)

v21.08.1

Features

• #2121 Calculate flaky tests from reruns (jan-gogo)
• #2131 Implement env parsing (pawelpasterz)

Refactor

• #2139 Structural output refresh last run (piotradamczyk5)
• #2127 Bash command execution (piotradamczyk5)
• #2107 Mixpanel module API & implementation (jan-gogo, adamfilipow92)

Bug Fixes

• #2142 Add retry and silent crash to mixpanel send method (piotradamczyk5)
• #2140 Disable mixpanel in tests (piotradamczyk5)
• #2129 Fix output of calculateShards() when all tests are filtered out (doodla)
• #2124 IOS nm global tests discovery (Sloox)
• #2122 Envs from additional apks not override default values (pawelpasterz)

CI Changes

• #2119 Simple GHA Dogfood script (Sloox)

v21.08.0

Features

• #2118 Added project ID to sentry (piotradamczyk5)
• #2113 Get apk details with retry (pawelpasterz)
• #2108 Added Gradle Plugin to check if helpers modules version get updated (piotradamczyk5)
• #2092 Rerun failed tests (jan-gogo)

Bug Fixes

• #2110 Fix dry run (pawelpasterz)

Refactor

• #2106 Structural output login google (piotradamczyk5)

Documentation

• #2102 Generate tasks diagram (jan-gogo)

v21.07.2

Features

• #2096 Add num-flaky-test-attempts CLI option (jan-gogo)
• #2094 Added Sdk Suppress Handling (pawelpasterz, adamfilipow92, piotradamczyk5)
• #2098 Improvements for :tool:execution:parallel (jan-gogo)
• #2088 Added firebase event to Mixpanel (axelzuziak-gogo, adamfilipow92)
• #2072 Integrate parallel execution in Corellium domain (jan-gogo)
• #2085 Add Analytics to Flank Wrapper (piotradamczyk5)
• #2086 Move Mixpanel metrics to tools:analytics (adamfilipow92)
• #2080 Improve :tool:execution:parallel. (jan-gogo)
• #2076 Parameterized Tests - multiple (Sloox)
• #2062 Merge test method duration for parameterized classes (jan-gogo)

Bug Fixes

• #2097 Incorrect calculations in JUnit tool (jan-gogo)
• #2095 XArgs command update (Sloox)
• #2091 Remove jfrog repositories (jan-gogo)
• #2075 Do not upload/read files when path starts with gs:// (pawelpasterz, adamfilipow92)
• #2084 Fix calculating total test cost in Mixpanel ()

Refactor

• #2093 Fix & simplify names for Corellium domain & cli (jan-gogo)
• #2081 Move legacy execution tool to standalone module. (jan-gogo)
• #2079 Move Config.kt into :tool:config module. (jan-gogo)

v21.07.1

Features

• #2074 Add Sentry to Flank Wrapper (piotradamczyk5)
• #2073 Add Flank version info to requests (adamfilipow92)
• #2069 Add option for running parallel tasks as synchronized sequence. (jan-gogo)
• #2056 Test targets option for Corellium (jan-gogo)
• #2064 Added Flank Wrapper (adamfilipow92, piotradamczyk5)
• #2058 Install apks asynchronous (jan-gogo)
• #2046 Parameterized tests options (Sloox)
• #2055 Expose test filters as standalone tool (jan-gogo)

Refactor

• #2057 Make the domain a source of defaults (jan-gogo)

Bug Fixes

• #2066 Parameterized Tests name change (Sloox)

v21.07.0

Features

• #2049 Save am instrument logs to file & handle parsing error. (jan-gogo)
• #2047 Implement slack notifications for failed release (pawelpasterz)
• #2042 Send missing analytics data from Flank to Mixpanel (pawelpasterz, adamfilipow92)
• #2032 Add structural logging (jan-gogo)
• #2009 Implement tool for parallel execution (jan-gogo)
• #2033 Add tools for structural logging (jan-gogo)
• #2035 Added new Parameterized Test Option (Sloox)
• #2034 Remove print lines from Corellium client (jan-gogo)

Bug Fixes

• #2050 Corellium client request retry (jan-gogo)
• #2043 Enhance table builder logic (pawelpasterz)
• #2031 Bump up trim-newlines version (pawelpasterz)

Refactor

• #2039 Data field should not be serialized (pawelpasterz)
• #2038 Move tools from corellium directory (jan-gogo)

v21.06.1

Bug Fixes

• #2026 Fix flank freezes when large number of matrices is launched (pawelpasterz)
• #2020 Added missing help command (adamfilipow92)
• #2019 Fix generating documentation (piotradamczyk5)
• #2010 Dumpshards fix #1 (Sloox)

Features

• #2004 Additional config options for test pairs (pawelpasterz)
• #2016 Set Google api issues level as DEBUG (piotradamczyk5)
• #1998 Load test cases durations from previous run and use for sharding (jan-gogo)

v21.06.0

Bug Fixes

• #1994 Disable ASCII doc generation (release blocker) ()
• #1990 Puml diagram links (jan-gogo)
• #1981 Enable dump shards IT (Sloox)
• #1982 CIOEngineContainer not found (jan-gogo)
• #1967 Filter devices without supported versions (pawelpasterz)
• #1956 Annotation filtering for parameterized classes (asadsalman)
• #1955 Service account as default (adamfilipow92)
• #1943 Several minor corellium changes - part 3. (jan-gogo)
• #1936 Several minor corellium changes - part 2. (jan-gogo)
• #1933 Remove deprecated corellium adapters example (jan-gogo)
• #1900 Several minor issues in corellium scope (jan-gogo)

Features

• #1992 Disable window animation in tests by default (jan-gogo)
• #1991 Enable GPU acceleration for new instances (jan-gogo)
• #1968 Added support for JUnit Theory tests (asadsalman)
• #1970 Add test file column to result table (pawelpasterz)
• #1897 Domain layer implementation for android test run Corellium MVP (jan-gogo)
• #1947 Added max-test-shards and client-details to additional-app-test-apks (asadsalman)
• #1945 Integrate flank.jar with corellium CLI (jan-gogo)
• #1940 Corellium MVP CLI layer (jan-gogo)
• #1935 Public API of corellium domain layer (jan-gogo)
• #1923 Obfuscate shards (jan-gogo)
• #1921 Dump shards (jan-gogo)
• #1908 Add junit module (jan-gogo)
• #1880 Corellium adapters (jan-gogo)

Documentation

• #1977 Add user guide for Corellium MVP (jan-gogo)
• #1969 Add docs for Corellium modules (jan-gogo)
• #1961 Add implementation section to architecture doc (jan-gogo)
• #1954 Add architecture abstraction (jan-gogo)

CI Changes

• #1972 Update cla assitant (piotradamczyk5)
• #1949 Validate Maven version on publish (piotradamczyk5)
• #1942 Ubuntu updates (Sloox)
• #1934 Make IT results independent of os versions (Sloox, pawelpasterz)
• #1927 Remaining ubuntu-latest variables (pawelpasterz)
• #1918 Update wrong ubuntu variable name (pawelpasterz)

Refactor

• #1952 Data scratch ios (Sloox)
• #1937 Run doctor command (pawelpasterz, adamfilipow92)
• #1948 Move am instrument commad formatter to dedicated module (jan-gogo)
• #1950 Move apk parsers to dedicated module (jan-gogo)
• #1941 Refactor data scratch-Android run (piotradamczyk5)
• #1931 Add removing stack traces for simple report (piotradamczyk5)
• #1930 List android versions (Sloox)
• #1924 Structural output list ios versions (adamfilipow92)
• #1915 Structural output list network profiles (piotradamczyk5)
• #1919 Structural output list provided software (piotradamczyk5)
• #1920 Move shards calculation to separated module (jan-gogo)
• #1907 Structural output for list android models (adamfilipow92)
• #1911 Remove client classes for JUnit refactor (piotradamczyk5)
• #1914 IOS List locales (Sloox)
• #1916 Ip blocks output (pawelpasterz)
• #1909 Structural output orientations (piotradamczyk5)
• #1912 Move files for authentication data refactor (piotradamczyk5)
• #1910 Structural output for iOS model list (adamfilipow92)
• #1901 Data scratch - test matrix (adamfilipow92, piotradamczyk5)
• #1906 Describe ios versions (Sloox)
• #1902 Structural output cancel last run (piotradamczyk5)
• #1896 Logging refactor - android/ios test environment (pawelpasterz)
• #1875 Fetching artifacts (pawelpasterz)
• #1899 Android locales describes (Sloox)
• #1884 Refactor data scratch-Junit test result (piotradamczyk5)
• #1886 Describe ios locales (Sloox)
• #1895 Structural output iOS models describe (piotradamczyk5)
• #1894 List android locales (Sloox)
• #1890 Refactor android versions logging (pawelpasterz)
• #1887 Structural output Android models describe (piotradamczyk5)

v21.05.0

Refactor

• #1885 Refactor DescribeNetworkProfiles logging (pawelpasterz)
• #1841 Data scratch file references (Sloox)
• #1878 Corellium client to functional style (jan-gogo)
• #1828 Data scratch getLocales (Sloox)
• #1840 Refactor data scratch-performance metrics (piotradamczyk5)
• #1833 Refactor os versions commands (adamfilipow92)
• #1834 Refactor data scratch-device model (piotradamczyk5)
• #1823 Refactor data scratch-softwarecatalog (Sloox)
• #1810 Refactor data scratch-remote storage (Sloox)
• #1819 Refactor data scratch network profiles (adamfilipow92)
• #1820 Refactor data scratch-orientation (piotradamczyk5)
• #1811 Refactor data scratch-ipblocks (piotradamczyk5)
• #1809 Refactor data scratch-authorization (piotradamczyk5)
• #1806 Rename corellium modules (pawelpasterz)

Bug Fixes

• #1883 Fix release job (piotradamczyk5)
• #1874 Add storage dir support (wclausen)
• #1829 CI issues on ubuntu (piotradamczyk5)
• #1807 Fix missing junit report in legacy mode (adamfilipow92)

Features

• #1877 TestApk parser (jan-gogo)
• #1879 API layer for corellium MVP (jan-gogo)
• #1835 Add sharding implementation for corellium (jan-gogo)
• #1824 Instrument test console log parser (pawelpasterz, jan-gogo)

Tests update

• #1842 Update task ordering (pawelpasterz)
• #1825 Optimize quota usage in IT (pawelpasterz)
• #1783 Add 3dmark instrumented test (jan-gogo)

CI Changes

• #1813 Disabled estimations copying (piotradamczyk5)

Documentation

• #1805 Fix information about project id (piotradamczyk5)

v21.04.1

Documentation

• #1788 Added hypershard-ios setup tutorial (piotradamczyk5)
• #1791 Hypershard android usage guide (Sloox)
• #1775 Add corellium android example (pawelpasterz)

Tests update

• #1796 1795 update custom sharding it (pawelpasterz)
• #1790 Update DumpShardsIT (pawelpasterz)

Bug Fixes

• #1793 Added workaround for uppercase project name (piotradamczyk5)
• #1784 Skip Dump shards IT test (Sloox)
• #1782 Fix entrypoint file name (pawelpasterz)
• #1772 Fix flank-scripts test failure on MacOS (adamfilipow92, piotradamczyk5)

Features

• #1773 Add printing total run duration (piotradamczyk5)
• #1779 Implement custom sharding -- iOS (pawelpasterz)
• #1763 1665 implement custom sharding -- android (pawelpasterz)
• #1739 Windows IOS integration tests (Sloox, adamfilipow92)

Refactor

• #1774 Move cli to presentation (Sloox)

v21.04.0

Bug Fixes

• #1761 Removed mandatory GitHub token on artifacts downloading (adamfilipow92)
• #1732 Follow up refactor fix (pawelpasterz)
• #1725 Ix cli class diagram link ()
• #1694 Output path to local results github action (piotradamczyk5)
• #1693 White space in Github action (piotradamczyk5)

Documentation

• #1735 Add base pages for flank layers (jan-gogo)
• #1714 Flutter support (jan-gogo, adamfilipow92)
• #1733 Add flank component diagram (jan-gogo)
• #1707 Add cli class diagram (jan-gogo)
• #1709 Desktop POC SDD (piotradamczyk5)
• #1701 Create Github marketplace documentation for Flank action (piotradamczyk5)

Refactor

• #1741 Rename cli package (piotradamczyk5)
• #1588 Investigate and create proposal (pawelpasterz, jan-gogo)
• #1718 Extract logic from cli to domain (jan-gogo)
• #1724 Separate main function from MainCommand (jan-gogo)
• #1696 Clean up dependencies (pawelpasterz)

Tests update

• #1737 Add IT for large shard test suite (piotradamczyk5)
• #1730 Added app with many tests (piotradamczyk5)
• #1719 Improve integration tests (adamfilipow92, piotradamczyk5)

Features

• #1717 Windows Updates For Integration Tests (Sloox)
• #1715 Add option to skip config validation (pawelpasterz)
• #1704 Add app name to the test result (pawelpasterz)
• #1711 Add support for emulator devices (pawelpasterz)

v21.03.1

Bug Fixes

• #1680 Fix output report error with dump shards (pawelpasterz)
• #1671 Saving service account by flank script (adamfilipow92)
• #1662 Fix NPE in GcToolResults (pawelpasterz)
• #1657 Remove physical device from integration tests (adamfilipow92)
• #1656 Snapshot publish by disabling closing staging artifacts (piotradamczyk5)
• #1652 Fix snapshot upload (piotradamczyk5)
• #1649 JUnitReport.xml only contained 50 test results (dmytrodanylyk)
• #1648 Publishing to GithubPackages (piotradamczyk5)

Features

• #1675 Return directories path in Flank Github action (adamfilipow92, piotradamczyk5)
• #1673 Run Flank Github action with config provided by user (adamfilipow92, piotradamczyk5)
• #1663 Added reading service account in Github action (adamfilipow92, piotradamczyk5)
• #1660 Add Flank GitHub action (adamfilipow92, piotradamczyk5)
• #1659 Remove flank-actions (Sloox)
• #1655 Update Flank Slack release notifier (Sloox)

CI Changes

• #1679 Fix publishing snapshots (piotradamczyk5)
• #1654 Treat env json as a string (pawelpasterz)
• #1653 Parse env object to JSON (pawelpasterz)
• #1639 Update workflow file (pawelpasterz)

Documentation

• #1621 Corellium sandbox (pawelpasterz)
• #1670 Add SDD for 1609 feature request (pawelpasterz)
• #1644 Add Flank output research docs (adamfilipow92, piotradamczyk5)

Tests update

• #1661 Implement logic to clear LocalGcs after each test (pawelpasterz)

Refactor

• #1651 Change packages of commands (piotradamczyk5)

v21.03.0

CI Changes

• #1641 Add missing subcommands (pawelpasterz)
• #1642 Fix release workflow (pawelpasterz)
• #1640 Fix gradle command (pawelpasterz)
• #1618 Publish Flank-scripts to Github (piotradamczyk5)
• #1614 Publish flank to maven central (adamfilipow92, piotradamczyk5)

Documentation

• #1627 Explore test-targets-for-shards SDD (Sloox, piotradamczyk5)
• #1592 Fix SDD for Github action (piotradamczyk5)
• #1590 Github action SDD proposal (piotradamczyk5)
• #1583 Flank-scripts ops package organization (piotradamczyk5)
• #1566 Flank-scripts command overview (piotradamczyk5)

Features

• #1635 Part 2 of IT tests (Sloox, pawelpasterz)
• #1624 Part 1 of multiple OS IT tests (Sloox)
• #1559 Add storing output as json (adamfilipow92, piotradamczyk5)

Bug Fixes

• #1631 Update compare files in IT (Sloox, pawelpasterz)
• #1628 Remove analytics from integration tests (Sloox)
• #1626 Spacing fix for yml file (Sloox)
• #1620 Authenticate in Github CLI before release Flank-Scripts (piotradamczyk5)
• #1619 Releasing flank-scripts (piotradamczyk5)
• #1617 Release job (piotradamczyk5)
• #1612 NPE on dumpShards (adamfilipow92)
• #1593 Remove GameloopIT test for IOS (Sloox)
• #1585 Print Flank version only on run command (adamfilipow92)
• #1581 Fixes for Workflow files & IT tests (Sloox, adamfilipow92)
• #1575 Increase heap size (pawelpasterz)
• #1564 Windows issues (Sloox)
• #1560 Fix IT workflow for windows (Sloox)
• #1557 Move shards json to result directory (adamfilipow92, piotradamczyk5)

Refactor

• #1589 Move function to files which use them (adamfilipow92, piotradamczyk5)
• #1584 Reorganize domain layer of flank scripts (adamfilipow92, piotradamczyk5)
• #1574 Refactor CLI of Flank-scripts (piotradamczyk5)
• #1572 Flank scripts features not depends on each other (adamfilipow92)
• #1533 Refactor flank scripts (jan-gogo, adamfilipow92, piotradamczyk5)

v21.02.0

Bug Fixes

• #1547 IT test fix ()
• #1540 Dummy var for pr (Sloox)
• #1546 Fix flaky FilesTest (pawelpasterz)
• #1526 Windows Integration tests (Sloox)
• #1521 Fix NPE and logging (pawelpasterz)
• #1506 Improve Sentry logging for tests (adamfilipow92, piotradamczyk5)
• #1470 Resolve Fails on Windows (Sloox, pawelpasterz)
• #1490 Fix incorrect method usage on master (pawelpasterz)
• #1465 CI failures on performance tests (piotradamczyk5)

CI Changes

• #1537 Integration Test for all OS's (Sloox)
• #1534 Added Windows workflow (piotradamczyk5)
• #1535 Windows integration test (Sloox)
• #1468 Use pointer workflows to preserve run date (pawelpasterz, piotradamczyk5)
• #1456 Update config for CLA (piotradamczyk5)

Tests update

• #1525 Add missing iOS options in IT (pawelpasterz)
• #1514 Update compare file and make url option not required (pawelpasterz, adamfilipow92)

Features

• #1448 Filtering test configurations (iOS TestPlans) (axelzuziak-gogo, jan-gogo)
• #1504 Sending configuration to mixpanel (adamfilipow92, piotradamczyk5)
• #1474 Amend pre-commit hook (Sloox)
• #1471 Migrate from bugsnag to sentry (adamfilipow92)
• #1428 Rewrite pre-commit hook & ktlint apply to idea into Flank Scripts (Sloox)

Documentation

• #1495 Choose analytics tool (adamfilipow92, piotradamczyk5)

Refactor

• #1450 Enable properties file in flank scripts (pawelpasterz, piotradamczyk5)
• #1473 Update picocli to latest version (pawelpasterz, piotradamczyk5)
• #1466 Change packages in the common module (pawelpasterz)

v21.01.1

CI Changes

• #1451 Added CLA assistant (piotradamczyk5)
• #1447 Fix dependency update workflow (pawelpasterz)
• #1443 Add missing step (pawelpasterz)

Bug Fixes

• #1453 Fix problem with test-runner-class (piotradamczyk5)

v21.01.0

CI Changes

• #1439 Remove sanity checks and change full suite IT OS to macOS (piotradamczyk5)
• #1433 Change IT workflow comment (pawelpasterz)
• #1424 Auto update firebase api client (piotradamczyk5)
• #1412 1411 implement version (pawelpasterz)
• #1409 Trigger integration tests from pr comment (adamfilipow92, piotradamczyk5)
• #1385 Get rid of binaries submodule (jan-gogo, piotradamczyk5)
• #1400 Change gradle command (pawelpasterz)
• #1398 Add create google account config step (pawelpasterz)
• #1353 Implement workflow for full suite IT (cron + manual) (pawelpasterz, piotradamczyk5)
• #1378 Update GH API (pawelpasterz)

Features

• #1436 1422 autodetect new gcloud features (pawelpasterz)
• #1429 Change uploading file output (adamfilipow92, piotradamczyk5)
• #1426 Support for iOS gameloop tests (Sloox, jan-gogo, adamfilipow92)
• #1421 Default project Id - use GOOGLE_APPLICATION_CREDENTIALS first, then GOOGLE_CLOUD_PROJECT (pawelpasterz)
• #1404 Add basic gameloop IT for Android (Sloox, adamfilipow92)
• #1393 Upload matrix ids (Sloox, jan-gogo)
• #1362 Add logic to verify xml results (adamfilipow92, piotradamczyk5)
• #1321 IOS support for testplans (axelzuziak-gogo, jan-gogo)
• #1375 Add new output style to print smaller output (adamfilipow92, piotradamczyk5)
• #1370 Add support for "fail fast" feature on FTL (RainNapper)

Refactor

• #1432 Small changes in flank-scripts module (pawelpasterz)
• #1418 Create module with shared utilities (piotradamczyk5)
• #1417 Update firebase_apis module (pawelpasterz)

Bug Fixes

• #1414 Add attempts to performance test (jan-gogo)
• #1410 Fix integration tests on CI. (adamfilipow92, piotradamczyk5)
• #1413 Fix calculate shards test (pawelpasterz, jan-gogo)
• #1405 CancelCommandRuns should works independent (Sloox, adamfilipow92)
• #1395 Print args when iOS tests are not found (jan-gogo, adamfilipow92)
• #1387 Fix NPE (pawelpasterz, jan-gogo)
• #1372 Fix Flank Scripts version verification tasks (piotradamczyk5)

Documentation

• #1401 Update orchestrator version in docs (adamfilipow92)
• #1380 Added documentation about handling #1374 issue (piotradamczyk5)

Tests update

• #1316 [IT] Add test cases (pawelpasterz, adamfilipow92)

v20.12.0

Bug Fixes

• #1366 Generation of release notes (piotradamczyk5)
• #1357 Fix release Action (Sloox, piotradamczyk5)
• #1333 Publishing Flank snapshot (Sloox, piotradamczyk5)
• #1338 Fix printing supported versions id (adamfilipow92)
• #1329 Uploading performance metrics for multiple matrices (adamfilipow92, piotradamczyk5)
• #1326 Downloading performance Metrics (adamfilipow92, piotradamczyk5)
• #1323 Nested subdirectories in results-dir (piotradamczyk5)
• #1307 Integration tests on windows (pawelpasterz, adamfilipow92)
• #1301 Handling broken token issues (piotradamczyk5)
• #1298 Fix incorrect printed shards number (pawelpasterz)
• #1295 Print formatted message instead of throwing NPE (pawelpasterz)
• #1283 Integration tests on windows (adamfilipow92, piotradamczyk5)
• #1275 Fix getting PR number on pull_request_review (piotradamczyk5)
• #1272 Fix integration test counter and trigger (piotradamczyk5)
• #1219 #842 support for test targets flag in multiple testbundles xctest (axelzuziak-gogo, jan-gogo)
• #1261 Add additional index to matrix when multiple test runs (pawelpasterz, adamfilipow92)
• #1250 Fix running flank workflows on Windows (piotradamczyk5)
• #1247 Flank web documentation link (piotradamczyk5)
• #1243 Disable cache for :test_runner:shadowJar task (pawelpasterz)
• #1233 Fix withClassName filter (pawelpasterz)
• #1221 Always dump shards (pawelpasterz, adamfilipow92)
• #1236 Empty branch name in workflows (jan-gogo)
• #1232 Test_runner:resolveArtifacts task (jan-gogo)
• #1225 Release job missing env ()
• #1188 Revert "feat: Dump shards and upload on every run (#1171)" (pawelpasterz)
• #1177 Fix flank-scripts test (pawelpasterz)
• #1167 Flank action (Sloox)
• #1161 Release notes slack tweaks (Sloox)
• #1164 Dependabot security issues (Sloox)

Refactor

• #1350 Ios test artifacts cleanup #1345 (axelzuziak-gogo, jan-gogo)
• #1339 Simplify beforeRunTests return singature (jan-gogo)
• #1281 Prepare flank codebase for supporting iOS testplans (axelzuziak-gogo, jan-gogo)
• #1246 Rewrite scripts to Kotlin (adamfilipow92, piotradamczyk5)

CI Changes

• #1361 Publishing and downloading flank scripts (piotradamczyk5)
• #1352 Make flank release more automatically (piotradamczyk5)
• #1344 Add directory filter for IT (pawelpasterz)
• #1310 Copy properties from issue to pull request (adamfilipow92, piotradamczyk5)
• #1320 Added pre-commit-hook (Sloox)
• #1286 Update existing bot comment (pawelpasterz)
• #1269 Add build scan for ubuntu workflow (pawelpasterz)
• #1265 Refresh integration tests (piotradamczyk5)
• #1263 Github Action optimizations (piotradamczyk5)
• #1253 Use Github app token for creating release notes (piotradamczyk5)
• #1248 Update deprecated options ::set-env and ::add-path (piotradamczyk5)
• #1240 Add current date to dependecy PR (pawelpasterz)
• #1148 Add scripts for test artifacts managment (jan-gogo, piotradamczyk5)
• #1210 Enable RC versions for gradle (dependency update task) (pawelpasterz)
• #1158 Fix test artifacts url (jan-gogo)
• #1152 Added WSL workflow (Sloox, piotradamczyk5)

Documentation

• #1355 Add documentation about code review by step (jan-gogo)
• #1311 Update documentations & Add Headings (Sloox)
• #1222 Add flank website code (jan-gogo)
• #1229 Update documentation (pawelpasterz)
• #1215 Added documentation about missing options (piotradamczyk5)
• #1190 Added documentation about Cucumber support (piotradamczyk5)
• #1181 Investigation incorrect outcome for flaky tests (pawelpasterz, adamfilipow92)
• #1173 Add FAQ section about sync problems (piotradamczyk5)
• #1131 Investigate flank options (jan-gogo, adamfilipow92)

Features

• #1325 IOS GameLoop addition (Sloox, axelzuziak-gogo)
• #1299 Add test targets for shard (Sloox, pawelpasterz)
• #1292 Added Performance Metrics for Android (piotradamczyk5)
• #1289 Add ios app for gameloop (Sloox)
• #1291 Add --test-special-entitlements for iOS (piotradamczyk5)
• #1266 IOS add directories-to-pull (adamfilipow92, piotradamczyk5)
• #1287 Ios scenario numbers (Sloox)
• #1284 Add Type to iOS (piotradamczyk5)
• #1262 Gameloop addition (Sloox)
• #1273 Add Additional Ipas option to iOS (piotradamczyk5)
• #1267 Add Other Files for iOS (adamfilipow92, piotradamczyk5)
• #1255 Obb file addition (Sloox)
• #1256 Update test shard limits (adamfilipow92)
• #1244 Added scenario-numbers (Sloox)
• #1238 Scenario Labels (Sloox)
• #1230 Add type (Sloox)
• #1186 Grant permissions addition (Sloox)
• #1214 Added printing missing options (piotradamczyk5)
• #1175 Android integration tests run on non wsl windows (Sloox, adamfilipow92)
• #1171 Dump shards and upload on every run (adamfilipow92)
• #1163 Integration tests run when pr is approved and not draft (adamfilipow92, piotradamczyk5)
• #1159 Improve error message on matrix failures (pawelpasterz, adamfilipow92)
• #1133 Auto update dependencies (piotradamczyk5)

Tests update

• #1300 Add flank multi test targets example (jan-gogo)
• #1274 Disable iOS test for Windows (piotradamczyk5)
• #1187 Remove verification test for edge cases of incorrect outcome in flaky tests (adamfilipow92)
• #1174 Added cucumber sample app for testing #1118 (piotradamczyk5)

v20.09.3

Bug Fixes

• #1151 Update flank-scripts serialization (piotradamczyk5)
• #1149 Flank-scripts next release tag generation (piotradamczyk5)
• #1138 Fix cost report (pawelpasterz)
• #1137 Running Code coverage job (piotradamczyk5)
• #1130 Bump action versioning (Sloox)
• #1124 Reflect gclouds outcome for robo tests (pawelpasterz)
• #1121 Dockerfile fix for slack message send (Sloox)
• #1116 Fixes release workflows (Sloox)

Features

• #1141 Add Java 15 compile support (piotradamczyk5)
• #1126 Allow Flank using different environment variables between test-apks (adamfilipow92)
• #1078 Add proguard initial step into Flank configuration (Sloox)
• #1125 Readded shadowjar minimization (Sloox)
• #1109 Integration tests for Flank (adamfilipow92)

Documentation

• #1139 Optimization docs addition (Sloox)
• #1136 Update documentation related with test-targets-always-run feature (pawelpasterz)

CI Changes

• #1114 Add Windows workflow (Sloox)
• #1095 Add new bash scripts for test artifacts generation (axelzuziak-gogo, jan-gogo)

Refactor

• #1113 Use single settings.gradle for flank projects (jan-gogo, piotradamczyk5)

v20.09.2

Features

• #1111 Check if gcs path exist before run (piotradamczyk5)
• #1110 Finialize the slack sending integration with actions (Sloox)
• #1108 Support for robo tests without robo script (pawelpasterz)
• #1104 Send slack message for releases (Sloox)
• #1097 Print the matrices web link at the end of a run (adamfilipow92)

Bug Fixes

• #1107 Running iOS test on Linux (piotradamczyk5)
• #1059 Shards and Tests count do not match (pawelpasterz, adamfilipow92)
• #1067 Matrix path not found in json (adamfilipow92, piotradamczyk5)

v20.09.1

Bug Fixes

• #1100 Fix gcs files validation (pawelpasterz)
• #1093 Flank release bot formatting (Sloox)
• #1091 Add missing authors to release notes (adamfilipow92)

v20.09.0

Bug Fixes

• #1087 Fix release action (adamfilipow92)
• #1080 Flaky Flank-scripts test (Sloox)
• #1079 Fix slack notification in slack (Sloox)
• #1054 Firebase refresh fails when test zip file doesn't exist (#1052) (axelzuziak-gogo, jan-gogo)
• #1070 Avoid fast fail while creating a bucket (adamfilipow92)
• #1066 Bad validation of local-result-dir by Doctor (piotradamczyk5)

CI Changes

• #1058 Post slack message about releases (Sloox)

v20.08.4

Features

• #1056 Added validation of smart-flank-gcs-path to not override different junit results (adamfilipow92)
• #1040 Add test axis value column to summary table (jan-gogo)
• #1043 Add printing messages for MatrixCanceledError and InfrastructureError (pawelpasterz)
• #1042 Added option for default test time and average time for smart shard (piotradamczyk5)

Tests update

• #1055 Added missing test t cover duplicated tests issue (piotradamczyk5)

Bug Fixes

• #1041 Invoking flank yml on gcloud cli (adamfilipow92)
• #1053 Avoid releasing on document changes only (Sloox)
• #1048 Flank finding and running duplicate tests (MatthewTPage)
• #1051 PR check from fork (piotradamczyk5)
• #1044 Master not compiling (Sloox)
• #994 Size annotations support (pgreze)

Refactor

• #1047 MatrixMap immutability (Sloox)
• #1028 Savedmatrix immutability change (Sloox)

Documentation

• #1009 Avoid multiple identical lines printing (adamfilipow92)

v20.08.3

CI Changes

• #1031 Disable publishing snapshot to Github Packages (piotradamczyk5)
• #1022 Publish to GitHub packages (piotradamczyk5)

Bug Fixes

• #1027 OtherNativeCrash NPE (jan-gogo)
• #1023 Release notes message at GitHub release (piotradamczyk5)

Refactor

• #1025 Update kotlin version to 1.4 (pawelpasterz)

v20.08.2

Features

• #1020 Make release notes more organized (piotradamczyk5)
• #1013 Generating docs before release (piotradamczyk5)
• #1012 Add ip-blocks command to test-environment command (pawelpasterz)
• #999 Implement ip-blocks list command (pawelpasterz)
• #996 Auto generate release notes for next release (piotradamczyk5)
• #995 Implement command models describe for ios/android (adamfilipow92)
• #991 Validate orientation and fail fast (Sloox)
• #969 Add locales description command for ios and android (adamfilipow92)
• #992 Update google api (jan-gogo)
• #988 Add versions description command for ios and android (adamfilipow92)

Refactor

• #1018 Fetch artifacts async (pawelpasterz)

Bug Fixes

• #919 Rate limit exceeded (pawelpasterz, jan-gogo)
• #1005 Generation of release notes (piotradamczyk5)
• #1007 Failing tests (piotradamczyk5)
• #990 Exclusion of @Suppress test (piotradamczyk5)

CI Changes

• #1015 Update mergify configuration (piotradamczyk5)
• #1011 Generate release notes for Github release description (piotradamczyk5)
• #989 Check if valid title is used in PR (piotradamczyk5)

Documentation

• #987 Analytics addition to readme (Sloox)

v20.08.1

• #978 Firebaseopensource.com addition (sloox)
• #937 Improve error message on iOS when test or xctestrun-file not found (sloox)
• #952 Fix version printing on Flank release (sloox)
• #950 Fix crash when --legacy-junit-result set. (adamfilipow92)
• #948 Increment retry tries and change sync tag for jfrogSync. (piotradamczyk5)
• #946 Added tests for flank scripts. (piotradamczyk5)
• #935 Process junit xml even when full junit is not enabled. (kozaxinan)
• #962 Make table text left aligned. (pawelpasterz)
• #965 Fast fail when full-junit-result and legacy-junit-result. (adamfilipow92)
• #970 Fixing Flood of snapshot releases. (piotradamczyk5)
• #972 Fix printing release version. (piotradamczyk5)
• #964 Implement network-profiles describe feature. (pawelpasterz)

v20.08.0

• #890 Convert bitrise ubuntu workflow into GitHub actions. (piotradamczyk5)
• #876 Added option to print Android available devices to test against. (piotradamczyk5)
• #895 Added option to print iOS available devices to test against. (piotradamczyk5)
• #894 Added option to print Android available versions to test against. (piotradamczyk5)
• #897 Added option to print iOS available versions to test against. (piotradamczyk5)
• #901 Added option to print Android and iOS available test-environment. (piotradamczyk5)
• #904 Added option to print provided software. (piotradamczyk5)
• #906 Added option to print network profiles. (adamfilipow92)
• #908 Added option to print iOS available locales to test against. (piotradamczyk5)
• #906 Added option to print iOS and Android screen orientations. (adamfilipow92)
• #907 Added option to print Android available locales to test against. (piotradamczyk5)
• #913 Add Gradle Enterprise API example. (pawelpasterz)
• #916 Test artifacts monorepo. (jan-gogo)
• #910 Migrate Bitrise release workflow into GitHub actions. (piotradamczyk5)
• #915 Update virtual devices sharding limit. (adamfilipow92)
• #920 Improve .yml validation on doctor command. (piotradamczyk5)
• #934 Delete incorrect flank snapshot labels. (piotradamczyk5)
• #926 Flank should reflect gcloud exit codes. (adamfilipow92)
• #917 Fix an incorrect outcome. (pawelpasterz)
• #939 Run *list commands when flank.yml not found should display right output. (adamfilipow92)

v20.07.0

• #857 Added multimodule setup for test app. (piotradamczyk5)
• #837 Added obfuscate option to dump shards. (piotradamczyk5)
• #868 Restored weblinks to all test results, not just failures. (rainnapper)
• #828 Store test results in gcloud bucket. (adamfilipow92)
• #865 Flank needs to respect the timeout value as that's a cap for billing purposes. (adamfilipow92, pawelpasterz)
• #866 Fix printing all matrix links. (piotradamczyk5)
• #862 Added printing outcome details. (piotradamczyk5, jan-gogo)
• #876 Added --directories-to-pull validation and avoid making request with empty toolStepResult. (piotradamczyk5)
• #875 Enhance permission denied exception logs. (adamfilipow92, pawelpasterz)

v20.06.2

• #853 Store @Ignore tests in the JUnit XML without sending ignored tests to FTL. (piotradamczyk5, adamfilipow92)
• #853 Handle duplicated apk names. (jan-gogo)

v20.06.1

• #840 Fix parametrized tests. (jan-gogo, adamfilipow92, pawelpasterz, piotradamczyk5)

v20.06.0

• #831 Refactor config entities and arguments. (jan-gogo)
• #817 Add AndroidTestContext as base data for dump shards & test execution. (jan-gogo)
• #801 Omit missing app apk if additional-app-test-apks specified. (jan-gogo)
• #784 Add output-style option. (jan-gogo)
• #779 Print retries & display additional info. (jan-gogo)
• #793 Better error message on file not found. (adamfilipow92)
• #808 Fixed dry run crashes. (piotradamczyk5)
• #807 Fix Bugsnag being initialized during tests. (piotradamczyk5)
• #805 Fix overlapping results. (pawelpasterz)
• #812 Convert bitrise macOS workflow to github action. (piotradamczyk5)
• #799 Refactor Shared object by splitting it into smaller functions. (piotradamczyk5)
• #798 Remove failure nodes from tests that passed on retry so that Jenkins JUnit plugin marks them as successful. (adamfilipow92)
• #822 Allow runtime test discovery when sharding is disabled by not setting test-targets. This unblocks cucumber testing. (adamfilipow92)
• #819 Display matrix results in a table format. (piotradamczyk5)
• #825 Automatically convert -1 in maximum-test-shards to the maximum shard amount. (adamfilipow92)
• #833 More error messages improvements. (piotradamczyk5)
• #826 Omit environment-variables for robo test executions instead of throwing exception. (adamfilipow92)

v20.05.2

• #781 Remove local exists check on cloud results-dir. Fixes crash when results-dir is set by the user. (adamfilipow92)
• #656 Improve error message reporting. (adamfilipow92)
• #783 Use legacy results for iOS by default. (pawelpasterz)
• #794 Enhance --dump-shards to dump shards from all test apks (bootstraponline, jan-gogo)

v20.05.1

• #775 Fix exception thrown for null start time. (pawelpasterz)

v20.05.0

• #764 Fix crash on parse some control chars. (adamfilipow92)
• #772 Fail fast when results-dir is incorrect. (jan-gogo)
• #757 Reduce memory usage by using Reader and Writer instead of ByteArrays. (jan-gogo)
• #763 Use "localhost" as default for hostname to fix backward compatibility. (jan-gogo)
• #757 Print version and revision before each command. (jan-gogo)
• #759 Add shard name for uploaded xctestrun files. (pawelpasterz)
• #755 Remove ascii doc generated section header. (jan-gogo)
• #731 Refactor jUnit HTML report. (Writhe)
• #754 Sync README.md flank.yml flank.ios.yml. (jan-gogo)
• #746 Ignore apk with filtered out tests instead of failing. (pawelpasterz)
• #741 Allow APKs with zero tests. (fondesa)
• #737 Generate ascii doc. (jan-gogo)
• #720 Update group id from flank to com.github.flank (bootstraponline)
• #714 Add support for num-uniform-shards option. (jan-gogo)
• #712 Add keep file path for ios. (pawelpasterz)
• #711 Remove hardcoded height. (pawelpasterz)
• #708 Add ignore failed tests option to Flank. (pawelpasterz)
• #704 Add robo for robo-directives & robo-script options. (jan-gogo)
• #704 Fix shards calculation when there are ignored tests and shardTime is -1. (jan-gogo)
• #692 Add support for other-files option. (jan-gogo)
• #695 Add support for additional-apks option. (jan-gogo)
• #683 Print web link. (pawelpasterz)
• #692 Add support for network-profiles list command & --network-profile option. (jan-gogo)
• #689 Add support for client-details option. (jan-gogo)
• #687 Debug message printed after every command. (pawelpasterz)
• #684 Add overhead time to junit test case report. (jan-gogo)
• #666 Use API instead of XML for result parsing for android. (jan-gogo)
• #678 Skip Bugsnag initialization if user disabled gcloud analytics. (pawelpasterz)
• #672 Flank timeout feature. (pawelpasterz)
• #657 Fix execution hangs. (pawelpasterz)
• #654 Fix test filters when using both notPackage and notClass. (jan-gogo)
• #648 Include @Ignore JUnit tests in JUnit XML. (pawelpasterz)
• #646 Adopt kotlin-logging as a logging framework. (jan-gogo)
• #644 Use high performance options by default. Video, login, and perf metrics are now disabled by default. (pawelpasterz)
• #643 Add --dry option to android run & ios run. (jan-gogo)
• #642 Flank doctor should exit 1 on validation issues. (pawelpasterz)
• #641 Move all deps to Deps.kt (doodla)
• #640 Update gradle to 6.2.1 and JaCoCo to 0.8.5. (doodla)
• #639 Cache all uploads and downloads to GCS. (Kurt-Bonatz)
• #635 Default to 2m time estimate for unknown tests when sharding. (RainNapper)
• #621 Adopt server side sharding. Max shard count is 50. (bootstraponline)

v8.1.0

• #612 Print HtmlErrorReport location. (bootstraponline)
• #615 Add --keep-file-path for Android when downloading assets from Google Cloud Storage. (tahirhajizada)

v8.0.1

• #608 Use MatrixRollupOutcome to set exit code value. (bootstraponline)

v8.0.0

• #595 Rename flaky-test-attempts to num-flaky-test-attempts. Rename repeat-tests to num-test-runs. (bootstraponline)
• #605 Improve exit code logging. Use matrix outcome to set exit code. (bootstraponline)
• #597 Support parsing testLabExecutionId. (yogurtearl)
• #599 Disable FAIL_ON_UNKNOWN_PROPERTIES for forward compatibility. (narenkmanoharan)

v7.0.2

• #589 Fix java.lang.NumberFormatException: empty String. (vfadc)
• #587 Optimize polling. (bootstraponline)

v7.0.1

• #586 Poll devices in parallel. Fixes performance regression in Flank v7. (bootstraponline)

v7.0.0

• #574 Improve test shard error reporting. Update device catalog to use projectId. (bootstraponline)
• #582 Fix iOS exit code when using flaky-test-attempts. Don't print environment-variables to stdout for security. (bootstraponline)
• #584 Poll all test executions instead of only the first per matrix. (bootstraponline)
• #585 Fix bug in smart flank when sharding tests that run in 0 seconds. (bootstraponline)

v6.2.3

• #567 Fix --app & --test on Android CLI. (bootstraponline)
• #571 Add flank ios run --dump-shards and flank android run --dump-shards for debugging (bootstraponline)
• #572 Fix exit code reporting when using flaky-test-attempts (bootstraponline)

v6.2.2

• #566 Fix --test & --xctestrun-file on iOS CLI. (bootstraponline)

v6.2.1

• #563 Fix CLI support for iOS. (bootstraponline)

v6.2.0

• #560 Add --test-runner-class support for Android. (jschear)

v6.1.0

• #542 Add additional-app-test-apks to include multiple app/test apk pairs in a single run. (bootstraponline)

v6.0.1

• #550 Update dex-test-parser to fix Inherited crash. (bootstraponline)

v6.0.0

• #541 Rename --test-shards CLI flag to --max-test-shards. Add --smart-flank-gcs-path CLI flag. (bootstraponline)
• #544 Fix empty test targets crash. (bootstraponline)
• #548 Fix flank cancel. Print os name when sharding iOS tests. (bootstraponline)
• #549 Update to llvm 8.0.0 and Swift 5.0.1. (bootstraponline)

v5.1.0

• #537 Add smart-flank-disable-upload yml option to prevent new results from overriding previous results. (elihart)

v5.0.2

• #538 Update dextestparser. Fixes APK parsing crash. (bootstraponline)
• #536 Always calculate exit code from matrix status instead of JUnit XML. (bootstraponline)

v5.0.1

• #534 Fix updateMatrixFile not saving matrix_ids.json. (bootstraponline)

v5.0.0

• #506 Add bugsnag reporting to detect Flank crashes. (bootstraponline)
• #507 Improve error message when credentials fail to load, folder doesn't exist, and on bucket creation failure. Properly pass through user credential when checking the storage bucket. (bootstraponline)
• #514 Rename testShards to maxTestShards (miguelslemos)
• #518 Add deprecation warnings when old key names are used. flank android doctor --fix will auto fix the YAML file. (bootstraponline)
• #519 Rename maxTestShards to max-test-shards, shardTime to shard-time, repeatTests to repeat-tests, smartFlankGcsPath to smart-flank-gcs-path, disableSharding to disable-sharding. Moved project from gcloud to flank (bootstraponline)
• #523 Add --local-result-dir to make it easy to find the test result at a fixed path. (bootstraponline)
• #524 Fix iOS test sharding when there's a space in the path (bootstraponline)
• #522 Correctly report test results and exit code when using flaky-test-attempts (bootstraponline)
• #530 Save files downloaded with files-to-download to device root folder. Fix web links in HTML report. (bootstraponline)
• #533 Update matrix_ids.json on every matrix change. Useful for debugging runs that crashed. (jschear)

v4.4.0

• #505 Fix flank auth login by using google-auth-library-java. (bootstraponline)
• #501 Fix nullability check in SavedMatrix. (bootstraponline)
• #493 Fix getDefaultBucket timeout. (bootstraponline)

v4.3.1

• #491 Fix shardTime when testShards is -1 (Macarse)

v4.3.0

• #436 Print how accurate test times are when using smart flank (Macarse)
• #462 Always find all iOS tests when sharding. (bootstraponline)
• #471 Add dynamic bucket counts for Smart Flank via shardTime (Macarse)
• #473 Add disableSharding flag (Macarse)
• #476 Retry matrix creation when FTL API errors. (bootstraponline)
• #477 Fix large number merging on iOS (bootstraponline)
• #478 Add iOS regular expression filtering for test-targets (Macarse)
• #479 Improve invalid iOS regex error message (bootstraponline)
• #481 Add iOS support for locale and orientation (Macarse)
• #482 Document Android code coverage with orchestrator on FTL (bootstraponline)
• #485 Replace : in folder name to improve Windows support. (Sunil-plsr)
• #487 Document all Flank YAML properties in README (bootstraponline)

v4.2.0

• Fix create Gcs bucket #444
• Add files-to-download to Android and iOS. Specify a list of regular expressions to download files from the Google Cloud Storage bucket. #441
• Add flank auth login to authorize with a user account instead of a service account. #446
• Add flaky-test-attempts support on Android and iOS which automatically retries failed tests. #454

v4.1.1

• Add support for parameterized iOS tests when shard count is 1. #435
• Add support for SkipTestIdentifiers when parsing iOS .xctestrun files. #435

v4.1.0

• app, test, and xctestrun-file now support ~, environment variables, and globs (*, **) when resolving paths. #386
• Add CLI support for flank android run and flank ios run
• Add experimental smartFlankGcsPath to shard iOS and Android tests by time using historical run data. The amount of shards used is set by testShards. #385
• Fix parsing empty testcase #402
• Add progress bar when uploading files. #403
• iOS iPhone 8 default device has been updated from 11.2 to 12.0.

v4.0.0

• Add flank cancel command. See flank cancel --help
• Add flank refresh command. See flank refresh --help
• Automatically detect projectId from service account credential
• Always generate aggregated JUnit XML reports
• Update HTML report to use create-react-app v2.1.0
• Add support for Xcode 10.1
• Improve test parsing to detect Swift tests that throw errors
• Update Flank exit codes, see readme for details.
• Link to matrix root when testing on multiple devices