test: Add 3dmark instrumented test #1783
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
CLA Assistant Lite bot All contributors have signed the CLA ✍️ ✅ |
|
Seems it requires a fix of ui-automator script, locally it works fine, on the emulator with the same resolution. |
jan-goral
changed the title
redfin-30-en-portrait 3dmark
NexusLowRes-30-en-portrait geekbench
NexusLowResEmulator-30-en-portrait geekbench
redfin-30-en-portrait geekbench
|
pawelpasterz
force-pushed
the
1771_ftl_benchmarks
branch
from
d773f49 to
90785ed
Compare
pawelpasterz
approved these changes
Apr 14, 2021
|
Timestamp: 2021-04-14 20:52:24 |
Sloox
approved these changes
Apr 15, 2021
| import flank.scripts.utils.runCommand | ||
| import java.nio.file.Paths | ||
|
|
||
| // TODO Design common abstraction for building apks and coping artifacts, add java doc. |
There was a problem hiding this comment.
Is it worth making a ticket so its not forgotten about?
| # For more details, see | ||
| # http://developer.android.com/guide/developing/tools/proguard.html | ||
|
|
||
| # If your project uses WebView with JS, uncomment the following |
There was a problem hiding this comment.
You can technically remove this file.
Everyline is commented out :)
|
@jan-gogo is it worth to add the pictures to documentation as it will be lost in this PR? |
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Fixes #1771
The instrumented test based on ui-automator should run a benchmark on the tested device.
The benchmark must be installed on the tested device.
Goal
Running the benchmark on FTL device and obtaining the benchmark results.
Config
https://github.com/Flank/flank/blob/1771_ftl_benchmarks/test_runner/src/test/kotlin/ftl/fixtures/benchmark.yml
Details
apkfile is specified usingadditional-apksoption/sdcard/Android/data/com.futuremark.dmandroid.application/files/3DMarkAndroid/Test Plan
copy
Geekbench 5_v5.3.2.apk3dmarkandroid-v2-1-4726.apkto
test_artifacts/1771_ftl_benchmarks/apk/benchmark/Devices
Results
3dmarkandroid-v2-1-4726.apk
Geekbench - all passed 836e622 firebase
PassMark
Checklist