Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix wpt run --list-test-groups #47114

Merged
merged 1 commit into from
Jul 19, 2024

Fix wpt run --list-test-groups

2cce79a
Select commit
Loading
Failed to load commit list.
Merged

Fix wpt run --list-test-groups #47114

Fix wpt run --list-test-groups
2cce79a
Select commit
Loading
Failed to load commit list.
Community-TC Integration / infrastructure/ tests succeeded Jul 19, 2024 in 18m 43s

Community-TC (pull_request)

Smoketests for wptrunner

Details

View task in Taskcluster
View logs in Taskcluster

WPT Command: python3 ./wpt run --log-tbpl=- --log-wptreport=../artifacts/wptreport-chrome.json --logcat-dir=../artifacts/ --metadata=infrastructure/metadata/ --include=infrastructure/ --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --no-headless --verify-log-full --enable-swiftshader --install-browser --install-webdriver chrome

WPT Command: python3 ./wpt run --log-tbpl=- --log-wptreport=../artifacts/wptreport-firefox.json --logcat-dir=../artifacts/ --metadata=infrastructure/metadata/ --include=infrastructure/ --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --no-headless --verify-log-full --binary=/home/test/build/firefox/firefox firefox

WPT Command: python3 ./wpt run --log-tbpl=- --log-wptreport=../artifacts/wptreport-firefox_android.json --logcat-dir=../artifacts/ --metadata=infrastructure/metadata/ --include=infrastructure/ --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --no-headless --verify-log-full --install-browser --install-webdriver --logcat-dir /home/test/artifacts/ firefox_android

 8:07.61 TEST_START: /infrastructure/reftest/reftest.https.html
TEST-START | /infrastructure/reftest/reftest.https.html
 8:08.17 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest.https.html | took 562ms
 8:08.17 TEST_START: /infrastructure/reftest/reftest.www.sub.html
TEST-START | /infrastructure/reftest/reftest.www.sub.html
 8:08.68 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest.www.sub.html | took 507ms
 8:08.68 TEST_START: /infrastructure/reftest/reftest_fuzzy_1.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_1.html
 8:09.44 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_1.html | took 762ms
 8:09.44 TEST_START: /infrastructure/reftest/reftest_fuzzy_ini_full.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_ini_full.html
 8:09.90 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_ini_full.html | took 459ms
 8:09.90 TEST_START: /infrastructure/reftest/reftest_fuzzy_ini_ref_only.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_ini_ref_only.html
 8:10.31 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_ini_ref_only.html | took 407ms
 8:10.31 TEST_START: /infrastructure/reftest/reftest_fuzzy_ini_short.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_ini_short.html
 8:10.70 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_ini_short.html | took 396ms
 8:10.70 TEST_START: /infrastructure/reftest/reftest_fuzzy_no_differences.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_no_differences.html
 8:11.15 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_no_differences.html | took 444ms
 8:11.15 TEST_START: /infrastructure/reftest/reftest_fuzzy_no_differences_1.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_no_differences_1.html
 8:11.51 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_no_differences_1.html | took 360ms
 8:11.51 TEST_START: /infrastructure/reftest/reftest_match.html
TEST-START | /infrastructure/reftest/reftest_match.html
 8:11.91 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_match.html | took 402ms
 8:11.91 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-0.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-0.html
 8:12.65 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-0.html | took 740ms
 8:12.65 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-1.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-1.html
 8:13.11 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-1.html | took 458ms
 8:13.11 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-2.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-2.html
 8:13.81 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_match_and_mismatch-2.html | took 697ms
 8:13.81 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-3.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-3.html
 8:14.26 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_match_and_mismatch-3.html | took 451ms
 8:14.26 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-4.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-4.html
 8:14.90 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-4.html | took 638ms
 8:14.90 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-5.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-5.html
 8:15.47 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-5.html | took 568ms
 8:15.47 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-6.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-6.html
 8:16.74 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-6.html | took 1273ms
 8:16.75 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-7.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-7.html
 8:17.12 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-7.html | took 377ms
 8:17.12 TEST_START: /infrastructure/reftest/reftest_match_fail.html
TEST-START | /infrastructure/reftest/reftest_match_fail.html
 8:17.55 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_fail.html | took 431ms
 8:17.55 TEST_START: /infrastructure/reftest/reftest_mismatch.html
TEST-START | /infrastructure/reftest/reftest_mismatch.html
 8:18.08 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_mismatch.html | took 531ms
 8:18.09 TEST_START: /infrastructure/reftest/reftest_mismatch_fail.html
TEST-START | /infrastructure/reftest/reftest_mismatch_fail.html
 8:18.53 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_mismatch_fail.html | took 443ms
 8:18.53 TEST_START: /infrastructure/reftest/reftest_multiple_match-0.html
TEST-START | /infrastructure/reftest/reftest_multiple_match-0.html
 8:19.59 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_multiple_match-0.html | took 1060ms
 8:19.59 TEST_START: /infrastructure/reftest/reftest_multiple_match-1.html
TEST-START | /infrastructure/reftest/reftest_multiple_match-1.html
 8:19.97 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_multiple_match-1.html | took 380ms
 8:19.97 TEST_START: /infrastructure/reftest/reftest_multiple_mismatch-0.html
TEST-START | /infrastructure/reftest/reftest_multiple_mismatch-0.html
 8:21.19 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_multiple_mismatch-0.html | took 1219ms
 8:21.19 TEST_START: /infrastructure/reftest/reftest_multiple_mismatch-1.html
TEST-START | /infrastructure/reftest/reftest_multiple_mismatch-1.html
 8:21.91 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_multiple_mismatch-1.html | took 723ms
 8:21.92 TEST_START: /infrastructure/reftest/reftest_ref_timeout.html
TEST-START | /infrastructure/reftest/reftest_ref_timeout.html
 8:42.00 TEST_END: TIMEOUT
TEST-TIMEOUT | /infrastructure/reftest/reftest_ref_timeout.html | took 20085ms
 8:42.00 TEST_START: /infrastructure/reftest/reftest_timeout.html
TEST-START | /infrastructure/reftest/reftest_timeout.html
 9:02.09 TEST_END: TIMEOUT
TEST-TIMEOUT | /infrastructure/reftest/reftest_timeout.html | took 20088ms
 9:02.09 TEST_START: /infrastructure/reftest/reftest_wait_0.html
TEST-START | /infrastructure/reftest/reftest_wait_0.html
mem avail: 11893 of 15806 MiB (75 %), swap free:    0 of    0 MiB ( 0 %)
 9:04.91 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_wait_0.html | took 2824ms
 9:04.91 TEST_START: /infrastructure/reftest/reftest_wait_TestRendered.html
TEST-START | /infrastructure/reftest/reftest_wait_TestRendered.html
 9:05.80 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_wait_TestRendered.html | took 891ms
 9:05.80 TEST_START: /infrastructure/reftest/reftest_window_load.html
TEST-START | /infrastructure/reftest/reftest_window_load.html
 9:06.66 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_window_load.html | took 860ms
 9:06.67 TEST_START: /infrastructure/reftest/size.html
TEST-START | /infrastructure/reftest/size.html
 9:07.47 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/size.html | took 806ms
 9:07.47 TEST_START: /infrastructure/reftest-wait.html
TEST-START | /infrastructure/reftest-wait.html
 9:09.33 TEST_END: PASS
TEST-PASS | /infrastructure/reftest-wait.html | took 1854ms
 9:09.33 INFO Restarting browser for new test group
Restarting browser for new test group
 9:09.78 INFO STDOUT: cleanup aborted: Unable to remount device
STDOUT: cleanup aborted: Unable to remount device
 9:09.95 INFO STDOUT: cleanup aborted: Unable to remount device
STDOUT: cleanup aborted: Unable to remount device
 9:09.57 INFO Closing logging queue
Closing logging queue
 9:09.57 INFO queue closed
queue closed
 9:10.13 INFO STDOUT: cleanup aborted: Unable to remount device
STDOUT: cleanup aborted: Unable to remount device
 9:10.14 INFO --certutil-binary not supplied; Firefox will not check certificates
--certutil-binary not supplied; Firefox will not check certificates
 9:10.28 INFO Starting WebDriver: /home/test/web-platform-tests/_venv3/bin/geckodriver --host 127.0.0.1 --port 0
Starting WebDriver: /home/test/web-platform-tests/_venv3/bin/geckodriver --host 127.0.0.1 --port 0
 9:10.50 pid:16541 Full command: /home/test/web-platform-tests/_venv3/bin/geckodriver --host 127.0.0.1 --port 0
pid:16541 1721400735271	geckodriver	INFO	Listening on 127.0.0.1:39685
PID 16541 | 1721400735271	geckodriver	INFO	Listening on 127.0.0.1:39685
 9:10.50 INFO Webdriver started successfully.
Webdriver started successfully.
 9:10.50 INFO Starting runner
Starting runner
 9:10.74 TEST_START: /infrastructure/webdriver/tests/test_load_file.py
TEST-START | /infrastructure/webdriver/tests/test_load_file.py
 9:11.26 INFO STDOUT: ============================= test session starts ==============================
STDOUT: ============================= test session starts ==============================
 9:11.26 INFO STDOUT: platform linux -- Python 3.8.10, pytest-8.2.1, pluggy-unknown -- /usr/bin/python3
STDOUT: platform linux -- Python 3.8.10, pytest-8.2.1, pluggy-unknown -- /usr/bin/python3
 9:11.26 INFO STDOUT: rootdir: /home/test/web-platform-tests
STDOUT: rootdir: /home/test/web-platform-tests
 9:11.26 INFO STDOUT: plugins: asyncio-0.19.0
STDOUT: plugins: asyncio-0.19.0
 9:11.26 INFO STDOUT: asyncio: mode=strict
STDOUT: asyncio: mode=strict
 9:11.26 INFO STDOUT: collecting ... 
STDOUT: collecting ... 
 9:11.30 INFO STDOUT: collected 1 item
STDOUT: collected 1 item
 9:11.30 INFO STDOUT: infrastructure/webdriver/tests/test_load_file.py::test_load 
STDOUT: infrastructure/webdriver/tests/test_load_file.py::test_load 
 9:11.36 pid:16541 1721400736167	mozdevice	INFO	Device is rooted
PID 16541 | 1721400736167	mozdevice	INFO	Device is rooted
 9:15.00 INFO STDOUT: PASSED
STDOUT: PASSED
 9:16.07 INFO STDOUT: ============================== 1 passed in 4.81s ===============================
STDOUT: ============================== 1 passed in 4.81s ===============================
TEST-PASS | /infrastructure/webdriver/tests/test_load_file.py | test_load 
 9:16.07 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/webdriver/tests/test_load_file.py | took 5327ms
 9:16.07 INFO Restarting browser for new test group
Restarting browser for new test group
 9:16.07 INFO Closing logging queue
Closing logging queue
 9:16.07 INFO queue closed
queue closed
 9:16.14 INFO --certutil-binary not supplied; Firefox will not check certificates
--certutil-binary not supplied; Firefox will not check certificates
 9:21.60 INFO STDOUT: timed out waiting for profiles.ini
STDOUT: timed out waiting for profiles.ini
 9:21.74 web-platform-tests INFO Granting important runtime permissions to org.mozilla.geckoview.test_runner
web-platform-tests Granting important runtime permissions to org.mozilla.geckoview.test_runner
 9:22.82 web-platform-tests INFO launch_application: am start -W -n org.mozilla.geckoview.test_runner/org.mozilla.geckoview.test_runner.TestRunnerActivity -a android.intent.action.MAIN --es env0 MOZ_CRASHREPORTER=1 --es env1 MOZ_CRASHREPORTER_NO_REPORT=1 --es env2 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env3 MOZ_HIDE_RESULTS_TABLE=1 --es env4 MOZ_IN_AUTOMATION=1 --es env5 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4 --es env6 R_LOG_LEVEL=6 --es env7 R_LOG_DESTINATION=stderr --es env8 R_LOG_VERBOSE=1 --es env9 MOZ_PROCESS_LOG=/tmp/tmp4jdjz8nwpidlog --es env10 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es arg0 -no-remote --es arg1 -profile --es arg2 /data/local/tmp/test_root/profile --es arg3 --marionette --es arg4 about:blank --ez use_multiprocess True
web-platform-tests launch_application: am start -W -n org.mozilla.geckoview.test_runner/org.mozilla.geckoview.test_runner.TestRunnerActivity -a android.intent.action.MAIN --es env0 MOZ_CRASHREPORTER=1 --es env1 MOZ_CRASHREPORTER_NO_REPORT=1 --es env2 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env3 MOZ_HIDE_RESULTS_TABLE=1 --es env4 MOZ_IN_AUTOMATION=1 --es env5 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4 --es env6 R_LOG_LEVEL=6 --es env7 R_LOG_DESTINATION=stderr --es env8 R_LOG_VERBOSE=1 --es env9 MOZ_PROCESS_LOG=/tmp/tmp4jdjz8nwpidlog --es env10 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es arg0 -no-remote --es arg1 -profile --es arg2 /data/local/tmp/test_root/profile --es arg3 --marionette --es arg4 about:blank --ez use_multiprocess True
 9:24.58 INFO Starting runner
Starting runner
 9:25.55 TEST_START: /infrastructure/crashtests/example.html
TEST-START | /infrastructure/crashtests/example.html
 9:26.01 TEST_END: PASS
TEST-PASS | /infrastructure/crashtests/example.html | took 460ms
 9:26.01 INFO No more tests
No more tests
 9:26.41 INFO STDOUT: cleanup aborted: Unable to remount device
STDOUT: cleanup aborted: Unable to remount device
 9:26.16 INFO Closing logging queue
Closing logging queue
 9:26.17 INFO queue closed
queue closed
 9:26.59 INFO STDOUT: cleanup aborted: Unable to remount device
STDOUT: cleanup aborted: Unable to remount device
 9:26.76 SUITE_END

web-platform-test
~~~~~~~~~~~~~~~~~
Ran 374 checks (219 subtests, 155 tests)
Expected results: 372
Skipped: 2 tests
Unexpected results: 0
OK
SUITE-END | took 426s
 9:26.76 INFO STDOUT: cleanup aborted: Unable to remount device
STDOUT: cleanup aborted: Unable to remount device
 9:26.77 INFO Got 0 unexpected results, with 0 unexpected passes
Got 0 unexpected results, with 0 unexpected passes
 9:26.79 wptserve INFO Stopped http server on 127.0.0.1:8001
wptserve Stopped http server on 127.0.0.1:8001
 9:26.82 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 9:26.83 wptserve INFO Stopped http server on 127.0.0.1:8444
wptserve Stopped http server on 127.0.0.1:8444
 9:26.93 wptserve INFO Stopped http server on 127.0.0.1:9000
wptserve Stopped http server on 127.0.0.1:9000
 9:27.09 wptserve INFO Stopped http server on 127.0.0.1:8000
wptserve Stopped http server on 127.0.0.1:8000
 9:27.10 wptserve INFO Stopped http server on 127.0.0.1:8445
wptserve Stopped http server on 127.0.0.1:8445
 9:27.13 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 9:27.13 wptserve INFO Stopped http server on 127.0.0.1:8002
wptserve Stopped http server on 127.0.0.1:8002
 9:27.16 wptserve INFO Stopped http server on 127.0.0.1:8446
wptserve Stopped http server on 127.0.0.1:8446
 9:27.21 wptserve INFO Stopped http server on 127.0.0.1:8443
wptserve Stopped http server on 127.0.0.1:8443
 9:27.23 wptserve INFO Stopped http server on 127.0.0.1:8003
wptserve Stopped http server on 127.0.0.1:8003
 9:27.26 INFO Removed font: Ahem.ttf
Removed font: Ahem.ttf
 9:27.29 INFO Closing logging queue
Closing logging queue
 9:27.29 INFO queue closed
queue closed
[taskcluster 2024-07-19 14:52:33.775Z] === Task Finished ===
[taskcluster 2024-07-19 14:52:35.529Z] Successful task run with exit code: 0 completed in 940.167 seconds
View more details on Community-TC Integration