[wptrunner] Add option to skip subtest checks for incomplete tests #44134
Community-TC Integration / tools/ unittests (Python 3.7)
succeeded
Jan 23, 2024 in 9m 7s
Community-TC (pull_request)
Unit tests for tools running under Python 3.7, excluding wptrunner
Details
View task in Taskcluster
View logs in Taskcluster
plugins: anyio-3.7.1, cov-4.1.0, hypothesis-6.78.2
collecting ...
collecting 48 items
collecting 501 items
collecting 854 items
collected 894 items
ci/tc/tests/test_decision.py .................. [ 2%]
ci/tc/tests/test_taskgraph.py ......... [ 3%]
ci/tc/tests/test_valid.py .......... [ 4%]
ci/tests/test_jobs.py ........... [ 5%]
gitignore/tests/test_gitignore.py ...................................... [ 9%]
............. [ 11%]
lint/tests/test_file_lints.py .......................................... [ 15%]
...................................................................... [ 23%]
lint/tests/test_lint.py ............................. [ 26%]
lint/tests/test_path_lints.py ...................................... [ 31%]
manifest/tests/test_XMLParser.py ......... [ 32%]
manifest/tests/test_item.py ............................................ [ 37%]
. [ 37%]
manifest/tests/test_manifest.py .......... [ 38%]
manifest/tests/test_sourcefile.py ...................................... [ 42%]
........................................................................ [ 50%]
................................................. [ 56%]
manifest/tests/test_utils.py . [ 56%]
metadata/meta/tests/test_schema.py ...... [ 56%]
metadata/tests/test_schema.py .................. [ 58%]
metadata/webfeatures/tests/test_schema.py ........ [ 59%]
metadata/yaml/tests/test_file.py ... [ 60%]
serve/test_functional.py . [ 60%]
serve/test_serve.py .s................ [ 62%]
third_party_modified/mozlog/tests/test_capture.py . [ 62%]
third_party_modified/mozlog/tests/test_errorsummary.py ..x. [ 62%]
third_party_modified/mozlog/tests/test_formatters.py ................... [ 64%]
............. [ 66%]
third_party_modified/mozlog/tests/test_logger.py ...... [ 67%]
third_party_modified/mozlog/tests/test_logtypes.py ......... [ 68%]
third_party_modified/mozlog/tests/test_structured.py ................... [ 70%]
..............................sss.......... [ 74%]
third_party_modified/mozlog/tests/test_terminal_colors.py s [ 75%]
web_features/tests/test_manifest.py ...... [ 75%]
web_features/tests/test_web_feature_map.py ..... [ 76%]
webtransport/h3/test_capsule.py sssssss [ 77%]
wptserve/tests/test_config.py .......xx................................. [ 81%]
.. [ 81%]
wptserve/tests/test_replacement_tokenizer.py .............. [ 83%]
wptserve/tests/test_request.py ..... [ 84%]
wptserve/tests/test_response.py .. [ 84%]
wptserve/tests/test_stash.py .. [ 84%]
wptserve/tests/functional/test_cookies.py .... [ 85%]
wptserve/tests/functional/test_handlers.py ............................. [ 88%]
................ [ 90%]
wptserve/tests/functional/test_input_file.py .............. [ 91%]
wptserve/tests/functional/test_pipes.py ................................ [ 95%]
... [ 95%]
wptserve/tests/functional/test_request.py .......... [ 96%]
wptserve/tests/functional/test_response.py .................... [ 98%]
wptserve/tests/functional/test_server.py ......... [ 99%]
wptserve/tests/functional/test_stash.py . [100%]
=============================== warnings summary ===============================
ci/tc/tests/test_valid.py: 64 warnings
/home/test/web-platform-tests/tools/.tox/py37/lib/python3.7/site-packages/jsonschema/validators.py:1115: DeprecationWarning: The metaschema specified by $schema was not found. Using the latest draft to validate, but this will raise an error in the future.
cls = validator_for(schema)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
---------- coverage: platform linux, python 3.7.17-final-0 -----------
Name Stmts Miss Branch BrPart Cover
---------------------------------------------------------------------------------------
__init__.py 1 0 0 0 100%
ci/__init__.py 0 0 0 0 100%
ci/jobs.py 82 18 46 3 76%
ci/macos_color_profile.py 19 19 8 0 0%
ci/make_hosts_file.py 12 12 0 0 0%
ci/manifest_build.py 148 148 42 0 0%
ci/regen_certs.py 37 37 4 0 0%
ci/run_tc.py 235 235 84 0 0%
ci/taskcluster-run.py 77 77 30 0 0%
ci/tc/__init__.py 0 0 0 0 100%
ci/tc/decision.py 250 62 121 5 77%
ci/tc/download.py 71 71 26 0 0%
ci/tc/github_checks_output.py 13 5 2 1 60%
ci/tc/sink_task.py 39 39 14 0 0%
ci/tc/taskgraph.py 124 9 70 9 91%
ci/update_built.py 37 37 14 0 0%
conftest.py 12 0 2 0 100%
docker/__init__.py 0 0 0 0 100%
docker/frontend.py 95 95 40 0 0%
docker/retry.py 39 39 10 0 0%
gitignore/__init__.py 0 0 0 0 100%
gitignore/gitignore.py 188 188 120 0 0%
lint/__init__.py 1 0 0 0 100%
lint/fnmatch.py 21 2 10 2 81%
lint/lint.py 641 99 389 23 84%
lint/rules.py 293 5 0 0 98%
localpaths.py 35 0 2 1 97%
manifest/XMLParser.py 91 2 14 1 97%
manifest/__init__.py 1 0 0 0 100%
manifest/download.py 138 111 50 0 14%
manifest/item.py 234 17 42 11 89%
manifest/jsonlib.py 44 21 14 5 48%
manifest/log.py 6 1 0 0 83%
manifest/manifest.py 226 83 100 13 60%
manifest/mputil.py 7 1 2 1 78%
manifest/sourcefile.py 581 45 269 34 90%
manifest/spec.py 43 43 6 0 0%
manifest/testpaths.py 56 56 18 0 0%
manifest/typedata.py 194 37 86 12 80%
manifest/update.py 46 29 8 1 33%
manifest/utils.py 54 14 16 6 66%
manifest/vcs.py 199 156 66 1 17%
metadata/__init__.py 0 0 0 0 100%
metadata/meta/__init__.py 0 0 0 0 100%
metadata/meta/schema.py 12 0 4 0 100%
metadata/schema.py 52 52 22 0 0%
metadata/webfeatures/__init__.py 0 0 0 0 100%
metadata/webfeatures/schema.py 36 36 18 0 0%
metadata/yaml/__init__.py 0 0 0 0 100%
metadata/yaml/load.py 9 0 0 0 100%
serve/__init__.py 1 0 0 0 100%
serve/serve.py 600 231 188 35 59%
serve/test_functional.py 44 2 2 1 93%
serve/test_serve.py 65 5 0 0 92%
serve/wave.py 78 78 22 0 0%
wave/__init__.py 0 0 0 0 100%
wave/configuration_loader.py 40 40 8 0 0%
wave/data/__init__.py 0 0 0 0 100%
wave/data/client.py 5 5 0 0 0%
wave/data/device.py 6 6 0 0 0%
wave/data/event_listener.py 7 7 0 0 0%
wave/data/exceptions/__init__.py 0 0 0 0 100%
wave/data/exceptions/duplicate_exception.py 2 2 0 0 0%
wave/data/exceptions/invalid_data_exception.py 2 2 0 0 0%
wave/data/exceptions/not_found_exception.py 2 2 0 0 0%
wave/data/exceptions/permission_denied_exception.py 2 2 0 0 0%
wave/data/http_polling_client.py 8 8 0 0 0%
wave/data/http_polling_event_listener.py 9 9 0 0 0%
wave/data/session.py 50 50 20 0 0%
wave/network/__init__.py 0 0 0 0 100%
wave/network/api/__init__.py 0 0 0 0 100%
wave/network/api/api_handler.py 74 74 22 0 0%
wave/network/api/devices_api_handler.py 155 155 54 0 0%
wave/network/api/general_api_handler.py 45 45 18 0 0%
wave/network/api/results_api_handler.py 186 186 48 0 0%
wave/network/api/sessions_api_handler.py 328 328 128 0 0%
wave/network/api/tests_api_handler.py 191 191 68 0 0%
wave/network/http_handler.py 85 85 28 0 0%
wave/network/static_handler.py 34 34 10 0 0%
wave/testing/__init__.py 0 0 0 0 100%
wave/testing/devices_manager.py 85 85 30 0 0%
wave/testing/event_dispatcher.py 104 104 54 0 0%
wave/testing/results_manager.py 494 494 240 0 0%
wave/testing/sessions_manager.py 327 327 168 0 0%
wave/testing/test_loader.py 145 145 98 0 0%
wave/testing/tests_manager.py 261 261 144 0 0%
wave/testing/wpt_report.py 24 24 8 0 0%
wave/utils/__init__.py 0 0 0 0 100%
wave/utils/deserializer.py 89 89 46 0 0%
wave/utils/serializer.py 14 14 4 0 0%
wave/utils/user_agent_parser.py 17 17 8 0 0%
wave/wave_server.py 50 50 6 0 0%
web_features/__init__.py 0 0 0 0 100%
web_features/manifest.py 67 3 14 1 95%
web_features/web_feature_map.py 46 0 24 1 99%
webtransport/__init__.py 0 0 0 0 100%
webtransport/h3/__init__.py 0 0 0 0 100%
webtransport/h3/capsule.py 62 62 22 0 0%
webtransport/h3/handler.py 13 13 0 0 0%
webtransport/h3/test_capsule.py 98 77 4 2 23%
webtransport/h3/webtransport_h3_server.py 327 327 96 0 0%
---------------------------------------------------------------------------------------
TOTAL 8741 5540 3351 169 35%
===== 879 passed, 12 skipped, 3 xfailed, 64 warnings in 367.02s (0:06:07) ======
py37: OK ✔ in 6 minutes 59.97 seconds
py37-flake8: install_deps> python -I -m pip install -r /home/test/web-platform-tests/tools/requirements_flake8.txt
py37-flake8: commands[0]> flake8 --append-config=/home/test/web-platform-tests/tools/flake8.ini
py37-flake8: OK ✔ in 8.11 seconds
py37-mypy: install_deps> python -I -m pip install -r /home/test/web-platform-tests/tools/requirements_mypy.txt
py37-mypy: commands[0] /home/test/web-platform-tests/tools/..> mypy --config-file=/home/test/web-platform-tests/tools/mypy.ini --explicit-package-bases tools
Success: no issues found in 305 source files
py37: OK (419.97=setup[51.84]+cmd[368.13] seconds)
py37-flake8: OK (8.11=setup[1.62]+cmd[6.49] seconds)
py37-mypy: OK (10.80=setup[3.34]+cmd[7.47] seconds)
congratulations :) (438.94 seconds)
+ export TOXENV=py37
+ TOXENV=py37
+ cd /home/test/web-platform-tests/tools/ci/../..
+ ./wpt test-jobs --includes wptrunner_unittest
+ cd tools/wptrunner
+ run_applicable_tox
+ local OLD_TOXENV=py37
+ unset TOXENV
++ tox -l
++ grep '^py37\(\-\|$\)'
++ tr '\n' ,
+ local RUN_ENVS=py37-base,
+ [[ -n py37-base, ]]
+ tox -e py37-base,
py37-base: install_deps> python -I -m pip install -r /home/test/web-platform-tests/tools/wptrunner/../requirements_pytest.txt -r /home/test/web-platform-tests/tools/wptrunner/requirements.txt
.pkg: install_requires> python -I -m pip install 'setuptools>=40.8.0' wheel
.pkg: _optional_hooks> python /home/test/.local/lib/python3.8/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__
.pkg: get_requires_for_build_sdist> python /home/test/.local/lib/python3.8/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__
.pkg: get_requires_for_build_wheel> python /home/test/.local/lib/python3.8/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__
.pkg: install_requires_for_build_wheel> python -I -m pip install wheel
.pkg: prepare_metadata_for_build_wheel> python /home/test/.local/lib/python3.8/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__
.pkg: build_sdist> python /home/test/.local/lib/python3.8/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__
py37-base: install_package> python -I -m pip install --force-reinstall --no-deps /home/test/web-platform-tests/tools/wptrunner/.tox/.tmp/package/1/wptrunner-1.14.tar.gz
py37-base: commands[0]> pytest -c/home/test/web-platform-tests/tools/wptrunner/../pytest.ini --rootdir=/home/test/web-platform-tests/tools/wptrunner
============================= test session starts ==============================
platform linux -- Python 3.7.17, pytest-7.4.4, pluggy-1.2.0
cachedir: .tox/py37-base/.pytest_cache
rootdir: /home/test/web-platform-tests/tools/wptrunner
configfile: ../pytest.ini
plugins: cov-4.1.0, hypothesis-6.78.2
collecting ...
collecting 135 items
collected 351 items
wptrunner/formatters/tests/test_chromium.py ................... [ 5%]
wptrunner/tests/test_executors.py ........ [ 7%]
wptrunner/tests/test_expectedtree.py ..... [ 9%]
wptrunner/tests/test_formatters.py ..... [ 10%]
wptrunner/tests/test_manifestexpected.py .......... [ 13%]
wptrunner/tests/test_manifestupdate.py . [ 13%]
wptrunner/tests/test_metadata.py ............ [ 17%]
wptrunner/tests/test_products.py sssssssssssssssssssssss................ [ 28%]
.......sssssssssssssssssssssss [ 36%]
wptrunner/tests/test_stability.py ...... [ 38%]
wptrunner/tests/test_testloader.py ........ [ 40%]
wptrunner/tests/test_update.py ......................................... [ 52%]
............... [ 56%]
wptrunner/tests/test_wptrunner.py . [ 56%]
wptrunner/tests/test_wpttest.py ......... [ 59%]
wptrunner/tests/browsers/test_base.py . [ 59%]
wptrunner/tests/browsers/test_sauce.py .......... [ 62%]
wptrunner/tests/browsers/test_webkitgtk.py sssssssssssssssssssssss [ 69%]
wptrunner/wptmanifest/tests/test_conditional.py ........ [ 71%]
wptrunner/wptmanifest/tests/test_parser.py ......... [ 74%]
wptrunner/wptmanifest/tests/test_serializer.py ......................... [ 81%]
.................. [ 86%]
wptrunner/wptmanifest/tests/test_static.py ...... [ 88%]
wptrunner/wptmanifest/tests/test_tokenizer.py .......................... [ 95%]
................ [100%]
======================= 282 passed, 69 skipped in 11.51s =======================
.pkg: _exit> python /home/test/.local/lib/python3.8/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__
py37-base: OK (20.98=setup[8.78]+cmd[12.20] seconds)
congratulations :) (21.04 seconds)
+ export TOXENV=py37
+ TOXENV=py37
+ cd /home/test/web-platform-tests/tools/ci/../..
[taskcluster 2024-01-23 02:22:46.834Z] === Task Finished ===
[taskcluster 2024-01-23 02:22:46.882Z] Successful task run with exit code: 0 completed in 546.067 seconds
Loading