Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve documentation in transforms #305

Merged
merged 2 commits into from
Dec 15, 2023

Add basic documentation to most transforms

4aa774c
Select commit
Loading
Failed to load commit list.
Merged

Improve documentation in transforms #305

Add basic documentation to most transforms
4aa774c
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / Decision Task (pull-request) succeeded Dec 15, 2023 in 1m 38s

FirefoxCI (pull_request)

The task that creates all of the other tasks in the task graph

Details

View task in Taskcluster
View logs in Taskcluster


[taskcluster 2023-12-15 18:57:53.164Z] Task ID: W5HdMidITDKt8_bp4ZXS1Q
[taskcluster 2023-12-15 18:57:53.165Z] Worker ID: 3010986894731321240
[taskcluster 2023-12-15 18:57:53.165Z] Worker Group: us-central1
[taskcluster 2023-12-15 18:57:53.165Z] Worker Node Type: projects/887720501152/machineTypes/n2-standard-2
[taskcluster 2023-12-15 18:57:53.165Z] Worker Pool: translations-1/decision-gcp
[taskcluster 2023-12-15 18:57:53.165Z] Worker Version: 38.0.5
[taskcluster 2023-12-15 18:57:53.165Z] Public IP: 34.29.168.186
[taskcluster 2023-12-15 18:57:53.165Z] Hostname: translations-1-decision-gcp-d1xdv3dytdexkm4k-zzw9w
[taskcluster 2023-12-15 18:57:53.165Z] using cache "translations-level-1-checkouts-sparse-v2" -> /builds/worker/checkouts

62074584a67e - Started downloading
5544ebdc0c7b - Started downloading
5544ebdc0c7b - Downloaded in 0.246 seconds
62074584a67e - Downloaded in 0.658 seconds
Digest: sha256:ef132cc5741539f846a85bbe0cebc3c9ead30b8f24c1da46c55363f2170c3993
Status: Downloaded newer image for mozillareleases/taskgraph@sha256:ef132cc5741539f846a85bbe0cebc3c9ead30b8f24c1da46c55363f2170c3993
[taskcluster 2023-12-15 18:58:01.553Z] === Task Starting ===
[setup 2023-12-15T18:58:02.697Z] run-task started in /
[vcs 2023-12-15T18:58:02.699Z] WARNING: vcs checkout path (/builds/worker/checkouts/src) not in cache or volume; performance will likely suffer
[setup 2023-12-15T18:58:02.699Z] running as worker:worker
[vcs 2023-12-15T18:58:02.699Z] executing ['git', 'clone', 'https://github.com/mozilla/firefox-translations-training', '/builds/worker/checkouts/src']
[vcs 2023-12-15T18:58:02.702Z] Cloning into '/builds/worker/checkouts/src'...
[vcs 2023-12-15T18:58:03.805Z] executing ['git', 'fetch', 'origin', 'main']
[vcs 2023-12-15T18:58:03.980Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2023-12-15T18:58:03.980Z]  * branch            main       -> FETCH_HEAD
[vcs 2023-12-15T18:58:03.987Z] executing ['git', 'checkout', 'main']
[vcs 2023-12-15T18:58:04.006Z] Already on 'main'
[vcs 2023-12-15T18:58:04.007Z] Your branch is up to date with 'origin/main'.
[vcs 2023-12-15T18:58:04.008Z] executing ['git', 'fetch', 'origin', '1273a0ef3f4a06f4eef9d8493e40a5848662b8de']
[vcs 2023-12-15T18:58:04.170Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2023-12-15T18:58:04.170Z]  * branch            1273a0ef3f4a06f4eef9d8493e40a5848662b8de -> FETCH_HEAD
[vcs 2023-12-15T18:58:04.175Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/bhearsum/firefox-translations-training', 'followup']
[vcs 2023-12-15T18:58:04.401Z] From https://github.com/bhearsum/firefox-translations-training
[vcs 2023-12-15T18:58:04.401Z]  * branch            followup   -> FETCH_HEAD
[vcs 2023-12-15T18:58:04.408Z] executing ['git', 'checkout', '-f', '-B', 'followup', '4aa774c2a9f31b93627bcac82e0c235839cb7c0e']
[vcs 2023-12-15T18:58:04.414Z] Switched to a new branch 'followup'
[vcs 2023-12-15T18:58:04.414Z] executing ['git', 'submodule', 'init']
[vcs 2023-12-15T18:58:04.435Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2023-12-15T18:58:04.436Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2023-12-15T18:58:04.437Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2023-12-15T18:58:04.439Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2023-12-15T18:58:04.440Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2023-12-15T18:58:04.441Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2023-12-15T18:58:04.442Z] executing ['git', 'submodule', 'update']
[vcs 2023-12-15T18:58:04.463Z] Cloning into '/builds/worker/checkouts/src/3rd_party/browsermt-marian-dev'...
[vcs 2023-12-15T18:58:08.131Z] Cloning into '/builds/worker/checkouts/src/3rd_party/extract-lex'...
[vcs 2023-12-15T18:58:08.391Z] Cloning into '/builds/worker/checkouts/src/3rd_party/fast_align'...
[vcs 2023-12-15T18:58:08.673Z] Cloning into '/builds/worker/checkouts/src/3rd_party/kenlm'...
[vcs 2023-12-15T18:58:09.984Z] Cloning into '/builds/worker/checkouts/src/3rd_party/marian-dev'...
[vcs 2023-12-15T18:58:12.510Z] Cloning into '/builds/worker/checkouts/src/3rd_party/preprocess'...
[vcs 2023-12-15T18:58:13.111Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2023-12-15T18:58:13.132Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2023-12-15T18:58:13.153Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2023-12-15T18:58:13.188Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2023-12-15T18:58:13.305Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2023-12-15T18:58:13.334Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2023-12-15T18:58:13.335Z] cleaning git checkout...
[vcs 2023-12-15T18:58:13.335Z] executing ['git', 'clean', '-nxdff']
[vcs 2023-12-15T18:58:13.339Z] removing []
[vcs 2023-12-15T18:58:13.339Z] successfully cleaned git checkout!
[vcs 2023-12-15T18:58:13.342Z] TinderboxPrint:<a href='https://github.com/bhearsum/firefox-translations-training/commit/4aa774c2a9f31b93627bcac82e0c235839cb7c0e' title='Built from firefox-translations-training commit 4aa774c2a9f31b93627bcac82e0c235839cb7c0e'>4aa774c2a9f31b93627bcac82e0c235839cb7c0e</a>
[pip-install 2023-12-15T18:58:13.343Z] executing ['/usr/bin/python3', '-mpip', 'install', '--require-hashes', '-r', '/builds/worker/checkouts/src/taskcluster/requirements.txt']
[pip-install 2023-12-15T18:58:13.601Z] Defaulting to user installation because normal site-packages is not writeable
[pip-install 2023-12-15T18:58:13.658Z] Requirement already satisfied: appdirs==1.4.4 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 7)) (1.4.4)
[pip-install 2023-12-15T18:58:13.659Z] Requirement already satisfied: arrow==1.2.3 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 11)) (1.2.3)
[pip-install 2023-12-15T18:58:13.660Z] Requirement already satisfied: binaryornot==0.4.4 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 15)) (0.4.4)
[pip-install 2023-12-15T18:58:13.661Z] Requirement already satisfied: certifi==2022.12.7 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 19)) (2022.12.7)
[pip-install 2023-12-15T18:58:13.663Z] Requirement already satisfied: chardet==5.1.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 23)) (5.1.0)
[pip-install 2023-12-15T18:58:13.664Z] Requirement already satisfied: charset-normalizer==3.0.1 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 27)) (3.0.1)
[pip-install 2023-12-15T18:58:13.665Z] Requirement already satisfied: click==8.1.3 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 117)) (8.1.3)
[pip-install 2023-12-15T18:58:13.666Z] Requirement already satisfied: cookiecutter==2.1.1 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 121)) (2.1.1)
[pip-install 2023-12-15T18:58:13.667Z] Requirement already satisfied: giturlparse==0.10.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 125)) (0.10.0)
[pip-install 2023-12-15T18:58:13.669Z] Requirement already satisfied: idna==3.4 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 129)) (3.4)
[pip-install 2023-12-15T18:58:13.670Z] Requirement already satisfied: jinja2==3.1.2 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 133)) (3.1.2)
[pip-install 2023-12-15T18:58:13.671Z] Requirement already satisfied: jinja2-time==0.2.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 139)) (0.2.0)
[pip-install 2023-12-15T18:58:13.672Z] Requirement already satisfied: json-e==4.5.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 143)) (4.5.0)
[pip-install 2023-12-15T18:58:13.673Z] Requirement already satisfied: markupsafe==2.1.2 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 147)) (2.1.2)
[pip-install 2023-12-15T18:58:13.674Z] Requirement already satisfied: mozilla-repo-urls==0.1.1 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 199)) (0.1.1)
[pip-install 2023-12-15T18:58:13.675Z] Requirement already satisfied: python-dateutil==2.8.2 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 203)) (2.8.2)
[pip-install 2023-12-15T18:58:13.676Z] Requirement already satisfied: python-slugify==8.0.1 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 207)) (8.0.1)
[pip-install 2023-12-15T18:58:13.677Z] Requirement already satisfied: pyyaml==6.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 211)) (6.0)
[pip-install 2023-12-15T18:58:13.678Z] Requirement already satisfied: redo==2.0.4 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 255)) (2.0.4)
[pip-install 2023-12-15T18:58:13.679Z] Requirement already satisfied: requests==2.28.2 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 259)) (2.28.2)
[pip-install 2023-12-15T18:58:13.680Z] Requirement already satisfied: requests-unixsocket==0.3.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 266)) (0.3.0)
[pip-install 2023-12-15T18:58:13.681Z] Requirement already satisfied: six==1.16.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 270)) (1.16.0)
[pip-install 2023-12-15T18:58:13.682Z] Requirement already satisfied: slugid==2.0.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 274)) (2.0.0)
[pip-install 2023-12-15T18:58:13.793Z] Collecting taskcluster-taskgraph==6.2.0
[pip-install 2023-12-15T18:58:13.956Z]   Downloading taskcluster_taskgraph-6.2.0-py3-none-any.whl (187 kB)
[pip-install 2023-12-15T18:58:14.056Z] Requirement already satisfied: taskcluster-urls==13.0.1 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 282)) (13.0.1)
[pip-install 2023-12-15T18:58:14.058Z] Requirement already satisfied: text-unidecode==1.3 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 287)) (1.3)
[pip-install 2023-12-15T18:58:14.059Z] Requirement already satisfied: urllib3==1.26.14 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 291)) (1.26.14)
[pip-install 2023-12-15T18:58:14.060Z] Requirement already satisfied: voluptuous==0.13.1 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 295)) (0.13.1)
[pip-install 2023-12-15T18:58:14.189Z] Installing collected packages: taskcluster-taskgraph
[pip-install 2023-12-15T18:58:14.274Z]   WARNING: The script taskgraph is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2023-12-15T18:58:14.274Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2023-12-15T18:58:14.278Z] Successfully installed taskcluster-taskgraph-6.2.0
[pip-install 2023-12-15T18:58:14.411Z] WARNING: You are using pip version 21.1.3; however, version 23.3.1 is available.
[pip-install 2023-12-15T18:58:14.411Z] You should consider upgrading via the '/usr/bin/python3 -m pip install --upgrade pip' command.
[task 2023-12-15T18:58:14.462Z] executing ['bash', '-cx', "cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && ~/.local/bin/taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='main' --base-rev='1273a0ef3f4a06f4eef9d8493e40a5848662b8de' --head-repository='https://github.com/bhearsum/firefox-translations-training' --head-ref='followup' --head-rev='4aa774c2a9f31b93627bcac82e0c235839cb7c0e' \n"]
[task 2023-12-15T18:58:14.465Z] + cd /builds/worker/checkouts/src
[task 2023-12-15T18:58:14.465Z] + ln -s /builds/worker/artifacts artifacts
[task 2023-12-15T18:58:14.466Z] + /builds/worker/.local/bin/taskgraph decision --pushlog-id=0 --pushdate=0 --project=firefox-translations-training [email protected] --level=1 --repository-type=git --tasks-for=github-pull-request --base-repository=https://github.com/mozilla/firefox-translations-training --base-ref=main --base-rev=1273a0ef3f4a06f4eef9d8493e40a5848662b8de --head-repository=https://github.com/bhearsum/firefox-translations-training --head-ref=followup --head-rev=4aa774c2a9f31b93627bcac82e0c235839cb7c0e
[task 2023-12-15T18:58:14.850Z] 2023-12-15 18:58:14,849 - INFO - Loading graph configuration.
[task 2023-12-15T18:58:14.871Z] 2023-12-15 18:58:14,871 - WARNING - using default project parameters; add firefox-translations-training to PER_PROJECT_PARAMETERS in /builds/worker/.local/lib/python3.8/site-packages/taskgraph/decision.py to customize behavior for this project
[task 2023-12-15T18:58:14.872Z] 2023-12-15 18:58:14,872 - INFO - Using Parameters(id=01c12378106b) (from defaults)
[task 2023-12-15T18:58:14.874Z] 2023-12-15 18:58:14,874 - INFO - writing artifact file `parameters.yml`
[task 2023-12-15T18:58:14.884Z] 2023-12-15 18:58:14,884 - INFO - writing artifact file `actions.json`
[task 2023-12-15T18:58:14.886Z] 2023-12-15 18:58:14,886 - INFO - Loading kinds
[task 2023-12-15T18:58:15.231Z] 2023-12-15 18:58:15,231 - INFO - Generating full task set
[task 2023-12-15T18:58:15.259Z] 2023-12-15 18:58:15,259 - INFO - Generated 7 tasks for kind dataset
[task 2023-12-15T18:58:15.261Z] 2023-12-15 18:58:15,261 - INFO - Writing docker-contexts/base.tar.gz for docker image base
[task 2023-12-15T18:58:15.278Z] 2023-12-15 18:58:15,278 - INFO - Writing docker-contexts/test.tar.gz for docker image test
[task 2023-12-15T18:58:15.279Z] 2023-12-15 18:58:15,279 - INFO - Writing docker-contexts/train.tar.gz for docker image train
[task 2023-12-15T18:58:15.280Z] 2023-12-15 18:58:15,280 - INFO - Writing docker-contexts/toolchain-build.tar.gz for docker image toolchain-build
[task 2023-12-15T18:58:15.297Z] 2023-12-15 18:58:15,297 - INFO - Generated 4 tasks for kind docker-image
[task 2023-12-15T18:58:15.424Z] 2023-12-15 18:58:15,424 - INFO - Generated 63 tasks for kind fetch
[task 2023-12-15T18:58:15.429Z] 2023-12-15 18:58:15,429 - INFO - Generated 6 tasks for kind tests
[task 2023-12-15T18:58:15.483Z] 2023-12-15 18:58:15,483 - INFO - Generated 8 tasks for kind toolchain
[task 2023-12-15T18:58:15.487Z] 2023-12-15 18:58:15,487 - INFO - Generated 2 tasks for kind clean-corpus
[task 2023-12-15T18:58:15.491Z] 2023-12-15 18:58:15,491 - INFO - Generated 2 tasks for kind bicleaner
[task 2023-12-15T18:58:15.495Z] 2023-12-15 18:58:15,495 - INFO - Generated 2 tasks for kind clean-mono
[task 2023-12-15T18:58:15.500Z] 2023-12-15 18:58:15,499 - INFO - Generated 1 tasks for kind merge-corpus
[task 2023-12-15T18:58:15.503Z] 2023-12-15 18:58:15,503 - INFO - Generated 2 tasks for kind merge-mono
[task 2023-12-15T18:58:15.505Z] 2023-12-15 18:58:15,505 - INFO - Generated 1 tasks for kind train-vocab
[task 2023-12-15T18:58:15.508Z] 2023-12-15 18:58:15,508 - INFO - Generated 1 tasks for kind split-corpus
[task 2023-12-15T18:58:15.510Z] 2023-12-15 18:58:15,510 - INFO - Generated 1 tasks for kind merge-devset
[task 2023-12-15T18:58:15.514Z] 2023-12-15 18:58:15,514 - INFO - Generated 1 tasks for kind train-backwards
[task 2023-12-15T18:58:15.517Z] 2023-12-15 18:58:15,517 - INFO - Generated 1 tasks for kind split-mono-src
[task 2023-12-15T18:58:15.519Z] 2023-12-15 18:58:15,519 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2023-12-15T18:58:15.524Z] 2023-12-15 18:58:15,524 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2023-12-15T18:58:15.527Z] 2023-12-15 18:58:15,527 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2023-12-15T18:58:15.531Z] 2023-12-15 18:58:15,531 - INFO - Generated 1 tasks for kind train-teacher
[task 2023-12-15T18:58:15.535Z] 2023-12-15 18:58:15,535 - INFO - Generated 2 tasks for kind translate-corpus
[task 2023-12-15T18:58:15.538Z] 2023-12-15 18:58:15,538 - INFO - Generated 2 tasks for kind extract-best
[task 2023-12-15T18:58:15.541Z] 2023-12-15 18:58:15,541 - INFO - Generated 1 tasks for kind collect-corpus
[task 2023-12-15T18:58:15.544Z] 2023-12-15 18:58:15,544 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2023-12-15T18:58:15.547Z] 2023-12-15 18:58:15,547 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2023-12-15T18:58:15.549Z] 2023-12-15 18:58:15,549 - INFO - Generated 1 tasks for kind merge-translated
[task 2023-12-15T18:58:15.552Z] 2023-12-15 18:58:15,552 - INFO - Generated 1 tasks for kind score
[task 2023-12-15T18:58:15.554Z] 2023-12-15 18:58:15,554 - INFO - Generated 1 tasks for kind cefilter
[task 2023-12-15T18:58:15.556Z] 2023-12-15 18:58:15,556 - INFO - Generated 1 tasks for kind alignments
[task 2023-12-15T18:58:15.558Z] 2023-12-15 18:58:15,558 - INFO - Generated 1 tasks for kind train-student
[task 2023-12-15T18:58:15.561Z] 2023-12-15 18:58:15,561 - INFO - Generated 1 tasks for kind finetune-student
[task 2023-12-15T18:58:15.567Z] 2023-12-15 18:58:15,567 - INFO - Generated 4 tasks for kind evaluate
[task 2023-12-15T18:58:15.570Z] 2023-12-15 18:58:15,570 - INFO - Generated 1 tasks for kind quantize
[task 2023-12-15T18:58:15.572Z] 2023-12-15 18:58:15,572 - INFO - Generated 1 tasks for kind export
[task 2023-12-15T18:58:15.575Z] 2023-12-15 18:58:15,575 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2023-12-15T18:58:15.578Z] 2023-12-15 18:58:15,578 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2023-12-15T18:58:15.579Z] 2023-12-15 18:58:15,579 - INFO - Generated 1 tasks for kind all
[task 2023-12-15T18:58:15.585Z] 2023-12-15 18:58:15,585 - INFO - Generated 1 tasks for kind all-pr
[task 2023-12-15T18:58:15.586Z] 2023-12-15 18:58:15,586 - INFO - Generating full task graph
[task 2023-12-15T18:58:15.587Z] 2023-12-15 18:58:15,586 - INFO - Full task graph contains 131 tasks and 270 dependencies
[task 2023-12-15T18:58:15.592Z] 2023-12-15 18:58:15,592 - INFO - writing artifact file `full-task-graph.json`
[task 2023-12-15T18:58:15.622Z] 2023-12-15 18:58:15,622 - INFO - writing artifact file `runnable-jobs.json`
[task 2023-12-15T18:58:15.624Z] 2023-12-15 18:58:15,624 - INFO - Generating target task set
[task 2023-12-15T18:58:15.625Z] 2023-12-15 18:58:15,625 - INFO - Filter filter_target_tasks pruned 116 tasks (15 remain)
[task 2023-12-15T18:58:15.625Z] 2023-12-15 18:58:15,625 - INFO - writing artifact file `target-tasks.json`
[task 2023-12-15T18:58:15.625Z] 2023-12-15 18:58:15,625 - INFO - Generating target task graph
[task 2023-12-15T18:58:15.628Z] 2023-12-15 18:58:15,625 - INFO - Adding 4 tasks with `always_target` attribute
[task 2023-12-15T18:58:15.628Z] 2023-12-15 18:58:15,627 - INFO - Generating optimized task graph
[task 2023-12-15T18:58:15.630Z] 2023-12-15 18:58:15,629 - INFO - Removed 2 tasks by skip-unless-changed (skip-unless-changed) during optimization.
[task 2023-12-15T18:58:18.089Z] 2023-12-15 18:58:18,089 - INFO - Replaced 18 tasks by index-search (index-search) during optimization.
[task 2023-12-15T18:58:18.094Z] 2023-12-15 18:58:18,094 - INFO - writing artifact file `task-graph.json`
[task 2023-12-15T18:58:18.107Z] 2023-12-15 18:58:18,107 - INFO - writing artifact file `label-to-taskid.json`
[task 2023-12-15T18:58:18.110Z] 2023-12-15 18:58:18,110 - INFO - Creating task with taskId BsNIwQ5jT9GBtqmg4LEJuQ for dataset-flores-devtest-ru-en
[task 2023-12-15T18:58:18.112Z] 2023-12-15 18:58:18,112 - INFO - Creating task with taskId JFsmTdjPSAuRu00B4DF2rg for dataset-opus-ada83_v1-ru-en
[task 2023-12-15T18:58:18.115Z] 2023-12-15 18:58:18,115 - INFO - Creating task with taskId Y5fnD3wRQuivspwdE9bUAg for build-docker-image-test
[task 2023-12-15T18:58:18.119Z] 2023-12-15 18:58:18,118 - INFO - Creating task with taskId Lp7o3qhzRsSGoMPk1oLJzw for tests-taskgraph-diff
[task 2023-12-15T18:58:18.128Z] 2023-12-15 18:58:18,120 - INFO - Creating task with taskId MXsnNyt9QSKtZ75sSrRBxA for dataset-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2023-12-15T18:58:18.130Z] 2023-12-15 18:58:18,121 - INFO - Creating task with taskId NKnB1GjgRemGXx9MAmVd4Q for dataset-sacrebleu-aug-mix_wmt19-ru-en
[task 2023-12-15T18:58:18.132Z] 2023-12-15 18:58:18,121 - INFO - Creating task with taskId KqNz22mKQXmPyC5P-I7xpw for dataset-news-crawl-news_2008-ru
[task 2023-12-15T18:58:18.136Z] 2023-12-15 18:58:18,122 - INFO - Creating task with taskId YQv73F16Sf2eCX5J7jnVKA for toolchain-browsermt-marian
[task 2023-12-15T18:58:18.140Z] 2023-12-15 18:58:18,122 - INFO - Creating task with taskId Vmjm7ZOYQyqhNvt57mD8Yg for dataset-news-crawl-news_2007-en
[task 2023-12-15T18:58:18.143Z] 2023-12-15 18:58:18,122 - INFO - Creating task with taskId Y07jWQYqSeKOqP2NuIwQ8Q for tests-taskgraph-definition
[task 2023-12-15T18:58:18.144Z] 2023-12-15 18:58:18,123 - INFO - Creating task with taskId LmSU5eo3RxyI3YizEJkH0Q for dataset-flores-dev-ru-en
[task 2023-12-15T18:58:18.145Z] 2023-12-15 18:58:18,123 - INFO - Creating task with taskId UswGrfJxS6y5QkebjwySaQ for toolchain-marian
[task 2023-12-15T18:58:18.283Z] 2023-12-15 18:58:18,283 - INFO - Creating task with taskId aNCI8gwJQzqUtfuiEG8HkQ for clean-corpus-opus-ada83_v1-ru-en
[task 2023-12-15T18:58:18.376Z] 2023-12-15 18:58:18,376 - INFO - Creating task with taskId YB0r7x8ARpyrAK1GIxkyWw for tests-lint
[task 2023-12-15T18:58:18.384Z] 2023-12-15 18:58:18,377 - INFO - Creating task with taskId T_YRtEI8TBm4Ib7hoU2RzA for clean-corpus-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2023-12-15T18:58:18.384Z] 2023-12-15 18:58:18,382 - INFO - Creating task with taskId YhGWAPklTIaV7vwphAn0BQ for clean-mono-news-crawl-ru-news_2008-mono-src
[task 2023-12-15T18:58:18.386Z] 2023-12-15 18:58:18,384 - INFO - Creating task with taskId BJgP-X3KRCSH39mCBSfgSg for tests-black
[task 2023-12-15T18:58:18.386Z] 2023-12-15 18:58:18,386 - INFO - Creating task with taskId Xlf1U6RHSXCei3fDqbeb8Q for clean-mono-news-crawl-en-news_2007-mono-trg
[task 2023-12-15T18:58:18.389Z] 2023-12-15 18:58:18,389 - INFO - Creating task with taskId ZZG_Hfw3TNa5hgmEyii0oA for bicleaner-opus-ada83_v1-ru-en
[task 2023-12-15T18:58:18.390Z] 2023-12-15 18:58:18,390 - INFO - Creating task with taskId dOPCtXWeSKOmtf_0oBawMQ for merge-devset-ru-en
[task 2023-12-15T18:58:18.471Z] 2023-12-15 18:58:18,471 - INFO - Creating task with taskId XaaxeW8yR9-q6BWkN4XcbQ for bicleaner-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2023-12-15T18:58:18.593Z] 2023-12-15 18:58:18,593 - INFO - Creating task with taskId KAFn2cQEQgSu_gb9x2LXpg for merge-mono-trg-en
[task 2023-12-15T18:58:18.597Z] 2023-12-15 18:58:18,595 - INFO - Creating task with taskId Ohh6Fa8HTdODh5lI_wF5bQ for merge-corpus-ru-en
[task 2023-12-15T18:58:18.600Z] 2023-12-15 18:58:18,598 - INFO - Creating task with taskId RLkXh5cgSQaYGaiDspw3cg for merge-mono-src-ru
[task 2023-12-15T18:58:18.693Z] 2023-12-15 18:58:18,693 - INFO - Creating task with taskId Qfgw_sqlR7KSO6fTw7Y6og for split-mono-src-ru
[task 2023-12-15T18:58:18.825Z] 2023-12-15 18:58:18,825 - INFO - Creating task with taskId EMDJom-wTlyAEfnnYISxAg for train-vocab-ru-en
[task 2023-12-15T18:58:18.826Z] 2023-12-15 18:58:18,825 - INFO - Creating task with taskId eC5pMSkARX2VedAW6wY32w for split-corpus-ru-en
[task 2023-12-15T18:58:18.830Z] 2023-12-15 18:58:18,826 - INFO - Creating task with taskId VVnCkPmzQrOV-QlZ5xvQTg for split-mono-trg-en
[task 2023-12-15T18:58:18.949Z] 2023-12-15 18:58:18,947 - INFO - Creating task with taskId bkumcnw0QvmsIvi8FxJIew for train-backwards-ru-en
[task 2023-12-15T18:58:19.037Z] 2023-12-15 18:58:19,037 - INFO - Creating task with taskId fkiA6nz3Rqe3xkCiUV9MmQ for translate-mono-trg-ru-en-2/2
[task 2023-12-15T18:58:19.041Z] 2023-12-15 18:58:19,037 - INFO - Creating task with taskId INbuB_htSPi_ugkR-2-lcA for translate-mono-trg-ru-en-1/2
[task 2023-12-15T18:58:19.042Z] 2023-12-15 18:58:19,041 - INFO - Creating task with taskId A8ANoUVxRiSYU0SMVxnLMQ for evaluate-backward-flores-devtest-ru-en
[task 2023-12-15T18:58:19.169Z] 2023-12-15 18:58:19,169 - INFO - Creating task with taskId ASVH6lACSvyrBa9OEeIhPw for collect-mono-trg-ru-en
[task 2023-12-15T18:58:19.409Z] 2023-12-15 18:58:19,409 - INFO - Creating task with taskId KO-WKTkfQWW1jB07XGd5Fw for train-teacher-ru-en-1/1
[task 2023-12-15T18:58:19.572Z] 2023-12-15 18:58:19,572 - INFO - Creating task with taskId Vaqe1TGrSVuwBN16igju4w for translate-mono-src-ru-en-2/2
[task 2023-12-15T18:58:19.573Z] 2023-12-15 18:58:19,572 - INFO - Creating task with taskId U7ujyJZATuy-0FSqB7Jb7A for translate-mono-src-ru-en-1/2
[task 2023-12-15T18:58:19.575Z] 2023-12-15 18:58:19,573 - INFO - Creating task with taskId IIcCFE2zQ1eiMDPTqtEaHQ for evaluate-teacher-flores-flores_devtest-ru-en-1/1
[task 2023-12-15T18:58:19.576Z] 2023-12-15 18:58:19,573 - INFO - Creating task with taskId P_vhfFVxRnqFAAclRbB2lA for translate-corpus-ru-en-1/2
[task 2023-12-15T18:58:19.578Z] 2023-12-15 18:58:19,573 - INFO - Creating task with taskId IVV4UGw6SLeqhbT_IVraRg for evaluate-teacher-ensemble-flores-flores_devtest-ru-en
[task 2023-12-15T18:58:19.579Z] 2023-12-15 18:58:19,574 - INFO - Creating task with taskId bdv1vvc-SmGMixpnN4Amtg for translate-corpus-ru-en-2/2
[task 2023-12-15T18:58:19.680Z] 2023-12-15 18:58:19,680 - INFO - Creating task with taskId BPQUNWqHTNO1qQiWpAj5Ww for collect-mono-src-ru-en
[task 2023-12-15T18:58:19.780Z] 2023-12-15 18:58:19,780 - INFO - Creating task with taskId ZeGAiU9MTlSPdqgHhSN82Q for extract-best-ru-en-2/2
[task 2023-12-15T18:58:19.783Z] 2023-12-15 18:58:19,782 - INFO - Creating task with taskId KH0K73xCS1WZmur24jjxpA for extract-best-ru-en-1/2
[task 2023-12-15T18:58:19.898Z] 2023-12-15 18:58:19,898 - INFO - Creating task with taskId GZHD5acXTcmYgDU-zHgnrw for collect-corpus-ru-en
[task 2023-12-15T18:58:20.000Z] 2023-12-15 18:58:20,000 - INFO - Creating task with taskId MwVpAguxTnSoI7_3xgyIHg for merge-translated-ru-en
[task 2023-12-15T18:58:20.118Z] 2023-12-15 18:58:20,118 - INFO - Creating task with taskId e-CVzR0gSoG2iWstvgxdsA for score-ru-en
[task 2023-12-15T18:58:20.221Z] 2023-12-15 18:58:20,221 - INFO - Creating task with taskId dsdbmRwdQkiG1zvb9zV_jw for cefilter-ru-en
[task 2023-12-15T18:58:20.347Z] 2023-12-15 18:58:20,347 - INFO - Creating task with taskId DL7gwpSAShm_ai7w1oCVxQ for alignments-ru-en
[task 2023-12-15T18:58:20.461Z] 2023-12-15 18:58:20,461 - INFO - Creating task with taskId JL8deLB0S8qbaC7HS9070Q for train-student-ru-en
[task 2023-12-15T18:58:20.576Z] 2023-12-15 18:58:20,576 - INFO - Creating task with taskId elbNjKtuSsan2tJ7KsygOQ for evaluate-student-flores-devtest-ru-en
[task 2023-12-15T18:58:20.578Z] 2023-12-15 18:58:20,578 - INFO - Creating task with taskId PgvZNVcgR1CnOcezZWWu5w for finetune-student-ru-en
[task 2023-12-15T18:58:20.671Z] 2023-12-15 18:58:20,671 - INFO - Creating task with taskId Qco6NEzPTeGFJ91F5H_9Hw for quantize-ru-en
[task 2023-12-15T18:58:20.674Z] 2023-12-15 18:58:20,673 - INFO - Creating task with taskId VBmqpXvQTuKCHH69LcFRJA for evaluate-finetuned-student-flores-devtest-ru-en
[task 2023-12-15T18:58:20.795Z] 2023-12-15 18:58:20,794 - INFO - Creating task with taskId K5PoTjraRc-N2XikslcUww for evaluate-quantized-flores-devtest-ru-en
[task 2023-12-15T18:58:20.797Z] 2023-12-15 18:58:20,797 - INFO - Creating task with taskId e5DkFVNXRUqoB_N_5hTEbw for export-ru-en
[task 2023-12-15T18:58:20.907Z] 2023-12-15 18:58:20,907 - INFO - Creating task with taskId PK2EDt0fQfeDb6ZPcbm42A for all-pr-ru-en-1
[taskcluster 2023-12-15 18:58:21.283Z] === Task Finished ===
[taskcluster 2023-12-15 18:58:23.235Z] Successful task run with exit code: 0 completed in 30.072 seconds