Improve documentation in transforms #305
Merged
firefoxci-taskcluster / Decision Task (pull-request)
succeeded
Dec 15, 2023 in 1m 38s
FirefoxCI (pull_request)
The task that creates all of the other tasks in the task graph
Details
View task in Taskcluster
View logs in Taskcluster
[taskcluster 2023-12-15 18:57:53.164Z] Task ID: W5HdMidITDKt8_bp4ZXS1Q
[taskcluster 2023-12-15 18:57:53.165Z] Worker ID: 3010986894731321240
[taskcluster 2023-12-15 18:57:53.165Z] Worker Group: us-central1
[taskcluster 2023-12-15 18:57:53.165Z] Worker Node Type: projects/887720501152/machineTypes/n2-standard-2
[taskcluster 2023-12-15 18:57:53.165Z] Worker Pool: translations-1/decision-gcp
[taskcluster 2023-12-15 18:57:53.165Z] Worker Version: 38.0.5
[taskcluster 2023-12-15 18:57:53.165Z] Public IP: 34.29.168.186
[taskcluster 2023-12-15 18:57:53.165Z] Hostname: translations-1-decision-gcp-d1xdv3dytdexkm4k-zzw9w
[taskcluster 2023-12-15 18:57:53.165Z] using cache "translations-level-1-checkouts-sparse-v2" -> /builds/worker/checkouts
62074584a67e - Started downloading
5544ebdc0c7b - Started downloading
5544ebdc0c7b - Downloaded in 0.246 seconds
62074584a67e - Downloaded in 0.658 seconds
Digest: sha256:ef132cc5741539f846a85bbe0cebc3c9ead30b8f24c1da46c55363f2170c3993
Status: Downloaded newer image for mozillareleases/taskgraph@sha256:ef132cc5741539f846a85bbe0cebc3c9ead30b8f24c1da46c55363f2170c3993
[taskcluster 2023-12-15 18:58:01.553Z] === Task Starting ===
[setup 2023-12-15T18:58:02.697Z] run-task started in /
[vcs 2023-12-15T18:58:02.699Z] WARNING: vcs checkout path (/builds/worker/checkouts/src) not in cache or volume; performance will likely suffer
[setup 2023-12-15T18:58:02.699Z] running as worker:worker
[vcs 2023-12-15T18:58:02.699Z] executing ['git', 'clone', 'https://github.com/mozilla/firefox-translations-training', '/builds/worker/checkouts/src']
[vcs 2023-12-15T18:58:02.702Z] Cloning into '/builds/worker/checkouts/src'...
[vcs 2023-12-15T18:58:03.805Z] executing ['git', 'fetch', 'origin', 'main']
[vcs 2023-12-15T18:58:03.980Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2023-12-15T18:58:03.980Z] * branch main -> FETCH_HEAD
[vcs 2023-12-15T18:58:03.987Z] executing ['git', 'checkout', 'main']
[vcs 2023-12-15T18:58:04.006Z] Already on 'main'
[vcs 2023-12-15T18:58:04.007Z] Your branch is up to date with 'origin/main'.
[vcs 2023-12-15T18:58:04.008Z] executing ['git', 'fetch', 'origin', '1273a0ef3f4a06f4eef9d8493e40a5848662b8de']
[vcs 2023-12-15T18:58:04.170Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2023-12-15T18:58:04.170Z] * branch 1273a0ef3f4a06f4eef9d8493e40a5848662b8de -> FETCH_HEAD
[vcs 2023-12-15T18:58:04.175Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/bhearsum/firefox-translations-training', 'followup']
[vcs 2023-12-15T18:58:04.401Z] From https://github.com/bhearsum/firefox-translations-training
[vcs 2023-12-15T18:58:04.401Z] * branch followup -> FETCH_HEAD
[vcs 2023-12-15T18:58:04.408Z] executing ['git', 'checkout', '-f', '-B', 'followup', '4aa774c2a9f31b93627bcac82e0c235839cb7c0e']
[vcs 2023-12-15T18:58:04.414Z] Switched to a new branch 'followup'
[vcs 2023-12-15T18:58:04.414Z] executing ['git', 'submodule', 'init']
[vcs 2023-12-15T18:58:04.435Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2023-12-15T18:58:04.436Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2023-12-15T18:58:04.437Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2023-12-15T18:58:04.439Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2023-12-15T18:58:04.440Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2023-12-15T18:58:04.441Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2023-12-15T18:58:04.442Z] executing ['git', 'submodule', 'update']
[vcs 2023-12-15T18:58:04.463Z] Cloning into '/builds/worker/checkouts/src/3rd_party/browsermt-marian-dev'...
[vcs 2023-12-15T18:58:08.131Z] Cloning into '/builds/worker/checkouts/src/3rd_party/extract-lex'...
[vcs 2023-12-15T18:58:08.391Z] Cloning into '/builds/worker/checkouts/src/3rd_party/fast_align'...
[vcs 2023-12-15T18:58:08.673Z] Cloning into '/builds/worker/checkouts/src/3rd_party/kenlm'...
[vcs 2023-12-15T18:58:09.984Z] Cloning into '/builds/worker/checkouts/src/3rd_party/marian-dev'...
[vcs 2023-12-15T18:58:12.510Z] Cloning into '/builds/worker/checkouts/src/3rd_party/preprocess'...
[vcs 2023-12-15T18:58:13.111Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2023-12-15T18:58:13.132Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2023-12-15T18:58:13.153Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2023-12-15T18:58:13.188Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2023-12-15T18:58:13.305Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2023-12-15T18:58:13.334Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2023-12-15T18:58:13.335Z] cleaning git checkout...
[vcs 2023-12-15T18:58:13.335Z] executing ['git', 'clean', '-nxdff']
[vcs 2023-12-15T18:58:13.339Z] removing []
[vcs 2023-12-15T18:58:13.339Z] successfully cleaned git checkout!
[vcs 2023-12-15T18:58:13.342Z] TinderboxPrint:<a href='https://github.com/bhearsum/firefox-translations-training/commit/4aa774c2a9f31b93627bcac82e0c235839cb7c0e' title='Built from firefox-translations-training commit 4aa774c2a9f31b93627bcac82e0c235839cb7c0e'>4aa774c2a9f31b93627bcac82e0c235839cb7c0e</a>
[pip-install 2023-12-15T18:58:13.343Z] executing ['/usr/bin/python3', '-mpip', 'install', '--require-hashes', '-r', '/builds/worker/checkouts/src/taskcluster/requirements.txt']
[pip-install 2023-12-15T18:58:13.601Z] Defaulting to user installation because normal site-packages is not writeable
[pip-install 2023-12-15T18:58:13.658Z] Requirement already satisfied: appdirs==1.4.4 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 7)) (1.4.4)
[pip-install 2023-12-15T18:58:13.659Z] Requirement already satisfied: arrow==1.2.3 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 11)) (1.2.3)
[pip-install 2023-12-15T18:58:13.660Z] Requirement already satisfied: binaryornot==0.4.4 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 15)) (0.4.4)
[pip-install 2023-12-15T18:58:13.661Z] Requirement already satisfied: certifi==2022.12.7 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 19)) (2022.12.7)
[pip-install 2023-12-15T18:58:13.663Z] Requirement already satisfied: chardet==5.1.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 23)) (5.1.0)
[pip-install 2023-12-15T18:58:13.664Z] Requirement already satisfied: charset-normalizer==3.0.1 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 27)) (3.0.1)
[pip-install 2023-12-15T18:58:13.665Z] Requirement already satisfied: click==8.1.3 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 117)) (8.1.3)
[pip-install 2023-12-15T18:58:13.666Z] Requirement already satisfied: cookiecutter==2.1.1 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 121)) (2.1.1)
[pip-install 2023-12-15T18:58:13.667Z] Requirement already satisfied: giturlparse==0.10.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 125)) (0.10.0)
[pip-install 2023-12-15T18:58:13.669Z] Requirement already satisfied: idna==3.4 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 129)) (3.4)
[pip-install 2023-12-15T18:58:13.670Z] Requirement already satisfied: jinja2==3.1.2 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 133)) (3.1.2)
[pip-install 2023-12-15T18:58:13.671Z] Requirement already satisfied: jinja2-time==0.2.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 139)) (0.2.0)
[pip-install 2023-12-15T18:58:13.672Z] Requirement already satisfied: json-e==4.5.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 143)) (4.5.0)
[pip-install 2023-12-15T18:58:13.673Z] Requirement already satisfied: markupsafe==2.1.2 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 147)) (2.1.2)
[pip-install 2023-12-15T18:58:13.674Z] Requirement already satisfied: mozilla-repo-urls==0.1.1 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 199)) (0.1.1)
[pip-install 2023-12-15T18:58:13.675Z] Requirement already satisfied: python-dateutil==2.8.2 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 203)) (2.8.2)
[pip-install 2023-12-15T18:58:13.676Z] Requirement already satisfied: python-slugify==8.0.1 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 207)) (8.0.1)
[pip-install 2023-12-15T18:58:13.677Z] Requirement already satisfied: pyyaml==6.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 211)) (6.0)
[pip-install 2023-12-15T18:58:13.678Z] Requirement already satisfied: redo==2.0.4 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 255)) (2.0.4)
[pip-install 2023-12-15T18:58:13.679Z] Requirement already satisfied: requests==2.28.2 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 259)) (2.28.2)
[pip-install 2023-12-15T18:58:13.680Z] Requirement already satisfied: requests-unixsocket==0.3.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 266)) (0.3.0)
[pip-install 2023-12-15T18:58:13.681Z] Requirement already satisfied: six==1.16.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 270)) (1.16.0)
[pip-install 2023-12-15T18:58:13.682Z] Requirement already satisfied: slugid==2.0.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 274)) (2.0.0)
[pip-install 2023-12-15T18:58:13.793Z] Collecting taskcluster-taskgraph==6.2.0
[pip-install 2023-12-15T18:58:13.956Z] Downloading taskcluster_taskgraph-6.2.0-py3-none-any.whl (187 kB)
[pip-install 2023-12-15T18:58:14.056Z] Requirement already satisfied: taskcluster-urls==13.0.1 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 282)) (13.0.1)
[pip-install 2023-12-15T18:58:14.058Z] Requirement already satisfied: text-unidecode==1.3 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 287)) (1.3)
[pip-install 2023-12-15T18:58:14.059Z] Requirement already satisfied: urllib3==1.26.14 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 291)) (1.26.14)
[pip-install 2023-12-15T18:58:14.060Z] Requirement already satisfied: voluptuous==0.13.1 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 295)) (0.13.1)
[pip-install 2023-12-15T18:58:14.189Z] Installing collected packages: taskcluster-taskgraph
[pip-install 2023-12-15T18:58:14.274Z] WARNING: The script taskgraph is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2023-12-15T18:58:14.274Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2023-12-15T18:58:14.278Z] Successfully installed taskcluster-taskgraph-6.2.0
[pip-install 2023-12-15T18:58:14.411Z] WARNING: You are using pip version 21.1.3; however, version 23.3.1 is available.
[pip-install 2023-12-15T18:58:14.411Z] You should consider upgrading via the '/usr/bin/python3 -m pip install --upgrade pip' command.
[task 2023-12-15T18:58:14.462Z] executing ['bash', '-cx', "cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && ~/.local/bin/taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='main' --base-rev='1273a0ef3f4a06f4eef9d8493e40a5848662b8de' --head-repository='https://github.com/bhearsum/firefox-translations-training' --head-ref='followup' --head-rev='4aa774c2a9f31b93627bcac82e0c235839cb7c0e' \n"]
[task 2023-12-15T18:58:14.465Z] + cd /builds/worker/checkouts/src
[task 2023-12-15T18:58:14.465Z] + ln -s /builds/worker/artifacts artifacts
[task 2023-12-15T18:58:14.466Z] + /builds/worker/.local/bin/taskgraph decision --pushlog-id=0 --pushdate=0 --project=firefox-translations-training [email protected] --level=1 --repository-type=git --tasks-for=github-pull-request --base-repository=https://github.com/mozilla/firefox-translations-training --base-ref=main --base-rev=1273a0ef3f4a06f4eef9d8493e40a5848662b8de --head-repository=https://github.com/bhearsum/firefox-translations-training --head-ref=followup --head-rev=4aa774c2a9f31b93627bcac82e0c235839cb7c0e
[task 2023-12-15T18:58:14.850Z] 2023-12-15 18:58:14,849 - INFO - Loading graph configuration.
[task 2023-12-15T18:58:14.871Z] 2023-12-15 18:58:14,871 - WARNING - using default project parameters; add firefox-translations-training to PER_PROJECT_PARAMETERS in /builds/worker/.local/lib/python3.8/site-packages/taskgraph/decision.py to customize behavior for this project
[task 2023-12-15T18:58:14.872Z] 2023-12-15 18:58:14,872 - INFO - Using Parameters(id=01c12378106b) (from defaults)
[task 2023-12-15T18:58:14.874Z] 2023-12-15 18:58:14,874 - INFO - writing artifact file `parameters.yml`
[task 2023-12-15T18:58:14.884Z] 2023-12-15 18:58:14,884 - INFO - writing artifact file `actions.json`
[task 2023-12-15T18:58:14.886Z] 2023-12-15 18:58:14,886 - INFO - Loading kinds
[task 2023-12-15T18:58:15.231Z] 2023-12-15 18:58:15,231 - INFO - Generating full task set
[task 2023-12-15T18:58:15.259Z] 2023-12-15 18:58:15,259 - INFO - Generated 7 tasks for kind dataset
[task 2023-12-15T18:58:15.261Z] 2023-12-15 18:58:15,261 - INFO - Writing docker-contexts/base.tar.gz for docker image base
[task 2023-12-15T18:58:15.278Z] 2023-12-15 18:58:15,278 - INFO - Writing docker-contexts/test.tar.gz for docker image test
[task 2023-12-15T18:58:15.279Z] 2023-12-15 18:58:15,279 - INFO - Writing docker-contexts/train.tar.gz for docker image train
[task 2023-12-15T18:58:15.280Z] 2023-12-15 18:58:15,280 - INFO - Writing docker-contexts/toolchain-build.tar.gz for docker image toolchain-build
[task 2023-12-15T18:58:15.297Z] 2023-12-15 18:58:15,297 - INFO - Generated 4 tasks for kind docker-image
[task 2023-12-15T18:58:15.424Z] 2023-12-15 18:58:15,424 - INFO - Generated 63 tasks for kind fetch
[task 2023-12-15T18:58:15.429Z] 2023-12-15 18:58:15,429 - INFO - Generated 6 tasks for kind tests
[task 2023-12-15T18:58:15.483Z] 2023-12-15 18:58:15,483 - INFO - Generated 8 tasks for kind toolchain
[task 2023-12-15T18:58:15.487Z] 2023-12-15 18:58:15,487 - INFO - Generated 2 tasks for kind clean-corpus
[task 2023-12-15T18:58:15.491Z] 2023-12-15 18:58:15,491 - INFO - Generated 2 tasks for kind bicleaner
[task 2023-12-15T18:58:15.495Z] 2023-12-15 18:58:15,495 - INFO - Generated 2 tasks for kind clean-mono
[task 2023-12-15T18:58:15.500Z] 2023-12-15 18:58:15,499 - INFO - Generated 1 tasks for kind merge-corpus
[task 2023-12-15T18:58:15.503Z] 2023-12-15 18:58:15,503 - INFO - Generated 2 tasks for kind merge-mono
[task 2023-12-15T18:58:15.505Z] 2023-12-15 18:58:15,505 - INFO - Generated 1 tasks for kind train-vocab
[task 2023-12-15T18:58:15.508Z] 2023-12-15 18:58:15,508 - INFO - Generated 1 tasks for kind split-corpus
[task 2023-12-15T18:58:15.510Z] 2023-12-15 18:58:15,510 - INFO - Generated 1 tasks for kind merge-devset
[task 2023-12-15T18:58:15.514Z] 2023-12-15 18:58:15,514 - INFO - Generated 1 tasks for kind train-backwards
[task 2023-12-15T18:58:15.517Z] 2023-12-15 18:58:15,517 - INFO - Generated 1 tasks for kind split-mono-src
[task 2023-12-15T18:58:15.519Z] 2023-12-15 18:58:15,519 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2023-12-15T18:58:15.524Z] 2023-12-15 18:58:15,524 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2023-12-15T18:58:15.527Z] 2023-12-15 18:58:15,527 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2023-12-15T18:58:15.531Z] 2023-12-15 18:58:15,531 - INFO - Generated 1 tasks for kind train-teacher
[task 2023-12-15T18:58:15.535Z] 2023-12-15 18:58:15,535 - INFO - Generated 2 tasks for kind translate-corpus
[task 2023-12-15T18:58:15.538Z] 2023-12-15 18:58:15,538 - INFO - Generated 2 tasks for kind extract-best
[task 2023-12-15T18:58:15.541Z] 2023-12-15 18:58:15,541 - INFO - Generated 1 tasks for kind collect-corpus
[task 2023-12-15T18:58:15.544Z] 2023-12-15 18:58:15,544 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2023-12-15T18:58:15.547Z] 2023-12-15 18:58:15,547 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2023-12-15T18:58:15.549Z] 2023-12-15 18:58:15,549 - INFO - Generated 1 tasks for kind merge-translated
[task 2023-12-15T18:58:15.552Z] 2023-12-15 18:58:15,552 - INFO - Generated 1 tasks for kind score
[task 2023-12-15T18:58:15.554Z] 2023-12-15 18:58:15,554 - INFO - Generated 1 tasks for kind cefilter
[task 2023-12-15T18:58:15.556Z] 2023-12-15 18:58:15,556 - INFO - Generated 1 tasks for kind alignments
[task 2023-12-15T18:58:15.558Z] 2023-12-15 18:58:15,558 - INFO - Generated 1 tasks for kind train-student
[task 2023-12-15T18:58:15.561Z] 2023-12-15 18:58:15,561 - INFO - Generated 1 tasks for kind finetune-student
[task 2023-12-15T18:58:15.567Z] 2023-12-15 18:58:15,567 - INFO - Generated 4 tasks for kind evaluate
[task 2023-12-15T18:58:15.570Z] 2023-12-15 18:58:15,570 - INFO - Generated 1 tasks for kind quantize
[task 2023-12-15T18:58:15.572Z] 2023-12-15 18:58:15,572 - INFO - Generated 1 tasks for kind export
[task 2023-12-15T18:58:15.575Z] 2023-12-15 18:58:15,575 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2023-12-15T18:58:15.578Z] 2023-12-15 18:58:15,578 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2023-12-15T18:58:15.579Z] 2023-12-15 18:58:15,579 - INFO - Generated 1 tasks for kind all
[task 2023-12-15T18:58:15.585Z] 2023-12-15 18:58:15,585 - INFO - Generated 1 tasks for kind all-pr
[task 2023-12-15T18:58:15.586Z] 2023-12-15 18:58:15,586 - INFO - Generating full task graph
[task 2023-12-15T18:58:15.587Z] 2023-12-15 18:58:15,586 - INFO - Full task graph contains 131 tasks and 270 dependencies
[task 2023-12-15T18:58:15.592Z] 2023-12-15 18:58:15,592 - INFO - writing artifact file `full-task-graph.json`
[task 2023-12-15T18:58:15.622Z] 2023-12-15 18:58:15,622 - INFO - writing artifact file `runnable-jobs.json`
[task 2023-12-15T18:58:15.624Z] 2023-12-15 18:58:15,624 - INFO - Generating target task set
[task 2023-12-15T18:58:15.625Z] 2023-12-15 18:58:15,625 - INFO - Filter filter_target_tasks pruned 116 tasks (15 remain)
[task 2023-12-15T18:58:15.625Z] 2023-12-15 18:58:15,625 - INFO - writing artifact file `target-tasks.json`
[task 2023-12-15T18:58:15.625Z] 2023-12-15 18:58:15,625 - INFO - Generating target task graph
[task 2023-12-15T18:58:15.628Z] 2023-12-15 18:58:15,625 - INFO - Adding 4 tasks with `always_target` attribute
[task 2023-12-15T18:58:15.628Z] 2023-12-15 18:58:15,627 - INFO - Generating optimized task graph
[task 2023-12-15T18:58:15.630Z] 2023-12-15 18:58:15,629 - INFO - Removed 2 tasks by skip-unless-changed (skip-unless-changed) during optimization.
[task 2023-12-15T18:58:18.089Z] 2023-12-15 18:58:18,089 - INFO - Replaced 18 tasks by index-search (index-search) during optimization.
[task 2023-12-15T18:58:18.094Z] 2023-12-15 18:58:18,094 - INFO - writing artifact file `task-graph.json`
[task 2023-12-15T18:58:18.107Z] 2023-12-15 18:58:18,107 - INFO - writing artifact file `label-to-taskid.json`
[task 2023-12-15T18:58:18.110Z] 2023-12-15 18:58:18,110 - INFO - Creating task with taskId BsNIwQ5jT9GBtqmg4LEJuQ for dataset-flores-devtest-ru-en
[task 2023-12-15T18:58:18.112Z] 2023-12-15 18:58:18,112 - INFO - Creating task with taskId JFsmTdjPSAuRu00B4DF2rg for dataset-opus-ada83_v1-ru-en
[task 2023-12-15T18:58:18.115Z] 2023-12-15 18:58:18,115 - INFO - Creating task with taskId Y5fnD3wRQuivspwdE9bUAg for build-docker-image-test
[task 2023-12-15T18:58:18.119Z] 2023-12-15 18:58:18,118 - INFO - Creating task with taskId Lp7o3qhzRsSGoMPk1oLJzw for tests-taskgraph-diff
[task 2023-12-15T18:58:18.128Z] 2023-12-15 18:58:18,120 - INFO - Creating task with taskId MXsnNyt9QSKtZ75sSrRBxA for dataset-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2023-12-15T18:58:18.130Z] 2023-12-15 18:58:18,121 - INFO - Creating task with taskId NKnB1GjgRemGXx9MAmVd4Q for dataset-sacrebleu-aug-mix_wmt19-ru-en
[task 2023-12-15T18:58:18.132Z] 2023-12-15 18:58:18,121 - INFO - Creating task with taskId KqNz22mKQXmPyC5P-I7xpw for dataset-news-crawl-news_2008-ru
[task 2023-12-15T18:58:18.136Z] 2023-12-15 18:58:18,122 - INFO - Creating task with taskId YQv73F16Sf2eCX5J7jnVKA for toolchain-browsermt-marian
[task 2023-12-15T18:58:18.140Z] 2023-12-15 18:58:18,122 - INFO - Creating task with taskId Vmjm7ZOYQyqhNvt57mD8Yg for dataset-news-crawl-news_2007-en
[task 2023-12-15T18:58:18.143Z] 2023-12-15 18:58:18,122 - INFO - Creating task with taskId Y07jWQYqSeKOqP2NuIwQ8Q for tests-taskgraph-definition
[task 2023-12-15T18:58:18.144Z] 2023-12-15 18:58:18,123 - INFO - Creating task with taskId LmSU5eo3RxyI3YizEJkH0Q for dataset-flores-dev-ru-en
[task 2023-12-15T18:58:18.145Z] 2023-12-15 18:58:18,123 - INFO - Creating task with taskId UswGrfJxS6y5QkebjwySaQ for toolchain-marian
[task 2023-12-15T18:58:18.283Z] 2023-12-15 18:58:18,283 - INFO - Creating task with taskId aNCI8gwJQzqUtfuiEG8HkQ for clean-corpus-opus-ada83_v1-ru-en
[task 2023-12-15T18:58:18.376Z] 2023-12-15 18:58:18,376 - INFO - Creating task with taskId YB0r7x8ARpyrAK1GIxkyWw for tests-lint
[task 2023-12-15T18:58:18.384Z] 2023-12-15 18:58:18,377 - INFO - Creating task with taskId T_YRtEI8TBm4Ib7hoU2RzA for clean-corpus-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2023-12-15T18:58:18.384Z] 2023-12-15 18:58:18,382 - INFO - Creating task with taskId YhGWAPklTIaV7vwphAn0BQ for clean-mono-news-crawl-ru-news_2008-mono-src
[task 2023-12-15T18:58:18.386Z] 2023-12-15 18:58:18,384 - INFO - Creating task with taskId BJgP-X3KRCSH39mCBSfgSg for tests-black
[task 2023-12-15T18:58:18.386Z] 2023-12-15 18:58:18,386 - INFO - Creating task with taskId Xlf1U6RHSXCei3fDqbeb8Q for clean-mono-news-crawl-en-news_2007-mono-trg
[task 2023-12-15T18:58:18.389Z] 2023-12-15 18:58:18,389 - INFO - Creating task with taskId ZZG_Hfw3TNa5hgmEyii0oA for bicleaner-opus-ada83_v1-ru-en
[task 2023-12-15T18:58:18.390Z] 2023-12-15 18:58:18,390 - INFO - Creating task with taskId dOPCtXWeSKOmtf_0oBawMQ for merge-devset-ru-en
[task 2023-12-15T18:58:18.471Z] 2023-12-15 18:58:18,471 - INFO - Creating task with taskId XaaxeW8yR9-q6BWkN4XcbQ for bicleaner-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2023-12-15T18:58:18.593Z] 2023-12-15 18:58:18,593 - INFO - Creating task with taskId KAFn2cQEQgSu_gb9x2LXpg for merge-mono-trg-en
[task 2023-12-15T18:58:18.597Z] 2023-12-15 18:58:18,595 - INFO - Creating task with taskId Ohh6Fa8HTdODh5lI_wF5bQ for merge-corpus-ru-en
[task 2023-12-15T18:58:18.600Z] 2023-12-15 18:58:18,598 - INFO - Creating task with taskId RLkXh5cgSQaYGaiDspw3cg for merge-mono-src-ru
[task 2023-12-15T18:58:18.693Z] 2023-12-15 18:58:18,693 - INFO - Creating task with taskId Qfgw_sqlR7KSO6fTw7Y6og for split-mono-src-ru
[task 2023-12-15T18:58:18.825Z] 2023-12-15 18:58:18,825 - INFO - Creating task with taskId EMDJom-wTlyAEfnnYISxAg for train-vocab-ru-en
[task 2023-12-15T18:58:18.826Z] 2023-12-15 18:58:18,825 - INFO - Creating task with taskId eC5pMSkARX2VedAW6wY32w for split-corpus-ru-en
[task 2023-12-15T18:58:18.830Z] 2023-12-15 18:58:18,826 - INFO - Creating task with taskId VVnCkPmzQrOV-QlZ5xvQTg for split-mono-trg-en
[task 2023-12-15T18:58:18.949Z] 2023-12-15 18:58:18,947 - INFO - Creating task with taskId bkumcnw0QvmsIvi8FxJIew for train-backwards-ru-en
[task 2023-12-15T18:58:19.037Z] 2023-12-15 18:58:19,037 - INFO - Creating task with taskId fkiA6nz3Rqe3xkCiUV9MmQ for translate-mono-trg-ru-en-2/2
[task 2023-12-15T18:58:19.041Z] 2023-12-15 18:58:19,037 - INFO - Creating task with taskId INbuB_htSPi_ugkR-2-lcA for translate-mono-trg-ru-en-1/2
[task 2023-12-15T18:58:19.042Z] 2023-12-15 18:58:19,041 - INFO - Creating task with taskId A8ANoUVxRiSYU0SMVxnLMQ for evaluate-backward-flores-devtest-ru-en
[task 2023-12-15T18:58:19.169Z] 2023-12-15 18:58:19,169 - INFO - Creating task with taskId ASVH6lACSvyrBa9OEeIhPw for collect-mono-trg-ru-en
[task 2023-12-15T18:58:19.409Z] 2023-12-15 18:58:19,409 - INFO - Creating task with taskId KO-WKTkfQWW1jB07XGd5Fw for train-teacher-ru-en-1/1
[task 2023-12-15T18:58:19.572Z] 2023-12-15 18:58:19,572 - INFO - Creating task with taskId Vaqe1TGrSVuwBN16igju4w for translate-mono-src-ru-en-2/2
[task 2023-12-15T18:58:19.573Z] 2023-12-15 18:58:19,572 - INFO - Creating task with taskId U7ujyJZATuy-0FSqB7Jb7A for translate-mono-src-ru-en-1/2
[task 2023-12-15T18:58:19.575Z] 2023-12-15 18:58:19,573 - INFO - Creating task with taskId IIcCFE2zQ1eiMDPTqtEaHQ for evaluate-teacher-flores-flores_devtest-ru-en-1/1
[task 2023-12-15T18:58:19.576Z] 2023-12-15 18:58:19,573 - INFO - Creating task with taskId P_vhfFVxRnqFAAclRbB2lA for translate-corpus-ru-en-1/2
[task 2023-12-15T18:58:19.578Z] 2023-12-15 18:58:19,573 - INFO - Creating task with taskId IVV4UGw6SLeqhbT_IVraRg for evaluate-teacher-ensemble-flores-flores_devtest-ru-en
[task 2023-12-15T18:58:19.579Z] 2023-12-15 18:58:19,574 - INFO - Creating task with taskId bdv1vvc-SmGMixpnN4Amtg for translate-corpus-ru-en-2/2
[task 2023-12-15T18:58:19.680Z] 2023-12-15 18:58:19,680 - INFO - Creating task with taskId BPQUNWqHTNO1qQiWpAj5Ww for collect-mono-src-ru-en
[task 2023-12-15T18:58:19.780Z] 2023-12-15 18:58:19,780 - INFO - Creating task with taskId ZeGAiU9MTlSPdqgHhSN82Q for extract-best-ru-en-2/2
[task 2023-12-15T18:58:19.783Z] 2023-12-15 18:58:19,782 - INFO - Creating task with taskId KH0K73xCS1WZmur24jjxpA for extract-best-ru-en-1/2
[task 2023-12-15T18:58:19.898Z] 2023-12-15 18:58:19,898 - INFO - Creating task with taskId GZHD5acXTcmYgDU-zHgnrw for collect-corpus-ru-en
[task 2023-12-15T18:58:20.000Z] 2023-12-15 18:58:20,000 - INFO - Creating task with taskId MwVpAguxTnSoI7_3xgyIHg for merge-translated-ru-en
[task 2023-12-15T18:58:20.118Z] 2023-12-15 18:58:20,118 - INFO - Creating task with taskId e-CVzR0gSoG2iWstvgxdsA for score-ru-en
[task 2023-12-15T18:58:20.221Z] 2023-12-15 18:58:20,221 - INFO - Creating task with taskId dsdbmRwdQkiG1zvb9zV_jw for cefilter-ru-en
[task 2023-12-15T18:58:20.347Z] 2023-12-15 18:58:20,347 - INFO - Creating task with taskId DL7gwpSAShm_ai7w1oCVxQ for alignments-ru-en
[task 2023-12-15T18:58:20.461Z] 2023-12-15 18:58:20,461 - INFO - Creating task with taskId JL8deLB0S8qbaC7HS9070Q for train-student-ru-en
[task 2023-12-15T18:58:20.576Z] 2023-12-15 18:58:20,576 - INFO - Creating task with taskId elbNjKtuSsan2tJ7KsygOQ for evaluate-student-flores-devtest-ru-en
[task 2023-12-15T18:58:20.578Z] 2023-12-15 18:58:20,578 - INFO - Creating task with taskId PgvZNVcgR1CnOcezZWWu5w for finetune-student-ru-en
[task 2023-12-15T18:58:20.671Z] 2023-12-15 18:58:20,671 - INFO - Creating task with taskId Qco6NEzPTeGFJ91F5H_9Hw for quantize-ru-en
[task 2023-12-15T18:58:20.674Z] 2023-12-15 18:58:20,673 - INFO - Creating task with taskId VBmqpXvQTuKCHH69LcFRJA for evaluate-finetuned-student-flores-devtest-ru-en
[task 2023-12-15T18:58:20.795Z] 2023-12-15 18:58:20,794 - INFO - Creating task with taskId K5PoTjraRc-N2XikslcUww for evaluate-quantized-flores-devtest-ru-en
[task 2023-12-15T18:58:20.797Z] 2023-12-15 18:58:20,797 - INFO - Creating task with taskId e5DkFVNXRUqoB_N_5hTEbw for export-ru-en
[task 2023-12-15T18:58:20.907Z] 2023-12-15 18:58:20,907 - INFO - Creating task with taskId PK2EDt0fQfeDb6ZPcbm42A for all-pr-ru-en-1
[taskcluster 2023-12-15 18:58:21.283Z] === Task Finished ===
[taskcluster 2023-12-15 18:58:23.235Z] Successful task run with exit code: 0 completed in 30.072 seconds
Loading