[taskcluster 2024-05-09 00:13:36.115Z] Task ID: AyiN3BcsSEeYmY_0heuUHg
[taskcluster 2024-05-09 00:13:36.115Z] Worker ID: 5822204901585955359
[taskcluster 2024-05-09 00:13:36.115Z] Worker Group: us-central1-b
[taskcluster 2024-05-09 00:13:36.115Z] Worker Node Type: projects/887720501152/machineTypes/n2-standard-2
[taskcluster 2024-05-09 00:13:36.115Z] Worker Pool: translations-1/decision-gcp
[taskcluster 2024-05-09 00:13:36.115Z] Worker Version: 38.0.5
[taskcluster 2024-05-09 00:13:36.115Z] Public IP: 104.154.187.252
[taskcluster 2024-05-09 00:13:36.115Z] Hostname: translations-1-decision-gcp-atxukubzqhytshowsv9-eg
[taskcluster 2024-05-09 00:13:36.115Z] using cache "translations-level-1-checkouts-sparse-v2" -> /builds/worker/checkouts

[taskcluster 2024-05-09 00:13:45.296Z] === Task Starting ===
[setup 2024-05-09T00:13:46.633Z] run-task started in /
[setup 2024-05-09T00:13:46.634Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/src -- bash -cx cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='main' --base-rev='90ba11d035df4d9e0af5c3d2997bd91eaf36c466' --head-repository='https://github.com/bhearsum/firefox-translations-training' --head-ref='d2g2' --head-rev='cc732468b03e93ec231218c7149edf5eb1725a44' 

[setup 2024-05-09T00:13:46.635Z] Python version: 3.11.2
[vcs 2024-05-09T00:13:46.638Z] WARNING: vcs checkout path (/builds/worker/checkouts/src) not in cache or volume; performance will likely suffer
[setup 2024-05-09T00:13:46.639Z] running as worker:worker
[vcs 2024-05-09T00:13:46.640Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/src']
[vcs 2024-05-09T00:13:46.643Z] executing ['git', 'clone', 'https://github.com/mozilla/firefox-translations-training', '/builds/worker/checkouts/src']
[vcs 2024-05-09T00:13:46.648Z] Cloning into '/builds/worker/checkouts/src'...
[vcs 2024-05-09T00:13:47.782Z] executing ['git', 'fetch', 'origin', 'main']
[vcs 2024-05-09T00:13:48.007Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-05-09T00:13:48.008Z]  * branch            main       -> FETCH_HEAD
[vcs 2024-05-09T00:13:48.013Z] executing ['git', 'checkout', 'main']
[vcs 2024-05-09T00:13:48.074Z] Already on 'main'
[vcs 2024-05-09T00:13:48.074Z] Your branch is up to date with 'origin/main'.
[vcs 2024-05-09T00:13:48.075Z] executing ['git', 'fetch', 'origin', '90ba11d035df4d9e0af5c3d2997bd91eaf36c466']
[vcs 2024-05-09T00:13:48.351Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-05-09T00:13:48.351Z]  * branch            90ba11d035df4d9e0af5c3d2997bd91eaf36c466 -> FETCH_HEAD
[vcs 2024-05-09T00:13:48.362Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/bhearsum/firefox-translations-training', 'd2g2']
[vcs 2024-05-09T00:13:48.657Z] From https://github.com/bhearsum/firefox-translations-training
[vcs 2024-05-09T00:13:48.657Z]  * branch            d2g2       -> FETCH_HEAD
[vcs 2024-05-09T00:13:48.659Z] executing ['git', 'checkout', '-f', '-B', 'd2g2', 'cc732468b03e93ec231218c7149edf5eb1725a44']
[vcs 2024-05-09T00:13:48.664Z] Switched to a new branch 'd2g2'
[vcs 2024-05-09T00:13:48.665Z] executing ['git', 'submodule', 'init']
[vcs 2024-05-09T00:13:48.685Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2024-05-09T00:13:48.686Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2024-05-09T00:13:48.686Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2024-05-09T00:13:48.687Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2024-05-09T00:13:48.689Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2024-05-09T00:13:48.691Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2024-05-09T00:13:48.692Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-05-09T00:13:48.716Z] Cloning into '/builds/worker/checkouts/src/3rd_party/browsermt-marian-dev'...
[vcs 2024-05-09T00:13:51.870Z] Cloning into '/builds/worker/checkouts/src/3rd_party/extract-lex'...
[vcs 2024-05-09T00:13:52.253Z] Cloning into '/builds/worker/checkouts/src/3rd_party/fast_align'...
[vcs 2024-05-09T00:13:52.607Z] Cloning into '/builds/worker/checkouts/src/3rd_party/kenlm'...
[vcs 2024-05-09T00:13:53.609Z] Cloning into '/builds/worker/checkouts/src/3rd_party/marian-dev'...
[vcs 2024-05-09T00:13:57.444Z] Cloning into '/builds/worker/checkouts/src/3rd_party/preprocess'...
[vcs 2024-05-09T00:13:58.106Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-05-09T00:13:58.114Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-05-09T00:13:58.121Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-05-09T00:13:58.149Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-05-09T00:13:58.285Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-05-09T00:13:58.303Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-05-09T00:13:58.303Z] cleaning git checkout...
[vcs 2024-05-09T00:13:58.303Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-05-09T00:13:58.307Z] removing []
[vcs 2024-05-09T00:13:58.307Z] successfully cleaned git checkout!
[vcs 2024-05-09T00:13:58.309Z] TinderboxPrint:<a href='https://github.com/bhearsum/firefox-translations-training/commit/cc732468b03e93ec231218c7149edf5eb1725a44' title='Built from firefox-translations-training commit cc732468b03e93ec231218c7149edf5eb1725a44'>cc732468b03e93ec231218c7149edf5eb1725a44</a>
[task 2024-05-09T00:13:58.309Z] executing ['bash', '-cx', "cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='main' --base-rev='90ba11d035df4d9e0af5c3d2997bd91eaf36c466' --head-repository='https://github.com/bhearsum/firefox-translations-training' --head-ref='d2g2' --head-rev='cc732468b03e93ec231218c7149edf5eb1725a44' \n"]
[task 2024-05-09T00:13:58.310Z] + cd /builds/worker/checkouts/src
[task 2024-05-09T00:13:58.310Z] + ln -s /builds/worker/artifacts artifacts
[task 2024-05-09T00:13:58.315Z] + taskgraph decision --pushlog-id=0 --pushdate=0 --project=firefox-translations-training [email protected] --level=1 --repository-type=git --tasks-for=github-pull-request --base-repository=https://github.com/mozilla/firefox-translations-training --base-ref=main --base-rev=90ba11d035df4d9e0af5c3d2997bd91eaf36c466 --head-repository=https://github.com/bhearsum/firefox-translations-training --head-ref=d2g2 --head-rev=cc732468b03e93ec231218c7149edf5eb1725a44
[task 2024-05-09T00:13:58.717Z] 2024-05-09 00:13:58,717 - INFO - Loading graph configuration.
[task 2024-05-09T00:13:58.739Z] 2024-05-09 00:13:58,737 - WARNING - using default project parameters; add firefox-translations-training to PER_PROJECT_PARAMETERS in /usr/local/lib/python3.11/dist-packages/taskgraph/decision.py to customize behavior for this project
[task 2024-05-09T00:13:58.739Z] 2024-05-09 00:13:58,738 - INFO - Using Parameters(id=9f3d9a726742) (from defaults)
[task 2024-05-09T00:13:58.747Z] 2024-05-09 00:13:58,740 - INFO - writing artifact file `parameters.yml`
[task 2024-05-09T00:13:58.759Z] 2024-05-09 00:13:58,758 - INFO - writing artifact file `actions.json`
[task 2024-05-09T00:13:58.762Z] 2024-05-09 00:13:58,762 - INFO - Loading kinds
[task 2024-05-09T00:13:58.805Z] 2024-05-09 00:13:58,805 - INFO - Generating full task set
[task 2024-05-09T00:13:58.864Z] 2024-05-09 00:13:58,864 - INFO - Generated 8 tasks for kind dataset
[task 2024-05-09T00:13:58.867Z] 2024-05-09 00:13:58,867 - INFO - Writing docker-contexts/base.tar.gz for docker image base
[task 2024-05-09T00:13:58.888Z] 2024-05-09 00:13:58,888 - INFO - Writing docker-contexts/test.tar.gz for docker image test
[task 2024-05-09T00:13:58.896Z] 2024-05-09 00:13:58,895 - INFO - Writing docker-contexts/train.tar.gz for docker image train
[task 2024-05-09T00:13:58.896Z] 2024-05-09 00:13:58,896 - INFO - Writing docker-contexts/toolchain-build.tar.gz for docker image toolchain-build
[task 2024-05-09T00:13:58.919Z] 2024-05-09 00:13:58,918 - INFO - Generated 4 tasks for kind docker-image
[task 2024-05-09T00:13:58.934Z] 2024-05-09 00:13:58,934 - INFO - Generated 9 tasks for kind fetch
[task 2024-05-09T00:13:59.028Z] 2024-05-09 00:13:59,028 - INFO - Generated 10 tasks for kind toolchain
[task 2024-05-09T00:13:59.035Z] 2024-05-09 00:13:59,034 - INFO - Generated 2 tasks for kind analyze-mono
[task 2024-05-09T00:13:59.041Z] 2024-05-09 00:13:59,041 - INFO - Generated 3 tasks for kind analyze-corpus
[task 2024-05-09T00:13:59.049Z] 2024-05-09 00:13:59,049 - INFO - Generated 3 tasks for kind clean-corpus
[task 2024-05-09T00:13:59.053Z] 2024-05-09 00:13:59,053 - INFO - Generated 1 tasks for kind bicleaner-model
[task 2024-05-09T00:13:59.063Z] 2024-05-09 00:13:59,063 - INFO - Generated 3 tasks for kind bicleaner
[task 2024-05-09T00:13:59.070Z] 2024-05-09 00:13:59,070 - INFO - Generated 2 tasks for kind clean-mono
[task 2024-05-09T00:13:59.097Z] 2024-05-09 00:13:59,096 - INFO - Generated 1 tasks for kind merge-corpus
[task 2024-05-09T00:13:59.103Z] 2024-05-09 00:13:59,103 - INFO - Generated 2 tasks for kind merge-mono
[task 2024-05-09T00:13:59.108Z] 2024-05-09 00:13:59,107 - INFO - Generated 1 tasks for kind train-vocab
[task 2024-05-09T00:13:59.112Z] 2024-05-09 00:13:59,112 - INFO - Generated 1 tasks for kind split-corpus
[task 2024-05-09T00:13:59.116Z] 2024-05-09 00:13:59,116 - INFO - Generated 1 tasks for kind merge-devset
[task 2024-05-09T00:13:59.124Z] 2024-05-09 00:13:59,124 - INFO - Generated 1 tasks for kind train-backwards
[task 2024-05-09T00:13:59.132Z] 2024-05-09 00:13:59,132 - INFO - Generated 1 tasks for kind split-mono-src
[task 2024-05-09T00:13:59.136Z] 2024-05-09 00:13:59,136 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2024-05-09T00:13:59.142Z] 2024-05-09 00:13:59,142 - INFO - Generated 5 tasks for kind tests
[task 2024-05-09T00:13:59.149Z] 2024-05-09 00:13:59,149 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2024-05-09T00:13:59.156Z] 2024-05-09 00:13:59,156 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2024-05-09T00:13:59.162Z] 2024-05-09 00:13:59,162 - INFO - Generated 1 tasks for kind alignments-original
[task 2024-05-09T00:13:59.168Z] 2024-05-09 00:13:59,168 - INFO - Generated 1 tasks for kind alignments-backtranslated
[task 2024-05-09T00:13:59.172Z] 2024-05-09 00:13:59,172 - INFO - Generated 1 tasks for kind train-teacher
[task 2024-05-09T00:13:59.176Z] 2024-05-09 00:13:59,176 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2024-05-09T00:13:59.182Z] 2024-05-09 00:13:59,181 - INFO - Generated 2 tasks for kind translate-corpus
[task 2024-05-09T00:13:59.186Z] 2024-05-09 00:13:59,186 - INFO - Generated 2 tasks for kind extract-best
[task 2024-05-09T00:13:59.189Z] 2024-05-09 00:13:59,189 - INFO - Generated 1 tasks for kind collect-corpus
[task 2024-05-09T00:13:59.195Z] 2024-05-09 00:13:59,195 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2024-05-09T00:13:59.198Z] 2024-05-09 00:13:59,198 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2024-05-09T00:13:59.202Z] 2024-05-09 00:13:59,202 - INFO - Generated 1 tasks for kind merge-translated
[task 2024-05-09T00:13:59.205Z] 2024-05-09 00:13:59,205 - INFO - Generated 1 tasks for kind score
[task 2024-05-09T00:13:59.208Z] 2024-05-09 00:13:59,208 - INFO - Generated 1 tasks for kind cefilter
[task 2024-05-09T00:13:59.212Z] 2024-05-09 00:13:59,212 - INFO - Generated 1 tasks for kind shortlist
[task 2024-05-09T00:13:59.215Z] 2024-05-09 00:13:59,215 - INFO - Generated 1 tasks for kind alignments-student
[task 2024-05-09T00:13:59.219Z] 2024-05-09 00:13:59,219 - INFO - Generated 1 tasks for kind train-student
[task 2024-05-09T00:13:59.222Z] 2024-05-09 00:13:59,222 - INFO - Generated 1 tasks for kind finetune-student
[task 2024-05-09T00:13:59.226Z] 2024-05-09 00:13:59,226 - INFO - Generated 1 tasks for kind quantize
[task 2024-05-09T00:13:59.229Z] 2024-05-09 00:13:59,229 - INFO - Generated 1 tasks for kind export
[task 2024-05-09T00:13:59.236Z] 2024-05-09 00:13:59,236 - INFO - Generated 4 tasks for kind evaluate
[task 2024-05-09T00:13:59.239Z] 2024-05-09 00:13:59,239 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2024-05-09T00:13:59.242Z] 2024-05-09 00:13:59,241 - INFO - Generated 1 tasks for kind all
[task 2024-05-09T00:13:59.250Z] 2024-05-09 00:13:59,250 - INFO - Generated 0 tasks for kind all-pr
[task 2024-05-09T00:13:59.250Z] 2024-05-09 00:13:59,250 - INFO - Generating full task graph
[task 2024-05-09T00:13:59.251Z] 2024-05-09 00:13:59,251 - INFO - Full task graph contains 89 tasks and 254 dependencies
[task 2024-05-09T00:13:59.255Z] 2024-05-09 00:13:59,255 - INFO - writing artifact file `full-task-graph.json`
[task 2024-05-09T00:13:59.273Z] 2024-05-09 00:13:59,273 - INFO - writing artifact file `runnable-jobs.json`
[task 2024-05-09T00:13:59.275Z] 2024-05-09 00:13:59,275 - INFO - Generating target task set
[task 2024-05-09T00:13:59.275Z] 2024-05-09 00:13:59,275 - INFO - Filter filter_target_tasks pruned 74 tasks (15 remain)
[task 2024-05-09T00:13:59.276Z] 2024-05-09 00:13:59,275 - INFO - writing artifact file `target-tasks.json`
[task 2024-05-09T00:13:59.277Z] 2024-05-09 00:13:59,276 - INFO - Generating target task graph
[task 2024-05-09T00:13:59.277Z] 2024-05-09 00:13:59,276 - INFO - Adding 4 tasks with `always_target` attribute
[task 2024-05-09T00:13:59.278Z] 2024-05-09 00:13:59,276 - INFO - Generating optimized task graph
[task 2024-05-09T00:13:59.278Z] 2024-05-09 00:13:59,278 - INFO - Removed 1 tasks by skip-unless-changed (skip-unless-changed) during optimization.
[task 2024-05-09T00:14:02.968Z] 2024-05-09 00:14:02,968 - INFO - Replaced 23 tasks by index-search (index-search) during optimization.
[task 2024-05-09T00:14:02.969Z] 2024-05-09 00:14:02,969 - INFO - writing artifact file `task-graph.json`
[task 2024-05-09T00:14:02.971Z] 2024-05-09 00:14:02,970 - INFO - writing artifact file `label-to-taskid.json`
[task 2024-05-09T00:14:02.973Z] 2024-05-09 00:14:02,973 - INFO - Creating task with taskId KxLr3TGES_iTACyApVzPRQ for tests-taskgraph-definition
[task 2024-05-09T00:14:02.974Z] 2024-05-09 00:14:02,973 - INFO - Creating task with taskId NHWfkOSZSIeXa05OTWD2mA for tests-taskgraph-diff
[task 2024-05-09T00:14:02.976Z] 2024-05-09 00:14:02,974 - INFO - Creating task with taskId cB_LALxCSmiUoFObdhr1yw for tests-black
[task 2024-05-09T00:14:02.979Z] 2024-05-09 00:14:02,976 - INFO - Creating task with taskId U303Q1g_TV-LdNNJ3JWBhA for tests-lint
[taskcluster 2024-05-09 00:14:03.632Z] === Task Finished ===
[taskcluster 2024-05-09 00:14:05.491Z] Successful task run with exit code: 0 completed in 29.376 seconds