[taskcluster 2024-02-28 02:30:34.563Z] Task ID: ceWXKhbYTk6G35-uPSrYDg
[taskcluster 2024-02-28 02:30:34.563Z] Worker ID: 1896560821215110701
[taskcluster 2024-02-28 02:30:34.563Z] Worker Group: us-central1
[taskcluster 2024-02-28 02:30:34.563Z] Worker Node Type: projects/887720501152/machineTypes/n2-highmem-32
[taskcluster 2024-02-28 02:30:34.563Z] Worker Pool: translations-1/b-linux-large-gcp-300gb
[taskcluster 2024-02-28 02:30:34.563Z] Worker Version: 38.0.5
[taskcluster 2024-02-28 02:30:34.563Z] Public IP: 35.193.192.129
[taskcluster 2024-02-28 02:30:34.563Z] Hostname: translations-1-b-linux-large-gcp-300gb-zifhbgdnr1efbn-gwpjpjq
[taskcluster 2024-02-28 02:30:34.563Z] using cache "translations-level-1-checkouts-v3-7afeb851dd97df8f3607-e_fnyhlhT6CGxAxd6QIFSA" -> /builds/worker/checkouts

[taskcluster 2024-02-28 02:30:35.166Z] Downloading artifact "public/image.tar.zst" from task ID: e_fnyhlhT6CGxAxd6QIFSA.
[taskcluster 2024-02-28 02:30:37.362Z] Downloaded artifact successfully.
[taskcluster 2024-02-28 02:30:37.362Z] Downloaded 265.144 mb
[taskcluster 2024-02-28 02:30:37.362Z] Decompressing downloaded image
[taskcluster 2024-02-28 02:30:38.933Z] Loading docker image from downloaded archive.
[taskcluster 2024-02-28 02:30:48.561Z] Image 'public/image.tar.zst' from task 'e_fnyhlhT6CGxAxd6QIFSA' loaded.  Using image ID sha256:4a564314aaa610230a33ae7b01128154df8057c24ea44b0f87454c1d2ac59a3d.
[taskcluster 2024-02-28 02:30:48.698Z] === Task Starting ===
[setup 2024-02-28T02:30:56.496Z] run-task started in /builds/worker
[setup 2024-02-28T02:30:56.496Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/vcs/ -- bash -c zstd -d --rm $MOZ_FETCHES_DIR/file* && $VCS_PATH/pipeline/translate/collect.sh fetches artifacts/mono.ru.zst $MOZ_FETCHES_DIR/mono.en.zst
[setup 2024-02-28T02:30:56.496Z] Python version: 3.10.12
[cache 2024-02-28T02:30:56.498Z] cache /builds/worker/checkouts is empty; writing requirements: gid=1000 uid=1000 version=1
[volume 2024-02-28T02:30:56.499Z] volume /builds/worker/checkouts is a cache
[setup 2024-02-28T02:30:56.499Z] running as worker:worker
[vcs 2024-02-28T02:30:56.499Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/vcs']
[vcs 2024-02-28T02:30:56.501Z] executing ['git', 'clone', 'https://github.com/mozilla/firefox-translations-training', '/builds/worker/checkouts/vcs']
[vcs 2024-02-28T02:30:56.503Z] Cloning into '/builds/worker/checkouts/vcs'...
[vcs 2024-02-28T02:30:58.198Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/bhearsum/firefox-translations-training', 'term']
[vcs 2024-02-28T02:30:58.455Z] From https://github.com/bhearsum/firefox-translations-training
[vcs 2024-02-28T02:30:58.455Z]  * branch            term       -> FETCH_HEAD
[vcs 2024-02-28T02:30:58.457Z] executing ['git', 'checkout', '-f', '-B', 'term', '38340942e4bdac1ff2749e0647f6fc7f10d602db']
[vcs 2024-02-28T02:30:58.513Z] Switched to a new branch 'term'
[vcs 2024-02-28T02:30:58.513Z] executing ['git', 'submodule', 'init']
[vcs 2024-02-28T02:30:58.533Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2024-02-28T02:30:58.534Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2024-02-28T02:30:58.535Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2024-02-28T02:30:58.536Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2024-02-28T02:30:58.536Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2024-02-28T02:30:58.537Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2024-02-28T02:30:58.537Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-02-28T02:30:58.558Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/browsermt-marian-dev'...
[vcs 2024-02-28T02:30:59.685Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/extract-lex'...
[vcs 2024-02-28T02:30:59.973Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/fast_align'...
[vcs 2024-02-28T02:31:00.282Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/kenlm'...
[vcs 2024-02-28T02:31:00.911Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/marian-dev'...
[vcs 2024-02-28T02:31:02.378Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/preprocess'...
[vcs 2024-02-28T02:31:02.880Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-02-28T02:31:02.890Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-02-28T02:31:02.900Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-02-28T02:31:02.925Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-02-28T02:31:03.029Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-02-28T02:31:03.047Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-02-28T02:31:03.048Z] cleaning git checkout...
[vcs 2024-02-28T02:31:03.048Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-02-28T02:31:03.050Z] removing []
[vcs 2024-02-28T02:31:03.050Z] successfully cleaned git checkout!
[vcs 2024-02-28T02:31:03.052Z] TinderboxPrint:<a href='https://github.com/bhearsum/firefox-translations-training/commit/38340942e4bdac1ff2749e0647f6fc7f10d602db' title='Built from firefox-translations-training commit 38340942e4bdac1ff2749e0647f6fc7f10d602db'>38340942e4bdac1ff2749e0647f6fc7f10d602db</a>
[setup 2024-02-28T02:31:03.052Z] MOZ_FETCHES_DIR is /builds/worker/fetches
[fetches 2024-02-28T02:31:03.052Z] fetching artifacts
[fetches 2024-02-28T02:31:03.052Z] executing ['/usr/bin/python3', '-u', '/usr/local/bin/fetch-content', 'task-artifacts']
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/fv42tLF-SpGBh_c7DnaSKQ/artifacts/public/build/mono.en.zst to /builds/worker/fetches/mono.en.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/fv42tLF-SpGBh_c7DnaSKQ/artifacts/public/build/mono.en.zst
attempt 1/5attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/AT_zBzKxRKOD2Vq6CZH75g/artifacts/public/build/file.2.out.zst to /builds/worker/fetches/file.2.out.zst

Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/K4w0ztgJT1qoRyZuYZlZ3w/artifacts/public/build/file.1.out.zst to /builds/worker/fetches/file.1.out.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/AT_zBzKxRKOD2Vq6CZH75g/artifacts/public/build/file.2.out.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/K4w0ztgJT1qoRyZuYZlZ3w/artifacts/public/build/file.1.out.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/K4w0ztgJT1qoRyZuYZlZ3w/artifacts/public/build/file.1.out.zst resolved to 7224 bytes with sha256 501e53e8261a7e0de6d39de1b47ced64ee51588792a01c29fd6d18c5907c302a in 0.142s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/AT_zBzKxRKOD2Vq6CZH75g/artifacts/public/build/file.2.out.zst resolved to 6851 bytes with sha256 7f712f77e7168d4fbc800be2da6ade81e984fee522c5c674c10d9c2293b35398 in 0.154s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/fv42tLF-SpGBh_c7DnaSKQ/artifacts/public/build/mono.en.zst resolved to 505129 bytes with sha256 e60f28343a5c3b20d6782b9e14e65151b97cc8a324a89c7954aeaed0b3f1e5c1 in 0.204s
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 0.20711341599997013, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2024-02-28T02:31:03.346Z] finished fetching artifacts
[task 2024-02-28T02:31:03.346Z] executing ['bash', '-c', 'zstd -d --rm $MOZ_FETCHES_DIR/file* && $VCS_PATH/pipeline/translate/collect.sh fetches artifacts/mono.ru.zst $MOZ_FETCHES_DIR/mono.en.zst']
[task 2024-02-28T02:31:03.348Z] 
[task 2024-02-28T02:31:03.349Z] Decompress:  1/ 2 files. Current: .../file.1.out.zst : 0 MB...    
[task 2024-02-28T02:31:03.349Z]                                                                                
[task 2024-02-28T02:31:03.349Z] 
[task 2024-02-28T02:31:03.349Z]                                                                                
[task 2024-02-28T02:31:03.349Z] 2 files decompressed : 179625 bytes total 
[task 2024-02-28T02:31:03.350Z] + set -euo pipefail
[task 2024-02-28T02:31:03.350Z] + chunks_dir=fetches
[task 2024-02-28T02:31:03.350Z] + output_path=artifacts/mono.ru.zst
[task 2024-02-28T02:31:03.350Z] + mono_path=/builds/worker/fetches/mono.en.zst
[task 2024-02-28T02:31:03.350Z] + COMPRESSION_CMD=zstdmt
[task 2024-02-28T02:31:03.350Z] + echo '### Collecting translations'
[task 2024-02-28T02:31:03.350Z] ### Collecting translations
[task 2024-02-28T02:31:03.351Z] + find fetches -name '*.out'
[task 2024-02-28T02:31:03.351Z] + sort -t . -k2,2n
[task 2024-02-28T02:31:03.351Z] + xargs cat
[task 2024-02-28T02:31:03.351Z] + zstdmt
[task 2024-02-28T02:31:03.355Z] + echo '### Comparing number of sentences in source and artificial target files'
[task 2024-02-28T02:31:03.355Z] ### Comparing number of sentences in source and artificial target files
[task 2024-02-28T02:31:03.355Z] ++ zstdmt -dc /builds/worker/fetches/mono.en.zst
[task 2024-02-28T02:31:03.355Z] ++ wc -l
[task 2024-02-28T02:31:03.360Z] + src_len=9920
[task 2024-02-28T02:31:03.360Z] ++ zstdmt -dc artifacts/mono.ru.zst
[task 2024-02-28T02:31:03.360Z] ++ wc -l
[task 2024-02-28T02:31:03.362Z] + trg_len=9920
[task 2024-02-28T02:31:03.362Z] + '[' 9920 '!=' 9920 ']'
[fetches 2024-02-28T02:31:03.362Z] removing /builds/worker/fetches
[fetches 2024-02-28T02:31:03.363Z] finished
[taskcluster 2024-02-28 02:31:03.914Z] === Task Finished ===
[taskcluster 2024-02-28 02:31:04.117Z] Successful task run with exit code: 0 completed in 29.555 seconds