[taskcluster 2023-12-15 19:03:24.181Z] Task ID: Qfgw_sqlR7KSO6fTw7Y6og
[taskcluster 2023-12-15 19:03:24.181Z] Worker ID: 7166567156057971816
[taskcluster 2023-12-15 19:03:24.181Z] Worker Group: us-west1
[taskcluster 2023-12-15 19:03:24.181Z] Worker Node Type: projects/887720501152/machineTypes/n2-highmem-32
[taskcluster 2023-12-15 19:03:24.181Z] Worker Pool: translations-1/b-linux-large-gcp-300gb
[taskcluster 2023-12-15 19:03:24.181Z] Worker Version: 38.0.5
[taskcluster 2023-12-15 19:03:24.181Z] Public IP: 34.83.126.14
[taskcluster 2023-12-15 19:03:24.181Z] Hostname: translations-1-b-linux-large-gcp-300gb-wgd0lpkstkym7a7za5gjcq
[taskcluster 2023-12-15 19:03:24.181Z] using cache "translations-level-1-checkouts-hg58-v3-2922149087d95338df26" -> /builds/worker/checkouts

[taskcluster 2023-12-15 19:03:25.407Z] Image 'public/image.tar.zst' from task 'coL2A8X7TtKPvOvddcYtiw' loaded.  Using image ID sha256:a6912c5313466b965d7bb74ac22f26d3fe1e8789f9d2bbd3c516122194ef152e.
[taskcluster 2023-12-15 19:03:25.419Z] === Task Starting ===
[setup 2023-12-15T19:03:26.256Z] run-task started in /builds/worker
[setup 2023-12-15T19:03:26.256Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/vcs/ -- bash -c export BIN=$MOZ_FETCHES_DIR && $VCS_PATH/taskcluster/scripts/pipeline/split-mono-taskcluster.sh 2 /builds/worker/artifacts 5000 $MOZ_FETCHES_DIR/mono.$LOCALE.zst
[setup 2023-12-15T19:03:26.256Z] Python version: 3.10.12
[cache 2023-12-15T19:03:26.258Z] cache /builds/worker/checkouts exists; requirements: gid=1000 uid=1000 version=1
[volume 2023-12-15T19:03:26.258Z] volume /builds/worker/checkouts is a cache
[setup 2023-12-15T19:03:26.258Z] running as worker:worker
[vcs 2023-12-15T19:03:26.259Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/bhearsum/firefox-translations-training', 'followup']
[vcs 2023-12-15T19:03:26.512Z] From https://github.com/bhearsum/firefox-translations-training
[vcs 2023-12-15T19:03:26.512Z]  * branch            followup   -> FETCH_HEAD
[vcs 2023-12-15T19:03:26.517Z] executing ['git', 'checkout', '-f', '-B', 'followup', '4aa774c2a9f31b93627bcac82e0c235839cb7c0e']
[vcs 2023-12-15T19:03:26.521Z] Reset branch 'followup'
[vcs 2023-12-15T19:03:26.521Z] executing ['git', 'submodule', 'init']
[vcs 2023-12-15T19:03:26.539Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2023-12-15T19:03:26.572Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2023-12-15T19:03:26.581Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2023-12-15T19:03:26.590Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2023-12-15T19:03:26.602Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2023-12-15T19:03:26.616Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2023-12-15T19:03:26.627Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2023-12-15T19:03:26.627Z] cleaning git checkout...
[vcs 2023-12-15T19:03:26.627Z] executing ['git', 'clean', '-nxdff']
[vcs 2023-12-15T19:03:26.629Z] removing []
[vcs 2023-12-15T19:03:26.629Z] successfully cleaned git checkout!
[vcs 2023-12-15T19:03:26.630Z] TinderboxPrint:<a href='https://github.com/bhearsum/firefox-translations-training/commit/4aa774c2a9f31b93627bcac82e0c235839cb7c0e' title='Built from firefox-translations-training commit 4aa774c2a9f31b93627bcac82e0c235839cb7c0e'>4aa774c2a9f31b93627bcac82e0c235839cb7c0e</a>
[setup 2023-12-15T19:03:26.630Z] MOZ_FETCHES_DIR is /builds/worker/fetches
[fetches 2023-12-15T19:03:26.630Z] fetching artifacts
[fetches 2023-12-15T19:03:26.630Z] executing ['/usr/bin/python3', '-u', '/usr/local/bin/fetch-content', 'task-artifacts']
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RLkXh5cgSQaYGaiDspw3cg/artifacts/public/build/mono.ru.zst to /builds/worker/fetches/mono.ru.zstattempt 1/5

Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/AgPlxUayScSDmqgddgY9pw/artifacts/public/build/dedupe.tar.zst to /builds/worker/fetches/dedupe.tar.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RLkXh5cgSQaYGaiDspw3cg/artifacts/public/build/mono.ru.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/AgPlxUayScSDmqgddgY9pw/artifacts/public/build/dedupe.tar.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/AgPlxUayScSDmqgddgY9pw/artifacts/public/build/dedupe.tar.zst resolved to 133246 bytes with sha256 1e567b7eabfbbac81c949ba165181bf3b4b5a15d4fcd114a0fc1d7ec82cfac07 in 0.053s
Extracting /builds/worker/fetches/dedupe.tar.zst to /builds/worker/fetches
/builds/worker/fetches/dedupe.tar.zst extracted in 0.002s
Removing /builds/worker/fetches/dedupe.tar.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RLkXh5cgSQaYGaiDspw3cg/artifacts/public/build/mono.ru.zst resolved to 576222 bytes with sha256 84cf4bd2b5eb3343c519b4b317c9c91250a409add8671ada999672f14bb04045 in 0.124s
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 0.1259782240000078, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2023-12-15T19:03:26.835Z] finished fetching artifacts
[task 2023-12-15T19:03:26.835Z] executing ['bash', '-c', 'export BIN=$MOZ_FETCHES_DIR && $VCS_PATH/taskcluster/scripts/pipeline/split-mono-taskcluster.sh 2 /builds/worker/artifacts 5000 $MOZ_FETCHES_DIR/mono.$LOCALE.zst']
[task 2023-12-15T19:03:26.837Z] + set -euo pipefail
[task 2023-12-15T19:03:26.837Z] + chunks=2
[task 2023-12-15T19:03:26.837Z] + output_dir=/builds/worker/artifacts
[task 2023-12-15T19:03:26.837Z] + length=5000
[task 2023-12-15T19:03:26.837Z] + lang_args=("${@:4}")
[task 2023-12-15T19:03:26.837Z] ++ dirname /builds/worker/checkouts/vcs/taskcluster/scripts/pipeline/split-mono-taskcluster.sh
[task 2023-12-15T19:03:26.838Z] + pushd /builds/worker/checkouts/vcs/taskcluster/scripts/pipeline/../../..
[task 2023-12-15T19:03:26.838Z] ++ pwd
[task 2023-12-15T19:03:26.838Z] + VCS_ROOT=/builds/worker/checkouts/vcs
[task 2023-12-15T19:03:26.838Z] + popd
[task 2023-12-15T19:03:26.838Z] + /builds/worker/checkouts/vcs/pipeline/translate/split-mono.sh /builds/worker/fetches/mono.ru.zst /builds/worker/artifacts 5000
[task 2023-12-15T19:03:26.840Z] + set -euo pipefail
[task 2023-12-15T19:03:26.840Z] + test -v BIN
[task 2023-12-15T19:03:26.840Z] + mono_path=/builds/worker/fetches/mono.ru.zst
[task 2023-12-15T19:03:26.840Z] + output_dir=/builds/worker/artifacts
[task 2023-12-15T19:03:26.840Z] + length=5000
[task 2023-12-15T19:03:26.840Z] + COMPRESSION_CMD=zstdmt
[task 2023-12-15T19:03:26.840Z] + ARTIFACT_EXT=zst
[task 2023-12-15T19:03:26.840Z] + mkdir -p /builds/worker/artifacts
[task 2023-12-15T19:03:26.841Z] + zstdmt -dc /builds/worker/fetches/mono.ru.zst
[task 2023-12-15T19:03:26.841Z] + /builds/worker/fetches/dedupe
[task 2023-12-15T19:03:26.841Z] + split -d -l 5000 - /builds/worker/artifacts/file.
[task 2023-12-15T19:03:26.843Z] File stdin isn't normal.  Using slower read() instead of mmap().  No progress bar.
[task 2023-12-15T19:03:26.849Z] Kept 9961 / 9961 = 1
[task 2023-12-15T19:03:26.849Z] + cd /builds/worker/artifacts
[task 2023-12-15T19:03:26.849Z] + ls file.00 file.01
[task 2023-12-15T19:03:26.849Z] + sort
[task 2023-12-15T19:03:26.851Z] ++ seq 1 2
[task 2023-12-15T19:03:26.851Z] ++ tr '\n' ' '
[task 2023-12-15T19:03:26.851Z] + for i in $(seq 1 ${chunks} | tr '\n' ' ')
[task 2023-12-15T19:03:26.852Z] ++ split -n l/1/2 out-files.txt
[task 2023-12-15T19:03:26.852Z] ++ tr '\n' ' '
[task 2023-12-15T19:03:26.853Z] + out_files='file.00 '
[task 2023-12-15T19:03:26.853Z] + '[' 'file.00 ' = '' ']'
[task 2023-12-15T19:03:26.853Z] + cat file.00
[task 2023-12-15T19:03:26.854Z] + zstd --rm out-file.1
[task 2023-12-15T19:03:26.856Z] 
[task 2023-12-15T19:03:26.856Z]                                                                                
[task 2023-12-15T19:03:26.863Z] Read :  0 /  0 MB ==> 32%
[task 2023-12-15T19:03:26.863Z]                                                                                
[task 2023-12-15T19:03:26.863Z] out-file.1           : 28.86%   (1017680 => 293700 bytes, out-file.1.zst) 
[task 2023-12-15T19:03:26.863Z] + for i in $(seq 1 ${chunks} | tr '\n' ' ')
[task 2023-12-15T19:03:26.864Z] ++ split -n l/2/2 out-files.txt
[task 2023-12-15T19:03:26.864Z] ++ tr '\n' ' '
[task 2023-12-15T19:03:26.864Z] + out_files='file.01 '
[task 2023-12-15T19:03:26.864Z] + '[' 'file.01 ' = '' ']'
[task 2023-12-15T19:03:26.864Z] + cat file.01
[task 2023-12-15T19:03:26.866Z] + zstd --rm out-file.2
[task 2023-12-15T19:03:26.868Z] 
[task 2023-12-15T19:03:26.868Z]                                                                                
[task 2023-12-15T19:03:26.874Z] Read :  0 /  0 MB ==> 32%
[task 2023-12-15T19:03:26.874Z]                                                                                
[task 2023-12-15T19:03:26.874Z] out-file.2           : 28.82%   (1015979 => 292790 bytes, out-file.2.zst) 
[task 2023-12-15T19:03:26.875Z] + rm file.00 file.01 out-files.txt
[fetches 2023-12-15T19:03:26.876Z] removing /builds/worker/fetches
[fetches 2023-12-15T19:03:26.876Z] finished
[taskcluster 2023-12-15 19:03:27.368Z] === Task Finished ===
[taskcluster 2023-12-15 19:03:27.702Z] Successful task run with exit code: 0 completed in 3.522 seconds