[taskcluster 2023-12-20 15:05:06.193Z] Task ID: CJdy2sm5QxuNTgZTy7hnvA
[taskcluster 2023-12-20 15:05:06.193Z] Worker ID: 8284144627451083910
[taskcluster 2023-12-20 15:05:06.193Z] Worker Group: us-central1
[taskcluster 2023-12-20 15:05:06.193Z] Worker Node Type: projects/887720501152/machineTypes/n2-highmem-32
[taskcluster 2023-12-20 15:05:06.193Z] Worker Pool: translations-1/b-linux-large-gcp-300gb
[taskcluster 2023-12-20 15:05:06.193Z] Worker Version: 38.0.5
[taskcluster 2023-12-20 15:05:06.193Z] Public IP: 23.251.157.233
[taskcluster 2023-12-20 15:05:06.193Z] Hostname: translations-1-b-linux-large-gcp-300gb-lekdqaarrcsfuljtzg7ljq
[taskcluster 2023-12-20 15:05:06.193Z] using cache "translations-level-1-checkouts-v3-58974d7dcf0417b3fe53-ARGg7JgtR3C0C2BCSaAWqA" -> /builds/worker/checkouts

[taskcluster 2023-12-20 15:05:08.773Z] Downloading artifact "public/image.tar.zst" from task ID: ARGg7JgtR3C0C2BCSaAWqA.
[taskcluster 2023-12-20 15:05:11.046Z] Downloaded artifact successfully.
[taskcluster 2023-12-20 15:05:11.047Z] Downloaded 251.882 mb
[taskcluster 2023-12-20 15:05:11.047Z] Decompressing downloaded image
[taskcluster 2023-12-20 15:05:12.614Z] Loading docker image from downloaded archive.
[taskcluster 2023-12-20 15:05:21.628Z] Image 'public/image.tar.zst' from task 'ARGg7JgtR3C0C2BCSaAWqA' loaded.  Using image ID sha256:fa53620b2ece3428f41eb15ffb863544aa69d70369d1fa2d4412339db9f7115c.
[taskcluster 2023-12-20 15:05:21.757Z] === Task Starting ===
[setup 2023-12-20T15:05:29.062Z] run-task started in /builds/worker
[setup 2023-12-20T15:05:29.062Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/vcs/ -- bash -c python3 $VCS_PATH/pipeline/translate/splitter.py --output_dir=/builds/worker/artifacts --num_parts=2 --compression_cmd=zstdmt $MOZ_FETCHES_DIR/mono.$LOCALE.zst
[setup 2023-12-20T15:05:29.062Z] Python version: 3.10.12
[cache 2023-12-20T15:05:29.064Z] cache /builds/worker/checkouts is empty; writing requirements: gid=1000 uid=1000 version=1
[volume 2023-12-20T15:05:29.064Z] volume /builds/worker/checkouts is a cache
[setup 2023-12-20T15:05:29.065Z] running as worker:worker
[vcs 2023-12-20T15:05:29.065Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/vcs']
[vcs 2023-12-20T15:05:29.067Z] executing ['git', 'clone', 'https://github.com/mozilla/firefox-translations-training', '/builds/worker/checkouts/vcs']
[vcs 2023-12-20T15:05:29.068Z] Cloning into '/builds/worker/checkouts/vcs'...
[vcs 2023-12-20T15:05:30.040Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/bhearsum/firefox-translations-training', 'taskgraph-7']
[vcs 2023-12-20T15:05:30.344Z] From https://github.com/bhearsum/firefox-translations-training
[vcs 2023-12-20T15:05:30.344Z]  * branch            taskgraph-7 -> FETCH_HEAD
[vcs 2023-12-20T15:05:30.346Z] executing ['git', 'checkout', '-f', '-B', 'taskgraph-7', '084cd68b442168a104ef509f6ea7bf320b139e2a']
[vcs 2023-12-20T15:05:30.383Z] Switched to a new branch 'taskgraph-7'
[vcs 2023-12-20T15:05:30.383Z] executing ['git', 'submodule', 'init']
[vcs 2023-12-20T15:05:30.402Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2023-12-20T15:05:30.402Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2023-12-20T15:05:30.403Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2023-12-20T15:05:30.404Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2023-12-20T15:05:30.404Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2023-12-20T15:05:30.405Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2023-12-20T15:05:30.405Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2023-12-20T15:05:30.425Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/browsermt-marian-dev'...
[vcs 2023-12-20T15:05:33.466Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/extract-lex'...
[vcs 2023-12-20T15:05:33.824Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/fast_align'...
[vcs 2023-12-20T15:05:34.176Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/kenlm'...
[vcs 2023-12-20T15:05:35.042Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/marian-dev'...
[vcs 2023-12-20T15:05:37.282Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/preprocess'...
[vcs 2023-12-20T15:05:37.910Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2023-12-20T15:05:37.919Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2023-12-20T15:05:37.928Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2023-12-20T15:05:37.952Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2023-12-20T15:05:38.056Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2023-12-20T15:05:38.073Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2023-12-20T15:05:38.073Z] cleaning git checkout...
[vcs 2023-12-20T15:05:38.073Z] executing ['git', 'clean', '-nxdff']
[vcs 2023-12-20T15:05:38.075Z] removing []
[vcs 2023-12-20T15:05:38.075Z] successfully cleaned git checkout!
[vcs 2023-12-20T15:05:38.077Z] TinderboxPrint:<a href='https://github.com/bhearsum/firefox-translations-training/commit/084cd68b442168a104ef509f6ea7bf320b139e2a' title='Built from firefox-translations-training commit 084cd68b442168a104ef509f6ea7bf320b139e2a'>084cd68b442168a104ef509f6ea7bf320b139e2a</a>
[setup 2023-12-20T15:05:38.077Z] MOZ_FETCHES_DIR is /builds/worker/fetches
[fetches 2023-12-20T15:05:38.077Z] fetching artifacts
[fetches 2023-12-20T15:05:38.077Z] executing ['/usr/bin/python3', '-u', '/usr/local/bin/fetch-content', 'task-artifacts']
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/fsh5EyQpSuyeGtJN9h_xgw/artifacts/public/build/mono.ru.zst to /builds/worker/fetches/mono.ru.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/fsh5EyQpSuyeGtJN9h_xgw/artifacts/public/build/mono.ru.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/fsh5EyQpSuyeGtJN9h_xgw/artifacts/public/build/mono.ru.zst resolved to 579339 bytes with sha256 2db63d6cdf5a15265b06cabd937bea6b3eef7ae669c16efa7207c823d75c4e55 in 0.260s
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 0.2617106289999924, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2023-12-20T15:05:38.415Z] finished fetching artifacts
[task 2023-12-20T15:05:38.415Z] executing ['bash', '-c', 'python3 $VCS_PATH/pipeline/translate/splitter.py --output_dir=/builds/worker/artifacts --num_parts=2 --compression_cmd=zstdmt $MOZ_FETCHES_DIR/mono.$LOCALE.zst']
[task 2023-12-20T15:05:38.459Z] 
[task 2023-12-20T15:05:38.459Z]                                                                                
[task 2023-12-20T15:05:38.466Z] Read :  0 /  0 MB ==> 32%
[task 2023-12-20T15:05:38.466Z]                                                                                
[task 2023-12-20T15:05:38.466Z] /builds/worker/artifacts/file.1 : 28.91%   (1014919 => 293423 bytes, /builds/worker/artifacts/file.1.zst) 
[task 2023-12-20T15:05:38.476Z] 
[task 2023-12-20T15:05:38.476Z]                                                                                
[task 2023-12-20T15:05:38.483Z] Read :  0 /  0 MB ==> 32%
[task 2023-12-20T15:05:38.483Z]                                                                                
[task 2023-12-20T15:05:38.483Z] /builds/worker/artifacts/file.2 : 28.83%   (1025472 => 295678 bytes, /builds/worker/artifacts/file.2.zst) 
[task 2023-12-20T15:05:38.484Z] Splitting /builds/worker/fetches/mono.ru.zst to 2 chunks x 9947 lines
[task 2023-12-20T15:05:38.484Z] A new file /builds/worker/artifacts/file.1 created
[task 2023-12-20T15:05:38.484Z] Compressing /builds/worker/artifacts/file.1 with zstdmt
[task 2023-12-20T15:05:38.484Z] A new file /builds/worker/artifacts/file.2 created
[task 2023-12-20T15:05:38.484Z] Compressing /builds/worker/artifacts/file.2 with zstdmt
[task 2023-12-20T15:05:38.484Z] Done
[fetches 2023-12-20T15:05:38.488Z] removing /builds/worker/fetches
[fetches 2023-12-20T15:05:38.488Z] finished
[taskcluster 2023-12-20 15:05:39.023Z] === Task Finished ===
[taskcluster 2023-12-20 15:05:39.585Z] Successful task run with exit code: 0 completed in 33.393 seconds