Set TERM for docker worker images #464
Merged
firefoxci-taskcluster / translate-mono-trg-ru-en-1/2
succeeded
Feb 28, 2024 in 7m 2s
FirefoxCI (pull_request)
translate mono for en
Details
View task in Taskcluster
View logs in Taskcluster
[vcs 2024-02-28T02:26:42.864Z] Cloning into '/home/ubuntu/tasks/task_170908714348551/checkouts/vcs/3rd_party/kenlm'...
[vcs 2024-02-28T02:26:43.635Z] Cloning into '/home/ubuntu/tasks/task_170908714348551/checkouts/vcs/3rd_party/marian-dev'...
[vcs 2024-02-28T02:26:45.562Z] Cloning into '/home/ubuntu/tasks/task_170908714348551/checkouts/vcs/3rd_party/preprocess'...
[vcs 2024-02-28T02:26:46.228Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-02-28T02:26:46.250Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-02-28T02:26:46.273Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-02-28T02:26:46.321Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-02-28T02:26:46.485Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-02-28T02:26:46.520Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-02-28T02:26:46.521Z] cleaning git checkout...
[vcs 2024-02-28T02:26:46.521Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-02-28T02:26:46.527Z] removing []
[vcs 2024-02-28T02:26:46.527Z] successfully cleaned git checkout!
[vcs 2024-02-28T02:26:46.573Z] TinderboxPrint:<a href='https://github.com/bhearsum/firefox-translations-training/commit/38340942e4bdac1ff2749e0647f6fc7f10d602db' title='Built from firefox-translations-training commit 38340942e4bdac1ff2749e0647f6fc7f10d602db'>38340942e4bdac1ff2749e0647f6fc7f10d602db</a>
[setup 2024-02-28T02:26:46.573Z] MOZ_FETCHES_DIR is /home/ubuntu/tasks/task_170908714348551/fetches
[fetches 2024-02-28T02:26:46.573Z] fetching artifacts
[fetches 2024-02-28T02:26:46.573Z] executing ['/usr/bin/python3', '-u', '/home/ubuntu/tasks/task_170908714348551/./fetch-content', 'task-artifacts']
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/IjrmKyn0RtCzBYdS2BrdcQ/artifacts/public/build/file.1.zst to /home/ubuntu/tasks/task_170908714348551/fetches/file.1.zst
attempt 1/5
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/XKFBSMoJRdO-Evx0QApuSQ/artifacts/public/build/cuda-toolkit.tar.zst to /home/ubuntu/tasks/task_170908714348551/fetches/cuda-toolkit.tar.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/HO2mjai4Spq8Hf9XJE-S0A/artifacts/public/build/marian.tar.zst to /home/ubuntu/tasks/task_170908714348551/fetches/marian.tar.zstDownloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/XKFBSMoJRdO-Evx0QApuSQ/artifacts/public/build/cuda-toolkit.tar.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/IjrmKyn0RtCzBYdS2BrdcQ/artifacts/public/build/file.1.zst
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SP5Tkju6QTel3ZKL4qKTMw/artifacts/public/build/final.model.npz.best-chrf.npz to /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz
/home/ubuntu/tasks/task_170908714348551/./fetch-content:192: DeprecationWarning: cafile, capath and cadefault are deprecated, use a custom context instead.
with urllib.request.urlopen(
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SP5Tkju6QTel3ZKL4qKTMw/artifacts/public/build/vocab.spm to /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SP5Tkju6QTel3ZKL4qKTMw/artifacts/public/build/vocab.spm
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SP5Tkju6QTel3ZKL4qKTMw/artifacts/public/build/final.model.npz.best-chrf.npz
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/HO2mjai4Spq8Hf9XJE-S0A/artifacts/public/build/marian.tar.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SP5Tkju6QTel3ZKL4qKTMw/artifacts/public/build/vocab.spm resolved to 252750 bytes with sha256 cb63c2c60d98d0a71d760497b22a2e877fd67667c7fbc722743ad8cc0a6c5fa5 in 0.395s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/IjrmKyn0RtCzBYdS2BrdcQ/artifacts/public/build/file.1.zst resolved to 257667 bytes with sha256 4d673d260f06caf70e11179ec6642dd813319b8ea63f6644de567afecaeab1bd in 0.416s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SP5Tkju6QTel3ZKL4qKTMw/artifacts/public/build/final.model.npz.best-chrf.npz resolved to 137530720 bytes with sha256 406487efb6932b1a9c70d70dee3d4e57d09a1e2cf88b88e50366360db22eb773 in 3.108s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/XKFBSMoJRdO-Evx0QApuSQ/artifacts/public/build/cuda-toolkit.tar.zst resolved to 3296632591 bytes with sha256 8235ffabba1ea2012dc266b0123cbdbd2ecb03512190c8f36ee3355407fcf464 in 47.172s
Extracting /home/ubuntu/tasks/task_170908714348551/fetches/cuda-toolkit.tar.zst to /home/ubuntu/tasks/task_170908714348551/fetches
/home/ubuntu/tasks/task_170908714348551/fetches/cuda-toolkit.tar.zst extracted in 21.741s
Removing /home/ubuntu/tasks/task_170908714348551/fetches/cuda-toolkit.tar.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/HO2mjai4Spq8Hf9XJE-S0A/artifacts/public/build/marian.tar.zst resolved to 655360834 bytes with sha256 55179d28e0fc61252a95b156c108cc10b8b091c579cd346f0e2d3c9926254920 in 185.560s
Extracting /home/ubuntu/tasks/task_170908714348551/fetches/marian.tar.zst to /home/ubuntu/tasks/task_170908714348551/fetches
/home/ubuntu/tasks/task_170908714348551/fetches/marian.tar.zst extracted in 7.122s
Removing /home/ubuntu/tasks/task_170908714348551/fetches/marian.tar.zst
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 192.794807951, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2024-02-28T02:29:59.744Z] finished fetching artifacts
[task 2024-02-28T02:29:59.744Z] executing ['bash', '-xc', 'export MARIAN=$MOZ_FETCHES_DIR && $VCS_PATH/taskcluster/scripts/pipeline/translate-taskcluster.sh $MOZ_FETCHES_DIR/file.1.zst artifacts plain $MOZ_FETCHES_DIR/vocab.spm $MOZ_FETCHES_DIR/*.npz --mini-batch-words 2000']
[task 2024-02-28T02:29:59.746Z] + export MARIAN=/home/ubuntu/tasks/task_170908714348551/fetches
[task 2024-02-28T02:29:59.746Z] + MARIAN=/home/ubuntu/tasks/task_170908714348551/fetches
[task 2024-02-28T02:29:59.746Z] + ./checkouts/vcs/taskcluster/scripts/pipeline/translate-taskcluster.sh /home/ubuntu/tasks/task_170908714348551/fetches/file.1.zst artifacts plain /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz --mini-batch-words 2000
[task 2024-02-28T02:29:59.748Z] + set -euo pipefail
[task 2024-02-28T02:29:59.748Z] + input=/home/ubuntu/tasks/task_170908714348551/fetches/file.1.zst
[task 2024-02-28T02:29:59.748Z] + output_dir=artifacts
[task 2024-02-28T02:29:59.748Z] + type=plain
[task 2024-02-28T02:29:59.748Z] + other_args=("${@:4}")
[task 2024-02-28T02:29:59.749Z] ++ dirname ./checkouts/vcs/taskcluster/scripts/pipeline/translate-taskcluster.sh
[task 2024-02-28T02:29:59.750Z] + pushd ./checkouts/vcs/taskcluster/scripts/pipeline/../../..
[task 2024-02-28T02:29:59.751Z] ++ pwd
[task 2024-02-28T02:29:59.751Z] + VCS_ROOT=/home/ubuntu/tasks/task_170908714348551/checkouts/vcs
[task 2024-02-28T02:29:59.751Z] + popd
[task 2024-02-28T02:29:59.751Z] + mkdir -p artifacts
[task 2024-02-28T02:29:59.753Z] + zstd -d --rm /home/ubuntu/tasks/task_170908714348551/fetches/file.1.zst
[task 2024-02-28T02:29:59.778Z]
[task 2024-02-28T02:29:59.781Z] 1/fetches/file.1.zst : 0 MB...
[task 2024-02-28T02:29:59.781Z]
[task 2024-02-28T02:29:59.781Z] /home/ubuntu/tasks/task_170908714348551/fetches/file.1.zst: 614890 bytes
[task 2024-02-28T02:29:59.782Z] + input=/home/ubuntu/tasks/task_170908714348551/fetches/file.1
[task 2024-02-28T02:29:59.782Z] + outfile=/home/ubuntu/tasks/task_170908714348551/fetches/file.1.out
[task 2024-02-28T02:29:59.782Z] + '[' plain = nbest ']'
[task 2024-02-28T02:29:59.782Z] + '[' -s /home/ubuntu/tasks/task_170908714348551/fetches/file.1 ']'
[task 2024-02-28T02:29:59.782Z] + '[' plain = plain ']'
[task 2024-02-28T02:29:59.782Z] + /home/ubuntu/tasks/task_170908714348551/checkouts/vcs/pipeline/translate/translate.sh /home/ubuntu/tasks/task_170908714348551/fetches/file.1 /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz --mini-batch-words 2000
[task 2024-02-28T02:29:59.784Z] + set -euo pipefail
[task 2024-02-28T02:29:59.784Z] + test -v GPUS
[task 2024-02-28T02:29:59.784Z] + test -v MARIAN
[task 2024-02-28T02:29:59.784Z] + test -v WORKSPACE
[task 2024-02-28T02:29:59.784Z] + input=/home/ubuntu/tasks/task_170908714348551/fetches/file.1
[task 2024-02-28T02:29:59.784Z] + vocab=/home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm
[task 2024-02-28T02:29:59.784Z] + models=("${@:3}")
[task 2024-02-28T02:29:59.785Z] ++ dirname /home/ubuntu/tasks/task_170908714348551/checkouts/vcs/pipeline/translate/translate.sh
[task 2024-02-28T02:29:59.786Z] + cd /home/ubuntu/tasks/task_170908714348551/checkouts/vcs/pipeline/translate
[task 2024-02-28T02:29:59.786Z] + /home/ubuntu/tasks/task_170908714348551/fetches/marian-decoder -c decoder.yml -m /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz --mini-batch-words 2000 -v /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm -i /home/ubuntu/tasks/task_170908714348551/fetches/file.1 -o /home/ubuntu/tasks/task_170908714348551/fetches/file.1.out --log /home/ubuntu/tasks/task_170908714348551/fetches/file.1.log -d 0 1 2 3 -w 12000
[task 2024-02-28T02:30:03.012Z] [2024-02-28 02:30:03] [marian] Marian v1.10.25; e8a1a25 2021-12-07 17:47:33 +0000
[task 2024-02-28T02:30:03.012Z] [2024-02-28 02:30:03] [marian] Running on translations-1-b-linux-v100-gpu-4-xyhbejjkqfkvqdi9uvrbjw as process 3592 with command line:
[task 2024-02-28T02:30:03.012Z] [2024-02-28 02:30:03] [marian] /home/ubuntu/tasks/task_170908714348551/fetches/marian-decoder -c decoder.yml -m /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz --mini-batch-words 2000 -v /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm -i /home/ubuntu/tasks/task_170908714348551/fetches/file.1 -o /home/ubuntu/tasks/task_170908714348551/fetches/file.1.out --log /home/ubuntu/tasks/task_170908714348551/fetches/file.1.log -d 0 1 2 3 -w 12000
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] alignment: ""
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] allow-special: false
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] allow-unk: false
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] authors: false
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] beam-size: 8
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] bert-class-symbol: "[CLS]"
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] bert-mask-symbol: "[MASK]"
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] bert-masking-fraction: 0.15
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] bert-sep-symbol: "[SEP]"
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] bert-train-type-embeddings: true
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] bert-type-vocab-size: 2
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] best-deep: false
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] build-info: ""
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] check-nan: false
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] cite: false
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] cpu-threads: 0
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] dec-cell: gru
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] dec-cell-base-depth: 2
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] dec-cell-high-depth: 1
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] dec-depth: 1
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] devices:
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] - 0
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] - 1
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] - 2
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] - 3
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] dim-emb: 512
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] dim-rnn: 1024
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] dim-vocabs:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] - 1000
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] - 1000
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] dump-config: ""
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] enc-cell: gru
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] enc-cell-depth: 1
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] enc-depth: 1
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] enc-type: bidirectional
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] factors-combine: sum
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] factors-dim-emb: 0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] gemm-type: float32
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] ignore-model-config: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] input:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] - /home/ubuntu/tasks/task_170908714348551/fetches/file.1
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] input-types:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] []
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] interpolate-env-vars: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] layer-normalization: True
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] lemma-dependency: ""
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] lemma-dim-emb: 0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] log: /home/ubuntu/tasks/task_170908714348551/fetches/file.1.log
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] log-level: info
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] log-time-zone: ""
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] max-length: 200
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] max-length-crop: true
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] max-length-factor: 3
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] maxi-batch: 1000
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] maxi-batch-sort: src
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] mini-batch: 16
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] mini-batch-words: 2000
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] models:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] - /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] n-best: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] no-spm-decode: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] normalize: 1.0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] num-devices: 0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] optimize: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] output: /home/ubuntu/tasks/task_170908714348551/fetches/file.1.out
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] output-approx-knn:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] []
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] output-omit-bias: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] output-sampling: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] precision:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] - float32
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] quantize-range: 0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] quiet: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] quiet-translation: True
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] relative-paths: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] right-left: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] seed: 0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] shortlist:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] []
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] skip: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] skip-cost: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] stat-freq: 0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] tied-embeddings: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] tied-embeddings-all: True
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] tied-embeddings-src: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-aan-activation: swish
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-aan-depth: 2
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-aan-nogate: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-decoder-autoreg: self-attention
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-depth-scaling: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-dim-aan: 2048
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-dim-ffn: 2048
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-ffn-activation: swish
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-ffn-depth: 2
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-guided-alignment-layer: last
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-heads: 8
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-no-projection: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-pool: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-postprocess: dan
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-postprocess-emb: d
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-postprocess-top: ""
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-preprocess: ""
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-tied-layers:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] []
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-train-position-embeddings: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] tsv: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] tsv-fields: 0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] type: s2s
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] ulr: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] ulr-dim-emb: 0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] ulr-trainable-transformation: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] version: v1.10.25; e8a1a25 2021-12-07 17:47:33 +0000
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] vocabs:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] - /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] - /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] weights:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] []
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] word-penalty: 0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] word-scores: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] workspace: 12000
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] Loaded model has been created with Marian v1.10.25; e8a1a25 2021-12-07 17:47:33 +0000
[task 2024-02-28T02:30:03.017Z] [2024-02-28 02:30:03] [data] Loading SentencePiece vocabulary from file /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm
[task 2024-02-28T02:30:03.020Z] [2024-02-28 02:30:03] [data] Loading SentencePiece vocabulary from file /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm
[task 2024-02-28T02:30:03.773Z] [2024-02-28 02:30:03] [memory] Extending reserved space to 12032 MB (device gpu3)
[task 2024-02-28T02:30:03.773Z] [2024-02-28 02:30:03] [memory] Extending reserved space to 12032 MB (device gpu2)
[task 2024-02-28T02:30:03.810Z] [2024-02-28 02:30:03] [memory] Extending reserved space to 12032 MB (device gpu0)
[task 2024-02-28T02:30:03.813Z] [2024-02-28 02:30:03] [memory] Extending reserved space to 12032 MB (device gpu1)
[task 2024-02-28T02:30:03.814Z] [2024-02-28 02:30:03] Loading scorer of type s2s as feature F0
[task 2024-02-28T02:30:03.815Z] [2024-02-28 02:30:03] Loading model from /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz
[task 2024-02-28T02:30:03.815Z] [2024-02-28 02:30:03] Loading scorer of type s2s as feature F0
[task 2024-02-28T02:30:03.815Z] [2024-02-28 02:30:03] Loading model from /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz
[task 2024-02-28T02:30:03.864Z] [2024-02-28 02:30:03] Loading scorer of type s2s as feature F0
[task 2024-02-28T02:30:03.864Z] [2024-02-28 02:30:03] Loading model from /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz
[task 2024-02-28T02:30:03.865Z] [2024-02-28 02:30:03] Loading scorer of type s2s as feature F0
[task 2024-02-28T02:30:03.865Z] [2024-02-28 02:30:03] Loading model from /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz
[task 2024-02-28T02:30:04.254Z] [2024-02-28 02:30:04] [memory] Reserving 131 MB, device gpu3
[task 2024-02-28T02:30:04.291Z] [2024-02-28 02:30:04] [memory] Reserving 131 MB, device gpu2
[task 2024-02-28T02:30:04.301Z] [2024-02-28 02:30:04] [memory] Reserving 131 MB, device gpu1
[task 2024-02-28T02:30:04.306Z] [2024-02-28 02:30:04] [memory] Reserving 131 MB, device gpu0
[task 2024-02-28T02:30:04.720Z] [2024-02-28 02:30:04] [gpu] 16-bit TensorCores enabled for float32 matrix operations
[task 2024-02-28T02:30:23.021Z] [2024-02-28 02:30:23] Total time: 18.65424s wall
[task 2024-02-28T02:30:30.692Z] ++ wc -l
[task 2024-02-28T02:30:30.752Z] ++ wc -l
[task 2024-02-28T02:30:30.754Z] + test 4960 == 4960
[task 2024-02-28T02:30:30.755Z] + zstd --rm /home/ubuntu/tasks/task_170908714348551/fetches/file.1.out
[task 2024-02-28T02:30:30.757Z]
[task 2024-02-28T02:30:30.757Z]
[task 2024-02-28T02:30:30.757Z] Read : 0 / 0 MB ==> 8%
[task 2024-02-28T02:30:30.757Z]
[task 2024-02-28T02:30:30.757Z] /home/ubuntu/tasks/task_170908714348551/fetches/file.1.out : 7.63% ( 94722 => 7224 bytes, /home/ubuntu/tasks/task_170908714348551/fetches/file.1.out.zst)
[task 2024-02-28T02:30:30.757Z] + cp /home/ubuntu/tasks/task_170908714348551/fetches/file.1.out.zst artifacts
[fetches 2024-02-28T02:30:30.760Z] removing /home/ubuntu/tasks/task_170908714348551/fetches
[fetches 2024-02-28T02:30:33.079Z] finished
[taskcluster 2024-02-28T02:30:33.091Z] Exit Code: 0
[taskcluster 2024-02-28T02:30:33.091Z] User Time: 1m53.517622s
[taskcluster 2024-02-28T02:30:33.091Z] Kernel Time: 34.705423s
[taskcluster 2024-02-28T02:30:33.091Z] Wall Time: 4m1.78187195s
[taskcluster 2024-02-28T02:30:33.091Z] Result: SUCCEEDED
[taskcluster 2024-02-28T02:30:33.091Z] === Task Finished ===
[taskcluster 2024-02-28T02:30:33.091Z] Task Duration: 4m1.784301962s
[taskcluster 2024-02-28T02:30:33.191Z] Uploading artifact public/build/file.1.out.zst from file /home/ubuntu/tasks/task_170908714348551/artifacts/file.1.out.zst with content encoding "identity", mime type "application/zstd" and expiry 2024-05-28T02:23:31.445Z
[taskcluster 2024-02-28T02:30:33.349Z] [mounts] Preserving cache: Moving "/home/ubuntu/tasks/task_170908714348551/checkouts" to "/home/ubuntu/caches/S_mqSvCQR5eevhUymO1bWg"
[taskcluster 2024-02-28T02:30:33.426Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2024-05-28T02:23:31.445Z
Loading