Upgrade to Taskgraph 7 #316
Merged
firefoxci-taskcluster / translate-mono-trg-ru-en-1/2
succeeded
Dec 20, 2023 in 7m 32s
FirefoxCI (pull_request)
translate mono for en
Details
View task in Taskcluster
View logs in Taskcluster
[vcs 2023-12-20T15:08:54.298Z] Cloning into '/home/ubuntu/tasks/task_170308489267541/checkouts/vcs/3rd_party/kenlm'...
[vcs 2023-12-20T15:08:55.628Z] Cloning into '/home/ubuntu/tasks/task_170308489267541/checkouts/vcs/3rd_party/marian-dev'...
[vcs 2023-12-20T15:08:59.447Z] Cloning into '/home/ubuntu/tasks/task_170308489267541/checkouts/vcs/3rd_party/preprocess'...
[vcs 2023-12-20T15:09:00.221Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2023-12-20T15:09:00.248Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2023-12-20T15:09:00.284Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2023-12-20T15:09:00.337Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2023-12-20T15:09:00.520Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2023-12-20T15:09:00.554Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2023-12-20T15:09:00.554Z] cleaning git checkout...
[vcs 2023-12-20T15:09:00.554Z] executing ['git', 'clean', '-nxdff']
[vcs 2023-12-20T15:09:00.558Z] removing []
[vcs 2023-12-20T15:09:00.558Z] successfully cleaned git checkout!
[vcs 2023-12-20T15:09:00.582Z] TinderboxPrint:<a href='https://github.com/bhearsum/firefox-translations-training/commit/084cd68b442168a104ef509f6ea7bf320b139e2a' title='Built from firefox-translations-training commit 084cd68b442168a104ef509f6ea7bf320b139e2a'>084cd68b442168a104ef509f6ea7bf320b139e2a</a>
[setup 2023-12-20T15:09:00.582Z] MOZ_FETCHES_DIR is /home/ubuntu/tasks/task_170308489267541/fetches
[fetches 2023-12-20T15:09:00.582Z] fetching artifacts
[fetches 2023-12-20T15:09:00.583Z] executing ['/usr/bin/python3', '-u', '/home/ubuntu/tasks/task_170308489267541/./fetch-content', 'task-artifacts']
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SyZAbAXGTOC2SwxzSiUK8w/artifacts/public/build/file.1.zst to /home/ubuntu/tasks/task_170308489267541/fetches/file.1.zst
attempt 1/5
attempt 1/5Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SyZAbAXGTOC2SwxzSiUK8w/artifacts/public/build/file.1.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/UGkRJAPkTfmkxcB8UlS-Cw/artifacts/public/build/cuda-toolkit.tar.zst to /home/ubuntu/tasks/task_170308489267541/fetches/cuda-toolkit.tar.zst
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cn-lpssPTcSd6hfnUpJWRg/artifacts/public/build/marian.tar.zst to /home/ubuntu/tasks/task_170308489267541/fetches/marian.tar.zst
/home/ubuntu/tasks/task_170308489267541/./fetch-content:192: DeprecationWarning: cafile, capath and cadefault are deprecated, use a custom context instead.
with urllib.request.urlopen(
attempt 1/5Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ImPa-cejQjG_yb_l1wHchQ/artifacts/public/build/final.model.npz.best-chrf.npz to /home/ubuntu/tasks/task_170308489267541/fetches/final.model.npz.best-chrf.npz
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ImPa-cejQjG_yb_l1wHchQ/artifacts/public/build/vocab.spm to /home/ubuntu/tasks/task_170308489267541/fetches/vocab.spm
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/UGkRJAPkTfmkxcB8UlS-Cw/artifacts/public/build/cuda-toolkit.tar.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ImPa-cejQjG_yb_l1wHchQ/artifacts/public/build/final.model.npz.best-chrf.npz
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ImPa-cejQjG_yb_l1wHchQ/artifacts/public/build/vocab.spm
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cn-lpssPTcSd6hfnUpJWRg/artifacts/public/build/marian.tar.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SyZAbAXGTOC2SwxzSiUK8w/artifacts/public/build/file.1.zst resolved to 258212 bytes with sha256 b179d5479a965d0d31efe4420d61b803eef5ebc88e152beddca690b74726c332 in 0.404s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ImPa-cejQjG_yb_l1wHchQ/artifacts/public/build/vocab.spm resolved to 252659 bytes with sha256 55399c37c1432c4d2a11bd342c3901a624b8822ca03e5ce01c92378bf38d562c in 0.438s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ImPa-cejQjG_yb_l1wHchQ/artifacts/public/build/final.model.npz.best-chrf.npz resolved to 137530720 bytes with sha256 a6dbb8bcd759736d8cf5c1af1d77992413daaa3efb6218691037fdf491c3eb39 in 3.883s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cn-lpssPTcSd6hfnUpJWRg/artifacts/public/build/marian.tar.zst resolved to 655359574 bytes with sha256 b6bd12da45186642cb8228b8d2e895528dbd4feb597068265504457ee90fec73 in 8.857s
Extracting /home/ubuntu/tasks/task_170308489267541/fetches/marian.tar.zst to /home/ubuntu/tasks/task_170308489267541/fetches
/home/ubuntu/tasks/task_170308489267541/fetches/marian.tar.zst extracted in 6.852s
Removing /home/ubuntu/tasks/task_170308489267541/fetches/marian.tar.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/UGkRJAPkTfmkxcB8UlS-Cw/artifacts/public/build/cuda-toolkit.tar.zst resolved to 3292700193 bytes with sha256 a3fb0996aeda9edd3737d0a76d371bcf8309187462c89dae62692bcb5a9d81ce in 76.780s
Extracting /home/ubuntu/tasks/task_170308489267541/fetches/cuda-toolkit.tar.zst to /home/ubuntu/tasks/task_170308489267541/fetches
/home/ubuntu/tasks/task_170308489267541/fetches/cuda-toolkit.tar.zst extracted in 18.986s
Removing /home/ubuntu/tasks/task_170308489267541/fetches/cuda-toolkit.tar.zst
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 96.267819612, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2023-12-20T15:10:37.218Z] finished fetching artifacts
[task 2023-12-20T15:10:37.218Z] executing ['bash', '-xc', 'export MARIAN=$MOZ_FETCHES_DIR && $VCS_PATH/taskcluster/scripts/pipeline/translate-taskcluster.sh $MOZ_FETCHES_DIR/file.1.zst artifacts plain $MOZ_FETCHES_DIR/vocab.spm $MOZ_FETCHES_DIR/*.npz --mini-batch-words 2000']
[task 2023-12-20T15:10:37.220Z] + export MARIAN=/home/ubuntu/tasks/task_170308489267541/fetches
[task 2023-12-20T15:10:37.220Z] + MARIAN=/home/ubuntu/tasks/task_170308489267541/fetches
[task 2023-12-20T15:10:37.244Z] + ./checkouts/vcs/taskcluster/scripts/pipeline/translate-taskcluster.sh /home/ubuntu/tasks/task_170308489267541/fetches/file.1.zst artifacts plain /home/ubuntu/tasks/task_170308489267541/fetches/vocab.spm /home/ubuntu/tasks/task_170308489267541/fetches/final.model.npz.best-chrf.npz --mini-batch-words 2000
[task 2023-12-20T15:10:37.245Z] + set -euo pipefail
[task 2023-12-20T15:10:37.246Z] + input=/home/ubuntu/tasks/task_170308489267541/fetches/file.1.zst
[task 2023-12-20T15:10:37.246Z] + output_dir=artifacts
[task 2023-12-20T15:10:37.246Z] + type=plain
[task 2023-12-20T15:10:37.246Z] + other_args=("${@:4}")
[task 2023-12-20T15:10:37.246Z] ++ dirname ./checkouts/vcs/taskcluster/scripts/pipeline/translate-taskcluster.sh
[task 2023-12-20T15:10:37.247Z] + pushd ./checkouts/vcs/taskcluster/scripts/pipeline/../../..
[task 2023-12-20T15:10:37.248Z] ++ pwd
[task 2023-12-20T15:10:37.248Z] + VCS_ROOT=/home/ubuntu/tasks/task_170308489267541/checkouts/vcs
[task 2023-12-20T15:10:37.248Z] + popd
[task 2023-12-20T15:10:37.248Z] + mkdir -p artifacts
[task 2023-12-20T15:10:37.250Z] + zstd -d --rm /home/ubuntu/tasks/task_170308489267541/fetches/file.1.zst
[task 2023-12-20T15:10:37.548Z]
[task 2023-12-20T15:10:37.551Z] 1/fetches/file.1.zst : 0 MB...
[task 2023-12-20T15:10:37.551Z]
[task 2023-12-20T15:10:37.551Z] /home/ubuntu/tasks/task_170308489267541/fetches/file.1.zst: 615911 bytes
[task 2023-12-20T15:10:37.551Z] + input=/home/ubuntu/tasks/task_170308489267541/fetches/file.1
[task 2023-12-20T15:10:37.551Z] + outfile=/home/ubuntu/tasks/task_170308489267541/fetches/file.1.out
[task 2023-12-20T15:10:37.551Z] + '[' plain = nbest ']'
[task 2023-12-20T15:10:37.551Z] + '[' -s /home/ubuntu/tasks/task_170308489267541/fetches/file.1 ']'
[task 2023-12-20T15:10:37.551Z] + '[' plain = plain ']'
[task 2023-12-20T15:10:37.551Z] + /home/ubuntu/tasks/task_170308489267541/checkouts/vcs/pipeline/translate/translate.sh /home/ubuntu/tasks/task_170308489267541/fetches/file.1 /home/ubuntu/tasks/task_170308489267541/fetches/vocab.spm /home/ubuntu/tasks/task_170308489267541/fetches/final.model.npz.best-chrf.npz --mini-batch-words 2000
[task 2023-12-20T15:10:37.553Z] + set -euo pipefail
[task 2023-12-20T15:10:37.553Z] + test -v GPUS
[task 2023-12-20T15:10:37.553Z] + test -v MARIAN
[task 2023-12-20T15:10:37.553Z] + test -v WORKSPACE
[task 2023-12-20T15:10:37.553Z] + input=/home/ubuntu/tasks/task_170308489267541/fetches/file.1
[task 2023-12-20T15:10:37.553Z] + vocab=/home/ubuntu/tasks/task_170308489267541/fetches/vocab.spm
[task 2023-12-20T15:10:37.553Z] + models=("${@:3}")
[task 2023-12-20T15:10:37.554Z] ++ dirname /home/ubuntu/tasks/task_170308489267541/checkouts/vcs/pipeline/translate/translate.sh
[task 2023-12-20T15:10:37.555Z] + cd /home/ubuntu/tasks/task_170308489267541/checkouts/vcs/pipeline/translate
[task 2023-12-20T15:10:37.555Z] + /home/ubuntu/tasks/task_170308489267541/fetches/marian-decoder -c decoder.yml -m /home/ubuntu/tasks/task_170308489267541/fetches/final.model.npz.best-chrf.npz --mini-batch-words 2000 -v /home/ubuntu/tasks/task_170308489267541/fetches/vocab.spm /home/ubuntu/tasks/task_170308489267541/fetches/vocab.spm -i /home/ubuntu/tasks/task_170308489267541/fetches/file.1 -o /home/ubuntu/tasks/task_170308489267541/fetches/file.1.out --log /home/ubuntu/tasks/task_170308489267541/fetches/file.1.log -d 0 1 2 3 -w 12000
[task 2023-12-20T15:10:50.264Z] [2023-12-20 15:10:50] [marian] Marian v1.10.25; e8a1a25 2021-12-07 17:47:33 +0000
[task 2023-12-20T15:10:50.264Z] [2023-12-20 15:10:50] [marian] Running on translations-1-b-linux-v100-gpu-4-m-pnqkgaq5iij4xf6a1qwg as process 1885 with command line:
[task 2023-12-20T15:10:50.264Z] [2023-12-20 15:10:50] [marian] /home/ubuntu/tasks/task_170308489267541/fetches/marian-decoder -c decoder.yml -m /home/ubuntu/tasks/task_170308489267541/fetches/final.model.npz.best-chrf.npz --mini-batch-words 2000 -v /home/ubuntu/tasks/task_170308489267541/fetches/vocab.spm /home/ubuntu/tasks/task_170308489267541/fetches/vocab.spm -i /home/ubuntu/tasks/task_170308489267541/fetches/file.1 -o /home/ubuntu/tasks/task_170308489267541/fetches/file.1.out --log /home/ubuntu/tasks/task_170308489267541/fetches/file.1.log -d 0 1 2 3 -w 12000
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] alignment: ""
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] allow-special: false
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] allow-unk: false
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] authors: false
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] beam-size: 8
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] bert-class-symbol: "[CLS]"
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] bert-mask-symbol: "[MASK]"
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] bert-masking-fraction: 0.15
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] bert-sep-symbol: "[SEP]"
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] bert-train-type-embeddings: true
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] bert-type-vocab-size: 2
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] best-deep: false
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] build-info: ""
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] check-nan: false
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] cite: false
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] cpu-threads: 0
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] dec-cell: gru
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] dec-cell-base-depth: 2
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] dec-cell-high-depth: 1
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] dec-depth: 1
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] devices:
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] - 0
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] - 1
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] - 2
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] - 3
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] dim-emb: 512
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] dim-rnn: 1024
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] dim-vocabs:
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] - 1000
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] - 1000
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] dump-config: ""
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] enc-cell: gru
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] enc-cell-depth: 1
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] enc-depth: 1
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] enc-type: bidirectional
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] factors-combine: sum
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] factors-dim-emb: 0
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] gemm-type: float32
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] ignore-model-config: false
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] input:
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] - /home/ubuntu/tasks/task_170308489267541/fetches/file.1
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] input-types:
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] []
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] interpolate-env-vars: false
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] layer-normalization: True
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] lemma-dependency: ""
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] lemma-dim-emb: 0
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] log: /home/ubuntu/tasks/task_170308489267541/fetches/file.1.log
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] log-level: info
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] log-time-zone: ""
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] max-length: 200
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] max-length-crop: true
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] max-length-factor: 3
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] maxi-batch: 1000
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] maxi-batch-sort: src
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] mini-batch: 16
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] mini-batch-words: 2000
[task 2023-12-20T15:10:50.266Z] [2023-12-20 15:10:50] [config] models:
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] - /home/ubuntu/tasks/task_170308489267541/fetches/final.model.npz.best-chrf.npz
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] n-best: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] no-spm-decode: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] normalize: 1.0
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] num-devices: 0
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] optimize: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] output: /home/ubuntu/tasks/task_170308489267541/fetches/file.1.out
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] output-approx-knn:
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] []
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] output-omit-bias: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] output-sampling: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] precision:
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] - float32
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] quantize-range: 0
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] quiet: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] quiet-translation: True
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] relative-paths: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] right-left: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] seed: 0
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] shortlist:
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] []
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] skip: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] skip-cost: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] stat-freq: 0
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] tied-embeddings: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] tied-embeddings-all: True
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] tied-embeddings-src: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] transformer-aan-activation: swish
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] transformer-aan-depth: 2
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] transformer-aan-nogate: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] transformer-decoder-autoreg: self-attention
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] transformer-depth-scaling: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] transformer-dim-aan: 2048
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] transformer-dim-ffn: 2048
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] transformer-ffn-activation: swish
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] transformer-ffn-depth: 2
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] transformer-guided-alignment-layer: last
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] transformer-heads: 8
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] transformer-no-projection: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] transformer-pool: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] transformer-postprocess: dan
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] transformer-postprocess-emb: d
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] transformer-postprocess-top: ""
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] transformer-preprocess: ""
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] transformer-tied-layers:
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] []
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] transformer-train-position-embeddings: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] tsv: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] tsv-fields: 0
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] type: s2s
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] ulr: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] ulr-dim-emb: 0
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] ulr-trainable-transformation: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] version: v1.10.25; e8a1a25 2021-12-07 17:47:33 +0000
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] vocabs:
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] - /home/ubuntu/tasks/task_170308489267541/fetches/vocab.spm
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] - /home/ubuntu/tasks/task_170308489267541/fetches/vocab.spm
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] weights:
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] []
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] word-penalty: 0
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] word-scores: false
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] workspace: 12000
[task 2023-12-20T15:10:50.267Z] [2023-12-20 15:10:50] [config] Loaded model has been created with Marian v1.10.25; e8a1a25 2021-12-07 17:47:33 +0000
[task 2023-12-20T15:10:50.269Z] [2023-12-20 15:10:50] [data] Loading SentencePiece vocabulary from file /home/ubuntu/tasks/task_170308489267541/fetches/vocab.spm
[task 2023-12-20T15:10:50.272Z] [2023-12-20 15:10:50] [data] Loading SentencePiece vocabulary from file /home/ubuntu/tasks/task_170308489267541/fetches/vocab.spm
[task 2023-12-20T15:10:53.763Z] [2023-12-20 15:10:53] [memory] Extending reserved space to 12032 MB (device gpu2)
[task 2023-12-20T15:10:53.763Z] [2023-12-20 15:10:53] [memory] Extending reserved space to 12032 MB (device gpu1)
[task 2023-12-20T15:10:53.763Z] [2023-12-20 15:10:53] [memory] Extending reserved space to 12032 MB (device gpu3)
[task 2023-12-20T15:10:53.812Z] [2023-12-20 15:10:53] [memory] Extending reserved space to 12032 MB (device gpu0)
[task 2023-12-20T15:10:53.819Z] [2023-12-20 15:10:53] Loading scorer of type s2s as feature F0
[task 2023-12-20T15:10:53.819Z] [2023-12-20 15:10:53] Loading model from /home/ubuntu/tasks/task_170308489267541/fetches/final.model.npz.best-chrf.npz
[task 2023-12-20T15:10:53.819Z] [2023-12-20 15:10:53] Loading scorer of type s2s as feature F0
[task 2023-12-20T15:10:53.819Z] [2023-12-20 15:10:53] Loading model from /home/ubuntu/tasks/task_170308489267541/fetches/final.model.npz.best-chrf.npz
[task 2023-12-20T15:10:53.821Z] [2023-12-20 15:10:53] Loading scorer of type s2s as feature F0
[task 2023-12-20T15:10:53.821Z] [2023-12-20 15:10:53] Loading model from /home/ubuntu/tasks/task_170308489267541/fetches/final.model.npz.best-chrf.npz
[task 2023-12-20T15:10:53.843Z] [2023-12-20 15:10:53] Loading scorer of type s2s as feature F0
[task 2023-12-20T15:10:53.843Z] [2023-12-20 15:10:53] Loading model from /home/ubuntu/tasks/task_170308489267541/fetches/final.model.npz.best-chrf.npz
[task 2023-12-20T15:10:54.251Z] [2023-12-20 15:10:54] [memory] Reserving 131 MB, device gpu3
[task 2023-12-20T15:10:54.255Z] [2023-12-20 15:10:54] [memory] Reserving 131 MB, device gpu2
[task 2023-12-20T15:10:54.259Z] [2023-12-20 15:10:54] [memory] Reserving 131 MB, device gpu0
[task 2023-12-20T15:10:54.284Z] [2023-12-20 15:10:54] [memory] Reserving 131 MB, device gpu1
[task 2023-12-20T15:10:54.740Z] [2023-12-20 15:10:54] [gpu] 16-bit TensorCores enabled for float32 matrix operations
[task 2023-12-20T15:11:09.916Z] [2023-12-20 15:11:09] Total time: 15.58991s wall
[task 2023-12-20T15:11:19.374Z] ++ wc -l
[task 2023-12-20T15:11:19.565Z] ++ wc -l
[task 2023-12-20T15:11:19.567Z] + test 4965 == 4965
[task 2023-12-20T15:11:19.568Z] + zstd --rm /home/ubuntu/tasks/task_170308489267541/fetches/file.1.out
[task 2023-12-20T15:11:19.570Z]
[task 2023-12-20T15:11:19.570Z]
[task 2023-12-20T15:11:19.570Z] Read : 0 / 0 MB ==> 8%
[task 2023-12-20T15:11:19.570Z]
[task 2023-12-20T15:11:19.570Z] /home/ubuntu/tasks/task_170308489267541/fetches/file.1.out : 8.47% (141920 => 12015 bytes, /home/ubuntu/tasks/task_170308489267541/fetches/file.1.out.zst)
[task 2023-12-20T15:11:19.571Z] + cp /home/ubuntu/tasks/task_170308489267541/fetches/file.1.out.zst artifacts
[fetches 2023-12-20T15:11:19.573Z] removing /home/ubuntu/tasks/task_170308489267541/fetches
[fetches 2023-12-20T15:11:22.334Z] finished
[taskcluster 2023-12-20T15:11:22.344Z] Exit Code: 0
[taskcluster 2023-12-20T15:11:22.344Z] User Time: 1m37.767243s
[taskcluster 2023-12-20T15:11:22.344Z] Kernel Time: 35.097165s
[taskcluster 2023-12-20T15:11:22.344Z] Wall Time: 2m42.430337094s
[taskcluster 2023-12-20T15:11:22.344Z] Result: SUCCEEDED
[taskcluster 2023-12-20T15:11:22.344Z] === Task Finished ===
[taskcluster 2023-12-20T15:11:22.344Z] Task Duration: 2m42.432262192s
[taskcluster 2023-12-20T15:11:22.966Z] Uploading artifact public/build/file.1.out.zst from file /home/ubuntu/tasks/task_170308489267541/artifacts/file.1.out.zst with content encoding "identity", mime type "application/zstd" and expiry 2024-03-19T15:03:51.663Z
[taskcluster 2023-12-20T15:11:23.122Z] [mounts] Preserving cache: Moving "/home/ubuntu/tasks/task_170308489267541/checkouts" to "/home/ubuntu/caches/Ze7D1CtZQ5yoUk7roWE9pw"
[taskcluster 2023-12-20T15:11:23.369Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2024-03-19T15:03:51.663Z
Loading