Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set TERM for docker worker images #464

Merged
merged 2 commits into from
Feb 28, 2024

Merge branch 'main' into term

3834094
Select commit
Loading
Failed to load commit list.
Merged

Set TERM for docker worker images #464

Merge branch 'main' into term
3834094
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / translate-mono-trg-ru-en-1/2 succeeded Feb 28, 2024 in 7m 2s

FirefoxCI (pull_request)

translate mono for en

Details

View task in Taskcluster
View logs in Taskcluster


[vcs 2024-02-28T02:26:42.864Z] Cloning into '/home/ubuntu/tasks/task_170908714348551/checkouts/vcs/3rd_party/kenlm'...
[vcs 2024-02-28T02:26:43.635Z] Cloning into '/home/ubuntu/tasks/task_170908714348551/checkouts/vcs/3rd_party/marian-dev'...
[vcs 2024-02-28T02:26:45.562Z] Cloning into '/home/ubuntu/tasks/task_170908714348551/checkouts/vcs/3rd_party/preprocess'...
[vcs 2024-02-28T02:26:46.228Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-02-28T02:26:46.250Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-02-28T02:26:46.273Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-02-28T02:26:46.321Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-02-28T02:26:46.485Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-02-28T02:26:46.520Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-02-28T02:26:46.521Z] cleaning git checkout...
[vcs 2024-02-28T02:26:46.521Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-02-28T02:26:46.527Z] removing []
[vcs 2024-02-28T02:26:46.527Z] successfully cleaned git checkout!
[vcs 2024-02-28T02:26:46.573Z] TinderboxPrint:<a href='https://github.com/bhearsum/firefox-translations-training/commit/38340942e4bdac1ff2749e0647f6fc7f10d602db' title='Built from firefox-translations-training commit 38340942e4bdac1ff2749e0647f6fc7f10d602db'>38340942e4bdac1ff2749e0647f6fc7f10d602db</a>
[setup 2024-02-28T02:26:46.573Z] MOZ_FETCHES_DIR is /home/ubuntu/tasks/task_170908714348551/fetches
[fetches 2024-02-28T02:26:46.573Z] fetching artifacts
[fetches 2024-02-28T02:26:46.573Z] executing ['/usr/bin/python3', '-u', '/home/ubuntu/tasks/task_170908714348551/./fetch-content', 'task-artifacts']
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/IjrmKyn0RtCzBYdS2BrdcQ/artifacts/public/build/file.1.zst to /home/ubuntu/tasks/task_170908714348551/fetches/file.1.zst
attempt 1/5
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/XKFBSMoJRdO-Evx0QApuSQ/artifacts/public/build/cuda-toolkit.tar.zst to /home/ubuntu/tasks/task_170908714348551/fetches/cuda-toolkit.tar.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/HO2mjai4Spq8Hf9XJE-S0A/artifacts/public/build/marian.tar.zst to /home/ubuntu/tasks/task_170908714348551/fetches/marian.tar.zstDownloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/XKFBSMoJRdO-Evx0QApuSQ/artifacts/public/build/cuda-toolkit.tar.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/IjrmKyn0RtCzBYdS2BrdcQ/artifacts/public/build/file.1.zst

attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SP5Tkju6QTel3ZKL4qKTMw/artifacts/public/build/final.model.npz.best-chrf.npz to /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz
/home/ubuntu/tasks/task_170908714348551/./fetch-content:192: DeprecationWarning: cafile, capath and cadefault are deprecated, use a custom context instead.
  with urllib.request.urlopen(
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SP5Tkju6QTel3ZKL4qKTMw/artifacts/public/build/vocab.spm to /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SP5Tkju6QTel3ZKL4qKTMw/artifacts/public/build/vocab.spm
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SP5Tkju6QTel3ZKL4qKTMw/artifacts/public/build/final.model.npz.best-chrf.npz
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/HO2mjai4Spq8Hf9XJE-S0A/artifacts/public/build/marian.tar.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SP5Tkju6QTel3ZKL4qKTMw/artifacts/public/build/vocab.spm resolved to 252750 bytes with sha256 cb63c2c60d98d0a71d760497b22a2e877fd67667c7fbc722743ad8cc0a6c5fa5 in 0.395s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/IjrmKyn0RtCzBYdS2BrdcQ/artifacts/public/build/file.1.zst resolved to 257667 bytes with sha256 4d673d260f06caf70e11179ec6642dd813319b8ea63f6644de567afecaeab1bd in 0.416s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SP5Tkju6QTel3ZKL4qKTMw/artifacts/public/build/final.model.npz.best-chrf.npz resolved to 137530720 bytes with sha256 406487efb6932b1a9c70d70dee3d4e57d09a1e2cf88b88e50366360db22eb773 in 3.108s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/XKFBSMoJRdO-Evx0QApuSQ/artifacts/public/build/cuda-toolkit.tar.zst resolved to 3296632591 bytes with sha256 8235ffabba1ea2012dc266b0123cbdbd2ecb03512190c8f36ee3355407fcf464 in 47.172s
Extracting /home/ubuntu/tasks/task_170908714348551/fetches/cuda-toolkit.tar.zst to /home/ubuntu/tasks/task_170908714348551/fetches
/home/ubuntu/tasks/task_170908714348551/fetches/cuda-toolkit.tar.zst extracted in 21.741s
Removing /home/ubuntu/tasks/task_170908714348551/fetches/cuda-toolkit.tar.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/HO2mjai4Spq8Hf9XJE-S0A/artifacts/public/build/marian.tar.zst resolved to 655360834 bytes with sha256 55179d28e0fc61252a95b156c108cc10b8b091c579cd346f0e2d3c9926254920 in 185.560s
Extracting /home/ubuntu/tasks/task_170908714348551/fetches/marian.tar.zst to /home/ubuntu/tasks/task_170908714348551/fetches
/home/ubuntu/tasks/task_170908714348551/fetches/marian.tar.zst extracted in 7.122s
Removing /home/ubuntu/tasks/task_170908714348551/fetches/marian.tar.zst
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 192.794807951, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2024-02-28T02:29:59.744Z] finished fetching artifacts
[task 2024-02-28T02:29:59.744Z] executing ['bash', '-xc', 'export MARIAN=$MOZ_FETCHES_DIR && $VCS_PATH/taskcluster/scripts/pipeline/translate-taskcluster.sh $MOZ_FETCHES_DIR/file.1.zst artifacts plain $MOZ_FETCHES_DIR/vocab.spm $MOZ_FETCHES_DIR/*.npz  --mini-batch-words 2000']
[task 2024-02-28T02:29:59.746Z] + export MARIAN=/home/ubuntu/tasks/task_170908714348551/fetches
[task 2024-02-28T02:29:59.746Z] + MARIAN=/home/ubuntu/tasks/task_170908714348551/fetches
[task 2024-02-28T02:29:59.746Z] + ./checkouts/vcs/taskcluster/scripts/pipeline/translate-taskcluster.sh /home/ubuntu/tasks/task_170908714348551/fetches/file.1.zst artifacts plain /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz --mini-batch-words 2000
[task 2024-02-28T02:29:59.748Z] + set -euo pipefail
[task 2024-02-28T02:29:59.748Z] + input=/home/ubuntu/tasks/task_170908714348551/fetches/file.1.zst
[task 2024-02-28T02:29:59.748Z] + output_dir=artifacts
[task 2024-02-28T02:29:59.748Z] + type=plain
[task 2024-02-28T02:29:59.748Z] + other_args=("${@:4}")
[task 2024-02-28T02:29:59.749Z] ++ dirname ./checkouts/vcs/taskcluster/scripts/pipeline/translate-taskcluster.sh
[task 2024-02-28T02:29:59.750Z] + pushd ./checkouts/vcs/taskcluster/scripts/pipeline/../../..
[task 2024-02-28T02:29:59.751Z] ++ pwd
[task 2024-02-28T02:29:59.751Z] + VCS_ROOT=/home/ubuntu/tasks/task_170908714348551/checkouts/vcs
[task 2024-02-28T02:29:59.751Z] + popd
[task 2024-02-28T02:29:59.751Z] + mkdir -p artifacts
[task 2024-02-28T02:29:59.753Z] + zstd -d --rm /home/ubuntu/tasks/task_170908714348551/fetches/file.1.zst
[task 2024-02-28T02:29:59.778Z] 
[task 2024-02-28T02:29:59.781Z] 1/fetches/file.1.zst : 0 MB...     
[task 2024-02-28T02:29:59.781Z]                                                                                
[task 2024-02-28T02:29:59.781Z] /home/ubuntu/tasks/task_170908714348551/fetches/file.1.zst: 614890 bytes 
[task 2024-02-28T02:29:59.782Z] + input=/home/ubuntu/tasks/task_170908714348551/fetches/file.1
[task 2024-02-28T02:29:59.782Z] + outfile=/home/ubuntu/tasks/task_170908714348551/fetches/file.1.out
[task 2024-02-28T02:29:59.782Z] + '[' plain = nbest ']'
[task 2024-02-28T02:29:59.782Z] + '[' -s /home/ubuntu/tasks/task_170908714348551/fetches/file.1 ']'
[task 2024-02-28T02:29:59.782Z] + '[' plain = plain ']'
[task 2024-02-28T02:29:59.782Z] + /home/ubuntu/tasks/task_170908714348551/checkouts/vcs/pipeline/translate/translate.sh /home/ubuntu/tasks/task_170908714348551/fetches/file.1 /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz --mini-batch-words 2000
[task 2024-02-28T02:29:59.784Z] + set -euo pipefail
[task 2024-02-28T02:29:59.784Z] + test -v GPUS
[task 2024-02-28T02:29:59.784Z] + test -v MARIAN
[task 2024-02-28T02:29:59.784Z] + test -v WORKSPACE
[task 2024-02-28T02:29:59.784Z] + input=/home/ubuntu/tasks/task_170908714348551/fetches/file.1
[task 2024-02-28T02:29:59.784Z] + vocab=/home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm
[task 2024-02-28T02:29:59.784Z] + models=("${@:3}")
[task 2024-02-28T02:29:59.785Z] ++ dirname /home/ubuntu/tasks/task_170908714348551/checkouts/vcs/pipeline/translate/translate.sh
[task 2024-02-28T02:29:59.786Z] + cd /home/ubuntu/tasks/task_170908714348551/checkouts/vcs/pipeline/translate
[task 2024-02-28T02:29:59.786Z] + /home/ubuntu/tasks/task_170908714348551/fetches/marian-decoder -c decoder.yml -m /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz --mini-batch-words 2000 -v /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm -i /home/ubuntu/tasks/task_170908714348551/fetches/file.1 -o /home/ubuntu/tasks/task_170908714348551/fetches/file.1.out --log /home/ubuntu/tasks/task_170908714348551/fetches/file.1.log -d 0 1 2 3 -w 12000
[task 2024-02-28T02:30:03.012Z] [2024-02-28 02:30:03] [marian] Marian v1.10.25; e8a1a25 2021-12-07 17:47:33 +0000
[task 2024-02-28T02:30:03.012Z] [2024-02-28 02:30:03] [marian] Running on translations-1-b-linux-v100-gpu-4-xyhbejjkqfkvqdi9uvrbjw as process 3592 with command line:
[task 2024-02-28T02:30:03.012Z] [2024-02-28 02:30:03] [marian] /home/ubuntu/tasks/task_170908714348551/fetches/marian-decoder -c decoder.yml -m /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz --mini-batch-words 2000 -v /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm -i /home/ubuntu/tasks/task_170908714348551/fetches/file.1 -o /home/ubuntu/tasks/task_170908714348551/fetches/file.1.out --log /home/ubuntu/tasks/task_170908714348551/fetches/file.1.log -d 0 1 2 3 -w 12000
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] alignment: ""
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] allow-special: false
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] allow-unk: false
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] authors: false
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] beam-size: 8
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] bert-class-symbol: "[CLS]"
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] bert-mask-symbol: "[MASK]"
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] bert-masking-fraction: 0.15
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] bert-sep-symbol: "[SEP]"
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] bert-train-type-embeddings: true
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] bert-type-vocab-size: 2
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] best-deep: false
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] build-info: ""
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] check-nan: false
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] cite: false
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] cpu-threads: 0
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] dec-cell: gru
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] dec-cell-base-depth: 2
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] dec-cell-high-depth: 1
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] dec-depth: 1
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] devices:
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config]   - 0
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config]   - 1
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config]   - 2
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config]   - 3
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] dim-emb: 512
[task 2024-02-28T02:30:03.014Z] [2024-02-28 02:30:03] [config] dim-rnn: 1024
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] dim-vocabs:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config]   - 1000
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config]   - 1000
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] dump-config: ""
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] enc-cell: gru
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] enc-cell-depth: 1
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] enc-depth: 1
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] enc-type: bidirectional
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] factors-combine: sum
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] factors-dim-emb: 0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] gemm-type: float32
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] ignore-model-config: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] input:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config]   - /home/ubuntu/tasks/task_170908714348551/fetches/file.1
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] input-types:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config]   []
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] interpolate-env-vars: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] layer-normalization: True
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] lemma-dependency: ""
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] lemma-dim-emb: 0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] log: /home/ubuntu/tasks/task_170908714348551/fetches/file.1.log
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] log-level: info
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] log-time-zone: ""
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] max-length: 200
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] max-length-crop: true
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] max-length-factor: 3
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] maxi-batch: 1000
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] maxi-batch-sort: src
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] mini-batch: 16
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] mini-batch-words: 2000
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] models:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config]   - /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] n-best: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] no-spm-decode: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] normalize: 1.0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] num-devices: 0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] optimize: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] output: /home/ubuntu/tasks/task_170908714348551/fetches/file.1.out
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] output-approx-knn:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config]   []
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] output-omit-bias: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] output-sampling: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] precision:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config]   - float32
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] quantize-range: 0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] quiet: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] quiet-translation: True
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] relative-paths: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] right-left: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] seed: 0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] shortlist:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config]   []
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] skip: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] skip-cost: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] stat-freq: 0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] tied-embeddings: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] tied-embeddings-all: True
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] tied-embeddings-src: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-aan-activation: swish
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-aan-depth: 2
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-aan-nogate: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-decoder-autoreg: self-attention
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-depth-scaling: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-dim-aan: 2048
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-dim-ffn: 2048
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-ffn-activation: swish
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-ffn-depth: 2
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-guided-alignment-layer: last
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-heads: 8
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-no-projection: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-pool: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-postprocess: dan
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-postprocess-emb: d
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-postprocess-top: ""
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-preprocess: ""
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-tied-layers:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config]   []
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] transformer-train-position-embeddings: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] tsv: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] tsv-fields: 0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] type: s2s
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] ulr: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] ulr-dim-emb: 0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] ulr-trainable-transformation: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] version: v1.10.25; e8a1a25 2021-12-07 17:47:33 +0000
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] vocabs:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config]   - /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config]   - /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] weights:
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config]   []
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] word-penalty: 0
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] word-scores: false
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] workspace: 12000
[task 2024-02-28T02:30:03.015Z] [2024-02-28 02:30:03] [config] Loaded model has been created with Marian v1.10.25; e8a1a25 2021-12-07 17:47:33 +0000
[task 2024-02-28T02:30:03.017Z] [2024-02-28 02:30:03] [data] Loading SentencePiece vocabulary from file /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm
[task 2024-02-28T02:30:03.020Z] [2024-02-28 02:30:03] [data] Loading SentencePiece vocabulary from file /home/ubuntu/tasks/task_170908714348551/fetches/vocab.spm
[task 2024-02-28T02:30:03.773Z] [2024-02-28 02:30:03] [memory] Extending reserved space to 12032 MB (device gpu3)
[task 2024-02-28T02:30:03.773Z] [2024-02-28 02:30:03] [memory] Extending reserved space to 12032 MB (device gpu2)
[task 2024-02-28T02:30:03.810Z] [2024-02-28 02:30:03] [memory] Extending reserved space to 12032 MB (device gpu0)
[task 2024-02-28T02:30:03.813Z] [2024-02-28 02:30:03] [memory] Extending reserved space to 12032 MB (device gpu1)
[task 2024-02-28T02:30:03.814Z] [2024-02-28 02:30:03] Loading scorer of type s2s as feature F0
[task 2024-02-28T02:30:03.815Z] [2024-02-28 02:30:03] Loading model from /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz
[task 2024-02-28T02:30:03.815Z] [2024-02-28 02:30:03] Loading scorer of type s2s as feature F0
[task 2024-02-28T02:30:03.815Z] [2024-02-28 02:30:03] Loading model from /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz
[task 2024-02-28T02:30:03.864Z] [2024-02-28 02:30:03] Loading scorer of type s2s as feature F0
[task 2024-02-28T02:30:03.864Z] [2024-02-28 02:30:03] Loading model from /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz
[task 2024-02-28T02:30:03.865Z] [2024-02-28 02:30:03] Loading scorer of type s2s as feature F0
[task 2024-02-28T02:30:03.865Z] [2024-02-28 02:30:03] Loading model from /home/ubuntu/tasks/task_170908714348551/fetches/final.model.npz.best-chrf.npz
[task 2024-02-28T02:30:04.254Z] [2024-02-28 02:30:04] [memory] Reserving 131 MB, device gpu3
[task 2024-02-28T02:30:04.291Z] [2024-02-28 02:30:04] [memory] Reserving 131 MB, device gpu2
[task 2024-02-28T02:30:04.301Z] [2024-02-28 02:30:04] [memory] Reserving 131 MB, device gpu1
[task 2024-02-28T02:30:04.306Z] [2024-02-28 02:30:04] [memory] Reserving 131 MB, device gpu0
[task 2024-02-28T02:30:04.720Z] [2024-02-28 02:30:04] [gpu] 16-bit TensorCores enabled for float32 matrix operations
[task 2024-02-28T02:30:23.021Z] [2024-02-28 02:30:23] Total time: 18.65424s wall
[task 2024-02-28T02:30:30.692Z] ++ wc -l
[task 2024-02-28T02:30:30.752Z] ++ wc -l
[task 2024-02-28T02:30:30.754Z] + test 4960 == 4960
[task 2024-02-28T02:30:30.755Z] + zstd --rm /home/ubuntu/tasks/task_170908714348551/fetches/file.1.out
[task 2024-02-28T02:30:30.757Z] 
[task 2024-02-28T02:30:30.757Z]                                                                                
[task 2024-02-28T02:30:30.757Z] Read :  0 /  0 MB ==>  8%
[task 2024-02-28T02:30:30.757Z]                                                                                
[task 2024-02-28T02:30:30.757Z] /home/ubuntu/tasks/task_170908714348551/fetches/file.1.out :  7.63%   ( 94722 =>   7224 bytes, /home/ubuntu/tasks/task_170908714348551/fetches/file.1.out.zst) 
[task 2024-02-28T02:30:30.757Z] + cp /home/ubuntu/tasks/task_170908714348551/fetches/file.1.out.zst artifacts
[fetches 2024-02-28T02:30:30.760Z] removing /home/ubuntu/tasks/task_170908714348551/fetches
[fetches 2024-02-28T02:30:33.079Z] finished
[taskcluster 2024-02-28T02:30:33.091Z]    Exit Code: 0
[taskcluster 2024-02-28T02:30:33.091Z]    User Time: 1m53.517622s
[taskcluster 2024-02-28T02:30:33.091Z]  Kernel Time: 34.705423s
[taskcluster 2024-02-28T02:30:33.091Z]    Wall Time: 4m1.78187195s
[taskcluster 2024-02-28T02:30:33.091Z]       Result: SUCCEEDED
[taskcluster 2024-02-28T02:30:33.091Z] === Task Finished ===
[taskcluster 2024-02-28T02:30:33.091Z] Task Duration: 4m1.784301962s
[taskcluster 2024-02-28T02:30:33.191Z] Uploading artifact public/build/file.1.out.zst from file /home/ubuntu/tasks/task_170908714348551/artifacts/file.1.out.zst with content encoding "identity", mime type "application/zstd" and expiry 2024-05-28T02:23:31.445Z
[taskcluster 2024-02-28T02:30:33.349Z] [mounts] Preserving cache: Moving "/home/ubuntu/tasks/task_170908714348551/checkouts" to "/home/ubuntu/caches/S_mqSvCQR5eevhUymO1bWg"
[taskcluster 2024-02-28T02:30:33.426Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2024-05-28T02:23:31.445Z