[taskcluster 2023-12-20T15:44:54.058Z]  Kernel Time: 1.513ms
[taskcluster 2023-12-20T15:44:54.058Z]    Wall Time: 1.696426ms
[taskcluster 2023-12-20T15:44:54.058Z]       Result: SUCCEEDED
[taskcluster 2023-12-20T15:44:54.058Z] Executing command 1: './run-task' '--firefox_translations_training-checkout=./checkouts/vcs/' -- bash -c 'export MARIAN=$MOZ_FETCHES_DIR && find fetches && $VCS_PATH/pipeline/cefilter/score.sh fetches/final.model.npz.best-chrf.npz fetches/vocab.spm fetches/corpus artifacts/scores.txt'
[setup 2023-12-20T15:44:54.132Z] run-task started in /home/ubuntu/tasks/task_170308703028158
[setup 2023-12-20T15:44:54.132Z] Invoked by command: --firefox_translations_training-checkout=./checkouts/vcs/ -- bash -c export MARIAN=$MOZ_FETCHES_DIR && find fetches && $VCS_PATH/pipeline/cefilter/score.sh fetches/final.model.npz.best-chrf.npz fetches/vocab.spm fetches/corpus artifacts/scores.txt
[setup 2023-12-20T15:44:54.132Z] Python version: 3.10.12
[vcs 2023-12-20T15:44:54.134Z] WARNING: vcs checkout path (/home/ubuntu/tasks/task_170308703028158/checkouts/vcs) not in cache or volume; performance will likely suffer
[vcs 2023-12-20T15:44:54.134Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/home/ubuntu/tasks/task_170308703028158/checkouts/vcs']
[vcs 2023-12-20T15:44:54.136Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/bhearsum/firefox-translations-training', 'taskgraph-7']
[vcs 2023-12-20T15:44:54.404Z] From https://github.com/bhearsum/firefox-translations-training
[vcs 2023-12-20T15:44:54.404Z]  * branch            taskgraph-7 -> FETCH_HEAD
[vcs 2023-12-20T15:44:54.410Z] executing ['git', 'checkout', '-f', '-B', 'taskgraph-7', '084cd68b442168a104ef509f6ea7bf320b139e2a']
[vcs 2023-12-20T15:44:54.460Z] Reset branch 'taskgraph-7'
[vcs 2023-12-20T15:44:54.460Z] executing ['git', 'submodule', 'init']
[vcs 2023-12-20T15:44:54.488Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2023-12-20T15:44:54.607Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2023-12-20T15:44:54.624Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2023-12-20T15:44:54.642Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2023-12-20T15:44:54.679Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2023-12-20T15:44:54.837Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2023-12-20T15:44:54.864Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2023-12-20T15:44:54.864Z] cleaning git checkout...
[vcs 2023-12-20T15:44:54.864Z] executing ['git', 'clean', '-nxdff']
[vcs 2023-12-20T15:44:54.868Z] removing []
[vcs 2023-12-20T15:44:54.868Z] successfully cleaned git checkout!
[vcs 2023-12-20T15:44:54.870Z] TinderboxPrint:<a href='https://github.com/bhearsum/firefox-translations-training/commit/084cd68b442168a104ef509f6ea7bf320b139e2a' title='Built from firefox-translations-training commit 084cd68b442168a104ef509f6ea7bf320b139e2a'>084cd68b442168a104ef509f6ea7bf320b139e2a</a>
[setup 2023-12-20T15:44:54.870Z] MOZ_FETCHES_DIR is /home/ubuntu/tasks/task_170308703028158/fetches
[fetches 2023-12-20T15:44:54.870Z] fetching artifacts
[fetches 2023-12-20T15:44:54.870Z] executing ['/usr/bin/python3', '-u', '/home/ubuntu/tasks/task_170308703028158/./fetch-content', 'task-artifacts']
attempt 1/5attempt 1/5

Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/asY3dw0rQ1WDzE5PPyxnXg/artifacts/public/build/corpus.en.zst to /home/ubuntu/tasks/task_170308703028158/fetches/corpus.en.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/asY3dw0rQ1WDzE5PPyxnXg/artifacts/public/build/corpus.ru.zst to /home/ubuntu/tasks/task_170308703028158/fetches/corpus.ru.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/asY3dw0rQ1WDzE5PPyxnXg/artifacts/public/build/corpus.en.zst
attempt 1/5
/home/ubuntu/tasks/task_170308703028158/./fetch-content:192: DeprecationWarning: cafile, capath and cadefault are deprecated, use a custom context instead.
  with urllib.request.urlopen(
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cn-lpssPTcSd6hfnUpJWRg/artifacts/public/build/marian.tar.zst to /home/ubuntu/tasks/task_170308703028158/fetches/marian.tar.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/asY3dw0rQ1WDzE5PPyxnXg/artifacts/public/build/corpus.ru.zst
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ImPa-cejQjG_yb_l1wHchQ/artifacts/public/build/final.model.npz.best-chrf.npz to /home/ubuntu/tasks/task_170308703028158/fetches/final.model.npz.best-chrf.npz
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cn-lpssPTcSd6hfnUpJWRg/artifacts/public/build/marian.tar.zst
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ImPa-cejQjG_yb_l1wHchQ/artifacts/public/build/vocab.spm to /home/ubuntu/tasks/task_170308703028158/fetches/vocab.spm
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ImPa-cejQjG_yb_l1wHchQ/artifacts/public/build/final.model.npz.best-chrf.npz
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ImPa-cejQjG_yb_l1wHchQ/artifacts/public/build/vocab.spm
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ImPa-cejQjG_yb_l1wHchQ/artifacts/public/build/vocab.spm resolved to 252659 bytes with sha256 55399c37c1432c4d2a11bd342c3901a624b8822ca03e5ce01c92378bf38d562c in 0.338s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/asY3dw0rQ1WDzE5PPyxnXg/artifacts/public/build/corpus.en.zst resolved to 171521 bytes with sha256 0d30d90af62bf42cf5c4bdceaf91941a91f6663fca808ea29662cb1295195f40 in 0.352s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/asY3dw0rQ1WDzE5PPyxnXg/artifacts/public/build/corpus.ru.zst resolved to 1022512 bytes with sha256 44a9f66616aa844a244c9716b21d8ad353c1aa6a72cf48b3411717bbcf5593f2 in 0.410s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ImPa-cejQjG_yb_l1wHchQ/artifacts/public/build/final.model.npz.best-chrf.npz resolved to 137530720 bytes with sha256 a6dbb8bcd759736d8cf5c1af1d77992413daaa3efb6218691037fdf491c3eb39 in 4.790s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cn-lpssPTcSd6hfnUpJWRg/artifacts/public/build/marian.tar.zst resolved to 655359574 bytes with sha256 b6bd12da45186642cb8228b8d2e895528dbd4feb597068265504457ee90fec73 in 4.842s
Extracting /home/ubuntu/tasks/task_170308703028158/fetches/marian.tar.zst to /home/ubuntu/tasks/task_170308703028158/fetches
/home/ubuntu/tasks/task_170308703028158/fetches/marian.tar.zst extracted in 6.364s
Removing /home/ubuntu/tasks/task_170308703028158/fetches/marian.tar.zst
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 11.624645294999993, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2023-12-20T15:45:06.593Z] finished fetching artifacts
[task 2023-12-20T15:45:06.593Z] executing ['bash', '-c', 'export MARIAN=$MOZ_FETCHES_DIR && find fetches && $VCS_PATH/pipeline/cefilter/score.sh fetches/final.model.npz.best-chrf.npz fetches/vocab.spm fetches/corpus artifacts/scores.txt']
[task 2023-12-20T15:45:06.627Z] fetches
[task 2023-12-20T15:45:06.627Z] fetches/marian
[task 2023-12-20T15:45:06.627Z] fetches/marian-vocab
[task 2023-12-20T15:45:06.627Z] fetches/final.model.npz.best-chrf.npz
[task 2023-12-20T15:45:06.627Z] fetches/marian-scorer
[task 2023-12-20T15:45:06.627Z] fetches/spm_encode
[task 2023-12-20T15:45:06.627Z] fetches/vocab.spm
[task 2023-12-20T15:45:06.627Z] fetches/corpus.en.zst
[task 2023-12-20T15:45:06.627Z] fetches/marian-conv
[task 2023-12-20T15:45:06.627Z] fetches/spm_train
[task 2023-12-20T15:45:06.627Z] fetches/marian-decoder
[task 2023-12-20T15:45:06.627Z] fetches/spm_export_vocab
[task 2023-12-20T15:45:06.627Z] fetches/corpus.ru.zst
[task 2023-12-20T15:45:06.629Z] + set -euo pipefail
[task 2023-12-20T15:45:06.629Z] + echo '###### Scoring'
[task 2023-12-20T15:45:06.629Z] ###### Scoring
[task 2023-12-20T15:45:06.629Z] + test -v MARIAN
[task 2023-12-20T15:45:06.629Z] + test -v GPUS
[task 2023-12-20T15:45:06.629Z] + test -v SRC
[task 2023-12-20T15:45:06.629Z] + test -v TRG
[task 2023-12-20T15:45:06.629Z] + test -v WORKSPACE
[task 2023-12-20T15:45:06.629Z] + model=fetches/final.model.npz.best-chrf.npz
[task 2023-12-20T15:45:06.629Z] + vocab=fetches/vocab.spm
[task 2023-12-20T15:45:06.629Z] + corpus_prefix=fetches/corpus
[task 2023-12-20T15:45:06.629Z] + output=artifacts/scores.txt
[task 2023-12-20T15:45:06.629Z] + ARTIFACT_EXT=zst
[task 2023-12-20T15:45:06.629Z] + '[' zst = zst ']'
[task 2023-12-20T15:45:06.629Z] + zstdmt --rm -d fetches/corpus.ru.zst
[task 2023-12-20T15:45:06.631Z] 
[task 2023-12-20T15:45:06.643Z] etches/corpus.ru.zst : 0 MB...     
[task 2023-12-20T15:45:06.643Z]                                                                                
[task 2023-12-20T15:45:06.643Z] fetches/corpus.ru.zst: 3666194 bytes 
[task 2023-12-20T15:45:06.644Z] + zstdmt --rm -d fetches/corpus.en.zst
[task 2023-12-20T15:45:06.646Z] 
[task 2023-12-20T15:45:06.669Z] etches/corpus.en.zst : 0 MB...     
[task 2023-12-20T15:45:06.669Z]                                                                                
[task 2023-12-20T15:45:06.669Z] fetches/corpus.en.zst: 17804663 bytes 
[task 2023-12-20T15:45:06.669Z] + ARTIFACT_EXT=
[task 2023-12-20T15:45:06.670Z] ++ dirname artifacts/scores.txt
[task 2023-12-20T15:45:06.671Z] + dir=artifacts
[task 2023-12-20T15:45:06.671Z] + mkdir -p artifacts
[task 2023-12-20T15:45:06.673Z] + /home/ubuntu/tasks/task_170308703028158/fetches/marian-scorer -m fetches/final.model.npz.best-chrf.npz -v fetches/vocab.spm fetches/vocab.spm -t fetches/corpus.en fetches/corpus.ru --mini-batch 32 --mini-batch-words 1500 --maxi-batch 1000 --max-length 250 --max-length-crop --normalize -d 0 1 2 3 -w 12000 --log artifacts/scores.txt.log
[task 2023-12-20T15:45:06.741Z] [2023-12-20 15:45:06] [marian] Marian v1.10.25; e8a1a25 2021-12-07 17:47:33 +0000
[task 2023-12-20T15:45:06.741Z] [2023-12-20 15:45:06] [marian] Running on translations-1-b-linux-v100-gpu-4-bu1x6lk4tnwo6q0uj5q7da as process 2206 with command line:
[task 2023-12-20T15:45:06.741Z] [2023-12-20 15:45:06] [marian] /home/ubuntu/tasks/task_170308703028158/fetches/marian-scorer -m fetches/final.model.npz.best-chrf.npz -v fetches/vocab.spm fetches/vocab.spm -t fetches/corpus.en fetches/corpus.ru --mini-batch 32 --mini-batch-words 1500 --maxi-batch 1000 --max-length 250 --max-length-crop --normalize -d 0 1 2 3 -w 12000 --log artifacts/scores.txt.log
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] alignment: ""
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] authors: false
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] bert-class-symbol: "[CLS]"
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] bert-mask-symbol: "[MASK]"
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] bert-masking-fraction: 0.15
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] bert-sep-symbol: "[SEP]"
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] bert-train-type-embeddings: true
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] bert-type-vocab-size: 2
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] best-deep: false
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] build-info: ""
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] check-nan: false
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] cite: false
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] cpu-threads: 0
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] dec-cell: gru
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] dec-cell-base-depth: 2
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] dec-cell-high-depth: 1
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] dec-depth: 1
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] devices:
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config]   - 0
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config]   - 1
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config]   - 2
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config]   - 3
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] dim-emb: 512
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] dim-rnn: 1024
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] dim-vocabs:
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config]   - 1000
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config]   - 1000
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] dump-config: ""
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] enc-cell: gru
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] enc-cell-depth: 1
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] enc-depth: 1
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] enc-type: bidirectional
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] factors-combine: sum
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] factors-dim-emb: 0
[task 2023-12-20T15:45:06.742Z] [2023-12-20 15:45:06] [config] gemm-type: float32
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] ignore-model-config: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] input-types:
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config]   []
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] interpolate-env-vars: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] layer-normalization: True
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] lemma-dependency: ""
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] lemma-dim-emb: 0
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] log: artifacts/scores.txt.log
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] log-level: info
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] log-time-zone: ""
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] max-length: 250
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] max-length-crop: true
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] maxi-batch: 1000
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] maxi-batch-sort: trg
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] mini-batch: 32
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] mini-batch-words: 1500
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] model: fetches/final.model.npz.best-chrf.npz
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] n-best: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] n-best-feature: Score
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] no-reload: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] normalize: true
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] num-devices: 0
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] optimize: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] output: stdout
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] output-omit-bias: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] precision:
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config]   - float32
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] quantize-range: 0
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] quiet: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] quiet-translation: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] relative-paths: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] right-left: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] seed: 0
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] skip: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] summary: ""
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] tied-embeddings: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] tied-embeddings-all: True
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] tied-embeddings-src: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] train-sets:
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config]   - fetches/corpus.en
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config]   - fetches/corpus.ru
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] transformer-aan-activation: swish
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] transformer-aan-depth: 2
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] transformer-aan-nogate: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] transformer-decoder-autoreg: self-attention
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] transformer-depth-scaling: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] transformer-dim-aan: 2048
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] transformer-dim-ffn: 2048
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] transformer-ffn-activation: swish
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] transformer-ffn-depth: 2
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] transformer-guided-alignment-layer: last
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] transformer-heads: 8
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] transformer-no-projection: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] transformer-pool: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] transformer-postprocess: dan
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] transformer-postprocess-emb: d
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] transformer-postprocess-top: ""
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] transformer-preprocess: ""
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] transformer-tied-layers:
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config]   []
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] transformer-train-position-embeddings: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] tsv: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] tsv-fields: 0
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] type: s2s
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] ulr: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] ulr-dim-emb: 0
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] ulr-trainable-transformation: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] version: v1.10.25; e8a1a25 2021-12-07 17:47:33 +0000
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] vocabs:
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config]   - fetches/vocab.spm
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config]   - fetches/vocab.spm
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] word-scores: false
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] workspace: 12000
[task 2023-12-20T15:45:06.743Z] [2023-12-20 15:45:06] [config] Loaded model has been created with Marian v1.10.25; e8a1a25 2021-12-07 17:47:33 +0000
[task 2023-12-20T15:45:06.744Z] [2023-12-20 15:45:06] [data] Loading SentencePiece vocabulary from file fetches/vocab.spm
[task 2023-12-20T15:45:06.747Z] [2023-12-20 15:45:06] [data] Setting vocabulary size for input 0 to 1,000
[task 2023-12-20T15:45:06.747Z] [2023-12-20 15:45:06] [data] Loading SentencePiece vocabulary from file fetches/vocab.spm
[task 2023-12-20T15:45:06.749Z] [2023-12-20 15:45:06] [data] Setting vocabulary size for input 1 to 1,000
[task 2023-12-20T15:45:06.947Z] [2023-12-20 15:45:06] [memory] Extending reserved space to 12032 MB (device gpu0)
[task 2023-12-20T15:45:07.062Z] [2023-12-20 15:45:07] [memory] Extending reserved space to 12032 MB (device gpu1)
[task 2023-12-20T15:45:07.176Z] [2023-12-20 15:45:07] [memory] Extending reserved space to 12032 MB (device gpu2)
[task 2023-12-20T15:45:07.295Z] [2023-12-20 15:45:07] [memory] Extending reserved space to 12032 MB (device gpu3)
[task 2023-12-20T15:45:07.313Z] [2023-12-20 15:45:07] Loading model from fetches/final.model.npz.best-chrf.npz
[task 2023-12-20T15:45:07.313Z] [2023-12-20 15:45:07] Loading model from fetches/final.model.npz.best-chrf.npz
[task 2023-12-20T15:45:07.315Z] [2023-12-20 15:45:07] Loading model from fetches/final.model.npz.best-chrf.npz
[task 2023-12-20T15:45:07.315Z] [2023-12-20 15:45:07] Loading model from fetches/final.model.npz.best-chrf.npz
[task 2023-12-20T15:45:07.783Z] [2023-12-20 15:45:07] Scoring
[task 2023-12-20T15:45:09.965Z] [2023-12-20 15:45:09] [logits] Applying loss function for 1 factor(s)
[task 2023-12-20T15:45:09.965Z] [2023-12-20 15:45:09] [memory] Reserving 131 MB, device gpu2
[task 2023-12-20T15:45:09.965Z] [2023-12-20 15:45:09] [memory] Reserving 131 MB, device gpu0
[task 2023-12-20T15:45:09.965Z] [2023-12-20 15:45:09] [memory] Reserving 131 MB, device gpu1
[task 2023-12-20T15:45:09.969Z] [2023-12-20 15:45:09] [memory] Reserving 131 MB, device gpu3
[task 2023-12-20T15:45:09.993Z] [2023-12-20 15:45:09] [gpu] 16-bit TensorCores enabled for float32 matrix operations
[task 2023-12-20T15:45:38.459Z] [2023-12-20 15:45:38] Total normalized log probs 7.53198e+06 : Total sentences 16842 : Total words 1101548
[task 2023-12-20T15:45:38.459Z] [2023-12-20 15:45:38] Sum of normalized log probs is a sum of averages
[task 2023-12-20T15:45:38.523Z] [2023-12-20 15:45:38] Total time: 31.77910s wall
[task 2023-12-20T15:45:38.841Z] + echo '###### Done: Scoring'
[task 2023-12-20T15:45:38.841Z] ###### Done: Scoring
[fetches 2023-12-20T15:45:38.842Z] removing /home/ubuntu/tasks/task_170308703028158/fetches
[fetches 2023-12-20T15:45:40.208Z] finished
[taskcluster 2023-12-20T15:45:40.219Z]    Exit Code: 0
[taskcluster 2023-12-20T15:45:40.219Z]    User Time: 2m4.521836s
[taskcluster 2023-12-20T15:45:40.219Z]  Kernel Time: 8.759423s
[taskcluster 2023-12-20T15:45:40.219Z]    Wall Time: 46.160205009s
[taskcluster 2023-12-20T15:45:40.219Z]       Result: SUCCEEDED
[taskcluster 2023-12-20T15:45:40.219Z] === Task Finished ===
[taskcluster 2023-12-20T15:45:40.219Z] Task Duration: 46.162505273s
[taskcluster 2023-12-20T15:45:40.240Z] Uploading artifact public/build/scores.txt from file /home/ubuntu/tasks/task_170308703028158/artifacts/scores.txt with content encoding "gzip", mime type "text/plain; charset=utf-8" and expiry 2024-03-19T15:03:52.824Z
[taskcluster 2023-12-20T15:45:40.442Z] Uploading artifact public/build/scores.txt.log from file /home/ubuntu/tasks/task_170308703028158/artifacts/scores.txt.log with content encoding "gzip", mime type "text/plain" and expiry 2024-03-19T15:03:52.824Z
[taskcluster 2023-12-20T15:45:40.604Z] [mounts] Preserving cache: Moving "/home/ubuntu/tasks/task_170308703028158/checkouts" to "/home/ubuntu/caches/ZVCJd_b7S0iVwggvVqoMFg"
[taskcluster 2023-12-20T15:45:40.633Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2024-03-19T15:03:52.824Z