Revert CPU generic workers #629
+11
−11
Merged
firefoxci-taskcluster / score-ru-en
succeeded
May 24, 2024 in 56m 2s
FirefoxCI (pull_request)
score for ru-en
Details
View task in Taskcluster
View logs in Taskcluster
[vcs 2024-05-24T17:44:05.946Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-05-24T17:44:05.965Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-05-24T17:44:06.003Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-05-24T17:44:06.162Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-05-24T17:44:06.191Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-05-24T17:44:06.192Z] cleaning git checkout...
[vcs 2024-05-24T17:44:06.192Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-05-24T17:44:06.196Z] removing []
[vcs 2024-05-24T17:44:06.196Z] successfully cleaned git checkout!
[vcs 2024-05-24T17:44:06.199Z] TinderboxPrint:<a href='https://github.com/mozilla/firefox-translations-training/commit/9db52842e17a9fa0ececcfc30809128fa1c52288' title='Built from firefox-translations-training commit 9db52842e17a9fa0ececcfc30809128fa1c52288'>9db52842e17a9fa0ececcfc30809128fa1c52288</a>
[setup 2024-05-24T17:44:06.199Z] MOZ_FETCHES_DIR is /home/ubuntu/tasks/task_171657241003114/fetches
[fetches 2024-05-24T17:44:06.199Z] fetching artifacts
[fetches 2024-05-24T17:44:06.199Z] executing ['/usr/bin/python3', '-u', '/home/ubuntu/tasks/task_171657241003114/./fetch-content', 'task-artifacts']
attempt 1/5attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/a2LeLawzTledMJLMV7PMjA/artifacts/public/build/corpus.ru.zst to /home/ubuntu/tasks/task_171657241003114/fetches/corpus.ru.zst
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cCr_z2sITDGiow53WiHs8g/artifacts/public/build/marian.tar.zst to /home/ubuntu/tasks/task_171657241003114/fetches/marian.tar.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/a2LeLawzTledMJLMV7PMjA/artifacts/public/build/corpus.ru.zstattempt 1/5Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cCr_z2sITDGiow53WiHs8g/artifacts/public/build/marian.tar.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/C9eIy-g2QtmfNxdaVlMWGw/artifacts/public/build/final.model.npz.best-chrf.npz to /home/ubuntu/tasks/task_171657241003114/fetches/final.model.npz.best-chrf.npz
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/a2LeLawzTledMJLMV7PMjA/artifacts/public/build/corpus.en.zst to /home/ubuntu/tasks/task_171657241003114/fetches/corpus.en.zst/home/ubuntu/tasks/task_171657241003114/./fetch-content:192: DeprecationWarning: cafile, capath and cadefault are deprecated, use a custom context instead.
with urllib.request.urlopen(
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/C9eIy-g2QtmfNxdaVlMWGw/artifacts/public/build/final.model.npz.best-chrf.npz
attempt 1/5Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/a2LeLawzTledMJLMV7PMjA/artifacts/public/build/corpus.en.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/C9eIy-g2QtmfNxdaVlMWGw/artifacts/public/build/vocab.spm to /home/ubuntu/tasks/task_171657241003114/fetches/vocab.spm
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/C9eIy-g2QtmfNxdaVlMWGw/artifacts/public/build/vocab.spm
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/C9eIy-g2QtmfNxdaVlMWGw/artifacts/public/build/vocab.spm resolved to 252230 bytes with sha256 9d8ac29958816890d18f1ab76bc153d1b73b59a3e447780e1021e936802d92ac in 8.497s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/a2LeLawzTledMJLMV7PMjA/artifacts/public/build/corpus.en.zst resolved to 225484 bytes with sha256 4b4fd3de840933503eb93132e7f750fab8dafe7acf78819775313a0ac18dc6fe in 8.518s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/a2LeLawzTledMJLMV7PMjA/artifacts/public/build/corpus.ru.zst resolved to 1027480 bytes with sha256 6e3ed157cd7493ade1322f6ea366226e9a732787cd59d637b207e7f803ae5f67 in 8.541s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/C9eIy-g2QtmfNxdaVlMWGw/artifacts/public/build/final.model.npz.best-chrf.npz resolved to 137530873 bytes with sha256 2ed45640f67e62c0cfb2f3a21a39a5f56b0cc1da64896d6b237701fa59c42321 in 10.112s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cCr_z2sITDGiow53WiHs8g/artifacts/public/build/marian.tar.zst resolved to 684170918 bytes with sha256 674b3ad4462d1b7ef22e1f2a5a1e340385136821b0e5f4b48af357281a41d819 in 14.248s
Extracting /home/ubuntu/tasks/task_171657241003114/fetches/marian.tar.zst to /home/ubuntu/tasks/task_171657241003114/fetches
/home/ubuntu/tasks/task_171657241003114/fetches/marian.tar.zst extracted in 7.188s
Removing /home/ubuntu/tasks/task_171657241003114/fetches/marian.tar.zst
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 21.776897211999994, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2024-05-24T17:44:28.078Z] finished fetching artifacts
[task 2024-05-24T17:44:28.078Z] executing ['bash', '-c', 'export MARIAN=$MOZ_FETCHES_DIR && find fetches && $VCS_PATH/pipeline/cefilter/score.sh fetches/final.model.npz.best-chrf.npz fetches/vocab.spm fetches/corpus artifacts/scores.txt']
[task 2024-05-24T17:44:28.103Z] fetches
[task 2024-05-24T17:44:28.103Z] fetches/corpus.en.zst
[task 2024-05-24T17:44:28.103Z] fetches/spm_train
[task 2024-05-24T17:44:28.103Z] fetches/marian-decoder
[task 2024-05-24T17:44:28.103Z] fetches/spm_encode
[task 2024-05-24T17:44:28.103Z] fetches/marian-vocab
[task 2024-05-24T17:44:28.103Z] fetches/vocab.spm
[task 2024-05-24T17:44:28.103Z] fetches/marian-scorer
[task 2024-05-24T17:44:28.103Z] fetches/marian-conv
[task 2024-05-24T17:44:28.103Z] fetches/corpus.ru.zst
[task 2024-05-24T17:44:28.103Z] fetches/final.model.npz.best-chrf.npz
[task 2024-05-24T17:44:28.103Z] fetches/spm_export_vocab
[task 2024-05-24T17:44:28.103Z] fetches/marian
[task 2024-05-24T17:44:28.104Z] + set -euo pipefail
[task 2024-05-24T17:44:28.104Z] + echo '###### Scoring'
[task 2024-05-24T17:44:28.105Z] ###### Scoring
[task 2024-05-24T17:44:28.105Z] + test -v MARIAN
[task 2024-05-24T17:44:28.105Z] + test -v GPUS
[task 2024-05-24T17:44:28.105Z] + test -v SRC
[task 2024-05-24T17:44:28.105Z] + test -v TRG
[task 2024-05-24T17:44:28.105Z] + test -v WORKSPACE
[task 2024-05-24T17:44:28.105Z] + model=fetches/final.model.npz.best-chrf.npz
[task 2024-05-24T17:44:28.105Z] + vocab=fetches/vocab.spm
[task 2024-05-24T17:44:28.105Z] + corpus_prefix=fetches/corpus
[task 2024-05-24T17:44:28.105Z] + output=artifacts/scores.txt
[task 2024-05-24T17:44:28.105Z] + ARTIFACT_EXT=zst
[task 2024-05-24T17:44:28.105Z] + '[' zst = zst ']'
[task 2024-05-24T17:44:28.105Z] + zstdmt --rm -d fetches/corpus.ru.zst
[task 2024-05-24T17:44:28.106Z]
[task 2024-05-24T17:44:28.119Z] etches/corpus.ru.zst : 0 MB...
[task 2024-05-24T17:44:28.119Z]
[task 2024-05-24T17:44:28.119Z] fetches/corpus.ru.zst: 3680980 bytes
[task 2024-05-24T17:44:28.120Z] + zstdmt --rm -d fetches/corpus.en.zst
[task 2024-05-24T17:44:28.121Z]
[task 2024-05-24T17:44:28.151Z] etches/corpus.en.zst : 0 MB...
[task 2024-05-24T17:44:28.151Z]
[task 2024-05-24T17:44:28.151Z] fetches/corpus.en.zst: 22921487 bytes
[task 2024-05-24T17:44:28.151Z] + ARTIFACT_EXT=
[task 2024-05-24T17:44:28.152Z] ++ dirname artifacts/scores.txt
[task 2024-05-24T17:44:28.153Z] + dir=artifacts
[task 2024-05-24T17:44:28.153Z] + mkdir -p artifacts
[task 2024-05-24T17:44:28.155Z] + /home/ubuntu/tasks/task_171657241003114/fetches/marian-scorer -m fetches/final.model.npz.best-chrf.npz -v fetches/vocab.spm fetches/vocab.spm -t fetches/corpus.en fetches/corpus.ru --mini-batch 32 --mini-batch-words 1500 --maxi-batch 1000 --max-length 250 --max-length-crop --normalize -d 0 1 2 3 -w 12000 --log artifacts/scores.txt.log
[task 2024-05-24T17:44:28.226Z] [2024-05-24 17:44:28] [marian] Marian v1.12.14 2d067af 2024-02-16 11:44:13 -0500
[task 2024-05-24T17:44:28.226Z] [2024-05-24 17:44:28] [marian] Running on translations-1-b-linux-v100-gpu-4-lyhgfmz1t6gduw9j8t6fmw as process 2835 with command line:
[task 2024-05-24T17:44:28.226Z] [2024-05-24 17:44:28] [marian] /home/ubuntu/tasks/task_171657241003114/fetches/marian-scorer -m fetches/final.model.npz.best-chrf.npz -v fetches/vocab.spm fetches/vocab.spm -t fetches/corpus.en fetches/corpus.ru --mini-batch 32 --mini-batch-words 1500 --maxi-batch 1000 --max-length 250 --max-length-crop --normalize -d 0 1 2 3 -w 12000 --log artifacts/scores.txt.log
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] alignment: ""
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] authors: false
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] bert-class-symbol: "[CLS]"
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] bert-mask-symbol: "[MASK]"
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] bert-masking-fraction: 0.15
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] bert-sep-symbol: "[SEP]"
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] bert-train-type-embeddings: true
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] bert-type-vocab-size: 2
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] best-deep: false
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] build-info: ""
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] check-nan: false
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] cite: false
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] comet-augment-bad: 0
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] comet-dropout: 0.1
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] comet-final-sigmoid: false
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] comet-mix: false
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] comet-mix-norm: false
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] comet-mixup: 0
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] comet-mixup-reg: false
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] comet-pooler-ffn:
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] - 2048
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] - 1024
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] comet-prepend-zero: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] comet-stop-grad: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] cpu-threads: 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] data-threads: 8
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] dec-cell: gru
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] dec-cell-base-depth: 2
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] dec-cell-high-depth: 1
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] dec-depth: 1
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] devices:
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] - 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] - 1
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] - 2
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] - 3
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] dim-emb: 512
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] dim-rnn: 1024
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] dim-vocabs:
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] - 1000
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] - 1000
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] dump-config: ""
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] enc-cell: gru
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] enc-cell-depth: 1
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] enc-depth: 1
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] enc-type: bidirectional
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] factors-combine: sum
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] factors-dim-emb: 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] gemm-type: float32
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] ignore-model-config: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] input-types:
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] []
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] interpolate-env-vars: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] layer-normalization: True
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] lemma-dependency: ""
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] lemma-dim-emb: 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] log: artifacts/scores.txt.log
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] log-level: info
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] log-time-zone: ""
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] max-length: 250
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] max-length-crop: true
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] maxi-batch: 1000
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] maxi-batch-sort: trg
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] mini-batch: 32
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] mini-batch-words: 1500
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] model: fetches/final.model.npz.best-chrf.npz
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] n-best: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] n-best-feature: Score
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] no-reload: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] normalize: true
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] optimize: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] output: stdout
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] output-omit-bias: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] precision:
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] - float32
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] quantize-range: 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] quiet: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] quiet-translation: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] relative-paths: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] right-left: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] seed: 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] skip: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] summary: ""
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] tied-embeddings: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] tied-embeddings-all: True
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] tied-embeddings-src: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] train-sets:
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] - fetches/corpus.en
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] - fetches/corpus.ru
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-aan-activation: swish
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-aan-depth: 2
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-aan-nogate: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-decoder-autoreg: self-attention
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-decoder-dim-ffn: 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-decoder-ffn-depth: 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-depth-scaling: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-dim-aan: 2048
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-dim-ffn: 2048
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-ffn-activation: swish
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-ffn-depth: 2
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-guided-alignment-layer: last
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-heads: 8
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-no-affine: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-no-bias: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-no-projection: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-pool: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-postprocess: dan
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-postprocess-emb: d
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-postprocess-top: ""
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-preprocess: ""
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-rnn-projection: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-tied-layers:
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] []
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-train-position-embeddings: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] tsv: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] tsv-fields: 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] type: s2s
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] ulr: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] ulr-dim-emb: 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] ulr-trainable-transformation: false
[task 2024-05-24T17:44:28.229Z] [2024-05-24 17:44:28] [config] version: v1.12.14 2d067af 2024-02-16 11:44:13 -0500
[task 2024-05-24T17:44:28.229Z] [2024-05-24 17:44:28] [config] vocabs:
[task 2024-05-24T17:44:28.229Z] [2024-05-24 17:44:28] [config] - fetches/vocab.spm
[task 2024-05-24T17:44:28.229Z] [2024-05-24 17:44:28] [config] - fetches/vocab.spm
[task 2024-05-24T17:44:28.229Z] [2024-05-24 17:44:28] [config] word-scores: false
[task 2024-05-24T17:44:28.229Z] [2024-05-24 17:44:28] [config] workspace: 12000
[task 2024-05-24T17:44:28.229Z] [2024-05-24 17:44:28] [config] Loaded model has been created with Marian v1.12.14 2d067af 2024-02-16 11:44:13 -0500
[task 2024-05-24T17:44:28.230Z] [2024-05-24 17:44:28] [data] Loading SentencePiece vocabulary from file fetches/vocab.spm
[task 2024-05-24T17:44:28.233Z] [2024-05-24 17:44:28] [data] Setting vocabulary size for input 0 to 1,000
[task 2024-05-24T17:44:28.233Z] [2024-05-24 17:44:28] [data] Loading SentencePiece vocabulary from file fetches/vocab.spm
[task 2024-05-24T17:44:28.235Z] [2024-05-24 17:44:28] [data] Setting vocabulary size for input 1 to 1,000
[task 2024-05-24T17:44:28.445Z] [2024-05-24 17:44:28] [memory] Extending reserved space to 12032 MB (device gpu0)
[task 2024-05-24T17:44:28.539Z] [2024-05-24 17:44:28] [memory] Extending reserved space to 12032 MB (device gpu1)
[task 2024-05-24T17:44:28.648Z] [2024-05-24 17:44:28] [memory] Extending reserved space to 12032 MB (device gpu2)
[task 2024-05-24T17:44:28.754Z] [2024-05-24 17:44:28] [memory] Extending reserved space to 12032 MB (device gpu3)
[task 2024-05-24T17:44:28.760Z] [2024-05-24 17:44:28] Loading model from fetches/final.model.npz.best-chrf.npz
[task 2024-05-24T17:44:28.760Z] [2024-05-24 17:44:28] Loading model from fetches/final.model.npz.best-chrf.npz
[task 2024-05-24T17:44:28.760Z] [2024-05-24 17:44:28] Loading model from fetches/final.model.npz.best-chrf.npz
[task 2024-05-24T17:44:28.761Z] [2024-05-24 17:44:28] Loading model from fetches/final.model.npz.best-chrf.npz
[task 2024-05-24T17:44:29.220Z] [2024-05-24 17:44:29] Scoring
[task 2024-05-24T17:44:30.032Z] [2024-05-24 17:44:30] [logits] Applying loss function for 1 factor(s)
[task 2024-05-24T17:44:30.032Z] [2024-05-24 17:44:30] [memory] Reserving 131 MB, device gpu0
[task 2024-05-24T17:44:30.033Z] [2024-05-24 17:44:30] [memory] Reserving 131 MB, device gpu2
[task 2024-05-24T17:44:30.046Z] [2024-05-24 17:44:30] [memory] Reserving 131 MB, device gpu1
[task 2024-05-24T17:44:30.047Z] [2024-05-24 17:44:30] [memory] Reserving 131 MB, device gpu3
[task 2024-05-24T17:44:30.081Z] [2024-05-24 17:44:30] [gpu] 16-bit TensorCores enabled for float32 matrix operations
[task 2024-05-24T17:44:59.620Z] [2024-05-24 17:44:59] Total normalized log probs 7.526e+06 : Total sentences 16967 : Total words 1131606
[task 2024-05-24T17:44:59.620Z] [2024-05-24 17:44:59] Sum of normalized log probs is a sum of averages
[task 2024-05-24T17:44:59.661Z] [2024-05-24 17:44:59] Total time: 31.43187s wall
[task 2024-05-24T17:44:59.979Z] + echo '###### Done: Scoring'
[task 2024-05-24T17:44:59.979Z] ###### Done: Scoring
[fetches 2024-05-24T17:44:59.980Z] removing /home/ubuntu/tasks/task_171657241003114/fetches
[fetches 2024-05-24T17:45:01.244Z] finished
[taskcluster 2024-05-24T17:45:01.255Z] Exit Code: 0
[taskcluster 2024-05-24T17:45:01.255Z] User Time: 2m12.87391s
[taskcluster 2024-05-24T17:45:01.255Z] Kernel Time: 9.306992s
[taskcluster 2024-05-24T17:45:01.255Z] Wall Time: 56.168629937s
[taskcluster 2024-05-24T17:45:01.255Z] Result: SUCCEEDED
[taskcluster 2024-05-24T17:45:01.255Z] === Task Finished ===
[taskcluster 2024-05-24T17:45:01.255Z] Task Duration: 56.170694607s
[taskcluster 2024-05-24T17:45:01.308Z] Uploading artifact public/build/scores.txt from file /home/ubuntu/tasks/task_171657241003114/artifacts/scores.txt with content encoding "gzip", mime type "text/plain; charset=utf-8" and expiry 2024-08-22T16:48:58.794Z
[taskcluster 2024-05-24T17:45:01.318Z] Uploading artifact public/build/scores.txt.log from file /home/ubuntu/tasks/task_171657241003114/artifacts/scores.txt.log with content encoding "gzip", mime type "text/plain" and expiry 2024-08-22T16:48:58.794Z
[taskcluster 2024-05-24T17:45:01.458Z] [mounts] Preserving cache: Moving "/home/ubuntu/tasks/task_171657241003114/checkouts" to "/home/ubuntu/caches/Spkyn1ifRACNPxvD8ZKGWA"
[taskcluster 2024-05-24T17:45:01.522Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2024-08-22T16:48:58.794Z
Loading