Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert CPU generic workers #629

Merged
merged 2 commits into from
May 27, 2024

Trigger CI

9db5284
Select commit
Loading
Failed to load commit list.
Merged

Revert CPU generic workers #629

Trigger CI
9db5284
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / score-ru-en succeeded May 24, 2024 in 56m 2s

FirefoxCI (pull_request)

score for ru-en

Details

View task in Taskcluster
View logs in Taskcluster


[vcs 2024-05-24T17:44:05.946Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-05-24T17:44:05.965Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-05-24T17:44:06.003Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-05-24T17:44:06.162Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-05-24T17:44:06.191Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-05-24T17:44:06.192Z] cleaning git checkout...
[vcs 2024-05-24T17:44:06.192Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-05-24T17:44:06.196Z] removing []
[vcs 2024-05-24T17:44:06.196Z] successfully cleaned git checkout!
[vcs 2024-05-24T17:44:06.199Z] TinderboxPrint:<a href='https://github.com/mozilla/firefox-translations-training/commit/9db52842e17a9fa0ececcfc30809128fa1c52288' title='Built from firefox-translations-training commit 9db52842e17a9fa0ececcfc30809128fa1c52288'>9db52842e17a9fa0ececcfc30809128fa1c52288</a>
[setup 2024-05-24T17:44:06.199Z] MOZ_FETCHES_DIR is /home/ubuntu/tasks/task_171657241003114/fetches
[fetches 2024-05-24T17:44:06.199Z] fetching artifacts
[fetches 2024-05-24T17:44:06.199Z] executing ['/usr/bin/python3', '-u', '/home/ubuntu/tasks/task_171657241003114/./fetch-content', 'task-artifacts']
attempt 1/5attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/a2LeLawzTledMJLMV7PMjA/artifacts/public/build/corpus.ru.zst to /home/ubuntu/tasks/task_171657241003114/fetches/corpus.ru.zst

attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cCr_z2sITDGiow53WiHs8g/artifacts/public/build/marian.tar.zst to /home/ubuntu/tasks/task_171657241003114/fetches/marian.tar.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/a2LeLawzTledMJLMV7PMjA/artifacts/public/build/corpus.ru.zstattempt 1/5Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cCr_z2sITDGiow53WiHs8g/artifacts/public/build/marian.tar.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/C9eIy-g2QtmfNxdaVlMWGw/artifacts/public/build/final.model.npz.best-chrf.npz to /home/ubuntu/tasks/task_171657241003114/fetches/final.model.npz.best-chrf.npz


Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/a2LeLawzTledMJLMV7PMjA/artifacts/public/build/corpus.en.zst to /home/ubuntu/tasks/task_171657241003114/fetches/corpus.en.zst/home/ubuntu/tasks/task_171657241003114/./fetch-content:192: DeprecationWarning: cafile, capath and cadefault are deprecated, use a custom context instead.
  with urllib.request.urlopen(

Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/C9eIy-g2QtmfNxdaVlMWGw/artifacts/public/build/final.model.npz.best-chrf.npz
attempt 1/5Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/a2LeLawzTledMJLMV7PMjA/artifacts/public/build/corpus.en.zst

Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/C9eIy-g2QtmfNxdaVlMWGw/artifacts/public/build/vocab.spm to /home/ubuntu/tasks/task_171657241003114/fetches/vocab.spm
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/C9eIy-g2QtmfNxdaVlMWGw/artifacts/public/build/vocab.spm
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/C9eIy-g2QtmfNxdaVlMWGw/artifacts/public/build/vocab.spm resolved to 252230 bytes with sha256 9d8ac29958816890d18f1ab76bc153d1b73b59a3e447780e1021e936802d92ac in 8.497s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/a2LeLawzTledMJLMV7PMjA/artifacts/public/build/corpus.en.zst resolved to 225484 bytes with sha256 4b4fd3de840933503eb93132e7f750fab8dafe7acf78819775313a0ac18dc6fe in 8.518s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/a2LeLawzTledMJLMV7PMjA/artifacts/public/build/corpus.ru.zst resolved to 1027480 bytes with sha256 6e3ed157cd7493ade1322f6ea366226e9a732787cd59d637b207e7f803ae5f67 in 8.541s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/C9eIy-g2QtmfNxdaVlMWGw/artifacts/public/build/final.model.npz.best-chrf.npz resolved to 137530873 bytes with sha256 2ed45640f67e62c0cfb2f3a21a39a5f56b0cc1da64896d6b237701fa59c42321 in 10.112s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cCr_z2sITDGiow53WiHs8g/artifacts/public/build/marian.tar.zst resolved to 684170918 bytes with sha256 674b3ad4462d1b7ef22e1f2a5a1e340385136821b0e5f4b48af357281a41d819 in 14.248s
Extracting /home/ubuntu/tasks/task_171657241003114/fetches/marian.tar.zst to /home/ubuntu/tasks/task_171657241003114/fetches
/home/ubuntu/tasks/task_171657241003114/fetches/marian.tar.zst extracted in 7.188s
Removing /home/ubuntu/tasks/task_171657241003114/fetches/marian.tar.zst
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 21.776897211999994, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2024-05-24T17:44:28.078Z] finished fetching artifacts
[task 2024-05-24T17:44:28.078Z] executing ['bash', '-c', 'export MARIAN=$MOZ_FETCHES_DIR && find fetches && $VCS_PATH/pipeline/cefilter/score.sh fetches/final.model.npz.best-chrf.npz fetches/vocab.spm fetches/corpus artifacts/scores.txt']
[task 2024-05-24T17:44:28.103Z] fetches
[task 2024-05-24T17:44:28.103Z] fetches/corpus.en.zst
[task 2024-05-24T17:44:28.103Z] fetches/spm_train
[task 2024-05-24T17:44:28.103Z] fetches/marian-decoder
[task 2024-05-24T17:44:28.103Z] fetches/spm_encode
[task 2024-05-24T17:44:28.103Z] fetches/marian-vocab
[task 2024-05-24T17:44:28.103Z] fetches/vocab.spm
[task 2024-05-24T17:44:28.103Z] fetches/marian-scorer
[task 2024-05-24T17:44:28.103Z] fetches/marian-conv
[task 2024-05-24T17:44:28.103Z] fetches/corpus.ru.zst
[task 2024-05-24T17:44:28.103Z] fetches/final.model.npz.best-chrf.npz
[task 2024-05-24T17:44:28.103Z] fetches/spm_export_vocab
[task 2024-05-24T17:44:28.103Z] fetches/marian
[task 2024-05-24T17:44:28.104Z] + set -euo pipefail
[task 2024-05-24T17:44:28.104Z] + echo '###### Scoring'
[task 2024-05-24T17:44:28.105Z] ###### Scoring
[task 2024-05-24T17:44:28.105Z] + test -v MARIAN
[task 2024-05-24T17:44:28.105Z] + test -v GPUS
[task 2024-05-24T17:44:28.105Z] + test -v SRC
[task 2024-05-24T17:44:28.105Z] + test -v TRG
[task 2024-05-24T17:44:28.105Z] + test -v WORKSPACE
[task 2024-05-24T17:44:28.105Z] + model=fetches/final.model.npz.best-chrf.npz
[task 2024-05-24T17:44:28.105Z] + vocab=fetches/vocab.spm
[task 2024-05-24T17:44:28.105Z] + corpus_prefix=fetches/corpus
[task 2024-05-24T17:44:28.105Z] + output=artifacts/scores.txt
[task 2024-05-24T17:44:28.105Z] + ARTIFACT_EXT=zst
[task 2024-05-24T17:44:28.105Z] + '[' zst = zst ']'
[task 2024-05-24T17:44:28.105Z] + zstdmt --rm -d fetches/corpus.ru.zst
[task 2024-05-24T17:44:28.106Z] 
[task 2024-05-24T17:44:28.119Z] etches/corpus.ru.zst : 0 MB...     
[task 2024-05-24T17:44:28.119Z]                                                                                
[task 2024-05-24T17:44:28.119Z] fetches/corpus.ru.zst: 3680980 bytes 
[task 2024-05-24T17:44:28.120Z] + zstdmt --rm -d fetches/corpus.en.zst
[task 2024-05-24T17:44:28.121Z] 
[task 2024-05-24T17:44:28.151Z] etches/corpus.en.zst : 0 MB...     
[task 2024-05-24T17:44:28.151Z]                                                                                
[task 2024-05-24T17:44:28.151Z] fetches/corpus.en.zst: 22921487 bytes 
[task 2024-05-24T17:44:28.151Z] + ARTIFACT_EXT=
[task 2024-05-24T17:44:28.152Z] ++ dirname artifacts/scores.txt
[task 2024-05-24T17:44:28.153Z] + dir=artifacts
[task 2024-05-24T17:44:28.153Z] + mkdir -p artifacts
[task 2024-05-24T17:44:28.155Z] + /home/ubuntu/tasks/task_171657241003114/fetches/marian-scorer -m fetches/final.model.npz.best-chrf.npz -v fetches/vocab.spm fetches/vocab.spm -t fetches/corpus.en fetches/corpus.ru --mini-batch 32 --mini-batch-words 1500 --maxi-batch 1000 --max-length 250 --max-length-crop --normalize -d 0 1 2 3 -w 12000 --log artifacts/scores.txt.log
[task 2024-05-24T17:44:28.226Z] [2024-05-24 17:44:28] [marian] Marian v1.12.14 2d067af 2024-02-16 11:44:13 -0500
[task 2024-05-24T17:44:28.226Z] [2024-05-24 17:44:28] [marian] Running on translations-1-b-linux-v100-gpu-4-lyhgfmz1t6gduw9j8t6fmw as process 2835 with command line:
[task 2024-05-24T17:44:28.226Z] [2024-05-24 17:44:28] [marian] /home/ubuntu/tasks/task_171657241003114/fetches/marian-scorer -m fetches/final.model.npz.best-chrf.npz -v fetches/vocab.spm fetches/vocab.spm -t fetches/corpus.en fetches/corpus.ru --mini-batch 32 --mini-batch-words 1500 --maxi-batch 1000 --max-length 250 --max-length-crop --normalize -d 0 1 2 3 -w 12000 --log artifacts/scores.txt.log
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] alignment: ""
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] authors: false
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] bert-class-symbol: "[CLS]"
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] bert-mask-symbol: "[MASK]"
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] bert-masking-fraction: 0.15
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] bert-sep-symbol: "[SEP]"
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] bert-train-type-embeddings: true
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] bert-type-vocab-size: 2
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] best-deep: false
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] build-info: ""
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] check-nan: false
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] cite: false
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] comet-augment-bad: 0
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] comet-dropout: 0.1
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] comet-final-sigmoid: false
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] comet-mix: false
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] comet-mix-norm: false
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] comet-mixup: 0
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] comet-mixup-reg: false
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config] comet-pooler-ffn:
[task 2024-05-24T17:44:28.227Z] [2024-05-24 17:44:28] [config]   - 2048
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config]   - 1024
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] comet-prepend-zero: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] comet-stop-grad: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] cpu-threads: 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] data-threads: 8
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] dec-cell: gru
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] dec-cell-base-depth: 2
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] dec-cell-high-depth: 1
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] dec-depth: 1
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] devices:
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config]   - 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config]   - 1
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config]   - 2
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config]   - 3
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] dim-emb: 512
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] dim-rnn: 1024
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] dim-vocabs:
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config]   - 1000
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config]   - 1000
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] dump-config: ""
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] enc-cell: gru
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] enc-cell-depth: 1
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] enc-depth: 1
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] enc-type: bidirectional
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] factors-combine: sum
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] factors-dim-emb: 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] gemm-type: float32
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] ignore-model-config: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] input-types:
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config]   []
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] interpolate-env-vars: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] layer-normalization: True
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] lemma-dependency: ""
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] lemma-dim-emb: 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] log: artifacts/scores.txt.log
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] log-level: info
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] log-time-zone: ""
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] max-length: 250
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] max-length-crop: true
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] maxi-batch: 1000
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] maxi-batch-sort: trg
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] mini-batch: 32
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] mini-batch-words: 1500
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] model: fetches/final.model.npz.best-chrf.npz
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] n-best: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] n-best-feature: Score
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] no-reload: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] normalize: true
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] optimize: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] output: stdout
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] output-omit-bias: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] precision:
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config]   - float32
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] quantize-range: 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] quiet: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] quiet-translation: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] relative-paths: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] right-left: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] seed: 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] skip: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] summary: ""
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] tied-embeddings: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] tied-embeddings-all: True
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] tied-embeddings-src: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] train-sets:
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config]   - fetches/corpus.en
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config]   - fetches/corpus.ru
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-aan-activation: swish
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-aan-depth: 2
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-aan-nogate: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-decoder-autoreg: self-attention
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-decoder-dim-ffn: 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-decoder-ffn-depth: 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-depth-scaling: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-dim-aan: 2048
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-dim-ffn: 2048
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-ffn-activation: swish
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-ffn-depth: 2
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-guided-alignment-layer: last
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-heads: 8
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-no-affine: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-no-bias: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-no-projection: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-pool: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-postprocess: dan
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-postprocess-emb: d
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-postprocess-top: ""
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-preprocess: ""
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-rnn-projection: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-tied-layers:
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config]   []
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] transformer-train-position-embeddings: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] tsv: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] tsv-fields: 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] type: s2s
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] ulr: false
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] ulr-dim-emb: 0
[task 2024-05-24T17:44:28.228Z] [2024-05-24 17:44:28] [config] ulr-trainable-transformation: false
[task 2024-05-24T17:44:28.229Z] [2024-05-24 17:44:28] [config] version: v1.12.14 2d067af 2024-02-16 11:44:13 -0500
[task 2024-05-24T17:44:28.229Z] [2024-05-24 17:44:28] [config] vocabs:
[task 2024-05-24T17:44:28.229Z] [2024-05-24 17:44:28] [config]   - fetches/vocab.spm
[task 2024-05-24T17:44:28.229Z] [2024-05-24 17:44:28] [config]   - fetches/vocab.spm
[task 2024-05-24T17:44:28.229Z] [2024-05-24 17:44:28] [config] word-scores: false
[task 2024-05-24T17:44:28.229Z] [2024-05-24 17:44:28] [config] workspace: 12000
[task 2024-05-24T17:44:28.229Z] [2024-05-24 17:44:28] [config] Loaded model has been created with Marian v1.12.14 2d067af 2024-02-16 11:44:13 -0500
[task 2024-05-24T17:44:28.230Z] [2024-05-24 17:44:28] [data] Loading SentencePiece vocabulary from file fetches/vocab.spm
[task 2024-05-24T17:44:28.233Z] [2024-05-24 17:44:28] [data] Setting vocabulary size for input 0 to 1,000
[task 2024-05-24T17:44:28.233Z] [2024-05-24 17:44:28] [data] Loading SentencePiece vocabulary from file fetches/vocab.spm
[task 2024-05-24T17:44:28.235Z] [2024-05-24 17:44:28] [data] Setting vocabulary size for input 1 to 1,000
[task 2024-05-24T17:44:28.445Z] [2024-05-24 17:44:28] [memory] Extending reserved space to 12032 MB (device gpu0)
[task 2024-05-24T17:44:28.539Z] [2024-05-24 17:44:28] [memory] Extending reserved space to 12032 MB (device gpu1)
[task 2024-05-24T17:44:28.648Z] [2024-05-24 17:44:28] [memory] Extending reserved space to 12032 MB (device gpu2)
[task 2024-05-24T17:44:28.754Z] [2024-05-24 17:44:28] [memory] Extending reserved space to 12032 MB (device gpu3)
[task 2024-05-24T17:44:28.760Z] [2024-05-24 17:44:28] Loading model from fetches/final.model.npz.best-chrf.npz
[task 2024-05-24T17:44:28.760Z] [2024-05-24 17:44:28] Loading model from fetches/final.model.npz.best-chrf.npz
[task 2024-05-24T17:44:28.760Z] [2024-05-24 17:44:28] Loading model from fetches/final.model.npz.best-chrf.npz
[task 2024-05-24T17:44:28.761Z] [2024-05-24 17:44:28] Loading model from fetches/final.model.npz.best-chrf.npz
[task 2024-05-24T17:44:29.220Z] [2024-05-24 17:44:29] Scoring
[task 2024-05-24T17:44:30.032Z] [2024-05-24 17:44:30] [logits] Applying loss function for 1 factor(s)
[task 2024-05-24T17:44:30.032Z] [2024-05-24 17:44:30] [memory] Reserving 131 MB, device gpu0
[task 2024-05-24T17:44:30.033Z] [2024-05-24 17:44:30] [memory] Reserving 131 MB, device gpu2
[task 2024-05-24T17:44:30.046Z] [2024-05-24 17:44:30] [memory] Reserving 131 MB, device gpu1
[task 2024-05-24T17:44:30.047Z] [2024-05-24 17:44:30] [memory] Reserving 131 MB, device gpu3
[task 2024-05-24T17:44:30.081Z] [2024-05-24 17:44:30] [gpu] 16-bit TensorCores enabled for float32 matrix operations
[task 2024-05-24T17:44:59.620Z] [2024-05-24 17:44:59] Total normalized log probs 7.526e+06 : Total sentences 16967 : Total words 1131606
[task 2024-05-24T17:44:59.620Z] [2024-05-24 17:44:59] Sum of normalized log probs is a sum of averages
[task 2024-05-24T17:44:59.661Z] [2024-05-24 17:44:59] Total time: 31.43187s wall
[task 2024-05-24T17:44:59.979Z] + echo '###### Done: Scoring'
[task 2024-05-24T17:44:59.979Z] ###### Done: Scoring
[fetches 2024-05-24T17:44:59.980Z] removing /home/ubuntu/tasks/task_171657241003114/fetches
[fetches 2024-05-24T17:45:01.244Z] finished
[taskcluster 2024-05-24T17:45:01.255Z]    Exit Code: 0
[taskcluster 2024-05-24T17:45:01.255Z]    User Time: 2m12.87391s
[taskcluster 2024-05-24T17:45:01.255Z]  Kernel Time: 9.306992s
[taskcluster 2024-05-24T17:45:01.255Z]    Wall Time: 56.168629937s
[taskcluster 2024-05-24T17:45:01.255Z]       Result: SUCCEEDED
[taskcluster 2024-05-24T17:45:01.255Z] === Task Finished ===
[taskcluster 2024-05-24T17:45:01.255Z] Task Duration: 56.170694607s
[taskcluster 2024-05-24T17:45:01.308Z] Uploading artifact public/build/scores.txt from file /home/ubuntu/tasks/task_171657241003114/artifacts/scores.txt with content encoding "gzip", mime type "text/plain; charset=utf-8" and expiry 2024-08-22T16:48:58.794Z
[taskcluster 2024-05-24T17:45:01.318Z] Uploading artifact public/build/scores.txt.log from file /home/ubuntu/tasks/task_171657241003114/artifacts/scores.txt.log with content encoding "gzip", mime type "text/plain" and expiry 2024-08-22T16:48:58.794Z
[taskcluster 2024-05-24T17:45:01.458Z] [mounts] Preserving cache: Moving "/home/ubuntu/tasks/task_171657241003114/checkouts" to "/home/ubuntu/caches/Spkyn1ifRACNPxvD8ZKGWA"
[taskcluster 2024-05-24T17:45:01.522Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2024-08-22T16:48:58.794Z