Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Publish comet metrics #621

Merged
merged 19 commits into from
May 22, 2024

Revert "Enable publication"

6d213f8
Select commit
Loading
Failed to load commit list.
Merged

Publish comet metrics #621

Revert "Enable publication"
6d213f8
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / translate-mono-src-ru-en-2/2 succeeded May 22, 2024 in 24m 23s

FirefoxCI (pull_request)

translate mono for ru

Details

View task in Taskcluster
View logs in Taskcluster


Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cCr_z2sITDGiow53WiHs8g/artifacts/public/build/marian.tar.zst to /home/ubuntu/tasks/task_171641223526640/fetches/marian.tar.zstDownloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/O0oHJxUSSECyllNKF_y7dA/artifacts/public/build/file.2.zst

attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/VLppB-nISxaB4CSrbocOCw/artifacts/public/build/final.model.npz.best-chrf.npz to /home/ubuntu/tasks/task_171641223526640/fetches/model1/final.model.npz.best-chrf.npz
/home/ubuntu/tasks/task_171641223526640/./fetch-content:192: DeprecationWarning: cafile, capath and cadefault are deprecated, use a custom context instead.
  with urllib.request.urlopen(
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/DtQ5zn1HS4-Q7G_cWlRc0Q/artifacts/public/build/cuda-toolkit.tar.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cCr_z2sITDGiow53WiHs8g/artifacts/public/build/marian.tar.zstattempt 1/5Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/VLppB-nISxaB4CSrbocOCw/artifacts/public/build/final.model.npz.best-chrf.npz

Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/VLppB-nISxaB4CSrbocOCw/artifacts/public/build/vocab.spm to /home/ubuntu/tasks/task_171641223526640/fetches/vocab.spm

Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/VLppB-nISxaB4CSrbocOCw/artifacts/public/build/vocab.spm
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/VLppB-nISxaB4CSrbocOCw/artifacts/public/build/vocab.spm resolved to 252230 bytes with sha256 9d8ac29958816890d18f1ab76bc153d1b73b59a3e447780e1021e936802d92ac in 0.344s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/O0oHJxUSSECyllNKF_y7dA/artifacts/public/build/file.2.zst resolved to 296276 bytes with sha256 4be5011e2daaa677e5d6718d270a4a6d71a087e3c27df1a98c2770d114139931 in 0.394s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/VLppB-nISxaB4CSrbocOCw/artifacts/public/build/final.model.npz.best-chrf.npz resolved to 178659619 bytes with sha256 14817d599221de9942895e5d2cb0324ff66b53c2abae01b4ab29280057f33044 in 2.532s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cCr_z2sITDGiow53WiHs8g/artifacts/public/build/marian.tar.zst resolved to 684170918 bytes with sha256 674b3ad4462d1b7ef22e1f2a5a1e340385136821b0e5f4b48af357281a41d819 in 5.543s
Extracting /home/ubuntu/tasks/task_171641223526640/fetches/marian.tar.zst to /home/ubuntu/tasks/task_171641223526640/fetches
/home/ubuntu/tasks/task_171641223526640/fetches/marian.tar.zst extracted in 9.083s
Removing /home/ubuntu/tasks/task_171641223526640/fetches/marian.tar.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/DtQ5zn1HS4-Q7G_cWlRc0Q/artifacts/public/build/cuda-toolkit.tar.zst resolved to 3295138224 bytes with sha256 e3bdbf0078b8eb8c7804039d6cf6a10b673212bedf1d016a7b4a7eed3ead5f04 in 158.351s
Extracting /home/ubuntu/tasks/task_171641223526640/fetches/cuda-toolkit.tar.zst to /home/ubuntu/tasks/task_171641223526640/fetches
/home/ubuntu/tasks/task_171641223526640/fetches/cuda-toolkit.tar.zst extracted in 21.334s
Removing /home/ubuntu/tasks/task_171641223526640/fetches/cuda-toolkit.tar.zst
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 180.22369115900003, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2024-05-22T21:14:45.353Z] finished fetching artifacts
[task 2024-05-22T21:14:45.353Z] executing ['bash', '-xc', 'export MARIAN=$MOZ_FETCHES_DIR && $VCS_PATH/taskcluster/scripts/pipeline/translate-taskcluster.sh $MOZ_FETCHES_DIR/file.2.zst artifacts plain $MOZ_FETCHES_DIR/vocab.spm $MOZ_FETCHES_DIR/model*/*.npz']
[task 2024-05-22T21:14:45.356Z] + export MARIAN=/home/ubuntu/tasks/task_171641223526640/fetches
[task 2024-05-22T21:14:45.356Z] + MARIAN=/home/ubuntu/tasks/task_171641223526640/fetches
[task 2024-05-22T21:14:45.356Z] + ./checkouts/vcs/taskcluster/scripts/pipeline/translate-taskcluster.sh /home/ubuntu/tasks/task_171641223526640/fetches/file.2.zst artifacts plain /home/ubuntu/tasks/task_171641223526640/fetches/vocab.spm /home/ubuntu/tasks/task_171641223526640/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-05-22T21:14:45.358Z] + set -euo pipefail
[task 2024-05-22T21:14:45.358Z] + input=/home/ubuntu/tasks/task_171641223526640/fetches/file.2.zst
[task 2024-05-22T21:14:45.358Z] + output_dir=artifacts
[task 2024-05-22T21:14:45.358Z] + type=plain
[task 2024-05-22T21:14:45.358Z] + other_args=("${@:4}")
[task 2024-05-22T21:14:45.359Z] ++ dirname ./checkouts/vcs/taskcluster/scripts/pipeline/translate-taskcluster.sh
[task 2024-05-22T21:14:45.360Z] + pushd ./checkouts/vcs/taskcluster/scripts/pipeline/../../..
[task 2024-05-22T21:14:45.361Z] ++ pwd
[task 2024-05-22T21:14:45.361Z] + VCS_ROOT=/home/ubuntu/tasks/task_171641223526640/checkouts/vcs
[task 2024-05-22T21:14:45.361Z] + popd
[task 2024-05-22T21:14:45.362Z] + mkdir -p artifacts
[task 2024-05-22T21:14:45.363Z] + zstd -d --rm /home/ubuntu/tasks/task_171641223526640/fetches/file.2.zst
[task 2024-05-22T21:14:45.656Z] 
[task 2024-05-22T21:14:45.661Z] 0/fetches/file.2.zst : 0 MB...     
[task 2024-05-22T21:14:45.661Z]                                                                                
[task 2024-05-22T21:14:45.661Z] /home/ubuntu/tasks/task_171641223526640/fetches/file.2.zst: 1024311 bytes 
[task 2024-05-22T21:14:45.661Z] + input=/home/ubuntu/tasks/task_171641223526640/fetches/file.2
[task 2024-05-22T21:14:45.661Z] + outfile=/home/ubuntu/tasks/task_171641223526640/fetches/file.2.out
[task 2024-05-22T21:14:45.661Z] + '[' plain = nbest ']'
[task 2024-05-22T21:14:45.661Z] + '[' -s /home/ubuntu/tasks/task_171641223526640/fetches/file.2 ']'
[task 2024-05-22T21:14:45.661Z] + '[' plain = plain ']'
[task 2024-05-22T21:14:45.662Z] + /home/ubuntu/tasks/task_171641223526640/checkouts/vcs/pipeline/translate/translate.sh /home/ubuntu/tasks/task_171641223526640/fetches/file.2 /home/ubuntu/tasks/task_171641223526640/fetches/vocab.spm /home/ubuntu/tasks/task_171641223526640/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-05-22T21:14:45.664Z] + set -euo pipefail
[task 2024-05-22T21:14:45.664Z] + test -v GPUS
[task 2024-05-22T21:14:45.664Z] + test -v MARIAN
[task 2024-05-22T21:14:45.664Z] + test -v WORKSPACE
[task 2024-05-22T21:14:45.664Z] + input=/home/ubuntu/tasks/task_171641223526640/fetches/file.2
[task 2024-05-22T21:14:45.664Z] + vocab=/home/ubuntu/tasks/task_171641223526640/fetches/vocab.spm
[task 2024-05-22T21:14:45.664Z] + models=("${@:3}")
[task 2024-05-22T21:14:45.664Z] ++ dirname /home/ubuntu/tasks/task_171641223526640/checkouts/vcs/pipeline/translate/translate.sh
[task 2024-05-22T21:14:45.666Z] + cd /home/ubuntu/tasks/task_171641223526640/checkouts/vcs/pipeline/translate
[task 2024-05-22T21:14:45.666Z] + /home/ubuntu/tasks/task_171641223526640/fetches/marian-decoder -c decoder.yml -m /home/ubuntu/tasks/task_171641223526640/fetches/model1/final.model.npz.best-chrf.npz -v /home/ubuntu/tasks/task_171641223526640/fetches/vocab.spm /home/ubuntu/tasks/task_171641223526640/fetches/vocab.spm -i /home/ubuntu/tasks/task_171641223526640/fetches/file.2 -o /home/ubuntu/tasks/task_171641223526640/fetches/file.2.out --log /home/ubuntu/tasks/task_171641223526640/fetches/file.2.log -d 0 1 2 3 -w 12000
[task 2024-05-22T21:15:01.440Z] [2024-05-22 21:15:01] [marian] Marian v1.12.14 2d067af 2024-02-16 11:44:13 -0500
[task 2024-05-22T21:15:01.440Z] [2024-05-22 21:15:01] [marian] Running on translations-1-b-linux-v100-gpu-4-d1tpd-xvsvqhw2fych7qua as process 2558 with command line:
[task 2024-05-22T21:15:01.440Z] [2024-05-22 21:15:01] [marian] /home/ubuntu/tasks/task_171641223526640/fetches/marian-decoder -c decoder.yml -m /home/ubuntu/tasks/task_171641223526640/fetches/model1/final.model.npz.best-chrf.npz -v /home/ubuntu/tasks/task_171641223526640/fetches/vocab.spm /home/ubuntu/tasks/task_171641223526640/fetches/vocab.spm -i /home/ubuntu/tasks/task_171641223526640/fetches/file.2 -o /home/ubuntu/tasks/task_171641223526640/fetches/file.2.out --log /home/ubuntu/tasks/task_171641223526640/fetches/file.2.log -d 0 1 2 3 -w 12000
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] alignment: ""
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] allow-special: false
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] allow-unk: false
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] authors: false
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] beam-size: 8
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] bert-class-symbol: "[CLS]"
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] bert-mask-symbol: "[MASK]"
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] bert-masking-fraction: 0.15
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] bert-sep-symbol: "[SEP]"
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] bert-train-type-embeddings: true
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] bert-type-vocab-size: 2
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] best-deep: false
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] build-info: ""
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] check-nan: false
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] cite: false
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] comet-augment-bad: 0
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] comet-dropout: 0.1
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] comet-final-sigmoid: false
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] comet-mix: false
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] comet-mix-norm: false
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] comet-mixup: 0
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] comet-mixup-reg: false
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] comet-pooler-ffn:
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config]   - 2048
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config]   - 1024
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] comet-prepend-zero: false
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] comet-stop-grad: false
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] cpu-threads: 0
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] data-threads: 8
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] dec-cell: gru
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] dec-cell-base-depth: 2
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] dec-cell-high-depth: 1
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] dec-depth: 6
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] devices:
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config]   - 0
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config]   - 1
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config]   - 2
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config]   - 3
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] dim-emb: 512
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] dim-rnn: 1024
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] dim-vocabs:
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config]   - 1000
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config]   - 1000
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] dump-config: ""
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] enc-cell: gru
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] enc-cell-depth: 1
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] enc-depth: 6
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] enc-type: bidirectional
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] factors-combine: sum
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] factors-dim-emb: 0
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] force-decode: false
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] gemm-type: float32
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] ignore-model-config: false
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] input:
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config]   - /home/ubuntu/tasks/task_171641223526640/fetches/file.2
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] input-types:
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config]   []
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] interpolate-env-vars: false
[task 2024-05-22T21:15:01.443Z] [2024-05-22 21:15:01] [config] layer-normalization: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] lemma-dependency: ""
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] lemma-dim-emb: 0
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] log: /home/ubuntu/tasks/task_171641223526640/fetches/file.2.log
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] log-level: info
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] log-time-zone: ""
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] max-length: 200
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] max-length-crop: true
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] max-length-factor: 3
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] maxi-batch: 1000
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] maxi-batch-sort: src
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] mini-batch: 16
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] mini-batch-words: 500
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] model-mmap: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] models:
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config]   - /home/ubuntu/tasks/task_171641223526640/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] n-best: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] no-spm-decode: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] no-spm-encode: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] normalize: 1.0
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] optimize: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] output: /home/ubuntu/tasks/task_171641223526640/fetches/file.2.out
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] output-approx-knn:
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config]   []
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] output-omit-bias: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] output-sampling:
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config]   []
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] precision:
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config]   - float32
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] quantize-range: 0
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] quiet: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] quiet-translation: True
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] relative-paths: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] right-left: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] seed: 0
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] shortlist:
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config]   []
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] skip: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] skip-cost: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] stat-freq: 0
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] tied-embeddings: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] tied-embeddings-all: true
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] tied-embeddings-src: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-aan-activation: swish
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-aan-depth: 2
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-aan-nogate: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-decoder-autoreg: self-attention
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-decoder-dim-ffn: 0
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-decoder-ffn-depth: 0
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-depth-scaling: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-dim-aan: 2048
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-dim-ffn: 2048
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-ffn-activation: relu
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-ffn-depth: 2
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-guided-alignment-layer: last
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-heads: 8
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-no-affine: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-no-bias: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-no-projection: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-pool: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-postprocess: dan
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-postprocess-emb: d
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-postprocess-top: ""
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-preprocess: ""
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-rnn-projection: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-tied-layers:
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config]   []
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] transformer-train-position-embeddings: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] tsv: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] tsv-fields: 0
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] type: transformer
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] ulr: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] ulr-dim-emb: 0
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] ulr-trainable-transformation: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] version: v1.12.14 2d067af 2024-02-16 11:44:13 -0500
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] vocabs:
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config]   - /home/ubuntu/tasks/task_171641223526640/fetches/vocab.spm
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config]   - /home/ubuntu/tasks/task_171641223526640/fetches/vocab.spm
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] weights:
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config]   []
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] word-penalty: 0
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] word-scores: false
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] workspace: 12000
[task 2024-05-22T21:15:01.444Z] [2024-05-22 21:15:01] [config] Loaded model has been created with Marian v1.12.14 2d067af 2024-02-16 11:44:13 -0500
[task 2024-05-22T21:15:01.446Z] [2024-05-22 21:15:01] [data] Loading SentencePiece vocabulary from file /home/ubuntu/tasks/task_171641223526640/fetches/vocab.spm
[task 2024-05-22T21:15:01.450Z] [2024-05-22 21:15:01] [data] Loading SentencePiece vocabulary from file /home/ubuntu/tasks/task_171641223526640/fetches/vocab.spm
[task 2024-05-22T21:15:01.453Z] [2024-05-22 21:15:01] Loading model from /home/ubuntu/tasks/task_171641223526640/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-05-22T21:15:04.032Z] [2024-05-22 21:15:04] [memory] Extending reserved space to 12032 MB (device gpu3)
[task 2024-05-22T21:15:04.032Z] [2024-05-22 21:15:04] [memory] Extending reserved space to 12032 MB (device gpu2)
[task 2024-05-22T21:15:04.032Z] [2024-05-22 21:15:04] [memory] Extending reserved space to 12032 MB (device gpu0)
[task 2024-05-22T21:15:04.032Z] [2024-05-22 21:15:04] [memory] Extending reserved space to 12032 MB (device gpu1)
[task 2024-05-22T21:15:04.367Z] [2024-05-22 21:15:04] Loaded model config
[task 2024-05-22T21:15:04.368Z] [2024-05-22 21:15:04] Loaded model config
[task 2024-05-22T21:15:04.375Z] [2024-05-22 21:15:04] Loaded model config
[task 2024-05-22T21:15:04.402Z] [2024-05-22 21:15:04] Loaded model config
[task 2024-05-22T21:15:04.530Z] [2024-05-22 21:15:04] Loading scorer of type transformer as feature F0
[task 2024-05-22T21:15:04.532Z] [2024-05-22 21:15:04] Loading scorer of type transformer as feature F0
[task 2024-05-22T21:15:04.539Z] [2024-05-22 21:15:04] Loading scorer of type transformer as feature F0
[task 2024-05-22T21:15:04.580Z] [2024-05-22 21:15:04] Loading scorer of type transformer as feature F0
[task 2024-05-22T21:15:04.754Z] [2024-05-22 21:15:04] [memory] Reserving 170 MB, device gpu2
[task 2024-05-22T21:15:04.758Z] [2024-05-22 21:15:04] [memory] Reserving 170 MB, device gpu3
[task 2024-05-22T21:15:04.762Z] [2024-05-22 21:15:04] [memory] Reserving 170 MB, device gpu0
[task 2024-05-22T21:15:04.824Z] [2024-05-22 21:15:04] [memory] Reserving 170 MB, device gpu1
[task 2024-05-22T21:15:07.480Z] [2024-05-22 21:15:07] [gpu] 16-bit TensorCores enabled for float32 matrix operations
[task 2024-05-22T21:19:00.938Z] [2024-05-22 21:19:00] Total time: 236.04777s wall
[task 2024-05-22T21:19:02.808Z] ++ wc -l
[task 2024-05-22T21:19:02.828Z] ++ wc -l
[task 2024-05-22T21:19:02.830Z] + test 4974 == 4974
[task 2024-05-22T21:19:02.831Z] + zstd --rm /home/ubuntu/tasks/task_171641223526640/fetches/file.2.out
[task 2024-05-22T21:19:02.833Z] 
[task 2024-05-22T21:19:02.833Z]                                                                                
[task 2024-05-22T21:19:02.836Z] Read :  0 /  1 MB ==>  0%
[task 2024-05-22T21:19:02.836Z]                                                                                
[task 2024-05-22T21:19:02.836Z] /home/ubuntu/tasks/task_171641223526640/fetches/file.2.out :  2.42%   (1101675 =>  26651 bytes, /home/ubuntu/tasks/task_171641223526640/fetches/file.2.out.zst) 
[task 2024-05-22T21:19:02.837Z] + cp /home/ubuntu/tasks/task_171641223526640/fetches/file.2.out.zst artifacts
[fetches 2024-05-22T21:19:02.839Z] removing /home/ubuntu/tasks/task_171641223526640/fetches
[fetches 2024-05-22T21:19:04.751Z] finished
[taskcluster 2024-05-22T21:19:04.762Z]    Exit Code: 0
[taskcluster 2024-05-22T21:19:04.762Z]    User Time: 16m8.200377s
[taskcluster 2024-05-22T21:19:04.762Z]  Kernel Time: 38.524073s
[taskcluster 2024-05-22T21:19:04.762Z]    Wall Time: 7m42.371511734s
[taskcluster 2024-05-22T21:19:04.762Z]       Result: SUCCEEDED
[taskcluster 2024-05-22T21:19:04.763Z] === Task Finished ===
[taskcluster 2024-05-22T21:19:04.763Z] Task Duration: 7m42.37393919s
[taskcluster 2024-05-22T21:19:04.837Z] Uploading artifact public/build/file.2.out.zst from file /home/ubuntu/tasks/task_171641223526640/artifacts/file.2.out.zst with content encoding "identity", mime type "application/zstd" and expiry 2024-08-20T20:54:41.991Z
[taskcluster 2024-05-22T21:19:04.996Z] [mounts] Preserving cache: Moving "/home/ubuntu/tasks/task_171641223526640/checkouts" to "/home/ubuntu/caches/OX1k8ZLDQP6lX6nj9b3EkQ"
[taskcluster 2024-05-22T21:19:05.092Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2024-08-20T20:54:41.991Z