Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve documentation in transforms #305

Merged
merged 2 commits into from
Dec 15, 2023

Add basic documentation to most transforms

4aa774c
Select commit
Loading
Failed to load commit list.
Merged

Improve documentation in transforms #305

Add basic documentation to most transforms
4aa774c
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / toolchain-browsermt-marian succeeded Dec 15, 2023 in 22m 11s

FirefoxCI (pull_request)

Browsermt Marian

Details

View task in Taskcluster
View logs in Taskcluster


[task 2023-12-15T19:03:53.905Z] /usr/include/x86_64-linux-gnu/bits/string_fortified.h:95:31: warning: ‘char* __builtin_strncpy(char*, const char*, long unsigned int)’ specified bound 16 equals destination size [-Wstringop-truncation]
[task 2023-12-15T19:03:53.905Z]    95 |   return __builtin___strncpy_chk (__dest, __src, __len,
[task 2023-12-15T19:03:53.905Z]       |        ~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~                                   
[task 2023-12-15T19:03:53.905Z] include/socket.h: In function ‘int findInterfaces(const char*, char*, socketAddress*, int, int, int)’:
[task 2023-12-15T19:03:53.905Z] include/socket.h:40:14: warning: ‘<’ directive writing 1 byte into a region of size between 0 and 1024 [-Wformat-overflow=]
[task 2023-12-15T19:03:53.905Z]    40 |   sprintf(buf, "%s<%s>", host, service);
[task 2023-12-15T19:03:53.905Z]       |              ^~~~~~~~
[task 2023-12-15T19:03:53.905Z] /usr/include/x86_64-linux-gnu/bits/stdio2.h:38:31: note: ‘__builtin___sprintf_chk’ output between 3 and 1058 bytes into a destination of size 1024
[task 2023-12-15T19:03:53.905Z]    38 |   return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1,
[task 2023-12-15T19:03:53.905Z]       |        ~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~                                              
[task 2023-12-15T19:03:53.949Z] In function ‘char* strncpy(char*, const char*, size_t)’,
[task 2023-12-15T19:03:53.950Z]     inlined from ‘int findInterfaces(const char*, char*, socketAddress*, int, int, int)’ at include/socket.h:105:8,
[task 2023-12-15T19:03:53.950Z]     inlined from ‘int findInterfaces(char*, socketAddress*, int, int)’ at include/socket.h:289:22,
[task 2023-12-15T19:03:53.950Z]     inlined from ‘void _ZL11initDevicesv.part.0()’ at transport/net_ib.cu:92:19:
[task 2023-12-15T19:03:53.950Z] /usr/include/x86_64-linux-gnu/bits/string_fortified.h:95:31: warning: ‘char* __builtin_strncpy(char*, const char*, long unsigned int)’ specified bound 16 equals destination size [-Wstringop-truncation]
[task 2023-12-15T19:03:53.950Z]    95 |   return __builtin___strncpy_chk (__dest, __src, __len,
[task 2023-12-15T19:03:53.950Z]       |        ~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~                                   
[task 2023-12-15T19:03:53.950Z] include/socket.h: In function ‘void _ZL11initDevicesv.part.0()’:
[task 2023-12-15T19:03:53.950Z] include/socket.h:40:14: warning: ‘<’ directive writing 1 byte into a region of size between 0 and 1024 [-Wformat-overflow=]
[task 2023-12-15T19:03:53.950Z]    40 |   sprintf(buf, "%s<%s>", host, service);
[task 2023-12-15T19:03:53.950Z]       |              ^~~~~~~~
[task 2023-12-15T19:03:53.950Z] /usr/include/x86_64-linux-gnu/bits/stdio2.h:38:31: note: ‘__builtin___sprintf_chk’ output between 3 and 1058 bytes into a destination of size 1024
[task 2023-12-15T19:03:53.950Z]    38 |   return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1,
[task 2023-12-15T19:03:53.950Z]       |        ~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~                                              
[task 2023-12-15T19:03:53.950Z] In function ‘char* strncpy(char*, const char*, size_t)’,
[task 2023-12-15T19:03:53.950Z]     inlined from ‘int findInterfaceMatchSubnet(char*, socketAddress*, socketAddress, int, int)’ at include/socket.h:184:8,
[task 2023-12-15T19:03:53.950Z]     inlined from ‘int findInterfaces(char*, socketAddress*, int, int)’ at include/socket.h:297:32,
[task 2023-12-15T19:03:53.950Z]     inlined from ‘void _ZL11initDevicesv.part.0()’ at transport/net_ib.cu:92:19:
[task 2023-12-15T19:03:53.950Z] /usr/include/x86_64-linux-gnu/bits/string_fortified.h:95:31: warning: ‘char* __builtin_strncpy(char*, const char*, long unsigned int)’ specified bound 16 equals destination size [-Wstringop-truncation]
[task 2023-12-15T19:03:53.950Z]    95 |   return __builtin___strncpy_chk (__dest, __src, __len,
[task 2023-12-15T19:03:53.950Z]       |        ~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~                                   
[task 2023-12-15T19:03:53.950Z] include/socket.h: In function ‘void _ZL11initDevicesv.part.0()’:
[task 2023-12-15T19:03:53.950Z] include/socket.h:40:14: warning: ‘<’ directive writing 1 byte into a region of size between 0 and 1024 [-Wformat-overflow=]
[task 2023-12-15T19:03:53.950Z]    40 |   sprintf(buf, "%s<%s>", host, service);
[task 2023-12-15T19:03:53.950Z]       |              ^~~~~~~~
[task 2023-12-15T19:03:53.950Z] /usr/include/x86_64-linux-gnu/bits/stdio2.h:38:31: note: ‘__builtin___sprintf_chk’ output between 3 and 1058 bytes into a destination of size 1024
[task 2023-12-15T19:03:53.950Z]    38 |   return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1,
[task 2023-12-15T19:03:53.950Z]       |        ~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~                                              
[task 2023-12-15T19:03:53.950Z] include/socket.h:40:14: warning: ‘<’ directive writing 1 byte into a region of size between 0 and 1024 [-Wformat-overflow=]
[task 2023-12-15T19:03:53.950Z]    40 |   sprintf(buf, "%s<%s>", host, service);
[task 2023-12-15T19:03:53.950Z]       |              ^~~~~~~~
[task 2023-12-15T19:03:53.950Z] /usr/include/x86_64-linux-gnu/bits/stdio2.h:38:31: note: ‘__builtin___sprintf_chk’ output between 3 and 1058 bytes into a destination of size 1024
[task 2023-12-15T19:03:53.950Z]    38 |   return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1,
[task 2023-12-15T19:03:53.950Z]       |        ~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~                                              
[task 2023-12-15T19:03:53.950Z] include/socket.h:40:14: warning: ‘<’ directive writing 1 byte into a region of size between 0 and 1024 [-Wformat-overflow=]
[task 2023-12-15T19:03:53.950Z]    40 |   sprintf(buf, "%s<%s>", host, service);
[task 2023-12-15T19:03:53.950Z]       |              ^~~~~~~~
[task 2023-12-15T19:03:53.950Z] /usr/include/x86_64-linux-gnu/bits/stdio2.h:38:31: note: ‘__builtin___sprintf_chk’ output between 3 and 1058 bytes into a destination of size 1024
[task 2023-12-15T19:03:53.950Z]    38 |   return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1,
[task 2023-12-15T19:03:53.950Z]       |        ~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~                                              
[task 2023-12-15T19:03:55.392Z] Compiling  collectives/all_reduce.cu           > /builds/worker/fetches/marian-source/build/local/obj/collectives/all_reduce.o
[task 2023-12-15T19:03:58.298Z] Compiling  collectives/all_gather.cu           > /builds/worker/fetches/marian-source/build/local/obj/collectives/all_gather.o
[task 2023-12-15T19:04:01.193Z] Compiling  collectives/broadcast.cu            > /builds/worker/fetches/marian-source/build/local/obj/collectives/broadcast.o
[task 2023-12-15T19:04:04.100Z] Compiling  collectives/reduce.cu               > /builds/worker/fetches/marian-source/build/local/obj/collectives/reduce.o
[task 2023-12-15T19:04:06.992Z] Compiling  collectives/reduce_scatter.cu       > /builds/worker/fetches/marian-source/build/local/obj/collectives/reduce_scatter.o
[task 2023-12-15T19:04:10.545Z] Compiling  all_reduce.cu                       > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/all_reduce_sum.o
[task 2023-12-15T19:04:57.381Z] [ 70%] Built target fbgemm_avx2
[task 2023-12-15T19:04:57.397Z] [ 70%] Linking CXX static library libfbgemm.a
[task 2023-12-15T19:04:57.492Z] [ 70%] Built target fbgemm
[task 2023-12-15T19:05:11.240Z] Compiling  broadcast.cu                        > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/broadcast_sum.o
[task 2023-12-15T19:05:18.286Z] Compiling  reduce.cu                           > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/reduce_sum.o
[task 2023-12-15T19:05:48.937Z] Compiling  all_gather.cu                       > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/all_gather_sum.o
[task 2023-12-15T19:05:56.406Z] Compiling  reduce_scatter.cu                   > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/reduce_scatter_sum.o
[task 2023-12-15T19:06:28.314Z] Compiling  all_reduce.cu                       > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/all_reduce_prod.o
[task 2023-12-15T19:07:27.717Z] Compiling  broadcast.cu                        > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/broadcast_prod.o
[task 2023-12-15T19:07:29.914Z] Compiling  reduce.cu                           > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/reduce_prod.o
[task 2023-12-15T19:08:00.531Z] Compiling  all_gather.cu                       > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/all_gather_prod.o
[task 2023-12-15T19:08:02.735Z] Compiling  reduce_scatter.cu                   > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/reduce_scatter_prod.o
[task 2023-12-15T19:08:35.291Z] Compiling  all_reduce.cu                       > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/all_reduce_min.o
[task 2023-12-15T19:09:34.429Z] Compiling  broadcast.cu                        > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/broadcast_min.o
[task 2023-12-15T19:09:36.630Z] Compiling  reduce.cu                           > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/reduce_min.o
[task 2023-12-15T19:10:07.531Z] Compiling  all_gather.cu                       > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/all_gather_min.o
[task 2023-12-15T19:10:09.723Z] Compiling  reduce_scatter.cu                   > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/reduce_scatter_min.o
[task 2023-12-15T19:10:42.403Z] Compiling  all_reduce.cu                       > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/all_reduce_max.o
[task 2023-12-15T19:11:41.425Z] Compiling  broadcast.cu                        > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/broadcast_max.o
[task 2023-12-15T19:11:43.618Z] Compiling  reduce.cu                           > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/reduce_max.o
[task 2023-12-15T19:12:14.389Z] Compiling  all_gather.cu                       > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/all_gather_max.o
[task 2023-12-15T19:12:16.578Z] Compiling  reduce_scatter.cu                   > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/reduce_scatter_max.o
[task 2023-12-15T19:12:49.870Z] Compiling  functions.cu                        > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/functions.o
[task 2023-12-15T19:12:56.412Z] Archiving  objects                             > /builds/worker/fetches/marian-source/build/local/obj/collectives/device/colldevice.a
[task 2023-12-15T19:12:56.596Z] Linking    libnccl.so.2.3.7                    > /builds/worker/fetches/marian-source/build/local/lib/libnccl.so.2.3.7
[task 2023-12-15T19:12:56.910Z] Archiving  libnccl_static.a                    > /builds/worker/fetches/marian-source/build/local/lib/libnccl_static.a
[task 2023-12-15T19:12:56.993Z] /builds/worker/fetches/marian-source/src/3rd_party/nccl/src
[task 2023-12-15T19:12:57.199Z] [ 71%] No install step for 'nccl_install'
[task 2023-12-15T19:12:57.218Z] [ 72%] Completed 'nccl_install'
[task 2023-12-15T19:12:57.243Z] [ 72%] Built target nccl_install
[task 2023-12-15T19:12:57.259Z] [ 72%] Built target 3rd_party_installs
[task 2023-12-15T19:12:57.267Z] [ 72%] Building NVCC (Device) object src/CMakeFiles/marian_cuda.dir/tensors/gpu/marian_cuda_generated_algorithm.cu.o
[task 2023-12-15T19:12:57.267Z] [ 72%] Building NVCC (Device) object src/CMakeFiles/marian_cuda.dir/tensors/gpu/marian_cuda_generated_add_all.cu.o
[task 2023-12-15T19:12:57.267Z] [ 72%] Building NVCC (Device) object src/CMakeFiles/marian_cuda.dir/tensors/gpu/marian_cuda_generated_add.cu.o
[task 2023-12-15T19:12:57.268Z] [ 73%] Building NVCC (Device) object src/CMakeFiles/marian_cuda.dir/tensors/gpu/marian_cuda_generated_device.cu.o
[task 2023-12-15T19:12:57.268Z] [ 73%] Building NVCC (Device) object src/CMakeFiles/marian_cuda.dir/translator/marian_cuda_generated_nth_element.cu.o
[task 2023-12-15T19:12:57.268Z] [ 74%] Building NVCC (Device) object src/CMakeFiles/marian_cuda.dir/tensors/gpu/marian_cuda_generated_element.cu.o
[task 2023-12-15T19:12:57.269Z] [ 75%] Building NVCC (Device) object src/CMakeFiles/marian_cuda.dir/tensors/gpu/marian_cuda_generated_cudnn_wrappers.cu.o
[task 2023-12-15T19:12:57.270Z] [ 75%] Building NVCC (Device) object src/CMakeFiles/marian_cuda.dir/tensors/gpu/marian_cuda_generated_tensor_operators.cu.o
[task 2023-12-15T19:12:57.270Z] [ 75%] Building NVCC (Device) object src/CMakeFiles/marian_cuda.dir/tensors/gpu/marian_cuda_generated_topk.cu.o
[task 2023-12-15T19:12:57.275Z] [ 75%] Building NVCC (Device) object src/CMakeFiles/marian_cuda.dir/translator/marian_cuda_generated_helpers.cu.o
[task 2023-12-15T19:18:24.410Z] [ 75%] Building CXX object src/CMakeFiles/marian_cuda.dir/tensors/gpu/prod.cpp.o
[task 2023-12-15T19:18:35.475Z] [ 76%] Linking CXX static library libmarian_cuda.a
[task 2023-12-15T19:18:36.737Z] [ 76%] Built target marian_cuda
[task 2023-12-15T19:18:36.756Z] [ 76%] Building CXX object src/CMakeFiles/marian.dir/common/version.cpp.o
[task 2023-12-15T19:18:36.756Z] [ 78%] Building CXX object src/CMakeFiles/marian.dir/common/logging.cpp.o
[task 2023-12-15T19:18:36.756Z] [ 78%] Building CXX object src/CMakeFiles/marian.dir/common/cli_helper.cpp.o
[task 2023-12-15T19:18:36.756Z] [ 78%] Building CXX object src/CMakeFiles/marian.dir/common/fastopt.cpp.o
[task 2023-12-15T19:18:36.757Z] [ 78%] Building CXX object src/CMakeFiles/marian.dir/common/aliases.cpp.o
[task 2023-12-15T19:18:36.758Z] [ 78%] Building CXX object src/CMakeFiles/marian.dir/common/config.cpp.o
[task 2023-12-15T19:18:36.758Z] [ 78%] Building CXX object src/CMakeFiles/marian.dir/common/utils.cpp.o
[task 2023-12-15T19:18:36.758Z] [ 78%] Building CXX object src/CMakeFiles/marian.dir/common/cli_wrapper.cpp.o
[task 2023-12-15T19:18:36.759Z] [ 79%] Building CXX object src/CMakeFiles/marian.dir/common/config_parser.cpp.o
[task 2023-12-15T19:18:36.759Z] [ 79%] Building CXX object src/CMakeFiles/marian.dir/common/config_validator.cpp.o
[task 2023-12-15T19:18:36.759Z] [ 80%] Building CXX object src/CMakeFiles/marian.dir/common/file_stream.cpp.o
[task 2023-12-15T19:18:36.759Z] [ 80%] Building CXX object src/CMakeFiles/marian.dir/common/options.cpp.o
[task 2023-12-15T19:18:36.760Z] [ 80%] Building CXX object src/CMakeFiles/marian.dir/common/binary.cpp.o
[task 2023-12-15T19:18:36.760Z] [ 81%] Building CXX object src/CMakeFiles/marian.dir/common/build_info.cpp.o
[task 2023-12-15T19:18:36.760Z] [ 81%] Building CXX object src/CMakeFiles/marian.dir/common/filesystem.cpp.o
[task 2023-12-15T19:18:36.760Z] [ 81%] Building CXX object src/CMakeFiles/marian.dir/common/io.cpp.o
[task 2023-12-15T19:18:36.762Z] [ 81%] Building CXX object src/CMakeFiles/marian.dir/common/file_utils.cpp.o
[task 2023-12-15T19:18:36.762Z] [ 82%] Building CXX object src/CMakeFiles/marian.dir/data/alignment.cpp.o
[task 2023-12-15T19:18:36.762Z] [ 82%] Building CXX object src/CMakeFiles/marian.dir/common/signal_handling.cpp.o
[task 2023-12-15T19:18:36.762Z] [ 82%] Building CXX object src/CMakeFiles/marian.dir/common/types.cpp.o
[task 2023-12-15T19:18:36.762Z] [ 82%] Building CXX object src/CMakeFiles/marian.dir/data/vocab.cpp.o
[task 2023-12-15T19:18:36.763Z] [ 82%] Building CXX object src/CMakeFiles/marian.dir/data/default_vocab.cpp.o
[task 2023-12-15T19:18:36.763Z] [ 82%] Building CXX object src/CMakeFiles/marian.dir/data/sentencepiece_vocab.cpp.o
[task 2023-12-15T19:18:36.763Z] [ 82%] Building CXX object src/CMakeFiles/marian.dir/data/corpus.cpp.o
[task 2023-12-15T19:18:36.764Z] [ 83%] Building CXX object src/CMakeFiles/marian.dir/data/factored_vocab.cpp.o
[task 2023-12-15T19:18:36.764Z] [ 83%] Building CXX object src/CMakeFiles/marian.dir/data/corpus_base.cpp.o
[task 2023-12-15T19:18:36.766Z] [ 84%] Building CXX object src/CMakeFiles/marian.dir/data/corpus_nbest.cpp.o
[task 2023-12-15T19:18:36.791Z] [ 84%] Building CXX object src/CMakeFiles/marian.dir/data/text_input.cpp.o
[task 2023-12-15T19:18:36.792Z] [ 84%] Building CXX object src/CMakeFiles/marian.dir/3rd_party/cnpy/cnpy.cpp.o
[task 2023-12-15T19:18:36.793Z] [ 84%] Building CXX object src/CMakeFiles/marian.dir/data/shortlist.cpp.o
[task 2023-12-15T19:18:36.796Z] [ 84%] Building CXX object src/CMakeFiles/marian.dir/3rd_party/phf/phf.cc.o
[task 2023-12-15T19:18:36.804Z] [ 85%] Building CXX object src/CMakeFiles/marian.dir/3rd_party/onnx/protobuf/onnx-ml.pb-wrapper.cpp.o
[task 2023-12-15T19:18:36.866Z] [ 85%] Building CXX object src/CMakeFiles/marian.dir/tensors/backend.cpp.o
[task 2023-12-15T19:18:37.140Z] [ 86%] Building CXX object src/CMakeFiles/marian.dir/tensors/rand.cpp.o
[task 2023-12-15T19:18:37.143Z] [ 86%] Building CXX object src/CMakeFiles/marian.dir/tensors/tensor.cpp.o
[task 2023-12-15T19:18:37.311Z] [ 86%] Building CXX object src/CMakeFiles/marian.dir/tensors/cpu/device.cpp.o
[task 2023-12-15T19:18:37.711Z] [ 86%] Building CXX object src/CMakeFiles/marian.dir/tensors/cpu/prod.cpp.o
[task 2023-12-15T19:18:38.395Z] [ 87%] Building CXX object src/CMakeFiles/marian.dir/tensors/cpu/topk.cpp.o
[task 2023-12-15T19:18:39.571Z] [ 87%] Building CXX object src/CMakeFiles/marian.dir/tensors/cpu/tensor_operators.cpp.o
[task 2023-12-15T19:18:41.011Z] [ 87%] Building CXX object src/CMakeFiles/marian.dir/tensors/cpu/integer_common.cpp.o
[task 2023-12-15T19:18:41.138Z] [ 87%] Building CXX object src/CMakeFiles/marian.dir/tensors/cpu/wasm_intgemm_fallback.cpp.o
[task 2023-12-15T19:18:41.164Z] [ 88%] Building CXX object src/CMakeFiles/marian.dir/graph/expression_graph.cpp.o
[task 2023-12-15T19:18:41.555Z] [ 88%] Building CXX object src/CMakeFiles/marian.dir/graph/expression_operators.cpp.o
[task 2023-12-15T19:18:41.691Z] [ 88%] Building CXX object src/CMakeFiles/marian.dir/graph/node.cpp.o
[task 2023-12-15T19:18:42.959Z] [ 89%] Building CXX object src/CMakeFiles/marian.dir/graph/node_operators.cpp.o
[task 2023-12-15T19:18:43.550Z] [ 89%] Building CXX object src/CMakeFiles/marian.dir/graph/node_initializers.cpp.o
[task 2023-12-15T19:18:43.571Z] [ 89%] Building CXX object src/CMakeFiles/marian.dir/onnx/expression_graph_onnx_exporter.cpp.o
[task 2023-12-15T19:18:43.598Z] [ 89%] Building CXX object src/CMakeFiles/marian.dir/onnx/expression_graph_onnx_serialization.cpp.o
[task 2023-12-15T19:18:43.626Z] [ 90%] Building CXX object src/CMakeFiles/marian.dir/layers/convolution.cpp.o
[task 2023-12-15T19:18:44.022Z] [ 90%] Building CXX object src/CMakeFiles/marian.dir/layers/generic.cpp.o
[task 2023-12-15T19:18:44.102Z] [ 90%] Building CXX object src/CMakeFiles/marian.dir/layers/loss.cpp.o
[task 2023-12-15T19:18:44.275Z] [ 91%] Building CXX object src/CMakeFiles/marian.dir/layers/weight.cpp.o
[task 2023-12-15T19:18:44.318Z] [ 91%] Building CXX object src/CMakeFiles/marian.dir/rnn/cells.cpp.o
[task 2023-12-15T19:18:45.394Z] [ 91%] Building CXX object src/CMakeFiles/marian.dir/rnn/attention.cpp.o
[task 2023-12-15T19:18:45.421Z] [ 91%] Building CXX object src/CMakeFiles/marian.dir/optimizers/clippers.cpp.o
[task 2023-12-15T19:18:47.487Z] [ 92%] Building CXX object src/CMakeFiles/marian.dir/optimizers/optimizers.cpp.o
[task 2023-12-15T19:18:47.574Z] [ 92%] Building CXX object src/CMakeFiles/marian.dir/models/model_factory.cpp.o
[task 2023-12-15T19:18:47.582Z] [ 92%] Building CXX object src/CMakeFiles/marian.dir/models/encoder_decoder.cpp.o
[task 2023-12-15T19:18:47.608Z] [ 92%] Building CXX object src/CMakeFiles/marian.dir/models/transformer_stub.cpp.o
[task 2023-12-15T19:18:49.639Z] [ 93%] Building CXX object src/CMakeFiles/marian.dir/rescorer/score_collector.cpp.o
[task 2023-12-15T19:18:49.756Z] [ 93%] Building CXX object src/CMakeFiles/marian.dir/embedder/vector_collector.cpp.o
[task 2023-12-15T19:18:49.857Z] [ 93%] Building CXX object src/CMakeFiles/marian.dir/translator/beam_search.cpp.o
[task 2023-12-15T19:18:49.927Z] [ 94%] Building CXX object src/CMakeFiles/marian.dir/translator/history.cpp.o
[task 2023-12-15T19:18:50.835Z] [ 94%] Building CXX object src/CMakeFiles/marian.dir/translator/output_collector.cpp.o
[task 2023-12-15T19:18:50.872Z] [ 94%] Building CXX object src/CMakeFiles/marian.dir/translator/output_printer.cpp.o
[task 2023-12-15T19:18:51.847Z] [ 94%] Building CXX object src/CMakeFiles/marian.dir/translator/nth_element.cpp.o
[task 2023-12-15T19:18:51.883Z] [ 95%] Building CXX object src/CMakeFiles/marian.dir/translator/helpers.cpp.o
[task 2023-12-15T19:18:52.452Z] [ 95%] Building CXX object src/CMakeFiles/marian.dir/translator/scorers.cpp.o
[task 2023-12-15T19:18:52.631Z] [ 95%] Building CXX object src/CMakeFiles/marian.dir/3rd_party/ExceptionWithCallStack.cpp.o
[task 2023-12-15T19:18:52.857Z] [ 96%] Building CXX object src/CMakeFiles/marian.dir/data/corpus_sqlite.cpp.o
[task 2023-12-15T19:18:53.384Z] [ 96%] Building CXX object src/CMakeFiles/marian.dir/tensors/cpu/fbgemm/packed_gemm.cpp.o
[task 2023-12-15T19:18:53.858Z] [ 96%] Building CXX object src/CMakeFiles/marian.dir/layers/lsh.cpp.o
[task 2023-12-15T19:18:54.035Z] [ 96%] Building CXX object src/CMakeFiles/marian.dir/optimizers/quantizer.cpp.o
[task 2023-12-15T19:18:55.184Z] [ 97%] Building CXX object src/CMakeFiles/marian.dir/training/graph_group_async.cpp.o
[task 2023-12-15T19:18:55.389Z] [ 97%] Building CXX object src/CMakeFiles/marian.dir/training/graph_group_sync.cpp.o
[task 2023-12-15T19:18:56.033Z] [ 97%] Building CXX object src/CMakeFiles/marian.dir/training/graph_group.cpp.o
[task 2023-12-15T19:18:56.251Z] [ 97%] Building CXX object src/CMakeFiles/marian.dir/training/graph_group_singleton.cpp.o
[task 2023-12-15T19:18:56.456Z] [ 98%] Building CXX object src/CMakeFiles/marian.dir/training/validator.cpp.o
[task 2023-12-15T19:18:56.964Z] [ 98%] Building CXX object src/CMakeFiles/marian.dir/training/communicator.cpp.o
[task 2023-12-15T19:18:57.389Z] [ 98%] Building CXX object src/CMakeFiles/marian.dir/microsoft/quicksand.cpp.o
[task 2023-12-15T19:18:57.562Z] [ 99%] Building CXX object src/CMakeFiles/marian.dir/microsoft/cosmos.cpp.o
[task 2023-12-15T19:19:45.086Z] [ 99%] Linking CXX static library ../libmarian.a
[task 2023-12-15T19:19:45.820Z] [ 99%] Built target marian
[task 2023-12-15T19:19:45.836Z] [100%] Building CXX object src/CMakeFiles/marian_vocab.dir/command/marian_vocab.cpp.o
[task 2023-12-15T19:19:45.836Z] [100%] Building CXX object src/CMakeFiles/marian_decoder.dir/command/marian_decoder.cpp.o
[task 2023-12-15T19:19:45.836Z] [100%] Building CXX object src/CMakeFiles/marian_train.dir/command/marian_main.cpp.o
[task 2023-12-15T19:19:45.836Z] [100%] Building CXX object src/CMakeFiles/marian_conv.dir/command/marian_conv.cpp.o
[task 2023-12-15T19:19:45.836Z] [100%] Building CXX object src/CMakeFiles/marian_scorer.dir/command/marian_scorer.cpp.o
[task 2023-12-15T19:19:56.454Z] [100%] Linking CXX executable ../marian-vocab
[task 2023-12-15T19:19:56.934Z] [100%] Built target marian_vocab
[task 2023-12-15T19:20:02.202Z] [100%] Linking CXX executable ../marian-decoder
[task 2023-12-15T19:20:02.525Z] [100%] Linking CXX executable ../marian-conv
[task 2023-12-15T19:20:04.249Z] [100%] Built target marian_conv
[task 2023-12-15T19:20:04.855Z] [100%] Linking CXX executable ../marian-scorer
[task 2023-12-15T19:20:05.225Z] [100%] Built target marian_decoder
[task 2023-12-15T19:20:07.581Z] [100%] Built target marian_scorer
[task 2023-12-15T19:20:19.300Z] [100%] Linking CXX executable ../marian
[task 2023-12-15T19:20:22.279Z] [100%] Built target marian_train
[task 2023-12-15T19:20:22.288Z] + echo '###### Done: Compiling marian'
[task 2023-12-15T19:20:22.288Z] ###### Done: Compiling marian
[task 2023-12-15T19:20:22.288Z] + cd /builds/worker/fetches/marian-source/build
[task 2023-12-15T19:20:22.288Z] + tar -cf /builds/worker/artifacts/marian.tar marian marian-decoder marian-scorer marian-conv marian-vocab spm_train spm_encode spm_export_vocab
[task 2023-12-15T19:20:22.860Z] + '[' -f /builds/worker/fetches/marian-source/scripts/alphas/extract_stats.py ']'
[task 2023-12-15T19:20:22.860Z] + cd /builds/worker/fetches/marian-source/scripts/alphas
[task 2023-12-15T19:20:22.860Z] + tar -rf /builds/worker/artifacts/marian.tar extract_stats.py
[task 2023-12-15T19:20:22.990Z] + zstd --rm /builds/worker/artifacts/marian.tar
[task 2023-12-15T19:20:22.991Z] 
[task 2023-12-15T19:20:22.991Z]                                                                                
[task 2023-12-15T19:20:23.160Z] Read :  0 / 715 MB ==>  0%
[task 2023-12-15T19:20:23.160Z]                                                                                
[task 2023-12-15T19:20:23.327Z] Read : 39 / 715 MB ==> 21%
[task 2023-12-15T19:20:23.327Z]                                                                                
[task 2023-12-15T19:20:23.497Z] Read : 98 / 715 MB ==> 17%
[task 2023-12-15T19:20:23.497Z]                                                                                
[task 2023-12-15T19:20:23.664Z] Read : 127 / 715 MB ==> 24%
[task 2023-12-15T19:20:23.664Z]                                                                                
[task 2023-12-15T19:20:23.833Z] Read : 161 / 715 MB ==> 29%
[task 2023-12-15T19:20:23.833Z]                                                                                
[task 2023-12-15T19:20:24.001Z] Read : 192 / 715 MB ==> 30%
[task 2023-12-15T19:20:24.001Z]                                                                                
[task 2023-12-15T19:20:24.168Z] Read : 231 / 715 MB ==> 29%
[task 2023-12-15T19:20:24.168Z]                                                                                
[task 2023-12-15T19:20:24.337Z] Read : 270 / 715 MB ==> 28%
[task 2023-12-15T19:20:24.337Z]                                                                                
[task 2023-12-15T19:20:24.504Z] Read : 334 / 715 MB ==> 24%
[task 2023-12-15T19:20:24.504Z]                                                                                
[task 2023-12-15T19:20:24.671Z] Read : 362 / 715 MB ==> 25%
[task 2023-12-15T19:20:24.671Z]                                                                                
[task 2023-12-15T19:20:24.838Z] Read : 401 / 715 MB ==> 25%
[task 2023-12-15T19:20:24.838Z]                                                                                
[task 2023-12-15T19:20:25.008Z] Read : 445 / 715 MB ==> 24%
[task 2023-12-15T19:20:25.008Z]                                                                                
[task 2023-12-15T19:20:25.175Z] Read : 505 / 715 MB ==> 23%
[task 2023-12-15T19:20:25.175Z]                                                                                
[task 2023-12-15T19:20:25.344Z] Read : 535 / 715 MB ==> 23%
[task 2023-12-15T19:20:25.344Z]                                                                                
[task 2023-12-15T19:20:25.511Z] Read : 576 / 715 MB ==> 23%
[task 2023-12-15T19:20:25.512Z]                                                                                
[task 2023-12-15T19:20:25.680Z] Read : 636 / 715 MB ==> 22%
[task 2023-12-15T19:20:25.680Z]                                                                                
[task 2023-12-15T19:20:25.847Z] Read : 669 / 715 MB ==> 22%
[task 2023-12-15T19:20:25.847Z]                                                                                
[task 2023-12-15T19:20:25.875Z] Read : 710 / 715 MB ==> 22%
[task 2023-12-15T19:20:25.875Z]                                                                                
[task 2023-12-15T19:20:25.875Z] /builds/worker/artifacts/marian.tar : 22.17%   (749834240 => 166201013 bytes, /builds/worker/artifacts/marian.tar.zst) 
[fetches 2023-12-15T19:20:25.964Z] removing /builds/worker/fetches
[fetches 2023-12-15T19:20:27.243Z] finished
[taskcluster 2023-12-15 19:20:27.782Z] === Task Finished ===
[taskcluster 2023-12-15 19:20:30.118Z] Successful task run with exit code: 0 completed in 1181.598 seconds