Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert CPU generic workers #629

Merged
merged 2 commits into from
May 27, 2024

Trigger CI

9db5284
Select commit
Loading
Failed to load commit list.
Merged

Revert CPU generic workers #629

Trigger CI
9db5284
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / clean-corpus-url-gcp_pytest-dataset_a0017e-ru-en succeeded May 24, 2024 in 5m 51s

FirefoxCI (pull_request)

Clean url gcp_pytest-dataset_a0017e dataset ru-en use OpusCleaner true

Details

View task in Taskcluster
View logs in Taskcluster

[task 2024-05-24T16:54:44.408Z] 118050K .......... .......... .......... .......... .......... 92%  197M 0s
[task 2024-05-24T16:54:44.408Z] 118100K .......... .......... .......... .......... .......... 92%  213M 0s
[task 2024-05-24T16:54:44.409Z] 118150K .......... .......... .......... .......... .......... 92%  180M 0s
[task 2024-05-24T16:54:44.409Z] 118200K .......... .......... .......... .......... .......... 92%  216M 0s
[task 2024-05-24T16:54:44.409Z] 118250K .......... .......... .......... .......... .......... 92%  222M 0s
[task 2024-05-24T16:54:44.409Z] 118300K .......... .......... .......... .......... .......... 92%  218M 0s
[task 2024-05-24T16:54:44.410Z] 118350K .......... .......... .......... .......... .......... 92%  189M 0s
[task 2024-05-24T16:54:44.410Z] 118400K .......... .......... .......... .......... .......... 92%  205M 0s
[task 2024-05-24T16:54:44.410Z] 118450K .......... .......... .......... .......... .......... 92%  220M 0s
[task 2024-05-24T16:54:44.410Z] 118500K .......... .......... .......... .......... .......... 92%  221M 0s
[task 2024-05-24T16:54:44.413Z] 118550K .......... .......... .......... .......... .......... 92% 18.9M 0s
[task 2024-05-24T16:54:44.413Z] 118600K .......... .......... .......... .......... .......... 92%  194M 0s
[task 2024-05-24T16:54:44.413Z] 118650K .......... .......... .......... .......... .......... 92%  194M 0s
[task 2024-05-24T16:54:44.414Z] 118700K .......... .......... .......... .......... .......... 92%  204M 0s
[task 2024-05-24T16:54:44.414Z] 118750K .......... .......... .......... .......... .......... 92%  170M 0s
[task 2024-05-24T16:54:44.414Z] 118800K .......... .......... .......... .......... .......... 92%  200M 0s
[task 2024-05-24T16:54:44.414Z] 118850K .......... .......... .......... .......... .......... 92%  194M 0s
[task 2024-05-24T16:54:44.415Z] 118900K .......... .......... .......... .......... .......... 92%  204M 0s
[task 2024-05-24T16:54:44.415Z] 118950K .......... .......... .......... .......... .......... 92%  160M 0s
[task 2024-05-24T16:54:44.415Z] 119000K .......... .......... .......... .......... .......... 92%  203M 0s
[task 2024-05-24T16:54:44.415Z] 119050K .......... .......... .......... .......... .......... 92%  196M 0s
[task 2024-05-24T16:54:44.416Z] 119100K .......... .......... .......... .......... .......... 92%  192M 0s
[task 2024-05-24T16:54:44.416Z] 119150K .......... .......... .......... .......... .......... 92%  165M 0s
[task 2024-05-24T16:54:44.416Z] 119200K .......... .......... .......... .......... .......... 93%  222M 0s
[task 2024-05-24T16:54:44.416Z] 119250K .......... .......... .......... .......... .......... 93%  219M 0s
[task 2024-05-24T16:54:44.417Z] 119300K .......... .......... .......... .......... .......... 93%  223M 0s
[task 2024-05-24T16:54:44.417Z] 119350K .......... .......... .......... .......... .......... 93%  191M 0s
[task 2024-05-24T16:54:44.417Z] 119400K .......... .......... .......... .......... .......... 93%  213M 0s
[task 2024-05-24T16:54:44.417Z] 119450K .......... .......... .......... .......... .......... 93%  209M 0s
[task 2024-05-24T16:54:44.418Z] 119500K .......... .......... .......... .......... .......... 93%  198M 0s
[task 2024-05-24T16:54:44.418Z] 119550K .......... .......... .......... .......... .......... 93%  168M 0s
[task 2024-05-24T16:54:44.418Z] 119600K .......... .......... .......... .......... .......... 93%  199M 0s
[task 2024-05-24T16:54:44.418Z] 119650K .......... .......... .......... .......... .......... 93%  195M 0s
[task 2024-05-24T16:54:44.419Z] 119700K .......... .......... .......... .......... .......... 93%  197M 0s
[task 2024-05-24T16:54:44.419Z] 119750K .......... .......... .......... .......... .......... 93%  175M 0s
[task 2024-05-24T16:54:44.419Z] 119800K .......... .......... .......... .......... .......... 93%  195M 0s
[task 2024-05-24T16:54:44.419Z] 119850K .......... .......... .......... .......... .......... 93%  203M 0s
[task 2024-05-24T16:54:44.420Z] 119900K .......... .......... .......... .......... .......... 93%  205M 0s
[task 2024-05-24T16:54:44.420Z] 119950K .......... .......... .......... .......... .......... 93%  175M 0s
[task 2024-05-24T16:54:44.420Z] 120000K .......... .......... .......... .......... .......... 93%  210M 0s
[task 2024-05-24T16:54:44.420Z] 120050K .......... .......... .......... .......... .......... 93%  192M 0s
[task 2024-05-24T16:54:44.421Z] 120100K .......... .......... .......... .......... .......... 93%  211M 0s
[task 2024-05-24T16:54:44.421Z] 120150K .......... .......... .......... .......... .......... 93%  192M 0s
[task 2024-05-24T16:54:44.421Z] 120200K .......... .......... .......... .......... .......... 93%  227M 0s
[task 2024-05-24T16:54:44.421Z] 120250K .......... .......... .......... .......... .......... 93%  225M 0s
[task 2024-05-24T16:54:44.422Z] 120300K .......... .......... .......... .......... .......... 93%  224M 0s
[task 2024-05-24T16:54:44.422Z] 120350K .......... .......... .......... .......... .......... 93%  180M 0s
[task 2024-05-24T16:54:44.422Z] 120400K .......... .......... .......... .......... .......... 93%  222M 0s
[task 2024-05-24T16:54:44.422Z] 120450K .......... .......... .......... .......... .......... 94%  221M 0s
[task 2024-05-24T16:54:44.423Z] 120500K .......... .......... .......... .......... .......... 94%  220M 0s
[task 2024-05-24T16:54:44.423Z] 120550K .......... .......... .......... .......... .......... 94%  198M 0s
[task 2024-05-24T16:54:44.434Z] 120600K .......... .......... .......... .......... .......... 94% 4.30M 0s
[task 2024-05-24T16:54:44.434Z] 120650K .......... .......... .......... .......... .......... 94%  177M 0s
[task 2024-05-24T16:54:44.435Z] 120700K .......... .......... .......... .......... .......... 94%  197M 0s
[task 2024-05-24T16:54:44.435Z] 120750K .......... .......... .......... .......... .......... 94%  160M 0s
[task 2024-05-24T16:54:44.435Z] 120800K .......... .......... .......... .......... .......... 94%  190M 0s
[task 2024-05-24T16:54:44.435Z] 120850K .......... .......... .......... .......... .......... 94%  205M 0s
[task 2024-05-24T16:54:44.436Z] 120900K .......... .......... .......... .......... .......... 94%  208M 0s
[task 2024-05-24T16:54:44.436Z] 120950K .......... .......... .......... .......... .......... 94%  173M 0s
[task 2024-05-24T16:54:44.436Z] 121000K .......... .......... .......... .......... .......... 94%  198M 0s
[task 2024-05-24T16:54:44.436Z] 121050K .......... .......... .......... .......... .......... 94%  200M 0s
[task 2024-05-24T16:54:44.437Z] 121100K .......... .......... .......... .......... .......... 94%  203M 0s
[task 2024-05-24T16:54:44.437Z] 121150K .......... .......... .......... .......... .......... 94%  168M 0s
[task 2024-05-24T16:54:44.437Z] 121200K .......... .......... .......... .......... .......... 94%  211M 0s
[task 2024-05-24T16:54:44.437Z] 121250K .......... .......... .......... .......... .......... 94%  208M 0s
[task 2024-05-24T16:54:44.438Z] 121300K .......... .......... .......... .......... .......... 94%  214M 0s
[task 2024-05-24T16:54:44.438Z] 121350K .......... .......... .......... .......... .......... 94%  188M 0s
[task 2024-05-24T16:54:44.438Z] 121400K .......... .......... .......... .......... .......... 94%  219M 0s
[task 2024-05-24T16:54:44.438Z] 121450K .......... .......... .......... .......... .......... 94%  221M 0s
[task 2024-05-24T16:54:44.439Z] 121500K .......... .......... .......... .......... .......... 94%  221M 0s
[task 2024-05-24T16:54:44.439Z] 121550K .......... .......... .......... .......... .......... 94%  178M 0s
[task 2024-05-24T16:54:44.439Z] 121600K .......... .......... .......... .......... .......... 94%  203M 0s
[task 2024-05-24T16:54:44.440Z] 121650K .......... .......... .......... .......... .......... 94% 47.5M 0s
[task 2024-05-24T16:54:44.440Z] 121700K .......... .......... .......... .......... .......... 94%  202M 0s
[task 2024-05-24T16:54:44.441Z] 121750K .......... .......... .......... .......... .......... 95%  178M 0s
[task 2024-05-24T16:54:44.441Z] 121800K .......... .......... .......... .......... .......... 95%  198M 0s
[task 2024-05-24T16:54:44.441Z] 121850K .......... .......... .......... .......... .......... 95%  201M 0s
[task 2024-05-24T16:54:44.441Z] 121900K .......... .......... .......... .......... .......... 95%  201M 0s
[task 2024-05-24T16:54:44.442Z] 121950K .......... .......... .......... .......... .......... 95%  175M 0s
[task 2024-05-24T16:54:44.442Z] 122000K .......... .......... .......... .......... .......... 95%  203M 0s
[task 2024-05-24T16:54:44.442Z] 122050K .......... .......... .......... .......... .......... 95%  199M 0s
[task 2024-05-24T16:54:44.442Z] 122100K .......... .......... .......... .......... .......... 95%  207M 0s
[task 2024-05-24T16:54:44.443Z] 122150K .......... .......... .......... .......... .......... 95%  181M 0s
[task 2024-05-24T16:54:44.443Z] 122200K .......... .......... .......... .......... .......... 95%  189M 0s
[task 2024-05-24T16:54:44.443Z] 122250K .......... .......... .......... .......... .......... 95%  205M 0s
[task 2024-05-24T16:54:44.443Z] 122300K .......... .......... .......... .......... .......... 95%  208M 0s
[task 2024-05-24T16:54:44.444Z] 122350K .......... .......... .......... .......... .......... 95%  178M 0s
[task 2024-05-24T16:54:44.444Z] 122400K .......... .......... .......... .......... .......... 95%  219M 0s
[task 2024-05-24T16:54:44.444Z] 122450K .......... .......... .......... .......... .......... 95%  223M 0s
[task 2024-05-24T16:54:44.444Z] 122500K .......... .......... .......... .......... .......... 95%  219M 0s
[task 2024-05-24T16:54:44.445Z] 122550K .......... .......... .......... .......... .......... 95%  190M 0s
[task 2024-05-24T16:54:44.445Z] 122600K .......... .......... .......... .......... .......... 95%  216M 0s
[task 2024-05-24T16:54:44.447Z] 122650K .......... .......... .......... .......... .......... 95% 23.0M 0s
[task 2024-05-24T16:54:44.447Z] 122700K .......... .......... .......... .......... .......... 95%  200M 0s
[task 2024-05-24T16:54:44.447Z] 122750K .......... .......... .......... .......... .......... 95%  163M 0s
[task 2024-05-24T16:54:44.448Z] 122800K .......... .......... .......... .......... .......... 95%  196M 0s
[task 2024-05-24T16:54:44.448Z] 122850K .......... .......... .......... .......... .......... 95%  179M 0s
[task 2024-05-24T16:54:44.448Z] 122900K .......... .......... .......... .......... .......... 95%  208M 0s
[task 2024-05-24T16:54:44.448Z] 122950K .......... .......... .......... .......... .......... 95%  180M 0s
[task 2024-05-24T16:54:44.449Z] 123000K .......... .......... .......... .......... .......... 95%  205M 0s
[task 2024-05-24T16:54:44.449Z] 123050K .......... .......... .......... .......... .......... 96%  216M 0s
[task 2024-05-24T16:54:44.449Z] 123100K .......... .......... .......... .......... .......... 96%  199M 0s
[task 2024-05-24T16:54:44.450Z] 123150K .......... .......... .......... .......... .......... 96%  156M 0s
[task 2024-05-24T16:54:44.450Z] 123200K .......... .......... .......... .......... .......... 96%  195M 0s
[task 2024-05-24T16:54:44.450Z] 123250K .......... .......... .......... .......... .......... 96%  197M 0s
[task 2024-05-24T16:54:44.450Z] 123300K .......... .......... .......... .......... .......... 96%  222M 0s
[task 2024-05-24T16:54:44.450Z] 123350K .......... .......... .......... .......... .......... 96%  198M 0s
[task 2024-05-24T16:54:44.451Z] 123400K .......... .......... .......... .......... .......... 96%  217M 0s
[task 2024-05-24T16:54:44.451Z] 123450K .......... .......... .......... .......... .......... 96%  201M 0s
[task 2024-05-24T16:54:44.451Z] 123500K .......... .......... .......... .......... .......... 96%  195M 0s
[task 2024-05-24T16:54:44.451Z] 123550K .......... .......... .......... .......... .......... 96%  167M 0s
[task 2024-05-24T16:54:44.452Z] 123600K .......... .......... .......... .......... .......... 96%  206M 0s
[task 2024-05-24T16:54:44.452Z] 123650K .......... .......... .......... .......... .......... 96%  188M 0s
[task 2024-05-24T16:54:44.452Z] 123700K .......... .......... .......... .......... .......... 96%  211M 0s
[task 2024-05-24T16:54:44.453Z] 123750K .......... .......... .......... .......... .......... 96%  173M 0s
[task 2024-05-24T16:54:44.453Z] 123800K .......... .......... .......... .......... .......... 96%  198M 0s
[task 2024-05-24T16:54:44.453Z] 123850K .......... .......... .......... .......... .......... 96%  210M 0s
[task 2024-05-24T16:54:44.453Z] 123900K .......... .......... .......... .......... .......... 96%  197M 0s
[task 2024-05-24T16:54:44.454Z] 123950K .......... .......... .......... .......... .......... 96%  168M 0s
[task 2024-05-24T16:54:44.454Z] 124000K .......... .......... .......... .......... .......... 96%  216M 0s
[task 2024-05-24T16:54:44.454Z] 124050K .......... .......... .......... .......... .......... 96%  200M 0s
[task 2024-05-24T16:54:44.454Z] 124100K .......... .......... .......... .......... .......... 96%  216M 0s
[task 2024-05-24T16:54:44.454Z] 124150K .......... .......... .......... .......... .......... 96%  193M 0s
[task 2024-05-24T16:54:44.455Z] 124200K .......... .......... .......... .......... .......... 96%  225M 0s
[task 2024-05-24T16:54:44.455Z] 124250K .......... .......... .......... .......... .......... 96%  198M 0s
[task 2024-05-24T16:54:44.455Z] 124300K .......... .......... .......... .......... .......... 97%  216M 0s
[task 2024-05-24T16:54:44.455Z] 124350K .......... .......... .......... .......... .......... 97%  191M 0s
[task 2024-05-24T16:54:44.456Z] 124400K .......... .......... .......... .......... .......... 97%  219M 0s
[task 2024-05-24T16:54:44.456Z] 124450K .......... .......... .......... .......... .......... 97%  212M 0s
[task 2024-05-24T16:54:44.456Z] 124500K .......... .......... .......... .......... .......... 97%  223M 0s
[task 2024-05-24T16:54:44.456Z] 124550K .......... .......... .......... .......... .......... 97%  170M 0s
[task 2024-05-24T16:54:44.457Z] 124600K .......... .......... .......... .......... .......... 97%  196M 0s
[task 2024-05-24T16:54:44.457Z] 124650K .......... .......... .......... .......... .......... 97%  205M 0s
[task 2024-05-24T16:54:44.457Z] 124700K .......... .......... .......... .......... .......... 97%  194M 0s
[task 2024-05-24T16:54:44.457Z] 124750K .......... .......... .......... .......... .......... 97%  167M 0s
[task 2024-05-24T16:54:44.458Z] 124800K .......... .......... .......... .......... .......... 97%  210M 0s
[task 2024-05-24T16:54:44.458Z] 124850K .......... .......... .......... .......... .......... 97%  191M 0s
[task 2024-05-24T16:54:44.458Z] 124900K .......... .......... .......... .......... .......... 97%  199M 0s
[task 2024-05-24T16:54:44.458Z] 124950K .......... .......... .......... .......... .......... 97%  186M 0s
[task 2024-05-24T16:54:44.459Z] 125000K .......... .......... .......... .......... .......... 97%  215M 0s
[task 2024-05-24T16:54:44.459Z] 125050K .......... .......... .......... .......... .......... 97%  186M 0s
[task 2024-05-24T16:54:44.459Z] 125100K .......... .......... .......... .......... .......... 97%  202M 0s
[task 2024-05-24T16:54:44.459Z] 125150K .......... .......... .......... .......... .......... 97%  178M 0s
[task 2024-05-24T16:54:44.460Z] 125200K .......... .......... .......... .......... .......... 97%  221M 0s
[task 2024-05-24T16:54:44.460Z] 125250K .......... .......... .......... .......... .......... 97%  216M 0s
[task 2024-05-24T16:54:44.460Z] 125300K .......... .......... .......... .......... .......... 97%  219M 0s
[task 2024-05-24T16:54:44.460Z] 125350K .......... .......... .......... .......... .......... 97%  197M 0s
[task 2024-05-24T16:54:44.461Z] 125400K .......... .......... .......... .......... .......... 97%  225M 0s
[task 2024-05-24T16:54:44.461Z] 125450K .......... .......... .......... .......... .......... 97%  221M 0s
[task 2024-05-24T16:54:44.461Z] 125500K .......... .......... .......... .......... .......... 97%  195M 0s
[task 2024-05-24T16:54:44.461Z] 125550K .......... .......... .......... .......... .......... 97%  171M 0s
[task 2024-05-24T16:54:44.462Z] 125600K .......... .......... .......... .......... .......... 98%  208M 0s
[task 2024-05-24T16:54:44.462Z] 125650K .......... .......... .......... .......... .......... 98%  212M 0s
[task 2024-05-24T16:54:44.462Z] 125700K .......... .......... .......... .......... .......... 98%  193M 0s
[task 2024-05-24T16:54:44.462Z] 125750K .......... .......... .......... .......... .......... 98%  187M 0s
[task 2024-05-24T16:54:44.463Z] 125800K .......... .......... .......... .......... .......... 98%  206M 0s
[task 2024-05-24T16:54:44.463Z] 125850K .......... .......... .......... .......... .......... 98%  201M 0s
[task 2024-05-24T16:54:44.463Z] 125900K .......... .......... .......... .......... .......... 98%  187M 0s
[task 2024-05-24T16:54:44.463Z] 125950K .......... .......... .......... .......... .......... 98%  165M 0s
[task 2024-05-24T16:54:44.464Z] 126000K .......... .......... .......... .......... .......... 98%  197M 0s
[task 2024-05-24T16:54:44.464Z] 126050K .......... .......... .......... .......... .......... 98%  198M 0s
[task 2024-05-24T16:54:44.464Z] 126100K .......... .......... .......... .......... .......... 98%  195M 0s
[task 2024-05-24T16:54:44.464Z] 126150K .......... .......... .......... .......... .......... 98%  196M 0s
[task 2024-05-24T16:54:44.465Z] 126200K .......... .......... .......... .......... .......... 98%  222M 0s
[task 2024-05-24T16:54:44.465Z] 126250K .......... .......... .......... .......... .......... 98%  219M 0s
[task 2024-05-24T16:54:44.465Z] 126300K .......... .......... .......... .......... .......... 98%  212M 0s
[task 2024-05-24T16:54:44.465Z] 126350K .......... .......... .......... .......... .......... 98%  184M 0s
[task 2024-05-24T16:54:44.465Z] 126400K .......... .......... .......... .......... .......... 98%  212M 0s
[task 2024-05-24T16:54:44.466Z] 126450K .......... .......... .......... .......... .......... 98%  218M 0s
[task 2024-05-24T16:54:44.466Z] 126500K .......... .......... .......... .......... .......... 98%  215M 0s
[task 2024-05-24T16:54:44.466Z] 126550K .......... .......... .......... .......... .......... 98%  190M 0s
[task 2024-05-24T16:54:44.466Z] 126600K .......... .......... .......... .......... .......... 98%  220M 0s
[task 2024-05-24T16:54:44.467Z] 126650K .......... .......... .......... .......... .......... 98%  217M 0s
[task 2024-05-24T16:54:44.467Z] 126700K .......... .......... .......... .......... .......... 98%  182M 0s
[task 2024-05-24T16:54:44.467Z] 126750K .......... .......... .......... .......... .......... 98%  185M 0s
[task 2024-05-24T16:54:44.467Z] 126800K .......... .......... .......... .......... .......... 98%  224M 0s
[task 2024-05-24T16:54:44.468Z] 126850K .......... .......... .......... .......... .......... 98%  218M 0s
[task 2024-05-24T16:54:44.468Z] 126900K .......... .......... .......... .......... .......... 99% 66.3M 0s
[task 2024-05-24T16:54:44.469Z] 126950K .......... .......... .......... .......... .......... 99%  178M 0s
[task 2024-05-24T16:54:44.469Z] 127000K .......... .......... .......... .......... .......... 99%  200M 0s
[task 2024-05-24T16:54:44.469Z] 127050K .......... .......... .......... .......... .......... 99%  207M 0s
[task 2024-05-24T16:54:44.469Z] 127100K .......... .......... .......... .......... .......... 99%  201M 0s
[task 2024-05-24T16:54:44.470Z] 127150K .......... .......... .......... .......... .......... 99%  163M 0s
[task 2024-05-24T16:54:44.470Z] 127200K .......... .......... .......... .......... .......... 99%  194M 0s
[task 2024-05-24T16:54:44.470Z] 127250K .......... .......... .......... .......... .......... 99%  197M 0s
[task 2024-05-24T16:54:44.470Z] 127300K .......... .......... .......... .......... .......... 99%  213M 0s
[task 2024-05-24T16:54:44.471Z] 127350K .......... .......... .......... .......... .......... 99%  178M 0s
[task 2024-05-24T16:54:44.471Z] 127400K .......... .......... .......... .......... .......... 99%  187M 0s
[task 2024-05-24T16:54:44.471Z] 127450K .......... .......... .......... .......... .......... 99%  194M 0s
[task 2024-05-24T16:54:44.471Z] 127500K .......... .......... .......... .......... .......... 99%  187M 0s
[task 2024-05-24T16:54:44.472Z] 127550K .......... .......... .......... .......... .......... 99%  166M 0s
[task 2024-05-24T16:54:44.472Z] 127600K .......... .......... .......... .......... .......... 99%  205M 0s
[task 2024-05-24T16:54:44.472Z] 127650K .......... .......... .......... .......... .......... 99%  220M 0s
[task 2024-05-24T16:54:44.472Z] 127700K .......... .......... .......... .......... .......... 99%  221M 0s
[task 2024-05-24T16:54:44.473Z] 127750K .......... .......... .......... .......... .......... 99%  198M 0s
[task 2024-05-24T16:54:44.473Z] 127800K .......... .......... .......... .......... .......... 99%  218M 0s
[task 2024-05-24T16:54:44.473Z] 127850K .......... .......... .......... .......... .......... 99%  220M 0s
[task 2024-05-24T16:54:44.473Z] 127900K .......... .......... .......... .......... .......... 99%  222M 0s
[task 2024-05-24T16:54:44.474Z] 127950K .......... .......... .......... .......... .......... 99%  188M 0s
[task 2024-05-24T16:54:44.474Z] 128000K .......... .......... .......... .......... .......... 99%  222M 0s
[task 2024-05-24T16:54:44.474Z] 128050K .......... .......... .......... .......... .......... 99%  213M 0s
[task 2024-05-24T16:54:44.474Z] 128100K .......... .......... .......... .......... .......... 99%  223M 0s
[task 2024-05-24T16:54:44.474Z] 128150K .......... .......... .......... .........            100%  210M=0.9s
[task 2024-05-24T16:54:44.474Z] 
[task 2024-05-24T16:54:44.475Z] 2024-05-24 16:54:44 (142 MB/s) - ‘/builds/worker/.local/lib/python3.10/site-packages/opuscleaner/filters/large.bin’ saved [131266198/131266198]
[task 2024-05-24T16:54:44.475Z] 
[task 2024-05-24T16:54:44.476Z] + echo '### Generating cleaning config: url_https://storage.googleapis.com/releng-translations-dev/data/en-ru/pytest-dataset.[LANG].zst.ru-en.filters.json'
[task 2024-05-24T16:54:44.476Z] ### Generating cleaning config: url_https://storage.googleapis.com/releng-translations-dev/data/en-ru/pytest-dataset.[LANG].zst.ru-en.filters.json
[task 2024-05-24T16:54:44.476Z] + filter_path=/builds/worker/artifacts/gcp_pytest-dataset_a0017e.ru-en.filters.json
[task 2024-05-24T16:54:44.476Z] + python3 generate_filters.py /builds/worker/fetches/gcp_pytest-dataset_a0017e ru en 'url_https://storage.googleapis.com/releng-translations-dev/data/en-ru/pytest-dataset.[LANG].zst' /builds/worker/artifacts/gcp_pytest-dataset_a0017e.ru-en.filters.json custom
[task 2024-05-24T16:54:44.504Z] Using filter /builds/worker/checkouts/vcs/pipeline/clean/opuscleaner/configs/default.filters.json
[task 2024-05-24T16:54:44.507Z] + test -s /builds/worker/artifacts/gcp_pytest-dataset_a0017e.ru-en.filters.json
[task 2024-05-24T16:54:44.507Z] + echo '### Cleaning /builds/worker/fetches/gcp_pytest-dataset_a0017e with filter /builds/worker/artifacts/gcp_pytest-dataset_a0017e.ru-en.filters.json'
[task 2024-05-24T16:54:44.507Z] ### Cleaning /builds/worker/fetches/gcp_pytest-dataset_a0017e with filter /builds/worker/artifacts/gcp_pytest-dataset_a0017e.ru-en.filters.json
[task 2024-05-24T16:54:44.508Z] + opuscleaner-clean --parallel 32 --batch-size=50000 --input=- /builds/worker/artifacts/gcp_pytest-dataset_a0017e.ru-en.filters.json ru en
[task 2024-05-24T16:54:44.508Z] ++ zstdmt -dc /builds/worker/fetches/gcp_pytest-dataset_a0017e.ru.zst
[task 2024-05-24T16:54:44.508Z] + paste /dev/fd/63 /dev/fd/62
[task 2024-05-24T16:54:44.508Z] + cut -f2
[task 2024-05-24T16:54:44.508Z] + tee /dev/fd/63
[task 2024-05-24T16:54:44.508Z] ++ zstdmt -dc /builds/worker/fetches/gcp_pytest-dataset_a0017e.en.zst
[task 2024-05-24T16:54:44.508Z] + zstdmt
[task 2024-05-24T16:54:44.508Z] ++ cut -f1
[task 2024-05-24T16:54:44.509Z] ++ zstdmt
[task 2024-05-24T16:54:45.081Z] + echo '### Checking length of the files'
[task 2024-05-24T16:54:45.081Z] ### Checking length of the files
[task 2024-05-24T16:54:45.081Z] + test -s /builds/worker/artifacts/gcp_pytest-dataset_a0017e.ru.zst
[task 2024-05-24T16:54:45.081Z] + test -s /builds/worker/artifacts/gcp_pytest-dataset_a0017e.en.zst
[task 2024-05-24T16:54:45.081Z] ++ zstdmt -dc /builds/worker/artifacts/gcp_pytest-dataset_a0017e.ru.zst
[task 2024-05-24T16:54:45.081Z] ++ wc -l
[task 2024-05-24T16:54:45.083Z] + new_len_src=8
[task 2024-05-24T16:54:45.083Z] ++ zstdmt -dc /builds/worker/artifacts/gcp_pytest-dataset_a0017e.en.zst
[task 2024-05-24T16:54:45.084Z] ++ wc -l
[task 2024-05-24T16:54:45.085Z] + new_len_trg=8
[task 2024-05-24T16:54:45.086Z] ++ zstdmt -dc /builds/worker/fetches/gcp_pytest-dataset_a0017e.ru.zst
[task 2024-05-24T16:54:45.086Z] ++ wc -l
[task 2024-05-24T16:54:45.087Z] + orig_len_src=8
[task 2024-05-24T16:54:45.087Z] + [[ 8 -ge 1 ]]
[task 2024-05-24T16:54:45.087Z] + [[ 8 -ge 1 ]]
[task 2024-05-24T16:54:45.087Z] + [[ 8 = \8 ]]
[task 2024-05-24T16:54:45.087Z] + echo '### Filtered length: 8 / 8'
[task 2024-05-24T16:54:45.087Z] ### Filtered length: 8 / 8
[task 2024-05-24T16:54:45.087Z] + echo '### Clean /builds/worker/fetches/gcp_pytest-dataset_a0017e is written to  /builds/worker/artifacts/gcp_pytest-dataset_a0017e'
[task 2024-05-24T16:54:45.087Z] ### Clean /builds/worker/fetches/gcp_pytest-dataset_a0017e is written to  /builds/worker/artifacts/gcp_pytest-dataset_a0017e
[task 2024-05-24T16:54:45.087Z] + echo '###### Done: Cleaning corpus with OpusCleaner'
[task 2024-05-24T16:54:45.087Z] ###### Done: Cleaning corpus with OpusCleaner
[fetches 2024-05-24T16:54:45.088Z] removing /builds/worker/fetches
[fetches 2024-05-24T16:54:45.088Z] finished
[taskcluster 2024-05-24 16:54:47.367Z] === Task Finished ===
[taskcluster 2024-05-24 16:54:47.973Z] Successful task run with exit code: 0 completed in 16.297 seconds
View more details on firefoxci-taskcluster