Fork bergamot-translator into this repostiory as inference#867

Merged

nordzilla merged 467 commits intomainfrom fork-bergamot

Oct 1, 2024

+11,685-2

This pull request is big! We're only showing the most recent 250 commits

Commits on Apr 27, 2021

Cleanup API: Refactor request on-complete transition (#80 )
Jerin Philip
authored

Commits on Apr 28, 2021

Handle empty translation requests

Jerin Philip
authored and
abhi-agg
committed

Commits on Apr 29, 2021

Control validating the config options via a boolean flag (#116 )
abhi-agg
authored
JS bindings for loading model and shortlist files as bytes (#117 )
abhi-agg
authored

Commits on May 5, 2021

Fix busy loop in windows (#131 )

kpu
and
XapaJIaMnu
authored
Making bytearray a commandline switch (#127 )
Jerin Philip
authored

Commits on May 6, 2021

Faithful to source-structure translation (#115 )

Jerin Philip
and
XapaJIaMnu
authored

Commits on May 9, 2021

Remove unused used types TokenRanges, SentenceTokenRanges, UPtr (#137 )
Jerin Philip
authored

Commits on May 10, 2021

Change USE_WASM_COMPATIBLE_SOURCE =OFF by default on native, force on for WASM (#138 )
kpu
authored

Commits on May 11, 2021

Commits on May 12, 2021

Commits on May 13, 2021

Bundle AlignedMemory inputs with MemoryBundle (#147 )
qianqianzhu
authored

Commits on May 17, 2021

Commits on May 18, 2021

Commits on May 19, 2021

Commits on May 21, 2021

Remove O(N^2) reallocation (#171 )
Jerin Philip
authored

Commits on May 25, 2021

Adding documentation action (#168 )
Jerin Philip
authored
Fix failures when loading text shortlist (#154 )
qianqianzhu
authored

Commits on May 27, 2021

Updating marian dev RelwithDebInfo -> Release (#178 )
Jerin Philip
authored

Commits on May 31, 2021

Single executable (#175 )
Jerin Philip
authored

Commits on Jun 1, 2021

Deploy generated documentation only if browsermt (#179 )
Jerin Philip
authored
Including WASM documentation in sphinx build toc (#176 )
Jerin Philip
authored

Commits on Jun 3, 2021

Commits on Jun 4, 2021

Update native (ubuntu, mac) workflows with ccache (#181 )
Jerin Philip
authored
Replace resize with possible negative range with pop_back() (#189 )
Jerin Philip
authored

Commits on Jun 14, 2021

Partial test-apps and tolerance in evaluations (#184 )

Jerin Philip
and
kpu
authored
Removing alignments and quality-scores test-code (#196 )
Jerin Philip
authored

Commits on Jun 15, 2021

Commits on Jun 21, 2021

Load sentence-splitter (non-breaking prefixes) from ByteArray
Jerin Philip
authored

Commits on Jun 28, 2021

maxLengthBreak_ -> wrapStep bugfix (#200 )
Jerin Philip
authored

Commits on Jul 5, 2021

Change ResponseBuilder to accept callback instead of future (#142 )

Jerin Philip
and
XapaJIaMnu
authored

Commits on Jul 19, 2021

Commits on Jul 29, 2021

Windows workflow: run-vcpkg7.{3->4}; vcpkg master (#208 )
jerinphilip
authored

Commits on Aug 11, 2021

Commits on Aug 13, 2021

Add a clang-tidy run (#214 )
jerinphilip
authored

Commits on Aug 26, 2021

Wasm test page using web workers now (#218 )
abhi-agg
authored

Commits on Aug 27, 2021

Commits on Aug 31, 2021

Circle CI wasm artifacts for non-wormhole builds
abhi-agg
committed

Commits on Sep 7, 2021

BRT: Update sacrebleu to get tests back working (#217 )

jerinphilip
and
XapaJIaMnu
authored

Commits on Sep 16, 2021

QualityEstimation: Preliminary Implementation (#197 )

authored

Commits on Sep 21, 2021

Multiple TranslationModels Implementation (#210 )
jerinphilip
authored

Commits on Sep 28, 2021

Adapted wasm test page for new Service interface (#224 )
abhi-agg
authored

Commits on Oct 19, 2021

Wasm test page UI for translating b/w non-English language pairs (#231 )
abhi-agg
authored

Commits on Oct 28, 2021

Set PR to any branch to trigger workflows (#230 )
jerinphilip
authored

Commits on Oct 29, 2021

[ssplit-cpp] Enable position independent library when compiled from sources (#240 )
jerinphilip
authored

Commits on Oct 31, 2021

EXCLUDE_FROM_ALL for marian and ssplit-cpp 3rd-party libraries (#243 )
jerinphilip
authored

Commits on Nov 3, 2021

Updated marian submodule (#256 )
abhi-agg
authored

Commits on Nov 5, 2021

Commits on Nov 15, 2021

Commits on Nov 17, 2021

Import optimized gemm implementation (when available) for wasm target (#265 )
abhi-agg
authored

Commits on Nov 25, 2021

HTML input (#253 )

authored

Commits on Nov 29, 2021

HTML handling improvements (#266 )
jelmervdl
authored

Commits on Nov 30, 2021

Updated marian-dev submodule
abhi-agg
committed

Commits on Dec 1, 2021

Updated configuration for html text translation to work in wasm test page (#269 )
abhi-agg
authored

Commits on Dec 15, 2021

Remove value length limit from HTML parser & interpolated alignments (#274 )

jelmervdl
and
jerinphilip
authored

Commits on Dec 17, 2021

Commits on Dec 20, 2021

Increase HTML test coverage (#279 )
jelmervdl
authored

Commits on Dec 29, 2021

GitHub CI: Update YAML to run all tests on marian-full (#292 )
jerinphilip
authored

Commits on Dec 30, 2021

Commits on Jan 2, 2022

Commits on Jan 3, 2022

Have alignments placed if HTML is on (#296 )
jerinphilip
authored

Commits on Jan 5, 2022

HTML transfer script/style/etc elements (#285 )
jelmervdl
authored

Commits on Jan 6, 2022

CI guaranteed example documentation (#300 )
jerinphilip
authored

Commits on Jan 14, 2022

Defer model loading to parallel worker thread (#303 )
jelmervdl
authored

Commits on Jan 16, 2022

Treat most HTML elements as word-breaking (#286 )
jelmervdl
authored

Commits on Jan 17, 2022

First class pivot translation capability (#236 )
jerinphilip
authored

Commits on Jan 19, 2022

Commits on Jan 21, 2022

Add API to trigger fast shutdown of AsyncService (#297 )
jelmervdl
authored

Commits on Jan 22, 2022

Speed up Windows CI with ccache (#308 )
jerinphilip
authored

Commits on Jan 24, 2022

Remove unused compiler hash script (#309 )
jerinphilip
authored

Commits on Jan 26, 2022

Batteries included python package (#310 )
jerinphilip
authored

Commits on Jan 31, 2022

BRT: Update to fix QE download failures (#321 )
jerinphilip
authored

Commits on Feb 1, 2022

Fix HTML with pivoting (#323 )
jerinphilip
authored

Commits on Feb 4, 2022

Consolidate release artefacts (#329 )
jerinphilip
authored

Commits on Feb 7, 2022

Commits on Feb 9, 2022

Commits on Feb 11, 2022

Allow per-input options (#346 )

jerinphilip
and
jelmervdl
authored

Commits on Feb 14, 2022

Commits on Feb 15, 2022

Improve cache (#347 )
jerinphilip
authored

Commits on Feb 22, 2022

Improve handling HTML special cases (#312 )
jelmervdl
authored

Commits on Feb 23, 2022

Simplify cache config and bind for use in JS (#359 )
jerinphilip
authored

Commits on Feb 25, 2022

Embed quality-scores as HTML tag attributes (#358 )
jelmervdl
authored

Commits on Mar 3, 2022

Commits on Mar 7, 2022

Bump version to 0.4.2 (#371 )
abhi-agg
authored

Commits on Mar 9, 2022

Bump 3rd_party/marian-dev from 08b1544 to 7e67124 (#372 )
dependabot[bot]
authored

Commits on Mar 14, 2022

JS: Reuse Model registry from firefox-translation-models for test page (#377 )
abhi-agg
authored

Commits on Mar 15, 2022

JS: Using supervised QE models for available language pairs (#378 )
abhi-agg
authored

Commits on Mar 18, 2022

Bump 3rd_party/marian-dev from 7e67124 to 844800e (#382 )
dependabot[bot]
authored

Commits on Mar 23, 2022

JS: Update languages & use Intl API for their display names (#379 )
jelmervdl
authored

Commits on Mar 24, 2022

Commits on Mar 28, 2022

Bump version to 0.4.3 (#392 )
abhi-agg
authored

Commits on Mar 30, 2022

Bump bergamot-translator-tests from d03a9d3 to 7984d14 (#394 )
dependabot[bot]
authored

Commits on Mar 31, 2022

Fix call to isspace (#396 )
jelmervdl
authored

Commits on Apr 14, 2022

Bump 3rd_party/ssplit-cpp from a08d6bc to 49fde6d (#408 )
dependabot[bot]
authored

Commits on Apr 15, 2022

Update and fix windows CI (#410 )
jerinphilip
authored

Commits on Apr 19, 2022

Upgrade emsdk to 3.1.8 (#414 )

abhi-agg
and
jelmervdl
authored

Commits on Apr 28, 2022

Bump version to 0.4.4 (#415 )
abhi-agg
authored

Commits on May 18, 2022

Bump 3rd_party/marian-dev from 199201e to e88c1aa (#416 )
dependabot[bot]
authored

Commits on Jun 20, 2022

Set up python packaging for pypi distribution (#424 )
jerinphilip
authored

Commits on Jun 21, 2022

Commits on Jun 24, 2022

Python package: pyyaml >= 5.1 (#429 )
jerinphilip
authored

Commits on Jun 25, 2022

Python: Work offline if models are available (#431 )
jerinphilip
authored

Commits on Jun 29, 2022

MacOS Wheels (#432 )
graemenail
authored

Commits on Jan 17, 2023

Commits on Jan 19, 2023

Fix compilation on x86
XapaJIaMnu
committed

Commits on Mar 1, 2023

Fix path to example program
kpu
committed

Commits on May 4, 2023

Commits on May 10, 2023

Bump 3rd_party/marian-dev from 8ceb051 to bb65f47 (#447 )
dependabot[bot]
authored

Commits on Jun 6, 2023

Fix compilation on newer gcc
XapaJIaMnu
committed

Commits on Jul 12, 2023

Sentencepiece windows compilation
XapaJIaMnu
committed

Commits on Jul 31, 2023

Commits on Aug 1, 2023

Enables model ensembles (#450 )
graemenail
authored

Commits on Aug 8, 2023

Bump 3rd_party/ssplit-cpp from ad2c5a5 to a311f98 (#456 )
dependabot[bot]
authored

Commits on Aug 11, 2023

Bump 3rd_party/marian-dev from aa0221e to 8dbde0f (#458 )
dependabot[bot]
authored

Commits on Aug 14, 2023

Remove wormhole references (#459 )

XapaJIaMnu
and
jelmervdl
authored

Commits on Aug 16, 2023

Commits on Aug 17, 2023

Report the wasm size on builds (#460 )
gregtatum
authored

Commits on Sep 11, 2023

Bump 3rd_party/marian-dev from 300a50f to 780df27 (#464 )
dependabot[bot]
authored

Commits on Sep 20, 2023

Bump 3rd_party/marian-dev from 780df27 to 11c6ae7 (#466 )
dependabot[bot]
authored

Commits on Dec 7, 2023

Commits on Dec 19, 2023

More pendantic spm
XapaJIaMnu
committed

Commits on Mar 23, 2024

model url update in example script (#470 )
Kirandevraj
authored

Commits on Apr 19, 2024

fix downloading of models in the python binding (#472 )
bjesus
authored

Commits on May 12, 2024

Update submodule
XapaJIaMnu
committed

Commits on Sep 26, 2024

Commits on Oct 1, 2024