Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update bleve language support #2622

Closed
srfrog opened this issue Sep 29, 2018 · 0 comments
Closed

Update bleve language support #2622

srfrog opened this issue Sep 29, 2018 · 0 comments
Assignees
@srfrog
Labels
kind/feature Something completely new we should consider.

Comments

@srfrog
Copy link
Contributor

srfrog commented Sep 29, 2018 •
edited
Loading

Currently the fulltext index has support for a limited set of languages, a partial list of those that bleve can support. This task is to refactor the fulltext index language support to the full list.

Success criteria:

  • Remove snowball dependency, which is creating the limitation.
  • Deprecate the contrib script that generates the stopword dictionaries
  • Add language aliases for languages that share similar stopwords (See add language aliases for broader support. #2602)
  • Update bleve version
  • Add all bleve supported language
  • Update the docs to indicate which languages are supported in fulltext index

Bleve language support can be found here: https://github.com/blevesearch/bleve/tree/master/analysis/lang
@srfrog srfrog added the kind/feature Something completely new we should consider. label Sep 29, 2018
@srfrog srfrog self-assigned this Oct 10, 2018
@srfrog srfrog mentioned this issue Nov 8, 2018
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@srfrog srfrog

Labels
kind/feature Something completely new we should consider.
Milestone
No milestone
Development

No branches or pull requests
1 participant
@srfrog