Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move message fields to match_only_text #1377

Closed
jpountz opened this issue Apr 22, 2021 · 6 comments
Closed

Move message fields to match_only_text #1377

jpountz opened this issue Apr 22, 2021 · 6 comments
Labels
enhancement New feature or request ready Issues we'd like to address in the future.

Comments

@jpountz
Copy link
Contributor

jpountz commented Apr 22, 2021

7.14 is introducing a new field type called match_only_text which is meant as a more space-efficient variant of the text field type. Its only downsides are the following:

  • no support for scoring: queries ignore index statistics and produce constant scores,
  • span queries are unsupported,
  • phrase and intervals queries run slower.

Other than that, this field supports the same feature set as text, and like text it doesn't support aggregations. See https://www.elastic.co/guide/en/elasticsearch/reference/master/text.html#match-only-text-field-type if you would like to know more.

We are in the process of changing our built-in templates in Elasticsearch so that message fields get mapped as match_only_text rather than text. I think we should do the same in ECS as of Elasticsearch 7.14 (when this field gets released)?

Please let me know if there's anything I can do to help.

@jpountz jpountz added the enhancement New feature or request label Apr 22, 2021
@ebeahan
Copy link
Member

ebeahan commented Apr 22, 2021

Thanks, @jpountz! We had been excitedly following the progress of match_only_text to see where we could adopt it once it was ready. 😄

I agree with looking to update message in ECS as well, and I think we may even consider additional fields within ECS where it makes sense.

@djptek
Copy link
Contributor

djptek commented May 4, 2021

@jpountz we'll aim to open an RFC to move this forward, watch this space

@ebeahan
Copy link
Member

ebeahan commented May 5, 2021

Stage 0 RFC PR: #1396

@ebeahan
Copy link
Member

ebeahan commented May 14, 2021

Stage 1 RFC PR: #1415

@kgeller kgeller added the ready Issues we'd like to address in the future. label Jun 1, 2021
@ebeahan
Copy link
Member

ebeahan commented Aug 20, 2021

RFC 0023 is finished and the changes implemented in #1584

@ebeahan ebeahan closed this as completed Aug 20, 2021
@jpountz
Copy link
Contributor Author

jpountz commented Aug 23, 2021

Thank you @ebeahan for moving this forward!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request ready Issues we'd like to address in the future.
Projects
None yet
Development

No branches or pull requests

4 participants