Add query string query to rollups #2405

Naarcha-AWS · 2023-01-13T18:21:54Z

Signed-off-by: Naarcha-AWS [email protected]

Checklist

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and subject to the Developers Certificate of Origin.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Naarcha-AWS <[email protected]>

* Adding Core API doc to doc website repo. Signed-off-by: carolxob <[email protected]> * Made edits based on doc review feedback. Signed-off-by: carolxob <[email protected]> * Update _data-prepper/core-apis.md Co-authored-by: Alice Williams <[email protected]> * Minor edits based on doc review feedback. Signed-off-by: carolxob <[email protected]> * Pushing first set of updates because last ones did not commit. Signed-off-by: carolxob <[email protected]> * Made more changes as part of editorial review. Signed-off-by: carolxob <[email protected]> * Added more editorial feedback edits. Signed-off-by: carolxob <[email protected]> * Pushing more editorial feedback changes. Signed-off-by: carolxob <[email protected]> * Added more editorial feedback changes. Signed-off-by: carolxob <[email protected]> * Added more editorial feedback. Signed-off-by: carolxob <[email protected]> * Made slight changes. Signed-off-by: carolxob <[email protected]> * Picked up a few more changes from editorial. Signed-off-by: carolxob <[email protected]> * Incorporated doc review feedback. Needs a couple of tech questions addressed. Signed-off-by: carolxob <[email protected]> * Minor changes. Signed-off-by: carolxob <[email protected]> * Minor edits. Signed-off-by: carolxob <[email protected]> * Minor edits made from editorial feedback. Signed-off-by: carolxob <[email protected]> * Minor capitalization update. Signed-off-by: carolxob <[email protected]> * Update _data-prepper/core-apis.md * Update _data-prepper/core-apis.md Co-authored-by: Nate Bower <[email protected]> * Made changes based on editorial feedback. Signed-off-by: carolxob <[email protected]> Signed-off-by: carolxob <[email protected]> Co-authored-by: Alice Williams <[email protected]> Co-authored-by: Nate Bower <[email protected]>

* Add Logs to doc website repo. Signed-off-by: carolxob <[email protected]> * Minor copy edits, added one heading. Signed-off-by: carolxob <[email protected]> * Update _data-prepper/logs.md Co-authored-by: Naarcha-AWS <[email protected]> * Minor heading changes. Signed-off-by: carolxob <[email protected]> * Incorporated doc review edits. Signed-off-by: carolxob <[email protected]> * Incorporated technical feedback. Signed-off-by: carolxob <[email protected]> * Minor technical feedback incorporated. Signed-off-by: carolxob <[email protected]> * Minor phrasing change. Signed-off-by: carolxob <[email protected]> * Added comments for editorial. Signed-off-by: carolxob <[email protected]> * Incorporated editorial feedkback changes. Signed-off-by: carolxob <[email protected]> Signed-off-by: carolxob <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>

* fix#2400-yaml-editor-rules Signed-off-by: cwillum <[email protected]> * fix#2400-yaml-editor-rules Signed-off-by: cwillum <[email protected]> * fix#2400-yaml-editor-rules Signed-off-by: cwillum <[email protected]> Signed-off-by: cwillum <[email protected]>

Updates the 2.4 release notes to remove content that was pulled and to remove the note.

* Adds documentation for Admin UI index operations Signed-off-by: ariamarble <[email protected]> * tech review and format changes Signed-off-by: ariamarble <[email protected]> * Update _dashboards/admin-ui-index/index-management.md Co-authored-by: kolchfa-aws <[email protected]> * Update _dashboards/admin-ui-index/index-management.md Co-authored-by: kolchfa-aws <[email protected]> * Update _dashboards/admin-ui-index/index-management.md Co-authored-by: kolchfa-aws <[email protected]> * Update _dashboards/admin-ui-index/index-management.md Co-authored-by: kolchfa-aws <[email protected]> * Update _dashboards/admin-ui-index/index-management.md Co-authored-by: kolchfa-aws <[email protected]> * Update _dashboards/admin-ui-index/index-management.md Co-authored-by: kolchfa-aws <[email protected]> * Update _dashboards/admin-ui-index/index-management.md Co-authored-by: kolchfa-aws <[email protected]> * Update _dashboards/admin-ui-index/index-management.md Co-authored-by: kolchfa-aws <[email protected]> * Apply suggestions from code review Co-authored-by: kolchfa-aws <[email protected]> * initial doc review changes Signed-off-by: ariamarble <[email protected]> * further doc review changes Signed-off-by: ariamarble <[email protected]> * consolidate snapshots Signed-off-by: ariamarble <[email protected]> * Doc Review 2 Electric Boogaloo Signed-off-by: ariamarble <[email protected]> Signed-off-by: ariamarble <[email protected]> Co-authored-by: kolchfa-aws <[email protected]>

kolchfa-aws · 2023-01-17T15:58:57Z

_im-plugin/index-rollups/index.md

@@ -9,7 +9,7 @@ has_toc: false

 # Index rollups

-Time series data increases storage costs, strains cluster health, and slows down aggregations over time. Index rollup lets you periodically reduce data granularity by rolling up old data into summarized indices.
+Time series data increases storage costs, strains cluster health, and slows down aggregations over time. Index rollup lets you periodically reduce data granularity by rolling up old data into summarized indexes.


Would it be better to break out the indexes vs indices update in a different PR so we can backport it to earlier versions?

You're right. I'll switch it back

kolchfa-aws · 2023-01-17T16:01:32Z

_im-plugin/index-rollups/index.md


-When data is rolled up into multiple target indices, you can run one search across all of the rollup indices. To search multiple target indices that have the same rollup, specify the index names as a comma-separated list or a wildcard pattern. For example, with `target_index` as <span style="white-space: nowrap">`{% raw %}rollup_ndx-{{ctx.source_index}}{% endraw %}`</span> and source indices that start with `log`, specify the `rollup_ndx-log*` pattern. Or, to search for rolled up log-000001 and log-000002 indices, specify the `rollup_ndx-log-000001,rollup_ndx-log-000002` list.
+To take advantage of shorter and easier to write strings in Query DSL, you can use [query strings]({{site.url}}{{site.baseurl}}/opensearch/query-dsl/full-text/#query-string) to simplify search queries in rollup indexes. To use query strings, add the following fields to your rollup search request.


Could we have a full example here with the HTTP method and concrete field names and field values?

Adding that now.

kolchfa-aws · 2023-01-17T16:18:43Z

_im-plugin/index-rollups/index.md

+  }
+```
+
+For more information on what fields are supported in query strings, see [Advanced filter options]({{site.url}}{{site.baseurl}}/opensearch/query-dsl/full-text/#advanced-filter-options/).


Unfortunately, we don't yet have a doc page for query_string query. And the parameter list in Advanced filter options is not 1:1. For example, query_string query does not support low_freq_operator. I don't know what the best way of dealing with this is: probably prioritize query_string query documentation and then link it here?

I'll go ahead and add it since I have a couple more days. For now, we could add a warning.

Signed-off-by: Fanit Kolchina <[email protected]> Signed-off-by: Fanit Kolchina <[email protected]>

* for new page how to analyze Jaeger trace data Signed-off-by: alicejw <[email protected]> * remove old image Signed-off-by: alicejw <[email protected]> * for new information and doc writer checklist Signed-off-by: alicejw <[email protected]> * for new information and doc writer checklist Signed-off-by: alicejw <[email protected]> * small rewrite Signed-off-by: alicejw <[email protected]> * new clean images from Dashboards URL directly Signed-off-by: alicejw <[email protected]> * for additional information Signed-off-by: alicejw <[email protected]> * remove blank lines Signed-off-by: alicejw <[email protected]> * for tech review feedback updates Signed-off-by: alicejw <[email protected]> * add requirements section Signed-off-by: alicejw <[email protected]> * for new procedure Signed-off-by: alicejw <[email protected]> * for tech review feedback updates Signed-off-by: alicejw <[email protected]> * continued updates Signed-off-by: alicejw <[email protected]> * for docker compose file instructions Signed-off-by: alicejw <[email protected]> * for docker usage instruction Signed-off-by: alicejw <[email protected]> * for step 2 view dashboards Signed-off-by: alicejw <[email protected]> * for additional link provided in tech review Signed-off-by: alicejw <[email protected]> * for link to index page to introduce the feature Signed-off-by: alicejw <[email protected]> * final checklist Signed-off-by: alicejw <[email protected]> * add warning not to use sample file in prod env Signed-off-by: alicejw <[email protected]> * updated docker file that is safe for prod env, remove warning note for previous file Signed-off-by: alicejw <[email protected]> * for small update to parent page Signed-off-by: alicejw <[email protected]> * for tech review Signed-off-by: alicejw <[email protected]> * typo fix for font Signed-off-by: alicejw <[email protected]> * for doc review #1 feedback updates Signed-off-by: alicejw <[email protected]> * for doc review feedback #2 updates Signed-off-by: alicejw <[email protected]> * for a couple minor changes Signed-off-by: alicejw <[email protected]> * spell out dashboard URI directly to trace analytics for accessibility. With URL obfuscated, this would not get spelled out in the vision-impaired app that scans through.it would simply read the title only Signed-off-by: alicejw <[email protected]> * need to add additional step from eng to generate sample data Signed-off-by: alicejw <[email protected]> * for additional step image of sample app Signed-off-by: alicejw <[email protected]> * rename step numbers Signed-off-by: alicejw <[email protected]> * minor fix heading levels Signed-off-by: alicejw <[email protected]> * updates recommended by the editorial reviewer Signed-off-by: alicejw <[email protected]> * clarify Spans window function Signed-off-by: alicejw <[email protected]> * clarified individual trace details section Signed-off-by: alicejw <[email protected]> Signed-off-by: alicejw <[email protected]>

* Adds maps documentation Signed-off-by: Fanit Kolchina <[email protected]> * Rewrites Signed-off-by: Fanit Kolchina <[email protected]> * Changed entry point for maps Signed-off-by: Fanit Kolchina <[email protected]> * Incorporated tech review comments Signed-off-by: Fanit Kolchina <[email protected]> * More tech review comments Signed-off-by: Fanit Kolchina <[email protected]> * Adds steps to install sample data Signed-off-by: Fanit Kolchina <[email protected]> * Minor edit Signed-off-by: Fanit Kolchina <[email protected]> * Incorporated doc review comments Signed-off-by: Fanit Kolchina <[email protected]> * Incorporated editorial comments Signed-off-by: Fanit Kolchina <[email protected]> * Updated the add layer dialog Signed-off-by: Fanit Kolchina <[email protected]> * Simplified adding sample dataset Signed-off-by: Fanit Kolchina <[email protected]> * Minor change Signed-off-by: Fanit Kolchina <[email protected]> * Added new images Signed-off-by: Fanit Kolchina <[email protected]> Signed-off-by: Fanit Kolchina <[email protected]>

* fix#2400-revisions-to-current Signed-off-by: cwillum <[email protected]> * fix#2400-SecAnalytics-updates Signed-off-by: cwillum <[email protected]> * fix#2400-SecAnalytics-updates Signed-off-by: cwillum <[email protected]> * fix#2400-SecAnalytics-updates Signed-off-by: cwillum <[email protected]> * fix#2400-SecAnalytics-updates Signed-off-by: cwillum <[email protected]> Signed-off-by: cwillum <[email protected]>

Signed-off-by: Naarcha-AWS <[email protected]>

Signed-off-by: Fanit Kolchina <[email protected]>

…oject/documentation-website into query-string-query

Add query string query to rollups

ad74eea

Signed-off-by: Naarcha-AWS <[email protected]>

Naarcha-AWS added 3 - Tech review PR: Tech review in progress v2.5.0 'Issues and PRs related to version v2.5.0' labels Jan 13, 2023

Naarcha-AWS requested a review from a team as a code owner January 13, 2023 18:21

hdhalter added the release-notes PR: Include this PR in the automated release notes label Jan 13, 2023

carolxob and others added 2 commits January 13, 2023 13:52

hdhalter assigned Naarcha-AWS Jan 13, 2023

cwillum and others added 3 commits January 13, 2023 17:24

Update opensearch-documentation-release-notes-2.4.0.md (#2406)

ac98ef5

Updates the 2.4 release notes to remove content that was pulled and to remove the note.

kolchfa-aws reviewed Jan 17, 2023

View reviewed changes

kolchfa-aws and others added 8 commits January 17, 2023 12:08

Fixes allow_partial_pit_creation (#2411)

32767eb

Signed-off-by: Fanit Kolchina <[email protected]> Signed-off-by: Fanit Kolchina <[email protected]>

Adds border to images (#2415)

515b66b

Signed-off-by: Fanit Kolchina <[email protected]> Signed-off-by: Fanit Kolchina <[email protected]>

Add example with method and path

2e72478

Signed-off-by: Naarcha-AWS <[email protected]>

Adds query string query documentation

fe3534f

Signed-off-by: Fanit Kolchina <[email protected]>

Merge branch 'query-string-query' of https://github.com/opensearch-pr…

91ffd00

…oject/documentation-website into query-string-query

kolchfa-aws closed this Jan 19, 2023

kolchfa-aws deleted the query-string-query branch January 19, 2023 13:56

kolchfa-aws restored the query-string-query branch January 19, 2023 15:58

Naarcha-AWS deleted the query-string-query branch March 28, 2024 23:24

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add query string query to rollups #2405

Add query string query to rollups #2405

Naarcha-AWS commented Jan 13, 2023

kolchfa-aws Jan 17, 2023

Naarcha-AWS Jan 18, 2023

kolchfa-aws Jan 17, 2023

Naarcha-AWS Jan 18, 2023

kolchfa-aws Jan 17, 2023

Naarcha-AWS Jan 17, 2023


		When data is rolled up into multiple target indices, you can run one search across all of the rollup indices. To search multiple target indices that have the same rollup, specify the index names as a comma-separated list or a wildcard pattern. For example, with `target_index` as <span style="white-space: nowrap">`{% raw %}rollup_ndx-{{ctx.source_index}}{% endraw %}`</span> and source indices that start with `log`, specify the `rollup_ndx-log*` pattern. Or, to search for rolled up log-000001 and log-000002 indices, specify the `rollup_ndx-log-000001,rollup_ndx-log-000002` list.
		To take advantage of shorter and easier to write strings in Query DSL, you can use [query strings]({{site.url}}{{site.baseurl}}/opensearch/query-dsl/full-text/#query-string) to simplify search queries in rollup indexes. To use query strings, add the following fields to your rollup search request.

Add query string query to rollups #2405

Add query string query to rollups #2405

Conversation

Naarcha-AWS commented Jan 13, 2023

Checklist

kolchfa-aws Jan 17, 2023

Choose a reason for hiding this comment

Naarcha-AWS Jan 18, 2023

Choose a reason for hiding this comment

kolchfa-aws Jan 17, 2023

Choose a reason for hiding this comment

Naarcha-AWS Jan 18, 2023

Choose a reason for hiding this comment

kolchfa-aws Jan 17, 2023

Choose a reason for hiding this comment

Naarcha-AWS Jan 17, 2023

Choose a reason for hiding this comment