Auto expand replicas #539

lezzago · 2023-09-06T17:41:17Z

Description

Auto expand replicas so for single node clusters, it wouldn't try to create a replica and cause the cluster to be yellow

Issues Resolved

N/A

Check List

New functionality includes testing.
- All tests pass
New functionality has been documented.
- New functionality has javadoc added
Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Ashish Agrawal <[email protected]>

eirsep · 2023-09-06T17:44:39Z

src/main/java/org/opensearch/securityanalytics/util/RuleIndices.java

@@ -99,9 +101,13 @@ public static String ruleMappings() throws IOException {

    public void initRuleIndex(ActionListener<CreateIndexResponse> actionListener, boolean isPrepackaged) throws IOException {
        if (!ruleIndexExists(isPrepackaged)) {
+            Settings indexSettings = Settings.builder()
+                    .put("index.hidden", true)
+                    .put("index.auto_expand_replicas", "0-all")


was this a miss?

have we already added this setting this for other system indices in SAP?

These indices are auto generated, so it would cause single node clusters starting up to immediately be in a yellow state even if they do not use the plugin.

codecov · 2023-09-06T17:49:04Z

Codecov Report

Merging #539 (c06e818) into main (5178cc0) will decrease coverage by 0.01%.
The diff coverage is 0.00%.

@@             Coverage Diff              @@
##               main     #539      +/-   ##
============================================
- Coverage     25.77%   25.76%   -0.01%     
  Complexity      942      942              
============================================
  Files           252      252              
  Lines         10768    10772       +4     
  Branches       1197     1197              
============================================
  Hits           2775     2775              
- Misses         7746     7750       +4     
  Partials        247      247

Files Changed	Coverage Δ
...opensearch/securityanalytics/util/RuleIndices.java	`0.00% <0.00%> (ø)`

Signed-off-by: Ashish Agrawal <[email protected]> (cherry picked from commit 1003936)

* auto expand replicas (#539) Signed-off-by: Ashish Agrawal <[email protected]> (cherry picked from commit 1003936) * Remove extra import Signed-off-by: Ashish Agrawal <[email protected]> --------- Signed-off-by: Ashish Agrawal <[email protected]> Co-authored-by: Ashish Agrawal <[email protected]> Co-authored-by: Ashish Agrawal <[email protected]>

* auto expand replicas (#539) Signed-off-by: Ashish Agrawal <[email protected]>

* Correlation engine ux (opensearch-project#524) * wip Signed-off-by: Amardeepsingh Siglani <[email protected]> * completed rules page; added placeholder for findings flyout tabs Signed-off-by: Amardeepsingh Siglani <[email protected]> * reverted change to show empty table Signed-off-by: Amardeepsingh Siglani <[email protected]> * updated rule type Signed-off-by: Amardeepsingh Siglani <[email protected]> * updated create correlation rule page Signed-off-by: Amardeepsingh Siglani <[email protected]> * correlation page wip Signed-off-by: Amardeepsingh Siglani <[email protected]> * Correlation store and API services Signed-off-by: Jovan Cvetkovic <[email protected]> * Correlation store and API services Signed-off-by: Jovan Cvetkovic <[email protected]> * Correlation store and API services Signed-off-by: Jovan Cvetkovic <[email protected]> * Correlation store and API services Signed-off-by: Jovan Cvetkovic <[email protected]> * Correlation store and API services Signed-off-by: Jovan Cvetkovic <[email protected]> * updated correlations page Signed-off-by: Amardeepsingh Siglani <[email protected]> * updated store interfaces Signed-off-by: Amardeepsingh Siglani <[email protected]> * fixed correlation store Signed-off-by: Amardeepsingh Siglani <[email protected]> * added api for all correlations Signed-off-by: Amardeepsingh Siglani <[email protected]> * added filter support for correlations Signed-off-by: Amardeepsingh Siglani <[email protected]> * using apis; added validation Signed-off-by: Amardeepsingh Siglani <[email protected]> * Implemented logic to populate correlations tables data. Signed-off-by: AWSHurneyt <[email protected]> * restricted to AND Signed-off-by: Amardeepsingh Siglani <[email protected]> * log type clearable Signed-off-by: Amardeepsingh Siglani <[email protected]> * code cleanup Signed-off-by: Jovan Cvetkovic <[email protected]> * fixed API issue Signed-off-by: Amardeepsingh Siglani <[email protected]> * updated snapshots Signed-off-by: Amardeepsingh Siglani <[email protected]> * ux improvements Signed-off-by: Amardeepsingh Siglani <[email protected]> * code cleanup Signed-off-by: Jovan Cvetkovic <[email protected]> * removed redundant code Signed-off-by: Amardeepsingh Siglani <[email protected]> * removed unwanted param Signed-off-by: Amardeepsingh Siglani <[email protected]> * connected refresh Signed-off-by: Amardeepsingh Siglani <[email protected]> --------- Signed-off-by: Amardeepsingh Siglani <[email protected]> Signed-off-by: Jovan Cvetkovic <[email protected]> Signed-off-by: AWSHurneyt <[email protected]> Co-authored-by: Jovan Cvetkovic <[email protected]> Co-authored-by: AWSHurneyt <[email protected]> (cherry picked from commit f565a923c6bfec1b8a69128d21e5d823a50cb142) * Removed duplicate import for EuiSpacer (opensearch-project#538) (opensearch-project#540) * removed duplicate import * updated snapshots --------- Signed-off-by: Amardeepsingh Siglani <[email protected]> * Pinned babel traverse and core (opensearch-project#539) (opensearch-project#544) * pinned babel traverse and core * removed cyclic dependency * added types for vis * refactored code --------- Signed-off-by: Amardeepsingh Siglani <[email protected]> --------- Signed-off-by: Amardeepsingh Siglani <[email protected]> Co-authored-by: Amardeepsingh Siglani <[email protected]>

auto expand replicas

c06e818

Signed-off-by: Ashish Agrawal <[email protected]>

lezzago requested review from amsiglan, AWSHurneyt, getsaurabh02, praveensameneni, sbcd90 and eirsep as code owners September 6, 2023 17:41

lezzago added backport 2.x backport 2.4 backport 2.5 backport 2.6 backport 2.7 backport 2.8 backport 2.9 backports to 2.9 labels Sep 6, 2023

eirsep reviewed Sep 6, 2023

View reviewed changes

eirsep approved these changes Sep 7, 2023

View reviewed changes

sbcd90 approved these changes Sep 7, 2023

View reviewed changes

sbcd90 merged commit 1003936 into opensearch-project:main Sep 7, 2023

opensearch-trigger-bot bot pushed a commit that referenced this pull request Sep 7, 2023

auto expand replicas (#539)

890d2d9

Signed-off-by: Ashish Agrawal <[email protected]> (cherry picked from commit 1003936)

opensearch-trigger-bot bot mentioned this pull request Sep 7, 2023

[Backport 2.x] Auto expand replicas #547

Merged

opensearch-trigger-bot bot pushed a commit that referenced this pull request Sep 7, 2023

auto expand replicas (#539)

890703c

Signed-off-by: Ashish Agrawal <[email protected]> (cherry picked from commit 1003936)

This was referenced Sep 7, 2023

[Backport 2.4] Auto expand replicas #548

Merged

[Backport 2.5] Auto expand replicas #549

Merged

opensearch-trigger-bot bot pushed a commit that referenced this pull request Sep 7, 2023

auto expand replicas (#539)

21f0b9c

Signed-off-by: Ashish Agrawal <[email protected]> (cherry picked from commit 1003936)

opensearch-trigger-bot bot pushed a commit that referenced this pull request Sep 7, 2023

auto expand replicas (#539)

d898536

Signed-off-by: Ashish Agrawal <[email protected]> (cherry picked from commit 1003936)

opensearch-trigger-bot bot mentioned this pull request Sep 7, 2023

[Backport 2.6] Auto expand replicas #550

Merged

opensearch-trigger-bot bot pushed a commit that referenced this pull request Sep 7, 2023

auto expand replicas (#539)

20de2b9

Signed-off-by: Ashish Agrawal <[email protected]> (cherry picked from commit 1003936)

opensearch-trigger-bot bot mentioned this pull request Sep 7, 2023

[Backport 2.7] Auto expand replicas #551

Merged

opensearch-trigger-bot bot pushed a commit that referenced this pull request Sep 7, 2023

auto expand replicas (#539)

185a81e

Signed-off-by: Ashish Agrawal <[email protected]> (cherry picked from commit 1003936)

opensearch-trigger-bot bot mentioned this pull request Sep 7, 2023

[Backport 2.8] Auto expand replicas #552

Merged

opensearch-trigger-bot bot pushed a commit that referenced this pull request Sep 7, 2023

auto expand replicas (#539)

5ceb374

Signed-off-by: Ashish Agrawal <[email protected]> (cherry picked from commit 1003936)

opensearch-trigger-bot bot mentioned this pull request Sep 7, 2023

[Backport 2.9] Auto expand replicas #553

Merged

lezzago added the backport 2.10 label Sep 7, 2023

opensearch-trigger-bot bot pushed a commit that referenced this pull request Sep 7, 2023

auto expand replicas (#539)

f4dfe0e

Signed-off-by: Ashish Agrawal <[email protected]> (cherry picked from commit 1003936)

opensearch-trigger-bot bot mentioned this pull request Sep 7, 2023

[Backport 2.10] Auto expand replicas #554

Merged

sbcd90 pushed a commit that referenced this pull request Sep 13, 2023

[Backport 2.7] Auto expand replicas (#551)

cd23067

* auto expand replicas (#539) Signed-off-by: Ashish Agrawal <[email protected]>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Auto expand replicas #539

Auto expand replicas #539

lezzago commented Sep 6, 2023

eirsep Sep 6, 2023 •

edited

Loading

lezzago Sep 7, 2023

codecov bot commented Sep 6, 2023 •

edited

Loading

Auto expand replicas #539

Auto expand replicas #539

Conversation

lezzago commented Sep 6, 2023

Description

Issues Resolved

Check List

eirsep Sep 6, 2023 • edited Loading

Choose a reason for hiding this comment

lezzago Sep 7, 2023

Choose a reason for hiding this comment

codecov bot commented Sep 6, 2023 • edited Loading

Codecov Report

eirsep Sep 6, 2023 •

edited

Loading

codecov bot commented Sep 6, 2023 •

edited

Loading