[Backport 1.x] Adding clear cache test step #346
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…ate-nmslib ENH: upgrade external library nmslib to latest
* synced from master * add performance tuning doc * incorporated comments
* odfe 1.10 version support * incorporated comments
…gments (opensearch-project#212) * force merge NPE when non knn doc updated to knn doc
Signed-off-by: John Mazanec <[email protected]>
Signed-off-by: Martin Gaievski <[email protected]>
Signed-off-by: John Mazanec <[email protected]>
Signed-off-by: John Mazanec <[email protected]>
Co-authored-by: whitesource-for-github.aaakk.us.kg[bot] <50673670+whitesource-for-github.aaakk.us.kg[bot]@users.noreply.github.com>
…ject#256) Signed-off-by: John Mazanec <[email protected]>
…lection of floats (opensearch-project#253) * Changing serialization for knn vector from single array object to collection of floats rev2: * Addressing PR comments: - added getDefaultSerializer to Factory - moved SerializationMode enum to a separate file - added javadocs and comments - adjust format, added missing endline characters rev3: * Addressing multiple review comments: - replace Vector by KNNVector in class names and variables - fixed method names in Serializer interface - replace number of bytes in float from number to constant rev4: * Moving new classes under index.codec.util rev5: * Addressing multiple review comments: - rework factory method getSerializerByStreamContent - added test case for stream of unsupported content - removed exceptions from Serializer interface method's signatures, changed it to unchecked runtime exception - simplify license header in new classes Signed-off-by: Martin Gaievski <[email protected]>
…ject#261) Signed-off-by: Martin Gaievski <[email protected]>
Signed-off-by: Martin Gaievski <[email protected]>
* Add Recall Tests Signed-off-by: Naveen Tatikonda <[email protected]> * Calculate Recall using document ids and other minor changes Signed-off-by: Naveen Tatikonda <[email protected]>
Signed-off-by: Martin Gaievski <[email protected]>
…pensearch-project#265) Signed-off-by: John Mazanec <[email protected]>
…rch-project#266) * Adding gradle task for running integ tests in remote cluster Signed-off-by: Martin Gaievski <[email protected]>
This change adds L2 space type fall back during query. This prevents backwards compatibility issues for clusters upgrading from ES 7.1 and 7.4. In those versions, space type was not introduced as a field attribute yet. Signed-off-by: John Mazanec <[email protected]>
…#268) Measuring total took time will give a better picture of how long it will take to make a particular set of documents searchable. Signed-off-by: John Mazanec <[email protected]>
…t#270) Makes the document and query count configurable in the benchmarking tool. With this functionality, users can now specify to only index or search a subset of the vectors in the data set. This is useful for indices that require training that may only need a subset of the data set for training. Signed-off-by: John Mazanec <[email protected]>
Adding JDK 11 to CI matrix of java versions, replacing as minimum prerequisite in Dev readme guide. Main reason for change - JDK 11 is the latest supported LTS. Signed-off-by: Martin Gaievski <[email protected]>
Removes collecting ingest results from the benchmarking tool. On big data sets, this will prevent the process from going out of memory. Signed-off-by: John Mazanec <[email protected]>
…pensearch-project#279) Sets the default value of space type to L2 in KNNIndexShard. KNNIndexShard is used during warmup to load segments into memory. For indices created in ES 7.1 and 7.4, they will not have this value set because the only space we supported was l2. So, we need to hardcode the defaults here. For nmslib, the ef_search parameter is configurable at load time. So, it needs to be passed as a parameter in both the search load phase as well as warmup. This commit adds it to the warmup phase and abstracts load parameters to a helper function so that it can be consistent for both search and warmup. Signed-off-by: John Mazanec <[email protected]> (cherry picked from commit 2fb2ad1)
… (opensearch-project#286) Closes resource monitor at the end of the Codec tests so that there are no unparked threads. Signed-off-by: John Mazanec <[email protected]> (cherry picked from commit 18e6e35)
Github doesn't support non-standard like @daily, we have to use standard cron syntax. Signed-off-by: Vijayan Balasubramanian <[email protected]> (cherry picked from commit 9c64451)
…#289) (opensearch-project#291) Signed-off-by: Vacha Shah <[email protected]> (cherry picked from commit cb1a7d8)
…earch-project#295) Updates direct Guava dependency to 30.0. Also, updates check style to 9.3 to inherent Guava fix. Remove deprecated features from check style xml config file. Signed-off-by: John Mazanec <[email protected]>
…-project#298) Switches checkstyle functionality to spotless. Sets ratchetFrom to origin/1.x. This will mean it will only fail on files recently changed. Pull formatting from OpenSearch. Signed-off-by: John Mazanec <[email protected]> (cherry picked from commit 0db9b2e)
Signed-off-by: Martin Gaievski <[email protected]>
Signed-off-by: Martin Gaievski <[email protected]>
…ject#310) Fixes getEnginePaths in KNNIndexShard to retrieve all engine paths, regardless of what version the index was created. Prevents silent failure when warmup completes but doesnt load any segments. Signed-off-by: John Mazanec <[email protected]>
…oject#317) Signed-off-by: Naveen Tatikonda <[email protected]> (cherry picked from commit f24c6b4) Co-authored-by: Naveen Tatikonda <[email protected]>
Signed-off-by: Martin Gaievski <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Backporting #339 to 1.x
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.