Add micro-benchmark module in k-NN plugin for benchmark streaming vectors to JNI layer functionality.

[navneet1v]

Description

Add micro-benchmark module in k-NN plugin for benchmark streaming vectors to JNI layer functionality.

This is first of many PR that will be raised for Issue: #1506.

The benchmark results that will be used in #1506 will come from this change. Hence adding it upfront.

Along with this change I am adding a new interface in JNILayer: transferVectorsV2, which is actually getting benchmarked. This interface is experimental and will changed once I start the feature development. Right now I have marked the interface as experimental.

What is micro-benchmarks? and how it is useful?

Micro-benchmark is a new module which is getting added in k-NN plugin that will host some client code to run the performance benchmarks. This module will help us do the benchmarking of a specific internal piece of code/functions/feature of k-NN plugin without setting up the whole cluster. Internally the module uses JMH as the benchmarking platform.

Results

./gradlew -p micro-benchmarks run --args ' -gc true ' -Djvm.heap.size=16g

Benchmark	(dimension)	(vectorsPerTransfer)	Mode	Cnt	Score	Units
TransferVectorsBenchmarks.transferVectors	128	100000	ss	3	1.904	s/op
TransferVectorsBenchmarks.transferVectors	128	500000	ss	3	1.589	s/op
TransferVectorsBenchmarks.transferVectors	128	1000000	ss	3	1.443	s/op
TransferVectorsBenchmarks.transferVectors	256	100000	ss	3	3.986	s/op
TransferVectorsBenchmarks.transferVectors	256	500000	ss	3	3.234	s/op
TransferVectorsBenchmarks.transferVectors	256	1000000	ss	3	2.863	s/op
TransferVectorsBenchmarks.transferVectors	384	100000	ss	3	6.306	s/op
TransferVectorsBenchmarks.transferVectors	384	500000	ss	3	4.953	s/op
TransferVectorsBenchmarks.transferVectors	384	1000000	ss	3	4.478	s/op
TransferVectorsBenchmarks.transferVectors	512	100000	ss	3	7.74	s/op
TransferVectorsBenchmarks.transferVectors	512	500000	ss	3	6.063	s/op
TransferVectorsBenchmarks.transferVectors	512	1000000	ss	3	5.338	s/op

Issues Resolved

NA

Check List

• New functionality includes testing.
  • All tests pass
• New functionality has been documented.
  • New functionality has javadoc added
• Commits are signed as per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[codecov]

Codecov Report

Attention: Patch coverage is 37.50000% with 5 lines in your changes are missing coverage. Please review.

Project coverage is 84.87%. Comparing base (c861966) to head (622ea16).

Files	Patch %	Lines
...ain/java/org/opensearch/knn/index/KNNSettings.java	42.85%	4 Missing ⚠️
...c/main/java/org/opensearch/knn/jni/JNIService.java	0.00%	1 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##               main    #1583      +/-   ##
============================================
- Coverage     84.96%   84.87%   -0.10%     
+ Complexity     1366     1365       -1     
============================================
  Files           172      172              
  Lines          5566     5572       +6     
  Branches        546      546              
============================================
  Hits           4729     4729              
- Misses          605      610       +5     
- Partials        232      233       +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[jmazanec15]

LGTM thanks!