Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Extensions] Add all fields of LockModel to RestGetLockAction response #342

Merged
merged 10 commits into from
Mar 10, 2023
Merged

[Extensions] Add all fields of LockModel to RestGetLockAction response #342

merged 10 commits into from
Mar 10, 2023

Conversation

joshpalis
Copy link
Member

Modifies the RestGetLockAction response to include all fields of the lock model object, rather than the lock model object itself

Check List

  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

…lock model object, rather than the lock model object itself

Signed-off-by: Joshua Palis <[email protected]>
@joshpalis joshpalis requested a review from a team March 8, 2023 23:32
Signed-off-by: Joshua Palis <[email protected]>
Signed-off-by: Joshua Palis <[email protected]>
@codecov-commenter
Copy link

codecov-commenter commented Mar 8, 2023

Codecov Report

Merging #342 (e8085c5) into main (90d25f0) will decrease coverage by 1.12%.
The diff coverage is 0.00%.

📣 This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more

@@             Coverage Diff              @@
##               main     #342      +/-   ##
============================================
- Coverage     30.23%   29.12%   -1.12%     
  Complexity       97       97              
============================================
  Files            22       23       +1     
  Lines          1128     1171      +43     
  Branches        107      109       +2     
============================================
  Hits            341      341              
- Misses          766      809      +43     
  Partials         21       21              
Impacted Files Coverage Δ
...ch/jobscheduler/rest/action/RestGetLockAction.java 38.77% <0.00%> (+2.92%) ⬆️
...rch/jobscheduler/transport/AcquireLockRequest.java 54.76% <0.00%> (-9.13%) ⬇️
...ch/jobscheduler/transport/AcquireLockResponse.java 0.00% <0.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

dbwiddis
dbwiddis previously approved these changes Mar 9, 2023
@saratvemulapalli
Copy link
Member

Adding a test would be nice!

@joshpalis
Copy link
Member Author

@saratvemulapalli sure I can modify the multinode integration test for the acquire lock rest api to check all the fields instead of just the lock ID

…that all response fields are populated

Signed-off-by: Joshua Palis <[email protected]>
@joshpalis joshpalis dismissed stale reviews from saratvemulapalli and dbwiddis via 534f976 March 9, 2023 20:11
dbwiddis
dbwiddis previously approved these changes Mar 9, 2023
@dbwiddis dbwiddis merged commit 4649c3d into opensearch-project:main Mar 10, 2023
vibrantvarun added a commit that referenced this pull request May 10, 2023
…#382)

* Communication mechanism for js (#289)

* Job Details from Extension for JS

Signed-off-by: Varun Jain <[email protected]>

* Communication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Communication mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Communication mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Communication mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Communication mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Commnunication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Commnunication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Commnunication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Commnunication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Commnunication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Commnunication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Communication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Communication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Communication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Communication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Communication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Communication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Communication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Communication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Communication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Communication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Communication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Communication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Communication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

* Communication Mechanism for JS

Signed-off-by: Varun Jain <[email protected]>

Signed-off-by: Varun Jain <[email protected]>

* [Extensions] Synchronize opensearch-plugin-job-details with JobDetailsService map (#299)

* Added JobDetailsService as an indexOperationListener to synchronize metadata index with internal job details m and indicesToListen set.

Signed-off-by: Joshua Palis <[email protected]>

* Changes indexToJobDetails to a ConcurrentMap, adds getter method for indexToJobDetails

Signed-off-by: Joshua Palis <[email protected]>

* Addressing PR comments, fixing log message

Signed-off-by: Joshua Palis <[email protected]>

* Addressing PR comments

Signed-off-by: Joshua Palis <[email protected]>

* Added test to updateIndexToJobDetails

Signed-off-by: Joshua Palis <[email protected]>

* Addressing PR comments, changing extensionId to extensionUniqueId

Signed-off-by: Joshua Palis <[email protected]>

* Addressing PR Comments : Updating Job Details index Name and mapping file to opensearch-job-scheduler-job-details

Signed-off-by: Joshua Palis <[email protected]>

* Addressing PR comments, enabling extensions to submit more than 1 job details entry to support extensions registering multiple types of jobs, updated all integration, multinode tests now that the rest response value is the document Id

Signed-off-by: Joshua Palis <[email protected]>

* Renaming TestHelper base URI name

Signed-off-by: Joshua Palis <[email protected]>

* Addressing PR comments, made multinode test request strings constant

Signed-off-by: Joshua Palis <[email protected]>

Signed-off-by: Joshua Palis <[email protected]>

* [Extensions] Create a proxy ScheduledJobRunner, ScheduledJobParser to invoke corresponding registered Job Detail actions (#306)

* Draft : Added JobParameterRequest to translate ScheduledJobParser parameters nto compatible inputs for the ExtensionActionRequest. Completed initial proxy scheduled job parser implementation. Added ExtensionJobParameter class to deserialize ExtensionActionResponsebyte array into an object of type ScheduledJobParameter

Signed-off-by: Joshua Palis <[email protected]>

* Added JobRunnerRequest, modified JobExecutionContext to implement writeable, created initial proxy ScheduledJobRunner, fixed failing tests

Signed-off-by: Joshua Palis <[email protected]>

* Added generic ExtensionJobActionRequest that extends ExtensionActionRequest, modified JobParameter/Runner request to implement writeable, refactored proxy object creation so that the requests are added to the ExtensionJobActionRequest, which in turn upcasts the request into an ExtensionActionRequest

Signed-off-by: Joshua Palis <[email protected]>

* Added byte array constructors for the JobRunner/Parameter requests, added javadocs

Signed-off-by: Joshua Palis <[email protected]>

* Fixing javadocs

Signed-off-by: Joshua Palis <[email protected]>

* Fixing javadocs

Signed-off-by: Joshua Palis <[email protected]>

* Added placeholder string for an eventual access token to be sent to extensions to validate prior to invoking an action

Signed-off-by: Joshua Palis <[email protected]>

* Added ExtensionJobActionResponse, JobParameterResponse, JobRunnerResponse to facilitate the response of extension actions

Signed-off-by: Joshua Palis <[email protected]>

* Fixing javadocs

Signed-off-by: Joshua Palis <[email protected]>

* Added JobRunnerResponse handling

Signed-off-by: Joshua Palis <[email protected]>

* Separating updateIndexToJobProviders into separate methods

Signed-off-by: Joshua Palis <[email protected]>

* Fixing javadocs

Signed-off-by: Joshua Palis <[email protected]>

* SpotlessApply

Signed-off-by: Joshua Palis <[email protected]>

* Addressing PR comments

Signed-off-by: Joshua Palis <[email protected]>

* Added tests for serialization/deserialization of JobExecutionContext, JobDocVersion, ExtensionJobParameter, ExtensionJobActionRequest, ExtensionJobActionResponse, JobRunner/JobParameter/Request/Response

Signed-off-by: Joshua Palis <[email protected]>

* Writing ExtensionActionRequest/Response to bytestream output to test deserialization

Signed-off-by: Joshua Palis <[email protected]>

* Fixing imports

Signed-off-by: Joshua Palis <[email protected]>

* Changing to extensionActionResponse constructor

Signed-off-by: Joshua Palis <[email protected]>

* Adding tests for updateIndexToJobProviders

Signed-off-by: Joshua Palis <[email protected]>

* Addressing PR comments, added getters for lock duration seconds and jitter values, added javadocs to ScheduleType enum and made this public

Signed-off-by: Joshua Palis <[email protected]>

* Removing Strings dependency from lock model to fix BWC tests

Signed-off-by: Joshua Palis <[email protected]>

* Fixes BWC fullRestartClusterTask, rollingUpgradeClusterTask, oldVersionCluster task. mixedClusterTask is still failing

Signed-off-by: Joshua Palis <[email protected]>

* Modified createProxyScheduledJobRunner to return the document Id of the extension job parameter entry within the registered job index, modifed the ExtensionJobParameter to null check the jitter value and setting this to 0.0 if null

Signed-off-by: Joshua Palis <[email protected]>

---------

Signed-off-by: Joshua Palis <[email protected]>

* [Extensions] Exposes a GetLock REST API to enable extensions to acquire a lock model for their job execution (#311)

* Added RestGetLockAction API, added AcquireLockRequest, enables extensions to retrieve a lock model object to run their Job

Signed-off-by: Joshua Palis <[email protected]>

* Adding Lock ID field to RestGetLockAction response

Signed-off-by: Joshua Palis <[email protected]>

* Added multi node integration tests for GetLockApi

Signed-off-by: Joshua Palis <[email protected]>

* Making lock service in RestGetLockAction private

Signed-off-by: Joshua Palis <[email protected]>

* Added Rest integration tests for RestGetLockAction

Signed-off-by: Joshua Palis <[email protected]>

* Addressing PR comments

Signed-off-by: Joshua Palis <[email protected]>

* Updating get lock rest path in tests

Signed-off-by: Joshua Palis <[email protected]>

* Addressing PR comments

Signed-off-by: Joshua Palis <[email protected]>

---------

Signed-off-by: Joshua Palis <[email protected]>

* Communication Mechanism Work Item 6 Release lock api (#312)

* Release lock API

Signed-off-by: Varun Jain <[email protected]>

* Release Lock API

Signed-off-by: Varun Jain <[email protected]>

* Release Lock API

Signed-off-by: Varun Jain <[email protected]>

* Release Lock API

Signed-off-by: Varun Jain <[email protected]>

* Reformatting

Signed-off-by: Varun Jain <[email protected]>

* Reformatting

Signed-off-by: Varun Jain <[email protected]>

* Reformatting

Signed-off-by: Varun Jain <[email protected]>

* Addressing Dan's Comments

Signed-off-by: Varun Jain <[email protected]>

* Addressing Dan's Comments

Signed-off-by: Varun Jain <[email protected]>

* Addressing Sarat's Comments

Signed-off-by: Varun Jain <[email protected]>

* Addressing Sarat's Comments

Signed-off-by: Varun Jain <[email protected]>

* Fixing test cases

Signed-off-by: Varun Jain <[email protected]>

* Fixing test cases

Signed-off-by: Varun Jain <[email protected]>

* Fixing ReleaseLocktestcase

Signed-off-by: Varun Jain <[email protected]>

* Fixing ReleaseLocktestcase

Signed-off-by: Varun Jain <[email protected]>

---------

Signed-off-by: Varun Jain <[email protected]>

* Bumping BWC version to 2.7 and Fixing xcontent imports (#322)

* [Extensions] Add all fields of LockModel to RestGetLockAction response (#342)

* Modifies the RestGetLockAction response to include all fields of the lock model object, rather than the lock model object itself

Signed-off-by: Joshua Palis <[email protected]>

* Removing unused fields

Signed-off-by: Joshua Palis <[email protected]>

* reverting field removal

Signed-off-by: Joshua Palis <[email protected]>

* Adding lockID to back to response

Signed-off-by: Joshua Palis <[email protected]>

* Adding checks to multinode get lock rest integration tests to ensure that all response fields are populated

Signed-off-by: Joshua Palis <[email protected]>

* fixing lock time parsing

Signed-off-by: Joshua Palis <[email protected]>

* Adds a new Response class to house serde logic for RestGetLockAction response

Signed-off-by: Joshua Palis <[email protected]>

* Moving parser.nextToken() within AcquireLockResponse.parse()

Signed-off-by: Joshua Palis <[email protected]>

* Implementing toXContentObject for AcquireLockRequest

Signed-off-by: Joshua Palis <[email protected]>

* Moving AcquireLockResponse to transpor package

Signed-off-by: Joshua Palis <[email protected]>

---------

Signed-off-by: Joshua Palis <[email protected]>

* Increasing JobDetailsService request timeoufrom 10 to 15, since the initial job detail registration request will initialize the job details metadata index, which takes some time (#346)

Signed-off-by: Joshua Palis <[email protected]>

* Fixes serde logic for proxy scheduled jobrunner/parser requests/responses (#349)

Signed-off-by: Joshua Palis <[email protected]>

* Fixes serde logic for JobParameterRequest/JobRunnerRequest. Removes extra trimming of request bytes for the streaminput constructor for the JobParameter/RunnerRequest, as this is already trimmed by the SDK prior to forwarding the actionrequest to the transport action (#351)

Signed-off-by: Joshua Palis <[email protected]>

* [Extensions] Makes JobRunner/Parameter/Request/Response classes extend from ActionRequest/Response (#352)

* Replaces ExtensionActionRequest class name with the JobParameter/RunnerRequest fully qualified class names, modifes JobParameter/Runner/Request/Response classes to extend from ActionRequest/Response

Signed-off-by: Joshua Palis <[email protected]>

* Removes ExtensionJobActionResponse and fixes affected test classes

Signed-off-by: Joshua Palis <[email protected]>

* Fixing javadocs

Signed-off-by: Joshua Palis <[email protected]>

---------

Signed-off-by: Joshua Palis <[email protected]>

* Consuming breaking changes from moving ExtensionActionRequest (#381)

Signed-off-by: Sarat Vemulapalli <[email protected]>

* spotless

Signed-off-by: Joshua Palis <[email protected]>

* Fixing apache imports for TestHelpers class

Signed-off-by: Joshua Palis <[email protected]>

* Modofies ODFERestTestCase to work with 2.x

Signed-off-by: Joshua Palis <[email protected]>

* Fixing wipeAllODFEIndices

Signed-off-by: Joshua Palis <[email protected]>

---------

Signed-off-by: Varun Jain <[email protected]>
Signed-off-by: Joshua Palis <[email protected]>
Signed-off-by: Sarat Vemulapalli <[email protected]>
Co-authored-by: Varun Jain <[email protected]>
Co-authored-by: Sarat Vemulapalli <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants