Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Index Transforms - Schedule start time issue #801

Closed
SDikshaR opened this issue May 31, 2023 · 2 comments
Closed

Index Transforms - Schedule start time issue #801

SDikshaR opened this issue May 31, 2023 · 2 comments
Assignees
Labels
bug Something isn't working good first issue Good for newcomers small transform

Comments

@SDikshaR
Copy link

When creating a transform job, where specified as start_time to run in a few hours in the future. However , always the start_time is set as the time that transform job is created.

Reproduction Steps:

Created a transform job with the start_time as 1684701322 using below API:

PUT _plugins/_transform/sample
{
"transform": {
"enabled": true,
"continuous": true,
"schedule": {
"interval": {
"period": 1,
"unit": "Minutes",
"start_time": 1684701322
}
},
"description": "Sample transform job",
"source_index": "sample1",
"target_index": "sample2",
"data_selection_query": {
"match_all": {}
},
"page_size": 1,
"groups": [
{
"terms": {
"source_field": "color",
"target_field": "colors"
}
}
],
"aggregations": {
}
}
}

OUTPUT:

{
"_id": "sample",
"_version": 1,
"_seq_no": 3407,
"_primary_term": 1,
"transform": {
"transform_id": "sample",
"schema_version": 17,
"schedule": {
"interval": {
"start_time": 1684733779323,
"period": 1,
"unit": "Minutes"
}
},
"metadata_id": null,
"updated_at": 1684733779323,
"enabled": true,
"enabled_at": 1684733779323,
"description": "Sample transform job",
"source_index": "sample1",
"data_selection_query": {
"match_all": {
"boost": 1
}

The time specified in the output is not same as time given at the time of creation

Expected behaviour:

When a specific time is specified then it should return in the output and job to be scheduled at that time.

Tested on:

  • OS: AWS opensearch
  • Version 2.5
  • Plugins

How do we determine the start time of the job as the output is giving different results to the specified start_time .

@ikibo
Copy link
Contributor

ikibo commented Oct 6, 2023

@bowenlan-amzn could I be assigned to this issue plz?

@bowenlan-amzn
Copy link
Member

For sure @ikibo , thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working good first issue Good for newcomers small transform
Projects
Status: Done
Development

No branches or pull requests

4 participants