Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Field with null value is omitted when write back to result index #139

Open
seankao-az opened this issue Nov 7, 2023 · 0 comments
Open
Labels
0.2 bug Something isn't working

Comments

@seankao-az
Copy link
Collaborator

What is the bug?
When writing back query result to query_execution_result_{datasource}, fields with null value is dropped. I encountered this with cloudwatch datasource.

Sample query:

SELECT srcPort FROM mycw.default.FLE_GLE_VPC_LoadGen LIMIT 10

Raw result:

+-------+
|srcPort|
+-------+
|  20641|
|  20641|
|   null|
|   null|
|  20641|
|  20641|
|   null|
|   null|
|  20641|
|  20641|
+-------+

Corresponding doc that is written back to query_execution_result_{datasource}

{
    "_index": "query_execution_result_mycw",
    "_id": "-BgYq4sBhRhnt4SbZiGq",
    "_score": 1,
    "_source": {
      "result": [
        "{'srcPort':20641}",
        "{'srcPort':20641}",
        "{}",
        "{}",
        "{'srcPort':20641}",
        "{'srcPort':20641}",
        "{}",
        "{}",
        "{'srcPort':20641}",
        "{'srcPort':20641}"
      ],
      "schema": [
        "{'column_name':'srcPort','data_type':'long'}"
      ],
      "jobRunId": "00feineujeco7g0a",
      "applicationId": "00feggo87noppi09",
      "dataSourceName": "mycw",
      "status": "SUCCESS",
      "error": "",
      "queryId": "cEZnRDVhVlVjWG15Y3c=",
      "queryText": "select srcPort from mycw.default.FLE_GLE_VPC_LoadGen limit 10",
      "sessionId": "dThKam9xTU5sVW15Y3c=",
      "updateTime": 1699382583256,
      "queryRunTime": 11805
    }
}

Expected result:

"result": [
        "{'srcPort':20641}",
        "{'srcPort':20641}",
        "{'srcPort':null}",
        "{'srcPort':null}",
        "{'srcPort':20641}",
        "{'srcPort':20641}",
        "{'srcPort':null}",
        "{'srcPort':null}",
        "{'srcPort':20641}",
        "{'srcPort':20641}"
      ]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
0.2 bug Something isn't working
Projects
Development

No branches or pull requests

2 participants