Date histogram fails to select new date range if date is scripted field #24891

Hohol · 2018-10-31T09:19:39Z

Kibana version: 6.4.2

Elasticsearch version: 6.4.2

Server OS version: Windows 10 Enterprise

Browser version: Chrome

Original install method: download page

Describe the bug: If you have date histogram where date is scripted field, visualization fails when you try to select date range twice.

Steps to reproduce:

Add documents to Elasticsearch

POST /_bulk
{"create": { "_index": "test", "_id": 1}}
{"timestamp": 1553076734409}
{"create": { "_index": "test", "_id": 2}}
{"timestamp": 1553076674409}
{"create": { "_index": "test", "_id": 3}}
{"timestamp": 1553076614409}
...1000 entries

data.txt

Create new scripted field.
Name: date, Language: painless, type: date, Format: default, Script: return doc['timestamp'].value
Create new Vertical Bar Chart.
Aggregation: Date Histogram, Field: date, Interval: Hourly. Apply changes.
Select some date range using mouse. Chart updates successfully.
Select some date range again. Chart does not update. Popup appears with the text

Error in visualization
Request to Elasticsearch failed: {"error":{"root_cause":[{"type":"script_exception","reason":"runtime error","script_stack":["return s.get() >= v} boolean lt(Supplier s, def v) {"," ^---- HERE"],"script":"boolean gte(Supplier s, def v) {return s.get() >= v} boolean lt(Supplier s, def v) {return s.get() < v}gte(() -> { return doc['timestamp'].value }, params.gte) && lt(() -> { return doc['timestamp'].value }, params.lt)","lang":"painless"}],"type":"search_phase_execution_exception","reason":"all shards failed","phase":"query","grouped":true,"failed_shards":[{"shard":0,"index":"test","node":"JjmpO3sdR7WtKQ7rFIi3Wg","reason":{"type":"script_exception","reason":"runtime error","script_stack":["return s.get() >= v} boolean lt(Supplier s, def v) {"," ^---- HERE"],"script":"boolean gte(Supplier s, def v) {return s.get() >= v} boolean lt(Supplier s, def v) {return s.get() < v}gte(() -> { return doc['timestamp'].value }, params.gte) && lt(() -> { return doc['timestamp'].value }, params.lt)","lang":"painless","caused_by":{"type":"class_cast_exception","reason":"Cannot apply [>] operation to types [java.lang.Long] and [java.lang.String]."}}}]},"status":500}

Screenshots (if relevant):

Errors in browser console (if relevant):

RequestFailure {message: "Request to Elasticsearch failed: {"error":{"root_c…Long] and [java.lang.String]."}}}]},"status":500}", origError: false, resp: {…}, stack: "Error: Request to Elasticsearch failed: {"error":{…ocalhost:5601/bundles/vendors.bundle.js:211:67265"} "Possibly unhandled rejection: {"message":"Request to Elasticsearch failed: {\"error\":{\"root_cause\":[{\"type\":\"script_exception\",\"reason\":\"runtime error\",\"script_stack\":[\"return s.get() >= v} boolean lt(Supplier s, def v) {\",\"        ^---- HERE\"],\"script\":\"boolean gte(Supplier s, def v) {return s.get() >= v} boolean lt(Supplier s, def v) {return s.get() < v}gte(() -> { return doc['timestamp'].value }, params.gte) && lt(() -> { return doc['timestamp'].value }, params.lt)\",\"lang\":\"painless\"}],\"type\":\"search_phase_execution_exception\",\"reason\":\"all shards failed\",\"phase\":\"query\",\"grouped\":true,\"failed_shards\":[{\"shard\":0,\"index\":\"test\",\"node\":\"JjmpO3sdR7WtKQ7rFIi3Wg\",\"reason\":{\"type\":\"script_exception\",\"reason\":\"runtime error\",\"script_stack\":[\"return s.get() >= v} boolean lt(Supplier s, def v) {\",\"        ^---- HERE\"],\"script\":\"boolean gte(Supplier s, def v) {return s.get() >= v} boolean lt(Supplier s, def v) {return s.get() < v}gte(() -> { return doc['timestamp'].value }, params.gte) && lt(() -> { return doc['timestamp'].value }, params.lt)\",\"lang\":\"painless\",\"caused_by\":{\"type\":\"class_cast_exception\",\"reason\":\"Cannot apply [>] operation to types [java.lang.Long] and [java.lang.String].\"}}}]},\"status\":500}","origError":false,"resp":{"error":{"root_cause":[{"type":"script_exception","reason":"runtime error","script_stack":["return s.get() >= v} boolean lt(Supplier s, def v) {","        ^---- HERE"],"script":"boolean gte(Supplier s, def v) {return s.get() >= v} boolean lt(Supplier s, def v) {return s.get() < v}gte(() -> { return doc['timestamp'].value }, params.gte) && lt(() -> { return doc['timestamp'].value }, params.lt)","lang":"painless"}],"type":"search_phase_execution_exception","reason":"all shards failed","phase":"query","grouped":true,"failed_shards":[{"shard":0,"index":"test","node":"JjmpO3sdR7WtKQ7rFIi3Wg","reason":{"type":"script_exception","reason":"runtime error","script_stack":["return s.get() >= v} boolean lt(Supplier s, def v) {","        ^---- HERE"],"script":"boolean gte(Supplier s, def v) {return s.get() >= v} boolean lt(Supplier s, def v) {return s.get() < v}gte(() -> { return doc['timestamp'].value }, params.gte) && lt(() -> { return doc['timestamp'].value }, params.lt)","lang":"painless","caused_by":{"type":"class_cast_exception","reason":"Cannot apply [>] operation to types [java.lang.Long] and [java.lang.String]."}}}]},"status":500}}"

Provide logs and/or server output (if relevant):

[2018-10-31T13:11:56,261][DEBUG][o.e.a.s.TransportSearchAction] [JjmpO3s] [test][3], node[JjmpO3sdR7WtKQ7rFIi3Wg], [P], s[STARTED], a[id=eFSFfLAIQe2eRf_pO3k1Pw]: Failed to execute [SearchRequest{searchType=QUERY_THEN_FETCH, indices=[test], indicesOptions=IndicesOptions[ignore_unavailable=true, allow_no_indices=true, expand_wildcards_open=true, expand_wildcards_closed=false, allow_aliases_to_multiple_indices=true, forbid_closed_indices=true, ignore_aliases=false], types=[], routing='null', preference='1540977082111', requestCache=null, scroll=null, maxConcurrentShardRequests=5, batchedReduceSize=512, preFilterShardSize=64, allowPartialSearchResults=true, source={"size":0,"query":{"bool":{"must":[{"match_all":{"boost":1.0}},{"script":{"script":{"source":"boolean gte(Supplier s, def v) {return s.get() >= v} boolean lt(Supplier s, def v) {return s.get() < v}gte(() -> { return doc['timestamp'].value }, params.gte) && lt(() -> { return doc['timestamp'].value }, params.lt)","lang":"painless","params":{"lt":"2018-10-31T05:57:47.466Z","gte":"2018-10-30T15:59:27.714Z","value":">=October 30th 2018, 19:55:10.185 <October 31st 2018, 10:57:27.744"}},"boost":1.0}}],"adjust_pure_negative":true,"boost":1.0}},"_source":{"includes":[],"excludes":[]},"stored_fields":"*","docvalue_fields":[],"script_fields":{"date":{"script":{"source":"return doc['timestamp'].value","lang":"painless"},"ignore_failure":false}},"aggregations":{"2":{"date_histogram":{"script":{"source":"return doc['timestamp'].value","lang":"painless"},"time_zone":"Asia/Dubai","interval":"1h","offset":0,"order":{"_key":"asc"},"keyed":false,"min_doc_count":1}}}}}]
org.elasticsearch.transport.RemoteTransportException: [JjmpO3s][127.0.0.1:9300][indices:data/read/search[phase/query]]
Caused by: org.elasticsearch.search.query.QueryPhaseExecutionException: Query Failed [Failed to execute main query]
        at org.elasticsearch.search.query.QueryPhase.execute(QueryPhase.java:298) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.query.QueryPhase.execute(QueryPhase.java:107) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService.loadOrExecuteQueryPhase(SearchService.java:324) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:357) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService$2.onResponse(SearchService.java:333) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService$2.onResponse(SearchService.java:329) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService$3.doRun(SearchService.java:1019) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:723) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.common.util.concurrent.TimedRunnable.doRun(TimedRunnable.java:41) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_181]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_181]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]
Caused by: org.elasticsearch.script.ScriptException: runtime error
        at org.elasticsearch.painless.PainlessScript.convertToScriptException(PainlessScript.java:94) ~[?:?]
        at org.elasticsearch.painless.PainlessScript$Script.execute(boolean gte(Supplier s, def v) {return s.get() >= v} boolean lt(Supplier s, def v) {return s.get() < v}gte(() -> { return doc['timestamp'].value }, params.gte) && lt(() -> { return doc['timestamp'].value }, params.lt):214) ~[?:?]
        at org.elasticsearch.index.query.ScriptQueryBuilder$ScriptQuery$1$1.matches(ScriptQueryBuilder.java:187) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.apache.lucene.search.ConjunctionDISI$ConjunctionTwoPhaseIterator.matches(ConjunctionDISI.java:345) ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz - 2018-06-18 16:51:45]
        at org.apache.lucene.search.Weight$DefaultBulkScorer.scoreAll(Weight.java:270) ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz - 2018-06-18 16:51:45]
        at org.apache.lucene.search.Weight$DefaultBulkScorer.score(Weight.java:214) ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz - 2018-06-18 16:51:45]
        at org.apache.lucene.search.BulkScorer.score(BulkScorer.java:39) ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz - 2018-06-18 16:51:45]
        at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:662) ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz - 2018-06-18 16:51:45]
        at org.elasticsearch.search.internal.ContextIndexSearcher.search(ContextIndexSearcher.java:191) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:463) ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz - 2018-06-18 16:51:45]
        at org.elasticsearch.search.query.QueryPhase.execute(QueryPhase.java:266) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.query.QueryPhase.execute(QueryPhase.java:107) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService.loadOrExecuteQueryPhase(SearchService.java:324) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:357) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService$2.onResponse(SearchService.java:333) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService$2.onResponse(SearchService.java:329) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService$3.doRun(SearchService.java:1019) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:723) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.common.util.concurrent.TimedRunnable.doRun(TimedRunnable.java:41) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_181]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_181]
        at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_181]
Caused by: java.lang.ClassCastException: Cannot apply [>] operation to types [java.lang.Long] and [java.lang.String].
        at org.elasticsearch.painless.DefMath.gte(DefMath.java:819) ~[?:?]
        at org.elasticsearch.painless.PainlessScript$Script.gte(boolean gte(Supplier s, def v) {return s.get() >= v} boolean lt(Supplier s, def v) {return s.get() < v}gte(() -> { return doc['timestamp'].value }, params.gte) && lt(() -> { return doc['timestamp'].value }, params.lt):41) ~[?:?]
        at org.elasticsearch.painless.PainlessScript$Script.execute(boolean gte(Supplier s, def v) {return s.get() >= v} boolean lt(Supplier s, def v) {return s.get() < v}gte(() -> { return doc['timestamp'].value }, params.gte) && lt(() -> { return doc['timestamp'].value }, params.lt):155) ~[?:?]
        at org.elasticsearch.index.query.ScriptQueryBuilder$ScriptQuery$1$1.matches(ScriptQueryBuilder.java:187) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.apache.lucene.search.ConjunctionDISI$ConjunctionTwoPhaseIterator.matches(ConjunctionDISI.java:345) ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz - 2018-06-18 16:51:45]
        at org.apache.lucene.search.Weight$DefaultBulkScorer.scoreAll(Weight.java:270) ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz - 2018-06-18 16:51:45]
        at org.apache.lucene.search.Weight$DefaultBulkScorer.score(Weight.java:214) ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz - 2018-06-18 16:51:45]
        at org.apache.lucene.search.BulkScorer.score(BulkScorer.java:39) ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz - 2018-06-18 16:51:45]
        at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:662) ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz - 2018-06-18 16:51:45]
        at org.elasticsearch.search.internal.ContextIndexSearcher.search(ContextIndexSearcher.java:191) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:463) ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz - 2018-06-18 16:51:45]
        at org.elasticsearch.search.query.QueryPhase.execute(QueryPhase.java:266) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.query.QueryPhase.execute(QueryPhase.java:107) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService.loadOrExecuteQueryPhase(SearchService.java:324) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:357) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService$2.onResponse(SearchService.java:333) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService$2.onResponse(SearchService.java:329) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService$3.doRun(SearchService.java:1019) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:723) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.common.util.concurrent.TimedRunnable.doRun(TimedRunnable.java:41) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_181]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_181]
        at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_181]
[2018-10-31T13:11:56,275][DEBUG][o.e.a.s.TransportSearchAction] [JjmpO3s] All shards failed for phase: [query]
org.elasticsearch.script.ScriptException: runtime error
        at org.elasticsearch.painless.PainlessScript.convertToScriptException(PainlessScript.java:94) ~[?:?]
        at org.elasticsearch.painless.PainlessScript$Script.execute(boolean gte(Supplier s, def v) {return s.get() >= v} boolean lt(Supplier s, def v) {return s.get() < v}gte(() -> { return doc['timestamp'].value }, params.gte) && lt(() -> { return doc['timestamp'].value }, params.lt):214) ~[?:?]
        at org.elasticsearch.index.query.ScriptQueryBuilder$ScriptQuery$1$1.matches(ScriptQueryBuilder.java:187) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.apache.lucene.search.ConjunctionDISI$ConjunctionTwoPhaseIterator.matches(ConjunctionDISI.java:345) ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz - 2018-06-18 16:51:45]
        at org.apache.lucene.search.Weight$DefaultBulkScorer.scoreAll(Weight.java:270) ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz - 2018-06-18 16:51:45]
        at org.apache.lucene.search.Weight$DefaultBulkScorer.score(Weight.java:214) ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz - 2018-06-18 16:51:45]
        at org.apache.lucene.search.BulkScorer.score(BulkScorer.java:39) ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz - 2018-06-18 16:51:45]
        at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:662) ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz - 2018-06-18 16:51:45]
        at org.elasticsearch.search.internal.ContextIndexSearcher.search(ContextIndexSearcher.java:191) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:463) ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz - 2018-06-18 16:51:45]
        at org.elasticsearch.search.query.QueryPhase.execute(QueryPhase.java:266) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.query.QueryPhase.execute(QueryPhase.java:107) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService.loadOrExecuteQueryPhase(SearchService.java:324) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:357) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService$2.onResponse(SearchService.java:333) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService$2.onResponse(SearchService.java:329) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.search.SearchService$3.doRun(SearchService.java:1019) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:723) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.common.util.concurrent.TimedRunnable.doRun(TimedRunnable.java:41) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_181]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_181]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]
Caused by: java.lang.ClassCastException: Cannot apply [>] operation to types [java.lang.Long] and [java.lang.String].
        at org.elasticsearch.painless.DefMath.gte(DefMath.java:819) ~[?:?]
        at org.elasticsearch.painless.PainlessScript$Script.gte(boolean gte(Supplier s, def v) {return s.get() >= v} boolean lt(Supplier s, def v) {return s.get() < v}gte(() -> { return doc['timestamp'].value }, params.gte) && lt(() -> { return doc['timestamp'].value }, params.lt):41) ~[?:?]
        at org.elasticsearch.painless.PainlessScript$Script.execute(boolean gte(Supplier s, def v) {return s.get() >= v} boolean lt(Supplier s, def v) {return s.get() < v}gte(() -> { return doc['timestamp'].value }, params.gte) && lt(() -> { return doc['timestamp'].value }, params.lt):155) ~[?:?]
        ... 22 more

The text was updated successfully, but these errors were encountered:

Hohol · 2018-10-31T09:25:39Z

I'd like to try to work on this issue.
Is it OK?
If it is, could anyone give me some recommendation, where should I dig?

Hohol · 2018-10-31T13:47:54Z

First query parameters:

 "params":{
    "gte":1540914910185,
    "lt":1540969047744,
    "value":">=October 30th 2018, 19:55:10.185 <October 31st 2018, 10:57:27.744"
 },

Second query parameters:

"params":{  
    "gte":"2018-10-30T15:56:06.716Z",
    "lt":"2018-10-31T05:58:37.716Z",
    "value":">=October 30th 2018, 19:55:10.185 <October 31st 2018, 10:57:27.744"
 }

For some reason, second query switched to using string representation of date, instead of timestamp.

Hohol · 2018-11-13T05:24:20Z

@thomasneirynck @cjcenizal could someone review my PR?
#25379

Hohol · 2019-03-20T11:18:59Z

I tried to update my pull request. But it seems something has changed and now scripted field filtering is broken in a new way.
Now even first request contains "gte" and "lt" fields with string representation of date instead of timestamp number. So even first range selection fails.

Hohol · 2019-03-20T11:19:56Z

@markov00, I'd like to continue working on it. Could you please assign me to this task?

markov00 · 2019-03-20T12:18:13Z

Done! Thanks @Hohol for your efforts on this

Hohol · 2019-04-01T14:23:45Z

It seems change in this PR is conflicting with scripted date field filtering
#31807

in brush_event.js file

      range = {
        gte: moment(min).toISOString(),
        lt: moment(max).toISOString(),
        format: 'strict_date_optional_time'
      };

It changed date format to string, but scripted date filtering requires timestamps.

@flash1293, could you please explain, why can't we continue using timestamps here?
I've just tried it with 'epoch_millis' format and with dates before the epoch. It worked fine for me.

flash1293 · 2019-04-01T14:31:26Z

Hi @Hohol This was changed because epoch_millis don't allow dates before the unix epoch anymore which would break Kibana for all data which predates 1970 elastic/elasticsearch#39375

Hohol · 2019-04-01T14:57:00Z

@flash1293, wow, it's sad. Forbidding negative timestamps and forcing us to use strings instead feels weird to me.

Hohol closed this as completed Oct 31, 2018

Hohol reopened this Oct 31, 2018

thomasneirynck added bug Fixes for quality problems that affect the customer experience triage_needed Team:Visualizations Visualization editors, elastic-charts and infrastructure labels Oct 31, 2018

Hohol mentioned this issue Nov 8, 2018

Fixes range filtering in XY charts when field is a scripted date field. #25379

Merged

markov00 removed the triage_needed label Jan 16, 2019

markov00 mentioned this issue Jan 16, 2019

Filters on scripted date fields don't work #19923

Closed

markov00 assigned Hohol Mar 20, 2019

Hohol mentioned this issue Apr 8, 2019

Unable to select Date Histogram as Aggregation for Vertical Bar chart #34714

Closed

Hohol mentioned this issue May 8, 2019

Add a way to convert date field value to single type in Painless script elastic/elasticsearch#41936

Closed

ppisljar closed this as completed in #25379 May 23, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Date histogram fails to select new date range if date is scripted field #24891

Date histogram fails to select new date range if date is scripted field #24891

Hohol commented Oct 31, 2018 •

edited

Loading

Hohol commented Oct 31, 2018 •

edited

Loading

Hohol commented Oct 31, 2018

Hohol commented Nov 13, 2018

Hohol commented Mar 20, 2019

Hohol commented Mar 20, 2019

markov00 commented Mar 20, 2019

Hohol commented Apr 1, 2019 •

edited

Loading

flash1293 commented Apr 1, 2019

Hohol commented Apr 1, 2019

Date histogram fails to select new date range if date is scripted field #24891

Date histogram fails to select new date range if date is scripted field #24891

Comments

Hohol commented Oct 31, 2018 • edited Loading

Hohol commented Oct 31, 2018 • edited Loading

Hohol commented Oct 31, 2018

Hohol commented Nov 13, 2018

Hohol commented Mar 20, 2019

Hohol commented Mar 20, 2019

markov00 commented Mar 20, 2019

Hohol commented Apr 1, 2019 • edited Loading

flash1293 commented Apr 1, 2019

Hohol commented Apr 1, 2019

Hohol commented Oct 31, 2018 •

edited

Loading

Hohol commented Oct 31, 2018 •

edited

Loading

Hohol commented Apr 1, 2019 •

edited

Loading