[FEATURE] Add geo-spacial quering to sql

[sholomellenbogen]

Is your feature request related to a problem?
I have 2 indexes, in 1 I have data that has polygons and the other index contains extra contextual data for each record. I need to be able to run a geo-spacial query (geo_shape) on the first index and join the results with the second index.

What solution would you like?
Add a geo_shape function to sql so that I can do the entire query in sql to take advantage of the ability to join across multiple indexes.

What alternatives have you considered?
And alternative I tried was to create a search-processor using a filter query. I had the processor do the geo-shape query and I tried to use a sql query to join that search pipeline result with the second index. I could not figure out (or there is no way) to invoke the search pipeline created by the processor in sql. If I could do this it would be an acceptable solution as well.

[YANG-DB]

hi @sholomellenbogen - thanks for u'r request
we are currently working on a few new PPL language support commands related Geo feature - hopefully the next release or the following one will have some related capabilities

[sholomellenbogen]

Hi @YANG-DB, I am not very familiar with PPL. Would it allow us to join the results from 2 indexes together?

My problem is that I specifically need to be able to join the results from 2 indexes where the first index is filtered by a geo-spacial query. |

I know I can join 2 indexes with SQL already so adding geo-spacial query filtering to that would solve my problem. Adding it to PPL would only solve it if I can also join 2 indexes using it.

[dblock]

[Catch All Triage - 1, 2, 3]

[YANG-DB]

@sholomellenbogen PPL is an opensearch language we are supporting for performing queries and data analysts
please take some time to review the language and see if it's grammar can help you...

[sholomellenbogen]

After looking into PPL more; it does not appear provide the ability to join multiple indices which is a hard requirement for my issue.

There seems to be an active issue (#3099) requesting this feature; is it in the works?

[YANG-DB]

Hi @sholomellenbogen
we are currently not working actively on this - we may resume this task during 2025 - still not determined
LMK if you can assist with this if you have the ability - we need support for adding features as we are not a very large team
Thanks

[sholomellenbogen]

I am pretty busy at the moment but I will get back to this in a month or so and if it is still not being worked on I may have time to take a look.