Add Docker-compose setting for IT testing #606
Conversation
salyh
requested review from
dai-chen,
rupal-bq,
vmmusings,
penghuo,
seankao-az,
anirudha,
kaituo and
YANG-DB
as code owners
|
I need still to wire spark and opensearch and add some docs ... |
|
nice |
|
Opensearch Dashboards are already there, see https://github.com/opensearch-project/opensearch-spark/pull/606/files#r1736775479 |
Signed-off-by: Hendrik Saly <[email protected]>
| @@ -0,0 +1,76 @@ | |||
| --- | |||
| services: | |||
| ppl-opensearch-node: | |||
There was a problem hiding this comment.
can we make this generic Docker setup instead of only PPL?
There was a problem hiding this comment.
OpenSearch can only work with EMR Serverless Spark.
| @@ -0,0 +1,4 @@ | |||
| FROM bitnami/spark:3.5 | |||
There was a problem hiding this comment.
can we leverage EMR Spark image. https://gallery.ecr.aws/emr-serverless/spark/emr-7.2.0
There was a problem hiding this comment.
I started some work on running with the EMR Spark image.
If there is interest, I could put up a PR. I would keep what you have here, but add a separate Dockerfile for EMR Spark.
| @@ -0,0 +1,76 @@ | |||
| --- | |||
| services: | |||
| ppl-opensearch-node: | |||
There was a problem hiding this comment.
OpenSearch can only work with EMR Serverless Spark.
|
Next steps:
|
|
@YANG-DB any update? |
|
closing this as its being addressed here |
Description
Add Docker-compose setting for IT testing
Issues Resolved
#601
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.