Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ingestion image is missing Java #6310

Closed
frsann opened this issue Oct 28, 2022 · 2 comments · Fixed by #6365
Closed

Ingestion image is missing Java #6310

frsann opened this issue Oct 28, 2022 · 2 comments · Fixed by #6365
Labels
bug Bug report devops PR or Issue related to DataHub backend & deployment

Comments

@frsann
Copy link
Contributor

frsann commented Oct 28, 2022

Describe the bug
Running the kafka connect ingestion fails

> docker run -it --user root -v /my/path/recipes:/temp linkedin/datahub-ingestion:v0.8.41 ingest run --dry-run -c /temp/kafka-connect-to-datahub-kafka.yml

[2022-10-28 09:47:42,927] INFO     {datahub.cli.ingest_cli:99} - DataHub CLI version: 0.8.41+docker
[2022-10-28 09:47:42,952] INFO     {datahub.ingestion.run.pipeline:160} - Sink configured successfully. 
[2022-10-28 09:47:44,455] INFO     {datahub.ingestion.source.kafka_connect:866} - Connection to <address> is ok
[2022-10-28 09:47:44,456] ERROR    {datahub.ingestion.run.pipeline:126} - No JVM shared library file (libjvm.so) found. Try setting up the JAVA_HOME environment variable properly.
[2022-10-28 09:47:44,456] INFO     {datahub.cli.ingest_cli:115} - Starting metadata ingestion
[2022-10-28 09:47:44,456] INFO     {datahub.cli.ingest_cli:133} - Finished metadata pipeline

Failed to configure source (kafka-connect) due to No JVM shared library file (libjvm.so) found. Try setting up the JAVA_HOME environment variable properly.
No ~/.datahubenv file found, generating one for you...

To Reproduce
Steps to reproduce the behavior:

  1. Try to run kafka-connect ingestion inside image.

Expected behavior
The ingestion would succeed

Additional context
Tested both v0.8.41 and v0.9.0.1

Somewhat related to: #4741

@frsann frsann added the bug Bug report label Oct 28, 2022
@frsann frsann changed the title Ingestion image is missing Java Ingestion (base) image is missing Java Oct 28, 2022
@frsann frsann changed the title Ingestion (base) image is missing Java Ingestion image is missing Java Oct 28, 2022
@frsann
Copy link
Contributor Author

frsann commented Oct 28, 2022

I fixed this in my own derived image by adding

RUN apt-get update && \
    apt-get install -y openjdk-11-jre-headless && \
    apt-get clean;

@anshbansal , let me know if adding this to the ingestion-base image is a satisfactory fix for you. Happy to make a PR for the fix.

@anshbansal
Copy link
Collaborator

@frsann yes please send a PR to add that in base image alongwith rest of the installs

@anshbansal anshbansal added the devops PR or Issue related to DataHub backend & deployment label Nov 3, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Bug report devops PR or Issue related to DataHub backend & deployment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants