Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add dependencies for x-pack/auditbeat and Journalbeat #58

Merged
merged 7 commits into from
Jul 8, 2020

Conversation

kuisathaverat
Copy link
Contributor

it installs cross-compile dependencies into the cross-build Docker images, finally, the trick is to add all the cross-packages manually, it seems it does not follow the dependencies.

This PR superseded #39

@kuisathaverat kuisathaverat added enhancement New feature or request automation Team:Automation Label for the Observability productivity team labels Jul 7, 2020
@kuisathaverat kuisathaverat requested review from urso, andrewkroh and a team July 7, 2020 19:54
@kuisathaverat kuisathaverat self-assigned this Jul 7, 2020
libicu57:arm64 \
icu-devtools:arm64 \
libsystemd-dev:arm64 \
# librpm-dev:armhf \
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we cannot install the three ARM variants, the packages conflict with each other. I have to take a look at https://wiki.debian.org/CrossCompiling to see if there is a way to make it. An alternative is to have an image for each ARM variant

@elasticmachine
Copy link

elasticmachine commented Jul 7, 2020

💚 Build Succeeded

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #58 updated]

  • Start Time: 2020-07-08T13:39:28.505+0000

  • Duration: 66 min 10 sec

@@ -17,6 +17,7 @@ RUN \
mingw-w64 \
mingw-w64-tools \
patch \
librpm-dev:i386 \
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kvch I think we are missing journalbeat dependencies here. What is required for amd64 and i386 builds (I think i386 requires us to jump through some extra hoops).

Is the main image used for building i386 and amd64 builds? Maybe we should provide separate images. Especially the systemd dependency can be a pain.

Copy link
Contributor Author

@kuisathaverat kuisathaverat Jul 8, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess so, but I could find a place where are defined the packages needed for any beat or the place where they are installed when you run the mage package
In any case, this would be done in a follow-up PR this one is to fix missing dependencies.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

there is a PR that create a new amd64 Docker image #53, I will make a review of it with the changes in here

Copy link
Contributor

@kvch kvch Jul 8, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am not sure I follow why this PR is needed. Journalbeat installs its dependencies before running GolangCrossbuild. Once it is merged, we need to follow-up in the magefile of the Beat? Is this template is used for all Beats? If yes, why would we install Journalbeat deps for the image when it builds e.g. Packetbeat?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I had a chat with @urso offline about the goal of this PR. You can find the deps of Journalbeat by platform here: https://github.com/elastic/beats/blob/master/journalbeat/magefile.go#L121-#L133

@kuisathaverat
Copy link
Contributor Author

BTW this generates images for the Go version 1.13.12 (among others), we use 1.13.10 on Beats, so or we bump the version in Beats or we generate a version 1.13.10 here

@kuisathaverat
Copy link
Contributor Author

@urso I have changed the Go version to 1.13.10 the same Beats use, to use the generated images in the package job

@urso
Copy link

urso commented Jul 8, 2020

+1 for providing 1.13.10.

We still try to update to go1.14.4: elastic/beats#18829

@kuisathaverat kuisathaverat merged commit e752ef4 into elastic:master Jul 8, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
automation enhancement New feature or request Team:Automation Label for the Observability productivity team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants