Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate feasibility of ephemeral build systems for non-Linux platforms #3264

Open
sxa opened this issue Feb 24, 2023 · 6 comments
Open
Assignees
Milestone

Comments

@sxa
Copy link
Member

sxa commented Feb 24, 2023

Part of SLSA level 3 and SSDF PO5.1. Part of this should be to avoid any possible interference from non-build processes to the systems used for building.
There are other technologies which could be used for this to mimic our use of dynamically created Docker containers which we use on Linux (s390x TBC), for example Solaris Zones, AIX WPARs etc.

@sxa sxa changed the title Investigate feasbility of ephemeral build systems for non-Linux platforms Investigate feasibility of ephemeral build systems for non-Linux platforms Feb 24, 2023
@sxa
Copy link
Member Author

sxa commented Mar 17, 2023

Note: The job-restrictions plugin which we will plan to install as part of adoptium/infrastructure#2108 (comment) should allow us to get some level of isolation (Not ephemeral, but blocking non-build jobs from running on certain systems)

@sxa sxa self-assigned this Jul 10, 2023
@sxa sxa added this to the july milestone Jul 10, 2023
@sxa
Copy link
Member Author

sxa commented Aug 22, 2023

We should initially look at prioritising the primary platforms. Noting that Linux/s390x mentioned in the description is now building in a container, but the image is not being regular refreshed or stored off-machine at present:

  • WINDOWS: There was some initial prototyping of using docker containers on windows for build in docker: add windows build support #2121 - we should look at reinvigorating that.
  • MACOS: We are looking at how we run our macos farms and the possibility of cross-compiling on aarch64 mac machines for our x64 builds in order to reduce costs since we have fewer sponsored systems for macos. If we do this would could use the built in macos virtualization framework to fire up machines, use them for a build, and shut them down afterwards.
    In terms of secondaries:
  • SOLARIS: Could use FLAR archives deployed as zones
  • AIX: Can deploy mksysb backups to WPARs

@sxa
Copy link
Member Author

sxa commented Oct 16, 2023

Update:

The other two platforms are not currently being progressed.

@sxa
Copy link
Member Author

sxa commented Nov 17, 2023

MacOS builds are being moved to orka3 under adoptium/infrastructure#2536 and will be tested heavily with the regular runs that will occur over the weekend.

@sxa
Copy link
Member Author

sxa commented Mar 26, 2024

adoptium/infrastructure#3286 is part of this

@sxa
Copy link
Member Author

sxa commented Nov 1, 2024

Feasibility has now been understood - windows will hopefully be ready shortly with the pipelines PR to allow docker containers, and AIX and Solaris can have separate issues created in the backlog pending someone with enough interest to achieve those levels on those platforms.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Todo
Development

No branches or pull requests

1 participant