Skip to content

Commit

Permalink
Add more combination of SBOM files and fixes generation for new CDXGEN (
Browse files Browse the repository at this point in the history
#40959)

With the new command we generate 4 different sbom types with python/npm
only, with both python and npm where python variants are either basic
runtime dependencies of airflow or full dependencies including providers
and development dependencies.

It works with latest CDXGEN and thanks to use --parallel flag, we can
significantly speed up generation of those SBOMs.

Fixes: #40810
  • Loading branch information
potiuk authored Jul 23, 2024
1 parent 0206a4c commit 84d19bc
Show file tree
Hide file tree
Showing 6 changed files with 246 additions and 90 deletions.
6 changes: 5 additions & 1 deletion dev/README_RELEASE_AIRFLOW.md
Original file line number Diff line number Diff line change
Expand Up @@ -881,14 +881,18 @@ Documentation for providers can be found in the ``/docs/apache-airflow`` directo
```shell script
breeze release-management publish-docs apache-airflow docker-stack
breeze release-management add-back-references apache-airflow --airflow-site-directory "${AIRFLOW_SITE_DIRECTORY}"
breeze sbom update-sbom-information --airflow-version ${VERSION} --airflow-site-directory ${AIRFLOW_SITE_DIRECTORY} --force
breeze sbom update-sbom-information --airflow-version ${VERSION} --airflow-site-directory ${AIRFLOW_SITE_DIRECTORY} --force --all-combinations --run-in-parallel
cd "${AIRFLOW_SITE_DIRECTORY}"
git add .
git commit -m "Add documentation for Apache Airflow ${VERSION}"
git push
# and finally open a PR
```
The `--run-in-parallell` switch allows to speed up SBOM generation significantly, but it might take a lot
of memory - if you are running into memory issues you can limit parallelism by setting `--parallelism N`
where N is a number of parallel `cdxgen` servers that should be started.
## Wait and make sure documentation is published on the website before proceeding
This is important as it takes time for the documentation to be published. You should exercise some patient
Expand Down
Loading

0 comments on commit 84d19bc

Please sign in to comment.