[pull] main from OpenLineage:main #53
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![pull[bot]](https://avatars.githubusercontent.com/in/12910?s=60&v=4){kind=small}
* The job normalization now includes more cases where parenthesis and acronyms are better handled. Signed-off-by: Artur Owczarek <[email protected]>
* Extract DatabricksEnvironment to manage Databricks resources * Add possibility to fetch log4j, stdout and stderr logs Signed-off-by: Artur Owczarek <[email protected]>
* Deprecated custom column level visitors have been removed Signed-off-by: Artur Owczarek <[email protected]>
…obs, set version using common method (#3200) Signed-off-by: Maciej Obuchowski <[email protected]>
#3199) Signed-off-by: Maciej Obuchowski <[email protected]>
…version of the Spark passed. (#3206) Signed-off-by: Artur Owczarek <[email protected]>
* Fix: Consider dbt sources when looking for test results Signed-off-by: Massy Bourennani <[email protected]> * format Signed-off-by: Massy Bourennani <[email protected]>
Signed-off-by: Jakub Dardzinski <[email protected]>
#3214) Bumps the client-java group in /client/java with 5 updates: | Package | From | To | | --- | --- | --- | | org.apache.kafka:kafka-clients | `3.8.0` | `3.8.1` | | [com.gradleup.shadow](https://github.com/GradleUp/shadow) | `8.3.3` | `8.3.5` | | [com.google.cloud:google-cloud-datalineage](https://github.com/googleapis/google-cloud-java) | `0.44.0` | `0.45.0` | | [com.google.cloud:google-cloud-nio](https://github.com/googleapis/java-storage-nio) | `0.127.25` | `0.127.26` | | software.amazon.awssdk:bom | `2.29.1` | `2.29.6` | Updates `org.apache.kafka:kafka-clients` from 3.8.0 to 3.8.1 Updates `com.gradleup.shadow` from 8.3.3 to 8.3.5 - [Release notes](https://github.com/GradleUp/shadow/releases) - [Commits](GradleUp/shadow@8.3.3...8.3.5) Updates `com.google.cloud:google-cloud-datalineage` from 0.44.0 to 0.45.0 - [Release notes](https://github.com/googleapis/google-cloud-java/releases) - [Changelog](https://github.com/googleapis/google-cloud-java/blob/main/CHANGELOG.md) - [Commits](googleapis/google-cloud-java@v0.44.0...v0.45.0) Updates `com.google.cloud:google-cloud-nio` from 0.127.25 to 0.127.26 - [Release notes](https://github.com/googleapis/java-storage-nio/releases) - [Changelog](https://github.com/googleapis/java-storage-nio/blob/main/CHANGELOG.md) - [Commits](googleapis/java-storage-nio@v0.127.25...v0.127.26) Updates `software.amazon.awssdk:bom` from 2.29.1 to 2.29.6 --- updated-dependencies: - dependency-name: org.apache.kafka:kafka-clients dependency-type: direct:production update-type: version-update:semver-patch dependency-group: client-java - dependency-name: com.gradleup.shadow dependency-type: direct:production update-type: version-update:semver-patch dependency-group: client-java - dependency-name: com.google.cloud:google-cloud-datalineage dependency-type: direct:production update-type: version-update:semver-minor dependency-group: client-java - dependency-name: com.google.cloud:google-cloud-nio dependency-type: direct:production update-type: version-update:semver-patch dependency-group: client-java - dependency-name: software.amazon.awssdk:bom dependency-type: direct:production update-type: version-update:semver-patch dependency-group: client-java ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps the integration-spark group in /integration/spark with 3 updates: software.amazon.awssdk:bom, org.apache.kafka:kafka-clients and [org.apache.httpcomponents.client5:httpclient5](https://github.com/apache/httpcomponents-client). Updates `software.amazon.awssdk:bom` from 2.29.1 to 2.29.6 Updates `org.apache.kafka:kafka-clients` from 3.8.0 to 3.8.1 Updates `org.apache.httpcomponents.client5:httpclient5` from 5.4 to 5.4.1 - [Changelog](https://github.com/apache/httpcomponents-client/blob/rel/v5.4.1/RELEASE_NOTES.txt) - [Commits](apache/httpcomponents-client@rel/v5.4...rel/v5.4.1) --- updated-dependencies: - dependency-name: software.amazon.awssdk:bom dependency-type: direct:production update-type: version-update:semver-patch dependency-group: integration-spark - dependency-name: org.apache.kafka:kafka-clients dependency-type: direct:production update-type: version-update:semver-patch dependency-group: integration-spark - dependency-name: org.apache.httpcomponents.client5:httpclient5 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: integration-spark ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Artur Owczarek <[email protected]>
Use EnvironmentVariablesRunFacet in Python client. Signed-off-by: Jakub Dardzinski <[email protected]>
Signed-off-by: Artur Owczarek <[email protected]>
Signed-off-by: Jakub Dardzinski <[email protected]>
Signed-off-by: Maciej Obuchowski <[email protected]>
* Update Dataproc run facet to include runType property Signed-off-by: Pahulpreet Singh <[email protected]> * rename gcp dataproc spark run facet Signed-off-by: Pahulpreet Singh <[email protected]> * rename runType to jobType in gcp dataproc run facet Signed-off-by: Pahulpreet Singh <[email protected]> * update expected facets in GCPUtilsTest Signed-off-by: Pahulpreet Singh <[email protected]> * rename gcp dataproc spark run facet Update gcp/dataproc/registry.json Signed-off-by: Pahulpreet Singh <[email protected]> * rename gcp dataproc spark run facet Update gcp/lineage/registry.json Signed-off-by: Pahulpreet Singh <[email protected]> --------- Signed-off-by: Pahulpreet Singh <[email protected]>
…3205) Signed-off-by: Maciej Obuchowski <[email protected]>
Signed-off-by: Maciej Obuchowski <[email protected]>
Signed-off-by: Maciej Obuchowski <[email protected]>
Signed-off-by: Maciej Obuchowski <[email protected]>
Signed-off-by: Maciej Obuchowski <[email protected]>
Signed-off-by: Artur Owczarek <[email protected]>
Signed-off-by: Jakub Dardzinski <[email protected]>
Signed-off-by: Maciej Obuchowski <[email protected]>
Signed-off-by: Maciej Obuchowski <[email protected]>
Signed-off-by: Maciej Obuchowski <[email protected]>
Signed-off-by: Maciej Obuchowski <[email protected]>
Signed-off-by: Maciej Obuchowski <[email protected]>
Edit link now depends on whether the document is current or versioned. Signed-off-by: Jakub Dardzinski <[email protected]>
* check manifest version for >=v12 to fix bug Signed-off-by: NJA010 <[email protected]> * typo in test_metadata Signed-off-by: NJA010 <[email protected]> * add test for manifest without test_metadata Signed-off-by: NJA010 <[email protected]> --------- Signed-off-by: NJA010 <[email protected]>
…n. (#3236) Signed-off-by: Artur Owczarek <[email protected]>
Signed-off-by: merobi-hub <[email protected]>
Signed-off-by: Pawel Leszczynski <[email protected]>
Signed-off-by: Maciej Obuchowski <[email protected]>
Bumps the integration-spark group in /integration/spark with 2 updates: software.amazon.awssdk:bom and org.apache.kafka:kafka-clients. Updates `software.amazon.awssdk:bom` from 2.29.6 to 2.29.9 Updates `org.apache.kafka:kafka-clients` from 3.8.1 to 3.9.0 --- updated-dependencies: - dependency-name: software.amazon.awssdk:bom dependency-type: direct:production update-type: version-update:semver-patch dependency-group: integration-spark - dependency-name: org.apache.kafka:kafka-clients dependency-type: direct:production update-type: version-update:semver-minor dependency-group: integration-spark ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Pawel Leszczynski <[email protected]>
* enable building input/output facets from the visitors Signed-off-by: Pawel Leszczynski <[email protected]> * preserve existing developers API methods Signed-off-by: Pawel Leszczynski <[email protected]> --------- Signed-off-by: Pawel Leszczynski <[email protected]>
Signed-off-by: Artur Owczarek <[email protected]>
* (proposal): New tags facet for arbitrary metadata Signed-off-by: Leo Godin <[email protected]> * (proposal): Documentation changes to clarify multiple new facets. Signed-off-by: Leo Godin <[email protected]> * (proposal): Fix tag facet for run event example Signed-off-by: Leo Godin <[email protected]> --------- Signed-off-by: Leo Godin <[email protected]>
Signed-off-by: Artur Owczarek <[email protected]>
Align to [Dataset Naming](https://openlineage.io/docs/spec/naming/#dataset-naming). Signed-off-by: Dumitru Uzun <[email protected]>
…aces (#3244) * exclude TransportBuilder from META-INF Signed-off-by: tnazarew <[email protected]> * add changelog entry Signed-off-by: tnazarew <[email protected]> --------- Signed-off-by: tnazarew <[email protected]>
…#3251) Signed-off-by: Abdallah Terrab <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
See Commits and Changes for more details.
Created by
pull[bot] (v2.0.0-alpha.1)
Can you help keep this open source service alive? 💖 Please sponsor : )