Skip to content

Commit

Permalink
See open-metadata/OpenMetadata@91ef22d from refs/heads/main
Browse files Browse the repository at this point in the history
  • Loading branch information
open-metadata committed Feb 13, 2025
1 parent 30bba55 commit 761f24d
Show file tree
Hide file tree
Showing 2 changed files with 23 additions and 51 deletions.
38 changes: 12 additions & 26 deletions content/partials/v1.6/connectors/yaml/lineage.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,20 +3,6 @@
After running a Metadata Ingestion workflow, we can run Lineage workflow.
While the `serviceName` will be the same to that was used in Metadata Ingestion, so the ingestion bot can get the `serviceConnection` details from the server.

{% note %}
If you have a **db2jcc_license_cisuz.jar** file, it will not work with **ibm_db**. This file is a **Db2 Connect** license for the Java Driver.
For **non-Java drivers**, such as the Python Client used in OpenMetadata ingestion, a **Db2 Connect** client-side license is required, typically named **db2con*.lic**.

The **db2jcc_license_cisuz.jar** is specifically for Java-based clients, whereas OpenMetadata ingestion operates with a Python Client, making the `.jar` file incompatible.

For activating a **non-Java license** for Db2 Connect **Application Server Edition**, **Advanced Application Server Edition**, **Enterprise Edition**, or **Trial**, follow these steps:
- Download the **license activation kit** from IBM Passport Advantage: [IBM PPA](https://www.ibm.com/software/passportadvantage/pao_customer.html).
- Unzip the package and locate the **non-Java license file** (e.g., `db2consv_ee.lic`).
- Apply the `.lic` file to activate the license.

For further reference, check this IBM post: [Everything About Db2 Connect Licensing](https://community.ibm.com/community/user/datamanagement/blogs/shilu-mathai2/2023/05/05/everything-about-db2-connect-licensing).
{% /note %}

### 1. Define the YAML Config

This is a sample config for BigQuery Lineage:
Expand Down Expand Up @@ -80,35 +66,35 @@ You can find all the definitions and types for the `sourceConfig` [here](https:
{% /codeInfo %}


{% codeInfo srNumber=49 %}
{% codeInfo srNumber=51 %}

**overrideViewLineage**: Set the 'Override View Lineage' toggle to control whether to override the existing view lineage.

{% /codeInfo %}


{% codeInfo srNumber=51 %}
{% codeInfo srNumber=52 %}

**processViewLineage**: Set the 'Process View Lineage' toggle to control whether to process view lineage.

{% /codeInfo %}


{% codeInfo srNumber=52 %}
{% codeInfo srNumber=53 %}

**processQueryLineage**: Set the 'Process Query Lineage' toggle to control whether to process query lineage.

{% /codeInfo %}


{% codeInfo srNumber=53 %}
{% codeInfo srNumber=54 %}

**processStoredProcedureLineage**: Set the 'Process Stored ProcedureLog Lineage' toggle to control whether to process stored procedure lineage.

{% /codeInfo %}


{% codeInfo srNumber=54 %}
{% codeInfo srNumber=55 %}

**threads**: Number of Threads to use in order to parallelize lineage ingestion.

Expand All @@ -120,6 +106,7 @@ You can find all the definitions and types for the `sourceConfig` [here](https:
#### Sink Configuration

To send the metadata to OpenMetadata, it needs to be specified as `type: metadata-rest`.

{% /codeInfo %}


Expand Down Expand Up @@ -191,13 +178,6 @@ source:
# - table3
# - table4
```

```yaml {% srNumber=49 %}
sink:
type: metadata-rest
config: {}
```
```yaml {% srNumber=51 %}
overrideViewLineage: false
```
Expand All @@ -218,6 +198,12 @@ sink:
threads: 1
```
```yaml {% srNumber=49 %}
sink:
type: metadata-rest
config: {}
```
{% partial file="/v1.6/connectors/yaml/workflow-config.md" /%}
{% /codeBlock %}
Expand Down
36 changes: 11 additions & 25 deletions content/partials/v1.7/connectors/yaml/lineage.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,20 +3,6 @@
After running a Metadata Ingestion workflow, we can run Lineage workflow.
While the `serviceName` will be the same to that was used in Metadata Ingestion, so the ingestion bot can get the `serviceConnection` details from the server.

{% note %}
If you have a **db2jcc_license_cisuz.jar** file, it will not work with **ibm_db**. This file is a **Db2 Connect** license for the Java Driver.
For **non-Java drivers**, such as the Python Client used in OpenMetadata ingestion, a **Db2 Connect** client-side license is required, typically named **db2con*.lic**.

The **db2jcc_license_cisuz.jar** is specifically for Java-based clients, whereas OpenMetadata ingestion operates with a Python Client, making the `.jar` file incompatible.

For activating a **non-Java license** for Db2 Connect **Application Server Edition**, **Advanced Application Server Edition**, **Enterprise Edition**, or **Trial**, follow these steps:
- Download the **license activation kit** from IBM Passport Advantage: [IBM PPA](https://www.ibm.com/software/passportadvantage/pao_customer.html).
- Unzip the package and locate the **non-Java license file** (e.g., `db2consv_ee.lic`).
- Apply the `.lic` file to activate the license.

For further reference, check this IBM post: [Everything About Db2 Connect Licensing](https://community.ibm.com/community/user/datamanagement/blogs/shilu-mathai2/2023/05/05/everything-about-db2-connect-licensing).
{% /note %}

### 1. Define the YAML Config

This is a sample config for BigQuery Lineage:
Expand Down Expand Up @@ -80,35 +66,35 @@ You can find all the definitions and types for the `sourceConfig` [here](https:
{% /codeInfo %}


{% codeInfo srNumber=49 %}
{% codeInfo srNumber=51 %}

**overrideViewLineage**: Set the 'Override View Lineage' toggle to control whether to override the existing view lineage.

{% /codeInfo %}


{% codeInfo srNumber=51 %}
{% codeInfo srNumber=52 %}

**processViewLineage**: Set the 'Process View Lineage' toggle to control whether to process view lineage.

{% /codeInfo %}


{% codeInfo srNumber=52 %}
{% codeInfo srNumber=53 %}

**processQueryLineage**: Set the 'Process Query Lineage' toggle to control whether to process query lineage.

{% /codeInfo %}


{% codeInfo srNumber=53 %}
{% codeInfo srNumber=54 %}

**processStoredProcedureLineage**: Set the 'Process Stored ProcedureLog Lineage' toggle to control whether to process stored procedure lineage.

{% /codeInfo %}


{% codeInfo srNumber=54 %}
{% codeInfo srNumber=55 %}

**threads**: Number of Threads to use in order to parallelize lineage ingestion.

Expand Down Expand Up @@ -193,12 +179,6 @@ source:
# - table4
```

```yaml {% srNumber=49 %}
sink:
type: metadata-rest
config: {}
```
```yaml {% srNumber=51 %}
overrideViewLineage: false
```
Expand All @@ -219,6 +199,12 @@ sink:
threads: 1
```
```yaml {% srNumber=49 %}
sink:
type: metadata-rest
config: {}
```
{% partial file="/v1.7/connectors/yaml/workflow-config.md" /%}
{% /codeBlock %}
Expand Down

0 comments on commit 761f24d

Please sign in to comment.