Skip to content

Commit

Permalink
See open-metadata/OpenMetadata@c68bb3c from refs/heads/main
Browse files Browse the repository at this point in the history
  • Loading branch information
open-metadata committed Jan 17, 2025
1 parent 7e9b7ec commit 0174139
Show file tree
Hide file tree
Showing 4 changed files with 14 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,8 @@ The `sourceConfig` is defined [here](https://github.com/open-metadata/OpenMetada

**includeDDL**: Optional configuration to toggle the DDL Statements ingestion.

**overrideMetadata** *(boolean)*: Set the 'Override Metadata' toggle to control whether to override the existing metadata in the OpenMetadata server with the metadata fetched from the source. If the toggle is set to true, the metadata fetched from the source will override the existing metadata in the OpenMetadata server. If the toggle is set to false, the metadata fetched from the source will not override the existing metadata in the OpenMetadata server. This is applicable for fields like description, tags, owner and displayName.

**queryLogDuration**: Configuration to tune how far we want to look back in query logs to process Stored Procedures results.

**queryParsingTimeoutLimit**: Configuration to set the timeout for parsing the query in seconds.
Expand All @@ -30,6 +32,8 @@ The `sourceConfig` is defined [here](https://github.com/open-metadata/OpenMetada

**threads (beta)**: The number of threads to use when extracting the metadata using multithreading. Please take a look [here](/connectors/ingestion/workflows/metadata/multithreading) before configuring this.

**databaseMetadataConfigType** *(string)*: Database Source Config Metadata Pipeline type.

**incremental (beta)**: Incremental Extraction configuration. Currently implemented for:

- [BigQuery](/connectors/ingestion/workflows/metadata/incremental-extraction/bigquery)
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -10,10 +10,12 @@
# includeOwners: false
# includeStoredProcedures: true
# includeDDL: true
# overrideMetadata: false
# queryLogDuration: 1
# queryParsingTimeoutLimit: 300
# useFqnForFiltering: false
# threads: 4
# threads: 1
# databaseMetadataConfigType: ()
# incremental:
# enabled: true
# lookbackDays: 7
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,8 @@ The `sourceConfig` is defined [here](https://github.com/open-metadata/OpenMetada

**includeDDL**: Optional configuration to toggle the DDL Statements ingestion.

**overrideMetadata** *(boolean)*: Set the 'Override Metadata' toggle to control whether to override the existing metadata in the OpenMetadata server with the metadata fetched from the source. If the toggle is set to true, the metadata fetched from the source will override the existing metadata in the OpenMetadata server. If the toggle is set to false, the metadata fetched from the source will not override the existing metadata in the OpenMetadata server. This is applicable for fields like description, tags, owner and displayName.

**queryLogDuration**: Configuration to tune how far we want to look back in query logs to process Stored Procedures results.

**queryParsingTimeoutLimit**: Configuration to set the timeout for parsing the query in seconds.
Expand All @@ -30,6 +32,8 @@ The `sourceConfig` is defined [here](https://github.com/open-metadata/OpenMetada

**threads (beta)**: The number of threads to use when extracting the metadata using multithreading. Please take a look [here](/connectors/ingestion/workflows/metadata/multithreading) before configuring this.

**databaseMetadataConfigType** *(string)*: Database Source Config Metadata Pipeline type.

**incremental (beta)**: Incremental Extraction configuration. Currently implemented for:

- [BigQuery](/connectors/ingestion/workflows/metadata/incremental-extraction/bigquery)
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -10,10 +10,12 @@
# includeOwners: false
# includeStoredProcedures: true
# includeDDL: true
# overrideMetadata: false
# queryLogDuration: 1
# queryParsingTimeoutLimit: 300
# useFqnForFiltering: false
# threads: 4
# threads: 1
# databaseMetadataConfigType: ()
# incremental:
# enabled: true
# lookbackDays: 7
Expand Down

0 comments on commit 0174139

Please sign in to comment.