Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue #305 feat: exclude system-events for the datasource validation #108

Merged
merged 1 commit into from
Dec 15, 2023

Conversation

yravinderkumar33
Copy link

No description provided.

@manjudr manjudr merged commit 7e9dc31 into develop Dec 15, 2023
manjudr added a commit that referenced this pull request Dec 15, 2023
* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>
manjudr added a commit that referenced this pull request Dec 15, 2023
* Fix: removed docker secrets

* updated the grafana_secrete

* Feat: updated image tags according to release 1.1.0

* Issue #171 feat: update job to deployment for jobmanagers

* develop into release 1.3.0 (#97)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>

* Release 1.3.1 Changes (#109)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>

---------

Co-authored-by: GayathriSrividya <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Manjunath Davanam <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>
manjudr pushed a commit that referenced this pull request Dec 15, 2023
* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

* feat new image tags (#112)

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>
manjudr added a commit that referenced this pull request Dec 15, 2023
* Fix: removed docker secrets

* updated the grafana_secrete

* Feat: updated image tags according to release 1.1.0

* Issue #171 feat: update job to deployment for jobmanagers

* develop into release 1.3.0 (#97)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>

* Release 1.3.1 Changes (#109)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>

* Merge changes to release (#113)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

* feat new image tags (#112)

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>

---------

Co-authored-by: GayathriSrividya <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Praveen <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>
manjudr added a commit that referenced this pull request Dec 18, 2023
* Fix: removed docker secrets

* updated the grafana_secrete

* Feat: updated image tags according to release 1.1.0

* Issue #171 feat: update job to deployment for jobmanagers

* develop into release 1.3.0 (#97)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>

* Release 1.3.1 Changes (#109)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>

* Merge changes to release (#113)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

* feat new image tags (#112)

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>

* feat add kafka-connector release

* fixes

* [1/3] change instance from spot to on_demand [2/3] remove unwanted jobs [3/3] modify submit ingestion configmap

* #0 fix: update druid configurations and disable kafka-connector

* druid configuration changes for 30 workers

---------

Co-authored-by: GayathriSrividya <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Manjunath Davanam <[email protected]>
Co-authored-by: Praveen <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>
manjudr added a commit that referenced this pull request Dec 26, 2023
* Fix: removed docker secrets

* updated the grafana_secrete

* Feat: updated image tags according to release 1.1.0

* Issue #171 feat: update job to deployment for jobmanagers

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* develop into release 1.3.0 (#97)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

* feat new image tags (#112)

* * #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* * #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #000: Rebased the develop with release-1.0.0-GA

* #0000 - feat: Import error dashboard (#119)

* [ Secor Timzone ] - Infra automation changes to take the timezone property (#120)

* #000: Configuring the helm to handle the instance level timezone

* Removed the unwanted timezone properties

* #203: Removed the commented code

* #226 Feat: Update postgres migrations to add system settings and default values (#121)

* #226 fix: add system_settings table

* #226 fix: Add data encryption key to PostgreSQL migration

* #226 fix: move system settings new migration script

* update tags for ga release and fix undeclared variable in secor (#122)

* System Telemetry Events Ingestion Spec and Backup Configurations (#118)

* #223: Configured the auto submission of telemetry events ingestion spec and configured the secor backup for system telemetry events

* #223: Updated the secor jobs variabl by including system-telemetry-events process

* #203: typo error fix

* #203: Configured the flag to submit the ingestion spec

* #203: Configured the flag to submit the ingestion spec

* #67 fix: add grant permissions for created table (#123)

---------

Co-authored-by: GayathriSrividya <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Praveen <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>
manjudr added a commit that referenced this pull request Dec 26, 2023
* Fix: removed docker secrets

* updated the grafana_secrete

* Feat: updated image tags according to release 1.1.0

* Issue #171 feat: update job to deployment for jobmanagers

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* develop into release 1.3.0 (#97)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

---------





* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

* feat new image tags (#112)

* * #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* * #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #000: Rebased the develop with release-1.0.0-GA

* #0000 - feat: Import error dashboard (#119)

* [ Secor Timzone ] - Infra automation changes to take the timezone property (#120)

* #000: Configuring the helm to handle the instance level timezone

* Removed the unwanted timezone properties

* #203: Removed the commented code

* #226 Feat: Update postgres migrations to add system settings and default values (#121)

* #226 fix: add system_settings table

* #226 fix: Add data encryption key to PostgreSQL migration

* #226 fix: move system settings new migration script

* update tags for ga release and fix undeclared variable in secor (#122)

* System Telemetry Events Ingestion Spec and Backup Configurations (#118)

* #223: Configured the auto submission of telemetry events ingestion spec and configured the secor backup for system telemetry events

* #223: Updated the secor jobs variabl by including system-telemetry-events process

* #203: typo error fix

* #203: Configured the flag to submit the ingestion spec

* #203: Configured the flag to submit the ingestion spec

* #67 fix: add grant permissions for created table (#123)

---------

Co-authored-by: Manjunath Davanam <[email protected]>
Co-authored-by: GayathriSrividya <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>
@ManojKrishnaChintaluri ManojKrishnaChintaluri deleted the exclude-system-events-ds-validation branch January 25, 2024 06:56
manjudr added a commit that referenced this pull request Jan 29, 2024
* Fix: removed docker secrets

* updated the grafana_secrete

* Feat: updated image tags according to release 1.1.0

* Issue #171 feat: update job to deployment for jobmanagers

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* develop into release 1.3.0 (#97)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

* feat new image tags (#112)

* * #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* * #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #000: Rebased the develop with release-1.0.0-GA

* #0000 - feat: Import error dashboard (#119)

* [ Secor Timzone ] - Infra automation changes to take the timezone property (#120)

* #000: Configuring the helm to handle the instance level timezone

* Removed the unwanted timezone properties

* #203: Removed the commented code

* #226 Feat: Update postgres migrations to add system settings and default values (#121)

* #226 fix: add system_settings table

* #226 fix: Add data encryption key to PostgreSQL migration

* #226 fix: move system settings new migration script

* update tags for ga release and fix undeclared variable in secor (#122)

* System Telemetry Events Ingestion Spec and Backup Configurations (#118)

* #223: Configured the auto submission of telemetry events ingestion spec and configured the secor backup for system telemetry events

* #223: Updated the secor jobs variabl by including system-telemetry-events process

* #203: typo error fix

* #203: Configured the flag to submit the ingestion spec

* #203: Configured the flag to submit the ingestion spec

* #67 fix: add grant permissions for created table (#123)

* #172 feat: add outputs for kafka service (#130)

* #172 feat: add outputs for kafka service (#132)

* #245 feat: Update Druid, PostgreSQL, and Superset versions (#133)

* #0 feat: Update Druid, PostgreSQL, and Superset versions

* #245 fix: Grant all privileges on schema to superset and druid_raw

* #245 fix: Update database ownership in migration scripts

* #241 Enhance Infrastructure Flexibility, Deployment Reliability, and Observability (#131)

* #241:feat: Infra automation script

* #241 feat: Toggle vpc creation, Toggle velero user creation

* update: #241 main.tf for velero user creation

* remove: #241 revert automation script changes

* update: #241 Toggle to change service type and dataset api cm bug fix

* #241:feat: Updated the infra setup shell script

* #241:doc: Updated the setup doc file

* #241:doc: Updated the setup doc file and removed commented code

* #241:doc: Added the Prerequisites section

* feat: #241 Toggle to enable cloudwatch logs for EKS

* feat: #241 Deployment changes to provision infra

* feat: # 241 Deployment script for provisioning infra

* clean: #241 remove unwanted code.

* update: #241 update helm version in shell script and remove overrides.tfvars file

* enhance: #241 Enhance shell script create a tfvars from setup.conf file

* fix: #241 typo in displayed message, fix terraform installation command

* update: #241 eks cluster version

* update: #241 kuberentes service type

* update: #241 kubernetes service type to loadbalancer

* Update helm version

---------

Co-authored-by: Manjunath Davanam <[email protected]>

* update: AKS cluster version (#134)

* bug fix: #241 region typo and modify shell script (#135)

* bug fix: #241 region typo and modify shell script

* Bug fix: #241 modify velero module

* Installation fixes (#138)

* fix: installation-fixes and enhancements

* update: [1/2] Enabling cluster logs by default. [2/2] Creating vpc, kong ingress, velero user by default

* feat: Enable kafka connector and fix class name for kafka connector

* update: add decrypt command

* upgrade: eks version

* dummy commit to reflect changes

* dummy commit to reflect changes

* modify desired node capacity

* revert node capacity changes

---------

Co-authored-by: GayathriSrividya <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Praveen <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>
@manjudr manjudr mentioned this pull request Jan 29, 2024
manjudr added a commit that referenced this pull request Jan 29, 2024
* Fix: removed docker secrets

* updated the grafana_secrete

* Feat: updated image tags according to release 1.1.0

* Issue #171 feat: update job to deployment for jobmanagers

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* develop into release 1.3.0 (#97)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

---------





* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

* feat new image tags (#112)

* * #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* * #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #000: Rebased the develop with release-1.0.0-GA

* #0000 - feat: Import error dashboard (#119)

* [ Secor Timzone ] - Infra automation changes to take the timezone property (#120)

* #000: Configuring the helm to handle the instance level timezone

* Removed the unwanted timezone properties

* #203: Removed the commented code

* #226 Feat: Update postgres migrations to add system settings and default values (#121)

* #226 fix: add system_settings table

* #226 fix: Add data encryption key to PostgreSQL migration

* #226 fix: move system settings new migration script

* update tags for ga release and fix undeclared variable in secor (#122)

* System Telemetry Events Ingestion Spec and Backup Configurations (#118)

* #223: Configured the auto submission of telemetry events ingestion spec and configured the secor backup for system telemetry events

* #223: Updated the secor jobs variabl by including system-telemetry-events process

* #203: typo error fix

* #203: Configured the flag to submit the ingestion spec

* #203: Configured the flag to submit the ingestion spec

* #67 fix: add grant permissions for created table (#123)

* #172 feat: add outputs for kafka service (#130)

* #172 feat: add outputs for kafka service (#132)

* #245 feat: Update Druid, PostgreSQL, and Superset versions (#133)

* #0 feat: Update Druid, PostgreSQL, and Superset versions

* #245 fix: Grant all privileges on schema to superset and druid_raw

* #245 fix: Update database ownership in migration scripts

* #241 Enhance Infrastructure Flexibility, Deployment Reliability, and Observability (#131)

* #241:feat: Infra automation script

* #241 feat: Toggle vpc creation, Toggle velero user creation

* update: #241 main.tf for velero user creation

* remove: #241 revert automation script changes

* update: #241 Toggle to change service type and dataset api cm bug fix

* #241:feat: Updated the infra setup shell script

* #241:doc: Updated the setup doc file

* #241:doc: Updated the setup doc file and removed commented code

* #241:doc: Added the Prerequisites section

* feat: #241 Toggle to enable cloudwatch logs for EKS

* feat: #241 Deployment changes to provision infra

* feat: # 241 Deployment script for provisioning infra

* clean: #241 remove unwanted code.

* update: #241 update helm version in shell script and remove overrides.tfvars file

* enhance: #241 Enhance shell script create a tfvars from setup.conf file

* fix: #241 typo in displayed message, fix terraform installation command

* update: #241 eks cluster version

* update: #241 kuberentes service type

* update: #241 kubernetes service type to loadbalancer

* Update helm version

---------



* update: AKS cluster version (#134)

* bug fix: #241 region typo and modify shell script (#135)

* bug fix: #241 region typo and modify shell script

* Bug fix: #241 modify velero module

* Installation fixes (#138)

* fix: installation-fixes and enhancements

* update: [1/2] Enabling cluster logs by default. [2/2] Creating vpc, kong ingress, velero user by default

* feat: Enable kafka connector and fix class name for kafka connector

* update: add decrypt command

* upgrade: eks version

* dummy commit to reflect changes

* dummy commit to reflect changes

* modify desired node capacity

* revert node capacity changes

---------

Co-authored-by: GayathriSrividya <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Praveen <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>
ravismula added a commit that referenced this pull request Feb 16, 2024
* Fix: removed docker secrets

* updated the grafana_secrete

* Feat: updated image tags according to release 1.1.0

* Issue #171 feat: update job to deployment for jobmanagers

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* develop into release 1.3.0 (#97)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

* feat new image tags (#112)

* * #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* * #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #000: Rebased the develop with release-1.0.0-GA

* #0000 - feat: Import error dashboard (#119)

* [ Secor Timzone ] - Infra automation changes to take the timezone property (#120)

* #000: Configuring the helm to handle the instance level timezone

* Removed the unwanted timezone properties

* #203: Removed the commented code

* #226 Feat: Update postgres migrations to add system settings and default values (#121)

* #226 fix: add system_settings table

* #226 fix: Add data encryption key to PostgreSQL migration

* #226 fix: move system settings new migration script

* update tags for ga release and fix undeclared variable in secor (#122)

* System Telemetry Events Ingestion Spec and Backup Configurations (#118)

* #223: Configured the auto submission of telemetry events ingestion spec and configured the secor backup for system telemetry events

* #223: Updated the secor jobs variabl by including system-telemetry-events process

* #203: typo error fix

* #203: Configured the flag to submit the ingestion spec

* #203: Configured the flag to submit the ingestion spec

* #67 fix: add grant permissions for created table (#123)

* #172 feat: add outputs for kafka service (#130)

* #172 feat: add outputs for kafka service (#132)

* #245 feat: Update Druid, PostgreSQL, and Superset versions (#133)

* #0 feat: Update Druid, PostgreSQL, and Superset versions

* #245 fix: Grant all privileges on schema to superset and druid_raw

* #245 fix: Update database ownership in migration scripts

* #241 Enhance Infrastructure Flexibility, Deployment Reliability, and Observability (#131)

* #241:feat: Infra automation script

* #241 feat: Toggle vpc creation, Toggle velero user creation

* update: #241 main.tf for velero user creation

* remove: #241 revert automation script changes

* update: #241 Toggle to change service type and dataset api cm bug fix

* #241:feat: Updated the infra setup shell script

* #241:doc: Updated the setup doc file

* #241:doc: Updated the setup doc file and removed commented code

* #241:doc: Added the Prerequisites section

* feat: #241 Toggle to enable cloudwatch logs for EKS

* feat: #241 Deployment changes to provision infra

* feat: # 241 Deployment script for provisioning infra

* clean: #241 remove unwanted code.

* update: #241 update helm version in shell script and remove overrides.tfvars file

* enhance: #241 Enhance shell script create a tfvars from setup.conf file

* fix: #241 typo in displayed message, fix terraform installation command

* update: #241 eks cluster version

* update: #241 kuberentes service type

* update: #241 kubernetes service type to loadbalancer

* Update helm version

---------

Co-authored-by: Manjunath Davanam <[email protected]>

* update: AKS cluster version (#134)

* bug fix: #241 region typo and modify shell script (#135)

* bug fix: #241 region typo and modify shell script

* Bug fix: #241 modify velero module

* Installation fixes (#138)

* fix: installation-fixes and enhancements

* update: [1/2] Enabling cluster logs by default. [2/2] Creating vpc, kong ingress, velero user by default

* feat: Enable kafka connector and fix class name for kafka connector

* update: add decrypt command

* upgrade: eks version

* dummy commit to reflect changes

* dummy commit to reflect changes

* modify desired node capacity

* revert node capacity changes

* #0000 upgrade eks add ons (#144)

* #0000 update granularity for system events and system telemetry events (#145)

* #0000 update granularity for system events and system telemetry events

* code refactoring

Signed-off-by: SurabhiAngadi <[email protected]>

* code refactoring

Signed-off-by: SurabhiAngadi <[email protected]>

* feat: added cluster-overrides.tfvars

Signed-off-by: SurabhiAngadi <[email protected]>

---------

Signed-off-by: SurabhiAngadi <[email protected]>
Co-authored-by: SurabhiAngadi <[email protected]>

* fix: Update default max.message.bytes configuration of kafka topic to 10mb. (#147)

* Installation fixes (#146)

* #000:feat: Updated the obsrv automation script

* #000:feat: Updated the obsrv automation script

* #000:feat: Updated the configurations

* #00 fix: update gcp automation scripts

* #00 fix: update gcp installation instructions

* feat: azure os helm chart

* #0000 update aks node count.

---------

Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: ManojKrishnaChintaluri <[email protected]>

---------

Signed-off-by: SurabhiAngadi <[email protected]>
Co-authored-by: GayathriSrividya <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Manjunath Davanam <[email protected]>
Co-authored-by: Praveen <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>
Co-authored-by: SurabhiAngadi <[email protected]>
Co-authored-by: ManojKrishnaChintaluri <[email protected]>
sowmya-dixit added a commit that referenced this pull request Mar 18, 2024
* Release 1.3.1 into Main (#111)

* Fix: removed docker secrets

* updated the grafana_secrete

* Feat: updated image tags according to release 1.1.0

* Issue #171 feat: update job to deployment for jobmanagers

* develop into release 1.3.0 (#97)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>

* Release 1.3.1 Changes (#109)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>

---------

Co-authored-by: GayathriSrividya <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Manjunath Davanam <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>

* Release 1.3.1 into Main (#114)

* Fix: removed docker secrets

* updated the grafana_secrete

* Feat: updated image tags according to release 1.1.0

* Issue #171 feat: update job to deployment for jobmanagers

* develop into release 1.3.0 (#97)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>

* Release 1.3.1 Changes (#109)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>

* Merge changes to release (#113)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

* feat new image tags (#112)

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>

---------

Co-authored-by: GayathriSrividya <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Praveen <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>

* 1.3.1 Release fixes (#115)

* Fix: removed docker secrets

* updated the grafana_secrete

* Feat: updated image tags according to release 1.1.0

* Issue #171 feat: update job to deployment for jobmanagers

* develop into release 1.3.0 (#97)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>

* Release 1.3.1 Changes (#109)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>

* Merge changes to release (#113)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

* feat new image tags (#112)

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>

* feat add kafka-connector release

* fixes

* [1/3] change instance from spot to on_demand [2/3] remove unwanted jobs [3/3] modify submit ingestion configmap

* #0 fix: update druid configurations and disable kafka-connector

* druid configuration changes for 30 workers

---------

Co-authored-by: GayathriSrividya <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Manjunath Davanam <[email protected]>
Co-authored-by: Praveen <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>

* Develop to release-1.0.0-GA (#124) (#125)

* Fix: removed docker secrets

* updated the grafana_secrete

* Feat: updated image tags according to release 1.1.0

* Issue #171 feat: update job to deployment for jobmanagers

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* develop into release 1.3.0 (#97)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

---------





* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

* feat new image tags (#112)

* * #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* * #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #000: Rebased the develop with release-1.0.0-GA

* #0000 - feat: Import error dashboard (#119)

* [ Secor Timzone ] - Infra automation changes to take the timezone property (#120)

* #000: Configuring the helm to handle the instance level timezone

* Removed the unwanted timezone properties

* #203: Removed the commented code

* #226 Feat: Update postgres migrations to add system settings and default values (#121)

* #226 fix: add system_settings table

* #226 fix: Add data encryption key to PostgreSQL migration

* #226 fix: move system settings new migration script

* update tags for ga release and fix undeclared variable in secor (#122)

* System Telemetry Events Ingestion Spec and Backup Configurations (#118)

* #223: Configured the auto submission of telemetry events ingestion spec and configured the secor backup for system telemetry events

* #223: Updated the secor jobs variabl by including system-telemetry-events process

* #203: typo error fix

* #203: Configured the flag to submit the ingestion spec

* #203: Configured the flag to submit the ingestion spec

* #67 fix: add grant permissions for created table (#123)

---------

Co-authored-by: Manjunath Davanam <[email protected]>
Co-authored-by: GayathriSrividya <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>

* #0 fix: update image tags for GA release (#126)

* #0 fix: update image tags for GA release

* #0 fix: add conflict handling for system settings

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: GayathriSrividya <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Manjunath Davanam <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants