Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

1.2.0-RC #40

Open
wants to merge 206 commits into
base: main-old
Choose a base branch
from
Open

1.2.0-RC #40

wants to merge 206 commits into from

Conversation

manjudr
Copy link
Collaborator

@manjudr manjudr commented Sep 24, 2024

No description provided.

pveleneni and others added 30 commits December 15, 2023 15:24
* Fix: removed docker secrets

* updated the grafana_secrete

* Feat: updated image tags according to release 1.1.0

* Issue #171 feat: update job to deployment for jobmanagers

* develop into release 1.3.0 (#97)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>

* Release 1.3.1 Changes (#109)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>

---------

Co-authored-by: GayathriSrividya <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Manjunath Davanam <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>
* Fix: removed docker secrets

* updated the grafana_secrete

* Feat: updated image tags according to release 1.1.0

* Issue #171 feat: update job to deployment for jobmanagers

* develop into release 1.3.0 (#97)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>

* Release 1.3.1 Changes (#109)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>

* Merge changes to release (#113)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

* feat new image tags (#112)

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>

---------

Co-authored-by: GayathriSrividya <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Praveen <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>
* Fix: removed docker secrets

* updated the grafana_secrete

* Feat: updated image tags according to release 1.1.0

* Issue #171 feat: update job to deployment for jobmanagers

* develop into release 1.3.0 (#97)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>

* Release 1.3.1 Changes (#109)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>

* Merge changes to release (#113)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

* feat new image tags (#112)

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>

* feat add kafka-connector release

* fixes

* [1/3] change instance from spot to on_demand [2/3] remove unwanted jobs [3/3] modify submit ingestion configmap

* #0 fix: update druid configurations and disable kafka-connector

* druid configuration changes for 30 workers

---------

Co-authored-by: GayathriSrividya <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Manjunath Davanam <[email protected]>
Co-authored-by: Praveen <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>
* Fix: removed docker secrets

* updated the grafana_secrete

* Feat: updated image tags according to release 1.1.0

* Issue #171 feat: update job to deployment for jobmanagers

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* develop into release 1.3.0 (#97)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

---------





* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

* feat new image tags (#112)

* * #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* * #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #000: Rebased the develop with release-1.0.0-GA

* #0000 - feat: Import error dashboard (#119)

* [ Secor Timzone ] - Infra automation changes to take the timezone property (#120)

* #000: Configuring the helm to handle the instance level timezone

* Removed the unwanted timezone properties

* #203: Removed the commented code

* #226 Feat: Update postgres migrations to add system settings and default values (#121)

* #226 fix: add system_settings table

* #226 fix: Add data encryption key to PostgreSQL migration

* #226 fix: move system settings new migration script

* update tags for ga release and fix undeclared variable in secor (#122)

* System Telemetry Events Ingestion Spec and Backup Configurations (#118)

* #223: Configured the auto submission of telemetry events ingestion spec and configured the secor backup for system telemetry events

* #223: Updated the secor jobs variabl by including system-telemetry-events process

* #203: typo error fix

* #203: Configured the flag to submit the ingestion spec

* #203: Configured the flag to submit the ingestion spec

* #67 fix: add grant permissions for created table (#123)

---------

Co-authored-by: Manjunath Davanam <[email protected]>
Co-authored-by: GayathriSrividya <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>
* #0 fix: update image tags for GA release

* #0 fix: add conflict handling for system settings
* Fix: removed docker secrets

* updated the grafana_secrete

* Feat: updated image tags according to release 1.1.0

* Issue #171 feat: update job to deployment for jobmanagers

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* develop into release 1.3.0 (#97)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

---------





* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

* feat new image tags (#112)

* * #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* * #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #000: Rebased the develop with release-1.0.0-GA

* #0000 - feat: Import error dashboard (#119)

* [ Secor Timzone ] - Infra automation changes to take the timezone property (#120)

* #000: Configuring the helm to handle the instance level timezone

* Removed the unwanted timezone properties

* #203: Removed the commented code

* #226 Feat: Update postgres migrations to add system settings and default values (#121)

* #226 fix: add system_settings table

* #226 fix: Add data encryption key to PostgreSQL migration

* #226 fix: move system settings new migration script

* update tags for ga release and fix undeclared variable in secor (#122)

* System Telemetry Events Ingestion Spec and Backup Configurations (#118)

* #223: Configured the auto submission of telemetry events ingestion spec and configured the secor backup for system telemetry events

* #223: Updated the secor jobs variabl by including system-telemetry-events process

* #203: typo error fix

* #203: Configured the flag to submit the ingestion spec

* #203: Configured the flag to submit the ingestion spec

* #67 fix: add grant permissions for created table (#123)

* #172 feat: add outputs for kafka service (#130)

* #172 feat: add outputs for kafka service (#132)

* #245 feat: Update Druid, PostgreSQL, and Superset versions (#133)

* #0 feat: Update Druid, PostgreSQL, and Superset versions

* #245 fix: Grant all privileges on schema to superset and druid_raw

* #245 fix: Update database ownership in migration scripts

* #241 Enhance Infrastructure Flexibility, Deployment Reliability, and Observability (#131)

* #241:feat: Infra automation script

* #241 feat: Toggle vpc creation, Toggle velero user creation

* update: #241 main.tf for velero user creation

* remove: #241 revert automation script changes

* update: #241 Toggle to change service type and dataset api cm bug fix

* #241:feat: Updated the infra setup shell script

* #241:doc: Updated the setup doc file

* #241:doc: Updated the setup doc file and removed commented code

* #241:doc: Added the Prerequisites section

* feat: #241 Toggle to enable cloudwatch logs for EKS

* feat: #241 Deployment changes to provision infra

* feat: # 241 Deployment script for provisioning infra

* clean: #241 remove unwanted code.

* update: #241 update helm version in shell script and remove overrides.tfvars file

* enhance: #241 Enhance shell script create a tfvars from setup.conf file

* fix: #241 typo in displayed message, fix terraform installation command

* update: #241 eks cluster version

* update: #241 kuberentes service type

* update: #241 kubernetes service type to loadbalancer

* Update helm version

---------



* update: AKS cluster version (#134)

* bug fix: #241 region typo and modify shell script (#135)

* bug fix: #241 region typo and modify shell script

* Bug fix: #241 modify velero module

* Installation fixes (#138)

* fix: installation-fixes and enhancements

* update: [1/2] Enabling cluster logs by default. [2/2] Creating vpc, kong ingress, velero user by default

* feat: Enable kafka connector and fix class name for kafka connector

* update: add decrypt command

* upgrade: eks version

* dummy commit to reflect changes

* dummy commit to reflect changes

* modify desired node capacity

* revert node capacity changes

---------

Co-authored-by: GayathriSrividya <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Praveen <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>
* #0000 update release tags

* #0000 revert flink image tag

* #0000 update image tag
* #0000 update release tags

* #0000 revert flink image tag

* #0000 update image tag

* #0 update flink image tag
* Fix: removed docker secrets

* updated the grafana_secrete

* Feat: updated image tags according to release 1.1.0

* Issue #171 feat: update job to deployment for jobmanagers

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* develop into release 1.3.0 (#97)

* #90 fix: Add default value for published_date in tables (#94)

* fix: remove restart policy from flink deployment manifest (#96)

* #196 Fix:Remove default region. (#95)

* fix: #196 remove default value for region

* update: #196 missing variable in variables.tf file

* #196 update:  example on how provide region

* #196 update: comments on how to provide region

* Separation of redis into dedup & meta/denorm. (#92)

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

* #58 feat: Separation of redis into dedup & meta/denorm.

---------

Co-authored-by: Praveen Veleneni <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>

* #126 feat: add new property to datasources table (#99)

* #126 feat: add new property to datasources table

* #126 fix: allow property to be nullable

* #0000 - feat: Fix masterdata stats ingestion spec (#100)

* #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* #0000 - feat: Flink helm configuration changes (#103)

* #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #0000 - feat: Secor changes for unified failed topic (#104)

* feat: azure terraform changes to provision cluster (#106)

* feat: azure terraform changes to provision cluster

* cleanup azure terraform code

* update node count and instance size for azure (#107)

* Issue #305 feat: exclude system-events for the datasource validation (#108)

* Issue #0000 fix: system events ingestion spec typo fix (#105)

* Issue #0000 fix: system events ingestion spec typo fix

* Issue #0000 fix: system-events ingestion spec update to add dataset_type

* #0 fix: add unique relation for source config table (#110)

* feat new image tags (#112)

* * #0000 - feat: Fix masterdata stats ingestion spec
* #0000 - feat: Add latency and processing times

* * #0000 - feat: Flink helm configuration changes

* #0000 - feat: Ingestion spec changes for system-events

* #0000 - feat: Remove outdated ingestion specs

* #000: Rebased the develop with release-1.0.0-GA

* #0000 - feat: Import error dashboard (#119)

* [ Secor Timzone ] - Infra automation changes to take the timezone property (#120)

* #000: Configuring the helm to handle the instance level timezone

* Removed the unwanted timezone properties

* #203: Removed the commented code

* #226 Feat: Update postgres migrations to add system settings and default values (#121)

* #226 fix: add system_settings table

* #226 fix: Add data encryption key to PostgreSQL migration

* #226 fix: move system settings new migration script

* update tags for ga release and fix undeclared variable in secor (#122)

* System Telemetry Events Ingestion Spec and Backup Configurations (#118)

* #223: Configured the auto submission of telemetry events ingestion spec and configured the secor backup for system telemetry events

* #223: Updated the secor jobs variabl by including system-telemetry-events process

* #203: typo error fix

* #203: Configured the flag to submit the ingestion spec

* #203: Configured the flag to submit the ingestion spec

* #67 fix: add grant permissions for created table (#123)

* #172 feat: add outputs for kafka service (#130)

* #172 feat: add outputs for kafka service (#132)

* #245 feat: Update Druid, PostgreSQL, and Superset versions (#133)

* #0 feat: Update Druid, PostgreSQL, and Superset versions

* #245 fix: Grant all privileges on schema to superset and druid_raw

* #245 fix: Update database ownership in migration scripts

* #241 Enhance Infrastructure Flexibility, Deployment Reliability, and Observability (#131)

* #241:feat: Infra automation script

* #241 feat: Toggle vpc creation, Toggle velero user creation

* update: #241 main.tf for velero user creation

* remove: #241 revert automation script changes

* update: #241 Toggle to change service type and dataset api cm bug fix

* #241:feat: Updated the infra setup shell script

* #241:doc: Updated the setup doc file

* #241:doc: Updated the setup doc file and removed commented code

* #241:doc: Added the Prerequisites section

* feat: #241 Toggle to enable cloudwatch logs for EKS

* feat: #241 Deployment changes to provision infra

* feat: # 241 Deployment script for provisioning infra

* clean: #241 remove unwanted code.

* update: #241 update helm version in shell script and remove overrides.tfvars file

* enhance: #241 Enhance shell script create a tfvars from setup.conf file

* fix: #241 typo in displayed message, fix terraform installation command

* update: #241 eks cluster version

* update: #241 kuberentes service type

* update: #241 kubernetes service type to loadbalancer

* Update helm version

---------

Co-authored-by: Manjunath Davanam <[email protected]>

* update: AKS cluster version (#134)

* bug fix: #241 region typo and modify shell script (#135)

* bug fix: #241 region typo and modify shell script

* Bug fix: #241 modify velero module

* Installation fixes (#138)

* fix: installation-fixes and enhancements

* update: [1/2] Enabling cluster logs by default. [2/2] Creating vpc, kong ingress, velero user by default

* feat: Enable kafka connector and fix class name for kafka connector

* update: add decrypt command

* upgrade: eks version

* dummy commit to reflect changes

* dummy commit to reflect changes

* modify desired node capacity

* revert node capacity changes

* #0000 upgrade eks add ons (#144)

* #0000 update granularity for system events and system telemetry events (#145)

* #0000 update granularity for system events and system telemetry events

* code refactoring

Signed-off-by: SurabhiAngadi <[email protected]>

* code refactoring

Signed-off-by: SurabhiAngadi <[email protected]>

* feat: added cluster-overrides.tfvars

Signed-off-by: SurabhiAngadi <[email protected]>

---------

Signed-off-by: SurabhiAngadi <[email protected]>
Co-authored-by: SurabhiAngadi <[email protected]>

* fix: Update default max.message.bytes configuration of kafka topic to 10mb. (#147)

* Installation fixes (#146)

* #000:feat: Updated the obsrv automation script

* #000:feat: Updated the obsrv automation script

* #000:feat: Updated the configurations

* #00 fix: update gcp automation scripts

* #00 fix: update gcp installation instructions

* feat: azure os helm chart

* #0000 update aks node count.

---------

Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: ManojKrishnaChintaluri <[email protected]>

---------

Signed-off-by: SurabhiAngadi <[email protected]>
Co-authored-by: GayathriSrividya <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Manjunath Davanam <[email protected]>
Co-authored-by: Praveen <[email protected]>
Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Ravinder Kumar <[email protected]>
Co-authored-by: SurabhiAngadi <[email protected]>
Co-authored-by: ManojKrishnaChintaluri <[email protected]>
* Sanketika-Obsrv/issue-tracker#65: fix:Bug fix terraform destroy deletes cloudwatch log group

* Sanketika-Obsrv/issue-tracker#65: fix:Bug fix terraform destroy deletes cloudwatch log group

* Sanketika-Obsrv/issue-tracker#65: fix:Bug fix terraform destroy deletes cloudwatch log group
* Sanketika-Obsrv/issue-tracker#8: doc: update shell script documentation for infra setup

* Sanketika-Obsrv/issue-tracker#8: doc: update azure documentation

* Sanketika-Obsrv/issue-tracker#8: doc: update AWS documentation for velero backup

* Sanketika-Obsrv/issue-tracker#8: fix: typo in installation doc
* #0000 feat azure terraform changes (#150)

* Local Installation Scripts (#151)

* Sanketika-Obsrv/issue-tracker#26: Helm Changes for Local Setup

* Sanketika-Obsrv/issue-tracker#26: CRD's for Local Setup

* delete cloudwatch loggroups when using terraform destroy

* Sanketika-Obsrv/issue-tracker#65: fix:Bug fix terraform destroy deletes cloudwatch log group

* Sanketika-Obsrv/issue-tracker#65: fix:Bug fix terraform destroy deletes cloudwatch log group

* Sanketika-Obsrv/issue-tracker#65: fix:Bug fix terraform destroy deletes cloudwatch log group

* Add connector info into system events ingestion spec. (#153)

* #8: Update Documentation for AWS and Azure (#154)

* Sanketika-Obsrv/issue-tracker#8: doc: update shell script documentation for infra setup

* Sanketika-Obsrv/issue-tracker#8: doc: update azure documentation

* Sanketika-Obsrv/issue-tracker#8: doc: update AWS documentation for velero backup

* Sanketika-Obsrv/issue-tracker#8: fix: typo in installation doc

---------

Co-authored-by: Manoj Krishna <[email protected]>
Co-authored-by: Ravi Mula <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Sowmya N Dixit <[email protected]>
Rakshitha-D and others added 30 commits December 31, 2024 10:10
* #I345: fix:automted private and public key generation

* #I345: fix:automated the keycloak helm chart

* #I345: fix:automated the keycloak helm chart

* #I345: fix:updated the keys file name

* #I345: fix:updated the keycloak database creation script

* #I345: fix:updated the .gitignore

* #I345: fix:updated the dataset-api and webconole config

* #I345: fix:updated the dataset-api and webconole config

* #OBS-I345 keycloak changes

* #OBS-I345 update letsencrypt bundle

* #OBS-I345 keycloak ingress and other changes

* OBS-I363 : fix:velero backup using service account

* Kafka exporter vulnerability fixes (#218)

* #I431: updated node js version

* #I431:  Removed unused package

* #I345: fix: private and public keys autoamtion and keycloak chanages

* #I345: fix: updated resource for keycloak service

* I345: fix:updated the configuration

* Critical Vulnerabilities Fixes (#216)

* #I431: 1. Upgraded the superset from 3.0.2 to 4.1.1
2. Velero Upgrade from 1.10.2 to 1.15.0
3. postgresql-exporter upgrade from v0.11.1 to v0.16.0
4. Grafana upgrade from 9.5.2 to 11.4.0

* #I431: 1.Upgrade the promtail from 2.7.4 to 3.2.2
2. Upgraded alertmanage from v0.25.0 to v0.28.0-rc.0
3. Upgraded the prometheus/node-exporter from v1.5.0 to v1.8.2
4. Upgraded the Postgres exporter from v0.11.1 to v0.16.0

* #I431: 1. Upgraded the grafana loki from 2.9.3 to 3.2.2

* #I431: 1. Upgraded the prom operator from v0.65.1 to v0.78.2

* #I431: 1. Upgraded the kube state metrics from 2.8.2 to 2.14.0

* #I431: 1. Upgraded the redis from 7.0.11-debian-11-r15 to 7.4.1

* #I431: 1. Upgraded the prometheus config reloader from v0.65.1 to v0.79.0 and nginx-unprivileged from 1.24-alpine to 1.27-alpine

* #I431: 1. Upgraded the prometheus config reloader from v0.65.1 to v0.79.0 and nginx-unprivileged from 1.24-alpine to 1.27-alpine

* #I431: 1. Resolved the vuln issues by upgrading certain dependencies

* #I431: 1. Vuln fixes

* #I431: 1.Upgrade the bats from v1.4.1 to 1.11.1

* #I431: Upgraded the golang in the druid exporter and disabled the grafana-testframework which is no longer needed

---------

Co-authored-by: Manjunath <[email protected]>

* I345: fix:removed the dev.tfvars file

* I345: fix:removed debug option in install.sh

* OBS-I392: fix:updated private and public keys configuration

* OBS-I392: fix:updated private and public keys configuration

* OBS-I392: fix:updated private and public keys configuration

* #OBS-I345 disable keycloak auth until superset and grafana are configured

* #OBS-I345 feat: Add Dockerfile for Superset (#220)

* #OBS-I438 superset and other fixes

* #OBS-I438 superset and other fixes

* #OBS-I199 disable oauth local dc

* #OBS-I199 disable oauth in all

* #OBS-I345 add hosts only if ssl is enabled

* #OBS-I345 disable kong in local dc

* #OBS-I433 flink sa default to false

* #OBS-I433 flink with credentials

* #OBS-I433 flink with credentials

* #OBS-I433 flink remove incorrect vals

* #OBS-I345 update default keys

* #OBS-I437 upgrade loki helm chart

* #OBS-I437 upgrade loki values

* #OBS-I437 update loki configurations

* #OBS-I393: remove dev prefix from all the kafka topics wherevere configured.

* #OBS-I436 update install.sh to take args

* #OBS-I436 update values.yaml web-console

* #OBS-I436 update secret creation jobs

* #OBS-I448 automate creation of keys

* #OBS-I448 fix reflection ns

* #OBS-I436 update masterdata to cacheidx

* #OBS-I436 update postgres backup image

* #OBS-I345 feat: Add Dockerfile for Superset (#220)

* #OBS-I436 images

---------

Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: divyagovindaiah <[email protected]>
Co-authored-by: Harish Kumar Gangula <[email protected]>
Co-authored-by: Manjunath Davanam <[email protected]>
Co-authored-by: Manjunath <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: SurabhiAngadi <[email protected]>
I392 fix:removed the schedule chnages in velero valyes.yaml file
fix: #OBS-I406 storage type support envs
fix: update role for obsrv_admin
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.