Update dependency acryl-datahub to v0.15.0.2

[renovate]

This PR contains the following updates:

Package	Change	Age	Adoption	Passing	Confidence
acryl-datahub (source, changelog)	==0.8.17.6 -> ==0.15.0.2
acryl-datahub (source, changelog)	==0.8.17.7 -> ==0.15.0.2

---

Warning

Some dependencies could not be looked up. Check the Dependency Dashboard for more information.

---

Release Notes

datahub-project/datahub (acryl-datahub)

v0.15.0

DataHub v0.15.0 Release Notes

User Experience

• Structured Properties

  • Added comprehensive support for managing structured properties, including creation, editing, deletion, and display preferences. Introduced timestamps for tracking creation and modification. [#​12100, #​11419]
  • Enhanced property display options with badge styling, custom column types, and configurable visibility settings in asset sidebars and schema fields. [#​12111, #​12052]
  • Added structured property filtering in UI with improved aggregation logic and entity metadata display. Introduced new property validators and display settings. [#​12097, #​12099]

• UI Enhancements

  • Enhanced container organization with parent hierarchy labels. [#​11705]
  • Added support for markdown in incident descriptions, enabling rich formatting capabilities. [#​11759]
  • Improved ingestion reporting with better visibility of successful ingestions with warnings. Enhanced browse paths display for business attributes and schema fields. [#​11704, #​11585]
  • Added support for timeseries aspects in OpenAPI and customizable date range fields for Analytics charts. [#​12096, #​11366]

• Authorization & Authentication

  • Enabled authentication and API authorization by default, with support for URN-wildcard-based policies using STARTS_WITH condition. [#​11484, #​11441]
  • Added authorization checks for managing Glossary terms, including privileges for ownership, domain management, and link actions. [#​11337]

Metadata Ingestion

Ingestion Framework Improvements

• Enhanced Data Source Support: Expanded ingestion capabilities for multiple platforms, including Superset (with dataset entities, schema fields, and column-level lineage), Feast (supporting tags and owners ingestion), Neo4j, and Cassandra. Added stateful ingestion support for file sources. [#​11688, #​11784, #​11804, #​11526, #​11822]

• SQL Processing Improvements: Replaced vulnerable sqlparse dependency with an in-house SQL parser, optimized CLL generation with reduced memory usage, and added special handling for MSSQL case sensitivity. Enhanced multi-query lineage support for Snowflake temporary tables. [#​11645, #​11708, #​11920, #​12020]

• CLI Enhancements: Introduced new commands for managing ingestion, including listing source runs with filtering capabilities, undoing soft deletes with platform filtering, and listing structured properties. Added an offline flag to the SQL parser CLI. [#​11740, #​11980, #​12012, #​12283, #​11635]

• Ownership and Metadata Management: Extended ownership transformer capabilities across entities, improved glossary sync to preserve custom ownership types, and added support for multiple ownership types in glossaries and terms. Enhanced Forms CLI with additional filters for subtypes, platform instances, owners, tags, and glossary terms. [#​11700, #​11545, #​12050, #​10979]

• Core Infrastructure Improvements: Implemented unique URN generation for all entities, added support for efficient entity ingestion through get_entity_as_mcps, improved empty field handling, and introduced progress reporting during ingestion. Added execution request cleanup job and support for dropping duplicate schema fields. [#​11676, #​11425, #​11613, #​12117, #​11765, #​12308]

Source-Specific Ingestion Improvements

Airflow

• Upgraded infrastructure with support for Airflow 2.10, deprecated versions below 2.3, and improved template handling with Jinja support. Added configuration options for dag patterns and environment variables. [#​11300, #​11371, #​11472, #​11537, #​11579, #​12056]
• Enhanced error handling and debugging with improved logging, fixed plugin stability issues on EMR, and added support for AthenaOperator lineage extraction. Introduced ability to disable plugin without restart. [#​11857, #​11877, #​11880, #​12098]

BigQuery

• Enhanced data modeling capabilities with support for foreign/primary keys, BigLake tables, and improved handling of external tables. Added support for region qualifiers and partition management. [#​11686, #​11728, #​11874, #​11940]
• Improved lineage tracking with GCS data source support and optimized query performance. Added platform resource entity generation from BigQuery labels. [#​11442, #​11492, #​11534, #​11602]
• Enhanced profiling and performance with better type handling and size limits. Fixed issues with tag synchronization and platform instance settings. [#​11807, #​12060]

Dagster

• Added support for skipping Asset ingestion, fixed input/output value formatting, and improved compatibility with latest Dagster versions (v1.9.6). Deprecated Python 3.8 support. [#​11262, #​11481, #​12121, #​12189]

dbt

• Improved performance and functionality with node_name_patterns for faster CLL processing, support for multiple test paths, and better handling of custom owner types. [#​11450, #​11460, #​11848]
• Enhanced lineage handling by preventing cycles in SQL parsing and supporting multiple dataset assertions for tests. Added support for dbt Cloud's Explore page. [#​11666, #​11451, #​12223]

Snowflake

• Expanded support for various table types, including secure, dynamic, and hybrid tables. Enhanced lineage capabilities for renames, swaps, and external tables. [#​11600, #​12039, #​12094, #​12179]
• Improved authentication with OAuth support and token management. Added incremental property processing and structured property support for tags. [#​11888, #​12048, #​12080, #​12285]
• Enhanced error handling and logging with better parse failure reporting and dot handling in table names. [#​12105, #​12110, #​12153]

Tableau

• Enhanced project management with new path pattern filtering and improved handling of hidden assets. Added support for access roles and group permissions. [#​10855, #​11157, #​11559]
• Improved API integration with retry logic for various error codes (502, 504), better authentication handling, and consistent page size application. [#​12213, #​12216, #​12233]
• Enhanced reporting and debugging capabilities while maintaining efficient performance and proper permission handling. [#​12015, #​12024, #​12175]

PowerBI

• Improved M-query parsing with support for comments, better handling of quotes, and DatabricksMultiCloud native query functionality. [#​12177, #​11743, #​11756]
• Enhanced workspace management with cross-workspace dataset linking and app ingestion support. Added timeouts for M-query parsing. [#​11560, #​11629, #​11753]
• Improved error reporting and performance optimization with reduced type casting and better organization of responsibilities. [#​11763, #​12004]

Developer Experience

• Entity Management: Introduced entity versioning for Datasets and ML Models, with support for version set linking. Improved timeline functionality with better handling of primary key changes and rename events. Added data transformation logic models to enhance data processing capabilities. [#​11819, #​11843, #​12166, #​12198]

• Enhanced Configuration Management: Added new customization options through environment variables and Helm charts, including editable dataset names and configurable garbage collection scheduling. The bootstrap process has been optimized to reduce latency during installation. [#​11391, #​11518]

• Development Environment Updates: Added Git support to the ingestion-base image, enabling better source control integration for ingestion workflows. [#​11477]

• Security Logging Enhancement: Improved security audit trails by adding actor URN tracking for unauthorized access attempts. [#​12030]

NEW: Garbage Collection

• Comprehensive Metadata Cleanup: Introduced a new ingestion source: DataHubGC to function as a garbage collector for managing dataflows, data jobs, and data process instances, with configurable retention policies and deletion parameters. Added dry run mode for testing cleanup operations. [#​11102, #​11413]

• Performance Optimizations: Significantly improved processing speed from 1 hour to 15 minutes by implementing batch processing, optimizing queries, and removing unnecessary operations. Increased default hard delete limit from 10k to 25k entities. [#​11809, #​12093, #​12238]

• Reliability Improvements: Enhanced garbage collection stability with additional validation checks, improved error handling, and better process visibility through ingestion stage reporting. Fixed issues with entity deletion logic and reference handling to preserve critical lineage relationships. [#​12011, #​12013, #​12027, #​12049, #​12124, #​12226]

Thank You to Our Contributors!

First-Time Contributors

@​AColocho, @​alberttwong, @​Alice-608, @​Bumyu, @​chakru-r, @​chriscc2, @​dejan2609, @​donovan-acryl, @​eagle-25, @​hwmarkcheng, @​k-bartlett, @​kanavnarula, @​kartikey-visa, @​kevinkarchacryl, @​kousiknandy, @​kris48k, @​llance, @​margaridafernandes-trip, @​mikeburke24, @​raudzis, @​ronybony1990, @​ryota-cloud, @​shepherd44, @​siong-tcha, @​ssidorenko, @​tanguyantoine, @​th0ger, @​udays-visa, @​udbhav-hbk, @​vejeta

Repeat Contributors

@​aviv-julienjehannet, @​bda618, @​bossenti, @​darnaut, @​deepgarg-visa, @​DSchmidtDev, @​dushayntAW, @​eboneil, @​ethan-cartwright, @​feldjay, @​githendrik, @​haeniya, @​Jorricks, @​Masterchen09, @​mkamalas, @​Nbagga14, @​nicholas-fwang, @​noggi, @​pankajmahato-visa, @​pinakipb2, @​rtekal, @​sagar-salvi-apptware, @​steffengr

DataHub Maintainers

@​acrylJonny, @​anshbansal, @​asikowitz, @​chriscollins3456, @​david-leifker, @​gabe-lyons, @​hsheth2, @​jayacryl, @​jjoyce0510, @​maggiehays, @​mayurinehate, @​pedro93, @​RyanHolstien, @​sakethvarma397, @​sgomezvillamor, @​shirshanka, @​sid-acryl, @​skrydal, @​treff7es, @​yoonhyejin

What's Changed

• fix(ingest): override setdefault in file-backed dict by @​hsheth2 in https://github.com/datahub-project/datahub/pull/11359
• fix(ingest/airflow): simplify env configuration by @​hsheth2 in https://github.com/datahub-project/datahub/pull/11371
• fix(airflow): added support for jinja template for datahub emitter operator by @​dushayntAW in https://github.com/datahub-project/datahub/pull/11300
• fix(smoke-test): add wait for sync to smoke-test by @​david-leifker in https://github.com/datahub-project/datahub/pull/11405
• fix(customSearch): apply query string interpolation to function score by @​RyanHolstien in https://github.com/datahub-project/datahub/pull/11406
• fix(docs): Fix typo in bigquery permissions error by @​gabe-lyons in https://github.com/datahub-project/datahub/pull/11401
• build(deps-dev): bump vite from 4.5.3 to 4.5.5 in /datahub-web-react by @​dependabot in https://github.com/datahub-project/datahub/pull/11410
• feat(ingest/gc): Add dataflow and soft deleted entities cleanup by @​treff7es in https://github.com/datahub-project/datahub/pull/11102
• feat(ingestion): adds env property in ContainerProperties by @​sgomezvillamor in https://github.com/datahub-project/datahub/pull/11214
• feat(ingest/gc): Add dry run mode to gc recipe by @​treff7es in https://github.com/datahub-project/datahub/pull/11413
• feat(kafka-setup): allow override KAFKA_HEAP_OPTS by @​david-leifker in https://github.com/datahub-project/datahub/pull/11400
• chore(docs): update release notes v0.14.1 by @​david-leifker in https://github.com/datahub-project/datahub/pull/11408
• Advance search - Added case sensitive flag for wildcard searches by @​kanavnarula in https://github.com/datahub-project/datahub/pull/11272
• fix(changeGenerator): fixes schema change generator corner cases v2 by @​RyanHolstien in https://github.com/datahub-project/datahub/pull/11386
• feat(docs-site) datahub homepage v2 by @​jayacryl in https://github.com/datahub-project/datahub/pull/11342
• feat(structuredProps) Add created and lastModified timestamps to structured prop entity by @​chriscollins3456 in https://github.com/datahub-project/datahub/pull/11419
• feat(docs-site) tours to open in a modal by @​jayacryl in https://github.com/datahub-project/datahub/pull/11420
• feat(structuredProps) Add delete structured props endpoint and handle null props by @​chriscollins3456 in https://github.com/datahub-project/datahub/pull/11418
• test(ingest/mcp_diff): Fallback to overwriting file on more complicated diffs by @​asikowitz in https://github.com/datahub-project/datahub/pull/11407
• feat(docs-site) fixed home paddings on mobile site by @​jayacryl in https://github.com/datahub-project/datahub/pull/11431
• feat(ingest): add get_entity_as_mcps method to client by @​hsheth2 in https://github.com/datahub-project/datahub/pull/11425
• fix(siblings) Combine siblings in embedded search results by @​chriscollins3456 in https://github.com/datahub-project/datahub/pull/11421
• fix(structuredProps) Fix adding new allowed types in updateStructuredProp endpoint by @​chriscollins3456 in https://github.com/datahub-project/datahub/pull/11424
• build(deps): bump path-to-regexp from 1.8.0 to 1.9.0 in /datahub-web-react by @​dependabot in https://github.com/datahub-project/datahub/pull/11356
• chore(bump): bump spring versions by @​david-leifker in https://github.com/datahub-project/datahub/pull/11435
• chore(bump): pac4j version by @​david-leifker in https://github.com/datahub-project/datahub/pull/11436
• fix(graphql/getDataset): Do not fetch parent for schema fields by @​asikowitz in https://github.com/datahub-project/datahub/pull/11434
• build: allow gradle daemon by @​hsheth2 in https://github.com/datahub-project/datahub/pull/11437
• fix(ingest/dbt): handle null index values by @​hsheth2 in https://github.com/datahub-project/datahub/pull/11433
• build(deps): bump dompurify from 2.3.8 to 2.5.4 in /datahub-web-react by @​dependabot in https://github.com/datahub-project/datahub/pull/11387
• build(deps): bump dset from 3.1.3 to 3.1.4 in /datahub-web-react by @​dependabot in https://github.com/datahub-project/datahub/pull/11361
• fix(ingest/dbt): fix dbt catalog version check by @​sid-acryl in https://github.com/datahub-project/datahub/pull/11350
• Add STARTS_WITH policy condition to allow for URN-wildcard-based policies by @​githendrik in https://github.com/datahub-project/datahub/pull/11441
• fix(restoreIndices): fix bug in urn paginated restoreIndices exit code by @​david-leifker in https://github.com/datahub-project/datahub/pull/11443
• feat(Analytics) Allow dateRangeField to be configurable for timeSeries chart by @​mkamalas in https://github.com/datahub-project/datahub/pull/11366
• fix(SearchDocumentTransformer): Use correct variable to update ES by @​pinakipb2 in https://github.com/datahub-project/datahub/pull/11430
• chore(version): bump protobuf version by @​david-leifker in https://github.com/datahub-project/datahub/pull/11446
• fix(search): restore prefix phrase match on quoted search by @​david-leifker in https://github.com/datahub-project/datahub/pull/11444
• fix(oidc): apply acr values to redirect url by @​RyanHolstien in https://github.com/datahub-project/datahub/pull/11447
• refactor(ui/lineage): Replace FetchedEntities Object with Map by @​asikowitz in https://github.com/datahub-project/datahub/pull/11440
• feat(ingest/sink): report datahub-rest sink mode by @​hsheth2 in https://github.com/datahub-project/datahub/pull/11422
• docs(ingest): add docs on pydantic compatibility by @​hsheth2 in https://github.com/datahub-project/datahub/pull/11423
• chore: use unique docker log artifact names by @​hsheth2 in https://github.com/datahub-project/datahub/pull/11445
• test(graphql): fix searchFlags in searchAcrossLineage by @​david-leifker in https://github.com/datahub-project/datahub/pull/11448
• Update pr-labeler.yml by @​donovan-acryl in https://github.com/datahub-project/datahub/pull/11393
• fix(docs): fix layout in documentation after #​11380 by @​Masterchen09 in https://github.com/datahub-project/datahub/pull/11390
• Group Modal Css fix by @​kanavnarula in https://github.com/datahub-project/datahub/pull/11403
• feat(graph): graph index soft-delete support by @​david-leifker in https://github.com/datahub-project/datahub/pull/11453
• config(reindex): create reindex timeout configuration by @​david-leifker in https://github.com/datahub-project/datahub/pull/11456
• fix(ingest): sort by last modified not working in the UI by @​sid-acryl in https://github.com/datahub-project/datahub/pull/11343
• feat(data-contracts): support custom assertions in the data contracts builder by @​jayacryl in https://github.com/datahub-project/datahub/pull/11454
• fix(ingest/sqlglot): Make detach_ctes more robust by @​asikowitz in https://github.com/datahub-project/datahub/pull/11449
• fix(ingest/mode): add connection timeouts to avoid RemoteDisconnected errors by @​sagar-salvi-apptware in https://github.com/datahub-project/datahub/pull/11245
• build(gradle): Update gradle.properties by @​david-leifker in https://github.com/datahub-project/datahub/pull/11458
• build(yarn): increase yarn timeout and version bump by @​david-leifker in https://github.com/datahub-project/datahub/pull/11461
• fix(ingest/dbt): allow custom owner types for dbt meta by @​hsheth2 in https://github.com/datahub-project/datahub/pull/11460
• doc: fix typo by @​anshbansal in https://github.com/datahub-project/datahub/pull/11464
• fix(ingestion/looker): skip personal folder independent looks by @​sid-acryl in https://github.com/datahub-project/datahub/pull/11415
• bump(version): zookeeper by @​david-leifker in https://github.com/datahub-project/datahub/pull/11465
• fix(ingest): do not cache temporary tables schema resolvers by @​mayurinehate in https://github.com/datahub-project/datahub/pull/11432
• fix(structuredProps) Allow upserting structured props on schema fields that don't exist by @​chriscollins3456 in https://github.com/datahub-project/datahub/pull/11466
• fix(docs-website): disable dark mode by @​hsheth2 in https://github.com/datahub-project/datahub/pull/11468
• fix: fix broken global style by @​yoonhyejin in https://github.com/datahub-project/datahub/pull/11470
• feat(ingest/dbt): speed up dbt CLL with node_name_patterns by @​hsheth2 in https://github.com/datahub-project/datahub/pull/11450
• feat(ingest/dbt): produce multiple assertions for multi-table dbt tests by @​hsheth2 in https://github.com/datahub-project/datahub/pull/11451
• feat(ingest): add git to ingestion-base image by @​hsheth2 in https://github.com/datahub-project/datahub/pull/11477
• fix(ingest): include platform instance in looker usage urns by @​hsheth2 in https://github.com/datahub-project/datahub/pull/11469
• fix(ingest/openapi): update recipe for DataHub OpenAPI with url_complement and bearer token by @​sagar-salvi-apptware in https://github.com/datahub-project/datahub/pull/10980
• docs(aws): Update AWS docs to keep consistency with Docker docs by @​AColocho in https://github.com/datahub-project/datahub/pull/11284
• feat: add second navbar by @​yoonhyejin in https://github.com/datahub-project/datahub/pull/11471
• feat: CTA to live demos in cloud section and a few more case studies on home by @​jayacryl in https://github.com/datahub-project/datahub/pull/11488
• fix(ingest/bq): do not query PARTITIONS for biglake tables by @​mayurinehate in https://github.com/datahub-project/datahub/pull/11463
• config(rest-api): enable authentication and api authorization by default by @​david-leifker in https://github.com/datahub-project/datahub/pull/11484
• feat(ingest/databricks): add usage perf report by @​mayurinehate in https://github.com/datahub-project/datahub/pull/11480
• feat(ingestion/tableau): introduce project_path_pattern by @​haeniya in https://github.com/datahub-project/datahub/pull/10855
• docs(ingest/dbt): update run result paths examples by @​acrylJonny in https://github.com/datahub-project/datahub/pull/11138
• feat(ingest): support DATAHUB_INCLUDE_ENV_IN_CONTAINER_PROPERTIES by @​hsheth2 in https://github.com/datahub-project/datahub/pull/11476
• refactor(criterion): refactor criterion construction by @​david-leifker in https://github.com/datahub-project/datahub/pull/11486
• feat(auth) - Manage Children Glossary term authorization check for Owner, Domain, Remove link by @​mkamalas in https://github.com/datahub-project/datahub/pull/11337
• fix(ingest/dagster): Fixing path to the dagster logo by @​treff7es in https://github.com/datahub-project/datahub/pull/11489
• docker(config): Update docker profiles by @​david-leifker in https://github.com/datahub-project/datahub/pull/11495
• fix(docs): fix form type by @​deepgarg-visa in https://github.com/datahub-project/datahub/pull/11497
• fix(fragments.graphql): values is a correct parameter for FacetFilterInput by @​bda618 in https://github.com/datahub-project/datahub/pull/11485
• feat: made datahub home page colors more consistent by @​jayacryl in https://github.com/datahub-project/datahub/pull/11496
• fix(ingest/bigquery): optimise queries v2 session processing by @​mayurinehate in https://github.com/datahub-project/datahub/pull/11492
• feat(ingest/elasticsearch): add api_key auth by @​th0ger in https://github.com/datahub-project/datahub/pull/11475
• fix(doc): Update the documentation for Timeline API by @​sakethvarma397 in https://github.com/datahub-project/datahub/pull/11504
• docs(upgrade): add note about downgrade limitation by @​david-leifker in https://github.com/datahub-project/datahub/pull/11507
• fix(docs-website): corrected minor alignment issues on the home page by @​jayacryl in https://github.com/datahub-project/datahub/pull/11508
• chore(cleanup): remove legacy bootstrap step by @​david-leifker in https://github.com/datahub-project/datahub/pull/11494
• docs(search): example of entity weighting by @​david-leifker in https://github.com/datahub-project/datahub/pull/11511
• feat(businessattribute): filter schema rows on business-attribute pro… by @​deepgarg-visa in https://github.com/datahub-project/datahub/pull/11502
• fix(ingest/lookml): missing lineage for looker template -- if prod by @​sid-acryl in https://github.com/datahub-project/datahub/pull/11426
• fix(ingestion/transformer): Add container support for ownership and domains by @​sagar-salvi-apptware in https://github.com/datahub-project/datahub/pull/11375
• fix(ingestion/nifi): Improve nifi lineage extraction performance by @​skrydal in https://github.com/datahub-project/datahub/pull/11490
• fix(dagster-plugin): Fix in/outs format and source config by @​DSchmidtDev in https://github.com/datahub-project/datahub/pull/11481
• fix(ingest/elasticsearch): detect sub-properties in 'nested' type mapping by @​Bumyu in https://github.com/datahub-project/datahub/pull/11338
• chore: update case studies by @​hsheth2 in https://github.com/datahub-project/datahub/pull/11520
• feat: visa case study with a text label instead of logo by @​jayacryl in https://github.com/datahub-project/datahub/pull/11521
• feat(docs-site) added snap logo by @​jayacryl in https://github.com/datahub-project/datahub/pull/11522
• fix(ingest/looker) : Handle DeserializeError to improve error reporting. by @​sagar-salvi-apptware in https://github.com/datahub-project/datahub/pull/11457
• build(misc): misc build, config, version updates by @​david-leifker in https://github.com/datahub-project/datahub/pull/11527
• feat: add miro & foursquare & Deutsche Telekom by @​yoonhyejin in https://github.com/datahub-project/datahub/pull/11516
• fix(ingestion/nifi): Fix for incremental lineage ingestion for nifi by @​skrydal in https://github.com/datahub-project/datahub/pull/11517
• fix(tests): fix metadata-io tests by @​david-leifker in https://github.com/datahub-project/datahub/pull/11530
• fix(search): Fix empty description by @​david-leifker in https://github.com/datahub-project/datahub/pull/11514
• Block http trace method on mce and mce consumers by @​udays-visa in https://github.com/datahub-project/datahub/pull/11513
• feat(bootstrap): bootstrap template mcps by @​david-leifker in https://github.com/datahub-project/datahub/pull/11518
• add new CREATE and UPDATE privileges for USERS_AND_GROUPS by @​githendrik in https://github.com/datahub-project/datahub/pull/11364
• feat(graphql/lineage): Support including ghost entities by @​asikowitz in https://github.com/datahub-project/datahub/pull/11510
• fix(ingest/sigma): handle members api paginated response by @​mayurinehate in https://github.com/datahub-project/datahub/pull/11535
• fix(metadata-service): Pass editableDatasetNameEnabled feature flag to the config. by @​kris48k in https://github.com/datahub-project/datahub/pull/11391
• Added IEQUAL operator to support case insensitive searches by @​Nbagga14 in https://github.com/datahub-project/datahub/pull/11501
• build(deps): bump rollup from 3.29.4 to 3.29.5 in /datahub-web-react by @​dependabot in https://github.com/datahub-project/datahub/pull/11459
• build(deps): bump express from 4.19.2 to 4.20.0 in /docs-website by @​dependabot in https://github.com/datahub-project/datahub/pull/11357
• build(deps): bump fast-loops from 1.1.3 to 1.1.4 in /datahub-web-react by @​dependabot in https://github.com/datahub-project/datahub/pull/10885
• feat(fabric): Add sandbox as a possible environment variable by @​pedro93 in https://github.com/datahub-project/datahub/pull/11491
• chore(bump): bump commons, misc versions by @​david-leifker in https://github.com/datahub-project/datahub/pull/11538
• feat(dataProduct): add data product unset side effect by @​RyanHolstien in https://github.com/datahub-project/datahub/pull/11512
• fix(search): Elasticsearch bool query should by @​david-leifker in https://github.com/datahub-project/datahub/pull/11536
• fix(changeGenerator): fix logic around descriptions and make execution more efficient by @​RyanHolstien in https://github.com/datahub-project/datahub/pull/11539
• feat(models): add support for generic platform resources by @​shirshanka in https://github.com/datahub-project/datahub/pull/11531
• fix(ingest): fix UnboundLocalError in dataproduct transformer by @​hsheth2 in https://github.com/datahub-project/datahub/pull/11528
• fix(ingest): add typeUrn in glossary sync source by @​anshbansal in https://github.com/datahub-project/datahub/pull/11545
• fix(docs-site) cloud form copy spelling error by @​jayacryl in https://github.com/datahub-project/datahub/pull/11455
• fix(propagation): show last modified propagated documentation by @​shirshanka in https://github.com/datahub-project/datahub/pull/11498
• privileges(refactor): consolidate individual sys op privileges by @​david-leifker in https://github.com/datahub-project/datahub/pull/11549
• feat(website): added built by acryl and linkedin to home hero by @​jayacryl in https://github.com/datahub-project/datahub/pull/11548
• feat(ingest/bigquery): casing for tmp table check for queries v2 by @​mayurinehate in https://github.com/datahub-project/datahub/pull/11534
• fix(ingestion/powerbi): fix for databricks lineage m-query pattern by @​sid-acryl in https://github.com/datahub-project/datahub/pull/11462
• fix(datahub-gc): set system flag on ingestion source by @​david-leifker in https://github.com/datahub-project/datahub/pull/11554
• fix(lint): fix yarn lint breakage from #​11498 by @​shirshanka in https://github.com/datahub-project/datahub/pull/11553
• chore(ci): bump trivy action version by @​david-leifker in https://github.com/datahub-project/datahub/pull/11555
• feat(docker-profiles): add elasticsearch envs to docker profiles by @​david-leifker in https://github.com/datahub-project/datahub/pull/11546
• sdk(platform-resource): add entity type for ease of use by @​shirshanka in https://github.com/datahub-project/datahub/pull/11541
• docs(release): 0.3.6 - docs update by @​david-leifker in https://github.com/datahub-project/datahub/pull/11506
• fix(datahub-gc): Update ingestion-datahub-gc.yaml by @​david-leifker in https://github.com/datahub-project/datahub/pull/11556
• fix(ci): fix cassandra test flake by @​david-leifker in https://github.com/datahub-project/datahub/pull/11557
• feat(scan): add scanning to setup images by @​RyanHolstien in https://github.com/datahub-project/datahub/pull/11563
• Fix data search for fieldType = OBJECT for non-string fields by @​udbhav-hbk in https://github.com/datahub-project/datahub/pull/11524
• docs(search): add structured search examples for structured properties by @​david-leifker in https://github.com/datahub-project/datahub/pull/11565
• docs(datahub source): Add urn exclusions to docs by @​eboneil in https://github.com/datahub-project/datahub/pull/11568
• docs(csv-enricher): Add warning for write_semantics by @​eboneil in https://github.com/datahub-project/datahub/pull/11561
• fix(test): fix test specific for single query by @​david-leifker in [https://github.com/fix(test): fix test specific for single query datahub-project/datahub#11567](http