Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Rename Dataset database tables as Asset #42023

Merged
merged 64 commits into from
Oct 21, 2024
Merged

Rename Dataset database tables as Asset #42023

merged 64 commits into from
Oct 21, 2024

Conversation

Lee-W
Copy link
Member

@Lee-W Lee-W commented Sep 5, 2024 •
edited
Loading

As part of #42307

  • Rename table dataset_alias_dataset as asset_alias_asset

    • Rename column dataset_id as dataset_id
    • Rename index idx_dataset_alias_dataset_alias_id as idx_asset_alias_asset_alias_id
    • Rename index idx_dataset_alias_dataset_alias_dataset_id as idx_asset_alias_asset_asset_id
    • Rename foreign key dataset_alias_dataset_alias_id_fkey as asset_alias_asset_alias_id_fk_key
    • Rename foreign key dataset_alias_dataset_dataset_id_fkey as asset_alias_asset_asset_id_fk_key

  • Rename table dataset_alias_dataset_event as asset_alias_asset_event

    • Rename index idx_dataset_alias_dataset_event_alias_id as idx_asset_alias_asset_event_alias_id
    • Rename index idx_dataset_alias_dataset_event_alias_id as idx_asset_alias_asset_event_event_id
    • Rename foreign key dataset_alias_dataset_event_alias_id_fkey as asset_alias_asset_event_asset_id_fkey
    • Rename foreign key dataset_alias_dataset_event_event_id_fkey as asset_alias_asset_event_event_id_fk_key

  • Rename table dataset_alias as asset_alias

    • Rename index idx_dataset_alias_name_unique as idx_asset_alias_name_unique

  • Rename table dataset as asset

    • Rename index idx_dataset_name_uri_unique as idx_asset_name_uri_unique

  • Rename table dag_schedule_dataset_alias_reference as dag_schedule_asset_alias_reference

    • Rename index idx_dag_schedule_dataset_alias_reference_dag_id as idx_dag_schedule_asset_alias_reference_dag_id
    • Rename primary key dsdar_pkey as asaar_pkey
    • Rename foreign key dsdar_dataset_fkey as dsaar_asset_alias_fkey
    • Rename foreign key dsdar_dag_id_fkey as dsaar_dag_fkey

  • Rename table dag_schedule_dataset_reference as dag_schedule_asset_reference

    • Rename column dataset_id as dataset_id
    • Rename index idx_dag_schedule_dataset_reference_dag_id as idx_dag_schedule_asset_reference_dag_id
    • Rename primary key dsdr_pkey as dsar_pkey
    • Rename foreign key dsdr_dag_id_fkey as dsar_dag_id_fkey
    • Rename foreign key dsdr_dataset_fkey as dsar_asset_fkey

  • Rename table task_outlet_dataset_reference as task_outlet_asset_reference

    • Rename column dataset_id as dataset_id
    • Rename index idx_task_outlet_dataset_reference_dag_id as idx_task_outlet_asset_reference_dag_id
    • Rename primary key todr_pkey as toar_pkey
    • Rename foreign key todr_dag_id_fkey as toar_dag_id_fkey
    • Rename foreign key todr_dataset_fkey as toar_asset_fkey

  • Rename table dataset_dag_run_queue as asset_dag_run_queue

    • Rename column dataset_id as dataset_id
    • Rename index idx_dataset_dag_run_queue_target_dag_id as idx_asset_dag_run_queue_target_dag_id
    • Rename primary key datasetdagrunqueue_pkey as assetdagrunqueue_pkey
    • Rename foreign key ddrq_dag_fkey as adrq_dag_fkey
    • Rename foreign key ddrq_dataset_fkey as adrq_dag_fkey

  • Rename table dagrun_dataset_event as dagrun_asset_event

    • Rename index idx_dagrun_dataset_events_dag_run_id as idx_dagrun_asset_events_dag_run_id
    • Rename index idx_dagrun_dataset_events_event_id as idx_dagrun_asset_events_event_id
    • Rename foreign key dagrun_dataset_event_event_id_fkey as dagrun_asset_event_dag_run_id_fkey
    • Rename foreign key dagrun_dataset_event_dag_run_id_fkey as dagrun_asset_event_event_id_fkey

  • Rename table dataset_event as asset_event

    • Rename column dataset_id as dataset_id
    • Rename index idx_dataset_id_timestamp as idx_asset_id_timestamp

  • Rename column dataset_expression in dag table as asset_expression

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@boring-cyborg boring-cyborg bot added area:API Airflow's REST/HTTP API area:dev-tools area:lineage area:Scheduler including HA (high availability) scheduler labels Sep 5, 2024
@Lee-W Lee-W added the AIP-74 Dataset -> Asset label Sep 5, 2024
@Lee-W Lee-W force-pushed the rename-dataset-as-asset-in-db branch from e9e7bbc to 9f9e3d2 Compare September 5, 2024 10:35
@Lee-W Lee-W force-pushed the rename-dataset-as-asset-in-db branch from 9f9e3d2 to cf5dd9f Compare September 18, 2024 10:16
@Lee-W Lee-W mentioned this pull request Sep 18, 2024
Closed
2 tasks
@Lee-W Lee-W force-pushed the rename-dataset-as-asset-in-db branch 2 times, most recently from 377166f to a84053a Compare September 20, 2024 10:04
@Lee-W Lee-W force-pushed the rename-dataset-as-asset-in-db branch from a84053a to e004c95 Compare October 2, 2024 07:44
@Lee-W Lee-W mentioned this pull request Oct 2, 2024
Merged
@Lee-W Lee-W force-pushed the rename-dataset-as-asset-in-db branch 4 times, most recently from e2ea6dc to 7a13d31 Compare October 4, 2024 00:09
@Lee-W Lee-W added the airflow3.0:breaking Candidates for Airflow 3.0 that contain breaking changes label Oct 6, 2024
@Lee-W Lee-W force-pushed the rename-dataset-as-asset-in-db branch 2 times, most recently from 4889fb8 to 17459a6 Compare October 7, 2024 13:38
@Lee-W Lee-W added legacy api Whether legacy API changes should be allowed in PR legacy ui Whether legacy UI change should be allowed in PR labels Oct 7, 2024
@Lee-W Lee-W force-pushed the rename-dataset-as-asset-in-db branch 9 times, most recently from 127f09b to bbc3f1c Compare October 14, 2024 08:06
Lee-W added 20 commits October 21, 2024 18:13
@Lee-W
feat(migrations): wrap up downgrade script
bcdc3f6
@Lee-W
fix: fix missing frontend change
b59ac7e
@Lee-W
fix(migrations): fix fk_constraint rename for association tables
92a0467
@Lee-W
fix: fix missing dataset related changes due to rebasing
fca7cd7
@Lee-W
feat(migrations): reorder migrations
76690b6
@Lee-W
feat(migrations): fix error for sqlite
15be3c4
@Lee-W
feat(models/asset): remove redundant fk constraint aa_ae_alias_id and…
1bb0ec3 
… aa_ae_event_id
@Lee-W
feat(migrations): remove redundant fk constraint a_aa_asset_id and a_…
d21eb32 
…aa_alias_id
@Lee-W
build: generate db migration side files
d3608e5
@Lee-W
feat(migrations): add postgresql support
f3ee8e9
@Lee-W
feat(migrations): add mysql support for downgrade
5fd88ae
@Lee-W
feat(migrations): add mysql support
25a6339
@Lee-W
fix: rename reference_table as referent_table
31cadd2
@Lee-W
refactor: reorganize 0038 migration
a5f1be7
@Lee-W
docs(newsfragements): update tables updated
f23d2f2
@Lee-W
fix(utils.db): fix revision map
635448a
@Lee-W
fix: fix rebasing error
83e1e46
@Lee-W
docs: improve endpoint asset_triggered change description
07c5e15
@Lee-W
docs: add more breaking change description to newsfragments
900f90a
@Lee-W
docs: add descirption to endpoint renaming and note it in newsfragments
d2a7481
@Lee-W Lee-W force-pushed the rename-dataset-as-asset-in-db branch from 8adbead to d2a7481 Compare October 21, 2024 10:13
@Lee-W
Copy link
Member Author

Lee-W commented Oct 21, 2024

I just address the comments from TP. The last CI failure was due to WTforms issue being fixed in pallets-eco/wtforms#862 (same as #43205 (comment))

Will merge this one

@Lee-W Lee-W merged commit dc4def7 into apache:main Oct 21, 2024
75 of 77 checks passed
@Lee-W Lee-W deleted the rename-dataset-as-asset-in-db branch October 21, 2024 10:44
@shubhamraj-git shubhamraj-git mentioned this pull request Oct 21, 2024
Closed
2 tasks
harjeevanmaan pushed a commit to harjeevanmaan/airflow that referenced this pull request Oct 23, 2024
@Lee-W @harjeevanmaan
Rename Dataset database tables as Asset (apache#42023)
7e7ee61 
* feat(models/asset): rename index idx_dataset_alias_dataset_event_alias_id as idx_asset_alias_asset_event_alias_id
* feat(models/asset): rename index idx_dataset_alias_dataset_event_event_id as idx_asset_alias_asset_event_event_id
* feat(models/asset): rename table dataset_alias_dataset_event as asset_alias_asset_event
* feat(models): rename dataset_alias as asset_alias
* rename table "dataset_alias" as "asset_alias"
* rename table "dataset_alias_dataset" as "asset_alias_dataset"
    * rename index "idx_dataset_alias_dataset_alias_id" as "idx_asset_alias_asset_alias_id"
    * rename index "idx_dataset_alias_dataset_alias_dataset_id" as "idx_asset_alias_asset_dataset_id"
    * rename fk constraint "ds_dsa_alias_id" as "a_aa_alias_id""
        * change reference column from "dataset_alias.id" to "asset_alias.id"
* rename table "dag_schedule_dataset_alias_reference" as "dag_schedule_asset_alias_reference"
    * rename column "dataset_alias" as "asset_alias"
    * rename fk constraint "dsdar_dataset_alias_fkey" as "dsaar_asset_alias_fkey"
        * change reference column from "dataset_alias.id" to "asset_alias.id"
    * rename index "idx_dag_schedule_dataset_alias_reference_dag_id" as "idx_dag_schedule_asset_alias_reference_dag_id"
* in table "asset_alias_asset_event"
    * change fk alias_id reference from "dataset_alias.id" to "asset_alias.id"
    * in fk constraint "dss_de_alias_id"
        * change reference column from "dataset_alias.id" to "asset_alias.id"
* feat(models/asset): rename table "dag_schedule_dataset_reference" as "dag_schedule_asset_reference"
* rename fk constraint "dsdr_dataset_fkey" as "dsar_dataset_fkey"
* rename fk constraint "dsdr_dag_id_fkey" as "dsar_dag_id_fkey"
* rename index "idx_dag_schedule_dataset_reference_dag_id" as "idx_dag_schedule_asset_reference_dag_id"
* feat(models): rename table "task_outlet_dataset_references" as "task_outlet_asset_references"
* rename fk constraint "todr_dataset_fkey" as "todr_asset_fkey"
* rename index "idx_task_outlet_dataset_reference_dag_id" as "todr_dataset_fkey"
* feat(models/asset): rename table "dagrun_dataset_event" as "dagrun_asset_event"
* rename index "idx_dagrun_dataset_events_dag_run_id" as "idx_dagrun_asset_events_dag_run_id"
* rename index "idx_dagrun_dataset_events_event_id" as "idx_dagrun_asset_events_event_id"
* feat(models/dag): rename column "schedule_dataset_references" as "schedule_asset_references" in table "dag"
* feat(models/asset): rename table "dataset_dag_run_queue" as "asset_dag_run_queue"
* rename index "idx_dataset_dag_run_queue_target_dag_id" as "idx_asset_dag_run_queue_target_dag_id"
* feat(models/dag): rename consumed_dataset_events as consumed_asset_events
* feat(models/asset): rename table "dataset_event" as "asset_event"
* feat(models/asset): rename index idx_dataset_id_timestamp as idx_asset_id_timestamp
* feat(models/asset): rename idx_asset_alias_asset_dataset_id as idx_asset_alias_asset_asset_id
* feat(models/asset): rename dataset as asset in fks
* feat(models/asset): rename asset_alias_dataset as asset_alias_asset
* feat(models/asset): rename index idx_dataset_alias_name_unique as idx_asset_alias_name_unique
* feat(models/asset): rename idx_dataset_name_uri_unique as idx_asset_name_uri_unique
* feat(models/asset): rename dsar_dataset_fkey as dsar_asset_fkey
* feat(models/asset): rename datasetdagrunqueue_pkey as assetdagrunqueue_pkey
* feat(models/asset): rename ddrq_dataset_fkey as ddrq_asset_fkey
* feat(models/asset): rename ddrq fks as adrq fks
* feat(models/asset): rename dsdr keys as dsar keys
* feat(models/asset): rename todr keys as toar keys
* feat(migrations): initial migration files
* feat(migrations): add utility functions _rename_index and _rename_fk_constraint
* feat(migrations): add _rename_pk_constraint utility function
* feat(migrations): update migration files to reflect current model change (except for fk reference table update)
* feat: rename dataset_id as asset_id
* feat(api_connexion): rename dataset_id as asset_id
* feat: rename dataset.uri as asset.uri
* feat: rename dataset_expression as asset_expression
* feat(listeners): rename argument dataset_alias as asset_alias
* feat(utils/types): rename DagRunType.DATASET_TRIGGERED as DagRunType.ASSET_TRIGGERED
* feat: rename dataset_triggered_dag_info as asset_triggered_dag_info
* feat: rename dataset as asset
* feat(models/asset): rename dss_de as aa_ae
* feat(models/asset): rename dsdar as dsaar
* feat(migrations): wrap up the upgrade part (except for fk upgrade)
* feat(migrations): rename migration file
* docs(newsfragment): add place holder newsfragment
* build: generate migration related files
* feat(migrations): wrap up upgrade script
* feat(migrations): wrap up downgrade script
* fix: fix missing frontend change
* fix(migrations): fix fk_constraint rename for association tables
* fix: fix missing dataset related changes due to rebasing
* feat(migrations): reorder migrations
* feat(migrations): fix error for sqlite
* feat(models/asset): remove redundant fk constraint aa_ae_alias_id and aa_ae_event_id
* feat(migrations): remove redundant fk constraint a_aa_asset_id and a_aa_alias_id
* build: generate db migration side files
* feat(migrations): add postgresql support
* feat(migrations): add mysql support for downgrade
* fix: rename reference_table as referent_table
* refactor: reorganize 0038 migration
* docs: improve endpoint asset_triggered change description
* docs: add description to endpoint renaming and note it in newsfragments
PaulKobow7536 pushed a commit to PaulKobow7536/airflow that referenced this pull request Oct 24, 2024
@Lee-W @PaulKobow7536
Rename Dataset database tables as Asset (apache#42023)
af82692 
* feat(models/asset): rename index idx_dataset_alias_dataset_event_alias_id as idx_asset_alias_asset_event_alias_id
* feat(models/asset): rename index idx_dataset_alias_dataset_event_event_id as idx_asset_alias_asset_event_event_id
* feat(models/asset): rename table dataset_alias_dataset_event as asset_alias_asset_event
* feat(models): rename dataset_alias as asset_alias
* rename table "dataset_alias" as "asset_alias"
* rename table "dataset_alias_dataset" as "asset_alias_dataset"
    * rename index "idx_dataset_alias_dataset_alias_id" as "idx_asset_alias_asset_alias_id"
    * rename index "idx_dataset_alias_dataset_alias_dataset_id" as "idx_asset_alias_asset_dataset_id"
    * rename fk constraint "ds_dsa_alias_id" as "a_aa_alias_id""
        * change reference column from "dataset_alias.id" to "asset_alias.id"
* rename table "dag_schedule_dataset_alias_reference" as "dag_schedule_asset_alias_reference"
    * rename column "dataset_alias" as "asset_alias"
    * rename fk constraint "dsdar_dataset_alias_fkey" as "dsaar_asset_alias_fkey"
        * change reference column from "dataset_alias.id" to "asset_alias.id"
    * rename index "idx_dag_schedule_dataset_alias_reference_dag_id" as "idx_dag_schedule_asset_alias_reference_dag_id"
* in table "asset_alias_asset_event"
    * change fk alias_id reference from "dataset_alias.id" to "asset_alias.id"
    * in fk constraint "dss_de_alias_id"
        * change reference column from "dataset_alias.id" to "asset_alias.id"
* feat(models/asset): rename table "dag_schedule_dataset_reference" as "dag_schedule_asset_reference"
* rename fk constraint "dsdr_dataset_fkey" as "dsar_dataset_fkey"
* rename fk constraint "dsdr_dag_id_fkey" as "dsar_dag_id_fkey"
* rename index "idx_dag_schedule_dataset_reference_dag_id" as "idx_dag_schedule_asset_reference_dag_id"
* feat(models): rename table "task_outlet_dataset_references" as "task_outlet_asset_references"
* rename fk constraint "todr_dataset_fkey" as "todr_asset_fkey"
* rename index "idx_task_outlet_dataset_reference_dag_id" as "todr_dataset_fkey"
* feat(models/asset): rename table "dagrun_dataset_event" as "dagrun_asset_event"
* rename index "idx_dagrun_dataset_events_dag_run_id" as "idx_dagrun_asset_events_dag_run_id"
* rename index "idx_dagrun_dataset_events_event_id" as "idx_dagrun_asset_events_event_id"
* feat(models/dag): rename column "schedule_dataset_references" as "schedule_asset_references" in table "dag"
* feat(models/asset): rename table "dataset_dag_run_queue" as "asset_dag_run_queue"
* rename index "idx_dataset_dag_run_queue_target_dag_id" as "idx_asset_dag_run_queue_target_dag_id"
* feat(models/dag): rename consumed_dataset_events as consumed_asset_events
* feat(models/asset): rename table "dataset_event" as "asset_event"
* feat(models/asset): rename index idx_dataset_id_timestamp as idx_asset_id_timestamp
* feat(models/asset): rename idx_asset_alias_asset_dataset_id as idx_asset_alias_asset_asset_id
* feat(models/asset): rename dataset as asset in fks
* feat(models/asset): rename asset_alias_dataset as asset_alias_asset
* feat(models/asset): rename index idx_dataset_alias_name_unique as idx_asset_alias_name_unique
* feat(models/asset): rename idx_dataset_name_uri_unique as idx_asset_name_uri_unique
* feat(models/asset): rename dsar_dataset_fkey as dsar_asset_fkey
* feat(models/asset): rename datasetdagrunqueue_pkey as assetdagrunqueue_pkey
* feat(models/asset): rename ddrq_dataset_fkey as ddrq_asset_fkey
* feat(models/asset): rename ddrq fks as adrq fks
* feat(models/asset): rename dsdr keys as dsar keys
* feat(models/asset): rename todr keys as toar keys
* feat(migrations): initial migration files
* feat(migrations): add utility functions _rename_index and _rename_fk_constraint
* feat(migrations): add _rename_pk_constraint utility function
* feat(migrations): update migration files to reflect current model change (except for fk reference table update)
* feat: rename dataset_id as asset_id
* feat(api_connexion): rename dataset_id as asset_id
* feat: rename dataset.uri as asset.uri
* feat: rename dataset_expression as asset_expression
* feat(listeners): rename argument dataset_alias as asset_alias
* feat(utils/types): rename DagRunType.DATASET_TRIGGERED as DagRunType.ASSET_TRIGGERED
* feat: rename dataset_triggered_dag_info as asset_triggered_dag_info
* feat: rename dataset as asset
* feat(models/asset): rename dss_de as aa_ae
* feat(models/asset): rename dsdar as dsaar
* feat(migrations): wrap up the upgrade part (except for fk upgrade)
* feat(migrations): rename migration file
* docs(newsfragment): add place holder newsfragment
* build: generate migration related files
* feat(migrations): wrap up upgrade script
* feat(migrations): wrap up downgrade script
* fix: fix missing frontend change
* fix(migrations): fix fk_constraint rename for association tables
* fix: fix missing dataset related changes due to rebasing
* feat(migrations): reorder migrations
* feat(migrations): fix error for sqlite
* feat(models/asset): remove redundant fk constraint aa_ae_alias_id and aa_ae_event_id
* feat(migrations): remove redundant fk constraint a_aa_asset_id and a_aa_alias_id
* build: generate db migration side files
* feat(migrations): add postgresql support
* feat(migrations): add mysql support for downgrade
* fix: rename reference_table as referent_table
* refactor: reorganize 0038 migration
* docs: improve endpoint asset_triggered change description
* docs: add description to endpoint renaming and note it in newsfragments
ellisms pushed a commit to ellisms/airflow that referenced this pull request Nov 13, 2024
@Lee-W @ellisms
Rename Dataset database tables as Asset (apache#42023)
863b7cf 
* feat(models/asset): rename index idx_dataset_alias_dataset_event_alias_id as idx_asset_alias_asset_event_alias_id
* feat(models/asset): rename index idx_dataset_alias_dataset_event_event_id as idx_asset_alias_asset_event_event_id
* feat(models/asset): rename table dataset_alias_dataset_event as asset_alias_asset_event
* feat(models): rename dataset_alias as asset_alias
* rename table "dataset_alias" as "asset_alias"
* rename table "dataset_alias_dataset" as "asset_alias_dataset"
    * rename index "idx_dataset_alias_dataset_alias_id" as "idx_asset_alias_asset_alias_id"
    * rename index "idx_dataset_alias_dataset_alias_dataset_id" as "idx_asset_alias_asset_dataset_id"
    * rename fk constraint "ds_dsa_alias_id" as "a_aa_alias_id""
        * change reference column from "dataset_alias.id" to "asset_alias.id"
* rename table "dag_schedule_dataset_alias_reference" as "dag_schedule_asset_alias_reference"
    * rename column "dataset_alias" as "asset_alias"
    * rename fk constraint "dsdar_dataset_alias_fkey" as "dsaar_asset_alias_fkey"
        * change reference column from "dataset_alias.id" to "asset_alias.id"
    * rename index "idx_dag_schedule_dataset_alias_reference_dag_id" as "idx_dag_schedule_asset_alias_reference_dag_id"
* in table "asset_alias_asset_event"
    * change fk alias_id reference from "dataset_alias.id" to "asset_alias.id"
    * in fk constraint "dss_de_alias_id"
        * change reference column from "dataset_alias.id" to "asset_alias.id"
* feat(models/asset): rename table "dag_schedule_dataset_reference" as "dag_schedule_asset_reference"
* rename fk constraint "dsdr_dataset_fkey" as "dsar_dataset_fkey"
* rename fk constraint "dsdr_dag_id_fkey" as "dsar_dag_id_fkey"
* rename index "idx_dag_schedule_dataset_reference_dag_id" as "idx_dag_schedule_asset_reference_dag_id"
* feat(models): rename table "task_outlet_dataset_references" as "task_outlet_asset_references"
* rename fk constraint "todr_dataset_fkey" as "todr_asset_fkey"
* rename index "idx_task_outlet_dataset_reference_dag_id" as "todr_dataset_fkey"
* feat(models/asset): rename table "dagrun_dataset_event" as "dagrun_asset_event"
* rename index "idx_dagrun_dataset_events_dag_run_id" as "idx_dagrun_asset_events_dag_run_id"
* rename index "idx_dagrun_dataset_events_event_id" as "idx_dagrun_asset_events_event_id"
* feat(models/dag): rename column "schedule_dataset_references" as "schedule_asset_references" in table "dag"
* feat(models/asset): rename table "dataset_dag_run_queue" as "asset_dag_run_queue"
* rename index "idx_dataset_dag_run_queue_target_dag_id" as "idx_asset_dag_run_queue_target_dag_id"
* feat(models/dag): rename consumed_dataset_events as consumed_asset_events
* feat(models/asset): rename table "dataset_event" as "asset_event"
* feat(models/asset): rename index idx_dataset_id_timestamp as idx_asset_id_timestamp
* feat(models/asset): rename idx_asset_alias_asset_dataset_id as idx_asset_alias_asset_asset_id
* feat(models/asset): rename dataset as asset in fks
* feat(models/asset): rename asset_alias_dataset as asset_alias_asset
* feat(models/asset): rename index idx_dataset_alias_name_unique as idx_asset_alias_name_unique
* feat(models/asset): rename idx_dataset_name_uri_unique as idx_asset_name_uri_unique
* feat(models/asset): rename dsar_dataset_fkey as dsar_asset_fkey
* feat(models/asset): rename datasetdagrunqueue_pkey as assetdagrunqueue_pkey
* feat(models/asset): rename ddrq_dataset_fkey as ddrq_asset_fkey
* feat(models/asset): rename ddrq fks as adrq fks
* feat(models/asset): rename dsdr keys as dsar keys
* feat(models/asset): rename todr keys as toar keys
* feat(migrations): initial migration files
* feat(migrations): add utility functions _rename_index and _rename_fk_constraint
* feat(migrations): add _rename_pk_constraint utility function
* feat(migrations): update migration files to reflect current model change (except for fk reference table update)
* feat: rename dataset_id as asset_id
* feat(api_connexion): rename dataset_id as asset_id
* feat: rename dataset.uri as asset.uri
* feat: rename dataset_expression as asset_expression
* feat(listeners): rename argument dataset_alias as asset_alias
* feat(utils/types): rename DagRunType.DATASET_TRIGGERED as DagRunType.ASSET_TRIGGERED
* feat: rename dataset_triggered_dag_info as asset_triggered_dag_info
* feat: rename dataset as asset
* feat(models/asset): rename dss_de as aa_ae
* feat(models/asset): rename dsdar as dsaar
* feat(migrations): wrap up the upgrade part (except for fk upgrade)
* feat(migrations): rename migration file
* docs(newsfragment): add place holder newsfragment
* build: generate migration related files
* feat(migrations): wrap up upgrade script
* feat(migrations): wrap up downgrade script
* fix: fix missing frontend change
* fix(migrations): fix fk_constraint rename for association tables
* fix: fix missing dataset related changes due to rebasing
* feat(migrations): reorder migrations
* feat(migrations): fix error for sqlite
* feat(models/asset): remove redundant fk constraint aa_ae_alias_id and aa_ae_event_id
* feat(migrations): remove redundant fk constraint a_aa_asset_id and a_aa_alias_id
* build: generate db migration side files
* feat(migrations): add postgresql support
* feat(migrations): add mysql support for downgrade
* fix: rename reference_table as referent_table
* refactor: reorganize 0038 migration
* docs: improve endpoint asset_triggered change description
* docs: add description to endpoint renaming and note it in newsfragments
@Lee-W Lee-W mentioned this pull request Nov 18, 2024
Open
96 tasks
@Lee-W Lee-W mentioned this pull request Dec 2, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@uranusjr uranusjr uranusjr left review comments

@phanikumv phanikumv phanikumv approved these changes

@bbovenzi bbovenzi Awaiting requested review from bbovenzi bbovenzi is a code owner

@pierrejeambrun pierrejeambrun Awaiting requested review from pierrejeambrun pierrejeambrun is a code owner

@ryanahamilton ryanahamilton Awaiting requested review from ryanahamilton ryanahamilton is a code owner

@jscheffl jscheffl Awaiting requested review from jscheffl jscheffl is a code owner

@ashb ashb Awaiting requested review from ashb ashb is a code owner

@ephraimbuddy ephraimbuddy Awaiting requested review from ephraimbuddy ephraimbuddy is a code owner

@potiuk potiuk Awaiting requested review from potiuk potiuk is a code owner

@jedcunningham jedcunningham Awaiting requested review from jedcunningham jedcunningham is a code owner

@bolkedebruin bolkedebruin Awaiting requested review from bolkedebruin bolkedebruin is a code owner

@XD-DENG XD-DENG Awaiting requested review from XD-DENG XD-DENG is a code owner

Assignees
No one assigned
Labels
AIP-74 Dataset -> Asset airflow3.0:breaking Candidates for Airflow 3.0 that contain breaking changes area:API Airflow's REST/HTTP API area:dev-tools area:lineage area:Scheduler including HA (high availability) scheduler legacy api Whether legacy API changes should be allowed in PR legacy ui Whether legacy UI change should be allowed in PR
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@Lee-W @uranusjr @phanikumv