Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rename dataset endpoints as asset endpoints #42579

Merged
merged 43 commits into from
Oct 3, 2024

Conversation

Lee-W
Copy link
Member

@Lee-W Lee-W commented Sep 30, 2024

  • Rename dataset endpoints as asset endpoints
    • Rename /datasets as /assets
    • Rename /datasets/{uri} as /assets/{uri}
    • Rename /datasets/events as /assets/events
    • Rename /datasets/queuedEvent/{uri} as /ui/next_run_assets/upstream
    • Rename /dags/{dag_id}/dagRuns/{dag_run_id}/upstreamDatasetEvents as /ui/next_run_assets/upstream
    • Rename /dags/{dag_id}/datasets/queuedEvent/{uri} as /ui/next_run_assets/upstream
    • Rename /dags/{dag_id}/datasets/queuedEvent as /ui/next_run_assets/upstream
    • Rename /ui/next_run_datasets/upstream as /ui/next_run_assets/upstream
  • Rename dataset schema as asset endpoints
    • Rename AssetCollection.datasets as AssetCollection.assets
    • Rename AssetEventCollection.dataset_events as AssetEventCollection.asset_events
    • Rename AssetEventCollectionSchema.dataset_events as AssetEventCollectionSchema.asset_events
    • Rename CreateAssetEventSchema.dataset_uri as CreateAssetEventSchema.asset_uri

Some of the names are still kept as Dataset due to the database not being changed. will be handled in #42023


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@boring-cyborg boring-cyborg bot added area:API Airflow's REST/HTTP API area:Scheduler including HA (high availability) scheduler labels Sep 30, 2024
@Lee-W Lee-W mentioned this pull request Sep 30, 2024
2 tasks
@Lee-W Lee-W force-pushed the rename-dataset-as-asset-api branch 9 times, most recently from 5af121f to 6b170e0 Compare October 2, 2024 06:31
@Lee-W Lee-W force-pushed the rename-dataset-as-asset-api branch 2 times, most recently from 6be206a to beba573 Compare October 2, 2024 13:29
@Lee-W Lee-W added the AIP-74 Dataset -> Asset label Oct 2, 2024
@Lee-W Lee-W changed the title Rename dataset as asset api Rename dataset endpoints as asset endpoints Oct 2, 2024
@Lee-W Lee-W force-pushed the rename-dataset-as-asset-api branch from beba573 to 159e7e8 Compare October 2, 2024 13:33
@Lee-W Lee-W marked this pull request as ready for review October 2, 2024 13:34
@Lee-W Lee-W force-pushed the rename-dataset-as-asset-api branch from 159e7e8 to 72d3df2 Compare October 2, 2024 21:51
@Lee-W Lee-W requested review from uranusjr and sunank200 October 3, 2024 08:45
@Lee-W Lee-W force-pushed the rename-dataset-as-asset-api branch from 72d3df2 to d6054ba Compare October 3, 2024 09:20
Copy link
Contributor

@bbovenzi bbovenzi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Functionality lgtm

There's still variable names and places in the UI that use the name "dataset". But it is all deprecated so that's fine by me. Once we upgrade the db columns, let's make sure no mention of dataset finds its way into /api_fastapi and /ui directories.

@Lee-W
Copy link
Member Author

Lee-W commented Oct 3, 2024

Functionality lgtm

There's still variable names and places in the UI that use the name "dataset". But it is all deprecated so that's fine by me. Once we upgrade the db columns, let's make sure no mention of dataset finds its way into /api_fastapi and /ui directories.

Sure! The next PR I'll work on is the DB one. once that's merged, I think we can get rid of the dataset in /api_fastapi and /ui. After that, I'll work on the rest of the UI thing, and everything has not yet changed

@Lee-W Lee-W merged commit ef981f1 into apache:main Oct 3, 2024
52 checks passed
@Lee-W Lee-W deleted the rename-dataset-as-asset-api branch October 3, 2024 23:57
@jscheffl
Copy link
Contributor

jscheffl commented Oct 4, 2024

Assuming post-merge this PR broke canary tests on main - can you take a look for fixing? https://github.com/apache/airflow/actions/runs/11175856695/job/31068286744

joaopamaral pushed a commit to joaopamaral/airflow that referenced this pull request Oct 21, 2024
* feat(api_connexion): rename dataset_endpoint module as asset_endpoint

* feat(api_connexion/openapi): rename tag Dataset as Asset

* feat(api_connexion): rename create_dataset_event as create_asset_event

* feat(api_connexion): rename schema CreateDatasetEvent as CreateAssetEvent

* test(api_connexion): rename test_dataset_endpoint as test_asset_endpoint

* feat(api_connexion): rename delete_dataset_queued_events as delete_asset_queued_events

* feat(api_connexion): rename get_dataset_queued_events as get_asset_queued_events

* feat(api_connexion): rename delete_dag_dataset_queued_events as delete_dag_asset_queued_events

* feat(api_connexion): rename delete_dag_dataset_queued_event as delete_dag_asset_queued_event

* feat(api_connexion): rename get_dag_dataset_queued_events as get_dag_asset_queued_events

* feat(api_connexion): rename get_dag_dataset_queued_event as get_dag_asset_queued_event

* refactor(api_connexion): remove unused dataset_id in _generate_queued_event_where_clause

* feat(api_connexion): rename get_dataset_events as get_asset_events

* feat(api_connexion): rename get_datasets as get_assets

* feat(api_connexion): rename get_dataset as get_asset

* feat(api_connexion/openapi): update api docs

* feat(js): rename DatasetEvents as AssetEvents

* feat(js): rename DatasetDetails as AssetDetails

* feat(js): rename DatasetList as AssetList

* feat(js/api): rename useUpstreamDatasetEvents as useUpstreamAssetEvents

* feat(js/api): rename useDatasetsSummary as useAssetsSummary

* feat(js/api): rename useDatasetDependencies as useAssetDependencies

* feat(js/api): rename useDatasetEvents as useAssetEvents

* feat(js/api): rename useDatasets as useAssets

* feat(js/api): rename useDataset as useAsset

* feat(api_connexion): rename get_upstream_dataset_events as get_upstream_asset_events

* feat(api_connexion/openapi/v1): rename DatasetURI as AssetURI

* feat(api_connexion/openapi/v1): rename DatasetCollection as AssetCollection

* feat(api_connexion/openapi/v1): rename DagScheduleDatasetReference as DagScheduleAssetReference

* feat(api_connexion/openapi/v1): rename TaskOutletDatasetReference as TaskOutletAssetReference

* feat(js/api): rename DatasetEventCollection as AssetEventCollection

* feat(api_connexion/openapi/v1): rename DatasetEvent as AssetEvent

* feat(api_connexion/openapi/v1): rename Dataset as Asset

* docs(api_connexion/openapi/v1): update dataset to asset in v1.yaml

* feat(api_connexion): rename endpoint datasets as assets

* test(api_connexion): rename dataset as asset

* fix(api_connexion/openapi/v1): fix queued_events property name error

* feat(api_fastapi): rename next_run_datasets as next_run_assets

* test: resolve test conflict

* docs(newsfragments): add newsfragments for dataset to asset endpoint rename

* feat(js/api): rename datasetEvents as assetEvents

* feat(js/api): rename variable datasetEvent as assetEvent

* feat(js/api): rename dataset_api as asset_api
ellisms pushed a commit to ellisms/airflow that referenced this pull request Nov 13, 2024
* feat(api_connexion): rename dataset_endpoint module as asset_endpoint

* feat(api_connexion/openapi): rename tag Dataset as Asset

* feat(api_connexion): rename create_dataset_event as create_asset_event

* feat(api_connexion): rename schema CreateDatasetEvent as CreateAssetEvent

* test(api_connexion): rename test_dataset_endpoint as test_asset_endpoint

* feat(api_connexion): rename delete_dataset_queued_events as delete_asset_queued_events

* feat(api_connexion): rename get_dataset_queued_events as get_asset_queued_events

* feat(api_connexion): rename delete_dag_dataset_queued_events as delete_dag_asset_queued_events

* feat(api_connexion): rename delete_dag_dataset_queued_event as delete_dag_asset_queued_event

* feat(api_connexion): rename get_dag_dataset_queued_events as get_dag_asset_queued_events

* feat(api_connexion): rename get_dag_dataset_queued_event as get_dag_asset_queued_event

* refactor(api_connexion): remove unused dataset_id in _generate_queued_event_where_clause

* feat(api_connexion): rename get_dataset_events as get_asset_events

* feat(api_connexion): rename get_datasets as get_assets

* feat(api_connexion): rename get_dataset as get_asset

* feat(api_connexion/openapi): update api docs

* feat(js): rename DatasetEvents as AssetEvents

* feat(js): rename DatasetDetails as AssetDetails

* feat(js): rename DatasetList as AssetList

* feat(js/api): rename useUpstreamDatasetEvents as useUpstreamAssetEvents

* feat(js/api): rename useDatasetsSummary as useAssetsSummary

* feat(js/api): rename useDatasetDependencies as useAssetDependencies

* feat(js/api): rename useDatasetEvents as useAssetEvents

* feat(js/api): rename useDatasets as useAssets

* feat(js/api): rename useDataset as useAsset

* feat(api_connexion): rename get_upstream_dataset_events as get_upstream_asset_events

* feat(api_connexion/openapi/v1): rename DatasetURI as AssetURI

* feat(api_connexion/openapi/v1): rename DatasetCollection as AssetCollection

* feat(api_connexion/openapi/v1): rename DagScheduleDatasetReference as DagScheduleAssetReference

* feat(api_connexion/openapi/v1): rename TaskOutletDatasetReference as TaskOutletAssetReference

* feat(js/api): rename DatasetEventCollection as AssetEventCollection

* feat(api_connexion/openapi/v1): rename DatasetEvent as AssetEvent

* feat(api_connexion/openapi/v1): rename Dataset as Asset

* docs(api_connexion/openapi/v1): update dataset to asset in v1.yaml

* feat(api_connexion): rename endpoint datasets as assets

* test(api_connexion): rename dataset as asset

* fix(api_connexion/openapi/v1): fix queued_events property name error

* feat(api_fastapi): rename next_run_datasets as next_run_assets

* test: resolve test conflict

* docs(newsfragments): add newsfragments for dataset to asset endpoint rename

* feat(js/api): rename datasetEvents as assetEvents

* feat(js/api): rename variable datasetEvent as assetEvent

* feat(js/api): rename dataset_api as asset_api
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
AIP-74 Dataset -> Asset area:API Airflow's REST/HTTP API area:Scheduler including HA (high availability) scheduler
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants