Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test failure: test_pipeline_migrate #3490

Closed
github-actions bot opened this issue Jan 7, 2025 · 2 comments · Fixed by #3554
Closed

Test failure: test_pipeline_migrate #3490

github-actions bot opened this issue Jan 7, 2025 · 2 comments · Fixed by #3554
Assignees
@JCZuurmond
Labels
feat/workflow triggered as a Databricks Job managed by UCX internal this pull request won't appear in release notes

Comments

@github-actions
Copy link

github-actions bot commented Jan 7, 2025

❌ test_pipeline_migrate: databricks.sdk.errors.platform.ResourceDoesNotExist: Job 871286276265735 does not exist. (1m36.028s) 
databricks.sdk.errors.platform.ResourceDoesNotExist: Job 871286276265735 does not exist.
[gw8] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
13:18 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s3afw.pipelines] fetching pipelines inventory
13:18 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/assessment/pipelines.py", line 79, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_s3afw`.`pipelines` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
13:18 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s3afw.pipelines] crawling new set of snapshot data for pipelines
13:19 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s3afw.pipelines] found 256 new records for pipelines
13:19 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s3afw.jobs] fetching jobs inventory
13:19 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/assessment/jobs.py", line 146, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_s3afw`.`jobs` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
13:19 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s3afw.jobs] crawling new set of snapshot data for jobs
13:19 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s3afw.jobs] found 249 new records for jobs
13:18 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s3afw.pipelines] fetching pipelines inventory
13:18 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/assessment/pipelines.py", line 79, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_s3afw`.`pipelines` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
13:18 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s3afw.pipelines] crawling new set of snapshot data for pipelines
13:19 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s3afw.pipelines] found 256 new records for pipelines
13:19 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s3afw.jobs] fetching jobs inventory
13:19 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/assessment/jobs.py", line 146, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_s3afw`.`jobs` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
13:19 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s3afw.jobs] crawling new set of snapshot data for jobs
13:19 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s3afw.jobs] found 249 new records for jobs
[gw8] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #342
@github-actions github-actions bot added the bug label Jan 7, 2025
@JCZuurmond
Copy link
Member

Related issues:

@github-actions GitHub Actions
Copy link
Author

❌ test_pipeline_migrate: databricks.sdk.errors.platform.ResourceDoesNotExist: Job 91434589848148 does not exist. (2m5.406s) 
databricks.sdk.errors.platform.ResourceDoesNotExist: Job 91434589848148 does not exist.
[gw2] linux -- Python 3.10.16 /home/runner/work/ucx/ucx/.venv/bin/python
19:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sa54d.pipelines] fetching pipelines inventory
19:04 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/assessment/pipelines.py", line 89, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sa54d`.`pipelines` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
19:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sa54d.pipelines] crawling new set of snapshot data for pipelines
19:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sa54d.pipelines] found 78 new records for pipelines
19:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sa54d.jobs] fetching jobs inventory
19:04 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/assessment/jobs.py", line 146, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sa54d`.`jobs` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
19:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sa54d.jobs] crawling new set of snapshot data for jobs
19:05 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sa54d.jobs] found 126 new records for jobs
19:06 INFO [databricks.labs.ucx.hive_metastore.pipelines_migrate] Found job:708363371846945 task:bggc associated with pipeline 9e4fbf5a-5878-4993-a38b-bcc42ba5aee5
19:06 INFO [databricks.labs.ucx.hive_metastore.pipelines_migrate] Found job:861182387047281 task:gpm3 associated with pipeline 9e4fbf5a-5878-4993-a38b-bcc42ba5aee5
19:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sa54d.pipelines] fetching pipelines inventory
19:04 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/assessment/pipelines.py", line 89, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sa54d`.`pipelines` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
19:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sa54d.pipelines] crawling new set of snapshot data for pipelines
19:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sa54d.pipelines] found 78 new records for pipelines
19:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sa54d.jobs] fetching jobs inventory
19:04 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/assessment/jobs.py", line 146, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sa54d`.`jobs` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
19:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sa54d.jobs] crawling new set of snapshot data for jobs
19:05 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sa54d.jobs] found 126 new records for jobs
19:06 INFO [databricks.labs.ucx.hive_metastore.pipelines_migrate] Found job:708363371846945 task:bggc associated with pipeline 9e4fbf5a-5878-4993-a38b-bcc42ba5aee5
19:06 INFO [databricks.labs.ucx.hive_metastore.pipelines_migrate] Found job:861182387047281 task:gpm3 associated with pipeline 9e4fbf5a-5878-4993-a38b-bcc42ba5aee5
[gw2] linux -- Python 3.10.16 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #355

@JCZuurmond JCZuurmond self-assigned this Jan 20, 2025
@JCZuurmond JCZuurmond added this to UCX Jan 20, 2025
@github-project-automation github-project-automation bot moved this to Todo in UCX Jan 20, 2025
@JCZuurmond JCZuurmond added migrate/jobs Step 5 - Upgrading Jobs for External Tables internal this pull request won't appear in release notes labels Jan 20, 2025
@JCZuurmond JCZuurmond mentioned this issue Jan 20, 2025
Merged
2 tasks
@JCZuurmond JCZuurmond added feat/workflow triggered as a Databricks Job managed by UCX and removed migrate/jobs Step 5 - Upgrading Jobs for External Tables labels Jan 20, 2025
@github-project-automation github-project-automation bot moved this from Todo to Done in UCX Jan 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@JCZuurmond JCZuurmond

Labels
feat/workflow triggered as a Databricks Job managed by UCX internal this pull request won't appear in release notes
Projects
UCX
Status: Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Let PipelinesMigrator skip unfound jobs databrickslabs/ucx
1 participant
@JCZuurmond