Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test failure: test_migrate_view #3205

Closed
github-actions bot opened this issue Nov 5, 2024 · 7 comments
Closed

Test failure: test_migrate_view #3205

github-actions bot opened this issue Nov 5, 2024 · 7 comments
Assignees
@pritishpai

Comments

@github-actions
Copy link

github-actions bot commented Nov 5, 2024

❌ test_migrate_view: AssertionError: assert 3 == 4 (3m6.352s) 
AssertionError: assert 3 == 4
 +  where 3 = len([Row(database='dummy_stue7', tableName='dummy_t2aev', isTemporary=False), Row(database='dummy_stue7', tableName='dummy_tz2ro', isTemporary=False), Row(database='dummy_stue7', tableName='view3', isTemporary=False)])
[gw1] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
05:11 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=dummy_ceici, managed_table=hive_metastore.dummy_stue7.dummy_t2aev
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] fetching migration_status inventory
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/table_migration_status.py", line 153, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sxyih`.`migration_status` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] crawling new set of snapshot data for migration_status
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] fetching tables inventory
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 411, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sxyih`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] crawling new set of snapshot data for tables
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_stue7] listing tables and views
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_stue7.dummy_t2aev] fetching table metadata
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_stue7.dummy_tncsf] fetching table metadata
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_stue7.dummy_tz2ro] fetching table metadata
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_stue7.view3] fetching table metadata
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] found 4 new records for tables
05:12 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_3rzuweif7iw21oem no longer exists. Skipping checking its migration status.
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] found 4 new records for migration_status
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] fetching tables inventory
05:12 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating managed table hive_metastore.dummy_stue7.dummy_t2aev to dummy_ceici.dummy_stue7.dummy_t2aev using SQL query: CREATE TABLE IF NOT EXISTS `dummy_ceici`.`dummy_stue7`.`dummy_t2aev` DEEP CLONE `hive_metastore`.`dummy_stue7`.`dummy_t2aev`;
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.grants] fetching grants inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/grants.py", line 236, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sxyih`.`grants` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.grants] crawling new set of snapshot data for grants
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] fetching tables inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.udfs] fetching udfs inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/udfs.py", line 63, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sxyih`.`udfs` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.udfs] crawling new set of snapshot data for udfs
05:12 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.dummy_stue7] listing udfs
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.udfs] found 0 new records for udfs
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.grants] found 5 new records for grants
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] fetching tables inventory
05:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.groups] fetching groups inventory
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 629, in _try_fetch
    for row in self._sql_backend.fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sxyih`.`groups` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.groups] crawling new set of snapshot data for groups
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 7 WorkspaceGroup
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 70 account groups
05:13 INFO [databricks.labs.ucx.workspace_access.groups] No group listing provided, all matching groups will be migrated
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-76HQ-ra78a579ab group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-WR7p-ra78a579ab group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-uojC-ra78a579ab group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-Nlve-ra78a579ab group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-ICk4-ra78a579ab group using name matching
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.groups] found 2 new records for groups
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_ceici.dummy_stue7.dummy_t2aev using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_ceici`.`dummy_stue7`.`dummy_t2aev` TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_ceici.dummy_stue7.dummy_t2aev using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_ceici`.`dummy_stue7`.`dummy_t2aev` TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed`
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_ceici.dummy_stue7.dummy_t2aev using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_ceici`.`dummy_stue7`.`dummy_t2aev` TO `[email protected]`
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_ceici.dummy_stue7.dummy_t2aev using SQL query: ALTER TABLE `dummy_ceici`.`dummy_stue7`.`dummy_t2aev` OWNER TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] fetching tables inventory
05:14 INFO [databricks.labs.ucx.hive_metastore.mapping] The intended target for hive_metastore.dummy_stue7.dummy_t2aev, dummy_ceici.dummy_stue7.dummy_t2aev, already exists.
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] crawling new set of snapshot data for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] fetching tables inventory
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_stue7.dummy_t2aev is set as migrated
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] found 4 new records for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_stue7.dummy_tz2ro to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_ceici`.`dummy_stue7`.`dummy_tz2ro` (`id`, `value`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('RemoveAfter'='2024110507', 'transient_lastDdlTime'='1730783512') AS SELECT * FROM `dummy_ceici`.`dummy_stue7`.`dummy_t2aev`
05:14 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_stue7.view3 to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_ceici`.`dummy_stue7`.`view3` (`col1`, `col2`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('transient_lastDdlTime'='1730783515') AS SELECT * FROM `dummy_ceici`.`dummy_stue7`.`dummy_t2aev`
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_stue7.dummy_tz2ro to dummy_ceici.dummy_stue7.dummy_tz2ro: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_ceici.dummy_stue7.dummy_t2aev for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_stue7.view3 to dummy_ceici.dummy_stue7.view3: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_ceici.dummy_stue7.dummy_t2aev for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] crawling new set of snapshot data for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] fetching tables inventory
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_5cyvgimyyhzgla6a no longer exists. Skipping checking its migration status.
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_7rdkfu7emss9ihcs no longer exists. Skipping checking its migration status.
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_sgxtat8y7lfqq8sq no longer exists. Skipping checking its migration status.
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_stue7.dummy_t2aev is set as migrated
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] found 4 new records for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] fetching migration_status inventory
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_stue7.dummy_tncsf cannot be migrated because hive_metastore.dummy_stue7.dummy_tz2ro is not migrated yet
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_stue7.dummy_tncsf is not supported for migration
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] crawling new set of snapshot data for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] fetching tables inventory
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_stue7.dummy_t2aev is set as migrated
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] found 4 new records for migration_status
05:11 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=dummy_ceici, managed_table=hive_metastore.dummy_stue7.dummy_t2aev
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] fetching migration_status inventory
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/table_migration_status.py", line 153, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sxyih`.`migration_status` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] crawling new set of snapshot data for migration_status
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] fetching tables inventory
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 411, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sxyih`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] crawling new set of snapshot data for tables
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_stue7] listing tables and views
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_stue7.dummy_t2aev] fetching table metadata
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_stue7.dummy_tncsf] fetching table metadata
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_stue7.dummy_tz2ro] fetching table metadata
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_stue7.view3] fetching table metadata
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] found 4 new records for tables
05:12 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_3rzuweif7iw21oem no longer exists. Skipping checking its migration status.
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] found 4 new records for migration_status
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] fetching tables inventory
05:12 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating managed table hive_metastore.dummy_stue7.dummy_t2aev to dummy_ceici.dummy_stue7.dummy_t2aev using SQL query: CREATE TABLE IF NOT EXISTS `dummy_ceici`.`dummy_stue7`.`dummy_t2aev` DEEP CLONE `hive_metastore`.`dummy_stue7`.`dummy_t2aev`;
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.grants] fetching grants inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/grants.py", line 236, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sxyih`.`grants` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.grants] crawling new set of snapshot data for grants
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] fetching tables inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.udfs] fetching udfs inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/udfs.py", line 63, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sxyih`.`udfs` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.udfs] crawling new set of snapshot data for udfs
05:12 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.dummy_stue7] listing udfs
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.udfs] found 0 new records for udfs
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.grants] found 5 new records for grants
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] fetching tables inventory
05:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.groups] fetching groups inventory
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 629, in _try_fetch
    for row in self._sql_backend.fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sxyih`.`groups` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.groups] crawling new set of snapshot data for groups
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 7 WorkspaceGroup
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 70 account groups
05:13 INFO [databricks.labs.ucx.workspace_access.groups] No group listing provided, all matching groups will be migrated
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-76HQ-ra78a579ab group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-WR7p-ra78a579ab group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-uojC-ra78a579ab group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-Nlve-ra78a579ab group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-ICk4-ra78a579ab group using name matching
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.groups] found 2 new records for groups
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_ceici.dummy_stue7.dummy_t2aev using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_ceici`.`dummy_stue7`.`dummy_t2aev` TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_ceici.dummy_stue7.dummy_t2aev using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_ceici`.`dummy_stue7`.`dummy_t2aev` TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed`
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_ceici.dummy_stue7.dummy_t2aev using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_ceici`.`dummy_stue7`.`dummy_t2aev` TO `[email protected]`
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_ceici.dummy_stue7.dummy_t2aev using SQL query: ALTER TABLE `dummy_ceici`.`dummy_stue7`.`dummy_t2aev` OWNER TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] fetching tables inventory
05:14 INFO [databricks.labs.ucx.hive_metastore.mapping] The intended target for hive_metastore.dummy_stue7.dummy_t2aev, dummy_ceici.dummy_stue7.dummy_t2aev, already exists.
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] crawling new set of snapshot data for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] fetching tables inventory
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_stue7.dummy_t2aev is set as migrated
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] found 4 new records for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_stue7.dummy_tz2ro to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_ceici`.`dummy_stue7`.`dummy_tz2ro` (`id`, `value`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('RemoveAfter'='2024110507', 'transient_lastDdlTime'='1730783512') AS SELECT * FROM `dummy_ceici`.`dummy_stue7`.`dummy_t2aev`
05:14 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_stue7.view3 to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_ceici`.`dummy_stue7`.`view3` (`col1`, `col2`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('transient_lastDdlTime'='1730783515') AS SELECT * FROM `dummy_ceici`.`dummy_stue7`.`dummy_t2aev`
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_stue7.dummy_tz2ro to dummy_ceici.dummy_stue7.dummy_tz2ro: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_ceici.dummy_stue7.dummy_t2aev for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_stue7.view3 to dummy_ceici.dummy_stue7.view3: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_ceici.dummy_stue7.dummy_t2aev for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] crawling new set of snapshot data for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] fetching tables inventory
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_5cyvgimyyhzgla6a no longer exists. Skipping checking its migration status.
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_7rdkfu7emss9ihcs no longer exists. Skipping checking its migration status.
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_sgxtat8y7lfqq8sq no longer exists. Skipping checking its migration status.
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_stue7.dummy_t2aev is set as migrated
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] found 4 new records for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] fetching migration_status inventory
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_stue7.dummy_tncsf cannot be migrated because hive_metastore.dummy_stue7.dummy_tz2ro is not migrated yet
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_stue7.dummy_tncsf is not supported for migration
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] crawling new set of snapshot data for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.tables] fetching tables inventory
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_stue7.dummy_t2aev is set as migrated
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sxyih.migration_status] found 4 new records for migration_status
[gw1] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #256
@github-actions github-actions bot added the bug label Nov 5, 2024
@github-actions GitHub Actions
Copy link
Author

github-actions bot commented Nov 5, 2024

❌ test_migrate_view: AssertionError: assert 3 == 4 (2m43.326s) 
AssertionError: assert 3 == 4
 +  where 3 = len([Row(database='dummy_su9sj', tableName='dummy_tf2vc', isTemporary=False), Row(database='dummy_su9sj', tableName='dummy_tovke', isTemporary=False), Row(database='dummy_su9sj', tableName='view3', isTemporary=False)])
[gw4] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
13:28 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=dummy_czn3y, managed_table=hive_metastore.dummy_su9sj.dummy_tf2vc
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] fetching migration_status inventory
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/table_migration_status.py", line 153, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sykoj`.`migration_status` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] crawling new set of snapshot data for migration_status
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] fetching tables inventory
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 411, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sykoj`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] crawling new set of snapshot data for tables
13:28 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_su9sj] listing tables and views
13:28 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_su9sj.dummy_t3bpb] fetching table metadata
13:28 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_su9sj.dummy_tf2vc] fetching table metadata
13:28 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_su9sj.dummy_tovke] fetching table metadata
13:28 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_su9sj.view3] fetching table metadata
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] found 4 new records for tables
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] found 4 new records for migration_status
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] fetching tables inventory
13:28 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating managed table hive_metastore.dummy_su9sj.dummy_tf2vc to dummy_czn3y.dummy_su9sj.dummy_tf2vc using SQL query: CREATE TABLE IF NOT EXISTS `dummy_czn3y`.`dummy_su9sj`.`dummy_tf2vc` DEEP CLONE `hive_metastore`.`dummy_su9sj`.`dummy_tf2vc`;
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.grants] fetching grants inventory
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/grants.py", line 236, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sykoj`.`grants` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.grants] crawling new set of snapshot data for grants
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] fetching tables inventory
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.udfs] fetching udfs inventory
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/udfs.py", line 63, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sykoj`.`udfs` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.udfs] crawling new set of snapshot data for udfs
13:28 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.dummy_su9sj] listing udfs
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.udfs] found 0 new records for udfs
13:29 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.grants] found 10 new records for grants
13:29 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] fetching tables inventory
13:29 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
13:29 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.groups] fetching groups inventory
13:29 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 629, in _try_fetch
    for row in self._sql_backend.fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sykoj`.`groups` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
13:29 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.groups] crawling new set of snapshot data for groups
13:29 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
13:29 INFO [databricks.labs.ucx.workspace_access.groups] Found 2 WorkspaceGroup
13:29 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
13:29 INFO [databricks.labs.ucx.workspace_access.groups] Found 70 account groups
13:29 INFO [databricks.labs.ucx.workspace_access.groups] No group listing provided, all matching groups will be migrated
13:29 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.groups] found 2 new records for groups
13:30 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_czn3y.dummy_su9sj.dummy_tf2vc using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_czn3y`.`dummy_su9sj`.`dummy_tf2vc` TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
13:30 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_czn3y.dummy_su9sj.dummy_tf2vc using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_czn3y`.`dummy_su9sj`.`dummy_tf2vc` TO `[email protected]`
13:30 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_czn3y.dummy_su9sj.dummy_tf2vc using SQL query: ALTER TABLE `dummy_czn3y`.`dummy_su9sj`.`dummy_tf2vc` OWNER TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] fetching migration_status inventory
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] fetching tables inventory
13:30 INFO [databricks.labs.ucx.hive_metastore.mapping] The intended target for hive_metastore.dummy_su9sj.dummy_tf2vc, dummy_czn3y.dummy_su9sj.dummy_tf2vc, already exists.
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] ignoring any existing migration_status inventory; refresh is forced.
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] crawling new set of snapshot data for migration_status
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] fetching tables inventory
13:30 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_su9sj.dummy_tf2vc is set as migrated
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] found 4 new records for migration_status
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] fetching migration_status inventory
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] fetching migration_status inventory
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] fetching migration_status inventory
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] fetching migration_status inventory
13:30 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_su9sj.view3 to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_czn3y`.`dummy_su9sj`.`view3` (`col1`, `col2`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('transient_lastDdlTime'='1730813294') AS SELECT * FROM `dummy_czn3y`.`dummy_su9sj`.`dummy_tf2vc`
13:30 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_su9sj.dummy_tovke to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_czn3y`.`dummy_su9sj`.`dummy_tovke` (`id`, `value`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('RemoveAfter'='2024110515', 'transient_lastDdlTime'='1730813291') AS SELECT * FROM `dummy_czn3y`.`dummy_su9sj`.`dummy_tf2vc`
13:30 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_su9sj.dummy_tovke to dummy_czn3y.dummy_su9sj.dummy_tovke: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_czn3y.dummy_su9sj.dummy_tf2vc for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
13:30 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_su9sj.view3 to dummy_czn3y.dummy_su9sj.view3: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_czn3y.dummy_su9sj.dummy_tf2vc for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] ignoring any existing migration_status inventory; refresh is forced.
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] crawling new set of snapshot data for migration_status
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] fetching tables inventory
13:30 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_su9sj.dummy_tf2vc is set as migrated
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] found 4 new records for migration_status
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] fetching migration_status inventory
13:30 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_su9sj.dummy_t3bpb cannot be migrated because hive_metastore.dummy_su9sj.dummy_tovke is not migrated yet
13:30 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_su9sj.dummy_t3bpb is not supported for migration
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] ignoring any existing migration_status inventory; refresh is forced.
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] crawling new set of snapshot data for migration_status
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] fetching tables inventory
13:30 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_su9sj.dummy_tf2vc is set as migrated
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] found 4 new records for migration_status
13:28 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=dummy_czn3y, managed_table=hive_metastore.dummy_su9sj.dummy_tf2vc
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] fetching migration_status inventory
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/table_migration_status.py", line 153, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sykoj`.`migration_status` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] crawling new set of snapshot data for migration_status
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] fetching tables inventory
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 411, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sykoj`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] crawling new set of snapshot data for tables
13:28 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_su9sj] listing tables and views
13:28 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_su9sj.dummy_t3bpb] fetching table metadata
13:28 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_su9sj.dummy_tf2vc] fetching table metadata
13:28 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_su9sj.dummy_tovke] fetching table metadata
13:28 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_su9sj.view3] fetching table metadata
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] found 4 new records for tables
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] found 4 new records for migration_status
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] fetching tables inventory
13:28 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating managed table hive_metastore.dummy_su9sj.dummy_tf2vc to dummy_czn3y.dummy_su9sj.dummy_tf2vc using SQL query: CREATE TABLE IF NOT EXISTS `dummy_czn3y`.`dummy_su9sj`.`dummy_tf2vc` DEEP CLONE `hive_metastore`.`dummy_su9sj`.`dummy_tf2vc`;
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.grants] fetching grants inventory
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/grants.py", line 236, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sykoj`.`grants` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.grants] crawling new set of snapshot data for grants
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] fetching tables inventory
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.udfs] fetching udfs inventory
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/udfs.py", line 63, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sykoj`.`udfs` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.udfs] crawling new set of snapshot data for udfs
13:28 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.dummy_su9sj] listing udfs
13:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.udfs] found 0 new records for udfs
13:29 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.grants] found 10 new records for grants
13:29 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] fetching tables inventory
13:29 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
13:29 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.groups] fetching groups inventory
13:29 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 629, in _try_fetch
    for row in self._sql_backend.fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sykoj`.`groups` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
13:29 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.groups] crawling new set of snapshot data for groups
13:29 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
13:29 INFO [databricks.labs.ucx.workspace_access.groups] Found 2 WorkspaceGroup
13:29 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
13:29 INFO [databricks.labs.ucx.workspace_access.groups] Found 70 account groups
13:29 INFO [databricks.labs.ucx.workspace_access.groups] No group listing provided, all matching groups will be migrated
13:29 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.groups] found 2 new records for groups
13:30 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_czn3y.dummy_su9sj.dummy_tf2vc using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_czn3y`.`dummy_su9sj`.`dummy_tf2vc` TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
13:30 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_czn3y.dummy_su9sj.dummy_tf2vc using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_czn3y`.`dummy_su9sj`.`dummy_tf2vc` TO `[email protected]`
13:30 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_czn3y.dummy_su9sj.dummy_tf2vc using SQL query: ALTER TABLE `dummy_czn3y`.`dummy_su9sj`.`dummy_tf2vc` OWNER TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] fetching migration_status inventory
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] fetching tables inventory
13:30 INFO [databricks.labs.ucx.hive_metastore.mapping] The intended target for hive_metastore.dummy_su9sj.dummy_tf2vc, dummy_czn3y.dummy_su9sj.dummy_tf2vc, already exists.
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] ignoring any existing migration_status inventory; refresh is forced.
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] crawling new set of snapshot data for migration_status
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] fetching tables inventory
13:30 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_su9sj.dummy_tf2vc is set as migrated
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] found 4 new records for migration_status
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] fetching migration_status inventory
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] fetching migration_status inventory
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] fetching migration_status inventory
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] fetching migration_status inventory
13:30 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_su9sj.view3 to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_czn3y`.`dummy_su9sj`.`view3` (`col1`, `col2`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('transient_lastDdlTime'='1730813294') AS SELECT * FROM `dummy_czn3y`.`dummy_su9sj`.`dummy_tf2vc`
13:30 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_su9sj.dummy_tovke to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_czn3y`.`dummy_su9sj`.`dummy_tovke` (`id`, `value`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('RemoveAfter'='2024110515', 'transient_lastDdlTime'='1730813291') AS SELECT * FROM `dummy_czn3y`.`dummy_su9sj`.`dummy_tf2vc`
13:30 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_su9sj.dummy_tovke to dummy_czn3y.dummy_su9sj.dummy_tovke: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_czn3y.dummy_su9sj.dummy_tf2vc for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
13:30 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_su9sj.view3 to dummy_czn3y.dummy_su9sj.view3: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_czn3y.dummy_su9sj.dummy_tf2vc for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] ignoring any existing migration_status inventory; refresh is forced.
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] crawling new set of snapshot data for migration_status
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] fetching tables inventory
13:30 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_su9sj.dummy_tf2vc is set as migrated
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] found 4 new records for migration_status
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] fetching migration_status inventory
13:30 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_su9sj.dummy_t3bpb cannot be migrated because hive_metastore.dummy_su9sj.dummy_tovke is not migrated yet
13:30 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_su9sj.dummy_t3bpb is not supported for migration
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] ignoring any existing migration_status inventory; refresh is forced.
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] crawling new set of snapshot data for migration_status
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.tables] fetching tables inventory
13:30 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_su9sj.dummy_tf2vc is set as migrated
13:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sykoj.migration_status] found 4 new records for migration_status
[gw4] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #257

@github-actions GitHub Actions
Copy link
Author

github-actions bot commented Nov 6, 2024

❌ test_migrate_view: AssertionError: assert 3 == 4 (2m39.403s) 
AssertionError: assert 3 == 4
 +  where 3 = len([Row(database='dummy_sv2hq', tableName='dummy_t0lxh', isTemporary=False), Row(database='dummy_sv2hq', tableName='dummy_tc5yw', isTemporary=False), Row(database='dummy_sv2hq', tableName='view3', isTemporary=False)])
[gw2] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
05:12 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=dummy_cdgdm, managed_table=hive_metastore.dummy_sv2hq.dummy_tc5yw
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] fetching migration_status inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/table_migration_status.py", line 153, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_svppa`.`migration_status` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] crawling new set of snapshot data for migration_status
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] fetching tables inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 411, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_svppa`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] crawling new set of snapshot data for tables
05:12 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_sv2hq] listing tables and views
05:12 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_sv2hq.dummy_t0lxh] fetching table metadata
05:12 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_sv2hq.dummy_t8pmh] fetching table metadata
05:12 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_sv2hq.dummy_tc5yw] fetching table metadata
05:12 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_sv2hq.view3] fetching table metadata
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] found 4 new records for tables
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] found 4 new records for migration_status
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] fetching tables inventory
05:12 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating managed table hive_metastore.dummy_sv2hq.dummy_tc5yw to dummy_cdgdm.dummy_sv2hq.dummy_tc5yw using SQL query: CREATE TABLE IF NOT EXISTS `dummy_cdgdm`.`dummy_sv2hq`.`dummy_tc5yw` DEEP CLONE `hive_metastore`.`dummy_sv2hq`.`dummy_tc5yw`;
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.grants] fetching grants inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/grants.py", line 236, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_svppa`.`grants` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.grants] crawling new set of snapshot data for grants
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] fetching tables inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.udfs] fetching udfs inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/udfs.py", line 63, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_svppa`.`udfs` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.udfs] crawling new set of snapshot data for udfs
05:12 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.dummy_sv2hq] listing udfs
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.udfs] found 0 new records for udfs
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.grants] found 5 new records for grants
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] fetching tables inventory
05:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.groups] fetching groups inventory
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 629, in _try_fetch
    for row in self._sql_backend.fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_svppa`.`groups` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.groups] crawling new set of snapshot data for groups
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 7 WorkspaceGroup
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 70 account groups
05:13 INFO [databricks.labs.ucx.workspace_access.groups] No group listing provided, all matching groups will be migrated
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-XcnQ-ra78a57a0f group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-QUus-ra78a57a0f group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-cuxa-ra78a57a0f group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-MEwo-ra78a57a0f group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-VMvq-ra78a57a0f group using name matching
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.groups] found 2 new records for groups
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cdgdm.dummy_sv2hq.dummy_tc5yw using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_cdgdm`.`dummy_sv2hq`.`dummy_tc5yw` TO `[email protected]`
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cdgdm.dummy_sv2hq.dummy_tc5yw using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_cdgdm`.`dummy_sv2hq`.`dummy_tc5yw` TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed`
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cdgdm.dummy_sv2hq.dummy_tc5yw using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_cdgdm`.`dummy_sv2hq`.`dummy_tc5yw` TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cdgdm.dummy_sv2hq.dummy_tc5yw using SQL query: ALTER TABLE `dummy_cdgdm`.`dummy_sv2hq`.`dummy_tc5yw` OWNER TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] fetching migration_status inventory
05:13 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_sv8thdqn5gpfb5qg no longer exists. Skipping checking its migration status.
05:13 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_x7t29act1l3qgkjy no longer exists. Skipping checking its migration status.
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] fetching tables inventory
05:13 INFO [databricks.labs.ucx.hive_metastore.mapping] The intended target for hive_metastore.dummy_sv2hq.dummy_tc5yw, dummy_cdgdm.dummy_sv2hq.dummy_tc5yw, already exists.
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] crawling new set of snapshot data for migration_status
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] fetching tables inventory
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_sv2hq.dummy_tc5yw is set as migrated
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] found 4 new records for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_sv2hq.dummy_t0lxh to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_cdgdm`.`dummy_sv2hq`.`dummy_t0lxh` (`id`, `value`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('RemoveAfter'='2024110607', 'transient_lastDdlTime'='1730869919') AS SELECT * FROM `dummy_cdgdm`.`dummy_sv2hq`.`dummy_tc5yw`
05:14 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_sv2hq.view3 to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_cdgdm`.`dummy_sv2hq`.`view3` (`col1`, `col2`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('transient_lastDdlTime'='1730869921') AS SELECT * FROM `dummy_cdgdm`.`dummy_sv2hq`.`dummy_tc5yw`
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_sv2hq.view3 to dummy_cdgdm.dummy_sv2hq.view3: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_cdgdm.dummy_sv2hq.dummy_tc5yw for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_sv2hq.dummy_t0lxh to dummy_cdgdm.dummy_sv2hq.dummy_t0lxh: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_cdgdm.dummy_sv2hq.dummy_tc5yw for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] crawling new set of snapshot data for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] fetching tables inventory
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_sv2hq.dummy_tc5yw is set as migrated
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] found 4 new records for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] fetching migration_status inventory
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_sv2hq.dummy_t8pmh cannot be migrated because hive_metastore.dummy_sv2hq.dummy_t0lxh is not migrated yet
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_sv2hq.dummy_t8pmh is not supported for migration
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] crawling new set of snapshot data for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] fetching tables inventory
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_sv2hq.dummy_tc5yw is set as migrated
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] found 4 new records for migration_status
05:12 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=dummy_cdgdm, managed_table=hive_metastore.dummy_sv2hq.dummy_tc5yw
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] fetching migration_status inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/table_migration_status.py", line 153, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_svppa`.`migration_status` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] crawling new set of snapshot data for migration_status
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] fetching tables inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 411, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_svppa`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] crawling new set of snapshot data for tables
05:12 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_sv2hq] listing tables and views
05:12 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_sv2hq.dummy_t0lxh] fetching table metadata
05:12 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_sv2hq.dummy_t8pmh] fetching table metadata
05:12 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_sv2hq.dummy_tc5yw] fetching table metadata
05:12 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_sv2hq.view3] fetching table metadata
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] found 4 new records for tables
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] found 4 new records for migration_status
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] fetching tables inventory
05:12 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating managed table hive_metastore.dummy_sv2hq.dummy_tc5yw to dummy_cdgdm.dummy_sv2hq.dummy_tc5yw using SQL query: CREATE TABLE IF NOT EXISTS `dummy_cdgdm`.`dummy_sv2hq`.`dummy_tc5yw` DEEP CLONE `hive_metastore`.`dummy_sv2hq`.`dummy_tc5yw`;
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.grants] fetching grants inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/grants.py", line 236, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_svppa`.`grants` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.grants] crawling new set of snapshot data for grants
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] fetching tables inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.udfs] fetching udfs inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/udfs.py", line 63, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_svppa`.`udfs` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.udfs] crawling new set of snapshot data for udfs
05:12 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.dummy_sv2hq] listing udfs
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.udfs] found 0 new records for udfs
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.grants] found 5 new records for grants
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] fetching tables inventory
05:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.groups] fetching groups inventory
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 629, in _try_fetch
    for row in self._sql_backend.fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_svppa`.`groups` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.groups] crawling new set of snapshot data for groups
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 7 WorkspaceGroup
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 70 account groups
05:13 INFO [databricks.labs.ucx.workspace_access.groups] No group listing provided, all matching groups will be migrated
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-XcnQ-ra78a57a0f group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-QUus-ra78a57a0f group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-cuxa-ra78a57a0f group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-MEwo-ra78a57a0f group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-VMvq-ra78a57a0f group using name matching
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.groups] found 2 new records for groups
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cdgdm.dummy_sv2hq.dummy_tc5yw using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_cdgdm`.`dummy_sv2hq`.`dummy_tc5yw` TO `[email protected]`
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cdgdm.dummy_sv2hq.dummy_tc5yw using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_cdgdm`.`dummy_sv2hq`.`dummy_tc5yw` TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed`
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cdgdm.dummy_sv2hq.dummy_tc5yw using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_cdgdm`.`dummy_sv2hq`.`dummy_tc5yw` TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cdgdm.dummy_sv2hq.dummy_tc5yw using SQL query: ALTER TABLE `dummy_cdgdm`.`dummy_sv2hq`.`dummy_tc5yw` OWNER TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] fetching migration_status inventory
05:13 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_sv8thdqn5gpfb5qg no longer exists. Skipping checking its migration status.
05:13 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_x7t29act1l3qgkjy no longer exists. Skipping checking its migration status.
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] fetching tables inventory
05:13 INFO [databricks.labs.ucx.hive_metastore.mapping] The intended target for hive_metastore.dummy_sv2hq.dummy_tc5yw, dummy_cdgdm.dummy_sv2hq.dummy_tc5yw, already exists.
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] crawling new set of snapshot data for migration_status
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] fetching tables inventory
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_sv2hq.dummy_tc5yw is set as migrated
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] found 4 new records for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_sv2hq.dummy_t0lxh to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_cdgdm`.`dummy_sv2hq`.`dummy_t0lxh` (`id`, `value`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('RemoveAfter'='2024110607', 'transient_lastDdlTime'='1730869919') AS SELECT * FROM `dummy_cdgdm`.`dummy_sv2hq`.`dummy_tc5yw`
05:14 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_sv2hq.view3 to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_cdgdm`.`dummy_sv2hq`.`view3` (`col1`, `col2`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('transient_lastDdlTime'='1730869921') AS SELECT * FROM `dummy_cdgdm`.`dummy_sv2hq`.`dummy_tc5yw`
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_sv2hq.view3 to dummy_cdgdm.dummy_sv2hq.view3: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_cdgdm.dummy_sv2hq.dummy_tc5yw for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_sv2hq.dummy_t0lxh to dummy_cdgdm.dummy_sv2hq.dummy_t0lxh: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_cdgdm.dummy_sv2hq.dummy_tc5yw for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] crawling new set of snapshot data for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] fetching tables inventory
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_sv2hq.dummy_tc5yw is set as migrated
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] found 4 new records for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] fetching migration_status inventory
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_sv2hq.dummy_t8pmh cannot be migrated because hive_metastore.dummy_sv2hq.dummy_t0lxh is not migrated yet
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_sv2hq.dummy_t8pmh is not supported for migration
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] crawling new set of snapshot data for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.tables] fetching tables inventory
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_sv2hq.dummy_tc5yw is set as migrated
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_svppa.migration_status] found 4 new records for migration_status
[gw2] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #258

@github-actions GitHub Actions
Copy link
Author

github-actions bot commented Nov 7, 2024

❌ test_migrate_view: AssertionError: assert 3 == 4 (2m59.36s) 
AssertionError: assert 3 == 4
 +  where 3 = len([Row(database='dummy_syyza', tableName='dummy_t6u7x', isTemporary=False), Row(database='dummy_syyza', tableName='dummy_tj6bn', isTemporary=False), Row(database='dummy_syyza', tableName='view3', isTemporary=False)])
[gw1] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
05:11 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=dummy_cowwk, managed_table=hive_metastore.dummy_syyza.dummy_tj6bn
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] fetching migration_status inventory
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/table_migration_status.py", line 153, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sztfp`.`migration_status` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] crawling new set of snapshot data for migration_status
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] fetching tables inventory
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 411, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sztfp`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] crawling new set of snapshot data for tables
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_syyza] listing tables and views
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_syyza.dummy_t6u7x] fetching table metadata
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_syyza.dummy_tg5xc] fetching table metadata
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_syyza.dummy_tj6bn] fetching table metadata
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_syyza.view3] fetching table metadata
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] found 4 new records for tables
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] found 4 new records for migration_status
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] fetching tables inventory
05:12 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating managed table hive_metastore.dummy_syyza.dummy_tj6bn to dummy_cowwk.dummy_syyza.dummy_tj6bn using SQL query: CREATE TABLE IF NOT EXISTS `dummy_cowwk`.`dummy_syyza`.`dummy_tj6bn` DEEP CLONE `hive_metastore`.`dummy_syyza`.`dummy_tj6bn`;
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.grants] fetching grants inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/grants.py", line 236, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sztfp`.`grants` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.grants] crawling new set of snapshot data for grants
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] fetching tables inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.udfs] fetching udfs inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/udfs.py", line 63, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sztfp`.`udfs` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.udfs] crawling new set of snapshot data for udfs
05:12 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.dummy_syyza] listing udfs
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.udfs] found 0 new records for udfs
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.grants] found 5 new records for grants
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] fetching tables inventory
05:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.groups] fetching groups inventory
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 629, in _try_fetch
    for row in self._sql_backend.fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sztfp`.`groups` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.groups] crawling new set of snapshot data for groups
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 7 WorkspaceGroup
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 70 account groups
05:13 INFO [databricks.labs.ucx.workspace_access.groups] No group listing provided, all matching groups will be migrated
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-3xkd-ra78a57a73 group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-x1vY-ra78a57a73 group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-JFrz-ra78a57a73 group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-Uyqb-ra78a57a73 group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-UWee-ra78a57a73 group using name matching
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.groups] found 2 new records for groups
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cowwk.dummy_syyza.dummy_tj6bn using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_cowwk`.`dummy_syyza`.`dummy_tj6bn` TO `[email protected]`
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cowwk.dummy_syyza.dummy_tj6bn using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_cowwk`.`dummy_syyza`.`dummy_tj6bn` TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cowwk.dummy_syyza.dummy_tj6bn using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_cowwk`.`dummy_syyza`.`dummy_tj6bn` TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed`
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cowwk.dummy_syyza.dummy_tj6bn using SQL query: ALTER TABLE `dummy_cowwk`.`dummy_syyza`.`dummy_tj6bn` OWNER TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] fetching migration_status inventory
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] fetching tables inventory
05:13 INFO [databricks.labs.ucx.hive_metastore.mapping] The intended target for hive_metastore.dummy_syyza.dummy_tj6bn, dummy_cowwk.dummy_syyza.dummy_tj6bn, already exists.
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] crawling new set of snapshot data for migration_status
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] fetching tables inventory
05:13 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_8jtgbpk2ohbwn15m no longer exists. Skipping checking its migration status.
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_syyza.dummy_tj6bn is set as migrated
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] found 4 new records for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_syyza.view3 to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_cowwk`.`dummy_syyza`.`view3` (`col1`, `col2`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('transient_lastDdlTime'='1730956310') AS SELECT * FROM `dummy_cowwk`.`dummy_syyza`.`dummy_tj6bn`
05:14 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_syyza.dummy_t6u7x to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_cowwk`.`dummy_syyza`.`dummy_t6u7x` (`id`, `value`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('RemoveAfter'='2024110707', 'transient_lastDdlTime'='1730956307') AS SELECT * FROM `dummy_cowwk`.`dummy_syyza`.`dummy_tj6bn`
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_syyza.dummy_t6u7x to dummy_cowwk.dummy_syyza.dummy_t6u7x: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_cowwk.dummy_syyza.dummy_tj6bn for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_syyza.view3 to dummy_cowwk.dummy_syyza.view3: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_cowwk.dummy_syyza.dummy_tj6bn for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] crawling new set of snapshot data for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] fetching tables inventory
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_3xeahhvoq7xbvtqj no longer exists. Skipping checking its migration status.
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_syyza.dummy_tj6bn is set as migrated
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] found 4 new records for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] fetching migration_status inventory
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_syyza.dummy_tg5xc cannot be migrated because hive_metastore.dummy_syyza.dummy_t6u7x is not migrated yet
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_syyza.dummy_tg5xc is not supported for migration
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] crawling new set of snapshot data for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] fetching tables inventory
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_bsdul3lnj3mp95rk no longer exists. Skipping checking its migration status.
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_ezrqqnqu8feclbdn no longer exists. Skipping checking its migration status.
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_syyza.dummy_tj6bn is set as migrated
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] found 4 new records for migration_status
05:11 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=dummy_cowwk, managed_table=hive_metastore.dummy_syyza.dummy_tj6bn
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] fetching migration_status inventory
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/table_migration_status.py", line 153, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sztfp`.`migration_status` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] crawling new set of snapshot data for migration_status
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] fetching tables inventory
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 411, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sztfp`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] crawling new set of snapshot data for tables
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_syyza] listing tables and views
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_syyza.dummy_t6u7x] fetching table metadata
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_syyza.dummy_tg5xc] fetching table metadata
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_syyza.dummy_tj6bn] fetching table metadata
05:11 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_syyza.view3] fetching table metadata
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] found 4 new records for tables
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] found 4 new records for migration_status
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] fetching tables inventory
05:12 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating managed table hive_metastore.dummy_syyza.dummy_tj6bn to dummy_cowwk.dummy_syyza.dummy_tj6bn using SQL query: CREATE TABLE IF NOT EXISTS `dummy_cowwk`.`dummy_syyza`.`dummy_tj6bn` DEEP CLONE `hive_metastore`.`dummy_syyza`.`dummy_tj6bn`;
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.grants] fetching grants inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/grants.py", line 236, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sztfp`.`grants` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.grants] crawling new set of snapshot data for grants
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] fetching tables inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.udfs] fetching udfs inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/udfs.py", line 63, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sztfp`.`udfs` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.udfs] crawling new set of snapshot data for udfs
05:12 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.dummy_syyza] listing udfs
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.udfs] found 0 new records for udfs
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.grants] found 5 new records for grants
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] fetching tables inventory
05:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.groups] fetching groups inventory
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 629, in _try_fetch
    for row in self._sql_backend.fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sztfp`.`groups` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.groups] crawling new set of snapshot data for groups
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 7 WorkspaceGroup
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 70 account groups
05:13 INFO [databricks.labs.ucx.workspace_access.groups] No group listing provided, all matching groups will be migrated
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-3xkd-ra78a57a73 group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-x1vY-ra78a57a73 group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-JFrz-ra78a57a73 group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-Uyqb-ra78a57a73 group using name matching
05:13 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-UWee-ra78a57a73 group using name matching
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.groups] found 2 new records for groups
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cowwk.dummy_syyza.dummy_tj6bn using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_cowwk`.`dummy_syyza`.`dummy_tj6bn` TO `[email protected]`
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cowwk.dummy_syyza.dummy_tj6bn using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_cowwk`.`dummy_syyza`.`dummy_tj6bn` TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cowwk.dummy_syyza.dummy_tj6bn using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_cowwk`.`dummy_syyza`.`dummy_tj6bn` TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed`
05:13 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cowwk.dummy_syyza.dummy_tj6bn using SQL query: ALTER TABLE `dummy_cowwk`.`dummy_syyza`.`dummy_tj6bn` OWNER TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] fetching migration_status inventory
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] fetching tables inventory
05:13 INFO [databricks.labs.ucx.hive_metastore.mapping] The intended target for hive_metastore.dummy_syyza.dummy_tj6bn, dummy_cowwk.dummy_syyza.dummy_tj6bn, already exists.
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] crawling new set of snapshot data for migration_status
05:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] fetching tables inventory
05:13 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_8jtgbpk2ohbwn15m no longer exists. Skipping checking its migration status.
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_syyza.dummy_tj6bn is set as migrated
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] found 4 new records for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] fetching migration_status inventory
05:14 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_syyza.view3 to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_cowwk`.`dummy_syyza`.`view3` (`col1`, `col2`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('transient_lastDdlTime'='1730956310') AS SELECT * FROM `dummy_cowwk`.`dummy_syyza`.`dummy_tj6bn`
05:14 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_syyza.dummy_t6u7x to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_cowwk`.`dummy_syyza`.`dummy_t6u7x` (`id`, `value`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('RemoveAfter'='2024110707', 'transient_lastDdlTime'='1730956307') AS SELECT * FROM `dummy_cowwk`.`dummy_syyza`.`dummy_tj6bn`
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_syyza.dummy_t6u7x to dummy_cowwk.dummy_syyza.dummy_t6u7x: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_cowwk.dummy_syyza.dummy_tj6bn for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_syyza.view3 to dummy_cowwk.dummy_syyza.view3: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_cowwk.dummy_syyza.dummy_tj6bn for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] crawling new set of snapshot data for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] fetching tables inventory
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_3xeahhvoq7xbvtqj no longer exists. Skipping checking its migration status.
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_syyza.dummy_tj6bn is set as migrated
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] found 4 new records for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] fetching migration_status inventory
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_syyza.dummy_tg5xc cannot be migrated because hive_metastore.dummy_syyza.dummy_t6u7x is not migrated yet
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_syyza.dummy_tg5xc is not supported for migration
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] crawling new set of snapshot data for migration_status
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.tables] fetching tables inventory
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_bsdul3lnj3mp95rk no longer exists. Skipping checking its migration status.
05:14 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_ezrqqnqu8feclbdn no longer exists. Skipping checking its migration status.
05:14 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_syyza.dummy_tj6bn is set as migrated
05:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sztfp.migration_status] found 4 new records for migration_status
[gw1] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #259

@pritishpai pritishpai self-assigned this Nov 7, 2024
@pritishpai
Copy link
Contributor

Dependency
table <- view1 <- view2

The view2 does not get created here as it is dependent on the view1. It should however get created on a subsequent run of migrate_view as the view1 will exist.

@github-actions GitHub Actions
Copy link
Author

github-actions bot commented Nov 8, 2024

❌ test_migrate_view: AssertionError: assert 3 == 4 (3m0.778s) 
AssertionError: assert 3 == 4
 +  where 3 = len([Row(database='dummy_szpjd', tableName='dummy_t0twd', isTemporary=False), Row(database='dummy_szpjd', tableName='dummy_tc1uy', isTemporary=False), Row(database='dummy_szpjd', tableName='view3', isTemporary=False)])
[gw2] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
05:09 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=dummy_cqbfi, managed_table=hive_metastore.dummy_szpjd.dummy_tc1uy
05:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] fetching migration_status inventory
05:09 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/table_migration_status.py", line 153, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_s5zki`.`migration_status` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] crawling new set of snapshot data for migration_status
05:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] fetching tables inventory
05:09 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 411, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_s5zki`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] crawling new set of snapshot data for tables
05:09 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_szpjd] listing tables and views
05:09 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_szpjd.dummy_t0twd] fetching table metadata
05:09 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_szpjd.dummy_tc1uy] fetching table metadata
05:09 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_szpjd.dummy_trbms] fetching table metadata
05:09 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_szpjd.view3] fetching table metadata
05:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] found 4 new records for tables
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] found 4 new records for migration_status
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] fetching tables inventory
05:10 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating managed table hive_metastore.dummy_szpjd.dummy_tc1uy to dummy_cqbfi.dummy_szpjd.dummy_tc1uy using SQL query: CREATE TABLE IF NOT EXISTS `dummy_cqbfi`.`dummy_szpjd`.`dummy_tc1uy` DEEP CLONE `hive_metastore`.`dummy_szpjd`.`dummy_tc1uy`;
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.grants] fetching grants inventory
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/grants.py", line 236, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_s5zki`.`grants` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.grants] crawling new set of snapshot data for grants
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] fetching tables inventory
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.udfs] fetching udfs inventory
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/udfs.py", line 63, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_s5zki`.`udfs` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.udfs] crawling new set of snapshot data for udfs
05:10 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.dummy_szpjd] listing udfs
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.udfs] found 0 new records for udfs
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.grants] found 5 new records for grants
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] fetching tables inventory
05:11 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.groups] fetching groups inventory
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 629, in _try_fetch
    for row in self._sql_backend.fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_s5zki`.`groups` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.groups] crawling new set of snapshot data for groups
05:11 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:11 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
05:11 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
05:11 INFO [databricks.labs.ucx.workspace_access.groups] Found 70 account groups
05:11 INFO [databricks.labs.ucx.workspace_access.groups] No group listing provided, all matching groups will be migrated
05:11 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-N8Yw-ra78a57ad7 group using name matching
05:11 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-aKsl-ra78a57ad7 group using name matching
05:11 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-qpb6-ra78a57ad7 group using name matching
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.groups] found 2 new records for groups
05:11 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cqbfi.dummy_szpjd.dummy_tc1uy using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_cqbfi`.`dummy_szpjd`.`dummy_tc1uy` TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
05:11 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cqbfi.dummy_szpjd.dummy_tc1uy using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_cqbfi`.`dummy_szpjd`.`dummy_tc1uy` TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed`
05:11 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cqbfi.dummy_szpjd.dummy_tc1uy using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_cqbfi`.`dummy_szpjd`.`dummy_tc1uy` TO `[email protected]`
05:11 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cqbfi.dummy_szpjd.dummy_tc1uy using SQL query: ALTER TABLE `dummy_cqbfi`.`dummy_szpjd`.`dummy_tc1uy` OWNER TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] fetching migration_status inventory
05:11 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_dqajwf2ys7vrd8yc no longer exists. Skipping checking its migration status.
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] fetching tables inventory
05:11 INFO [databricks.labs.ucx.hive_metastore.mapping] The intended target for hive_metastore.dummy_szpjd.dummy_tc1uy, dummy_cqbfi.dummy_szpjd.dummy_tc1uy, already exists.
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] crawling new set of snapshot data for migration_status
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] fetching tables inventory
05:12 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_szpjd.dummy_tc1uy is set as migrated
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] found 4 new records for migration_status
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] fetching migration_status inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] fetching migration_status inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] fetching migration_status inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] fetching migration_status inventory
05:12 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_szpjd.dummy_t0twd to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_cqbfi`.`dummy_szpjd`.`dummy_t0twd` (`id`, `value`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('RemoveAfter'='2024110807', 'transient_lastDdlTime'='1731042581') AS SELECT * FROM `dummy_cqbfi`.`dummy_szpjd`.`dummy_tc1uy`
05:12 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_szpjd.view3 to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_cqbfi`.`dummy_szpjd`.`view3` (`col1`, `col2`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('transient_lastDdlTime'='1731042584') AS SELECT * FROM `dummy_cqbfi`.`dummy_szpjd`.`dummy_tc1uy`
05:12 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_szpjd.view3 to dummy_cqbfi.dummy_szpjd.view3: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_cqbfi.dummy_szpjd.dummy_tc1uy for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
05:12 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_szpjd.dummy_t0twd to dummy_cqbfi.dummy_szpjd.dummy_t0twd: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_cqbfi.dummy_szpjd.dummy_tc1uy for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] crawling new set of snapshot data for migration_status
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] fetching tables inventory
05:12 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Schema dummy_ckb3i.TEST_SCHEMA no longer exists. Skipping checking its migration status.
05:12 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Schema dummy_ckb3i.dummy_sfou9 no longer exists. Skipping checking its migration status.
05:12 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Schema dummy_ckb3i.information_schema no longer exists. Skipping checking its migration status.
05:12 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_akjzkmbnfawy4rgp no longer exists. Skipping checking its migration status.
05:12 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_ovgrwe9rwrumnvpl no longer exists. Skipping checking its migration status.
05:12 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_szpjd.dummy_tc1uy is set as migrated
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] found 4 new records for migration_status
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] fetching migration_status inventory
05:12 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_szpjd.dummy_trbms cannot be migrated because hive_metastore.dummy_szpjd.dummy_t0twd is not migrated yet
05:12 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_szpjd.dummy_trbms is not supported for migration
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] crawling new set of snapshot data for migration_status
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] fetching tables inventory
05:12 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_gl2pmxkmrawdjls3 no longer exists. Skipping checking its migration status.
05:12 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_szpjd.dummy_tc1uy is set as migrated
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] found 4 new records for migration_status
05:09 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=dummy_cqbfi, managed_table=hive_metastore.dummy_szpjd.dummy_tc1uy
05:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] fetching migration_status inventory
05:09 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/table_migration_status.py", line 153, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_s5zki`.`migration_status` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] crawling new set of snapshot data for migration_status
05:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] fetching tables inventory
05:09 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 411, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_s5zki`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] crawling new set of snapshot data for tables
05:09 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_szpjd] listing tables and views
05:09 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_szpjd.dummy_t0twd] fetching table metadata
05:09 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_szpjd.dummy_tc1uy] fetching table metadata
05:09 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_szpjd.dummy_trbms] fetching table metadata
05:09 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_szpjd.view3] fetching table metadata
05:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] found 4 new records for tables
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] found 4 new records for migration_status
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] fetching tables inventory
05:10 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating managed table hive_metastore.dummy_szpjd.dummy_tc1uy to dummy_cqbfi.dummy_szpjd.dummy_tc1uy using SQL query: CREATE TABLE IF NOT EXISTS `dummy_cqbfi`.`dummy_szpjd`.`dummy_tc1uy` DEEP CLONE `hive_metastore`.`dummy_szpjd`.`dummy_tc1uy`;
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.grants] fetching grants inventory
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/grants.py", line 236, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_s5zki`.`grants` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.grants] crawling new set of snapshot data for grants
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] fetching tables inventory
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.udfs] fetching udfs inventory
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/udfs.py", line 63, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_s5zki`.`udfs` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.udfs] crawling new set of snapshot data for udfs
05:10 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.dummy_szpjd] listing udfs
05:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.udfs] found 0 new records for udfs
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.grants] found 5 new records for grants
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] fetching tables inventory
05:11 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.groups] fetching groups inventory
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 629, in _try_fetch
    for row in self._sql_backend.fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 331, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 255, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 465, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_s5zki`.`groups` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.groups] crawling new set of snapshot data for groups
05:11 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:11 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
05:11 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
05:11 INFO [databricks.labs.ucx.workspace_access.groups] Found 70 account groups
05:11 INFO [databricks.labs.ucx.workspace_access.groups] No group listing provided, all matching groups will be migrated
05:11 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-N8Yw-ra78a57ad7 group using name matching
05:11 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-aKsl-ra78a57ad7 group using name matching
05:11 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-qpb6-ra78a57ad7 group using name matching
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.groups] found 2 new records for groups
05:11 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cqbfi.dummy_szpjd.dummy_tc1uy using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_cqbfi`.`dummy_szpjd`.`dummy_tc1uy` TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
05:11 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cqbfi.dummy_szpjd.dummy_tc1uy using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_cqbfi`.`dummy_szpjd`.`dummy_tc1uy` TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed`
05:11 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cqbfi.dummy_szpjd.dummy_tc1uy using SQL query: GRANT ALL PRIVILEGES ON TABLE `dummy_cqbfi`.`dummy_szpjd`.`dummy_tc1uy` TO `[email protected]`
05:11 DEBUG [databricks.labs.ucx.hive_metastore.grants] Migrating acls on dummy_cqbfi.dummy_szpjd.dummy_tc1uy using SQL query: ALTER TABLE `dummy_cqbfi`.`dummy_szpjd`.`dummy_tc1uy` OWNER TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] fetching migration_status inventory
05:11 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_dqajwf2ys7vrd8yc no longer exists. Skipping checking its migration status.
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] fetching tables inventory
05:11 INFO [databricks.labs.ucx.hive_metastore.mapping] The intended target for hive_metastore.dummy_szpjd.dummy_tc1uy, dummy_cqbfi.dummy_szpjd.dummy_tc1uy, already exists.
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] crawling new set of snapshot data for migration_status
05:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] fetching tables inventory
05:12 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_szpjd.dummy_tc1uy is set as migrated
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] found 4 new records for migration_status
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] fetching migration_status inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] fetching migration_status inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] fetching migration_status inventory
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] fetching migration_status inventory
05:12 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_szpjd.dummy_t0twd to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_cqbfi`.`dummy_szpjd`.`dummy_t0twd` (`id`, `value`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('RemoveAfter'='2024110807', 'transient_lastDdlTime'='1731042581') AS SELECT * FROM `dummy_cqbfi`.`dummy_szpjd`.`dummy_tc1uy`
05:12 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating view hive_metastore.dummy_szpjd.view3 to using SQL query: CREATE VIEW IF NOT EXISTS `dummy_cqbfi`.`dummy_szpjd`.`view3` (`col1`, `col2`) WITH SCHEMA COMPENSATION TBLPROPERTIES ('transient_lastDdlTime'='1731042584') AS SELECT * FROM `dummy_cqbfi`.`dummy_szpjd`.`dummy_tc1uy`
05:12 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_szpjd.view3 to dummy_cqbfi.dummy_szpjd.view3: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_cqbfi.dummy_szpjd.dummy_tc1uy for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
05:12 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] Failed to migrate view hive_metastore.dummy_szpjd.dummy_t0twd to dummy_cqbfi.dummy_szpjd.dummy_t0twd: [UC_COMMAND_NOT_SUPPORTED.WITH_RECOMMENDATION] The command(s): 3-layer (catalogName.schemaName.tableName) table name notation: dummy_cqbfi.dummy_szpjd.dummy_tc1uy for view creation in HMS federation are not supported in Unity Catalog. Please use schemaName.tableName or tableName instead. SQLSTATE: 0AKUC
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] crawling new set of snapshot data for migration_status
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] fetching tables inventory
05:12 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Schema dummy_ckb3i.TEST_SCHEMA no longer exists. Skipping checking its migration status.
05:12 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Schema dummy_ckb3i.dummy_sfou9 no longer exists. Skipping checking its migration status.
05:12 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Schema dummy_ckb3i.information_schema no longer exists. Skipping checking its migration status.
05:12 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_akjzkmbnfawy4rgp no longer exists. Skipping checking its migration status.
05:12 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_ovgrwe9rwrumnvpl no longer exists. Skipping checking its migration status.
05:12 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_szpjd.dummy_tc1uy is set as migrated
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] found 4 new records for migration_status
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] fetching migration_status inventory
05:12 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_szpjd.dummy_trbms cannot be migrated because hive_metastore.dummy_szpjd.dummy_t0twd is not migrated yet
05:12 INFO [databricks.labs.ucx.hive_metastore.table_migrate] View hive_metastore.dummy_szpjd.dummy_trbms is not supported for migration
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] ignoring any existing migration_status inventory; refresh is forced.
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] crawling new set of snapshot data for migration_status
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.tables] fetching tables inventory
05:12 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_gl2pmxkmrawdjls3 no longer exists. Skipping checking its migration status.
05:12 INFO [databricks.labs.ucx.hive_metastore.table_migration_status] dummy_szpjd.dummy_tc1uy is set as migrated
05:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s5zki.migration_status] found 4 new records for migration_status
[gw2] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #260

@nfx nfx mentioned this issue Nov 8, 2024
Merged
@pritishpai
Copy link
Contributor

Tests are passing now. Will keep an eye on it and close it if it doesn't fail anymore.

@nfx
Copy link
Collaborator

nfx commented Nov 11, 2024

most likely this was related to the same underlying platform issue as in b01131d

@nfx nfx closed this as completed Nov 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@pritishpai pritishpai

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@nfx @pritishpai