Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test failure: test_running_real_migrate_groups_job #3548

Open
github-actions bot opened this issue Jan 19, 2025 · 0 comments
Open

Test failure: test_running_real_migrate_groups_job #3548

github-actions bot opened this issue Jan 19, 2025 · 0 comments
Labels
bug Something isn't working

Comments

@github-actions
Copy link

❌ test_running_real_migrate_groups_job: databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task apply_permissions failed with message: Workload failed, see run output for details. (3m52.475s) 
databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task apply_permissions failed with message: Workload failed, see run output for details.
05:38 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:38 INFO [databricks.sdk] Using Databricks Metadata Service authentication
[gw1] linux -- Python 3.10.16 /home/runner/work/ucx/ucx/.venv/bin/python
05:38 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:38 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:38 INFO [databricks.labs.pytester.fixtures.baseline] Created [email protected]: https://DATABRICKS_HOST/#settings/workspace/identity-and-access/users/798583160390333
05:38 INFO [databricks.labs.pytester.fixtures.iam] Workspace group ucx-E7Bi-ra78b33ac3: https://DATABRICKS_HOST#setting/accounts/groups/533560367274046
05:38 INFO [databricks.labs.pytester.fixtures.iam] Account group ucx-E7Bi-ra78b33ac3: https://accounts.CLOUD_ENVdatabricks.net/users/groups/287405923914514/members
05:38 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-usHO-ra78b33ac3: https://DATABRICKS_HOST/setting/clusters/cluster-policies/view/0016819A90FCA05B
05:38 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_sdeey schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_sdeey
05:38 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_sdeey.dummy_tshi4 schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_sdeey/dummy_tshi4
05:38 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_s9ucr schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_s9ucr
05:38 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.9cWB/config.yml) doesn't exist.
05:38 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mChoose how to map the workspace groups:�[0m
�[1m[0]�[0m �[36mMatch by Name�[0m
�[1m[1]�[0m �[36mApply a Prefix�[0m
�[1m[2]�[0m �[36mApply a Suffix�[0m
�[1m[3]�[0m �[36mMatch by External ID�[0m
�[1m[4]�[0m �[36mRegex Substitution�[0m
�[1m[5]�[0m �[36mRegex Matching�[0m
Enter a number between 0 and 5
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to skip TACL migration when migrating tables?
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to define a TEST_SCHEMA owner group for all tables and schemas? 
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 4095808988021766 block Internet access?
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation?
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage
05:38 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one?
05:38 INFO [databricks.labs.ucx.install] Fetching installations...
05:38 INFO [databricks.labs.blueprint.parallel] finding 9cWB installations 100/102, rps: 236.721/sec
05:38 INFO [databricks.labs.blueprint.parallel] finding 9cWB installations 102/102, rps: 237.587/sec
05:38 INFO [databricks.labs.blueprint.parallel] Finished 'finding 9cWB installations' tasks: 0% results available (0/102). Took 0:00:00.429861
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mSelect PRO or SERVERLESS SQL warehouse to run assessment dashboards on�[0m
�[1m[0]�[0m �[36m[Create new PRO SQL warehouse]�[0m
�[1m[1]�[0m �[36mDEFAULT Test Warehouse (DATABRICKS_WAREHOUSE_ID, SERVERLESS, RUNNING)�[0m
Enter a number between 0 and 1
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore?
05:38 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mIf hive_metastore contains managed table with external location paths (not dbfs root), please select which migration option to choose from�[0m
�[1m[0]�[0m �[36mConvert MANAGED HMS table to EXTERNAL HMS table and migrate as EXTERNAL UC table. Once the relevant HMS tables are deleted, the underlying data won't get deleted anymore, consider the impact of this change on your data workloads�[0m
�[1m[1]�[0m �[36mCopy data from MANAGED HMS to MANAGED UC table�[0m
�[1m[2]�[0m �[36mMigrate MANAGED HMS table as EXTERNAL UC table. This option would require you to convert MANAGED HMS tables to EXTERNAL HMS tables once UC migration is complete, otherwise deleting HMS MANAGED table would delete the migrated UC table�[0m
Enter a number between 0 and 2
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.9cWB/config.yml
05:38 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:38 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 55.339/sec
05:38 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.054481
05:38 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:38 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_vVJFc9e2CFjRR4QY catalog: https://DATABRICKS_HOST/#explore/data/ucx_vVJFc9e2CFjRR4QY
05:38 INFO [databricks.labs.ucx.install] Installing UCX v0.53.2+2420250119053823
05:38 INFO [databricks.labs.ucx.install] Creating ucx schemas...
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr database exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.CLOUD_ENV_service_principals table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.clusters table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.global_init_scripts table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.jobs table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.pipelines table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.external_locations table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.mounts table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.grants table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.groups table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.tables table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.table_size table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.table_failures table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.workspace_objects table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.permissions table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.submit_runs table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.policies table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.migration_status table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.workflow_problems table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.query_problems table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.udfs table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.logs table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.recon_results table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.directfs_in_paths table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.directfs_in_queries table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.used_tables_in_paths table exists
05:38 INFO [databricks.labs.blueprint.parallel] deploy tables 10/29, rps: 7.258/sec
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.used_tables_in_queries table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.inferred_grants table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.redash_dashboards table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.lakeview_dashboards table exists
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
05:38 INFO [databricks.labs.blueprint.parallel] deploy tables 20/29, rps: 8.030/sec
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
05:38 INFO [databricks.labs.blueprint.parallel] deploy tables 29/29, rps: 10.961/sec
05:38 INFO [databricks.labs.blueprint.parallel] Finished 'deploy tables' tasks: 0% results available (0/29). Took 0:00:02.646083
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.grant_detail view matches queries/views/grant_detail.sql contents
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.objects view matches queries/views/objects.sql contents
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.table_estimates view matches queries/views/table_estimates.sql contents
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.misc_patterns view matches queries/views/misc_patterns.sql contents
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.code_patterns view matches queries/views/code_patterns.sql contents
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.reconciliation_results view matches queries/views/reconciliation_results.sql contents
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.directfs view matches queries/views/directfs.sql contents
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.used_tables view matches queries/views/used_tables.sql contents
05:38 INFO [databricks.labs.ucx.install] Creating dashboards...
05:38 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
05:38 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
05:38 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
05:38 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
05:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
05:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
05:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
05:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
05:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
05:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
05:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
05:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:38 INFO [databricks.labs.blueprint.parallel] installing dashboards 7/7, rps: 2.925/sec
05:38 INFO [databricks.labs.blueprint.parallel] Finished 'installing dashboards' tasks: 0% results available (0/7). Took 0:00:02.393584
05:38 INFO [databricks.labs.blueprint.parallel] installing components 2/2, rps: 0.085/sec
05:38 INFO [databricks.labs.blueprint.parallel] Finished 'installing components' tasks: 0% results available (0/2). Took 0:00:23.611044
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Open job overview in your browser? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.9cWB/README
05:38 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.9cWB/README for the next steps.
05:38 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s9ucr.tables] ignoring any existing tables inventory; refresh is forced.
05:38 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s9ucr.tables] crawling new set of snapshot data for tables
05:38 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_sdeey] listing tables and views
05:38 INFO [databricks.labs.blueprint.parallel] listing tables 1/1, rps: 2.216/sec
05:38 INFO [databricks.labs.blueprint.parallel] Finished 'listing tables' tasks: 100% results available (1/1). Took 0:00:00.451498
05:38 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_sdeey.dummy_tshi4] fetching table metadata
05:38 INFO [databricks.labs.blueprint.parallel] describing tables in hive_metastore 1/1, rps: 2.181/sec
05:38 INFO [databricks.labs.blueprint.parallel] Finished 'describing tables in hive_metastore' tasks: 100% results available (1/1). Took 0:00:00.458771
05:38 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s9ucr.tables] found 1 new records for tables
05:38 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-groups job: https://DATABRICKS_HOST#job/763874117007960
05:38 INFO [databricks.labs.ucx.installer.workflows] Started migrate-groups job: https://DATABRICKS_HOST#job/763874117007960/runs/15788115617532
05:38 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-groups workflow: https://DATABRICKS_HOST#job/763874117007960
05:38 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
05:38 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:38 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:38 INFO [databricks.labs.pytester.fixtures.baseline] Created [email protected]: https://DATABRICKS_HOST/#settings/workspace/identity-and-access/users/798583160390333
05:38 INFO [databricks.labs.pytester.fixtures.iam] Workspace group ucx-E7Bi-ra78b33ac3: https://DATABRICKS_HOST#setting/accounts/groups/533560367274046
05:38 INFO [databricks.labs.pytester.fixtures.iam] Account group ucx-E7Bi-ra78b33ac3: https://accounts.CLOUD_ENVdatabricks.net/users/groups/287405923914514/members
05:38 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-usHO-ra78b33ac3: https://DATABRICKS_HOST/setting/clusters/cluster-policies/view/0016819A90FCA05B
05:38 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_sdeey schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_sdeey
05:38 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_sdeey.dummy_tshi4 schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_sdeey/dummy_tshi4
05:38 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_s9ucr schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_s9ucr
05:38 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.9cWB/config.yml) doesn't exist.
05:38 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mChoose how to map the workspace groups:�[0m
�[1m[0]�[0m �[36mMatch by Name�[0m
�[1m[1]�[0m �[36mApply a Prefix�[0m
�[1m[2]�[0m �[36mApply a Suffix�[0m
�[1m[3]�[0m �[36mMatch by External ID�[0m
�[1m[4]�[0m �[36mRegex Substitution�[0m
�[1m[5]�[0m �[36mRegex Matching�[0m
Enter a number between 0 and 5
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to skip TACL migration when migrating tables?
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to define a TEST_SCHEMA owner group for all tables and schemas? 
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 4095808988021766 block Internet access?
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation?
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage
05:38 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one?
05:38 INFO [databricks.labs.ucx.install] Fetching installations...
05:38 INFO [databricks.labs.blueprint.parallel] finding 9cWB installations 100/102, rps: 236.721/sec
05:38 INFO [databricks.labs.blueprint.parallel] finding 9cWB installations 102/102, rps: 237.587/sec
05:38 INFO [databricks.labs.blueprint.parallel] Finished 'finding 9cWB installations' tasks: 0% results available (0/102). Took 0:00:00.429861
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mSelect PRO or SERVERLESS SQL warehouse to run assessment dashboards on�[0m
�[1m[0]�[0m �[36m[Create new PRO SQL warehouse]�[0m
�[1m[1]�[0m �[36mDEFAULT Test Warehouse (DATABRICKS_WAREHOUSE_ID, SERVERLESS, RUNNING)�[0m
Enter a number between 0 and 1
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore?
05:38 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mIf hive_metastore contains managed table with external location paths (not dbfs root), please select which migration option to choose from�[0m
�[1m[0]�[0m �[36mConvert MANAGED HMS table to EXTERNAL HMS table and migrate as EXTERNAL UC table. Once the relevant HMS tables are deleted, the underlying data won't get deleted anymore, consider the impact of this change on your data workloads�[0m
�[1m[1]�[0m �[36mCopy data from MANAGED HMS to MANAGED UC table�[0m
�[1m[2]�[0m �[36mMigrate MANAGED HMS table as EXTERNAL UC table. This option would require you to convert MANAGED HMS tables to EXTERNAL HMS tables once UC migration is complete, otherwise deleting HMS MANAGED table would delete the migrated UC table�[0m
Enter a number between 0 and 2
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.9cWB/config.yml
05:38 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:38 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 55.339/sec
05:38 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.054481
05:38 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:38 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_vVJFc9e2CFjRR4QY catalog: https://DATABRICKS_HOST/#explore/data/ucx_vVJFc9e2CFjRR4QY
05:38 INFO [databricks.labs.ucx.install] Installing UCX v0.53.2+2420250119053823
05:38 INFO [databricks.labs.ucx.install] Creating ucx schemas...
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr database exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.CLOUD_ENV_service_principals table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.clusters table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.global_init_scripts table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.jobs table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.pipelines table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.external_locations table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.mounts table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.grants table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.groups table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.tables table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.table_size table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.table_failures table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.workspace_objects table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.permissions table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.submit_runs table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.policies table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.migration_status table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.workflow_problems table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.query_problems table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.udfs table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.logs table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.recon_results table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.directfs_in_paths table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.directfs_in_queries table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.used_tables_in_paths table exists
05:38 INFO [databricks.labs.blueprint.parallel] deploy tables 10/29, rps: 7.258/sec
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.used_tables_in_queries table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.inferred_grants table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.redash_dashboards table exists
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.lakeview_dashboards table exists
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
05:38 INFO [databricks.labs.blueprint.parallel] deploy tables 20/29, rps: 8.030/sec
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
05:38 INFO [databricks.labs.blueprint.parallel] deploy tables 29/29, rps: 10.961/sec
05:38 INFO [databricks.labs.blueprint.parallel] Finished 'deploy tables' tasks: 0% results available (0/29). Took 0:00:02.646083
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.grant_detail view matches queries/views/grant_detail.sql contents
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.objects view matches queries/views/objects.sql contents
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
05:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.table_estimates view matches queries/views/table_estimates.sql contents
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.misc_patterns view matches queries/views/misc_patterns.sql contents
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.code_patterns view matches queries/views/code_patterns.sql contents
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.reconciliation_results view matches queries/views/reconciliation_results.sql contents
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.directfs view matches queries/views/directfs.sql contents
05:38 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_s9ucr.used_tables view matches queries/views/used_tables.sql contents
05:38 INFO [databricks.labs.ucx.install] Creating dashboards...
05:38 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
05:38 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
05:38 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
05:38 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
05:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
05:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
05:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
05:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
05:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
05:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
05:38 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
05:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:38 INFO [databricks.labs.blueprint.parallel] installing dashboards 7/7, rps: 2.925/sec
05:38 INFO [databricks.labs.blueprint.parallel] Finished 'installing dashboards' tasks: 0% results available (0/7). Took 0:00:02.393584
05:38 INFO [databricks.labs.blueprint.parallel] installing components 2/2, rps: 0.085/sec
05:38 INFO [databricks.labs.blueprint.parallel] Finished 'installing components' tasks: 0% results available (0/2). Took 0:00:23.611044
05:38 INFO [databricks.labs.blueprint.tui] Asking prompt: Open job overview in your browser? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.9cWB/README
05:38 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.9cWB/README for the next steps.
05:38 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s9ucr.tables] ignoring any existing tables inventory; refresh is forced.
05:38 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s9ucr.tables] crawling new set of snapshot data for tables
05:38 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_sdeey] listing tables and views
05:38 INFO [databricks.labs.blueprint.parallel] listing tables 1/1, rps: 2.216/sec
05:38 INFO [databricks.labs.blueprint.parallel] Finished 'listing tables' tasks: 100% results available (1/1). Took 0:00:00.451498
05:38 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_sdeey.dummy_tshi4] fetching table metadata
05:38 INFO [databricks.labs.blueprint.parallel] describing tables in hive_metastore 1/1, rps: 2.181/sec
05:38 INFO [databricks.labs.blueprint.parallel] Finished 'describing tables in hive_metastore' tasks: 100% results available (1/1). Took 0:00:00.458771
05:38 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s9ucr.tables] found 1 new records for tables
05:38 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-groups job: https://DATABRICKS_HOST#job/763874117007960
05:38 INFO [databricks.labs.ucx.installer.workflows] Started migrate-groups job: https://DATABRICKS_HOST#job/763874117007960/runs/15788115617532
05:38 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-groups workflow: https://DATABRICKS_HOST#job/763874117007960
05:38 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
05:41 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to uninstall ucx from the workspace too, this would remove ucx project folder, dashboards, queries and jobs
05:41 INFO [databricks.labs.ucx.install] Deleting UCX v0.53.2+2420250119053823 from https://DATABRICKS_HOST
05:41 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to delete the inventory database dummy_s9ucr too?
05:41 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_s9ucr
05:41 INFO [databricks.labs.lsql.deployment] Deleting hive_metastore.dummy_s9ucr database
05:41 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=421573236023208, as it is no longer needed
05:41 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=891612853366557, as it is no longer needed
05:41 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=568795794081628, as it is no longer needed
05:41 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=826133199277115, as it is no longer needed
05:41 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=91433322596567, as it is no longer needed
05:41 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=65818215473219, as it is no longer needed
05:41 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=763874117007960, as it is no longer needed
05:41 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=946561050812926, as it is no longer needed
05:41 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1011091545361566, as it is no longer needed
05:41 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=854282461713207, as it is no longer needed
05:41 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=241136496877377, as it is no longer needed
05:41 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=898390482337685, as it is no longer needed
05:41 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1093355081421399, as it is no longer needed
05:41 INFO [databricks.labs.ucx.install] Deleting cluster policy
05:41 INFO [databricks.labs.ucx.install] Deleting secret scope
05:41 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw1] linux -- Python 3.10.16 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #361
@github-actions github-actions bot added the bug Something isn't working label Jan 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
0 participants