Test failure: test_table_migration_job_refreshes_migration_status[regular-migrate-tables]

[github-actions]

❌ test_table_migration_job_refreshes_migration_status[regular-migrate-tables]: AssertionError: Workflow failed: assessment (5m33.526s)

AssertionError: Workflow failed: assessment
assert False
[gw5] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
05:14 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Nl1y/config.yml) doesn't exist.
05:14 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:14 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:14 INFO [databricks.labs.ucx.install] Fetching installations...
05:14 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Nl1y is corrupted. Skipping...
05:14 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:14 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:16 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:16 INFO [databricks.labs.ucx.install] Installing UCX v0.53.2+220250107051634
05:16 INFO [databricks.labs.ucx.install] Creating ucx schemas...
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
05:16 INFO [databricks.labs.ucx.install] Creating dashboards...
05:16 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
05:16 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
05:16 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
05:16 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
05:16 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
05:16 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
05:16 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
05:16 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
05:16 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
05:16 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
05:16 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
05:16 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:16 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:16 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:16 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:16 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:16 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:16 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:16 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Nl1y/README for the next steps.
05:16 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
05:16 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/568737401980049
05:16 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/568737401980049/runs/478085977366542
05:16 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/568737401980049
05:16 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
05:14 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Nl1y/config.yml) doesn't exist.
05:14 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:14 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:14 INFO [databricks.labs.ucx.install] Fetching installations...
05:14 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Nl1y is corrupted. Skipping...
05:14 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:14 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:16 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:16 INFO [databricks.labs.ucx.install] Installing UCX v0.53.2+220250107051634
05:16 INFO [databricks.labs.ucx.install] Creating ucx schemas...
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
05:16 INFO [databricks.labs.ucx.install] Creating dashboards...
05:16 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
05:16 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
05:16 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
05:16 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
05:16 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
05:16 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
05:16 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
05:16 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
05:16 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
05:16 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
05:16 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
05:16 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:16 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:16 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:16 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:16 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:16 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:16 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:16 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Nl1y/README for the next steps.
05:16 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
05:16 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/568737401980049
05:16 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/568737401980049/runs/478085977366542
05:16 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/568737401980049
05:16 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
05:19 INFO [databricks.labs.ucx.install] Deleting UCX v0.53.2+220250107051634 from https://DATABRICKS_HOST
05:19 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_shrmh
05:19 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=568737401980049, as it is no longer needed
05:19 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=130770415134720, as it is no longer needed
05:19 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=622630152060956, as it is no longer needed
05:19 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=714809474681092, as it is no longer needed
05:19 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=717794279864465, as it is no longer needed
05:19 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=533134073919832, as it is no longer needed
05:19 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1016006147247521, as it is no longer needed
05:19 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=742967897335688, as it is no longer needed
05:19 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=485073814694478, as it is no longer needed
05:19 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=264920169474517, as it is no longer needed
05:19 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=684556170026014, as it is no longer needed
05:19 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=320809564071712, as it is no longer needed
05:19 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=266092224984746, as it is no longer needed
05:19 INFO [databricks.labs.ucx.install] Deleting cluster policy
05:19 INFO [databricks.labs.ucx.install] Deleting secret scope
05:19 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw5] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #341}

[JCZuurmond]

Less likely to happen again due to: #3489