Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

whitelist plotly #1984

Merged
merged 1 commit into from
Jul 2, 2024
Merged

whitelist plotly #1984

merged 1 commit into from
Jul 2, 2024

Conversation

ericvergnaud
Copy link
Contributor

Changes

whitelist plotly

Linked issues

Progresses #1901

Functionality

None

Tests

  • manually tested

@ericvergnaud ericvergnaud requested review from a team and prajin-29 July 2, 2024 15:24
@github-actions GitHub Actions
Copy link

github-actions bot commented Jul 2, 2024

❌ 77/79 passed, 2 failed, 19 skipped, 5h34m47s total

❌ test_create_catalog_schema_with_principal_acl_CLOUD_ENV: databricks.sdk.errors.platform.BadRequest: [RequestId=fbe60483-e851-4c0a-aee0-6303bb413eb5 ErrorClass=PRINCIPAL_DOES_NOT_EXIST] Could not find principal with name ucx_GCtj5 (18m49.009s) 
databricks.sdk.errors.platform.BadRequest: [RequestId=fbe60483-e851-4c0a-aee0-6303bb413eb5 ErrorClass=PRINCIPAL_DOES_NOT_EXIST] Could not find principal with name ucx_GCtj5
15:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/Ytyc
15:31 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_szpbf: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szpbf
15:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szpbf', metastore_id=None, name='ucx_szpbf', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:31 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_szpbf.ucx_th6ve: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szpbf/ucx_th6ve
15:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_szpbf.ucx_th6ve', metastore_id=None, name='ucx_th6ve', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='ucx_szpbf', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/Ytyc', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1719934317491, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cg4wz', isolation_mode=<CatalogIsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cg4wz', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719934317491, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
15:32 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cg4wz.ucx_szpbf: https://DATABRICKS_HOST/explore/data/ucx_cg4wz/ucx_szpbf
15:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cg4wz', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cg4wz.ucx_szpbf', metastore_id=None, name='ucx_szpbf', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw8] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
15:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/Ytyc
15:31 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_szpbf: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szpbf
15:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szpbf', metastore_id=None, name='ucx_szpbf', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:31 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_szpbf.ucx_th6ve: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szpbf/ucx_th6ve
15:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_szpbf.ucx_th6ve', metastore_id=None, name='ucx_th6ve', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='ucx_szpbf', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/Ytyc', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1719934317491, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cg4wz', isolation_mode=<CatalogIsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cg4wz', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719934317491, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
15:32 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cg4wz.ucx_szpbf: https://DATABRICKS_HOST/explore/data/ucx_cg4wz/ucx_szpbf
15:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cg4wz', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cg4wz.ucx_szpbf', metastore_id=None, name='ucx_szpbf', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: <databricks.sdk.service._internal.Wait object at 0x7fa1f78094e0>
15:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8363400977611263', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
15:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-153248-85np1dar [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
15:33 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s9pfk: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s9pfk
15:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s9pfk', metastore_id=None, name='ucx_s9pfk', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas
15:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: <databricks.sdk.service._internal.Wait object at 0x7fa1f7727340>
15:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='5562482972591826', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
15:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-153347-xkvx5ygi [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
15:34 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas
15:34 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Preparing a list of UC catalogs and schema to be created
15:34 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s9pfk.tables] fetching tables inventory
15:34 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s9pfk.tables] crawling new batch for tables
15:34 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szpbf] listing tables
15:35 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szpbf.ucx_th6ve] fetching table metadata
15:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s9pfk.tables] found 1 new records for tables
15:37 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `ucx_GCtj5`
15:38 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
15:38 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `[email protected]`
15:39 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `[email protected]`
15:39 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `[email protected]`
15:40 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `[email protected]`
15:40 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `ucx_GcM0H`
15:40 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `[email protected]`
15:41 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `[email protected]`
15:41 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `ucx_Gs40O`
15:41 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `ucx_GLpCH`
15:42 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed`
15:42 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `[email protected]`
15:43 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cg4wz') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cg4wz TO `[email protected]`
15:43 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cg4wz') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cg4wz TO `[email protected]`
15:43 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cg4wz') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cg4wz TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
15:44 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cg4wz') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cg4wz TO `ucx_GcM0H`
15:44 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cg4wz') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cg4wz TO `ucx_GLpCH`
15:45 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cg4wz') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cg4wz TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed`
15:45 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cg4wz') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cg4wz TO `[email protected]`
15:46 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cg4wz') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cg4wz TO `ucx_Gs40O`
15:47 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cg4wz') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cg4wz TO `ucx_GCtj5`
15:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/Ytyc
15:31 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_szpbf: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szpbf
15:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szpbf', metastore_id=None, name='ucx_szpbf', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:31 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_szpbf.ucx_th6ve: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szpbf/ucx_th6ve
15:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_szpbf.ucx_th6ve', metastore_id=None, name='ucx_th6ve', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='ucx_szpbf', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/Ytyc', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1719934317491, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cg4wz', isolation_mode=<CatalogIsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cg4wz', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719934317491, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
15:32 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cg4wz.ucx_szpbf: https://DATABRICKS_HOST/explore/data/ucx_cg4wz/ucx_szpbf
15:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cg4wz', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cg4wz.ucx_szpbf', metastore_id=None, name='ucx_szpbf', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: <databricks.sdk.service._internal.Wait object at 0x7fa1f78094e0>
15:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8363400977611263', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
15:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-153248-85np1dar [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
15:33 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s9pfk: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s9pfk
15:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s9pfk', metastore_id=None, name='ucx_s9pfk', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
15:33 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas
15:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: <databricks.sdk.service._internal.Wait object at 0x7fa1f7727340>
15:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='5562482972591826', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
15:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-153347-xkvx5ygi [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
15:34 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas
15:34 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Preparing a list of UC catalogs and schema to be created
15:34 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s9pfk.tables] fetching tables inventory
15:34 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s9pfk.tables] crawling new batch for tables
15:34 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szpbf] listing tables
15:35 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szpbf.ucx_th6ve] fetching table metadata
15:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s9pfk.tables] found 1 new records for tables
15:37 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `ucx_GCtj5`
15:38 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
15:38 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `[email protected]`
15:39 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `[email protected]`
15:39 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `[email protected]`
15:40 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `[email protected]`
15:40 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `ucx_GcM0H`
15:40 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `[email protected]`
15:41 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `[email protected]`
15:41 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `ucx_Gs40O`
15:41 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `ucx_GLpCH`
15:42 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed`
15:42 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cg4wz.ucx_szpbf') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cg4wz.ucx_szpbf TO `[email protected]`
15:43 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cg4wz') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cg4wz TO `[email protected]`
15:43 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cg4wz') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cg4wz TO `[email protected]`
15:43 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cg4wz') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cg4wz TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d`
15:44 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cg4wz') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cg4wz TO `ucx_GcM0H`
15:44 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cg4wz') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cg4wz TO `ucx_GLpCH`
15:45 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cg4wz') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cg4wz TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed`
15:45 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cg4wz') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cg4wz TO `[email protected]`
15:46 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cg4wz') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cg4wz TO `ucx_Gs40O`
15:47 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cg4wz') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cg4wz TO `ucx_GCtj5`
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 cluster permissions fixtures
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0702-153248-85np1dar [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0702-153347-xkvx5ygi [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1719934317491, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cg4wz', isolation_mode=<CatalogIsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cg4wz', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719934317491, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/Ytyc
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 cluster fixtures
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: <databricks.sdk.service._internal.Wait object at 0x7fa1f78094e0>
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: <databricks.sdk.service._internal.Wait object at 0x7fa1f7727340>
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_szpbf.ucx_th6ve', metastore_id=None, name='ucx_th6ve', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='ucx_szpbf', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/Ytyc', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:48 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures
15:48 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szpbf', metastore_id=None, name='ucx_szpbf', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:48 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cg4wz', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cg4wz.ucx_szpbf', metastore_id=None, name='ucx_szpbf', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:48 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s9pfk', metastore_id=None, name='ucx_s9pfk', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 workspace user fixtures
15:49 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8363400977611263', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
15:49 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='5562482972591826', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
[gw8] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_table_migration_job_refreshes_migration_status[hiveserde-migrate-external-tables-ctas]: TimeoutError: Timed out after 0:05:00 (18m17.905s) 
TimeoutError: Timed out after 0:05:00
15:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/avnT
15:40 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_htumr: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_htumr
15:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_htumr', metastore_id=None, name='hiveserde_in_place_htumr', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_htumr
15:41 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_htumr.parquet_serde_htumr: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_htumr/parquet_serde_htumr
15:41 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_htumr.parquet_serde_htumr', metastore_id=None, name='parquet_serde_htumr', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_htumr', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_htumr/parquet_serde_htumr', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:41 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_htumr.orc_serde_htumr: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_htumr/orc_serde_htumr
15:41 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_htumr.orc_serde_htumr', metastore_id=None, name='orc_serde_htumr', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_htumr', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_htumr/orc_serde_htumr', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:41 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_htumr.avro_serde_htumr: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_htumr/avro_serde_htumr
15:41 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_htumr.avro_serde_htumr', metastore_id=None, name='avro_serde_htumr', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_htumr', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_htumr/avro_serde_htumr', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:41 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1719934917786, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_co76z', isolation_mode=<CatalogIsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_co76z', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719934917786, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
15:42 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_co76z.hiveserde_in_place_htumr: https://DATABRICKS_HOST/explore/data/ucx_co76z/hiveserde_in_place_htumr
15:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_co76z', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_co76z.hiveserde_in_place_htumr', metastore_id=None, name='hiveserde_in_place_htumr', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:42 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sxeif: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sxeif
15:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sxeif', metastore_id=None, name='ucx_sxeif', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
15:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/avnT
15:40 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_htumr: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_htumr
15:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_htumr', metastore_id=None, name='hiveserde_in_place_htumr', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_htumr
15:41 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_htumr.parquet_serde_htumr: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_htumr/parquet_serde_htumr
15:41 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_htumr.parquet_serde_htumr', metastore_id=None, name='parquet_serde_htumr', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_htumr', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_htumr/parquet_serde_htumr', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:41 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_htumr.orc_serde_htumr: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_htumr/orc_serde_htumr
15:41 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_htumr.orc_serde_htumr', metastore_id=None, name='orc_serde_htumr', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_htumr', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_htumr/orc_serde_htumr', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:41 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_htumr.avro_serde_htumr: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_htumr/avro_serde_htumr
15:41 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_htumr.avro_serde_htumr', metastore_id=None, name='avro_serde_htumr', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_htumr', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_htumr/avro_serde_htumr', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:41 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1719934917786, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_co76z', isolation_mode=<CatalogIsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_co76z', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719934917786, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
15:42 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_co76z.hiveserde_in_place_htumr: https://DATABRICKS_HOST/explore/data/ucx_co76z/hiveserde_in_place_htumr
15:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_co76z', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_co76z.hiveserde_in_place_htumr', metastore_id=None, name='hiveserde_in_place_htumr', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:42 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sxeif: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sxeif
15:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sxeif', metastore_id=None, name='ucx_sxeif', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:46 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zjJh/config.yml) doesn't exist.
15:46 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
15:46 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
15:46 INFO [databricks.labs.ucx.install] Fetching installations...
15:46 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zjJh is corrupted. Skipping...
15:46 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
15:46 DEBUG [tests.integration.conftest] Waiting for clusters to start...
15:46 DEBUG [tests.integration.conftest] Waiting for clusters to start...
15:46 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+2820240702154649
15:46 INFO [databricks.labs.ucx.install] Creating ucx schemas...
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
15:50 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zjJh/README for the next steps.
15:50 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-tables-ctas job: https://DATABRICKS_HOST#job/581938428621756
15:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/avnT
15:40 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_htumr: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_htumr
15:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_htumr', metastore_id=None, name='hiveserde_in_place_htumr', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_htumr
15:41 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_htumr.parquet_serde_htumr: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_htumr/parquet_serde_htumr
15:41 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_htumr.parquet_serde_htumr', metastore_id=None, name='parquet_serde_htumr', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_htumr', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_htumr/parquet_serde_htumr', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:41 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_htumr.orc_serde_htumr: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_htumr/orc_serde_htumr
15:41 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_htumr.orc_serde_htumr', metastore_id=None, name='orc_serde_htumr', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_htumr', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_htumr/orc_serde_htumr', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:41 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_htumr.avro_serde_htumr: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_htumr/avro_serde_htumr
15:41 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_htumr.avro_serde_htumr', metastore_id=None, name='avro_serde_htumr', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_htumr', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_htumr/avro_serde_htumr', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:41 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1719934917786, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_co76z', isolation_mode=<CatalogIsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_co76z', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719934917786, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
15:42 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_co76z.hiveserde_in_place_htumr: https://DATABRICKS_HOST/explore/data/ucx_co76z/hiveserde_in_place_htumr
15:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_co76z', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_co76z.hiveserde_in_place_htumr', metastore_id=None, name='hiveserde_in_place_htumr', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:42 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sxeif: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sxeif
15:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sxeif', metastore_id=None, name='ucx_sxeif', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:46 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zjJh/config.yml) doesn't exist.
15:46 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
15:46 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
15:46 INFO [databricks.labs.ucx.install] Fetching installations...
15:46 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zjJh is corrupted. Skipping...
15:46 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
15:46 DEBUG [tests.integration.conftest] Waiting for clusters to start...
15:46 DEBUG [tests.integration.conftest] Waiting for clusters to start...
15:46 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+2820240702154649
15:46 INFO [databricks.labs.ucx.install] Creating ucx schemas...
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter
15:50 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
15:50 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zjJh/README for the next steps.
15:50 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-tables-ctas job: https://DATABRICKS_HOST#job/581938428621756
15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_storage_dir fixtures
15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_htumr
15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures
15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/avnT
15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures
15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures
15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1719934917786, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_co76z', isolation_mode=<CatalogIsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_co76z', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719934917786, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
15:55 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+2820240702154649 from https://DATABRICKS_HOST
15:55 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sxeif
15:55 INFO [databricks.labs.ucx.install] Deleting jobs
15:55 INFO [databricks.labs.ucx.install] Deleting assessment job_id=479065173056770.
15:55 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=581938428621756.
15:55 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=225686107386774.
15:55 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=781737073542604.
15:55 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=138580058529625.
15:55 INFO [databricks.labs.ucx.install] Deleting failing job_id=903196820952577.
15:55 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=286436101297584.
15:55 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=657463194248350.
15:55 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=860265734214234.
15:55 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=625323673343375.
15:55 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=920197466290146.
15:55 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=364358251342696.
15:55 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=1009490032803620.
15:55 INFO [databricks.labs.ucx.install] Deleting cluster policy
15:55 INFO [databricks.labs.ucx.install] Deleting secret scope
15:55 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures
15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures
15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures
15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 table fixtures
15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_htumr.parquet_serde_htumr', metastore_id=None, name='parquet_serde_htumr', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_htumr', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_htumr/parquet_serde_htumr', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:56 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_htumr.orc_serde_htumr', metastore_id=None, name='orc_serde_htumr', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_htumr', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_htumr/orc_serde_htumr', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:56 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_htumr.avro_serde_htumr', metastore_id=None, name='avro_serde_htumr', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_htumr', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_htumr/avro_serde_htumr', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:57 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures
15:57 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_htumr', metastore_id=None, name='hiveserde_in_place_htumr', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:57 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_co76z', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_co76z.hiveserde_in_place_htumr', metastore_id=None, name='hiveserde_in_place_htumr', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:58 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sxeif', metastore_id=None, name='ucx_sxeif', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python

Running from acceptance #4139

nfx
nfx approved these changes Jul 2, 2024
View reviewed changes
Copy link
Collaborator

@nfx nfx left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@nfx nfx added the internal this pull request won't appear in release notes label Jul 2, 2024
@nfx nfx merged commit 9923849 into main Jul 2, 2024
3 of 4 checks passed
@nfx nfx deleted the whitelist-plotly branch July 2, 2024 16:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@nfx nfx nfx approved these changes

@prajin-29 prajin-29 Awaiting requested review from prajin-29

Assignees
No one assigned
Labels
internal this pull request won't appear in release notes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@ericvergnaud @nfx