Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates to AzureACL class to load file directly using Installation class instead of AzureResourcePermission #1281

Closed
wants to merge 2 commits into from

Conversation

HariGS-DB
Copy link
Contributor

Changes

This PR is an update to the PR #1077
AzureResourcePermission is used to load the azure_storage_permission_info file. Instead this PR is using the Installation class directly which makes it simpler and avoids using AzureStoragePermission class

Linked issues

Related to #907

Functionality

  • added relevant user documentation
  • added new CLI command
  • modified existing command: databricks labs ucx ...
  • added a new workflow
  • modified existing workflow: ...
  • added a new table
  • modified existing table: ...

Tests

  • manually tested
  • added unit tests
  • added integration tests
  • verified on staging environment (screenshot attached)

@HariGS-DB HariGS-DB marked this pull request as ready for review April 5, 2024 14:16
@HariGS-DB HariGS-DB requested review from a team and andrascsillag-db April 5, 2024 14:16
Copy link

github-actions bot commented Apr 5, 2024

❌ 122/138 passed, 16 failed, 20 skipped, 1h18m14s total

❌ test_catalog_fixture: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'. (1.286s)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'.
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
04:29 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_move_tables_no_from_schema: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'. (402ms)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'.
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
04:29 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_move_tables: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'. (4.4s)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'.
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
04:29 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-qhdl: https://accounts.CLOUD_ENVdatabricks.net/users/groups/453450102949603/members
04:29 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-qhdl', entitlements=[], external_id=None, groups=[], id='453450102949603', members=[], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:29 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-YENz: https://accounts.CLOUD_ENVdatabricks.net/users/groups/1066416453857617/members
04:29 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-YENz', entitlements=[], external_id=None, groups=[], id='1066416453857617', members=[], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:29 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-qhdl: https://accounts.CLOUD_ENVdatabricks.net/users/groups/453450102949603/members
04:29 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-qhdl', entitlements=[], external_id=None, groups=[], id='453450102949603', members=[], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:29 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-YENz: https://accounts.CLOUD_ENVdatabricks.net/users/groups/1066416453857617/members
04:29 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-YENz', entitlements=[], external_id=None, groups=[], id='1066416453857617', members=[], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 account group fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='sdk-qhdl', entitlements=[], external_id=None, groups=[], id='453450102949603', members=[], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='sdk-YENz', entitlements=[], external_id=None, groups=[], id='1066416453857617', members=[], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 schema fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_move_tables_no_to_schema: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'. (929ms)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'.
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 schema fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_migrate_managed_tables_with_acl: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'. (8.415s)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'.
04:29 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_smlbd: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_smlbd
04:29 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smlbd', metastore_id=None, name='ucx_smlbd', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
04:29 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_smlbd: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_smlbd
04:29 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smlbd', metastore_id=None, name='ucx_smlbd', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:29 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_snfxd: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_snfxd
04:29 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_snfxd', metastore_id=None, name='ucx_snfxd', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:29 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_snfxd.ucx_trqbo: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_snfxd/ucx_trqbo
04:29 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_snfxd.ucx_trqbo', metastore_id=None, name='ucx_trqbo', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_snfxd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_snfxd/ucx_trqbo', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:29 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='3643460029433393', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
04:29 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_smlbd: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_smlbd
04:29 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smlbd', metastore_id=None, name='ucx_smlbd', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:29 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_snfxd: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_snfxd
04:29 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_snfxd', metastore_id=None, name='ucx_snfxd', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:29 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_snfxd.ucx_trqbo: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_snfxd/ucx_trqbo
04:29 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_snfxd.ucx_trqbo', metastore_id=None, name='ucx_trqbo', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_snfxd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_snfxd/ucx_trqbo', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:29 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='3643460029433393', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='3643460029433393', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_snfxd.ucx_trqbo', metastore_id=None, name='ucx_trqbo', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_snfxd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_snfxd/ucx_trqbo', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 schema fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smlbd', metastore_id=None, name='ucx_smlbd', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_snfxd', metastore_id=None, name='ucx_snfxd', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_move_views: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'. (314ms)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'.
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 schema fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_alias_tables: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'. (2.946s)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'.
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-rthK: https://accounts.CLOUD_ENVdatabricks.net/users/groups/723069029299664/members
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-rthK', entitlements=[], external_id=None, groups=[], id='723069029299664', members=[], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-fIva: https://accounts.CLOUD_ENVdatabricks.net/users/groups/900329668403762/members
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-fIva', entitlements=[], external_id=None, groups=[], id='900329668403762', members=[], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-rthK: https://accounts.CLOUD_ENVdatabricks.net/users/groups/723069029299664/members
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-rthK', entitlements=[], external_id=None, groups=[], id='723069029299664', members=[], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-fIva: https://accounts.CLOUD_ENVdatabricks.net/users/groups/900329668403762/members
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-fIva', entitlements=[], external_id=None, groups=[], id='900329668403762', members=[], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 account group fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='sdk-rthK', entitlements=[], external_id=None, groups=[], id='723069029299664', members=[], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='sdk-fIva', entitlements=[], external_id=None, groups=[], id='900329668403762', members=[], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 schema fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_migrate_managed_tables_with_principal_acl_CLOUD_ENV: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'. (7.763s)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'.
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_so9zb: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_so9zb
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_so9zb', metastore_id=None, name='ucx_so9zb', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: <databricks.sdk.service._internal.Wait object at 0x7fd8ea797c40>
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/ucx_so9zb
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sruta: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sruta
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sruta', metastore_id=None, name='ucx_sruta', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sruta.ucx_tzkzw: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sruta/ucx_tzkzw
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sruta.ucx_tzkzw', metastore_id=None, name='ucx_tzkzw', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sruta', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/ucx_so9zb', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_so9zb: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_so9zb
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_so9zb', metastore_id=None, name='ucx_so9zb', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: <databricks.sdk.service._internal.Wait object at 0x7fd8ea797c40>
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/ucx_so9zb
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sruta: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sruta
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sruta', metastore_id=None, name='ucx_sruta', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sruta.ucx_tzkzw: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sruta/ucx_tzkzw
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sruta.ucx_tzkzw', metastore_id=None, name='ucx_tzkzw', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sruta', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/ucx_so9zb', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: <databricks.sdk.service._internal.Wait object at 0x7fd8ea797c40>
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sruta.ucx_tzkzw', metastore_id=None, name='ucx_tzkzw', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sruta', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/ucx_so9zb', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/ucx_so9zb
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 schema fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_so9zb', metastore_id=None, name='ucx_so9zb', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sruta', metastore_id=None, name='ucx_sruta', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures
[gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_migrate_managed_tables: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'. (4.949s)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'.
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sx64z: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sx64z
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sx64z', metastore_id=None, name='ucx_sx64z', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw9] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sx64z: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sx64z
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sx64z', metastore_id=None, name='ucx_sx64z', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_svb7d: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_svb7d
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_svb7d', metastore_id=None, name='ucx_svb7d', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_svb7d.ucx_t5l6y: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_svb7d/ucx_t5l6y
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_svb7d.ucx_t5l6y', metastore_id=None, name='ucx_t5l6y', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_svb7d', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_svb7d/ucx_t5l6y', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sx64z: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sx64z
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sx64z', metastore_id=None, name='ucx_sx64z', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_svb7d: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_svb7d
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_svb7d', metastore_id=None, name='ucx_svb7d', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_svb7d.ucx_t5l6y: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_svb7d/ucx_t5l6y
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_svb7d.ucx_t5l6y', metastore_id=None, name='ucx_t5l6y', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_svb7d', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_svb7d/ucx_t5l6y', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_svb7d.ucx_t5l6y', metastore_id=None, name='ucx_t5l6y', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_svb7d', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_svb7d/ucx_t5l6y', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 schema fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sx64z', metastore_id=None, name='ucx_sx64z', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_svb7d', metastore_id=None, name='ucx_svb7d', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw9] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_migrate_tables_with_cache_should_not_create_table: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'. (2.691s)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'.
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_smcar: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_smcar
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smcar', metastore_id=None, name='ucx_smcar', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw9] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_smcar: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_smcar
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smcar', metastore_id=None, name='ucx_smcar', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_snwn1: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_snwn1
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_snwn1', metastore_id=None, name='ucx_snwn1', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_smcar: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_smcar
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smcar', metastore_id=None, name='ucx_smcar', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_snwn1: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_snwn1
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_snwn1', metastore_id=None, name='ucx_snwn1', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 schema fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smcar', metastore_id=None, name='ucx_smcar', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_snwn1', metastore_id=None, name='ucx_snwn1', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw9] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_revert_migrated_table: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'. (10.775s)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'.
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_srktl: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_srktl
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_srktl', metastore_id=None, name='ucx_srktl', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw8] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_srktl: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_srktl
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_srktl', metastore_id=None, name='ucx_srktl', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s1rp5: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s1rp5
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s1rp5', metastore_id=None, name='ucx_s1rp5', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sjmop: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sjmop
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sjmop', metastore_id=None, name='ucx_sjmop', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_s1rp5.ucx_tjfvy: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s1rp5/ucx_tjfvy
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s1rp5.ucx_tjfvy', metastore_id=None, name='ucx_tjfvy', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_s1rp5', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_s1rp5/ucx_tjfvy', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_s1rp5.ucx_tj7oa: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s1rp5/ucx_tj7oa
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s1rp5.ucx_tj7oa', metastore_id=None, name='ucx_tj7oa', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_s1rp5', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_s1rp5/ucx_tj7oa', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sjmop.ucx_tyaen: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sjmop/ucx_tyaen
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sjmop.ucx_tyaen', metastore_id=None, name='ucx_tyaen', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sjmop', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sjmop/ucx_tyaen', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_srktl: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_srktl
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_srktl', metastore_id=None, name='ucx_srktl', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s1rp5: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s1rp5
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s1rp5', metastore_id=None, name='ucx_s1rp5', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sjmop: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sjmop
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sjmop', metastore_id=None, name='ucx_sjmop', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_s1rp5.ucx_tjfvy: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s1rp5/ucx_tjfvy
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s1rp5.ucx_tjfvy', metastore_id=None, name='ucx_tjfvy', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_s1rp5', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_s1rp5/ucx_tjfvy', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_s1rp5.ucx_tj7oa: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s1rp5/ucx_tj7oa
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s1rp5.ucx_tj7oa', metastore_id=None, name='ucx_tj7oa', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_s1rp5', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_s1rp5/ucx_tj7oa', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sjmop.ucx_tyaen: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sjmop/ucx_tyaen
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sjmop.ucx_tyaen', metastore_id=None, name='ucx_tyaen', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sjmop', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sjmop/ucx_tyaen', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 table fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s1rp5.ucx_tjfvy', metastore_id=None, name='ucx_tjfvy', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_s1rp5', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_s1rp5/ucx_tjfvy', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s1rp5.ucx_tj7oa', metastore_id=None, name='ucx_tj7oa', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_s1rp5', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_s1rp5/ucx_tj7oa', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sjmop.ucx_tyaen', metastore_id=None, name='ucx_tyaen', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sjmop', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sjmop/ucx_tyaen', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_srktl', metastore_id=None, name='ucx_srktl', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s1rp5', metastore_id=None, name='ucx_s1rp5', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sjmop', metastore_id=None, name='ucx_sjmop', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw8] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_migrate_external_table: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'. (5.527s)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'.
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s6buj: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s6buj
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s6buj', metastore_id=None, name='ucx_s6buj', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw9] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s6buj: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s6buj
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s6buj', metastore_id=None, name='ucx_s6buj', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sw9px: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sw9px
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sw9px', metastore_id=None, name='ucx_sw9px', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/twGK
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sw9px.ucx_tadkl: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sw9px/ucx_tadkl
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sw9px.ucx_tadkl', metastore_id=None, name='ucx_tadkl', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sw9px', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/twGK', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s6buj: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s6buj
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s6buj', metastore_id=None, name='ucx_s6buj', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sw9px: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sw9px
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sw9px', metastore_id=None, name='ucx_sw9px', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/twGK
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sw9px.ucx_tadkl: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sw9px/ucx_tadkl
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sw9px.ucx_tadkl', metastore_id=None, name='ucx_tadkl', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sw9px', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/twGK', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/twGK
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sw9px.ucx_tadkl', metastore_id=None, name='ucx_tadkl', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sw9px', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/twGK', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 schema fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s6buj', metastore_id=None, name='ucx_s6buj', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sw9px', metastore_id=None, name='ucx_sw9px', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw9] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_mapping_skips_tables_databases: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'. (12.499s)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'.
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_snkg7: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_snkg7
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_snkg7', metastore_id=None, name='ucx_snkg7', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw8] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_snkg7: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_snkg7
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_snkg7', metastore_id=None, name='ucx_snkg7', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_swvau: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_swvau
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_swvau', metastore_id=None, name='ucx_swvau', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_subty: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_subty
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_subty', metastore_id=None, name='ucx_subty', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_swvau.ucx_trrht: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_swvau/ucx_trrht
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_swvau.ucx_trrht', metastore_id=None, name='ucx_trrht', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_swvau', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_swvau/ucx_trrht', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_swvau.ucx_tzbb9: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_swvau/ucx_tzbb9
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_swvau.ucx_tzbb9', metastore_id=None, name='ucx_tzbb9', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_swvau', sql_path=None, storage_credential_name=None, storage_location='dbfs:/databricks-datasets/adult/adult.data', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_swvau.ucx_traem: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_swvau/ucx_traem
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_swvau.ucx_traem', metastore_id=None, name='ucx_traem', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_swvau', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_swvau/ucx_traem', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_subty.ucx_tuh1q: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_subty/ucx_tuh1q
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_subty.ucx_tuh1q', metastore_id=None, name='ucx_tuh1q', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_subty', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_subty/ucx_tuh1q', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_snkg7: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_snkg7
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_snkg7', metastore_id=None, name='ucx_snkg7', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_swvau: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_swvau
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_swvau', metastore_id=None, name='ucx_swvau', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_subty: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_subty
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_subty', metastore_id=None, name='ucx_subty', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_swvau.ucx_trrht: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_swvau/ucx_trrht
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_swvau.ucx_trrht', metastore_id=None, name='ucx_trrht', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_swvau', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_swvau/ucx_trrht', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_swvau.ucx_tzbb9: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_swvau/ucx_tzbb9
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_swvau.ucx_tzbb9', metastore_id=None, name='ucx_tzbb9', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_swvau', sql_path=None, storage_credential_name=None, storage_location='dbfs:/databricks-datasets/adult/adult.data', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_swvau.ucx_traem: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_swvau/ucx_traem
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_swvau.ucx_traem', metastore_id=None, name='ucx_traem', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_swvau', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_swvau/ucx_traem', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_subty.ucx_tuh1q: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_subty/ucx_tuh1q
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_subty.ucx_tuh1q', metastore_id=None, name='ucx_tuh1q', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_subty', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_subty/ucx_tuh1q', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 4 table fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_swvau.ucx_trrht', metastore_id=None, name='ucx_trrht', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_swvau', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_swvau/ucx_trrht', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_swvau.ucx_tzbb9', metastore_id=None, name='ucx_tzbb9', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_swvau', sql_path=None, storage_credential_name=None, storage_location='dbfs:/databricks-datasets/adult/adult.data', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_swvau.ucx_traem', metastore_id=None, name='ucx_traem', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_swvau', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_swvau/ucx_traem', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_subty.ucx_tuh1q', metastore_id=None, name='ucx_tuh1q', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_subty', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_subty/ucx_tuh1q', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_snkg7', metastore_id=None, name='ucx_snkg7', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_swvau', metastore_id=None, name='ucx_swvau', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_subty', metastore_id=None, name='ucx_subty', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw8] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_mapping_reverts_table: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'. (6.308s)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'.
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_svjl2: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_svjl2
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_svjl2', metastore_id=None, name='ucx_svjl2', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw8] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_svjl2: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_svjl2
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_svjl2', metastore_id=None, name='ucx_svjl2', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sulse: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sulse
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sulse', metastore_id=None, name='ucx_sulse', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sulse.ucx_tjm5m: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sulse/ucx_tjm5m
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sulse.ucx_tjm5m', metastore_id=None, name='ucx_tjm5m', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sulse', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sulse/ucx_tjm5m', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sulse.ucx_t7yb0: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sulse/ucx_t7yb0
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sulse.ucx_t7yb0', metastore_id=None, name='ucx_t7yb0', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sulse', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sulse/ucx_t7yb0', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_svjl2: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_svjl2
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_svjl2', metastore_id=None, name='ucx_svjl2', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sulse: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sulse
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sulse', metastore_id=None, name='ucx_sulse', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sulse.ucx_tjm5m: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sulse/ucx_tjm5m
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sulse.ucx_tjm5m', metastore_id=None, name='ucx_tjm5m', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sulse', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sulse/ucx_tjm5m', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sulse.ucx_t7yb0: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sulse/ucx_t7yb0
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sulse.ucx_t7yb0', metastore_id=None, name='ucx_t7yb0', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sulse', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sulse/ucx_t7yb0', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 table fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sulse.ucx_tjm5m', metastore_id=None, name='ucx_tjm5m', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sulse', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sulse/ucx_tjm5m', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sulse.ucx_t7yb0', metastore_id=None, name='ucx_t7yb0', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sulse', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sulse/ucx_t7yb0', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 schema fixtures
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_svjl2', metastore_id=None, name='ucx_svjl2', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:30 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sulse', metastore_id=None, name='ucx_sulse', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw8] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_table_migration_job_cluster_override: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'. (11.02s)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: User does not have CREATE CATALOG on Metastore 'primary'.
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
04:36 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_truau: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_truau
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_truau', metastore_id=None, name='migrate_truau', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:36 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_truau.ucx_too3p: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_truau/ucx_too3p
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_truau.ucx_too3p', metastore_id=None, name='ucx_too3p', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_truau', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_truau/ucx_too3p', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/9lgI
04:36 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_truau.ucx_tt8wg: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_truau/ucx_tt8wg
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_truau.ucx_tt8wg', metastore_id=None, name='ucx_tt8wg', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_truau', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/9lgI', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:36 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_truau: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_truau
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_truau', metastore_id=None, name='migrate_truau', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:36 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_truau.ucx_too3p: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_truau/ucx_too3p
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_truau.ucx_too3p', metastore_id=None, name='ucx_too3p', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_truau', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_truau/ucx_too3p', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/9lgI
04:36 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_truau.ucx_tt8wg: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_truau/ucx_tt8wg
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_truau.ucx_tt8wg', metastore_id=None, name='ucx_tt8wg', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_truau', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/9lgI', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/9lgI
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 table fixtures
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_truau.ucx_too3p', metastore_id=None, name='ucx_too3p', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_truau', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_truau/ucx_too3p', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_truau.ucx_tt8wg', metastore_id=None, name='ucx_tt8wg', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_truau', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/9lgI', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_truau', metastore_id=None, name='migrate_truau', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_replace_workspace_groups_with_account_groups: TimeoutError: Timed out after 0:03:00 (3m40.883s)
TimeoutError: Timed out after 0:03:00
04:35 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s1uhf: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s1uhf
04:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s1uhf', metastore_id=None, name='ucx_s1uhf', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
04:35 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s1uhf: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s1uhf
04:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s1uhf', metastore_id=None, name='ucx_s1uhf', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='6159901008641806', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
04:36 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_syg5: https://DATABRICKS_HOST#setting/accounts/groups/404162076239159
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_syg5', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='404162076239159', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/6159901008641806', type=None, value='6159901008641806')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:36 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_syg5: https://accounts.CLOUD_ENVdatabricks.net/users/groups/599610960016787/members
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_syg5', entitlements=[], external_id=None, groups=[], id='599610960016787', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/6159901008641806', type=None, value='6159901008641806')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:36 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/0019684376417329
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='0019684376417329')
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 0019684376417329 [group_name admins CAN_USE] -> [group_name ucx_syg5 CAN_USE]
04:36 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_skppg: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_skppg
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_skppg', metastore_id=None, name='ucx_skppg', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:36 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_skppg.ucx_tjmxg: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_skppg/ucx_tjmxg
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_skppg.ucx_tjmxg', metastore_id=None, name='ucx_tjmxg', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_skppg', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_skppg/ucx_tjmxg', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:36 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions
04:36 INFO [databricks.labs.ucx.workspace_access.generic] Listed cluster-policies in 0:00:00.038763
04:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.grants] fetching grants inventory
04:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.grants] crawling new batch for grants
04:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.grants] found 16 new records for grants
04:36 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 24
04:36 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 24
04:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.permissions] found 24 new records for permissions
04:36 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table
04:36 INFO [databricks.labs.ucx.workspace_access.manager] Saved 24 to hive_metastore.ucx_s1uhf.permissions
04:36 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_s1uhf.permissions
04:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.groups] fetching groups inventory
04:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.groups] crawling new batch for groups
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Found 13 WorkspaceGroup
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Found 311 account groups
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated
04:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.groups] found 1 new records for groups
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta...
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Found 57 Group
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Found 13 WorkspaceGroup
04:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.groups] fetching groups inventory
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Renaming: ucx_syg5 -> ucx-temp-ucx_syg5
04:36 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
04:36 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
04:36 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
04:36 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
04:36 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
04:36 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
04:37 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
04:37 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
04:37 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 311 account groups
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta...
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 57 Group
04:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.groups] fetching groups inventory
04:37 INFO [tests.integration.workspace_access.test_groups] check_permissions_after_replace()
04:37 INFO [tests.integration.workspace_access.test_groups] check_permissions_after_replace()
04:37 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_s1uhf.permissions
04:37 INFO [databricks.labs.ucx.workspace_access.manager] Applying the permissions to account groups. Total groups to apply permissions: 1. Total permissions found: 24
04:37 INFO [databricks.labs.ucx.workspace_access.manager] Total tasks for TABLE: 1
04:37 DEBUG [databricks.labs.ucx.workspace_access.generic] Skipping AccessControlResponse(all_permissions=[Permission(inherited=True, inherited_from_object=['/cluster-policies/cluster-policies'], permission_level=<PermissionLevel.CAN_USE: 'CAN_USE'>)], display_name=None, group_name='admins', service_principal_name=None, user_name=None) for cluster-policy//cluster-policies/0019684376417329 because it is not in scope
04:37 INFO [databricks.labs.ucx.workspace_access.manager] Total tasks for cluster-policies: 1
04:37 INFO [databricks.labs.ucx.workspace_access.manager] Starting to apply permissions on account groups. Total tasks: 2
04:37 INFO [databricks.labs.ucx.workspace_access.manager] Permissions were applied
04:37 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_account_group()
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 3 WorkspaceGroup
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta...
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 58 Group
04:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.groups] fetching groups inventory
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Deleting the workspace-level group ucx-temp-ucx_syg5 with id 404162076239159
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Workspace-level group ucx-temp-ucx_syg5 with id 404162076239159 was deleted
04:37 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:37 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:37 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:37 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:37 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:37 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:37 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:38 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:38 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:38 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='2490546602098632', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
04:38 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_qmG0: https://DATABRICKS_HOST#setting/accounts/groups/854636598122345
04:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_qmG0', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='854636598122345', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/2490546602098632', type=None, value='2490546602098632')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:38 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_qmG0: https://accounts.CLOUD_ENVdatabricks.net/users/groups/751740750045638/members
04:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_qmG0', entitlements=[], external_id=None, groups=[], id='751740750045638', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/2490546602098632', type=None, value='2490546602098632')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:38 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/00132C53CB50FD05
04:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='00132C53CB50FD05')
04:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 00132C53CB50FD05 [group_name admins CAN_USE] -> [group_name ucx_qmG0 CAN_USE]
04:38 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_skqje: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_skqje
04:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_skqje', metastore_id=None, name='ucx_skqje', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:38 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_skqje.ucx_tkyvv: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_skqje/ucx_tkyvv
04:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_skqje.ucx_tkyvv', metastore_id=None, name='ucx_tkyvv', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_skqje', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_skqje/ucx_tkyvv', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:38 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions
04:38 INFO [databricks.labs.ucx.workspace_access.generic] Listed cluster-policies in 0:00:00.038011
04:38 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.grants] fetching grants inventory
04:38 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 24
04:38 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 24
04:38 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.permissions] found 24 new records for permissions
04:38 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table
04:38 INFO [databricks.labs.ucx.workspace_access.manager] Saved 24 to hive_metastore.ucx_s1uhf.permissions
04:38 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_s1uhf.permissions
04:38 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_s1uhf.permissions
04:38 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_s1uhf.permissions
04:38 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_s1uhf.permissions
04:38 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_s1uhf.permissions
04:39 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_s1uhf.permissions
04:39 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_s1uhf.permissions
04:35 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s1uhf: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s1uhf
04:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s1uhf', metastore_id=None, name='ucx_s1uhf', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='6159901008641806', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
04:36 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_syg5: https://DATABRICKS_HOST#setting/accounts/groups/404162076239159
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_syg5', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='404162076239159', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/6159901008641806', type=None, value='6159901008641806')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:36 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_syg5: https://accounts.CLOUD_ENVdatabricks.net/users/groups/599610960016787/members
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_syg5', entitlements=[], external_id=None, groups=[], id='599610960016787', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/6159901008641806', type=None, value='6159901008641806')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:36 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/0019684376417329
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='0019684376417329')
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 0019684376417329 [group_name admins CAN_USE] -> [group_name ucx_syg5 CAN_USE]
04:36 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_skppg: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_skppg
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_skppg', metastore_id=None, name='ucx_skppg', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:36 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_skppg.ucx_tjmxg: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_skppg/ucx_tjmxg
04:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_skppg.ucx_tjmxg', metastore_id=None, name='ucx_tjmxg', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_skppg', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_skppg/ucx_tjmxg', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:36 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions
04:36 INFO [databricks.labs.ucx.workspace_access.generic] Listed cluster-policies in 0:00:00.038763
04:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.grants] fetching grants inventory
04:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.grants] crawling new batch for grants
04:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.grants] found 16 new records for grants
04:36 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 24
04:36 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 24
04:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.permissions] found 24 new records for permissions
04:36 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table
04:36 INFO [databricks.labs.ucx.workspace_access.manager] Saved 24 to hive_metastore.ucx_s1uhf.permissions
04:36 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_s1uhf.permissions
04:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.groups] fetching groups inventory
04:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.groups] crawling new batch for groups
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Found 13 WorkspaceGroup
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Found 311 account groups
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated
04:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.groups] found 1 new records for groups
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta...
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Found 57 Group
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Found 13 WorkspaceGroup
04:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.groups] fetching groups inventory
04:36 INFO [databricks.labs.ucx.workspace_access.groups] Renaming: ucx_syg5 -> ucx-temp-ucx_syg5
04:36 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
04:36 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
04:36 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
04:36 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
04:36 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
04:36 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
04:37 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
04:37 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
04:37 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 311 account groups
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta...
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 57 Group
04:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.groups] fetching groups inventory
04:37 INFO [tests.integration.workspace_access.test_groups] check_permissions_after_replace()
04:37 INFO [tests.integration.workspace_access.test_groups] check_permissions_after_replace()
04:37 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_s1uhf.permissions
04:37 INFO [databricks.labs.ucx.workspace_access.manager] Applying the permissions to account groups. Total groups to apply permissions: 1. Total permissions found: 24
04:37 INFO [databricks.labs.ucx.workspace_access.manager] Total tasks for TABLE: 1
04:37 DEBUG [databricks.labs.ucx.workspace_access.generic] Skipping AccessControlResponse(all_permissions=[Permission(inherited=True, inherited_from_object=['/cluster-policies/cluster-policies'], permission_level=<PermissionLevel.CAN_USE: 'CAN_USE'>)], display_name=None, group_name='admins', service_principal_name=None, user_name=None) for cluster-policy//cluster-policies/0019684376417329 because it is not in scope
04:37 INFO [databricks.labs.ucx.workspace_access.manager] Total tasks for cluster-policies: 1
04:37 INFO [databricks.labs.ucx.workspace_access.manager] Starting to apply permissions on account groups. Total tasks: 2
04:37 INFO [databricks.labs.ucx.workspace_access.manager] Permissions were applied
04:37 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_account_group()
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 3 WorkspaceGroup
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta...
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 58 Group
04:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.groups] fetching groups inventory
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Deleting the workspace-level group ucx-temp-ucx_syg5 with id 404162076239159
04:37 INFO [databricks.labs.ucx.workspace_access.groups] Workspace-level group ucx-temp-ucx_syg5 with id 404162076239159 was deleted
04:37 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:37 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:37 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:37 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:37 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:37 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:37 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:38 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:38 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:38 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
04:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='2490546602098632', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
04:38 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_qmG0: https://DATABRICKS_HOST#setting/accounts/groups/854636598122345
04:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_qmG0', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='854636598122345', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/2490546602098632', type=None, value='2490546602098632')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:38 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_qmG0: https://accounts.CLOUD_ENVdatabricks.net/users/groups/751740750045638/members
04:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_qmG0', entitlements=[], external_id=None, groups=[], id='751740750045638', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/2490546602098632', type=None, value='2490546602098632')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:38 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/00132C53CB50FD05
04:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='00132C53CB50FD05')
04:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 00132C53CB50FD05 [group_name admins CAN_USE] -> [group_name ucx_qmG0 CAN_USE]
04:38 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_skqje: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_skqje
04:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_skqje', metastore_id=None, name='ucx_skqje', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:38 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_skqje.ucx_tkyvv: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_skqje/ucx_tkyvv
04:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_skqje.ucx_tkyvv', metastore_id=None, name='ucx_tkyvv', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_skqje', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_skqje/ucx_tkyvv', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:38 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions
04:38 INFO [databricks.labs.ucx.workspace_access.generic] Listed cluster-policies in 0:00:00.038011
04:38 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.grants] fetching grants inventory
04:38 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 24
04:38 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 24
04:38 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s1uhf.permissions] found 24 new records for permissions
04:38 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table
04:38 INFO [databricks.labs.ucx.workspace_access.manager] Saved 24 to hive_metastore.ucx_s1uhf.permissions
04:38 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_s1uhf.permissions
04:38 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_s1uhf.permissions
04:38 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_s1uhf.permissions
04:38 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_s1uhf.permissions
04:38 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_s1uhf.permissions
04:39 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_s1uhf.permissions
04:39 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_s1uhf.permissions
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 table fixtures
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_skppg.ucx_tjmxg', metastore_id=None, name='ucx_tjmxg', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_skppg', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_skppg/ucx_tjmxg', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_skqje.ucx_tkyvv', metastore_id=None, name='ucx_tkyvv', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_skqje', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_skqje/ucx_tkyvv', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 cluster_policy permissions fixtures
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 0019684376417329 [group_name admins CAN_USE] -> [group_name ucx_syg5 CAN_USE]
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 00132C53CB50FD05 [group_name admins CAN_USE] -> [group_name ucx_qmG0 CAN_USE]
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 cluster policy fixtures
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='0019684376417329')
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='00132C53CB50FD05')
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 workspace user fixtures
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='6159901008641806', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='2490546602098632', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 account group fixtures
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx_syg5', entitlements=[], external_id=None, groups=[], id='599610960016787', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/6159901008641806', type=None, value='6159901008641806')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx_qmG0', entitlements=[], external_id=None, groups=[], id='751740750045638', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/2490546602098632', type=None, value='2490546602098632')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 workspace group fixtures
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx_syg5', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='404162076239159', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/6159901008641806', type=None, value='6159901008641806')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while workspace group Group(display_name='ucx_syg5', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='404162076239159', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/6159901008641806', type=None, value='6159901008641806')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>]) teardown: None Group with id 404162076239159 not found.
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx_qmG0', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='854636598122345', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/2490546602098632', type=None, value='2490546602098632')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s1uhf', metastore_id=None, name='ucx_s1uhf', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_skppg', metastore_id=None, name='ucx_skppg', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
04:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_skqje', metastore_id=None, name='ucx_skqje', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python

Running from acceptance #2052

@HariGS-DB HariGS-DB requested review from nfx and removed request for andrascsillag-db April 5, 2024 14:38
@nfx
Copy link
Collaborator

nfx commented Apr 6, 2024

the code has to be adjusted to #1209

@nfx
Copy link
Collaborator

nfx commented Apr 8, 2024

fixed in 55baf86

@nfx nfx closed this Apr 8, 2024
@nfx nfx deleted the feature/807_updates branch April 8, 2024 19:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants