Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix issues when running solacc #1902

Merged
merged 27 commits into from
Jun 14, 2024
Merged

Fix issues when running solacc #1902

merged 27 commits into from
Jun 14, 2024

Conversation

ericvergnaud
Copy link
Contributor

@nfx this PR relies on #1891

Changes

  • fix issue when linting sql statement 'CREATE SCHEMA xxx'
  • Infer table names from f-strings and improve Advice messages

Linked issues

Progresses #1901

Functionality

  • added relevant user documentation
  • added new CLI command
  • modified existing command: databricks labs ucx ...
  • added a new workflow
  • modified existing workflow: ...
  • added a new table
  • modified existing table: ...

Tests

  • manually tested
  • added unit tests
  • added integration tests
  • verified on staging environment (screenshot attached)

ericvergnaud and others added 24 commits June 12, 2024 11:15
@ericvergnaud
rename tree.root to tree.node
74095eb
@ericvergnaud
add root property to tree
62cb196
@ericvergnaud
successful unit tests
36d6dbb
@ericvergnaud
use named parameters from sate, not from context
b3b5140
@ericvergnaud
integrate session state to linters
0f081be
@ericvergnaud
Merge branch 'main' into infer-linted-values-that-resolve-to-dbutils.…
018eb26 
…widgets.get
@ericvergnaud
drop obsolete file
84e13a9
@ericvergnaud
Merge branch 'infer-linted-values-that-resolve-to-dbutils.widgets.get…
8fce5df 
…' of github.com:databrickslabs/ucx into infer-linted-values-that-resolve-to-dbutils.widgets.get
@ericvergnaud
integrate session state to linters and addd functional tests
d0117eb
@ericvergnaud
improve test coverage
cd993e7
@ericvergnaud
improve test coverage nd formatting
efb7188
@ericvergnaud
improve test coverage
1c7aa67
@ericvergnaud
simplify
521c416
@ericvergnaud
refactor API
fdbdbed
@ericvergnaud
Merge branch 'main' into infer-linted-values-that-resolve-to-dbutils.…
95082c3 
…widgets.get
@ericvergnaud
formatting
43cf134
@ericvergnaud
fix failing test
8b6a0e8
@ericvergnaud
fix failing tests
4759117
@ericvergnaud
add support for dbutils.widgets.getAll
3ff9ba6
@ericvergnaud
fix crasher when running solacc
939b42f
@ericvergnaud
fix the fix
6e63ee2
@ericvergnaud
fix issue when linting sql statement 'CREATE SCHEMA xxx'
b59cbd3
@ericvergnaud
Infer table names from f-strings and improve Advice messages
2f0e028
@ericvergnaud
Infer table names from f-strings and improve Advice messages
4602ac1
@ericvergnaud ericvergnaud requested review from a team and dmoore247 June 13, 2024 13:13
@ericvergnaud ericvergnaud marked this pull request as draft June 13, 2024 13:14
@ericvergnaud
Copy link
Contributor Author

@nfx @asnare keeping this as draft until #1891 is merged

@codecov Codecov
Copy link

codecov bot commented Jun 13, 2024 •
edited
Loading

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 89.58%. Comparing base (4414463) to head (aa63ece).

Additional details and impacted files 
@@           Coverage Diff           @@
##             main    #1902   +/-   ##
=======================================
  Coverage   89.57%   89.58%           
=======================================
  Files          95       95           
  Lines       12329    12333    +4     
  Branches     2164     2166    +2     
=======================================
+ Hits        11044    11048    +4     
  Misses        864      864           
  Partials      421      421

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@nfx
Copy link
Collaborator

nfx commented Jun 13, 2024

@ericvergnaud #1891 is orthogonal to to reducing noise

@ericvergnaud
Merge branch 'main' into fix-issues-when-running-solacc
ba2cc83 
# Conflicts:
#	tests/integration/source_code/test_jobs.py
@ericvergnaud
increase test coverage
aa63ece
@ericvergnaud
Copy link
Contributor Author

@ericvergnaud #1891 is orthogonal to to reducing noise

some noise comes from failing to infer values

@ericvergnaud ericvergnaud marked this pull request as ready for review June 14, 2024 07:50
@github-actions GitHub Actions
Copy link

❌ 193/194 passed, 1 failed, 24 skipped, 2h44m31s total

❌ test_running_real_validate_groups_permissions_job_fails: databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: ResourceDoesNotExist: Scope sdk-wvlo does not exist! (3m5.714s) 
databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: ResourceDoesNotExist: Scope sdk-wvlo does not exist!
[gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
08:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='4286384023111618', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
08:03 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_GDzO1: https://DATABRICKS_HOST#setting/accounts/groups/395057018244884
08:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_GDzO1', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='395057018244884', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/4286384023111618', type=None, value='4286384023111618')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
08:03 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_GDzO1: https://accounts.CLOUD_ENVdatabricks.net/users/groups/297776123434351/members
08:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_GDzO1', entitlements=[], external_id=None, groups=[], id='297776123434351', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/4286384023111618', type=None, value='4286384023111618')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
08:03 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/0002C56A7B71F154
08:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='0002C56A7B71F154')
08:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 0002C56A7B71F154 [group_name admins CAN_USE] -> [group_name ucx_GDzO1 CAN_USE]
08:03 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sz7l2: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sz7l2
08:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sz7l2', metastore_id=None, name='ucx_sz7l2', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
08:03 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.goa0/config.yml) doesn't exist.
08:03 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
08:03 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
08:03 INFO [databricks.labs.ucx.install] Fetching installations...
08:03 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
08:03 DEBUG [tests.integration.conftest] Waiting for clusters to start...
08:03 DEBUG [tests.integration.conftest] Waiting for clusters to start...
08:04 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+3120240614080400
08:04 INFO [databricks.labs.ucx.install] Creating ucx schemas...
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
08:04 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.goa0/README for the next steps.
08:04 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed clusters in 0:00:00.062993
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed cluster-policies in 0:00:00.044453
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed instance-pools in 0:00:00.092261
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed sql/warehouses in 0:00:00.063765
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed jobs in 0:00:00.438502
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed pipelines in 0:00:00.059392
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed serving-endpoints in 0:00:01.050970
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed experiments in 0:00:00.635576
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed registered-models in 0:00:00.287627
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed registered-models in 0:00:00.000005
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed authorization in 0:00:00.000005
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed feature-tables in 0:00:00.061089
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed feature-tables in 0:00:00.000008
08:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.workspace_objects] fetching workspace_objects inventory
08:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.workspace_objects] crawling new batch for workspace_objects
08:04 INFO [databricks.labs.ucx.workspace_access.listing] Recursive WorkspaceFS listing started at 2024-06-14 08:04:42.740697
08:04 DEBUG [databricks.labs.ucx.workspace_access.listing] Listed /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.goa0, found 1 sub-directories and 6 other objects
08:04 DEBUG [databricks.labs.ucx.workspace_access.listing] Listed /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.goa0/wheels, found 0 sub-directories and 2 other objects
08:04 INFO [databricks.labs.ucx.workspace_access.listing] Recursive WorkspaceFS listing finished at 2024-06-14 08:04:42.919414. Total time taken for workspace listing: 0:00:00.178728
08:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.workspace_objects] found 10 new records for workspace_objects
08:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.grants] fetching grants inventory
08:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.grants] crawling new batch for grants
08:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.tables] fetching tables inventory
08:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.tables] crawling new batch for tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_yswrw] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_scczc] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sd3kv] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhqc] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sx5iu] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sxyih] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_syswv] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szcvf] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ajs_grant_testing] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ajs_view_grant_testing] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.foo] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.some] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_t08ek] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_t7mgw] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tiixw] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tkbmh] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tkgro] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tlodc] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tloia] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_twblz] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_twmnr] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_ty0j0] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_yswrw.avro_serde_yswrw] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_yswrw.orc_serde_yswrw] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_yswrw.parquet_serde_yswrw] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.CLOUD_ENV_service_principals] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.clusters] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.code_patterns] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.external_locations] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.global_init_scripts] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.grant_detail] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.grants] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.groups] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.jobs] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.logs] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.migration_status] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.misc_patterns] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.mounts] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.objects] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.permissions] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.pipelines] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.policies] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.recon_results] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.reconciliation_results] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.submit_runs] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.table_estimates] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.table_failures] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.table_size] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.tables] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.udfs] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.workflow_problems] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.workspace_objects] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sd3kv.groups] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.CLOUD_ENV_service_principals] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.clusters] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.code_patterns] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.external_locations] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.global_init_scripts] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.grant_detail] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.grants] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.groups] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.jobs] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.logs] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.migration_status] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.misc_patterns] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.mounts] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.objects] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.permissions] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.pipelines] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.policies] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.recon_results] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.reconciliation_results] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.submit_runs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.table_estimates] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.table_failures] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.table_size] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.tables] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.udfs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.workflow_problems] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.workspace_objects] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.CLOUD_ENV_service_principals] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.clusters] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.code_patterns] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.external_locations] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.global_init_scripts] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.grant_detail] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.grants] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.groups] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.jobs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.logs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.migration_status] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.misc_patterns] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.mounts] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.objects] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.permissions] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.pipelines] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.policies] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.recon_results] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.reconciliation_results] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.submit_runs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.table_estimates] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.table_failures] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.table_size] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.tables] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.udfs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.workflow_problems] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.workspace_objects] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sx5iu.groups] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.CLOUD_ENV_service_principals] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.clusters] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.code_patterns] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.external_locations] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.global_init_scripts] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.grant_detail] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.grants] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.groups] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.jobs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.logs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.migration_status] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.misc_patterns] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.mounts] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.objects] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.permissions] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.pipelines] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.policies] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.recon_results] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.reconciliation_results] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.submit_runs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.table_estimates] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.table_failures] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.table_size] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.tables] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.udfs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.workflow_problems] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.workspace_objects] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szcvf.ucx_tm7ug] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.CLOUD_ENV_service_principals] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.clusters] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.code_patterns] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.external_locations] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.global_init_scripts] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.grant_detail] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.grants] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.groups] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.jobs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.logs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.migration_status] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.misc_patterns] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.mounts] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.objects] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.permissions] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.pipelines] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.policies] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.recon_results] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.reconciliation_results] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.submit_runs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.table_estimates] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.table_failures] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.table_size] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.tables] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.udfs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.workflow_problems] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.workspace_objects] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.tables] found 155 new records for tables
08:05 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.udfs] fetching udfs inventory
08:05 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.udfs] crawling new batch for udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.hiveserde_in_place_yswrw] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_s9ohw] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_scczc] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_scsqz] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sd3kv] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sjewg] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_slhqc] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_srq1e] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sx5iu] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sxyih] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_syswv] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sz7l2] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_szcvf] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_szott] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA.convert_f_to_c] fetching udf metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA.hiveudaf] fetching udf metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA.hiveudtf] fetching udf metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA.testudf] fetching udf metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_slhqc.ucx_tfdyv] fetching udf metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_slhqc.ucx_tivgl] fetching udf metadata
08:05 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.udfs] found 6 new records for udfs
08:05 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_sd3kv no longer existed
08:05 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_scczc no longer existed
08:05 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_sx5iu no longer existed
08:05 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_sx5iu no longer existed
08:05 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_sd3kv no longer existed
08:05 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_slhqc no longer existed
08:05 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.grants] found 176 new records for grants
08:06 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 2585
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] removed on backend: authorization passwords
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] Object authorization passwords doesn't have any permissions
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.DASHBOARDS d7ebcc49-b468-4198-a777-d84a0feee951
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.DASHBOARDS e89080f8-2833-48bc-b637-9227f2fa9ee7
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.DASHBOARDS 7f85fd94-cf79-4520-a478-01d0191077e5
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.DASHBOARDS d544dbc9-cd2f-496f-914d-9847a1d63df2
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.DASHBOARDS f42451b3-7bc1-4b74-9cf5-67ef42582077
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES ff02bcfe-27e7-4821-a869-4248ac349094
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES b34a4a63-f891-4303-a8b4-ded13e0f8a78
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES c0690420-e889-41a2-9ccf-9992cca1cdd4
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 2159c1d9-dcc4-437f-b07b-40e5a602a55a
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES f3db69d6-d605-496f-9ec8-7c242bd79ab1
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 96ff6689-7bac-4343-832d-9cd3c735d8c8
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES bb31a223-7f98-40bf-9f75-437dafdb5275
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 81149b50-6697-4dde-8732-0a546fc56350
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 2d2b2ab4-4ca5-4e37-aa9a-1adefe36895f
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 30749579-aaad-4ab2-9d92-86ccdefde064
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 0e56ae1c-c681-4ca2-be5d-8fd38873ddd6
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES bc5a1840-50e6-4d07-9398-1a55406ab9ee
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES c251b782-8840-4a16-a54f-52a3100b467c
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 97fc0d7e-555b-4c2f-a277-e3f018d827af
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES ca41c5db-f3b2-410b-9553-17371f7274a9
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 5489440d-afc9-4f61-9a82-967747116dcb
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 7381f716-b21c-4cb6-976d-9cf0869289a1
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 9e5de597-e6fc-440c-9545-b3d4b35e0e89
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 57445fe0-2521-4de2-bde5-badc48d1b597
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 07232081-baa0-44dd-91d8-f28995f2420f
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 5742dcce-aade-453a-8417-bc51cfc849fc
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES eaaf6cd4-12f3-4fb4-868b-be542bc3bc99
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES d7780873-6372-4505-b222-8a2be32c0fa7
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 9af33c44-d85c-41e5-aac6-839bd0080563
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES e1a53768-69fc-4a42-a39c-fdea9919d4ae
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 7b7f9bbc-904a-4ce5-8a60-fe0e564c8b75
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 2ce3f48c-81ce-408c-b4a4-e6ea80102fd5
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES c7e9ce5b-bc8e-4b34-ac1c-761d54c0e166
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 9a2db33f-2335-4375-91f7-146d37495a72
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 53bd91db-9cd6-42aa-b6ed-88f83283ccb6
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES cfe4874d-b225-4c49-bf4d-77d8e62b2b03
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 3e8fa9c8-ffd7-4f6e-91ba-a3f134c3ea37
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES cefda76b-5ffd-466b-bf80-1c064fb8614d
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 2b61b299-394f-4912-8013-abb1d53684f9
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 1c42b56c-35ce-46c1-8001-ea0aab5384ee
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 4c9a26dd-8b76-48ce-848e-0f402d608014
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 60f39c7c-b86c-4069-86d8-13aa9fed3af0
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 338f932f-603e-4199-b234-2c321fdbd590
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 4927f691-86dd-4757-9f4c-457505587477
08:06 ERROR [databricks.labs.blueprint.parallel] crawl permissions(SecretScope(backend_type=<ScopeBackendType.DATABRICKS: 'DATABRICKS'>, keyvault_metadata=None, name='sdk-wvlo')) task failed: Scope sdk-wvlo does not exist!
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/secrets.py", line 37, in _crawler_task
    acl_items = self._ws.secrets.list_acls(scope.name)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/workspace.py", line 1995, in list_acls
    json = self._api.do('GET', '/api/2.0/secrets/acls/list', query=query, headers=headers)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 131, in do
    response = retryable(self._perform)(method,
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper
    raise err
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper
    return func(*args, **kwargs)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 242, in _perform
    raise self._make_nicer_error(response=response, **payload) from None
databricks.sdk.errors.platform.ResourceDoesNotExist: Scope sdk-wvlo does not exist!
08:06 WARNING [databricks.labs.blueprint.parallel] Some 'crawl permissions' tasks failed: 98% results available (2531/2585). Took 0:00:30.571627
08:06 ERROR [databricks.labs.ucx.workspace_access.manager] Error while crawling permissions: Scope sdk-wvlo does not exist!
08:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='4286384023111618', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
08:03 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_GDzO1: https://DATABRICKS_HOST#setting/accounts/groups/395057018244884
08:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_GDzO1', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='395057018244884', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/4286384023111618', type=None, value='4286384023111618')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
08:03 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_GDzO1: https://accounts.CLOUD_ENVdatabricks.net/users/groups/297776123434351/members
08:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_GDzO1', entitlements=[], external_id=None, groups=[], id='297776123434351', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/4286384023111618', type=None, value='4286384023111618')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
08:03 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/0002C56A7B71F154
08:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='0002C56A7B71F154')
08:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 0002C56A7B71F154 [group_name admins CAN_USE] -> [group_name ucx_GDzO1 CAN_USE]
08:03 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sz7l2: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sz7l2
08:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sz7l2', metastore_id=None, name='ucx_sz7l2', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
08:03 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.goa0/config.yml) doesn't exist.
08:03 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
08:03 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
08:03 INFO [databricks.labs.ucx.install] Fetching installations...
08:03 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
08:03 DEBUG [tests.integration.conftest] Waiting for clusters to start...
08:03 DEBUG [tests.integration.conftest] Waiting for clusters to start...
08:04 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+3120240614080400
08:04 INFO [databricks.labs.ucx.install] Creating ucx schemas...
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
08:04 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
08:04 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.goa0/README for the next steps.
08:04 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed clusters in 0:00:00.062993
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed cluster-policies in 0:00:00.044453
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed instance-pools in 0:00:00.092261
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed sql/warehouses in 0:00:00.063765
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed jobs in 0:00:00.438502
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed pipelines in 0:00:00.059392
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed serving-endpoints in 0:00:01.050970
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed experiments in 0:00:00.635576
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed registered-models in 0:00:00.287627
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed registered-models in 0:00:00.000005
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed authorization in 0:00:00.000005
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed feature-tables in 0:00:00.061089
08:04 INFO [databricks.labs.ucx.workspace_access.generic] Listed feature-tables in 0:00:00.000008
08:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.workspace_objects] fetching workspace_objects inventory
08:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.workspace_objects] crawling new batch for workspace_objects
08:04 INFO [databricks.labs.ucx.workspace_access.listing] Recursive WorkspaceFS listing started at 2024-06-14 08:04:42.740697
08:04 DEBUG [databricks.labs.ucx.workspace_access.listing] Listed /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.goa0, found 1 sub-directories and 6 other objects
08:04 DEBUG [databricks.labs.ucx.workspace_access.listing] Listed /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.goa0/wheels, found 0 sub-directories and 2 other objects
08:04 INFO [databricks.labs.ucx.workspace_access.listing] Recursive WorkspaceFS listing finished at 2024-06-14 08:04:42.919414. Total time taken for workspace listing: 0:00:00.178728
08:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.workspace_objects] found 10 new records for workspace_objects
08:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.grants] fetching grants inventory
08:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.grants] crawling new batch for grants
08:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.tables] fetching tables inventory
08:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.tables] crawling new batch for tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_yswrw] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_scczc] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sd3kv] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_slhqc] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sx5iu] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sxyih] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_syswv] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szcvf] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott] listing tables
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ajs_grant_testing] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ajs_view_grant_testing] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.foo] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.some] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_t08ek] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_t7mgw] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tiixw] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tkbmh] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tkgro] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tlodc] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_tloia] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_twblz] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_twmnr] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.TEST_SCHEMA.ucx_ty0j0] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_yswrw.avro_serde_yswrw] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_yswrw.orc_serde_yswrw] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_yswrw.parquet_serde_yswrw] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.CLOUD_ENV_service_principals] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.clusters] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.code_patterns] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.external_locations] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.global_init_scripts] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.grant_detail] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.grants] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.groups] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.jobs] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.logs] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.migration_status] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.misc_patterns] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.mounts] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.objects] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.permissions] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.pipelines] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.policies] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.recon_results] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.reconciliation_results] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.submit_runs] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.table_estimates] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.table_failures] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.table_size] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.tables] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.udfs] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.workflow_problems] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s9ohw.workspace_objects] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sd3kv.groups] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.CLOUD_ENV_service_principals] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.clusters] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.code_patterns] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.external_locations] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.global_init_scripts] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.grant_detail] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.grants] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.groups] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.jobs] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.logs] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.migration_status] fetching table metadata
08:04 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.misc_patterns] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.mounts] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.objects] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.permissions] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.pipelines] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.policies] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.recon_results] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.reconciliation_results] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.submit_runs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.table_estimates] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.table_failures] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.table_size] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.tables] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.udfs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.workflow_problems] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sjewg.workspace_objects] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.CLOUD_ENV_service_principals] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.clusters] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.code_patterns] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.external_locations] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.global_init_scripts] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.grant_detail] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.grants] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.groups] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.jobs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.logs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.migration_status] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.misc_patterns] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.mounts] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.objects] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.permissions] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.pipelines] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.policies] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.recon_results] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.reconciliation_results] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.submit_runs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.table_estimates] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.table_failures] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.table_size] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.tables] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.udfs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.workflow_problems] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_srq1e.workspace_objects] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sx5iu.groups] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.CLOUD_ENV_service_principals] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.clusters] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.code_patterns] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.external_locations] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.global_init_scripts] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.grant_detail] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.grants] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.groups] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.jobs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.logs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.migration_status] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.misc_patterns] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.mounts] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.objects] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.permissions] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.pipelines] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.policies] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.recon_results] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.reconciliation_results] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.submit_runs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.table_estimates] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.table_failures] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.table_size] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.tables] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.udfs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.workflow_problems] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sz7l2.workspace_objects] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szcvf.ucx_tm7ug] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.CLOUD_ENV_service_principals] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.clusters] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.code_patterns] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.external_locations] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.global_init_scripts] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.grant_detail] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.grants] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.groups] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.jobs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.logs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.migration_status] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.misc_patterns] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.mounts] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.objects] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.permissions] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.pipelines] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.policies] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.recon_results] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.reconciliation_results] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.submit_runs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.table_estimates] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.table_failures] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.table_size] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.tables] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.udfs] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.workflow_problems] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szott.workspace_objects] fetching table metadata
08:05 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.tables] found 155 new records for tables
08:05 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.udfs] fetching udfs inventory
08:05 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.udfs] crawling new batch for udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.hiveserde_in_place_yswrw] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_s9ohw] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_scczc] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_scsqz] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sd3kv] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sjewg] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_slhqc] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_srq1e] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sx5iu] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sxyih] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_syswv] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sz7l2] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_szcvf] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_szott] listing udfs
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA.convert_f_to_c] fetching udf metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA.hiveudaf] fetching udf metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA.hiveudtf] fetching udf metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.TEST_SCHEMA.testudf] fetching udf metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_slhqc.ucx_tfdyv] fetching udf metadata
08:05 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_slhqc.ucx_tivgl] fetching udf metadata
08:05 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.udfs] found 6 new records for udfs
08:05 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_sd3kv no longer existed
08:05 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_scczc no longer existed
08:05 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_sx5iu no longer existed
08:05 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_sx5iu no longer existed
08:05 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_sd3kv no longer existed
08:05 WARNING [databricks.labs.ucx.hive_metastore.grants] Schema hive_metastore.ucx_slhqc no longer existed
08:05 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sz7l2.grants] found 176 new records for grants
08:06 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 2585
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] jobs or cluster removed on backend: serving-endpoints None
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] Object serving-endpoints None doesn't have any permissions
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] removed on backend: authorization passwords
08:06 WARNING [databricks.labs.ucx.workspace_access.generic] Object authorization passwords doesn't have any permissions
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.DASHBOARDS d7ebcc49-b468-4198-a777-d84a0feee951
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.DASHBOARDS e89080f8-2833-48bc-b637-9227f2fa9ee7
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.DASHBOARDS 7f85fd94-cf79-4520-a478-01d0191077e5
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.DASHBOARDS d544dbc9-cd2f-496f-914d-9847a1d63df2
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.DASHBOARDS f42451b3-7bc1-4b74-9cf5-67ef42582077
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES ff02bcfe-27e7-4821-a869-4248ac349094
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES b34a4a63-f891-4303-a8b4-ded13e0f8a78
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES c0690420-e889-41a2-9ccf-9992cca1cdd4
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 2159c1d9-dcc4-437f-b07b-40e5a602a55a
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES f3db69d6-d605-496f-9ec8-7c242bd79ab1
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 96ff6689-7bac-4343-832d-9cd3c735d8c8
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES bb31a223-7f98-40bf-9f75-437dafdb5275
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 81149b50-6697-4dde-8732-0a546fc56350
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 2d2b2ab4-4ca5-4e37-aa9a-1adefe36895f
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 30749579-aaad-4ab2-9d92-86ccdefde064
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 0e56ae1c-c681-4ca2-be5d-8fd38873ddd6
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES bc5a1840-50e6-4d07-9398-1a55406ab9ee
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES c251b782-8840-4a16-a54f-52a3100b467c
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 97fc0d7e-555b-4c2f-a277-e3f018d827af
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES ca41c5db-f3b2-410b-9553-17371f7274a9
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 5489440d-afc9-4f61-9a82-967747116dcb
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 7381f716-b21c-4cb6-976d-9cf0869289a1
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 9e5de597-e6fc-440c-9545-b3d4b35e0e89
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 57445fe0-2521-4de2-bde5-badc48d1b597
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 07232081-baa0-44dd-91d8-f28995f2420f
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 5742dcce-aade-453a-8417-bc51cfc849fc
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES eaaf6cd4-12f3-4fb4-868b-be542bc3bc99
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES d7780873-6372-4505-b222-8a2be32c0fa7
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 9af33c44-d85c-41e5-aac6-839bd0080563
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES e1a53768-69fc-4a42-a39c-fdea9919d4ae
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 7b7f9bbc-904a-4ce5-8a60-fe0e564c8b75
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 2ce3f48c-81ce-408c-b4a4-e6ea80102fd5
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES c7e9ce5b-bc8e-4b34-ac1c-761d54c0e166
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 9a2db33f-2335-4375-91f7-146d37495a72
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 53bd91db-9cd6-42aa-b6ed-88f83283ccb6
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES cfe4874d-b225-4c49-bf4d-77d8e62b2b03
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 3e8fa9c8-ffd7-4f6e-91ba-a3f134c3ea37
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES cefda76b-5ffd-466b-bf80-1c064fb8614d
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 2b61b299-394f-4912-8013-abb1d53684f9
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 1c42b56c-35ce-46c1-8001-ea0aab5384ee
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 4c9a26dd-8b76-48ce-848e-0f402d608014
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 60f39c7c-b86c-4069-86d8-13aa9fed3af0
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 338f932f-603e-4199-b234-2c321fdbd590
08:06 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 4927f691-86dd-4757-9f4c-457505587477
08:06 ERROR [databricks.labs.blueprint.parallel] crawl permissions(SecretScope(backend_type=<ScopeBackendType.DATABRICKS: 'DATABRICKS'>, keyvault_metadata=None, name='sdk-wvlo')) task failed: Scope sdk-wvlo does not exist!
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/secrets.py", line 37, in _crawler_task
    acl_items = self._ws.secrets.list_acls(scope.name)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/workspace.py", line 1995, in list_acls
    json = self._api.do('GET', '/api/2.0/secrets/acls/list', query=query, headers=headers)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 131, in do
    response = retryable(self._perform)(method,
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper
    raise err
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper
    return func(*args, **kwargs)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 242, in _perform
    raise self._make_nicer_error(response=response, **payload) from None
databricks.sdk.errors.platform.ResourceDoesNotExist: Scope sdk-wvlo does not exist!
08:06 WARNING [databricks.labs.blueprint.parallel] Some 'crawl permissions' tasks failed: 98% results available (2531/2585). Took 0:00:30.571627
08:06 ERROR [databricks.labs.ucx.workspace_access.manager] Error while crawling permissions: Scope sdk-wvlo does not exist!
08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures
08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 0002C56A7B71F154 [group_name admins CAN_USE] -> [group_name ucx_GDzO1 CAN_USE]
08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures
08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='0002C56A7B71F154')
08:06 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+3120240614080400 from https://DATABRICKS_HOST
08:06 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sz7l2
08:06 INFO [databricks.labs.ucx.install] Deleting jobs
08:06 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=773176348763764.
08:06 INFO [databricks.labs.ucx.install] Deleting failing job_id=31103329831653.
08:06 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=508839067358935.
08:06 INFO [databricks.labs.ucx.install] Deleting assessment job_id=239927949865801.
08:06 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=582368802202738.
08:06 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=254211059487645.
08:06 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=182210493756853.
08:06 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=227682210899899.
08:06 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=969911807903631.
08:06 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=213238479646047.
08:06 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=732248416324953.
08:06 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=59475762521105.
08:06 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=1054959154200087.
08:06 INFO [databricks.labs.ucx.install] Deleting cluster policy
08:06 INFO [databricks.labs.ucx.install] Deleting secret scope
08:06 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures
08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='4286384023111618', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures
08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx_GDzO1', entitlements=[], external_id=None, groups=[], id='297776123434351', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/4286384023111618', type=None, value='4286384023111618')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures
08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx_GDzO1', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='395057018244884', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/4286384023111618', type=None, value='4286384023111618')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures
08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sz7l2', metastore_id=None, name='ucx_sz7l2', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python

Running from acceptance #3939

@ericvergnaud ericvergnaud enabled auto-merge June 14, 2024 10:09
nfx
nfx approved these changes Jun 14, 2024
View reviewed changes
Copy link
Collaborator

@nfx nfx left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lgtm

@nfx nfx merged commit 7c3dab9 into main Jun 14, 2024
7 of 8 checks passed
@nfx nfx deleted the fix-issues-when-running-solacc branch June 14, 2024 14:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@nfx nfx nfx approved these changes

@dmoore247 dmoore247 Awaiting requested review from dmoore247

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@ericvergnaud @nfx