Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG]: wasbs:// and dbfs:// mount external tables are not listing in principal-prefix-access command #1552

Closed
1 task done
heydil opened this issue Apr 25, 2024 · 1 comment · Fixed by #2212
Closed
1 task done
Assignees
Labels
cloud/azure issues related to Azure step/assessment go/uc/upgrade - Assessment Step

Comments

@heydil
Copy link

heydil commented Apr 25, 2024

Is there an existing issue for this?

  • I have searched the existing issues

Current Behavior

Currently, external tables mounted using the wasbs:// and dbfs:// are not being listed when using the principal-prefix-access command, azure_storage_account_info.csv file is not getting generated.

Expected Behavior

External tables mounted using the wasbs:// and dbfs:// protocol should be listed when using the principal-prefix-access command and successful creation of azure_storage_account_info.csv file.

Steps To Reproduce

  1. I have external table , mount point and external locations listed in the inventory database after the assessment run.
    Screenshot 2024-04-25 112727
    Screenshot 2024-04-25 112913

  2. When running the principal-prefix-access command, receive the below warning message:
    Screenshot 2024-04-25 114100

Cloud

Azure

Operating System

Windows

Version

latest via Databricks CLI

Relevant log output

WARN [d.l.u.assessment.crawlers] There are no external table present with azure storage account. Please check if assessment job is run
@heydil heydil changed the title [BUG]: wasbs:// and dbfs mount external tables are not listing in principal-prefix-access command [BUG]: wasbs:// and dbfs:// mount external tables are not listing in principal-prefix-access command Apr 25, 2024
@nkvuong nkvuong added step/assessment go/uc/upgrade - Assessment Step cloud/azure issues related to Azure and removed needs-triage labels Apr 30, 2024
@nkvuong nkvuong self-assigned this Apr 30, 2024
@HariGS-DB
Copy link
Contributor

principal-prefix-access cmd creates a list of storage account used by tables along with its permission. This list is then used to create storage credentials. for table referring to wasb:// and adl:// , we shouldn't be creating its service principal as credential. The ideal solution would be to migrate the data from wasb:// ad adl:// to abfss storage and use its storage credential and location.
refer #1065 for more details.
we should update the documentation to make this clear

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cloud/azure issues related to Azure step/assessment go/uc/upgrade - Assessment Step
Projects
None yet
3 participants