Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CLI command to mark table/schema for skipping in the table migration process. #680

Merged
merged 4 commits into from
Dec 19, 2023

Conversation

FastLee
Copy link
Contributor

@FastLee FastLee commented Dec 6, 2023

closes #672

Copy link

codecov bot commented Dec 6, 2023

Codecov Report

Attention: 14 lines in your changes are missing coverage. Please review.

Comparison is base (e1b7a27) 78.60% compared to head (562a669) 79.09%.
Report is 2 commits behind head on main.

Files Patch % Lines
src/databricks/labs/ucx/hive_metastore/mapping.py 56.52% 6 Missing and 4 partials ⚠️
src/databricks/labs/ucx/cli.py 78.94% 4 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #680      +/-   ##
==========================================
+ Coverage   78.60%   79.09%   +0.49%     
==========================================
  Files          41       41              
  Lines        4272     4310      +38     
  Branches      800      806       +6     
==========================================
+ Hits         3358     3409      +51     
+ Misses        711      696      -15     
- Partials      203      205       +2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@FastLee FastLee marked this pull request as ready for review December 6, 2023 22:12
@FastLee FastLee requested review from a team and dipankarkush-db December 6, 2023 22:12
Copy link
Contributor

@dmoore247 dmoore247 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Logging and testing issues.

src/databricks/labs/ucx/cli.py Show resolved Hide resolved
src/databricks/labs/ucx/cli.py Outdated Show resolved Hide resolved
src/databricks/labs/ucx/cli.py Outdated Show resolved Hide resolved
src/databricks/labs/ucx/cli.py Outdated Show resolved Hide resolved
src/databricks/labs/ucx/cli.py Outdated Show resolved Hide resolved
src/databricks/labs/ucx/cli.py Outdated Show resolved Hide resolved
src/databricks/labs/ucx/cli.py Outdated Show resolved Hide resolved
src/databricks/labs/ucx/cli.py Outdated Show resolved Hide resolved
Copy link
Contributor

@dmoore247 dmoore247 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's have a more scalable property naming convention using the dot notation.

src/databricks/labs/ucx/cli.py Show resolved Hide resolved
src/databricks/labs/ucx/hive_metastore/tables.py Outdated Show resolved Hide resolved
src/databricks/labs/ucx/hive_metastore/tables.py Outdated Show resolved Hide resolved
src/databricks/labs/ucx/hive_metastore/tables.py Outdated Show resolved Hide resolved
src/databricks/labs/ucx/cli.py Show resolved Hide resolved
src/databricks/labs/ucx/hive_metastore/tables.py Outdated Show resolved Hide resolved
tests/unit/hive_metastore/test_tables.py Outdated Show resolved Hide resolved
tests/unit/hive_metastore/test_tables.py Outdated Show resolved Hide resolved
tests/unit/hive_metastore/test_tables.py Outdated Show resolved Hide resolved
tests/unit/test_cli.py Show resolved Hide resolved
@FastLee FastLee force-pushed the feature/cli_table_skip_672 branch from cafa380 to ff3102d Compare December 15, 2023 18:39
@FastLee FastLee requested a review from nfx December 15, 2023 18:40
src/databricks/labs/ucx/cli.py Outdated Show resolved Hide resolved
src/databricks/labs/ucx/cli.py Outdated Show resolved Hide resolved
@FastLee FastLee requested a review from nfx December 19, 2023 13:45
@FastLee FastLee requested a review from nfx December 19, 2023 16:03
@nfx nfx merged commit 06a3539 into main Dec 19, 2023
4 of 6 checks passed
@nfx nfx deleted the feature/cli_table_skip_672 branch December 19, 2023 16:04
nfx added a commit that referenced this pull request Dec 21, 2023
* Added `databricks labs ucx create-table-mapping` and `databricks labs ucx manual-workspace-info` commands for CLI ([#682](#682)).
* Added `databricks labs ucx installations` command ([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to mark table/schema for skipping in the table migration process ([#680](#680)).
* Added `workspace_group_name` and `account_group_name` to `make_ucx_group` fixture ([#664](#664)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants ([#653](#653)).
* Added cluster override and handle case of write protected DBFS ([#610](#610)).
* Added cluster policy selector in the installer ([#655](#655)).
* Added detailed UCX pre-requisite information to README.md ([#689](#689)).
* Added filters to run only cloud specific task ([#681](#681)).
* Added interactive wizard for `databricks labs uninstall ucx` command ([#657](#657)).
* Added more granular error retry logic ([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up assessment workflow ([#691](#691)).
* Added retry on workspace listing ([#659](#659)).
* Added support for mapping workspace group to account group by prefix/suffix/regex/external id ([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as `crawl_tables` was failing when run on non-UC Workspace in No Isolation mode with unable to access the config file ([#661](#661)).
* Changed the fields of the table "Tables" to lower case ([#684](#684)).
* Cleanup README.md ([#695](#695)).
* Cleanup installer framework and speed up test execution ([#711](#711)).
* Decouple group configuration from `install.py` ([#714](#714)).
* Enabled integration tests for `EXTERNAL` table migrations ([#677](#677)).
* Enforced `mypy` validation ([#713](#713)).
* Filtering out inventory database from loading into tables and filtering out the same from grant detail view ([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and updated `CONTRIBUTING.md` guide ([#654](#654)).
* Fixed for secret scope apply task always raises ValueError ([#683](#683)).
* Fixed some flaky integration tests ([#700](#700)).
* More `mypy` chores ([#697](#697)).
* Moved `ExternalLocations` and `Mounts` to `locations` module ([#692](#692)).
* New CLI command for workspace mapping ([#678](#678)).
* No more `mypy` chores after this ([#699](#699)).
* Reduce server load for getting workspace groups and their members ([#666](#666)).
* Some `mypy` chores ([#696](#696)).
* Throwing ManyError on migrate-groups tasks ([#710](#710)).
* Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0 ([#651](#651)).
* Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0 ([#687](#687)).
* Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0 ([#712](#712)).
* Updated installation documentation to use Databricks CLI ([#686](#686)).
nfx added a commit that referenced this pull request Dec 21, 2023
* Added `databricks labs ucx create-table-mapping` and `databricks labs ucx manual-workspace-info` commands for CLI ([#682](#682)).
* Added `databricks labs ucx installations` command ([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to mark table/schema for skipping in the table migration process ([#680](#680)).
* Added `workspace_group_name` and `account_group_name` to `make_ucx_group` fixture ([#664](#664)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants ([#653](#653)).
* Added cluster override and handle case of write protected DBFS ([#610](#610)).
* Added cluster policy selector in the installer ([#655](#655)).
* Added detailed UCX pre-requisite information to README.md ([#689](#689)).
* Added filters to run only cloud specific task ([#681](#681)).
* Added interactive wizard for `databricks labs uninstall ucx` command ([#657](#657)).
* Added more granular error retry logic ([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up assessment workflow ([#691](#691)).
* Added retry on workspace listing ([#659](#659)).
* Added support for mapping workspace group to account group by prefix/suffix/regex/external id ([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as `crawl_tables` was failing when run on non-UC Workspace in No Isolation mode with unable to access the config file ([#661](#661)).
* Changed the fields of the table "Tables" to lower case ([#684](#684)).
* Cleanup README.md ([#695](#695)).
* Cleanup installer framework and speed up test execution ([#711](#711)).
* Decouple group configuration from `install.py` ([#714](#714)).
* Enabled integration tests for `EXTERNAL` table migrations ([#677](#677)).
* Enforced `mypy` validation ([#713](#713)).
* Filtering out inventory database from loading into tables and filtering out the same from grant detail view ([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and updated `CONTRIBUTING.md` guide ([#654](#654)).
* Fixed for secret scope apply task always raises ValueError ([#683](#683)).
* Fixed some flaky integration tests ([#700](#700)).
* More `mypy` chores ([#697](#697)).
* Moved `ExternalLocations` and `Mounts` to `locations` module ([#692](#692)).
* New CLI command for workspace mapping ([#678](#678)).
* No more `mypy` chores after this ([#699](#699)).
* Reduce server load for getting workspace groups and their members ([#666](#666)).
* Some `mypy` chores ([#696](#696)).
* Throwing ManyError on migrate-groups tasks ([#710](#710)).
* Updated installation documentation to use Databricks CLI ([#686](#686)).

Dependency updates:

 * Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0 ([#651](#651)).
 * Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0 ([#687](#687)).
 * Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0 ([#712](#712)).
nfx added a commit that referenced this pull request Dec 21, 2023
* Added `databricks labs ucx create-table-mapping` and `databricks labs ucx manual-workspace-info` commands for CLI ([#682](#682)).
* Added `databricks labs ucx installations` command ([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to mark table/schema for skipping in the table migration process ([#680](#680)).
* Added `workspace_group_name` and `account_group_name` to `make_ucx_group` fixture ([#664](#664)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants ([#653](#653)).
* Added cluster override and handle case of write protected DBFS ([#610](#610)).
* Added cluster policy selector in the installer ([#655](#655)).
* Added detailed UCX pre-requisite information to README.md ([#689](#689)).
* Added filters to run only cloud specific task ([#681](#681)).
* Added interactive wizard for `databricks labs uninstall ucx` command ([#657](#657)).
* Added more granular error retry logic ([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up assessment workflow ([#691](#691)).
* Added retry on workspace listing ([#659](#659)).
* Added support for mapping workspace group to account group by prefix/suffix/regex/external id ([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as `crawl_tables` was failing when run on non-UC Workspace in No Isolation mode with unable to access the config file ([#661](#661)).
* Changed the fields of the table "Tables" to lower case ([#684](#684)).
* Cleanup README.md ([#695](#695)).
* Cleanup installer framework and speed up test execution ([#711](#711)).
* Decouple group configuration from `install.py` ([#714](#714)).
* Enabled integration tests for `EXTERNAL` table migrations ([#677](#677)).
* Enforced `mypy` validation ([#713](#713)).
* Filtering out inventory database from loading into tables and filtering out the same from grant detail view ([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and updated `CONTRIBUTING.md` guide ([#654](#654)).
* Fixed for secret scope apply task always raises ValueError ([#683](#683)).
* Fixed some flaky integration tests ([#700](#700)).
* More `mypy` chores ([#697](#697)).
* Moved `ExternalLocations` and `Mounts` to `locations` module ([#692](#692)).
* New CLI command for workspace mapping ([#678](#678)).
* No more `mypy` chores after this ([#699](#699)).
* Reduce server load for getting workspace groups and their members ([#666](#666)).
* Some `mypy` chores ([#696](#696)).
* Throwing ManyError on migrate-groups tasks ([#710](#710)).
* Updated installation documentation to use Databricks CLI ([#686](#686)).

Dependency updates:

 * Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0 ([#651](#651)).
 * Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0 ([#687](#687)).
 * Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0 ([#712](#712)).
nfx added a commit that referenced this pull request Dec 21, 2023
* Added `databricks labs ucx create-table-mapping` and `databricks labs ucx manual-workspace-info` commands for CLI ([#682](#682)).
* Added `databricks labs ucx installations` command ([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to mark table/schema for skipping in the table migration process ([#680](#680)).
* Added `workspace_group_name` and `account_group_name` to `make_ucx_group` fixture ([#664](#664)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants ([#653](#653)).
* Added cluster override and handle case of write protected DBFS ([#610](#610)).
* Added cluster policy selector in the installer ([#655](#655)).
* Added detailed UCX pre-requisite information to README.md ([#689](#689)).
* Added filters to run only cloud specific task ([#681](#681)).
* Added interactive wizard for `databricks labs uninstall ucx` command ([#657](#657)).
* Added more granular error retry logic ([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up assessment workflow ([#691](#691)).
* Added retry on workspace listing ([#659](#659)).
* Added support for mapping workspace group to account group by prefix/suffix/regex/external id ([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as `crawl_tables` was failing when run on non-UC Workspace in No Isolation mode with unable to access the config file ([#661](#661)).
* Changed the fields of the table "Tables" to lower case ([#684](#684)).
* Cleanup README.md ([#695](#695)).
* Cleanup installer framework and speed up test execution ([#711](#711)).
* Decouple group configuration from `install.py` ([#714](#714)).
* Enabled integration tests for `EXTERNAL` table migrations ([#677](#677)).
* Enforced `mypy` validation ([#713](#713)).
* Filtering out inventory database from loading into tables and filtering out the same from grant detail view ([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and updated `CONTRIBUTING.md` guide ([#654](#654)).
* Fixed for secret scope apply task always raises ValueError ([#683](#683)).
* Fixed some flaky integration tests ([#700](#700)).
* More `mypy` chores ([#697](#697)).
* Moved `ExternalLocations` and `Mounts` to `locations` module ([#692](#692)).
* New CLI command for workspace mapping ([#678](#678)).
* No more `mypy` chores after this ([#699](#699)).
* Reduce server load for getting workspace groups and their members ([#666](#666)).
* Some `mypy` chores ([#696](#696)).
* Throwing ManyError on migrate-groups tasks ([#710](#710)).
* Updated installation documentation to use Databricks CLI ([#686](#686)).

Dependency updates:

 * Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0 ([#651](#651)).
 * Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0 ([#687](#687)).
 * Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0 ([#712](#712)).
@nfx nfx mentioned this pull request Dec 21, 2023
nfx added a commit that referenced this pull request Dec 21, 2023
* Added `databricks labs ucx create-table-mapping` and `databricks labs ucx manual-workspace-info` commands for CLI ([#682](#682)).
* Added `databricks labs ucx installations` command ([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to mark table/schema for skipping in the table migration process ([#680](#680)).
* Added `databricks labs ucx validate-external-locations` command for cli ([#715](#715)).
* Added `workspace_group_name` and `account_group_name` to `make_ucx_group` fixture ([#664](#664)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants ([#653](#653)).
* Added cluster override and handle case of write protected DBFS ([#610](#610)).
* Added cluster policy selector in the installer ([#655](#655)).
* Added detailed UCX pre-requisite information to README.md ([#689](#689)).
* Added filters to run only cloud specific task ([#681](#681)).
* Added interactive wizard for `databricks labs uninstall ucx` command ([#657](#657)).
* Added more granular error retry logic ([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up assessment workflow ([#691](#691)).
* Added retry on workspace listing ([#659](#659)).
* Added support for mapping workspace group to account group by prefix/suffix/regex/external id ([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as `crawl_tables` was failing when run on non-UC Workspace in No Isolation mode with unable to access the config file ([#661](#661)).
* Changed the fields of the table "Tables" to lower case ([#684](#684)).
* Cleanup README.md ([#695](#695)).
* Cleanup installer framework and speed up test execution ([#711](#711)).
* Decouple group configuration from `install.py` ([#714](#714)).
* Enabled integration tests for `EXTERNAL` table migrations ([#677](#677)).
* Enforced `mypy` validation ([#713](#713)).
* Filtering out inventory database from loading into tables and filtering out the same from grant detail view ([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and updated `CONTRIBUTING.md` guide ([#654](#654)).
* Fixed for secret scope apply task always raises ValueError ([#683](#683)).
* Fixed some flaky integration tests ([#700](#700)).
* More `mypy` chores ([#697](#697)).
* Moved `ExternalLocations` and `Mounts` to `locations` module ([#692](#692)).
* New CLI command for workspace mapping ([#678](#678)).
* No more `mypy` chores after this ([#699](#699)).
* Reduce server load for getting workspace groups and their members ([#666](#666)).
* Some `mypy` chores ([#696](#696)).
* Throwing ManyError on migrate-groups tasks ([#710](#710)).
* Updated installation documentation to use Databricks CLI ([#686](#686)).

Dependency updates:

 * Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0 ([#651](#651)).
 * Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0 ([#687](#687)).
 * Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0 ([#712](#712)).
@nfx nfx mentioned this pull request Dec 21, 2023
nfx added a commit that referenced this pull request Dec 21, 2023
* Added `databricks labs ucx create-table-mapping` and `databricks labs ucx manual-workspace-info` commands for CLI ([#682](#682)).
* Added `databricks labs ucx ensure-assessment-run` to CLI commands ([#708](#708)).
* Added `databricks labs ucx installations` command ([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to mark table/schema for skipping in the table migration process ([#680](#680)).
* Added `databricks labs ucx validate-external-locations` command for cli ([#715](#715)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants ([#653](#653)).
* Added cluster override and handle case of write protected DBFS ([#610](#610)).
* Added cluster policy selector in the installer ([#655](#655)).
* Added detailed UCX pre-requisite information to README.md ([#689](#689)).
* Added interactive wizard for `databricks labs uninstall ucx` command ([#657](#657)).
* Added more granular error retry logic ([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up assessment workflow ([#691](#691)).
* Added retry on workspace listing ([#659](#659)).
* Added support for mapping workspace group to account group by prefix/suffix/regex/external id ([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as `crawl_tables` was failing when run on non-UC Workspace in No Isolation mode with unable to access the config file ([#661](#661)).
* Changed the fields of the table "Tables" to lower case ([#684](#684)).
* Enabled integration tests for `EXTERNAL` table migrations ([#677](#677)).
* Enforced `mypy` validation ([#713](#713)).
* Filtering out inventory database from loading into tables and filtering out the same from grant detail view ([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and updated `CONTRIBUTING.md` guide ([#654](#654)).
* Fixed secret scope apply task to raise ValueError ([#683](#683)).
* Fixed legacy table ACL ownership migration and other integration testing issues ([#722](#722)).
* Fixed some flaky integration tests ([#700](#700)).
* New CLI command for workspace mapping ([#678](#678)).
* Reduce server load for getting workspace groups and their members ([#666](#666)).
* Throwing ManyError on migrate-groups tasks ([#710](#710)).
* Updated installation documentation to use Databricks CLI ([#686](#686)).

Dependency updates:

 * Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0 ([#651](#651)).
 * Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0 ([#687](#687)).
 * Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0 ([#712](#712)).
@nfx nfx mentioned this pull request Dec 21, 2023
nfx added a commit that referenced this pull request Dec 21, 2023
* Added `databricks labs ucx create-table-mapping` and `databricks labs
ucx manual-workspace-info` commands for CLI
([#682](#682)).
* Added `databricks labs ucx ensure-assessment-run` to CLI commands
([#708](#708)).
* Added `databricks labs ucx installations` command
([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to
mark table/schema for skipping in the table migration process
([#680](#680)).
* Added `databricks labs ucx validate-external-locations` command for
cli ([#715](#715)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants
([#653](#653)).
* Added cluster override and handle case of write protected DBFS
([#610](#610)).
* Added cluster policy selector in the installer
([#655](#655)).
* Added detailed UCX pre-requisite information to README.md
([#689](#689)).
* Added interactive wizard for `databricks labs uninstall ucx` command
([#657](#657)).
* Added more granular error retry logic
([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up
assessment workflow
([#691](#691)).
* Added retry on workspace listing
([#659](#659)).
* Added support for mapping workspace group to account group by
prefix/suffix/regex/external id
([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as
`crawl_tables` was failing when run on non-UC Workspace in No Isolation
mode with unable to access the config file
([#661](#661)).
* Changed the fields of the table "Tables" to lower case
([#684](#684)).
* Enabled integration tests for `EXTERNAL` table migrations
([#677](#677)).
* Enforced `mypy` validation
([#713](#713)).
* Filtering out inventory database from loading into tables and
filtering out the same from grant detail view
([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and
updated `CONTRIBUTING.md` guide
([#654](#654)).
* Fixed secret scope apply task to raise ValueError
([#683](#683)).
* Fixed legacy table ACL ownership migration and other integration
testing issues ([#722](#722)).
* Fixed some flaky integration tests
([#700](#700)).
* New CLI command for workspace mapping
([#678](#678)).
* Reduce server load for getting workspace groups and their members
([#666](#666)).
* Throwing ManyError on migrate-groups tasks
([#710](#710)).
* Updated installation documentation to use Databricks CLI
([#686](#686)).

Dependency updates:

* Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0
([#651](#651)).
* Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0
([#687](#687)).
* Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0
([#712](#712)).
FastLee pushed a commit that referenced this pull request Jan 19, 2024
* Added `databricks labs ucx create-table-mapping` and `databricks labs
ucx manual-workspace-info` commands for CLI
([#682](#682)).
* Added `databricks labs ucx ensure-assessment-run` to CLI commands
([#708](#708)).
* Added `databricks labs ucx installations` command
([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to
mark table/schema for skipping in the table migration process
([#680](#680)).
* Added `databricks labs ucx validate-external-locations` command for
cli ([#715](#715)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants
([#653](#653)).
* Added cluster override and handle case of write protected DBFS
([#610](#610)).
* Added cluster policy selector in the installer
([#655](#655)).
* Added detailed UCX pre-requisite information to README.md
([#689](#689)).
* Added interactive wizard for `databricks labs uninstall ucx` command
([#657](#657)).
* Added more granular error retry logic
([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up
assessment workflow
([#691](#691)).
* Added retry on workspace listing
([#659](#659)).
* Added support for mapping workspace group to account group by
prefix/suffix/regex/external id
([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as
`crawl_tables` was failing when run on non-UC Workspace in No Isolation
mode with unable to access the config file
([#661](#661)).
* Changed the fields of the table "Tables" to lower case
([#684](#684)).
* Enabled integration tests for `EXTERNAL` table migrations
([#677](#677)).
* Enforced `mypy` validation
([#713](#713)).
* Filtering out inventory database from loading into tables and
filtering out the same from grant detail view
([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and
updated `CONTRIBUTING.md` guide
([#654](#654)).
* Fixed secret scope apply task to raise ValueError
([#683](#683)).
* Fixed legacy table ACL ownership migration and other integration
testing issues ([#722](#722)).
* Fixed some flaky integration tests
([#700](#700)).
* New CLI command for workspace mapping
([#678](#678)).
* Reduce server load for getting workspace groups and their members
([#666](#666)).
* Throwing ManyError on migrate-groups tasks
([#710](#710)).
* Updated installation documentation to use Databricks CLI
([#686](#686)).

Dependency updates:

* Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0
([#651](#651)).
* Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0
([#687](#687)).
* Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0
([#712](#712)).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add databricks labs ucx skip --schema ... --table ... command
3 participants