Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE]: Enable Liquid Clustering for tables migrated #3417

Open
1 task done
artsheiko opened this issue Dec 9, 2024 · 0 comments
Open
1 task done

[FEATURE]: Enable Liquid Clustering for tables migrated #3417

artsheiko opened this issue Dec 9, 2024 · 0 comments
Labels
enhancement New feature or request needs-triage

Comments

@artsheiko
Copy link

artsheiko commented Dec 9, 2024

Is there an existing issue for this?

  • I have searched the existing issues

Problem statement

UC enablement requires recreating tables for managed ones. It could be great to allow LC enablement for all / selected tables.

Proposed Solution

Once CLUSTER BY AUTO is shipped, we could mark tables in mapping.csv as to-be-activated-for-LC by default. Using the file, teams could decide whether to enable LC or do nothing (meaning they plan to continue to leverage their existing maintenance operations).

As an extension, we could allow the manual inclusion of a list of columns to be used as keys for LC for one or another table.

Finally, we could identify what is used for ZORDER, re-use the same columns in LC (if any), or invite to overwrite a list with new ones, or just set AUTO.

Additional Context

It seems at first ANALYZE will become available for PO (blog). As of 2024-12-09, the feature is in Gated Public Preview.
Next, Liquid will allow for a dynamic selection of clustering keys (CLUSTER BY AUTO), based on the Q4 roadmap, Public Preview should become available by ~January.

  • Once available, Choose clustering keys section from the documentation will be relevant when the customer knows what exactly should be used as keys, but I believe auto-selection will become more and more useful option.
  • Given Predictive Optimisation supports LC, CLUSTER BY AUTO for migrated tables could allow for a better UX compared to ZORDER from the day 0.
@artsheiko artsheiko added enhancement New feature or request needs-triage labels Dec 9, 2024
@github-project-automation github-project-automation bot moved this to Todo in UCX Dec 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request needs-triage
Projects
Status: Todo
Development

No branches or pull requests

1 participant