Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/master thesis schema evolution in polystores #429

Open
wants to merge 30 commits into
base: master
Choose a base branch
from

Conversation

sulea
Copy link
Contributor

@sulea sulea commented Dec 20, 2022

Summary

MergeColumns: Allows merging multiple columns of a table in a relational namespace of Polypheny. As a test, the MergeColumns operation was performed in a vertically partitioned schema, where the one merging column in a document based store while the other is placed in a relational store.
TransferTable: This operation allows tables to be moved from one relational namespace to another relational or to a document-based namespace, and also allows a collection to be moved to either type of namespace. Here the challenge and the scope is also increasing. Moving a table or collection (depending on the type of schema) to another namespace of the same data model, through a simple but elegant solution, does not require migration, just changing the metadata of the Polypheny-DB’s catalog. The second approach, where a table from a relational namespace is about to be moved to a document-based namespace, requires both schema evolution and data migration, explains the differences in data storage depending on the global namespace, but is only shown for the simple case where the table being moved is not included related to other tables. The third approach, moving a collection to a relational namespace, also considers embedded/nested documents from which multiple tables related to each other are then created.

Changes

  • Endpoints for MergeColumns and TransferTable
  • New PolySql-Statements: MERGE COLUMNS INTO and TRANSFER TABLE SET PRIMARY KEYS
  • DdlManager: Methods for MergeColumns and TransferTable
  • Catalog: Transfer an object from a namespace to another namespace of the same data model
  • DataMigrator: Data migration after merge columns. Data migrations after transfer from relational to document-stored namespace and vice-versa

Features

  • MergeColumns
  • TransferTable

Attila Süle and others added 30 commits September 16, 2022 21:23
# Conflicts:
#	dbms/src/main/java/org/polypheny/db/processing/DataMigratorImpl.java
#	sql-language/src/main/codegen/config.fmpp
#	sql-language/src/main/java/org/polypheny/db/sql/language/ddl/altertable/SqlAlterTableMergeColumns.java
…lution-in-polystores' into feature/transfer-table-old-concept

# Conflicts:
#	dbms/src/main/java/org/polypheny/db/processing/DataMigratorImpl.java
#	webui/src/main/java/org/polypheny/db/webui/Crud.java
@sulea sulea marked this pull request as ready for review December 29, 2022 07:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant