Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(E6data): initial implemantation for E6data SQL Analytics platform #9517

Open
wants to merge 19 commits into
base: main
Choose a base branch
from
Open

feat(E6data): initial implemantation for E6data SQL Analytics platform #9517

wants to merge 19 commits into from

Commits on Jun 11, 2024

  1. Adding the compiler, and Backend implementation for E6data.

    @hackintoshrao
    hackintoshrao committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    7b98b77 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2024

  1. Add e6data_python_connector import and update do_connect method

    @hackintoshrao
    hackintoshrao committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    13a196c View commit details
    Browse the repository at this point in the history

  2. Add e6data-python-connector dependency

    @hackintoshrao
    hackintoshrao committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    2f142b0 View commit details
    Browse the repository at this point in the history

  3. Update Backend name and add _from_url method

    @hackintoshrao
    hackintoshrao committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    876820b View commit details
    Browse the repository at this point in the history

  4. Remove unnecessary transaction rollback in Backend class for E6data s… 

    …ince it doesn't support transactions.
    @hackintoshrao
    hackintoshrao committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    ccec1e0 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. Refactor database listing and query execution

    @hackintoshrao
    hackintoshrao committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    6b762f4 View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2024

  1. Adapt E6Data backend for Ibis integration 

    - Add support for catalog, secure connection, auto-resume, and cluster UUID
- Implement custom table() method to handle catalog and database hierarchy
- Modify get_schema() to use E6Data-specific column information
- Adjust execute() method for E6Data compatibility
- Update _fetch_from_cursor() to handle E6Data result format
    @hackintoshrao
    hackintoshrao committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    623c006 View commit details
    Browse the repository at this point in the history

  2. Add E6data dialect to SQL generator 

    - Customize Tokenizer to use double quotes for identifiers
- Modify Generator to map VARCHAR, CHAR, and TEXT to STRING
- Add custom TRANSFORMS for concat and length functions
    @hackintoshrao
    hackintoshrao committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    942277e View commit details
    Browse the repository at this point in the history

  3. Adding E6Datatype class.

    @hackintoshrao
    hackintoshrao committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    2332c5b View commit details
    Browse the repository at this point in the history

  4. Update E6DataCompiler to use E6data dialect and E6DataType 

    - Add E6data dialect
- Use E6DataType for type mapping
- Retain existing rewrites including custom limit rewrite
- Keep other compiler configurations unchanged
    @hackintoshrao
    hackintoshrao committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    6436b16 View commit details
    Browse the repository at this point in the history

  5. remove debug print statements.

    @hackintoshrao
    hackintoshrao committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    76aa687 View commit details
    Browse the repository at this point in the history

  6. Merge conflict fix.

    @hackintoshrao
    hackintoshrao committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    729e1e9 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2024

  1. Update e6data-python-connector version in pyproject.toml

    @hackintoshrao
    hackintoshrao committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    c4c2644 View commit details
    Browse the repository at this point in the history

  2. Remove empty line in class definition

    @hackintoshrao
    hackintoshrao committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    1ba682e View commit details
    Browse the repository at this point in the history

  3. Removing the tests till they are implemented correctly.

    @hackintoshrao
    hackintoshrao committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    daef522 View commit details
    Browse the repository at this point in the history

  4. Refactor E6data backend to inherit from MySQLBackend 

    - Change Backend class to inherit from MySQLBackend instead of SQLBackend
- Remove unnecessary imports and methods duplicated in MySQLBackend
- Update connection handling to use E6data_python_connector
- Modify schema and table retrieval methods for E6data compatibility
- Replace MySQLPandasData with E6DataPandasData for data conversion
- Clean up and streamline code, removing print statements and unused methods
    @hackintoshrao
    hackintoshrao committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    2361d7e View commit details
    Browse the repository at this point in the history

  5. Inherting compiler operations from MySQL.

    @hackintoshrao
    hackintoshrao committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    7ce06cf View commit details
    Browse the repository at this point in the history

  6. Creating a placeholder E6data data converter.

    @hackintoshrao
    hackintoshrao committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    20f875f View commit details
    Browse the repository at this point in the history

  7. Remove pymysql from e6data dependencies

    @hackintoshrao
    hackintoshrao committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    c8520f8 View commit details
    Browse the repository at this point in the history