Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Improve][Connector-V2] Improve the paimon source #6887

Merged
merged 9 commits into from
Jun 11, 2024

Conversation

dailai
Copy link
Contributor

@dailai dailai commented May 23, 2024

Purpose of this pull request

  1. Support filter read for paimon Source. Link [Paimon]support projection for paimon source #6343, We can also use the sql of this feature to realize the column projection feature later.
  2. Support factory for paimon source. Link [Feature][Connector-V2] Support TableSourceFactory on Paimon #6695.
  3. Support hadoop ha for paimon source
  4. Support hivecatalog for paimon source
  5. Support read timestamp(n) for paimon source

Does this PR introduce any user-facing change?

How was this patch tested?

Check list

@dailai
Copy link
Contributor Author

dailai commented May 23, 2024

Read from hdfs with hadoop ha:

截屏2024-05-22 13 59 36

@zhilinli123
Copy link
Contributor

Modify the paimon document to refer to the mysql.md format

@dailai dailai force-pushed the support-query-for-paimon-source branch from f717d6b to a5740ca Compare May 23, 2024 08:59
@dailai
Copy link
Contributor Author

dailai commented May 23, 2024

Modify the paimon document to refer to the mysql.md format

Ok

@dailai dailai force-pushed the support-query-for-paimon-source branch from a5740ca to 4f07591 Compare May 24, 2024 08:35
@Carl-Zhou-CN
Copy link
Member

link #6343

@dailai dailai force-pushed the support-query-for-paimon-source branch from 7fa0cc3 to b03a7e4 Compare June 6, 2024 06:12
Copy link
Member

@Carl-Zhou-CN Carl-Zhou-CN left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Member

@Hisoka-X Hisoka-X left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @dailai !

@Hisoka-X
Copy link
Member

Hisoka-X commented Jun 7, 2024

Could you take a look? @zhilinli123

@hailin0 hailin0 merged commit 658643a into apache:dev Jun 11, 2024
8 checks passed
@dailai dailai deleted the support-query-for-paimon-source branch June 13, 2024 08:10
chaorongzhi pushed a commit to chaorongzhi/seatunnel that referenced this pull request Aug 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants