-
Notifications
You must be signed in to change notification settings - Fork 2.5k
HUDI-162 : File System view must be built with correct timeline actions #775
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There is already a getCommitsAndCompactionTimeline in HoodieActiveTimeline, do we need this ?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I need similar method in HoodieTimeline interface. I have renamed the method to getCommitsAndCompactionTimeline so that they will be overridden by HoodieDefaultTimeline and HoodieActiveTImeline.
hoodie-common/src/main/java/com/uber/hoodie/common/table/view/AbstractTableFileSystemView.java
Outdated
Show resolved
Hide resolved
n3nash
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
left some comments
vinothchandar
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
https://issues.apache.org/jira/browse/HUDI-162 Can you add more context around the issue here
hoodie-common/src/main/java/com/uber/hoodie/common/table/view/AbstractTableFileSystemView.java
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
is this needed? seems redundant with getTimeline()?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is needed to distinguish active timeline from commitsAndCompactionTimeline
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1
hoodie-common/src/main/java/com/uber/hoodie/common/table/view/AbstractTableFileSystemView.java
Outdated
Show resolved
Hide resolved
|
@n3nash @vinothchandar : Addressed/Replied-to review comments. Unit tests and automated hoodie-demo (manually triggered) ran fine. As discussed earlier, will go ahead merging this change. @cdmikechen : I addressed the exception " java.lang.IllegalArgumentException: Can not create a Path from an empty string" as part of this PR. The pattern was found in few other places and I felt it is best handled together. |
…able recreation (apache#775) Co-authored-by: Vamsi <[email protected]> Co-authored-by: Vamsi <[email protected]>
No description provided.