Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Timestamp instant support #13

Closed
Jefffrey opened this issue Nov 3, 2023 · 4 comments
Closed

Timestamp instant support #13

Jefffrey opened this issue Nov 3, 2023 · 4 comments
Assignees
@Jefffrey

Comments

@Jefffrey
Copy link
Collaborator

Jefffrey commented Nov 3, 2023

See Timestamp with local time zone here https://orc.apache.org/docs/types.html
@waynexia waynexia mentioned this issue Oct 30, 2024
Open
16 tasks
@Jefffrey Jefffrey self-assigned this Mar 23, 2024
@Jefffrey
Copy link
Collaborator Author

Writer timezone seems encoded at stripe level, which is problematic if that suggests timezone for a column can vary between stripes since Arrow encodes the timezone in the datatype so would need to be consistent for all data. Need to investigate this more

@Jefffrey
Copy link
Collaborator Author

It seems I misunderstood. According to:

The writer timezone in the stripe is used for regular Timestamp, as Timestamp instants are in UTC timezone.

@Jefffrey
Copy link
Collaborator Author

Separate note: encoding as Timestamp(Nanoseconds) severely limits the range representable in Arrow, need to keep this in mind

@Jefffrey
Copy link
Collaborator Author

Added by 1888015

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Jefffrey Jefffrey

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Jefffrey