Skip to content

Conversation

wendigo
Copy link
Contributor

@wendigo wendigo commented Jan 24, 2025

This brings updated timezonedb to version 2024b
(openjdk/jdk23u@73b2341) which amends historical timezone definitions for Mexico/Bahia_Banderas that we use for testing timezone gap around the unix timestamp epoch.

Corresponding Joda time update also has these timezone definitions updated. PostgreSQL test server was upgraded to 12 to correctly handle
UTC around epoch. MySQL was updated to 8.0.41 due to the same reason.

Description

Additional context and related issues

Release notes

( ) This is not user-visible or is docs only, and no release notes are required.
( ) Release notes are required. Please propose a release note for me.
( ) Release notes are required, with the following suggested text:

## Section
* Fix some things. ({issue}`issuenumber`)

@cla-bot cla-bot bot added the cla-signed label Jan 24, 2025
@wendigo wendigo force-pushed the serafin/23.0.2 branch 2 times, most recently from ae171c6 to e4828b0 Compare January 24, 2025 09:01
@github-actions github-actions bot added the jdbc Relates to Trino JDBC driver label Jan 24, 2025
@github-actions github-actions bot added the delta-lake Delta Lake connector label Jan 24, 2025
@wendigo wendigo force-pushed the serafin/23.0.2 branch 8 times, most recently from 7c28499 to 03593e8 Compare January 24, 2025 14:59
@wendigo wendigo requested a review from martint January 24, 2025 14:59
@wendigo
Copy link
Contributor Author

wendigo commented Jan 24, 2025

Alternative approach to #24786

@wendigo
Copy link
Contributor Author

wendigo commented Jan 24, 2025

Remaining failures are snowflake related. Some test cases were removed, one test was disabled (delta lake), maybe it's no longer needed. Cc @ebyhr

@wendigo
Copy link
Contributor Author

wendigo commented Jan 26, 2025

Waiting for PPC64LE release: adoptium/temurin#67

This brings updated timezonedb to version 2024b
(openjdk/jdk23u@73b2341)
which amends historical timezone definitions for Mexico/Bahia_Banderas
that we use for testing timezone gap around the unix timestamp epoch.

Corresponding Joda time update also has these timezone definitions
updated. PostgreSQL test server was upgraded to 12 to correctly handle
UTC around epoch. MySQL was updated to 8.0.41 due to the same reason.

Temporary downgrade JDK for ppc64 to make CI happy
@wendigo wendigo merged commit 1350a8b into master Jan 27, 2025
103 checks passed
@wendigo wendigo deleted the serafin/23.0.2 branch January 27, 2025 14:59
@github-actions github-actions bot added this to the 469 milestone Jan 27, 2025
}

@Test
@Disabled("This test assumes specific tzdb version and it will fail on mismatch between Spark and Trino tzdb versions")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

isn't this a user-facing issue then?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What if we update the JDK used to run Spark to the latest patch release for that version?

@Test
public void testUnsupportedTimestampWithTimeZoneValues()
{
// The range for TIMESTAMP values is '1970-01-01 00:00:01.000000' to '2038-01-19 03:14:07.499999'
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the comment is still correct, restoring this.

- offset change since 1970 (offset Jan 1970: -08:00, offset Jan 2018: -06:00)
- DST (e.g. at 2017-04-02 02:00:00 clocks turned forward 1 hour; 2017-10-29 02:00:00 clocks turned backward 1 hour)
- has forward offset change on first day of epoch (1970-01-01 00:00:00 clocks turned forward 1 hour)
- had forward change at midnight (1970-01-01 00:00:00 clocks turned forward 1 hour)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That was the reason to use America/Bahia_Banderas in tests. We should switch to a different zone.
This one became nothing special.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is no timezone like that anymore in the amended tzdb

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fair. But again there is no reason to use Bahia anymore. It's a left over now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla-signed delta-lake Delta Lake connector jdbc Relates to Trino JDBC driver

Development

Successfully merging this pull request may close these issues.

4 participants