Skip to content

Releases: GoogleCloudDataproc/hadoop-connectors

2.1.9

16 Nov 02:04
Compare
Choose a tag to compare
  1. Set socket read timeout (fs.gs.http.read-timeout) as early as possible on
    new sockets returned from the custom SSLSocketFactory. This guarantees the
    timeout is enforced during TLS handshakes when using Conscrypt as the
    security provider.
  2. The Google Cloud Storage Connector now can be used as a
    Hadoop Credential Provider.

2.2.9

09 Nov 13:30
18f6e9f
Compare
Choose a tag to compare
  1. The Google Cloud Storage Connector now can be used as a
    Hadoop Credential Provider.

2022-09-15 (GCS 2.2.8)

15 Sep 23:44
e51b0f8
Compare
Choose a tag to compare

What's Changed

2.2.8 - 2022-09-12

  1. Set socket read timeout (fs.gs.http.read-timeout) as early as possible on
    new sockets returned from the custom SSLSocketFactory. This guarantees the
    timeout is enforced during TLS handshakes when using Conscrypt as the
    security provider.

  2. Add trace logging for JSON and gRPC requests, toggled with option:

    fs.gs.tracelog.enable (default : false)
    
  3. Fixing seek back to same position with grpc channel.

  4. Grpc read optimization to not prematurely close existing requests.

  5. Retry request on 408/timeout response from server.

  6. Upgrade Google auth dependency to 1.7.0.

  7. Increasing gRPC read timeout from 30 seconds to 3600 seconds.

  8. Set default value for fs.gs.list.max.items.per.call property to 5000.

  9. Adding support for invocationId in Json path.

Full Changelog: v2.2.7...v2.2.8

2022-06-01 (GCS 2.2.7)

06 Jun 09:57
8453ce7
Compare
Choose a tag to compare

What's Changed

  1. Fix: Prevent clobbering of SSL trustCertificates

  2. Lazy footer prefetch optimizations

  3. Make writes via GCS gRPC API resilient

Full Changelog: v2.2.6...v2.2.7

2022-05-31 (GCS 2.1.8)

31 May 06:31
d55fdd2
Compare
Choose a tag to compare

Changelog

  1. Prevent clobbering of SSL trustCertificates

2022-04-14 (GCS 2.2.6)

15 Apr 23:05
619c8bd
Compare
Choose a tag to compare
  1. Improve trace logging for gRPC channels.

  2. Traffic Director is enabled by default.

2022-02-09 (GCS 2.2.5)

09 Feb 07:14
Compare
Choose a tag to compare
  1. [grpc] Refactor footer caching logic

  2. Enable TCP keep alive by default.

  3. Upgrade gRPC to 1.43

  4. Add message level timeouts for gRPC requests

  5. Added Traffic Director support

2022-02-07 (GCS 2.1.7)

07 Feb 16:21
6c38292
Compare
Choose a tag to compare

Changlelog

Cloud Storage connector:

  1. Enable TCP keep alive socket option by default.

2021-11-16 (GCS 2.2.4)

16 Nov 17:55
Compare
Choose a tag to compare
  1. Support GCS fine-grained action in AuthorizationHandlers.

  2. Upgrade Google Auth library to support ExternalAccount.

  3. Decrease log-level for hflush rate-limit warning log message.

  4. Update google dependencies to LTS versions

2021-10-19 (GCS 2.2.3)

19 Oct 14:34
33fe5c8
Compare
Choose a tag to compare
  1. Update all dependencies to latest versions.

  2. Add support for downscoped tokens in AccessTokenProvider.

  3. Restore compatibility with pre-2.8 Hadoop versions.

  4. Migrate gRPC channels to GCS v2 APIs.

  5. Add zero-copy deserializer for gRPC reads, toggled with option:

    fs.gs.grpc.read.zerocopy.enable (default : true)