2.0.1-incubating

This release fixes issues reported for 2.0.0-rc1-incubating.

• #1893 - Fixed issues with Python packages on PyPI
• #1797 - Proxy doesn't strip the request
  URL for admin requests correctly
• #1862 - Fix REST APIs provided by Pulsar proxy

The complete list of changes can be found at:
https://github.com/apache/incubator-pulsar/milestone/14?closed=1

Release 1.22.1-incubating

This is the sixth release of Apache Pulsar since entering the ASF incubator.

Major changes in this release include:
Fixes
[#1660] Deadlock while closing non persistent topic
[#1591] Deadlock while closing non shared consumer
[#1554] Handle invalid mark delete position at managed cursor
[#1262] Broker should not start replicator for root partitioned topic
[#1662] NPE when cursor failed to close empty subscription
[#1370] Relocate service files for shading pulsar-client-admin module
[#1265] Fixed lookup redirect logic on Proxyside
[#1428] Handle Race condition in concurrent bundle split
[#1817] Fixed mem leak when acknowledging while disconnected from broke
[#1851] Fixing resource leak due to open file descriptors in SecurityUtility.

The complete list of changes can be found at:
https://github.com/apache/incubator-pulsar/milestone/15?closed=1

v2.0.0-rc1-incubating

This is the fifth release of Apache Pulsar since entering the ASF incubator and the first time we increase major release number.

There are several new features and major improvements:

• Pulsar functions: Lightweight
  compute framework
• New type-safe Java API for producer/consumers
• Schema registry — Enforce schema on topics
• Topic compaction — Out of band compaction of messages to allow consumer to fetch a
  snapshot with last published message for each message key.
• Upgraded to Apache BookKeeper 4.7.0
• Performance improvements — Up to 3x throughput improvements compared to Pulsar-1.22 and
  99.9 Pct publish latencies <10ms
• Simplified terminology and admin tools
  • Renamed "property" into "tenants"
  • Short topic names: my-topic
  • Topics independent of cluster names: my-tenant/my-namespace/my-topic

The complete list of changes can be found at: https://github.com/apache/incubator-pulsar/milestone/12?closed=1

Release 1.22.0-incubating

This is the fourth of Apache Pulsar since entering the ASF incubator.

Major changes in this release include:

Features

• [#896] PIP-7 Introduce Failure-domain and Anti-affinity-namespace group
• [#1031] Add optional key/value metadata to producers/consumers
• [#1129] Added end to end encryption in C++ client
• [#1151] Added REST handler to create a subscription on a topic
• [#1087] Add basic authentication plugin
• [#1200] Add pluggable authorization mechanism
• [#1208] Add hostname-verification at client tls connection
• [#950] Provided an DCOS Universe package for pulsar
• [#1046] Introduce config to skip non-recoverable data-ledger
• [#899] Add subscription auth mode by prefix
• [#1135] Added infinite time retention configuration option

Enhancements

• [#1094] Include BoringSSL native implementation for faster TLS
• [#1204] Reduce size of buffer used to assemble batches
• [#930] Perform async DNS resolution
• [#1124] Support Pulsar proxy from C++/Python client library
• [#1012] Made load shedding for load manager Dynamically configurable
• [#962] Raw Reader for Pulsar Topics
• [#941] Upgraded Jackson version
• [#1002, #1169, #1168] Making Pulsar Proxy more secure
• [#1029] Fix MessageRouter hash inconsistent on C++/Java clien

Fixes

• [#1153] Fixed increase partitions on a partitioned topic
• [#1195] Ensure the checksum is not stripped after validation in the broker
• [#1203] Use duplicates when writing from ByteBuf pair to avoid multiple threads issues
• [#1210] Cancel keep-alive timer task after the proxy switch to TCP proxy
• [#1170] Upgrade BK version: BK-4.3.1.91-yahoo (fix: stats + DoubleByteBuf)
• [#875] Bug fixes for Websocket proxy

The complete list of changes can be found at:
https://github.com/apache/incubator-pulsar/milestone/11?closed=1

Release 1.21.0-incubating

This is the third of Apache Pulsar since entering the ASF incubator.

Major changes in this release include:

• [#689] Upgrade to Netty 4.1
• [#846] Publish the shaded pulsar-client as the default dependency
• [#832] [#833] [#849] [#852] Enhancements to Kafka API wrapper to have it work with Kafka's own benchmark tools
• [#836] Fix to C++ partitioned consumer client
• [#822] [#826] Several fixes and improvements related to the namespace bundles
• [#848] Allow consumer to seek to message id from within Pulsar client
• [#903] PIP-8: Scale Pulsar beyond 1M topics
• [#824] Enable secure replication over TLS
• [#923] Upgrade to bk-4.3.1.83-yahoo to expose journalSyncData option
• [#807] Prevent message duplication when active consumer is changed

Complete list of changes can be found at:
https://github.com/apache/incubator-pulsar/milestone/10?closed=1

Release 1.20.0-incubating

This is the second of Apache Pulsar since entering the ASF incubator.

Major changes in this release include:

• [#620] [#717] [#718] Reader API support for C++ , Python & Websocket Proxy
• [#634] Added Message dispatch throttling
• [#731] Added End to End Encryption
• [#732] Support for Event Time for messages
• [#751] Guaranteed Deduplication of Messages
• [#761] Kafka API wrapper for Pulsar client library

Complete list of changes can be found at:
https://github.com/apache/incubator-pulsar/milestone/9?closed=1

Release 1.19.0-incubating

This is the first of Apache Pulsar since entering the ASF incubator.

Major changes included in this release are:

• [#524] Moved APIs from com.yahoo.pulsar to org.apache.pulsar
• [#548] Added stateless Pulsar proxy
• [#538] Support for non-persistent topics
• [#587] Upgraded RocksDB to comply with ASF policy
• [#507] Instrumentation of ZooKeeper client to expose metrics
• Various fixes for TLS auth in WebSocket proxy

Complete list of changes can be found at:
https://github.com/apache/incubator-pulsar/milestone/8?closed=1

Release 1.18

Main changes

• #325 Add Modular load manager documentation
• #329 Add api to get list of partitioned topics
• #296 Added spark streaming custom receiver for pulsar
• #317 HTTP lookups for c++ client lib
• #332 Fix: Modular load manager bug fixes
• #352 Fix: Delete local-policies and invalidate cache when namespace is dele
• #356 Fix: WebSocket TLS connection bug
• #363 Use binary protocol lookup for connection between WebSocket proxy and broker
• #375 Fix: Bug fixes on deadlock while topic loading failure
• #376 Fix: Avoid incrementing unack-msg count for non-shared sub and not show it on stats
• #329 Fix: Handle zkCache failures
• #387 Pass client library version to broker and show on stats
• #345 Add load shedding strategy
• #393 Change default mark-delete rate limit from 10s to 1s
• #392 Upgrade to netty-4.0.46
• #366 NonDurable cursor for managed ledger
• #371 Introduce topic reader in client API
• #341 Add stats and monitoring for websocket proxy
• #299 Add api to increase partitions of existing non-global partitioned-topic
• #294 Add endpoint to fetch stats for Prometheus
• #440 Enable PulsarAdmin to trust multiple certificates
• #442 Fix: Remove broker weights for ModularLoadManager
• #446 Fix: Recover cursor with correct readPosition and replay unackedMessages
• #441 Set Block If queue full to false by default
• #447 Fix: DoubleByteBuf to send large size messages in TLS mode
• #443 Add topic termination option
• #436 Added ZooKeeper instrumentation for enhanced stats
• #448 WebSocket proxy should not make a consumer/producer when authorization is failed
• #443 Add Docker images definition and instruction to deploy on Kubernetes
• #474 Fix: message rate out with batches to count messages/s
• #482 Allow client(producer/consumer) to check topic stats
• #468 Pulsar Python client library
• #386 Increment bookkeeper version to 4.3.1.69-yahoo

Full list of changes

https://github.com/yahoo/pulsar/milestone/7?closed=1

Release 1.17.5

• #343 Fix ModularLoadManager to select broker from current available-broker list
• #384 Fix Send replay entries read callback from background thread, to avoid recursive stack calls
• #390 Fix Shaded AsyncHttpClient in pulsar client
• #374 Fix Remove Exceptionally Completed Topic Futures

Release 1.17.4

• #362 Fix add timeout on blocking ZookeeperCache get call
• #375 Fix possible deal lock on topic loading if broker fails to get MLConfiguration from zk
• #377 Fix zkCache error handling and zk-callback processing on separate dedicated thread