[ADDED] Per-message TTL support (nats-server v2.11 feature)#863
Merged
Conversation
See https://github.com/nats-io/nats-architecture-and-design/blob/main/adr/ADR-43.md and nats-io/nats.go#1825. Also added all of the new JS error status codes from the server.
levb
commented
Apr 8, 2025
levb
commented
Apr 8, 2025
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #863 +/- ##
==========================================
+ Coverage 68.71% 70.42% +1.71%
==========================================
Files 39 47 +8
Lines 15207 15417 +210
Branches 3143 3163 +20
==========================================
+ Hits 10449 10858 +409
+ Misses 1700 1516 -184
+ Partials 3058 3043 -15 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
levb
marked this pull request as ready for review
April 8, 2025 13:40
Collaborator
Author
|
Not sure what's going on with the Windows build yet (wget missing?); the Ubuntu 20.04 release builds are affected by the GitHub's deprecation of that Ubuntu version, I filed a separate, unrelated PR to fix it. |
kozlovic
requested changes
Apr 8, 2025
kozlovic
approved these changes
Apr 8, 2025
kozlovic
left a comment
kozlovic
left a comment
Member
There was a problem hiding this comment.
LGTM (taking into account my previous comment about the MsgTTL unit comment).
github-actions Bot
pushed a commit
that referenced
this pull request
Apr 8, 2025
…-server v2.11 feature) (#863)
kozlovic
added a commit
that referenced
this pull request
Sep 26, 2025
Release notes will be: This release contains some breaking changes. See the "Changed" section below. * Build * Disable NATS Streaming by default by @mtmk in #770 * TLS * Require OpenSSL 1.1.1+ to compile. Removed the `NATS_BUILD_TLS_USE_OPENSSL_1_1_API` CMake variable by @kozlovic in #905 * The option `natsOptions_SetSSLVerificationCallback` signature was changed to replace the use of `SSL_verify_cb` (which required OpenSSL dependency in the `nats.h` file), to the new callback `natsSSLVerifyCb`. See documentation of `natsSSLVerifyCb` to see the cast needed to compile with this new header file by @kozlovic in #908 * Modification of a `natsOptions` object if it has TLS/SSL configuration and is actively used by connections will now return a `NATS_ILLEGAL_STATE` by @kozlovic in #912 * Options * Ability to load the trusted CA certificates from a directory using the new option `natsOptions_LoadCATrustedCertificatesPath` by @kerbert101 in #862 * Ability to connect via HTTP proxy for instance by adding a proxy connection handler using the new option `natsOptions_SetProxyConnHandler` by @wolfkor in #871 and @kozlovic in #897 * Ability to load the certificate chain and key from a file on every connection attempt using the new option `natsOptions_LoadCertificatesChainDynamic` by @Matus-p in #901 * Ability to perform concurrent TLS handshakes that may improve time it takes for concurrent connections to be established using the new option `natsOptions_AllowConcurrentTLSHandshakes ` by @kozlovic in #914. Issue was reported by @yanyongcheng in #899 * JetStream * Per-message TTL support (a NATS Server v2.11 feature) by @levb in #863 * Pull consumer priority groups (a NATS Server v2.11 feature) by @levb in #869 * ObjectStore support by @kozlovic in #902. Thanks to @jfflynn41 and @alex1891 for the feedback in #876 * JetStream * Handling of publish asynchronous timeouts by @kozlovic in #886. Issue reported by @yanyongcheng in #880 * Timer insertion by @kozlovic in #883. Issue reported by @yanyongcheng in #881 * EventLoop: * Handling of possible failure on initial attach by @kozlovic in #918 * LibEvent: `natsConnection_Close()` not closing the TCP connection by @kozlovic in #882. Issue was reported by @yanyongcheng in #879 * Libuv: Possible crash if connection is destroyed while receiving data by @kozlovic in #889. Issue was reported by @yanyongcheng in #888 * KeyValue * Keys, History or watcher's next may incorrectly return `NATS_TIMEOUT` by @kozlovic in #917/ Issue was reported by @ArashPartow in #916 * MicroServices: * Wrong marshaling of `average_processing_time` by @kozlovic in #892. Issue was reported by @Archie3d in #890 * Statistics error was always incremented by @kozlovic in #894. Issue was reported by @Archie3d in #893 * TLS * Unknown type name `SSL_verify_cb` by @kozlovic in #878. Issue was reported by @philipfoulkes in #877 * Initialization and cleanup code related to OpenSSL was removed since it was deprecated for versions post OpenSSL 1.1. A cleanup function pertinent to 1.1+ code was possibly causing a problem. By @kozlovic in #905. Issue was reported by @vdeters in #904 * Possible hang during handshake by @kozlovic in #907. Issue was reported by @etrochim in #906 * Protect calls to `SSL_read` and `SSL_write` with a mutex. Since the same `SSL` object is shared between different threads, the OpenSSL library requires a mutex to be used by @kozlovic in #913 * Memory allocation check by @wooffie in #868 * Add missing status text string by @oldnick85 in #872 and @kozlovic in #874 (the issue was not present in any published release and was introduced in #869) * Parsing of message headers with `NULL` or all-whitespace values by @habbbe in #873 * Removed some unused code related to handling of responses and added custom inbox with very long prefix test by @kozlovic in #885. Issue was reported by @yanyongcheng in #884 * Connection drain could cause missed reply and/or a 100ms delay by @kozlovic in #915. Issue was reported by @T-Maxxx in #911 * Build * Deprecated Ubuntu 20.04 in GitHub actions by @levb in #864 * Removed the older compiler jobs by @levb in #865 * Fixed Windows build to use the NATS Server main branch by @levb in #866 * @kerbert101 made their first contribution in #862 * @habbbe made their first contribution in #873 * @wolfkor made their first contribution in #871 * @Matus-p made their first contribution in #901 Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
NormB
added a commit
to NormB/nats.c
that referenced
this pull request
Jun 30, 2026
Bring nats.c to parity with nats.go #1864 ("KeyValue per key TTL support and
limit markers") by adding a KV-level per-key TTL write surface on top of the
existing per-message TTL primitives (nats-io#863):
- kvConfig.LimitMarkerTTL: at bucket create, enable AllowMsgTTL +
SubjectDeleteMarkerTTL on the backing stream.
- kvStore_CreateWithTTL / kvStore_CreateStringWithTTL: per-key TTL on create,
reusing the marker-aware re-create retry (a re-create over a DEL/PURGE/MaxAge
tombstone succeeds and keeps the TTL).
- kvStore_UpdateWithTTL / kvStore_UpdateStringWithTTL: per-key TTL on a CAS update.
- PurgeTTL: kvPurgeOptions.TTL threads a per-message TTL onto the purge marker
so the purge tombstone auto-expires.
- kvStore_Create / kvStore_Update delegate to the *WithTTL entry points with
ttl=0, so existing behavior is unchanged.
- test_KeyValueCreateWithTTL (test/test.c + test/list_test.txt): create-with-TTL,
get-before-expiry, create-over-live-key-fails, server-side expiry, re-create
over the expired marker, update-with-TTL (binary + string), and Purge+PurgeTTL.
JS_SETUP(2,11,0) skips it on < 2.11; verified green on nats-server 2.11.10,
2.12.11 & 2.14.2.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
See https://github.com/nats-io/nats-architecture-and-design/blob/main/adr/ADR-43.md and nats-io/nats.go#1825.
Also added all of the new JS error status codes from the server.