Skip to content

feat: implement gossipsub partial messages extension #577

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
jxs wants to merge 64 commits into
base: sigp-gossipsub
Choose a base branch
from
Open

feat: implement gossipsub partial messages extension #577

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
64 commits
Select commit Hold shift + click to select a range
6313068
feat(gossipsub): implement gossipsub 1.3
jxs Jul 4, 2025
53cc7e8
implement test extesion
jxs Aug 7, 2025
4249ccb
Add PartialMessage trait implementation
jxs Aug 7, 2025
9aa7ead
implement sending and receiving partial messages at te protocol level
jxs Sep 10, 2025
bc45d3e
add partial_publish method
jxs Sep 12, 2025
8b1c086
update trait extend method to receive slice instead
jxs Sep 12, 2025
b1b8dbe
implement Partial message handling and publishing at the behaviour level
jxs Sep 15, 2025
e7250f5
Merge branch 'sigp-gossipsub' of github.com:sigp/rust-libp2p into gos…
jxs Sep 16, 2025
6370514
address Marco's review
jxs Sep 20, 2025
909a68f
feature gate partial messages
jxs Sep 20, 2025
046ad47
remove PartialIDONWANT from proto to follow spec
jxs Sep 24, 2025
69c2d95
update trait return types and remove non used impl
jxs Sep 25, 2025
45c2bc1
fixup! feature gate partial messages
jxs Sep 26, 2025
85b92f3
update to spec changes
jxs Sep 29, 2025
b6478d5
update extension message priority to highest
jxs Sep 29, 2025
5e98f1a
add missing proto field SubOpts partial
jxs Sep 29, 2025
f77490c
implement subscription options partial
jxs Sep 30, 2025
1bfbc55
publish only full messages to partial false peers
jxs Sep 30, 2025
33783bd
revert to only using TopicHash,
jxs Oct 1, 2025
438a297
add partial option to subscribe and unsubscribe methods
jxs Oct 1, 2025
6cb5244
polish PR
jxs Oct 3, 2025
bc3d7ba
push publish method above for smaller diff
jxs Oct 3, 2025
4321429
address Daniel's review
jxs Oct 10, 2025
c3aa3e4
enum return value for `partial_message_bytes_from_metadata`
dknopik Oct 10, 2025
88806ad
update Partial implementation
jxs Oct 13, 2025
4ea2e45
address Daniel's review
jxs Oct 14, 2025
ea73a71
address missing review comment
jxs Oct 14, 2025
c415f37
impl Daniel's suggestions for the public API
jxs Oct 15, 2025
3048649
borrow metadata mutably for `metadata.update`
dknopik Oct 15, 2025
1685aae
impl penalization for failed partials
jxs Oct 15, 2025
69cde69
address Marco review
jxs Oct 15, 2025
19e359d
cargo fmt
jxs Oct 15, 2025
22a7b74
Merge branch 'master' of github.com:libp2p/rust-libp2p into gossipsub…
jxs Oct 16, 2025
54228bf
Require Metadata to be Send + Sync
dknopik Oct 21, 2025
2220ae4
merge master@origin
jxs Oct 28, 2025
9545140
fix sending partial messages to peers not supporting them
jxs Oct 28, 2025
dd21893
update to latest spec changes
jxs Oct 29, 2025
d97ae1f
emmit gosipsup event whenever partial data was updated
jxs Oct 31, 2025
246fe26
update behaviour to cache partials
jxs Nov 9, 2025
a3ba227
experimental change
dknopik Nov 10, 2025
aa94317
add send and sync
dknopik Nov 10, 2025
4e59700
automatically reply to partial messages
jxs Nov 11, 2025
0a58619
Revert "add send and sync"
jxs Nov 12, 2025
1ea4ebd
Revert "experimental change"
jxs Nov 12, 2025
ac9f618
merge Daniel's experiments into main branch
jxs Nov 12, 2025
20c0b09
merge master
jxs Dec 9, 2025
cdad5cb
add transient peers to the publish peers
jxs Dec 9, 2025
3de7fc0
fix fanout, we need fanout to be mesh_n not non empty
jxs Dec 11, 2025
6e0c2a5
fix wording on comments when gathering fanout peers
jxs Dec 11, 2025
62a9fc4
fix never sending any partial message unless another has been receive…
dknopik Dec 12, 2025
7751293
do not return early in handle_partial_messsage if it pushes data
dknopik Dec 12, 2025
5673256
update partial message codepoints
MarcoPolo Dec 15, 2025
6fc2b06
merge master
jxs Dec 18, 2025
4a01d9c
refactor partial messages internals
jxs Jan 13, 2026
1b441ff
fix tests
jxs Jan 14, 2026
655bcb6
fix re-publishing of PartialAction
jxs Jan 15, 2026
6cf8139
improve imports and rename PartialMessagesError to PartialError
jxs Jan 15, 2026
278c153
more improvements
jxs Jan 15, 2026
922e5c2
update Partial api
jxs Jan 15, 2026
8f03b0b
do not parse partial messages by penalized peers
jxs Jan 15, 2026
c3e6c83
add updated metrics
jxs Jan 16, 2026
911f9d9
namespace partial_messages types re-exports
jxs Jan 20, 2026
e2bcf85
Add missing transient peers when publishing
jxs Jan 20, 2026
bd02db8
fix bug where for partial messages instead of gathering the nodes that
jxs Jan 20, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions protocols/gossipsub/CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,10 @@
- Fix underflow when shuffling peers after prunning.
See [PR 6183](https://github.com/libp2p/rust-libp2p/pull/6183)


- Implement gossipsub 1.3 extensions control message.
See [PR 6119](https://github.com/libp2p/rust-libp2p/pull/6119)

- Remove peer penalty for duplicate messages.
See [PR 6112](https://github.com/libp2p/rust-libp2p/pull/6112)

Expand All @@ -26,6 +30,9 @@
- Switch the internal `async-channel` used to dispatch messages from `NetworkBehaviour` to the `ConnectionHandler`
with an internal priority queue. See [PR 6175](https://github.com/libp2p/rust-libp2p/pull/6175)

- Switch the internal `async-channel` used to dispatch messages from `NetworkBehaviour` to the `ConnectionHandler`
with an internal priority queue. See [PR XXXX](https://github.com/libp2p/rust-libp2p/pull/XXXX)

- gossipsub: do early return in for an empty input
See [PR 6208](https://github.com/libp2p/rust-libp2p/pull/6208).

Expand Down
1 change: 1 addition & 0 deletions protocols/gossipsub/Cargo.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,7 @@ categories = ["network-programming", "asynchronous"]
[features]
wasm-bindgen = ["getrandom/js", "futures-timer/wasm-bindgen"]
metrics = ["prometheus-client"]
partial_messages = []

[dependencies]
async-channel = "2.3.1"
Expand Down
Loading