feat(engine): prefetch withdrawal addresses in pre-warming by gakonst · Pull Request #21966 · paradigmxyz/reth

gakonst · 2026-02-08T16:03:20Z

Summary

Prefetch trie proofs for withdrawal addresses during pre-warming, before block execution reaches the post-block balance increment phase.

Motivation

Withdrawals happen at the end of block execution as balance increments. The multiproof computation for these accounts currently has to wait for I/O during post-execution. Since withdrawal addresses are known from the payload upfront, we can prefetch their trie proofs early.

Changes

Add withdrawals field to ExecutionEnv (mod.rs)
Add multiproof_targets_from_withdrawals() helper in prewarm.rs (supports both legacy and V2 proof targets)
Send PrefetchProofs for withdrawals at spawn time in PayloadProcessor::spawn(), non-BAL path only
Add withdrawals() accessor to BlockOrPayload
Zero-amount withdrawals are filtered, duplicate addresses are deduplicated

Testing

Benchmark submitted: run_id a70a6a1a-3221-496e-b67d-7327ec34d57b

Slack thread: https://tempoxyz.slack.com/archives/C0A87C21805/p1770564694402899

github-actions · 2026-02-08T16:03:58Z

⚠️ Changelog not found.

A changelog entry is required before merging. We've generated a suggested changelog based on your changes:

Preview

---
reth-engine-tree: patch
---

Added prefetching of withdrawal addresses during block execution prewarming to improve performance.

Add changelog to commit this to your branch.

crates/engine/tree/src/tree/payload_processor/prewarm.rs

Withdrawals happen at the end of block execution as balance increments. Previously, the pre-warming system did not prefetch any data for these withdrawal addresses, meaning the multiproof computation for withdrawals had to wait for I/O during post-execution. This change generates account-level multiproof prefetch targets for withdrawal addresses and sends them immediately when spawning the payload processor, before transaction prewarming begins. This gives the multiproof task a head start on fetching trie proofs for withdrawal accounts. - Add `withdrawals` field to `ExecutionEnv` - Add `multiproof_targets_from_withdrawals()` helper (supports both legacy and V2 proof targets) - Send `PrefetchProofs` for withdrawals at spawn time in non-BAL path - Filter zero-amount withdrawals and deduplicate addresses - BAL path excluded since BAL should already cover withdrawal touches Co-authored-by: mattsse <matt@paradigm.xyz> Amp-Thread-ID: https://ampcode.com/threads/T-019c3de1-3f1a-75ce-89f6-cc1ff085a42c Co-authored-by: Amp <amp@ampcode.com>

Amp-Thread-ID: https://ampcode.com/threads/T-019c3de1-3f1a-75ce-89f6-cc1ff085a42c Co-authored-by: Amp <amp@ampcode.com>

This reverts commit a812d80.

Amp-Thread-ID: https://ampcode.com/threads/T-019c42d4-887b-7004-b11d-48bea8f3a51b Co-authored-by: Amp <amp@ampcode.com>

crates/engine/tree/src/tree/payload_processor/mod.rs

crates/engine/tree/src/tree/payload_processor/prewarm.rs

crates/engine/tree/src/tree/payload_processor/mod.rs

crates/engine/tree/src/tree/payload_processor/prewarm.rs

crates/engine/tree/src/tree/payload_validator.rs

crates/engine/tree/src/tree/payload_processor/mod.rs

- Remove amount > 0 filters (withdrawal amounts are never 0) - Check withdrawals is non-empty instead of filtering by amount - Return &[Withdrawal] from BlockOrPayload::withdrawals() to avoid cloning - Keep dedup filter in V2 targets Amp-Thread-ID: https://ampcode.com/threads/T-019c43f3-4165-7637-bea2-707b4d96b71d Co-authored-by: Amp <amp@ampcode.com>

…tions Amp-Thread-ID: https://ampcode.com/threads/T-019c43fa-95b8-76d7-9a28-d8fc40812735 Co-authored-by: Amp <amp@ampcode.com>

Amp-Thread-ID: https://ampcode.com/threads/T-019c43fa-95b8-76d7-9a28-d8fc40812735 Co-authored-by: Amp <amp@ampcode.com>

crates/engine/tree/src/tree/payload_processor/prewarm.rs

* paradigmxyz/main: (144 commits) feat(engine): add getPayloadBodiesV2 endpoints for EIP-7928 BAL support (paradigmxyz#21774) ci: skip scheduled workflows on forks (paradigmxyz#22022) chore: rm random log file (paradigmxyz#22023) chore: remove base.reth.rs public endpoint references (paradigmxyz#22019) feat(rpc): add `subscribeFinalizedChainNotifications` endpoint (paradigmxyz#22011) feat(trie): remove `SerialSparseTrie` (paradigmxyz#21808) fix(rocksdb): set max_open_files to prevent fd exhaustion (paradigmxyz#22005) refactor(txpool): rename and document validation methods (paradigmxyz#22008) feat(engine): prefetch withdrawal addresses in pre-warming (paradigmxyz#21966) refactor(pool): add IntoIter: Send bounds to avoid unnecessary Vec collect (paradigmxyz#22001) fix(rpc): enforce blockHash constraint in append_matching_block_logs (paradigmxyz#22007) chore: move Kurtosis failures to the hive slack channel (paradigmxyz#21983) feat(rpc): propagate TransactionOrigin through send_transaction and batcher (paradigmxyz#21969) feat(engine): reorg depth commitment metric (paradigmxyz#21992) feat(storage): add use_hashed_state storage setting (paradigmxyz#21997) perf: better scheduling for storage roots computation (paradigmxyz#21987) chore(deps): bump alloy 1.6.2 -> 1.6.3 (paradigmxyz#21986) fix(stages): skip sender unwind when fully pruned (paradigmxyz#21988) chore(net): remove OP stack bootnodes (paradigmxyz#21984) ci: use depot for hive and kurtosis image builds, run daily (paradigmxyz#21976) ... # Conflicts: # .github/workflows/compact.yml # .github/workflows/dependencies.yml # .github/workflows/docker-tag-latest.yml # .github/workflows/docker.yml # .github/workflows/e2e.yml # .github/workflows/hive.yml # .github/workflows/integration.yml # .github/workflows/kurtosis.yml # .github/workflows/lint.yml # .github/workflows/release.yml # .github/workflows/reproducible-build.yml # .github/workflows/stale.yml # .github/workflows/sync-era.yml # .github/workflows/sync.yml # .github/workflows/unit.yml # bin/reth/Cargo.toml # crates/cli/commands/src/node.rs # crates/node/core/src/node_config.rs

gakonst requested review from Rjected, mattsse, mediocregopher and yongkangc as code owners February 8, 2026 16:03

github-project-automation bot added this to Reth Tracker Feb 8, 2026

github-project-automation bot moved this to Backlog in Reth Tracker Feb 8, 2026

mattsse requested changes Feb 9, 2026

View reviewed changes

crates/engine/tree/src/tree/payload_processor/prewarm.rs Outdated Show resolved Hide resolved

crates/engine/tree/src/tree/payload_processor/prewarm.rs Outdated Show resolved Hide resolved

github-project-automation bot moved this from Backlog to In Progress in Reth Tracker Feb 9, 2026

DaniPopes requested a review from mattsse February 9, 2026 10:23

gakonst and others added 4 commits February 9, 2026 14:40

refactor: simplify withdrawal target generation to iter+collect

11ce45f

Amp-Thread-ID: https://ampcode.com/threads/T-019c3de1-3f1a-75ce-89f6-cc1ff085a42c Co-authored-by: Amp <amp@ampcode.com>

Revert "refactor: simplify withdrawal target generation to iter+collect"

5f596b2

This reverts commit a812d80.

refactor: simplify withdrawal target generation to iter+collect

d809536

Amp-Thread-ID: https://ampcode.com/threads/T-019c42d4-887b-7004-b11d-48bea8f3a51b Co-authored-by: Amp <amp@ampcode.com>

gakonst force-pushed the mattsse/prefetch-withdrawals branch from 750c61e to d809536 Compare February 9, 2026 14:40

DaniPopes reviewed Feb 9, 2026

View reviewed changes

crates/engine/tree/src/tree/payload_processor/mod.rs Outdated Show resolved Hide resolved

DaniPopes reviewed Feb 9, 2026

View reviewed changes

crates/engine/tree/src/tree/payload_processor/prewarm.rs Outdated Show resolved Hide resolved

mattsse requested changes Feb 9, 2026

View reviewed changes

gakonst and others added 5 commits February 9, 2026 19:52

move withdrawal prefetch to after tx spawning in PrewarmMode::Transac…

118df7c

…tions Amp-Thread-ID: https://ampcode.com/threads/T-019c43fa-95b8-76d7-9a28-d8fc40812735 Co-authored-by: Amp <amp@ampcode.com>

Merge branch 'main' into mattsse/prefetch-withdrawals

772eaa1

simplify withdrawal prefetch: inline helpers, make private, remove dedup

2b0ec3a

Amp-Thread-ID: https://ampcode.com/threads/T-019c43fa-95b8-76d7-9a28-d8fc40812735 Co-authored-by: Amp <amp@ampcode.com>

remove misleading comment

f47c8f1

Amp-Thread-ID: https://ampcode.com/threads/T-019c43fa-95b8-76d7-9a28-d8fc40812735 Co-authored-by: Amp <amp@ampcode.com>

mattsse approved these changes Feb 9, 2026

View reviewed changes

gakonst commented Feb 9, 2026

View reviewed changes

crates/engine/tree/src/tree/payload_processor/prewarm.rs Outdated Show resolved Hide resolved

move import

ceb1a46

shekhirin approved these changes Feb 9, 2026

View reviewed changes

Merge branch 'main' into mattsse/prefetch-withdrawals

3231867

mattsse added this pull request to the merge queue Feb 9, 2026

Merged via the queue into main with commit 67f89fa Feb 9, 2026
42 checks passed

mattsse deleted the mattsse/prefetch-withdrawals branch February 9, 2026 22:25

github-project-automation bot moved this from In Progress to Done in Reth Tracker Feb 9, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(engine): prefetch withdrawal addresses in pre-warming#21966

feat(engine): prefetch withdrawal addresses in pre-warming#21966
mattsse merged 11 commits intomainfrom
mattsse/prefetch-withdrawals

gakonst commented Feb 8, 2026

Uh oh!

github-actions bot commented Feb 8, 2026 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Conversation

gakonst commented Feb 8, 2026

Summary

Motivation

Changes

Testing

Uh oh!

github-actions bot commented Feb 8, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

⚠️ Changelog not found.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

github-actions bot commented Feb 8, 2026 •

edited

Loading