Skip to content

Add scan throughput benchmarks - #3007

Merged
liquidsec merged 1 commit into
3.0from
scan-benchmarks-3.0
Apr 1, 2026
Merged

Add scan throughput benchmarks#3007
liquidsec merged 1 commit into
3.0from
scan-benchmarks-3.0

Conversation

@liquidsec

Copy link
Copy Markdown
Collaborator

Summary

  • Add scan throughput benchmarks (100 and 1000 URL tests) measuring end-to-end HTTP probing performance through the full scan pipeline
  • Make HTTP module references portable across branches (httpx on 3.0, http on blasthttp) so benchmark comparisons work correctly

@liquidsec
liquidsec merged commit 38b735e into 3.0 Apr 1, 2026
15 of 16 checks passed
@github-actions

github-actions Bot commented Apr 1, 2026

Copy link
Copy Markdown
Contributor

📊 Performance Benchmark Report

Comparing 3.0 (baseline) vs scan-benchmarks-3.0 (current)

📈 Detailed Results (All Benchmarks)

📋 Complete results for all benchmarks - includes both significant and insignificant changes

🧪 Test Name 📏 Base 📏 Current 📈 Change 🎯 Status
Bloom Filter Dns Mutation Tracking Performance 4.24ms 4.26ms +0.3%
Bloom Filter Large Scale Dns Brute Force 17.12ms 18.18ms +6.2%
Large Closest Match Lookup 352.37ms 359.87ms +2.1%
Realistic Closest Match Workload 189.41ms 187.14ms -1.2%
Event Memory Medium Scan 1776 B/event 1774 B/event -0.1%
Event Memory Large Scan 1760 B/event 1760 B/event +0.0%
Event Validation Full Scan Startup Small Batch 410.74ms 406.42ms -1.1%
Event Validation Full Scan Startup Large Batch 589.39ms 571.69ms -3.0%
Make Event Autodetection Small 30.73ms 30.88ms +0.5%
Make Event Autodetection Large 316.26ms 313.96ms -0.7%
Make Event Explicit Types 13.69ms 13.91ms +1.6%
Excavate Single Thread Small 3.917s 4.074s +4.0%
Excavate Single Thread Large 9.571s 9.914s +3.6%
Excavate Parallel Tasks Small 4.257s 4.165s -2.2%
Excavate Parallel Tasks Large 7.312s 7.443s +1.8%
Is Ip Performance 3.16ms 3.16ms +0.2%
Make Ip Type Performance 11.58ms 11.72ms +1.2%
Mixed Ip Operations 4.53ms 4.54ms +0.2%
Scan Throughput 100 - 8.430s New 🆕 🆕
Scan Throughput 1000 - 44.357s New 🆕 🆕
Typical Queue Shuffle 61.74µs 63.78µs +3.3%
Priority Queue Shuffle 699.13µs 733.10µs +4.9%

🎯 Performance Summary

No significant performance changes detected (all changes <10%)

🔍 Significant Changes (>10%)

  • Scan Throughput 100: New test 🆕 (8.430s, 0.1 ops/sec)
  • Scan Throughput 1000: New test 🆕 (44.357s, 0.0 ops/sec)

🐍 Python Version 3.11.15

@codecov

codecov Bot commented Apr 1, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 37.50000% with 30 lines in your changes missing coverage. Please review.
✅ Project coverage is 91%. Comparing base (8b02acb) to head (bdd9e93).
⚠️ Report is 11 commits behind head on 3.0.

Files with missing lines Patch % Lines
...test/benchmarks/test_scan_throughput_benchmarks.py 37% 28 Missing ⚠️
bbot/test/benchmarks/test_excavate_benchmarks.py 50% 2 Missing ⚠️
Additional details and impacted files
@@          Coverage Diff          @@
##             3.0   #3007   +/-   ##
=====================================
- Coverage     91%     91%   -0%     
=====================================
  Files        436     437    +1     
  Lines      37072   37118   +46     
=====================================
+ Hits       33677   33684    +7     
- Misses      3395    3434   +39     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@liquidsec liquidsec mentioned this pull request Jun 9, 2026
@ausmaster
ausmaster deleted the scan-benchmarks-3.0 branch June 11, 2026 01:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants