Performance Optimizations for Bloom Filter

[liquidsec]

No description provided.

[github-actions]

📊 Performance Benchmark Report

Comparing dev (baseline) vs bloom-performance (current)

📈 Detailed Results (All Benchmarks)

📋 Complete results for all benchmarks - includes both significant and insignificant changes

🧪 Test Name	📏 Base	📏 Current	📈 Change	🎯 Status
Bloom Filter Dns Mutation Tracking Performance	8.04ms	4.23ms	-47.5% 🟢🟢🟢	🚀
Bloom Filter Large Scale Dns Brute Force	37.73ms	18.28ms	-51.6% 🟢🟢🟢	🚀
Large Closest Match Lookup	348.91ms	356.66ms	+2.2% ⚪	✅
Realistic Closest Match Workload	189.71ms	196.37ms	+3.5% ⚪	✅
Event Validation Full Scan Startup Small Batch	448.08ms	456.84ms	+2.0% ⚪	✅
Event Validation Full Scan Startup Large Batch	789.67ms	804.49ms	+1.9% ⚪	✅
Make Event Autodetection Small	31.22ms	31.00ms	-0.7% ⚪	✅
Make Event Autodetection Large	318.14ms	318.42ms	+0.1% ⚪	✅
Make Event Explicit Types	13.91ms	13.91ms	+0.0% ⚪	✅
Excavate Single Thread Small	4.086s	4.025s	-1.5% ⚪	✅
Excavate Single Thread Large	9.418s	9.423s	+0.1% ⚪	✅
Excavate Parallel Tasks Small	4.229s	4.218s	-0.3% ⚪	✅
Excavate Parallel Tasks Large	7.256s	7.244s	-0.2% ⚪	✅
Is Ip Performance	3.21ms	3.15ms	-1.9% ⚪	✅
Make Ip Type Performance	11.31ms	11.26ms	-0.4% ⚪	✅
Mixed Ip Operations	4.43ms	4.42ms	-0.2% ⚪	✅
Typical Queue Shuffle	62.44µs	61.61µs	-1.3% ⚪	✅
Priority Queue Shuffle	707.00µs	688.64µs	-2.6% ⚪	✅

🎯 Performance Summary

+ 2 improvements 🚀
  16 unchanged ✅

🔍 Significant Changes (>10%)

• Bloom Filter Dns Mutation Tracking Performance: 47.5% 🚀 faster
• Bloom Filter Large Scale Dns Brute Force: 51.6% 🚀 faster

---

🐍 Python Version 3.11.13

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 92%. Comparing base (bd56db8) to head (6e7ea13).
⚠️ Report is 4 commits behind head on dev.

Additional details and impacted files

@@          Coverage Diff          @@
##             dev   #2674   +/-   ##
=====================================
- Coverage     92%     92%   -0%     
=====================================
  Files        410     410           
  Lines      33947   33942    -5     
=====================================
- Hits       31015   30997   -18     
- Misses      2932    2945   +13     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.