-
Notifications
You must be signed in to change notification settings - Fork 477
ci(benchmarks): update django version errortracking_django_simple #15922
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
ci(benchmarks): update django version errortracking_django_simple #15922
Conversation
Codeowners resolved as |
Performance SLOsComparing candidate engraver-auto-version-upgrade/minorpatch/pip/errortracking_django_simple/2-1767841044 (97b19e2) with baseline main (fd55943) 📈 Performance Regressions (3 suites)📈 iastaspects - 118/118✅ add_aspectTime: ✅ 17.840µs (SLO: <20.000µs 📉 -10.8%) vs baseline: 📈 +20.4% Memory: ✅ 42.585MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +4.7% ✅ add_inplace_aspectTime: ✅ 14.912µs (SLO: <20.000µs 📉 -25.4%) vs baseline: -0.3% Memory: ✅ 42.664MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +5.1% ✅ add_inplace_noaspectTime: ✅ 0.338µs (SLO: <10.000µs 📉 -96.6%) vs baseline: -0.2% Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.9% ✅ add_noaspectTime: ✅ 0.545µs (SLO: <10.000µs 📉 -94.6%) vs baseline: -0.3% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.1% ✅ bytearray_aspectTime: ✅ 17.834µs (SLO: <30.000µs 📉 -40.6%) vs baseline: -1.2% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.1% ✅ bytearray_extend_aspectTime: ✅ 23.871µs (SLO: <30.000µs 📉 -20.4%) vs baseline: -1.0% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.1% ✅ bytearray_extend_noaspectTime: ✅ 2.712µs (SLO: <10.000µs 📉 -72.9%) vs baseline: -2.0% Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +5.1% ✅ bytearray_noaspectTime: ✅ 1.450µs (SLO: <10.000µs 📉 -85.5%) vs baseline: -1.8% Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +5.0% ✅ bytes_aspectTime: ✅ 16.555µs (SLO: <20.000µs 📉 -17.2%) vs baseline: -0.2% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.9% ✅ bytes_noaspectTime: ✅ 1.406µs (SLO: <10.000µs 📉 -85.9%) vs baseline: -2.2% Memory: ✅ 42.487MB (SLO: <43.500MB -2.3%) vs baseline: +4.5% ✅ bytesio_aspectTime: ✅ 55.018µs (SLO: <70.000µs 📉 -21.4%) vs baseline: -1.1% Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.7% ✅ bytesio_noaspectTime: ✅ 3.267µs (SLO: <10.000µs 📉 -67.3%) vs baseline: +0.6% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.0% ✅ capitalize_aspectTime: ✅ 14.623µs (SLO: <20.000µs 📉 -26.9%) vs baseline: -0.1% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.1% ✅ capitalize_noaspectTime: ✅ 2.540µs (SLO: <10.000µs 📉 -74.6%) vs baseline: -1.8% Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +5.0% ✅ casefold_aspectTime: ✅ 14.590µs (SLO: <20.000µs 📉 -27.1%) vs baseline: -0.6% Memory: ✅ 42.526MB (SLO: <43.500MB -2.2%) vs baseline: +4.8% ✅ casefold_noaspectTime: ✅ 3.152µs (SLO: <10.000µs 📉 -68.5%) vs baseline: +0.2% Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.9% ✅ decode_aspectTime: ✅ 15.537µs (SLO: <30.000µs 📉 -48.2%) vs baseline: -0.5% Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.6% ✅ decode_noaspectTime: ✅ 1.592µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.8% Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.9% ✅ encode_aspectTime: ✅ 18.063µs (SLO: <30.000µs 📉 -39.8%) vs baseline: 📈 +22.4% Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.5% ✅ encode_noaspectTime: ✅ 1.433µs (SLO: <10.000µs 📉 -85.7%) vs baseline: -5.0% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.0% ✅ format_aspectTime: ✅ 171.101µs (SLO: <200.000µs 📉 -14.4%) vs baseline: ~same Memory: ✅ 42.841MB (SLO: <43.250MB 🟡 -0.9%) vs baseline: +5.1% ✅ format_map_aspectTime: ✅ 190.962µs (SLO: <200.000µs -4.5%) vs baseline: ~same Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.9% ✅ format_map_noaspectTime: ✅ 3.798µs (SLO: <10.000µs 📉 -62.0%) vs baseline: -0.8% Memory: ✅ 42.743MB (SLO: <43.250MB 🟡 -1.2%) vs baseline: +5.4% ✅ format_noaspectTime: ✅ 3.119µs (SLO: <10.000µs 📉 -68.8%) vs baseline: -1.3% Memory: ✅ 42.684MB (SLO: <43.250MB 🟡 -1.3%) vs baseline: +5.1% ✅ index_aspectTime: ✅ 15.313µs (SLO: <20.000µs 📉 -23.4%) vs baseline: -0.3% Memory: ✅ 42.664MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +5.1% ✅ index_noaspectTime: ✅ 0.464µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -0.3% Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +5.0% ✅ join_aspectTime: ✅ 16.897µs (SLO: <20.000µs 📉 -15.5%) vs baseline: -1.6% Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.9% ✅ join_noaspectTime: ✅ 1.548µs (SLO: <10.000µs 📉 -84.5%) vs baseline: -0.9% Memory: ✅ 42.644MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +5.1% ✅ ljust_aspectTime: ✅ 20.522µs (SLO: <30.000µs 📉 -31.6%) vs baseline: -1.0% Memory: ✅ 42.664MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +5.2% ✅ ljust_noaspectTime: ✅ 2.647µs (SLO: <10.000µs 📉 -73.5%) vs baseline: -1.4% Memory: ✅ 42.585MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +4.8% ✅ lower_aspectTime: ✅ 17.781µs (SLO: <30.000µs 📉 -40.7%) vs baseline: -0.7% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.0% ✅ lower_noaspectTime: ✅ 2.417µs (SLO: <10.000µs 📉 -75.8%) vs baseline: -0.3% Memory: ✅ 42.526MB (SLO: <43.250MB 🟡 -1.7%) vs baseline: +4.7% ✅ lstrip_aspectTime: ✅ 17.573µs (SLO: <30.000µs 📉 -41.4%) vs baseline: -0.7% Memory: ✅ 42.605MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +5.0% ✅ lstrip_noaspectTime: ✅ 1.855µs (SLO: <10.000µs 📉 -81.4%) vs baseline: -0.6% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.1% ✅ modulo_aspectTime: ✅ 166.358µs (SLO: <200.000µs 📉 -16.8%) vs baseline: +0.1% Memory: ✅ 42.723MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.9% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 179.281µs (SLO: <200.000µs 📉 -10.4%) vs baseline: +3.1% Memory: ✅ 42.723MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.5% ✅ modulo_aspect_for_bytesTime: ✅ 168.963µs (SLO: <200.000µs 📉 -15.5%) vs baseline: ~same Memory: ✅ 42.802MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +5.3% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 172.153µs (SLO: <200.000µs 📉 -13.9%) vs baseline: +0.4% Memory: ✅ 42.821MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +5.1% ✅ modulo_noaspectTime: ✅ 3.636µs (SLO: <10.000µs 📉 -63.6%) vs baseline: -1.4% Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +5.0% ✅ replace_aspectTime: ✅ 211.507µs (SLO: <300.000µs 📉 -29.5%) vs baseline: -0.2% Memory: ✅ 42.743MB (SLO: <44.000MB -2.9%) vs baseline: +4.8% ✅ replace_noaspectTime: ✅ 2.929µs (SLO: <10.000µs 📉 -70.7%) vs baseline: +1.1% Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +5.1% ✅ repr_aspectTime: ✅ 1.438µs (SLO: <10.000µs 📉 -85.6%) vs baseline: -0.2% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.9% ✅ repr_noaspectTime: ✅ 0.522µs (SLO: <10.000µs 📉 -94.8%) vs baseline: -0.3% Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.8% ✅ rstrip_aspectTime: ✅ 18.834µs (SLO: <30.000µs 📉 -37.2%) vs baseline: -0.8% Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.8% ✅ rstrip_noaspectTime: ✅ 1.946µs (SLO: <10.000µs 📉 -80.5%) vs baseline: +1.1% Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.9% ✅ slice_aspectTime: ✅ 15.829µs (SLO: <20.000µs 📉 -20.9%) vs baseline: -0.6% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.0% ✅ slice_noaspectTime: ✅ 0.600µs (SLO: <10.000µs 📉 -94.0%) vs baseline: -0.9% Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +5.2% ✅ stringio_aspectTime: ✅ 53.699µs (SLO: <80.000µs 📉 -32.9%) vs baseline: -1.2% Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +5.2% ✅ stringio_noaspectTime: ✅ 3.610µs (SLO: <10.000µs 📉 -63.9%) vs baseline: -0.7% Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.9% ✅ strip_aspectTime: ✅ 17.556µs (SLO: <20.000µs 📉 -12.2%) vs baseline: -0.9% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.9% ✅ strip_noaspectTime: ✅ 1.844µs (SLO: <10.000µs 📉 -81.6%) vs baseline: -1.5% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.8% ✅ swapcase_aspectTime: ✅ 18.353µs (SLO: <30.000µs 📉 -38.8%) vs baseline: -0.3% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.0% ✅ swapcase_noaspectTime: ✅ 2.778µs (SLO: <10.000µs 📉 -72.2%) vs baseline: -0.3% Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +5.1% ✅ title_aspectTime: ✅ 18.058µs (SLO: <30.000µs 📉 -39.8%) vs baseline: -0.8% Memory: ✅ 42.664MB (SLO: <43.000MB 🟡 -0.8%) vs baseline: +5.1% ✅ title_noaspectTime: ✅ 2.625µs (SLO: <10.000µs 📉 -73.8%) vs baseline: -1.0% Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +5.0% ✅ translate_aspectTime: ✅ 24.125µs (SLO: <30.000µs 📉 -19.6%) vs baseline: 📈 +17.7% Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.1% ✅ translate_noaspectTime: ✅ 4.302µs (SLO: <10.000µs 📉 -57.0%) vs baseline: ~same Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.8% ✅ upper_aspectTime: ✅ 17.884µs (SLO: <30.000µs 📉 -40.4%) vs baseline: -0.4% Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +5.1% ✅ upper_noaspectTime: ✅ 2.416µs (SLO: <10.000µs 📉 -75.8%) vs baseline: -0.3% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.1% 📈 iastaspectsospath - 24/24✅ ospathbasename_aspectTime: ✅ 5.081µs (SLO: <10.000µs 📉 -49.2%) vs baseline: 📈 +17.8% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.1% ✅ ospathbasename_noaspectTime: ✅ 4.257µs (SLO: <10.000µs 📉 -57.4%) vs baseline: -1.0% Memory: ✅ 42.507MB (SLO: <43.500MB -2.3%) vs baseline: +5.0% ✅ ospathjoin_aspectTime: ✅ 6.277µs (SLO: <10.000µs 📉 -37.2%) vs baseline: +0.3% Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +5.0% ✅ ospathjoin_noaspectTime: ✅ 6.333µs (SLO: <10.000µs 📉 -36.7%) vs baseline: ~same Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +5.3% ✅ ospathnormcase_aspectTime: ✅ 3.551µs (SLO: <10.000µs 📉 -64.5%) vs baseline: -1.1% Memory: ✅ 42.526MB (SLO: <43.500MB -2.2%) vs baseline: +5.0% ✅ ospathnormcase_noaspectTime: ✅ 3.586µs (SLO: <10.000µs 📉 -64.1%) vs baseline: -1.0% Memory: ✅ 42.526MB (SLO: <43.500MB -2.2%) vs baseline: +5.0% ✅ ospathsplit_aspectTime: ✅ 4.909µs (SLO: <10.000µs 📉 -50.9%) vs baseline: -0.4% Memory: ✅ 42.487MB (SLO: <43.500MB -2.3%) vs baseline: +4.8% ✅ ospathsplit_noaspectTime: ✅ 5.000µs (SLO: <10.000µs 📉 -50.0%) vs baseline: -1.4% Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +5.1% ✅ ospathsplitdrive_aspectTime: ✅ 3.729µs (SLO: <10.000µs 📉 -62.7%) vs baseline: -1.8% Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.7% ✅ ospathsplitdrive_noaspectTime: ✅ 0.740µs (SLO: <10.000µs 📉 -92.6%) vs baseline: -2.4% Memory: ✅ 42.467MB (SLO: <43.500MB -2.4%) vs baseline: +4.6% ✅ ospathsplitext_aspectTime: ✅ 4.572µs (SLO: <10.000µs 📉 -54.3%) vs baseline: -1.4% Memory: ✅ 42.487MB (SLO: <43.500MB -2.3%) vs baseline: +4.7% ✅ ospathsplitext_noaspectTime: ✅ 4.601µs (SLO: <10.000µs 📉 -54.0%) vs baseline: -1.1% Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +5.3% 📈 telemetryaddmetric - 30/30✅ 1-count-metric-1-timesTime: ✅ 3.409µs (SLO: <20.000µs 📉 -83.0%) vs baseline: 📈 +13.8% Memory: ✅ 35.036MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +5.3% ✅ 1-count-metrics-100-timesTime: ✅ 198.655µs (SLO: <220.000µs -9.7%) vs baseline: -0.4% Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.6% ✅ 1-distribution-metric-1-timesTime: ✅ 3.339µs (SLO: <20.000µs 📉 -83.3%) vs baseline: +0.4% Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.2% ✅ 1-distribution-metrics-100-timesTime: ✅ 214.839µs (SLO: <230.000µs -6.6%) vs baseline: +0.6% Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0% ✅ 1-gauge-metric-1-timesTime: ✅ 2.194µs (SLO: <20.000µs 📉 -89.0%) vs baseline: -0.3% Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.2% ✅ 1-gauge-metrics-100-timesTime: ✅ 136.880µs (SLO: <150.000µs -8.7%) vs baseline: -0.1% Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.2% ✅ 1-rate-metric-1-timesTime: ✅ 3.182µs (SLO: <20.000µs 📉 -84.1%) vs baseline: +0.9% Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.9% ✅ 1-rate-metrics-100-timesTime: ✅ 212.526µs (SLO: <250.000µs 📉 -15.0%) vs baseline: ~same Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.0% ✅ 100-count-metrics-100-timesTime: ✅ 20.015ms (SLO: <22.000ms -9.0%) vs baseline: -0.9% Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0% ✅ 100-distribution-metrics-100-timesTime: ✅ 2.219ms (SLO: <2.550ms 📉 -13.0%) vs baseline: -0.9% Memory: ✅ 35.232MB (SLO: <35.500MB 🟡 -0.8%) vs baseline: +5.6% ✅ 100-gauge-metrics-100-timesTime: ✅ 1.413ms (SLO: <1.550ms -8.8%) vs baseline: +0.7% Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.3% ✅ 100-rate-metrics-100-timesTime: ✅ 2.182ms (SLO: <2.550ms 📉 -14.4%) vs baseline: -0.3% Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7% ✅ flush-1-metricTime: ✅ 4.528µs (SLO: <20.000µs 📉 -77.4%) vs baseline: -0.6% Memory: ✅ 35.291MB (SLO: <35.500MB 🟡 -0.6%) vs baseline: +5.2% ✅ flush-100-metricsTime: ✅ 174.092µs (SLO: <250.000µs 📉 -30.4%) vs baseline: -0.6% Memory: ✅ 35.350MB (SLO: <35.500MB 🟡 -0.4%) vs baseline: +5.2% ✅ flush-1000-metricsTime: ✅ 2.184ms (SLO: <2.500ms 📉 -12.7%) vs baseline: -0.6% Memory: ✅ 36.117MB (SLO: <36.500MB 🟡 -1.0%) vs baseline: +5.1% 🟡 Near SLO Breach (16 suites)🟡 coreapiscenario - 10/10 (1 unstable)
|
emmettbutler
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
seems good to have benchmark dependencies updated, generally speaking
Summary: Critical-severity security update — 1 package upgraded (patch changes only)
Manifests changed:
benchmarks/errortracking_django_simple(pip)Updates
Security Details
🚨 Critical & High Severity (4 fixed)
ℹ️ Other Vulnerabilities (5)
Review Checklist
Enhanced review recommended for this update:
Update Mode: Vulnerability Remediation (Critical/High)
🤖 Generated by DataDog Automated Dependency Management System