-
Notifications
You must be signed in to change notification settings - Fork 477
ci(benchmarks): update gunicorn version django_simple #15921
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
ci(benchmarks): update gunicorn version django_simple #15921
Conversation
Codeowners resolved as |
Performance SLOsComparing candidate engraver-auto-version-upgrade/major/pip/django_simple/7-1767841044 (9d2a87e) with baseline main (71fb063) 📈 Performance Regressions (3 suites)📈 iastaspects - 118/118✅ add_aspectTime: ✅ 104.519µs (SLO: <130.000µs 📉 -19.6%) vs baseline: +4.4% Memory: ✅ 42.743MB (SLO: <43.250MB 🟡 -1.2%) vs baseline: +5.2% ✅ add_inplace_aspectTime: ✅ 100.582µs (SLO: <130.000µs 📉 -22.6%) vs baseline: -0.5% Memory: ✅ 42.743MB (SLO: <43.250MB 🟡 -1.2%) vs baseline: +5.2% ✅ add_inplace_noaspectTime: ✅ 28.190µs (SLO: <40.000µs 📉 -29.5%) vs baseline: ~same Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.8% ✅ add_noaspectTime: ✅ 48.841µs (SLO: <70.000µs 📉 -30.2%) vs baseline: -0.1% Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.7% ✅ bytearray_aspectTime: ✅ 257.791µs (SLO: <400.000µs 📉 -35.6%) vs baseline: +0.9% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.7% ✅ bytearray_extend_aspectTime: ✅ 651.413µs (SLO: <800.000µs 📉 -18.6%) vs baseline: ~same Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.7% ✅ bytearray_extend_noaspectTime: ✅ 267.306µs (SLO: <400.000µs 📉 -33.2%) vs baseline: -1.5% Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.9% ✅ bytearray_noaspectTime: ✅ 141.114µs (SLO: <300.000µs 📉 -53.0%) vs baseline: +1.3% Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.8% ✅ bytes_aspectTime: ✅ 222.053µs (SLO: <300.000µs 📉 -26.0%) vs baseline: +0.4% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.0% ✅ bytes_noaspectTime: ✅ 132.538µs (SLO: <200.000µs 📉 -33.7%) vs baseline: -0.2% Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.0% ✅ bytesio_aspectTime: ✅ 3.851ms (SLO: <5.000ms 📉 -23.0%) vs baseline: +0.2% Memory: ✅ 42.723MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.9% ✅ bytesio_noaspectTime: ✅ 319.926µs (SLO: <420.000µs 📉 -23.8%) vs baseline: -1.2% Memory: ✅ 42.723MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +5.2% ✅ capitalize_aspectTime: ✅ 89.675µs (SLO: <300.000µs 📉 -70.1%) vs baseline: -0.4% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.0% ✅ capitalize_noaspectTime: ✅ 251.083µs (SLO: <300.000µs 📉 -16.3%) vs baseline: +1.1% Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.7% ✅ casefold_aspectTime: ✅ 89.821µs (SLO: <500.000µs 📉 -82.0%) vs baseline: -0.7% Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +5.0% ✅ casefold_noaspectTime: ✅ 308.964µs (SLO: <500.000µs 📉 -38.2%) vs baseline: -0.4% Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.5% ✅ decode_aspectTime: ✅ 87.363µs (SLO: <100.000µs 📉 -12.6%) vs baseline: +0.3% Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.8% ✅ decode_noaspectTime: ✅ 152.144µs (SLO: <210.000µs 📉 -27.6%) vs baseline: -0.4% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.0% ✅ encode_aspectTime: ✅ 85.210µs (SLO: <200.000µs 📉 -57.4%) vs baseline: ~same Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.8% ✅ encode_noaspectTime: ✅ 137.514µs (SLO: <200.000µs 📉 -31.2%) vs baseline: -1.0% Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.6% ✅ format_aspectTime: ✅ 14.703ms (SLO: <19.200ms 📉 -23.4%) vs baseline: ~same Memory: ✅ 42.782MB (SLO: <43.250MB 🟡 -1.1%) vs baseline: +4.7% ✅ format_map_aspectTime: ✅ 16.465ms (SLO: <21.500ms 📉 -23.4%) vs baseline: ~same Memory: ✅ 42.743MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +4.7% ✅ format_map_noaspectTime: ✅ 365.794µs (SLO: <500.000µs 📉 -26.8%) vs baseline: -0.5% Memory: ✅ 42.743MB (SLO: <43.250MB 🟡 -1.2%) vs baseline: +5.1% ✅ format_noaspectTime: ✅ 306.246µs (SLO: <500.000µs 📉 -38.8%) vs baseline: ~same Memory: ✅ 42.625MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +4.9% ✅ index_aspectTime: ✅ 133.654µs (SLO: <300.000µs 📉 -55.4%) vs baseline: +8.9% Memory: ✅ 42.585MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +4.7% ✅ index_noaspectTime: ✅ 40.813µs (SLO: <300.000µs 📉 -86.4%) vs baseline: +0.6% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.9% ✅ join_aspectTime: ✅ 219.375µs (SLO: <300.000µs 📉 -26.9%) vs baseline: +1.0% Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.9% ✅ join_noaspectTime: ✅ 148.813µs (SLO: <300.000µs 📉 -50.4%) vs baseline: -1.6% Memory: ✅ 42.605MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +4.8% ✅ ljust_aspectTime: ✅ 573.396µs (SLO: <700.000µs 📉 -18.1%) vs baseline: 📈 +15.2% Memory: ✅ 42.605MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +4.9% ✅ ljust_noaspectTime: ✅ 255.642µs (SLO: <300.000µs 📉 -14.8%) vs baseline: +0.2% Memory: ✅ 42.605MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +4.9% ✅ lower_aspectTime: ✅ 308.161µs (SLO: <500.000µs 📉 -38.4%) vs baseline: +0.8% Memory: ✅ 42.762MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +5.1% ✅ lower_noaspectTime: ✅ 233.725µs (SLO: <300.000µs 📉 -22.1%) vs baseline: +0.4% Memory: ✅ 42.664MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +5.0% ✅ lstrip_aspectTime: ✅ 0.271ms (SLO: <3.000ms 📉 -91.0%) vs baseline: +0.7% Memory: ✅ 42.723MB (SLO: <43.250MB 🟡 -1.2%) vs baseline: +5.0% ✅ lstrip_noaspectTime: ✅ 0.179ms (SLO: <3.000ms 📉 -94.0%) vs baseline: +0.6% Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.9% ✅ modulo_aspectTime: ✅ 14.368ms (SLO: <18.750ms 📉 -23.4%) vs baseline: +0.1% Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +5.1% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 14.877ms (SLO: <19.350ms 📉 -23.1%) vs baseline: +0.1% Memory: ✅ 42.802MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +4.8% ✅ modulo_aspect_for_bytesTime: ✅ 14.479ms (SLO: <18.900ms 📉 -23.4%) vs baseline: -0.4% Memory: ✅ 42.821MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +4.9% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 14.670ms (SLO: <19.150ms 📉 -23.4%) vs baseline: -0.4% Memory: ✅ 42.802MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +4.9% ✅ modulo_noaspectTime: ✅ 0.358ms (SLO: <3.000ms 📉 -88.1%) vs baseline: +0.4% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.9% ✅ replace_aspectTime: ✅ 18.471ms (SLO: <24.000ms 📉 -23.0%) vs baseline: ~same Memory: ✅ 42.802MB (SLO: <44.000MB -2.7%) vs baseline: +4.8% ✅ replace_noaspectTime: ✅ 284.089µs (SLO: <300.000µs -5.3%) vs baseline: -1.0% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.0% ✅ repr_aspectTime: ✅ 317.882µs (SLO: <420.000µs 📉 -24.3%) vs baseline: +0.4% Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.1% ✅ repr_noaspectTime: ✅ 47.273µs (SLO: <90.000µs 📉 -47.5%) vs baseline: +1.1% Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.0% ✅ rstrip_aspectTime: ✅ 377.028µs (SLO: <500.000µs 📉 -24.6%) vs baseline: +0.1% Memory: ✅ 42.743MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +5.1% ✅ rstrip_noaspectTime: ✅ 181.564µs (SLO: <300.000µs 📉 -39.5%) vs baseline: -0.9% Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.6% ✅ slice_aspectTime: ✅ 181.531µs (SLO: <300.000µs 📉 -39.5%) vs baseline: +0.2% Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.8% ✅ slice_noaspectTime: ✅ 53.918µs (SLO: <90.000µs 📉 -40.1%) vs baseline: -0.2% Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.7% ✅ stringio_aspectTime: ✅ 4.471ms (SLO: <5.000ms 📉 -10.6%) vs baseline: 📈 +15.4% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.8% ✅ stringio_noaspectTime: ✅ 354.734µs (SLO: <500.000µs 📉 -29.1%) vs baseline: +0.4% Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.6% ✅ strip_aspectTime: ✅ 271.150µs (SLO: <350.000µs 📉 -22.5%) vs baseline: +0.7% Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +5.0% ✅ strip_noaspectTime: ✅ 179.336µs (SLO: <240.000µs 📉 -25.3%) vs baseline: ~same Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.9% ✅ swapcase_aspectTime: ✅ 343.624µs (SLO: <500.000µs 📉 -31.3%) vs baseline: -0.1% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.7% ✅ swapcase_noaspectTime: ✅ 272.681µs (SLO: <400.000µs 📉 -31.8%) vs baseline: ~same Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.8% ✅ title_aspectTime: ✅ 334.429µs (SLO: <500.000µs 📉 -33.1%) vs baseline: +1.2% Memory: ✅ 42.546MB (SLO: <43.000MB 🟡 -1.1%) vs baseline: +4.4% ✅ title_noaspectTime: ✅ 260.377µs (SLO: <400.000µs 📉 -34.9%) vs baseline: -0.2% Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.0% ✅ translate_aspectTime: ✅ 503.908µs (SLO: <700.000µs 📉 -28.0%) vs baseline: +1.4% Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.7% ✅ translate_noaspectTime: ✅ 424.618µs (SLO: <500.000µs 📉 -15.1%) vs baseline: -1.0% Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.8% ✅ upper_aspectTime: ✅ 307.318µs (SLO: <500.000µs 📉 -38.5%) vs baseline: -0.2% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.0% ✅ upper_noaspectTime: ✅ 233.305µs (SLO: <400.000µs 📉 -41.7%) vs baseline: -0.3% Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.6% 📈 iastaspectsospath - 24/24✅ ospathbasename_aspectTime: ✅ 499.861µs (SLO: <700.000µs 📉 -28.6%) vs baseline: 📈 +17.7% Memory: ✅ 42.487MB (SLO: <43.500MB -2.3%) vs baseline: +5.2% ✅ ospathbasename_noaspectTime: ✅ 423.920µs (SLO: <700.000µs 📉 -39.4%) vs baseline: -0.2% Memory: ✅ 42.408MB (SLO: <43.500MB -2.5%) vs baseline: +4.6% ✅ ospathjoin_aspectTime: ✅ 625.669µs (SLO: <700.000µs 📉 -10.6%) vs baseline: +0.6% Memory: ✅ 42.467MB (SLO: <43.500MB -2.4%) vs baseline: +4.9% ✅ ospathjoin_noaspectTime: ✅ 628.203µs (SLO: <700.000µs 📉 -10.3%) vs baseline: -0.6% Memory: ✅ 42.212MB (SLO: <43.500MB -3.0%) vs baseline: +4.5% ✅ ospathnormcase_aspectTime: ✅ 348.712µs (SLO: <700.000µs 📉 -50.2%) vs baseline: -0.3% Memory: ✅ 42.349MB (SLO: <43.500MB -2.6%) vs baseline: +4.9% ✅ ospathnormcase_noaspectTime: ✅ 353.652µs (SLO: <700.000µs 📉 -49.5%) vs baseline: -0.5% Memory: ✅ 42.408MB (SLO: <43.500MB -2.5%) vs baseline: +4.9% ✅ ospathsplit_aspectTime: ✅ 482.782µs (SLO: <700.000µs 📉 -31.0%) vs baseline: -0.3% Memory: ✅ 42.310MB (SLO: <43.500MB -2.7%) vs baseline: +4.8% ✅ ospathsplit_noaspectTime: ✅ 498.999µs (SLO: <700.000µs 📉 -28.7%) vs baseline: +1.5% Memory: ✅ 42.428MB (SLO: <43.500MB -2.5%) vs baseline: +5.1% ✅ ospathsplitdrive_aspectTime: ✅ 371.994µs (SLO: <700.000µs 📉 -46.9%) vs baseline: +0.5% Memory: ✅ 42.448MB (SLO: <43.500MB -2.4%) vs baseline: +5.1% ✅ ospathsplitdrive_noaspectTime: ✅ 72.229µs (SLO: <700.000µs 📉 -89.7%) vs baseline: -0.2% Memory: ✅ 42.389MB (SLO: <43.500MB -2.6%) vs baseline: +4.9% ✅ ospathsplitext_aspectTime: ✅ 456.433µs (SLO: <700.000µs 📉 -34.8%) vs baseline: +0.4% Memory: ✅ 42.310MB (SLO: <43.500MB -2.7%) vs baseline: +5.0% ✅ ospathsplitext_noaspectTime: ✅ 461.126µs (SLO: <700.000µs 📉 -34.1%) vs baseline: +0.1% Memory: ✅ 42.507MB (SLO: <43.500MB -2.3%) vs baseline: +5.1% 📈 telemetryaddmetric - 30/30✅ 1-count-metric-1-timesTime: ✅ 3.410µs (SLO: <20.000µs 📉 -82.9%) vs baseline: 📈 +12.9% Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7% ✅ 1-count-metrics-100-timesTime: ✅ 200.317µs (SLO: <220.000µs -8.9%) vs baseline: -0.1% Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.0% ✅ 1-distribution-metric-1-timesTime: ✅ 3.359µs (SLO: <20.000µs 📉 -83.2%) vs baseline: ~same Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.3% ✅ 1-distribution-metrics-100-timesTime: ✅ 213.936µs (SLO: <230.000µs -7.0%) vs baseline: -0.3% Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.7% ✅ 1-gauge-metric-1-timesTime: ✅ 2.191µs (SLO: <20.000µs 📉 -89.0%) vs baseline: -0.1% Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.1% ✅ 1-gauge-metrics-100-timesTime: ✅ 136.528µs (SLO: <150.000µs -9.0%) vs baseline: -0.2% Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.8% ✅ 1-rate-metric-1-timesTime: ✅ 3.189µs (SLO: <20.000µs 📉 -84.1%) vs baseline: +0.9% Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.6% ✅ 1-rate-metrics-100-timesTime: ✅ 214.166µs (SLO: <250.000µs 📉 -14.3%) vs baseline: ~same Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.0% ✅ 100-count-metrics-100-timesTime: ✅ 20.017ms (SLO: <22.000ms -9.0%) vs baseline: +0.9% Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.7% ✅ 100-distribution-metrics-100-timesTime: ✅ 2.224ms (SLO: <2.550ms 📉 -12.8%) vs baseline: -0.3% Memory: ✅ 35.232MB (SLO: <35.500MB 🟡 -0.8%) vs baseline: +5.4% ✅ 100-gauge-metrics-100-timesTime: ✅ 1.408ms (SLO: <1.550ms -9.1%) vs baseline: +0.6% Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.5% ✅ 100-rate-metrics-100-timesTime: ✅ 2.167ms (SLO: <2.550ms 📉 -15.0%) vs baseline: ~same Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.0% ✅ flush-1-metricTime: ✅ 4.561µs (SLO: <20.000µs 📉 -77.2%) vs baseline: ~same Memory: ✅ 35.291MB (SLO: <35.500MB 🟡 -0.6%) vs baseline: +5.0% ✅ flush-100-metricsTime: ✅ 174.864µs (SLO: <250.000µs 📉 -30.1%) vs baseline: -0.4% Memory: ✅ 35.311MB (SLO: <35.500MB 🟡 -0.5%) vs baseline: +5.1% ✅ flush-1000-metricsTime: ✅ 2.182ms (SLO: <2.500ms 📉 -12.7%) vs baseline: ~same Memory: ✅ 36.097MB (SLO: <36.500MB 🟡 -1.1%) vs baseline: +4.7% 🟡 Near SLO Breach (15 suites)🟡 coreapiscenario - 10/10 (1 unstable)
|
…go_simple/7-1767841044
…go_simple/7-1767841044
Summary: High-severity security update — 1 package upgraded (MAJOR changes included)
Manifests changed:
benchmarks/django_simple(pip)Updates
Warning
Major Version Upgrade
This update includes major version changes that may contain breaking changes. Please:
Security Details
🚨 Critical & High Severity (2 fixed)
Review Checklist
Enhanced review recommended for this update:
Update Mode: Vulnerability Remediation (High)
🤖 Generated by DataDog Automated Dependency Management System