Skip to content

Conversation

@emmettbutler
Copy link
Collaborator

@emmettbutler emmettbutler commented Jan 9, 2026

This change removes the *-profile jobs from the github actions config because they're not actionable. In the future it would make sense to add benchmarks that exercise the same code and provide pass/fail statuses per commit based on configurable thresholds.

@emmettbutler emmettbutler requested review from a team as code owners January 9, 2026 18:08
@emmettbutler emmettbutler marked this pull request as draft January 9, 2026 18:08
@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Jan 9, 2026

Codeowners resolved as

.github/workflows/django-overhead-profile.yml                           @DataDog/python-guild @DataDog/apm-core-python
.github/workflows/encoders-profile.yml                                  @DataDog/python-guild @DataDog/apm-core-python
.github/workflows/flask-overhead-profile.yml                            @DataDog/python-guild @DataDog/apm-core-python
scripts/profiles/encoders/run.sh                                        @DataDog/apm-core-python
scripts/profiles/encoders/setup.sh                                      @DataDog/apm-core-python

@pr-commenter
Copy link

pr-commenter bot commented Jan 9, 2026

Performance SLOs

Comparing candidate emmett.butler/profile-jobs (096382d) with baseline main (76fae6c)

📈 Performance Regressions (3 suites)
📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 105.338µs (SLO: <130.000µs 📉 -19.0%) vs baseline: +4.6%

Memory: ✅ 42.625MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +4.7%


✅ add_inplace_aspect

Time: ✅ 102.475µs (SLO: <130.000µs 📉 -21.2%) vs baseline: +1.6%

Memory: ✅ 42.644MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +5.0%


✅ add_inplace_noaspect

Time: ✅ 28.115µs (SLO: <40.000µs 📉 -29.7%) vs baseline: -0.9%

Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.8%


✅ add_noaspect

Time: ✅ 48.747µs (SLO: <70.000µs 📉 -30.4%) vs baseline: ~same

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%


✅ bytearray_aspect

Time: ✅ 257.396µs (SLO: <400.000µs 📉 -35.7%) vs baseline: +1.1%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.9%


✅ bytearray_extend_aspect

Time: ✅ 650.975µs (SLO: <800.000µs 📉 -18.6%) vs baseline: +0.4%

Memory: ✅ 42.723MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.9%


✅ bytearray_extend_noaspect

Time: ✅ 266.927µs (SLO: <400.000µs 📉 -33.3%) vs baseline: -0.3%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%


✅ bytearray_noaspect

Time: ✅ 139.555µs (SLO: <300.000µs 📉 -53.5%) vs baseline: -0.1%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.9%


✅ bytes_aspect

Time: ✅ 224.547µs (SLO: <300.000µs 📉 -25.2%) vs baseline: +1.5%

Memory: ✅ 42.762MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +5.0%


✅ bytes_noaspect

Time: ✅ 134.868µs (SLO: <200.000µs 📉 -32.6%) vs baseline: +1.1%

Memory: ✅ 42.782MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +5.3%


✅ bytesio_aspect

Time: ✅ 3.836ms (SLO: <5.000ms 📉 -23.3%) vs baseline: -0.8%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ bytesio_noaspect

Time: ✅ 319.562µs (SLO: <420.000µs 📉 -23.9%) vs baseline: -0.7%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.7%


✅ capitalize_aspect

Time: ✅ 90.089µs (SLO: <300.000µs 📉 -70.0%) vs baseline: -0.3%

Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.8%


✅ capitalize_noaspect

Time: ✅ 253.214µs (SLO: <300.000µs 📉 -15.6%) vs baseline: -0.8%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%


✅ casefold_aspect

Time: ✅ 92.913µs (SLO: <500.000µs 📉 -81.4%) vs baseline: +3.0%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.9%


✅ casefold_noaspect

Time: ✅ 309.275µs (SLO: <500.000µs 📉 -38.1%) vs baseline: -0.5%

Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ decode_aspect

Time: ✅ 87.282µs (SLO: <100.000µs 📉 -12.7%) vs baseline: +0.2%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.0%


✅ decode_noaspect

Time: ✅ 152.371µs (SLO: <210.000µs 📉 -27.4%) vs baseline: -1.1%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.7%


✅ encode_aspect

Time: ✅ 84.761µs (SLO: <200.000µs 📉 -57.6%) vs baseline: -0.3%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.7%


✅ encode_noaspect

Time: ✅ 137.233µs (SLO: <200.000µs 📉 -31.4%) vs baseline: -0.4%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.0%


✅ format_aspect

Time: ✅ 14.705ms (SLO: <19.200ms 📉 -23.4%) vs baseline: -0.2%

Memory: ✅ 42.821MB (SLO: <43.250MB 🟡 -1.0%) vs baseline: +4.9%


✅ format_map_aspect

Time: ✅ 16.479ms (SLO: <21.500ms 📉 -23.4%) vs baseline: ~same

Memory: ✅ 42.821MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +4.8%


✅ format_map_noaspect

Time: ✅ 370.893µs (SLO: <500.000µs 📉 -25.8%) vs baseline: +0.1%

Memory: ✅ 42.585MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +4.3%


✅ format_noaspect

Time: ✅ 305.875µs (SLO: <500.000µs 📉 -38.8%) vs baseline: ~same

Memory: ✅ 42.605MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +4.9%


✅ index_aspect

Time: ✅ 123.865µs (SLO: <300.000µs 📉 -58.7%) vs baseline: +0.4%

Memory: ✅ 42.605MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +4.7%


✅ index_noaspect

Time: ✅ 40.645µs (SLO: <300.000µs 📉 -86.5%) vs baseline: ~same

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%


✅ join_aspect

Time: ✅ 219.274µs (SLO: <300.000µs 📉 -26.9%) vs baseline: +1.1%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.8%


✅ join_noaspect

Time: ✅ 148.983µs (SLO: <300.000µs 📉 -50.3%) vs baseline: +0.5%

Memory: ✅ 42.625MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +4.8%


✅ ljust_aspect

Time: ✅ 499.278µs (SLO: <700.000µs 📉 -28.7%) vs baseline: ~same

Memory: ✅ 42.585MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +4.7%


✅ ljust_noaspect

Time: ✅ 256.069µs (SLO: <300.000µs 📉 -14.6%) vs baseline: ~same

Memory: ✅ 42.625MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +4.9%


✅ lower_aspect

Time: ✅ 306.515µs (SLO: <500.000µs 📉 -38.7%) vs baseline: -0.3%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ lower_noaspect

Time: ✅ 232.522µs (SLO: <300.000µs 📉 -22.5%) vs baseline: -1.7%

Memory: ✅ 42.644MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +4.7%


✅ lstrip_aspect

Time: ✅ 0.271ms (SLO: <3.000ms 📉 -91.0%) vs baseline: -0.4%

Memory: ✅ 42.664MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +5.0%


✅ lstrip_noaspect

Time: ✅ 0.199ms (SLO: <3.000ms 📉 -93.4%) vs baseline: 📈 +12.4%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.9%


✅ modulo_aspect

Time: ✅ 14.379ms (SLO: <18.750ms 📉 -23.3%) vs baseline: ~same

Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.5%


✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 14.863ms (SLO: <19.350ms 📉 -23.2%) vs baseline: +0.1%

Memory: ✅ 42.821MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +4.7%


✅ modulo_aspect_for_bytes

Time: ✅ 14.506ms (SLO: <18.900ms 📉 -23.2%) vs baseline: +0.4%

Memory: ✅ 42.782MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +4.6%


✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 14.668ms (SLO: <19.150ms 📉 -23.4%) vs baseline: -0.4%

Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.9%


✅ modulo_noaspect

Time: ✅ 0.357ms (SLO: <3.000ms 📉 -88.1%) vs baseline: -0.5%

Memory: ✅ 42.723MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +5.2%


✅ replace_aspect

Time: ✅ 18.460ms (SLO: <24.000ms 📉 -23.1%) vs baseline: +0.1%

Memory: ✅ 42.821MB (SLO: <44.000MB -2.7%) vs baseline: +4.9%


✅ replace_noaspect

Time: ✅ 283.993µs (SLO: <300.000µs -5.3%) vs baseline: -0.4%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.7%


✅ repr_aspect

Time: ✅ 316.280µs (SLO: <420.000µs 📉 -24.7%) vs baseline: -0.5%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.8%


✅ repr_noaspect

Time: ✅ 46.701µs (SLO: <90.000µs 📉 -48.1%) vs baseline: +0.3%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ rstrip_aspect

Time: ✅ 379.808µs (SLO: <500.000µs 📉 -24.0%) vs baseline: +0.1%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.7%


✅ rstrip_noaspect

Time: ✅ 181.318µs (SLO: <300.000µs 📉 -39.6%) vs baseline: -0.4%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.0%


✅ slice_aspect

Time: ✅ 189.590µs (SLO: <300.000µs 📉 -36.8%) vs baseline: +3.7%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ slice_noaspect

Time: ✅ 53.958µs (SLO: <90.000µs 📉 -40.0%) vs baseline: -0.3%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.6%


✅ stringio_aspect

Time: ✅ 3.897ms (SLO: <5.000ms 📉 -22.1%) vs baseline: -0.1%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.6%


✅ stringio_noaspect

Time: ✅ 354.517µs (SLO: <500.000µs 📉 -29.1%) vs baseline: -0.4%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.5%


✅ strip_aspect

Time: ✅ 269.611µs (SLO: <350.000µs 📉 -23.0%) vs baseline: -0.3%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.7%


✅ strip_noaspect

Time: ✅ 178.639µs (SLO: <240.000µs 📉 -25.6%) vs baseline: +0.6%

Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +5.0%


✅ swapcase_aspect

Time: ✅ 345.832µs (SLO: <500.000µs 📉 -30.8%) vs baseline: +1.3%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.8%


✅ swapcase_noaspect

Time: ✅ 271.940µs (SLO: <400.000µs 📉 -32.0%) vs baseline: +0.4%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ title_aspect

Time: ✅ 333.084µs (SLO: <500.000µs 📉 -33.4%) vs baseline: ~same

Memory: ✅ 42.625MB (SLO: <43.000MB 🟡 -0.9%) vs baseline: +4.8%


✅ title_noaspect

Time: ✅ 260.599µs (SLO: <400.000µs 📉 -34.9%) vs baseline: +0.7%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.7%


✅ translate_aspect

Time: ✅ 501.946µs (SLO: <700.000µs 📉 -28.3%) vs baseline: +1.2%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.8%


✅ translate_noaspect

Time: ✅ 423.460µs (SLO: <500.000µs 📉 -15.3%) vs baseline: -2.3%

Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +5.1%


✅ upper_aspect

Time: ✅ 307.520µs (SLO: <500.000µs 📉 -38.5%) vs baseline: +0.5%

Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.8%


✅ upper_noaspect

Time: ✅ 234.745µs (SLO: <400.000µs 📉 -41.3%) vs baseline: +0.1%

Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.9%


📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 507.308µs (SLO: <700.000µs 📉 -27.5%) vs baseline: 📈 +20.2%

Memory: ✅ 42.290MB (SLO: <43.500MB -2.8%) vs baseline: +4.8%


✅ ospathbasename_noaspect

Time: ✅ 425.587µs (SLO: <700.000µs 📉 -39.2%) vs baseline: -0.2%

Memory: ✅ 42.467MB (SLO: <43.500MB -2.4%) vs baseline: +5.1%


✅ ospathjoin_aspect

Time: ✅ 617.360µs (SLO: <700.000µs 📉 -11.8%) vs baseline: -1.3%

Memory: ✅ 42.310MB (SLO: <43.500MB -2.7%) vs baseline: +5.1%


✅ ospathjoin_noaspect

Time: ✅ 631.811µs (SLO: <700.000µs -9.7%) vs baseline: ~same

Memory: ✅ 42.467MB (SLO: <43.500MB -2.4%) vs baseline: +5.1%


✅ ospathnormcase_aspect

Time: ✅ 352.790µs (SLO: <700.000µs 📉 -49.6%) vs baseline: +0.2%

Memory: ✅ 42.389MB (SLO: <43.500MB -2.6%) vs baseline: +4.8%


✅ ospathnormcase_noaspect

Time: ✅ 355.636µs (SLO: <700.000µs 📉 -49.2%) vs baseline: -0.5%

Memory: ✅ 42.330MB (SLO: <43.500MB -2.7%) vs baseline: +4.6%


✅ ospathsplit_aspect

Time: ✅ 486.392µs (SLO: <700.000µs 📉 -30.5%) vs baseline: -0.6%

Memory: ✅ 42.467MB (SLO: <43.500MB -2.4%) vs baseline: +5.0%


✅ ospathsplit_noaspect

Time: ✅ 497.531µs (SLO: <700.000µs 📉 -28.9%) vs baseline: +0.1%

Memory: ✅ 42.487MB (SLO: <43.500MB -2.3%) vs baseline: +5.4%


✅ ospathsplitdrive_aspect

Time: ✅ 371.562µs (SLO: <700.000µs 📉 -46.9%) vs baseline: ~same

Memory: ✅ 42.408MB (SLO: <43.500MB -2.5%) vs baseline: +4.9%


✅ ospathsplitdrive_noaspect

Time: ✅ 73.597µs (SLO: <700.000µs 📉 -89.5%) vs baseline: +1.3%

Memory: ✅ 42.389MB (SLO: <43.500MB -2.6%) vs baseline: +4.8%


✅ ospathsplitext_aspect

Time: ✅ 455.940µs (SLO: <700.000µs 📉 -34.9%) vs baseline: -0.3%

Memory: ✅ 42.330MB (SLO: <43.500MB -2.7%) vs baseline: +4.8%


✅ ospathsplitext_noaspect

Time: ✅ 460.252µs (SLO: <700.000µs 📉 -34.2%) vs baseline: +0.2%

Memory: ✅ 42.290MB (SLO: <43.500MB -2.8%) vs baseline: +4.8%


📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.406µs (SLO: <20.000µs 📉 -83.0%) vs baseline: 📈 +12.8%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.8%


✅ 1-count-metrics-100-times

Time: ✅ 199.886µs (SLO: <220.000µs -9.1%) vs baseline: -0.2%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.8%


✅ 1-distribution-metric-1-times

Time: ✅ 3.361µs (SLO: <20.000µs 📉 -83.2%) vs baseline: -0.6%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.0%


✅ 1-distribution-metrics-100-times

Time: ✅ 214.609µs (SLO: <230.000µs -6.7%) vs baseline: +0.2%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.7%


✅ 1-gauge-metric-1-times

Time: ✅ 2.196µs (SLO: <20.000µs 📉 -89.0%) vs baseline: -0.8%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%


✅ 1-gauge-metrics-100-times

Time: ✅ 137.166µs (SLO: <150.000µs -8.6%) vs baseline: +0.3%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.2%


✅ 1-rate-metric-1-times

Time: ✅ 3.173µs (SLO: <20.000µs 📉 -84.1%) vs baseline: ~same

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%


✅ 1-rate-metrics-100-times

Time: ✅ 214.854µs (SLO: <250.000µs 📉 -14.1%) vs baseline: +0.2%

Memory: ✅ 35.036MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +5.7%


✅ 100-count-metrics-100-times

Time: ✅ 19.958ms (SLO: <22.000ms -9.3%) vs baseline: +0.4%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.6%


✅ 100-distribution-metrics-100-times

Time: ✅ 2.222ms (SLO: <2.550ms 📉 -12.9%) vs baseline: -0.6%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.5%


✅ 100-gauge-metrics-100-times

Time: ✅ 1.411ms (SLO: <1.550ms -9.0%) vs baseline: +1.0%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.9%


✅ 100-rate-metrics-100-times

Time: ✅ 2.189ms (SLO: <2.550ms 📉 -14.1%) vs baseline: +0.7%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%


✅ flush-1-metric

Time: ✅ 4.590µs (SLO: <20.000µs 📉 -77.0%) vs baseline: -0.1%

Memory: ✅ 35.232MB (SLO: <35.500MB 🟡 -0.8%) vs baseline: +5.0%


✅ flush-100-metrics

Time: ✅ 173.495µs (SLO: <250.000µs 📉 -30.6%) vs baseline: -0.7%

Memory: ✅ 35.271MB (SLO: <35.500MB 🟡 -0.6%) vs baseline: +5.1%


✅ flush-1000-metrics

Time: ✅ 2.185ms (SLO: <2.500ms 📉 -12.6%) vs baseline: +0.2%

Memory: ✅ 36.137MB (SLO: <36.500MB 🟡 -1.0%) vs baseline: +4.9%

🟡 Near SLO Breach (14 suites)
🟡 coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.254µs (SLO: <20.000µs 📉 -33.7%) vs baseline: ~same

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.1%


✅ context_with_data_no_listeners

Time: ✅ 3.261µs (SLO: <10.000µs 📉 -67.4%) vs baseline: ~same

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.0%


✅ get_item_exists

Time: ✅ 0.584µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +0.6%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.4%


✅ get_item_missing

Time: ✅ 0.633µs (SLO: <10.000µs 📉 -93.7%) vs baseline: -0.8%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.5%


✅ set_item

Time: ✅ 24.124µs (SLO: <30.000µs 📉 -19.6%) vs baseline: -0.5%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.1%


🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 19.456ms (SLO: <22.300ms 📉 -12.8%) vs baseline: -0.4%

Memory: ✅ 68.203MB (SLO: <70.500MB -3.3%) vs baseline: +4.8%


✅ exception-replay-enabled

Time: ✅ 1.371ms (SLO: <1.450ms -5.5%) vs baseline: ~same

Memory: ✅ 66.396MB (SLO: <67.500MB 🟡 -1.6%) vs baseline: +5.1%


✅ iast

Time: ✅ 19.467ms (SLO: <22.250ms 📉 -12.5%) vs baseline: -0.2%

Memory: ✅ 68.243MB (SLO: <70.000MB -2.5%) vs baseline: +4.9%


✅ profiler

Time: ✅ 15.219ms (SLO: <16.550ms -8.0%) vs baseline: -0.5%

Memory: ✅ 56.443MB (SLO: <57.500MB 🟡 -1.8%) vs baseline: +4.9%


✅ resource-renaming

Time: ✅ 19.583ms (SLO: <21.750ms -10.0%) vs baseline: +0.6%

Memory: ✅ 68.302MB (SLO: <70.500MB -3.1%) vs baseline: +4.9%


✅ span-code-origin

Time: ✅ 19.948ms (SLO: <28.200ms 📉 -29.3%) vs baseline: +1.9%

Memory: ✅ 68.051MB (SLO: <71.000MB -4.2%) vs baseline: +4.7%


✅ tracer

Time: ✅ 19.586ms (SLO: <21.750ms -10.0%) vs baseline: +0.8%

Memory: ✅ 68.262MB (SLO: <70.000MB -2.5%) vs baseline: +4.9%


✅ tracer-and-profiler

Time: ✅ 21.610ms (SLO: <23.500ms -8.0%) vs baseline: ~same

Memory: ✅ 69.796MB (SLO: <71.000MB 🟡 -1.7%) vs baseline: +4.8%


✅ tracer-dont-create-db-spans

Time: ✅ 19.507ms (SLO: <21.500ms -9.3%) vs baseline: -1.0%

Memory: ✅ 68.184MB (SLO: <70.000MB -2.6%) vs baseline: +4.8%


✅ tracer-minimal

Time: ✅ 16.706ms (SLO: <17.500ms -4.5%) vs baseline: -0.6%

Memory: ✅ 68.125MB (SLO: <70.000MB -2.7%) vs baseline: +4.8%


✅ tracer-native

Time: ✅ 19.477ms (SLO: <21.750ms 📉 -10.5%) vs baseline: +0.3%

Memory: ✅ 68.282MB (SLO: <72.500MB -5.8%) vs baseline: +5.1%


✅ tracer-no-caches

Time: ✅ 17.901ms (SLO: <19.650ms -8.9%) vs baseline: ~same

Memory: ✅ 68.144MB (SLO: <70.000MB -2.7%) vs baseline: +4.8%


✅ tracer-no-databases

Time: ✅ 19.449ms (SLO: <20.100ms -3.2%) vs baseline: +0.7%

Memory: ✅ 67.948MB (SLO: <70.000MB -2.9%) vs baseline: +4.6%


✅ tracer-no-middleware

Time: ✅ 19.250ms (SLO: <21.500ms 📉 -10.5%) vs baseline: +0.1%

Memory: ✅ 68.282MB (SLO: <70.000MB -2.5%) vs baseline: +4.9%


✅ tracer-no-templates

Time: ✅ 19.593ms (SLO: <22.000ms 📉 -10.9%) vs baseline: +1.5%

Memory: ✅ 68.241MB (SLO: <70.500MB -3.2%) vs baseline: +4.9%


🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 16.271ms (SLO: <19.850ms 📉 -18.0%) vs baseline: -0.7%

Memory: ✅ 69.793MB (SLO: <70.000MB 🟡 -0.3%) vs baseline: +4.9%


✅ errortracking-enabled-user

Time: ✅ 16.293ms (SLO: <19.400ms 📉 -16.0%) vs baseline: -0.6%

Memory: ✅ 69.811MB (SLO: <70.000MB 🟡 -0.3%) vs baseline: +4.9%


✅ tracer-enabled

Time: ✅ 16.312ms (SLO: <19.450ms 📉 -16.1%) vs baseline: ~same

Memory: ✅ 69.794MB (SLO: <70.000MB 🟡 -0.3%) vs baseline: +4.8%


🟡 errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.070ms (SLO: <2.300ms -10.0%) vs baseline: -0.3%

Memory: ✅ 55.758MB (SLO: <56.500MB 🟡 -1.3%) vs baseline: +4.8%


✅ errortracking-enabled-user

Time: ✅ 2.083ms (SLO: <2.250ms -7.4%) vs baseline: +0.4%

Memory: ✅ 55.778MB (SLO: <56.500MB 🟡 -1.3%) vs baseline: +4.9%


✅ tracer-enabled

Time: ✅ 2.065ms (SLO: <2.300ms 📉 -10.2%) vs baseline: +0.3%

Memory: ✅ 55.719MB (SLO: <56.500MB 🟡 -1.4%) vs baseline: +4.9%


🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 3.390ms (SLO: <4.750ms 📉 -28.6%) vs baseline: +0.3%

Memory: ✅ 55.746MB (SLO: <66.500MB 📉 -16.2%) vs baseline: +4.9%


✅ appsec-post

Time: ✅ 2.860ms (SLO: <6.750ms 📉 -57.6%) vs baseline: +0.1%

Memory: ✅ 55.743MB (SLO: <66.500MB 📉 -16.2%) vs baseline: +4.9%


✅ appsec-telemetry

Time: ✅ 3.408ms (SLO: <4.750ms 📉 -28.3%) vs baseline: +1.2%

Memory: ✅ 55.730MB (SLO: <66.500MB 📉 -16.2%) vs baseline: +4.8%


✅ debugger

Time: ✅ 1.868ms (SLO: <2.000ms -6.6%) vs baseline: ~same

Memory: ✅ 47.825MB (SLO: <49.500MB -3.4%) vs baseline: +4.8%


✅ iast-get

Time: ✅ 1.861ms (SLO: <2.000ms -7.0%) vs baseline: ~same

Memory: ✅ 44.720MB (SLO: <49.000MB -8.7%) vs baseline: +4.7%


✅ profiler

Time: ✅ 1.900ms (SLO: <2.100ms -9.5%) vs baseline: -0.2%

Memory: ✅ 48.686MB (SLO: <50.000MB -2.6%) vs baseline: +4.9%


✅ resource-renaming

Time: ✅ 3.358ms (SLO: <3.650ms -8.0%) vs baseline: +0.2%

Memory: ✅ 55.762MB (SLO: <56.000MB 🟡 -0.4%) vs baseline: +4.9%


✅ tracer

Time: ✅ 3.366ms (SLO: <3.650ms -7.8%) vs baseline: ~same

Memory: ✅ 55.728MB (SLO: <56.500MB 🟡 -1.4%) vs baseline: +4.8%


✅ tracer-native

Time: ✅ 3.369ms (SLO: <3.650ms -7.7%) vs baseline: +0.2%

Memory: ✅ 55.743MB (SLO: <60.000MB -7.1%) vs baseline: +4.8%


🟡 flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 2.060ms (SLO: <4.200ms 📉 -50.9%) vs baseline: -0.3%

Memory: ✅ 55.758MB (SLO: <66.000MB 📉 -15.5%) vs baseline: +4.8%


✅ iast-enabled

Time: ✅ 2.071ms (SLO: <2.800ms 📉 -26.0%) vs baseline: +0.1%

Memory: ✅ 55.797MB (SLO: <62.500MB 📉 -10.7%) vs baseline: +4.8%


✅ tracer-enabled

Time: ✅ 2.057ms (SLO: <2.250ms -8.6%) vs baseline: ~same

Memory: ✅ 55.797MB (SLO: <56.500MB 🟡 -1.2%) vs baseline: +4.9%


🟡 httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 85.388µs (SLO: <100.000µs 📉 -14.6%) vs baseline: +5.0%

Memory: ✅ 35.095MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +5.2%


✅ b3_headers

Time: ✅ 14.430µs (SLO: <20.000µs 📉 -27.9%) vs baseline: +0.2%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.0%


✅ b3_single_headers

Time: ✅ 13.466µs (SLO: <20.000µs 📉 -32.7%) vs baseline: ~same

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.9%


✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 64.103µs (SLO: <80.000µs 📉 -19.9%) vs baseline: +0.2%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.7%


✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 66.206µs (SLO: <80.000µs 📉 -17.2%) vs baseline: -0.2%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.8%


✅ empty_headers

Time: ✅ 1.601µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.1%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.7%


✅ full_t_id_datadog_headers

Time: ✅ 22.735µs (SLO: <30.000µs 📉 -24.2%) vs baseline: -0.3%

Memory: ✅ 35.055MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +5.1%


✅ invalid_priority_header

Time: ✅ 6.492µs (SLO: <10.000µs 📉 -35.1%) vs baseline: +0.4%

Memory: ✅ 35.055MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +5.1%


✅ invalid_span_id_header

Time: ✅ 6.515µs (SLO: <10.000µs 📉 -34.9%) vs baseline: +0.4%

Memory: ✅ 35.055MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +5.1%


✅ invalid_tags_header

Time: ✅ 6.531µs (SLO: <10.000µs 📉 -34.7%) vs baseline: +0.3%

Memory: ✅ 35.036MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +4.9%


✅ invalid_trace_id_header

Time: ✅ 6.504µs (SLO: <10.000µs 📉 -35.0%) vs baseline: -0.5%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.7%


✅ large_header_no_matches

Time: ✅ 27.584µs (SLO: <30.000µs -8.1%) vs baseline: -0.2%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.7%


✅ large_valid_headers_all

Time: ✅ 28.890µs (SLO: <40.000µs 📉 -27.8%) vs baseline: +0.5%

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.9%


✅ medium_header_no_matches

Time: ✅ 9.834µs (SLO: <20.000µs 📉 -50.8%) vs baseline: -0.2%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.7%


✅ medium_valid_headers_all

Time: ✅ 11.268µs (SLO: <20.000µs 📉 -43.7%) vs baseline: +0.8%

Memory: ✅ 35.173MB (SLO: <35.500MB 🟡 -0.9%) vs baseline: +5.3%


✅ none_propagation_style

Time: ✅ 1.699µs (SLO: <10.000µs 📉 -83.0%) vs baseline: -0.7%

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.7%


✅ tracecontext_headers

Time: ✅ 34.965µs (SLO: <40.000µs 📉 -12.6%) vs baseline: +0.5%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.6%


✅ valid_headers_all

Time: ✅ 6.517µs (SLO: <10.000µs 📉 -34.8%) vs baseline: +0.4%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.8%


✅ valid_headers_basic

Time: ✅ 6.011µs (SLO: <10.000µs 📉 -39.9%) vs baseline: -0.5%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.8%


✅ wsgi_empty_headers

Time: ✅ 1.601µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -0.2%

Memory: ✅ 35.036MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +4.9%


✅ wsgi_invalid_priority_header

Time: ✅ 6.533µs (SLO: <10.000µs 📉 -34.7%) vs baseline: +0.5%

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.9%


✅ wsgi_invalid_span_id_header

Time: ✅ 1.594µs (SLO: <10.000µs 📉 -84.1%) vs baseline: +0.2%

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.8%


✅ wsgi_invalid_tags_header

Time: ✅ 6.563µs (SLO: <10.000µs 📉 -34.4%) vs baseline: +0.1%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.7%


✅ wsgi_invalid_trace_id_header

Time: ✅ 6.581µs (SLO: <10.000µs 📉 -34.2%) vs baseline: +0.5%

Memory: ✅ 35.055MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +5.3%


✅ wsgi_large_header_no_matches

Time: ✅ 28.698µs (SLO: <40.000µs 📉 -28.3%) vs baseline: -0.4%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.0%


✅ wsgi_large_valid_headers_all

Time: ✅ 30.000µs (SLO: <40.000µs 📉 -25.0%) vs baseline: +0.4%

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.7%


✅ wsgi_medium_header_no_matches

Time: ✅ 10.145µs (SLO: <20.000µs 📉 -49.3%) vs baseline: +0.1%

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.0%


✅ wsgi_medium_valid_headers_all

Time: ✅ 11.569µs (SLO: <20.000µs 📉 -42.2%) vs baseline: -0.2%

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.8%


✅ wsgi_valid_headers_all

Time: ✅ 6.572µs (SLO: <10.000µs 📉 -34.3%) vs baseline: +0.5%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.8%


✅ wsgi_valid_headers_basic

Time: ✅ 6.057µs (SLO: <10.000µs 📉 -39.4%) vs baseline: -0.8%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.7%


🟡 httppropagationinject - 16/16

✅ ids_only

Time: ✅ 21.888µs (SLO: <30.000µs 📉 -27.0%) vs baseline: +4.8%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.8%


✅ with_all

Time: ✅ 27.871µs (SLO: <40.000µs 📉 -30.3%) vs baseline: ~same

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.0%


✅ with_dd_origin

Time: ✅ 24.697µs (SLO: <30.000µs 📉 -17.7%) vs baseline: +0.5%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.0%


✅ with_priority_and_origin

Time: ✅ 23.866µs (SLO: <40.000µs 📉 -40.3%) vs baseline: -0.7%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.6%


✅ with_sampling_priority

Time: ✅ 20.818µs (SLO: <30.000µs 📉 -30.6%) vs baseline: -0.5%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.9%


✅ with_tags

Time: ✅ 25.846µs (SLO: <40.000µs 📉 -35.4%) vs baseline: -1.0%

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.0%


✅ with_tags_invalid

Time: ✅ 27.404µs (SLO: <40.000µs 📉 -31.5%) vs baseline: -0.3%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.0%


✅ with_tags_max_size

Time: ✅ 26.330µs (SLO: <40.000µs 📉 -34.2%) vs baseline: -0.2%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.9%


🟡 ratelimiter - 12/12

✅ defaults

Time: ✅ 2.364µs (SLO: <10.000µs 📉 -76.4%) vs baseline: +0.5%

Memory: ✅ 35.134MB (SLO: <35.500MB 🟡 -1.0%) vs baseline: +4.3%


✅ high_rate_limit

Time: ✅ 2.415µs (SLO: <10.000µs 📉 -75.9%) vs baseline: +1.0%

Memory: ✅ 35.232MB (SLO: <35.500MB 🟡 -0.8%) vs baseline: +4.6%


✅ long_window

Time: ✅ 2.356µs (SLO: <10.000µs 📉 -76.4%) vs baseline: -0.2%

Memory: ✅ 35.291MB (SLO: <35.500MB 🟡 -0.6%) vs baseline: +5.0%


✅ low_rate_limit

Time: ✅ 2.371µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +0.2%

Memory: ✅ 35.212MB (SLO: <35.500MB 🟡 -0.8%) vs baseline: +4.9%


✅ no_rate_limit

Time: ✅ 0.824µs (SLO: <10.000µs 📉 -91.8%) vs baseline: +0.1%

Memory: ✅ 35.232MB (SLO: <35.500MB 🟡 -0.8%) vs baseline: +5.0%


✅ short_window

Time: ✅ 2.490µs (SLO: <10.000µs 📉 -75.1%) vs baseline: ~same

Memory: ✅ 35.291MB (SLO: <35.500MB 🟡 -0.6%) vs baseline: +4.9%


🟡 recursivecomputation - 8/8

✅ deep

Time: ✅ 309.340ms (SLO: <320.950ms -3.6%) vs baseline: -0.1%

Memory: ✅ 36.137MB (SLO: <36.500MB 🟡 -1.0%) vs baseline: +4.7%


✅ deep-profiled

Time: ✅ 326.913ms (SLO: <359.150ms -9.0%) vs baseline: ~same

Memory: ✅ 39.931MB (SLO: <40.500MB 🟡 -1.4%) vs baseline: +4.9%


✅ medium

Time: ✅ 6.998ms (SLO: <7.400ms -5.4%) vs baseline: ~same

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.5%


✅ shallow

Time: ✅ 0.949ms (SLO: <1.050ms -9.6%) vs baseline: +1.1%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.7%


🟡 samplingrules - 8/8

✅ average_match

Time: ✅ 136.070µs (SLO: <290.000µs 📉 -53.1%) vs baseline: -1.0%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.6%


✅ high_match

Time: ✅ 174.756µs (SLO: <480.000µs 📉 -63.6%) vs baseline: +1.4%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ low_match

Time: ✅ 98.297µs (SLO: <120.000µs 📉 -18.1%) vs baseline: -0.8%

Memory: ✅ 603.700MB (SLO: <700.000MB 📉 -13.8%) vs baseline: +4.8%


✅ very_low_match

Time: ✅ 2.661ms (SLO: <8.500ms 📉 -68.7%) vs baseline: +0.3%

Memory: ✅ 71.123MB (SLO: <75.000MB -5.2%) vs baseline: +4.7%


🟡 sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.512µs (SLO: <20.000µs 📉 -47.4%) vs baseline: +0.2%

Memory: ✅ 35.724MB (SLO: <36.000MB 🟡 -0.8%) vs baseline: +4.5%


✅ all-enabled

Time: ✅ 41.101µs (SLO: <50.000µs 📉 -17.8%) vs baseline: +2.7%

Memory: ✅ 35.763MB (SLO: <36.000MB 🟡 -0.7%) vs baseline: +4.7%


✅ collectipvariant_exists

Time: ✅ 41.010µs (SLO: <50.000µs 📉 -18.0%) vs baseline: +0.7%

Memory: ✅ 35.783MB (SLO: <36.000MB 🟡 -0.6%) vs baseline: +4.9%


✅ no-collectipvariant

Time: ✅ 40.049µs (SLO: <50.000µs 📉 -19.9%) vs baseline: +0.1%

Memory: ✅ 35.743MB (SLO: <36.000MB 🟡 -0.7%) vs baseline: +4.6%


✅ no-useragentvariant

Time: ✅ 39.037µs (SLO: <50.000µs 📉 -21.9%) vs baseline: +0.5%

Memory: ✅ 35.783MB (SLO: <36.000MB 🟡 -0.6%) vs baseline: +4.8%


✅ obfuscation-no-query

Time: ✅ 40.412µs (SLO: <50.000µs 📉 -19.2%) vs baseline: -0.1%

Memory: ✅ 35.842MB (SLO: <36.000MB 🟡 -0.4%) vs baseline: +5.0%


✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.745µs (SLO: <90.000µs 📉 -15.8%) vs baseline: ~same

Memory: ✅ 35.743MB (SLO: <36.500MB -2.1%) vs baseline: +4.3%


✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.214µs (SLO: <90.000µs 📉 -15.3%) vs baseline: +0.3%

Memory: ✅ 35.842MB (SLO: <36.500MB 🟡 -1.8%) vs baseline: +5.2%


✅ obfuscation-send-querystring-disabled

Time: ✅ 154.334µs (SLO: <170.000µs -9.2%) vs baseline: ~same

Memory: ✅ 35.842MB (SLO: <36.500MB 🟡 -1.8%) vs baseline: +5.0%


✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.817µs (SLO: <160.000µs -7.0%) vs baseline: +0.1%

Memory: ✅ 35.802MB (SLO: <36.500MB 🟡 -1.9%) vs baseline: +4.8%


✅ obfuscation-worst-case-implicit-query

Time: ✅ 154.833µs (SLO: <170.000µs -8.9%) vs baseline: ~same

Memory: ✅ 35.802MB (SLO: <36.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ useragentvariant_exists_1

Time: ✅ 39.494µs (SLO: <50.000µs 📉 -21.0%) vs baseline: +0.1%

Memory: ✅ 35.822MB (SLO: <36.000MB 🟡 -0.5%) vs baseline: +4.6%


✅ useragentvariant_exists_2

Time: ✅ 40.786µs (SLO: <50.000µs 📉 -18.4%) vs baseline: +0.2%

Memory: ✅ 35.861MB (SLO: <36.000MB 🟡 -0.4%) vs baseline: +5.0%


✅ useragentvariant_exists_3

Time: ✅ 40.190µs (SLO: <50.000µs 📉 -19.6%) vs baseline: ~same

Memory: ✅ 35.783MB (SLO: <36.000MB 🟡 -0.6%) vs baseline: +4.9%


✅ useragentvariant_not_exists_1

Time: ✅ 39.788µs (SLO: <50.000µs 📉 -20.4%) vs baseline: +0.8%

Memory: ✅ 35.842MB (SLO: <36.000MB 🟡 -0.4%) vs baseline: +4.9%


✅ useragentvariant_not_exists_2

Time: ✅ 39.621µs (SLO: <50.000µs 📉 -20.8%) vs baseline: +0.2%

Memory: ✅ 35.822MB (SLO: <36.000MB 🟡 -0.5%) vs baseline: +5.0%


🟡 span - 26/26

✅ add-event

Time: ✅ 18.171ms (SLO: <22.500ms 📉 -19.2%) vs baseline: -0.2%

Memory: ✅ 37.063MB (SLO: <53.000MB 📉 -30.1%) vs baseline: +4.8%


✅ add-metrics

Time: ✅ 88.239ms (SLO: <93.500ms -5.6%) vs baseline: ~same

Memory: ✅ 41.244MB (SLO: <53.000MB 📉 -22.2%) vs baseline: +4.8%


✅ add-tags

Time: ✅ 141.104ms (SLO: <155.000ms -9.0%) vs baseline: -0.6%

Memory: ✅ 41.184MB (SLO: <53.000MB 📉 -22.3%) vs baseline: +4.6%


✅ get-context

Time: ✅ 17.013ms (SLO: <20.500ms 📉 -17.0%) vs baseline: +0.7%

Memory: ✅ 36.805MB (SLO: <53.000MB 📉 -30.6%) vs baseline: +4.8%


✅ is-recording

Time: ✅ 17.190ms (SLO: <20.500ms 📉 -16.1%) vs baseline: ~same

Memory: ✅ 36.882MB (SLO: <53.000MB 📉 -30.4%) vs baseline: +4.9%


✅ record-exception

Time: ✅ 36.634ms (SLO: <40.000ms -8.4%) vs baseline: -0.4%

Memory: ✅ 37.587MB (SLO: <53.000MB 📉 -29.1%) vs baseline: +5.3%


✅ set-status

Time: ✅ 18.698ms (SLO: <22.000ms 📉 -15.0%) vs baseline: +0.2%

Memory: ✅ 36.885MB (SLO: <53.000MB 📉 -30.4%) vs baseline: +5.0%


✅ start

Time: ✅ 17.279ms (SLO: <20.500ms 📉 -15.7%) vs baseline: +2.8%

Memory: ✅ 36.923MB (SLO: <53.000MB 📉 -30.3%) vs baseline: +5.1%


✅ start-finish

Time: ✅ 51.049ms (SLO: <52.500ms -2.8%) vs baseline: -0.1%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.9%


✅ start-finish-telemetry

Time: ✅ 52.930ms (SLO: <54.500ms -2.9%) vs baseline: +1.0%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.9%


✅ start-finish-traceid128

Time: ✅ 53.997ms (SLO: <57.000ms -5.3%) vs baseline: ~same

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.7%


✅ start-traceid128

Time: ✅ 17.286ms (SLO: <22.500ms 📉 -23.2%) vs baseline: -0.4%

Memory: ✅ 36.882MB (SLO: <53.000MB 📉 -30.4%) vs baseline: +4.6%


✅ update-name

Time: ✅ 17.413ms (SLO: <22.000ms 📉 -20.8%) vs baseline: +0.9%

Memory: ✅ 36.988MB (SLO: <53.000MB 📉 -30.2%) vs baseline: +5.2%


🟡 tracer - 6/6

✅ large

Time: ✅ 29.041ms (SLO: <32.950ms 📉 -11.9%) vs baseline: -0.8%

Memory: ✅ 36.019MB (SLO: <36.500MB 🟡 -1.3%) vs baseline: +4.4%


✅ medium

Time: ✅ 2.880ms (SLO: <3.200ms -10.0%) vs baseline: +0.3%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.2%


✅ small

Time: ✅ 329.932µs (SLO: <370.000µs 📉 -10.8%) vs baseline: +1.3%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%

⚠️ Unstable Tests (1 suite)
⚠️ packagesupdateimporteddependencies - 24/24 (1 unstable)

✅ import_many

Time: ✅ 155.404µs (SLO: <170.000µs -8.6%) vs baseline: +0.7%

Memory: ✅ 39.699MB (SLO: <43.000MB -7.7%) vs baseline: +4.8%


✅ import_many_cached

Time: ✅ 121.125µs (SLO: <130.000µs -6.8%) vs baseline: -0.4%

Memory: ✅ 39.872MB (SLO: <43.000MB -7.3%) vs baseline: +5.7%


✅ import_many_stdlib

Time: ✅ 0.757ms (SLO: <1.750ms 📉 -56.7%) vs baseline: -0.4%

Memory: ✅ 39.690MB (SLO: <43.000MB -7.7%) vs baseline: +5.2%


⚠️ import_many_stdlib_cached

Time: ⚠️ 0.172ms (SLO: <1.100ms 📉 -84.4%) vs baseline: +0.1%

Memory: ✅ 39.990MB (SLO: <43.000MB -7.0%) vs baseline: +5.2%


✅ import_many_unknown

Time: ✅ 838.674µs (SLO: <890.000µs -5.8%) vs baseline: +0.9%

Memory: ✅ 39.828MB (SLO: <43.000MB -7.4%) vs baseline: +4.9%


✅ import_many_unknown_cached

Time: ✅ 790.034µs (SLO: <870.000µs -9.2%) vs baseline: ~same

Memory: ✅ 39.829MB (SLO: <43.000MB -7.4%) vs baseline: +4.8%


✅ import_one

Time: ✅ 19.835µs (SLO: <30.000µs 📉 -33.9%) vs baseline: +0.2%

Memory: ✅ 39.488MB (SLO: <43.000MB -8.2%) vs baseline: +3.3%


✅ import_one_cache

Time: ✅ 6.317µs (SLO: <10.000µs 📉 -36.8%) vs baseline: +0.8%

Memory: ✅ 39.840MB (SLO: <43.000MB -7.3%) vs baseline: +5.0%


✅ import_one_stdlib

Time: ✅ 18.665µs (SLO: <20.000µs -6.7%) vs baseline: +0.4%

Memory: ✅ 39.748MB (SLO: <43.000MB -7.6%) vs baseline: +4.8%


✅ import_one_stdlib_cache

Time: ✅ 6.280µs (SLO: <10.000µs 📉 -37.2%) vs baseline: -0.5%

Memory: ✅ 39.639MB (SLO: <43.000MB -7.8%) vs baseline: +4.8%


✅ import_one_unknown

Time: ✅ 45.270µs (SLO: <50.000µs -9.5%) vs baseline: -0.3%

Memory: ✅ 39.566MB (SLO: <43.000MB -8.0%) vs baseline: +4.9%


✅ import_one_unknown_cache

Time: ✅ 6.284µs (SLO: <10.000µs 📉 -37.2%) vs baseline: +0.4%

Memory: ✅ 39.499MB (SLO: <43.000MB -8.1%) vs baseline: +4.5%

✅ All Tests Passing (6 suites)
iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 3.740ms (SLO: <4.880ms 📉 -23.4%) vs baseline: +7.1%

Memory: ✅ 42.192MB (SLO: <43.500MB -3.0%) vs baseline: +4.1%


✅ re_expand_noaspect

Time: ✅ 3.517ms (SLO: <4.620ms 📉 -23.9%) vs baseline: +0.9%

Memory: ✅ 42.113MB (SLO: <43.500MB -3.2%) vs baseline: +4.5%


✅ re_findall_aspect

Time: ✅ 342.894µs (SLO: <450.000µs 📉 -23.8%) vs baseline: +1.4%

Memory: ✅ 42.369MB (SLO: <43.500MB -2.6%) vs baseline: +5.2%


✅ re_findall_noaspect

Time: ✅ 322.167µs (SLO: <430.000µs 📉 -25.1%) vs baseline: -0.1%

Memory: ✅ 42.349MB (SLO: <43.500MB -2.6%) vs baseline: +5.1%


✅ re_finditer_aspect

Time: ✅ 454.207µs (SLO: <590.000µs 📉 -23.0%) vs baseline: +0.8%

Memory: ✅ 42.389MB (SLO: <43.500MB -2.6%) vs baseline: +4.7%


✅ re_finditer_noaspect

Time: ✅ 325.345µs (SLO: <440.000µs 📉 -26.1%) vs baseline: -1.0%

Memory: ✅ 42.349MB (SLO: <43.500MB -2.6%) vs baseline: +4.8%


✅ re_fullmatch_aspect

Time: ✅ 275.690µs (SLO: <360.000µs 📉 -23.4%) vs baseline: +0.6%

Memory: ✅ 42.487MB (SLO: <43.500MB -2.3%) vs baseline: +5.3%


✅ re_fullmatch_noaspect

Time: ✅ 306.868µs (SLO: <400.000µs 📉 -23.3%) vs baseline: -0.7%

Memory: ✅ 42.428MB (SLO: <43.500MB -2.5%) vs baseline: +5.4%


✅ re_group_aspect

Time: ✅ 478.680µs (SLO: <630.000µs 📉 -24.0%) vs baseline: +0.3%

Memory: ✅ 42.271MB (SLO: <43.500MB -2.8%) vs baseline: +5.0%


✅ re_group_noaspect

Time: ✅ 481.338µs (SLO: <640.000µs 📉 -24.8%) vs baseline: -0.3%

Memory: ✅ 42.290MB (SLO: <43.500MB -2.8%) vs baseline: +4.4%


✅ re_groups_aspect

Time: ✅ 490.650µs (SLO: <650.000µs 📉 -24.5%) vs baseline: -0.3%

Memory: ✅ 42.271MB (SLO: <43.500MB -2.8%) vs baseline: +4.9%


✅ re_groups_noaspect

Time: ✅ 497.008µs (SLO: <650.000µs 📉 -23.5%) vs baseline: -0.6%

Memory: ✅ 42.330MB (SLO: <43.500MB -2.7%) vs baseline: +4.8%


✅ re_match_aspect

Time: ✅ 280.822µs (SLO: <370.000µs 📉 -24.1%) vs baseline: +0.5%

Memory: ✅ 42.330MB (SLO: <43.500MB -2.7%) vs baseline: +4.9%


✅ re_match_noaspect

Time: ✅ 304.884µs (SLO: <410.000µs 📉 -25.6%) vs baseline: +0.1%

Memory: ✅ 42.212MB (SLO: <43.500MB -3.0%) vs baseline: +4.5%


✅ re_search_aspect

Time: ✅ 266.633µs (SLO: <350.000µs 📉 -23.8%) vs baseline: +2.7%

Memory: ✅ 42.212MB (SLO: <43.500MB -3.0%) vs baseline: +4.7%


✅ re_search_noaspect

Time: ✅ 287.618µs (SLO: <380.000µs 📉 -24.3%) vs baseline: +0.4%

Memory: ✅ 42.251MB (SLO: <43.500MB -2.9%) vs baseline: +4.4%


✅ re_sub_aspect

Time: ✅ 353.118µs (SLO: <460.000µs 📉 -23.2%) vs baseline: +1.2%

Memory: ✅ 42.330MB (SLO: <43.500MB -2.7%) vs baseline: +5.1%


✅ re_sub_noaspect

Time: ✅ 393.863µs (SLO: <520.000µs 📉 -24.3%) vs baseline: +0.5%

Memory: ✅ 42.212MB (SLO: <43.500MB -3.0%) vs baseline: +4.5%


✅ re_subn_aspect

Time: ✅ 370.663µs (SLO: <490.000µs 📉 -24.4%) vs baseline: +0.4%

Memory: ✅ 42.349MB (SLO: <43.500MB -2.6%) vs baseline: +5.3%


✅ re_subn_noaspect

Time: ✅ 404.750µs (SLO: <530.000µs 📉 -23.6%) vs baseline: ~same

Memory: ✅ 42.330MB (SLO: <43.500MB -2.7%) vs baseline: +4.8%


iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 155.866µs (SLO: <250.000µs 📉 -37.7%) vs baseline: +3.5%

Memory: ✅ 42.585MB (SLO: <44.000MB -3.2%) vs baseline: +4.6%


✅ rsplit_noaspect

Time: ✅ 161.568µs (SLO: <250.000µs 📉 -35.4%) vs baseline: +0.5%

Memory: ✅ 42.546MB (SLO: <44.000MB -3.3%) vs baseline: +4.6%


✅ split_aspect

Time: ✅ 154.378µs (SLO: <250.000µs 📉 -38.2%) vs baseline: +1.4%

Memory: ✅ 42.703MB (SLO: <44.000MB -2.9%) vs baseline: +5.1%


✅ split_noaspect

Time: ✅ 160.056µs (SLO: <250.000µs 📉 -36.0%) vs baseline: -1.7%

Memory: ✅ 42.644MB (SLO: <44.000MB -3.1%) vs baseline: +5.0%


✅ splitlines_aspect

Time: ✅ 149.646µs (SLO: <250.000µs 📉 -40.1%) vs baseline: +1.1%

Memory: ✅ 42.664MB (SLO: <44.000MB -3.0%) vs baseline: +5.0%


✅ splitlines_noaspect

Time: ✅ 154.282µs (SLO: <250.000µs 📉 -38.3%) vs baseline: -0.2%

Memory: ✅ 42.605MB (SLO: <44.000MB -3.2%) vs baseline: +4.6%


iastpropagation - 8/8

✅ no-propagation

Time: ✅ 48.890µs (SLO: <60.000µs 📉 -18.5%) vs baseline: -0.5%

Memory: ✅ 38.398MB (SLO: <42.000MB -8.6%) vs baseline: +4.6%


✅ propagation_enabled

Time: ✅ 136.648µs (SLO: <190.000µs 📉 -28.1%) vs baseline: +0.7%

Memory: ✅ 38.378MB (SLO: <42.000MB -8.6%) vs baseline: +4.9%


✅ propagation_enabled_100

Time: ✅ 1.584ms (SLO: <2.300ms 📉 -31.2%) vs baseline: -0.3%

Memory: ✅ 38.299MB (SLO: <42.000MB -8.8%) vs baseline: +4.0%


✅ propagation_enabled_1000

Time: ✅ 29.149ms (SLO: <34.550ms 📉 -15.6%) vs baseline: ~same

Memory: ✅ 38.633MB (SLO: <42.000MB -8.0%) vs baseline: +4.8%


otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.394ms (SLO: <42.000ms -3.8%) vs baseline: -0.1%

Memory: ✅ 37.788MB (SLO: <39.000MB -3.1%) vs baseline: +5.0%


✅ add-link

Time: ✅ 36.252ms (SLO: <38.550ms -6.0%) vs baseline: -0.5%

Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +4.5%


✅ add-metrics

Time: ✅ 218.791ms (SLO: <232.000ms -5.7%) vs baseline: -0.3%

Memory: ✅ 37.808MB (SLO: <39.000MB -3.1%) vs baseline: +5.0%


✅ add-tags

Time: ✅ 212.878ms (SLO: <221.600ms -3.9%) vs baseline: +0.5%

Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +4.7%


✅ get-context

Time: ✅ 29.054ms (SLO: <31.300ms -7.2%) vs baseline: -0.2%

Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +4.7%


✅ is-recording

Time: ✅ 29.293ms (SLO: <31.000ms -5.5%) vs baseline: +0.4%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ record-exception

Time: ✅ 62.967ms (SLO: <65.850ms -4.4%) vs baseline: -0.5%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.8%


✅ set-status

Time: ✅ 31.868ms (SLO: <34.150ms -6.7%) vs baseline: +0.3%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.4%


✅ start

Time: ✅ 29.416ms (SLO: <30.150ms -2.4%) vs baseline: +2.3%

Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +4.7%


✅ start-finish

Time: ✅ 33.851ms (SLO: <35.350ms -4.2%) vs baseline: -0.2%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.8%


✅ start-finish-telemetry

Time: ✅ 34.128ms (SLO: <35.450ms -3.7%) vs baseline: +0.4%

Memory: ✅ 37.847MB (SLO: <39.000MB -3.0%) vs baseline: +5.4%


✅ update-name

Time: ✅ 31.046ms (SLO: <33.400ms -7.0%) vs baseline: ~same

Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +4.9%


otelspan - 22/22

✅ add-event

Time: ✅ 40.253ms (SLO: <47.150ms 📉 -14.6%) vs baseline: -0.2%

Memory: ✅ 39.602MB (SLO: <47.000MB 📉 -15.7%) vs baseline: +5.0%


✅ add-metrics

Time: ✅ 257.461ms (SLO: <344.800ms 📉 -25.3%) vs baseline: -0.7%

Memory: ✅ 43.785MB (SLO: <47.500MB -7.8%) vs baseline: +4.6%


✅ add-tags

Time: ✅ 314.278ms (SLO: <321.000ms -2.1%) vs baseline: -0.5%

Memory: ✅ 43.784MB (SLO: <47.500MB -7.8%) vs baseline: +4.6%


✅ get-context

Time: ✅ 80.442ms (SLO: <92.350ms 📉 -12.9%) vs baseline: +0.2%

Memory: ✅ 40.007MB (SLO: <46.500MB 📉 -14.0%) vs baseline: +5.0%


✅ is-recording

Time: ✅ 37.826ms (SLO: <44.500ms 📉 -15.0%) vs baseline: +0.2%

Memory: ✅ 39.613MB (SLO: <47.500MB 📉 -16.6%) vs baseline: +4.6%


✅ record-exception

Time: ✅ 58.765ms (SLO: <67.650ms 📉 -13.1%) vs baseline: -0.1%

Memory: ✅ 40.084MB (SLO: <47.000MB 📉 -14.7%) vs baseline: +4.4%


✅ set-status

Time: ✅ 44.120ms (SLO: <50.400ms 📉 -12.5%) vs baseline: -0.5%

Memory: ✅ 39.543MB (SLO: <47.000MB 📉 -15.9%) vs baseline: +4.7%


✅ start

Time: ✅ 37.802ms (SLO: <43.450ms 📉 -13.0%) vs baseline: +2.1%

Memory: ✅ 39.545MB (SLO: <47.000MB 📉 -15.9%) vs baseline: +4.7%


✅ start-finish

Time: ✅ 82.745ms (SLO: <88.000ms -6.0%) vs baseline: ~same

Memory: ✅ 37.434MB (SLO: <46.500MB 📉 -19.5%) vs baseline: +5.0%


✅ start-finish-telemetry

Time: ✅ 84.214ms (SLO: <89.000ms -5.4%) vs baseline: ~same

Memory: ✅ 37.375MB (SLO: <46.500MB 📉 -19.6%) vs baseline: +4.6%


✅ update-name

Time: ✅ 38.650ms (SLO: <45.150ms 📉 -14.4%) vs baseline: ~same

Memory: ✅ 39.692MB (SLO: <47.000MB 📉 -15.5%) vs baseline: +4.8%


packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 342.669ms (SLO: <354.300ms -3.3%) vs baseline: ~same

Memory: ✅ 40.848MB (SLO: <43.500MB -6.1%) vs baseline: +3.9%


✅ cache_on

Time: ✅ 0.384µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.9%

Memory: ✅ 38.572MB (SLO: <43.000MB 📉 -10.3%) vs baseline: +4.6%

ℹ️ Scenarios Missing SLO Configuration (26 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

  • coreapiscenario-core_dispatch_listeners
  • coreapiscenario-core_dispatch_no_listeners
  • coreapiscenario-core_dispatch_with_results_listeners
  • coreapiscenario-core_dispatch_with_results_no_listeners
  • djangosimple-baseline
  • errortrackingdjangosimple-baseline
  • errortrackingflasksqli-baseline
  • flasksimple-baseline
  • flasksqli-baseline
  • sethttpmeta-obfuscation-disabled
  • startup-baseline
  • startup-baseline_django
  • startup-baseline_flask
  • startup-ddtrace_run
  • startup-ddtrace_run_appsec
  • startup-ddtrace_run_profiling
  • startup-ddtrace_run_runtime_metrics
  • startup-ddtrace_run_send_span
  • startup-ddtrace_run_telemetry_disabled
  • startup-ddtrace_run_telemetry_enabled
  • startup-import_ddtrace
  • startup-import_ddtrace_auto
  • startup-import_ddtrace_auto_django
  • startup-import_ddtrace_auto_flask
  • startup-import_ddtrace_django
  • startup-import_ddtrace_flask

@emmettbutler
Copy link
Collaborator Author

@P403n1x87 do you have any idea what's going on here with the "insufficient permissions" error? https://gitlab.ddbuild.io/DataDog/apm-reliability/dd-trace-py/-/jobs/1340383332

@emmettbutler emmettbutler changed the title ci: make encoders_profile gitlab job ci: remove *-profile jobs Jan 12, 2026
@emmettbutler emmettbutler marked this pull request as ready for review January 12, 2026 19:09
@emmettbutler emmettbutler added the changelog/no-changelog A changelog entry is not required for this PR. label Jan 12, 2026
@emmettbutler emmettbutler enabled auto-merge (squash) January 12, 2026 19:32
@emmettbutler emmettbutler merged commit a030a79 into main Jan 12, 2026
393 of 394 checks passed
@emmettbutler emmettbutler deleted the emmett.butler/profile-jobs branch January 12, 2026 19:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/no-changelog A changelog entry is not required for this PR.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants