Skip to content

Conversation

@KowalskiThomas
Copy link
Contributor

@KowalskiThomas KowalskiThomas commented Jan 8, 2026

Description

I think I may have been a little bit too quick with this one (#15864)... this should unflake again.

See test runs

@KowalskiThomas KowalskiThomas requested a review from a team as a code owner January 8, 2026 15:05
@KowalskiThomas KowalskiThomas added changelog/no-changelog A changelog entry is not required for this PR. Profiling Continous Profling labels Jan 8, 2026
@KowalskiThomas KowalskiThomas changed the title test(profiling): unflake test_gunicorn, again test(profiling): unflake test_gunicorn, again Jan 8, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Jan 8, 2026

CODEOWNERS have been resolved as:

tests/profiling/test_gunicorn.py                                        @DataDog/profiling-python

@github-actions
Copy link
Contributor

github-actions bot commented Jan 8, 2026

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 247 ± 2 ms.

The average import time from base is: 251 ± 2 ms.

The import time difference between this PR and base is: -4.7 ± 0.1 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 2.926 ms (1.19%)
ddtrace.bootstrap.sitecustomize 1.483 ms (0.60%)
ddtrace.bootstrap.preload 1.483 ms (0.60%)
ddtrace.internal.remoteconfig.client 0.667 ms (0.27%)
ddtrace 1.443 ms (0.59%)
ddtrace._logger 0.705 ms (0.29%)
ddtrace.internal.telemetry 0.705 ms (0.29%)
ddtrace.internal.telemetry.writer 0.705 ms (0.29%)
ddtrace.internal.utils.version 0.705 ms (0.29%)
ddtrace.version 0.705 ms (0.29%)
ddtrace.internal._unpatched 0.082 ms (0.03%)
subprocess 0.052 ms (0.02%)
contextlib 0.052 ms (0.02%)
json 0.030 ms (0.01%)
json.decoder 0.030 ms (0.01%)
re 0.030 ms (0.01%)
enum 0.030 ms (0.01%)
types 0.030 ms (0.01%)

@KowalskiThomas KowalskiThomas changed the title test(profiling): unflake test_gunicorn, again test(profiling): unflake test_gunicorn, again [backport 4.2] Jan 8, 2026
@KowalskiThomas KowalskiThomas enabled auto-merge (squash) January 8, 2026 16:10
@KowalskiThomas KowalskiThomas changed the title test(profiling): unflake test_gunicorn, again [backport 4.2] test(profiling): unflake test_gunicorn, again [backport 4.1] Jan 8, 2026
@pr-commenter
Copy link

pr-commenter bot commented Jan 8, 2026

Performance SLOs

Comparing candidate kowalski/test-profiling-unflake-test_gunicorn-again (7c5c7bf) with baseline 4.1 (b412b81)

📈 Performance Regressions (3 suites)
📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 18.217µs (SLO: <20.000µs -8.9%) vs baseline: 📈 +20.8%

Memory: ✅ 42.841MB (SLO: <43.250MB 🟡 -0.9%) vs baseline: +4.6%


✅ add_inplace_aspect

Time: ✅ 15.102µs (SLO: <20.000µs 📉 -24.5%) vs baseline: ~same

Memory: ✅ 42.939MB (SLO: <43.250MB 🟡 -0.7%) vs baseline: +4.8%


✅ add_inplace_noaspect

Time: ✅ 0.338µs (SLO: <10.000µs 📉 -96.6%) vs baseline: -2.1%

Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.2%


✅ add_noaspect

Time: ✅ 0.548µs (SLO: <10.000µs 📉 -94.5%) vs baseline: -0.2%

Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.8%


✅ bytearray_aspect

Time: ✅ 18.019µs (SLO: <30.000µs 📉 -39.9%) vs baseline: ~same

Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.7%


✅ bytearray_extend_aspect

Time: ✅ 23.718µs (SLO: <30.000µs 📉 -20.9%) vs baseline: -0.4%

Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.8%


✅ bytearray_extend_noaspect

Time: ✅ 2.676µs (SLO: <10.000µs 📉 -73.2%) vs baseline: +0.7%

Memory: ✅ 42.841MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.8%


✅ bytearray_noaspect

Time: ✅ 1.461µs (SLO: <10.000µs 📉 -85.4%) vs baseline: -0.7%

Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.2%


✅ bytes_aspect

Time: ✅ 16.805µs (SLO: <20.000µs 📉 -16.0%) vs baseline: +0.2%

Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.7%


✅ bytes_noaspect

Time: ✅ 1.411µs (SLO: <10.000µs 📉 -85.9%) vs baseline: +0.8%

Memory: ✅ 42.743MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +4.3%


✅ bytesio_aspect

Time: ✅ 55.184µs (SLO: <70.000µs 📉 -21.2%) vs baseline: -0.7%

Memory: ✅ 43.018MB (SLO: <43.500MB 🟡 -1.1%) vs baseline: +4.9%


✅ bytesio_noaspect

Time: ✅ 3.209µs (SLO: <10.000µs 📉 -67.9%) vs baseline: -0.5%

Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.0%


✅ capitalize_aspect

Time: ✅ 14.799µs (SLO: <20.000µs 📉 -26.0%) vs baseline: -0.3%

Memory: ✅ 42.979MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.6%


✅ capitalize_noaspect

Time: ✅ 2.606µs (SLO: <10.000µs 📉 -73.9%) vs baseline: +2.8%

Memory: ✅ 42.802MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +4.5%


✅ casefold_aspect

Time: ✅ 14.661µs (SLO: <20.000µs 📉 -26.7%) vs baseline: -0.6%

Memory: ✅ 42.979MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.9%


✅ casefold_noaspect

Time: ✅ 3.084µs (SLO: <10.000µs 📉 -69.2%) vs baseline: ~same

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +3.9%


✅ decode_aspect

Time: ✅ 15.668µs (SLO: <30.000µs 📉 -47.8%) vs baseline: +0.5%

Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.8%


✅ decode_noaspect

Time: ✅ 1.598µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -0.3%

Memory: ✅ 42.821MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +4.5%


✅ encode_aspect

Time: ✅ 18.403µs (SLO: <30.000µs 📉 -38.7%) vs baseline: 📈 +21.9%

Memory: ✅ 42.979MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +5.0%


✅ encode_noaspect

Time: ✅ 1.480µs (SLO: <10.000µs 📉 -85.2%) vs baseline: ~same

Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.9%


✅ format_aspect

Time: ✅ 171.089µs (SLO: <200.000µs 📉 -14.5%) vs baseline: -0.3%

Memory: ✅ 43.096MB (SLO: <43.250MB 🟡 -0.4%) vs baseline: +4.8%


✅ format_map_aspect

Time: ✅ 192.095µs (SLO: <200.000µs -4.0%) vs baseline: +0.3%

Memory: ✅ 43.037MB (SLO: <43.500MB 🟡 -1.1%) vs baseline: +4.7%


✅ format_map_noaspect

Time: ✅ 3.772µs (SLO: <10.000µs 📉 -62.3%) vs baseline: +0.6%

Memory: ✅ 42.762MB (SLO: <43.250MB 🟡 -1.1%) vs baseline: +4.3%


✅ format_noaspect

Time: ✅ 3.175µs (SLO: <10.000µs 📉 -68.3%) vs baseline: +1.0%

Memory: ✅ 42.684MB (SLO: <43.250MB 🟡 -1.3%) vs baseline: +4.1%


✅ index_aspect

Time: ✅ 15.242µs (SLO: <20.000µs 📉 -23.8%) vs baseline: -0.3%

Memory: ✅ 43.018MB (SLO: <43.250MB 🟡 -0.5%) vs baseline: +4.8%


✅ index_noaspect

Time: ✅ 0.465µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -0.2%

Memory: ✅ 42.743MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +4.3%


✅ join_aspect

Time: ✅ 17.041µs (SLO: <20.000µs 📉 -14.8%) vs baseline: -0.3%

Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.5%


✅ join_noaspect

Time: ✅ 1.505µs (SLO: <10.000µs 📉 -85.0%) vs baseline: -0.1%

Memory: ✅ 42.998MB (SLO: <43.250MB 🟡 -0.6%) vs baseline: +5.0%


✅ ljust_aspect

Time: ✅ 20.827µs (SLO: <30.000µs 📉 -30.6%) vs baseline: -0.9%

Memory: ✅ 42.998MB (SLO: <43.250MB 🟡 -0.6%) vs baseline: +4.9%


✅ ljust_noaspect

Time: ✅ 2.689µs (SLO: <10.000µs 📉 -73.1%) vs baseline: +1.5%

Memory: ✅ 42.802MB (SLO: <43.250MB 🟡 -1.0%) vs baseline: +4.7%


✅ lower_aspect

Time: ✅ 17.975µs (SLO: <30.000µs 📉 -40.1%) vs baseline: -0.3%

Memory: ✅ 42.979MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.9%


✅ lower_noaspect

Time: ✅ 2.386µs (SLO: <10.000µs 📉 -76.1%) vs baseline: +0.2%

Memory: ✅ 42.585MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +3.7%


✅ lstrip_aspect

Time: ✅ 17.705µs (SLO: <30.000µs 📉 -41.0%) vs baseline: -0.3%

Memory: ✅ 43.018MB (SLO: <43.250MB 🟡 -0.5%) vs baseline: +4.6%


✅ lstrip_noaspect

Time: ✅ 1.836µs (SLO: <10.000µs 📉 -81.6%) vs baseline: -0.2%

Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.0%


✅ modulo_aspect

Time: ✅ 166.680µs (SLO: <200.000µs 📉 -16.7%) vs baseline: -0.2%

Memory: ✅ 43.136MB (SLO: <43.500MB 🟡 -0.8%) vs baseline: +5.0%


✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 174.948µs (SLO: <200.000µs 📉 -12.5%) vs baseline: +0.2%

Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.3%


✅ modulo_aspect_for_bytes

Time: ✅ 168.521µs (SLO: <200.000µs 📉 -15.7%) vs baseline: +0.2%

Memory: ✅ 42.998MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.6%


✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 171.678µs (SLO: <200.000µs 📉 -14.2%) vs baseline: -0.3%

Memory: ✅ 42.998MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.6%


✅ modulo_noaspect

Time: ✅ 3.711µs (SLO: <10.000µs 📉 -62.9%) vs baseline: -0.8%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +3.9%


✅ replace_aspect

Time: ✅ 214.163µs (SLO: <300.000µs 📉 -28.6%) vs baseline: -0.2%

Memory: ✅ 42.959MB (SLO: <44.000MB -2.4%) vs baseline: +4.5%


✅ replace_noaspect

Time: ✅ 5.219µs (SLO: <10.000µs 📉 -47.8%) vs baseline: ~same

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.0%


✅ repr_aspect

Time: ✅ 1.397µs (SLO: <10.000µs 📉 -86.0%) vs baseline: +0.7%

Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.2%


✅ repr_noaspect

Time: ✅ 0.527µs (SLO: <10.000µs 📉 -94.7%) vs baseline: +0.6%

Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.6%


✅ rstrip_aspect

Time: ✅ 23.169µs (SLO: <30.000µs 📉 -22.8%) vs baseline: 📈 +20.1%

Memory: ✅ 43.057MB (SLO: <43.500MB 🟡 -1.0%) vs baseline: +5.1%


✅ rstrip_noaspect

Time: ✅ 1.874µs (SLO: <10.000µs 📉 -81.3%) vs baseline: -0.2%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.0%


✅ slice_aspect

Time: ✅ 16.016µs (SLO: <20.000µs 📉 -19.9%) vs baseline: -0.7%

Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.7%


✅ slice_noaspect

Time: ✅ 0.603µs (SLO: <10.000µs 📉 -94.0%) vs baseline: -0.3%

Memory: ✅ 42.821MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +4.9%


✅ stringio_aspect

Time: ✅ 54.559µs (SLO: <80.000µs 📉 -31.8%) vs baseline: +0.3%

Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.6%


✅ stringio_noaspect

Time: ✅ 3.550µs (SLO: <10.000µs 📉 -64.5%) vs baseline: -0.2%

Memory: ✅ 42.743MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +4.3%


✅ strip_aspect

Time: ✅ 17.764µs (SLO: <20.000µs 📉 -11.2%) vs baseline: +0.2%

Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.8%


✅ strip_noaspect

Time: ✅ 1.842µs (SLO: <10.000µs 📉 -81.6%) vs baseline: +0.7%

Memory: ✅ 42.743MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +4.3%


✅ swapcase_aspect

Time: ✅ 18.520µs (SLO: <30.000µs 📉 -38.3%) vs baseline: -0.1%

Memory: ✅ 42.979MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +5.1%


✅ swapcase_noaspect

Time: ✅ 2.786µs (SLO: <10.000µs 📉 -72.1%) vs baseline: +0.8%

Memory: ✅ 42.743MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +4.4%


✅ title_aspect

Time: ✅ 18.189µs (SLO: <30.000µs 📉 -39.4%) vs baseline: -0.6%

Memory: ✅ 42.920MB (SLO: <43.000MB 🟡 -0.2%) vs baseline: +4.8%


✅ title_noaspect

Time: ✅ 2.622µs (SLO: <10.000µs 📉 -73.8%) vs baseline: -1.4%

Memory: ✅ 42.802MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +4.4%


✅ translate_aspect

Time: ✅ 20.632µs (SLO: <30.000µs 📉 -31.2%) vs baseline: ~same

Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.6%


✅ translate_noaspect

Time: ✅ 4.238µs (SLO: <10.000µs 📉 -57.6%) vs baseline: -0.4%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.2%


✅ upper_aspect

Time: ✅ 18.018µs (SLO: <30.000µs 📉 -39.9%) vs baseline: ~same

Memory: ✅ 42.979MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.8%


✅ upper_noaspect

Time: ✅ 2.385µs (SLO: <10.000µs 📉 -76.1%) vs baseline: +0.9%

Memory: ✅ 42.743MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +4.3%


📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 5.157µs (SLO: <10.000µs 📉 -48.4%) vs baseline: 📈 +21.7%

Memory: ✅ 41.366MB (SLO: <43.500MB -4.9%) vs baseline: +4.6%


✅ ospathbasename_noaspect

Time: ✅ 4.371µs (SLO: <10.000µs 📉 -56.3%) vs baseline: +1.1%

Memory: ✅ 41.406MB (SLO: <43.500MB -4.8%) vs baseline: +4.9%


✅ ospathjoin_aspect

Time: ✅ 6.151µs (SLO: <10.000µs 📉 -38.5%) vs baseline: -0.4%

Memory: ✅ 41.445MB (SLO: <43.500MB -4.7%) vs baseline: +5.2%


✅ ospathjoin_noaspect

Time: ✅ 6.175µs (SLO: <10.000µs 📉 -38.3%) vs baseline: -0.4%

Memory: ✅ 41.425MB (SLO: <43.500MB -4.8%) vs baseline: +4.8%


✅ ospathnormcase_aspect

Time: ✅ 3.508µs (SLO: <10.000µs 📉 -64.9%) vs baseline: +0.6%

Memory: ✅ 41.406MB (SLO: <43.500MB -4.8%) vs baseline: +4.8%


✅ ospathnormcase_noaspect

Time: ✅ 3.591µs (SLO: <10.000µs 📉 -64.1%) vs baseline: ~same

Memory: ✅ 41.406MB (SLO: <43.500MB -4.8%) vs baseline: +4.9%


✅ ospathsplit_aspect

Time: ✅ 4.860µs (SLO: <10.000µs 📉 -51.4%) vs baseline: +0.5%

Memory: ✅ 41.386MB (SLO: <43.500MB -4.9%) vs baseline: +4.7%


✅ ospathsplit_noaspect

Time: ✅ 4.958µs (SLO: <10.000µs 📉 -50.4%) vs baseline: -0.2%

Memory: ✅ 41.465MB (SLO: <43.500MB -4.7%) vs baseline: +5.1%


✅ ospathsplitdrive_aspect

Time: ✅ 3.769µs (SLO: <10.000µs 📉 -62.3%) vs baseline: +0.8%

Memory: ✅ 41.386MB (SLO: <43.500MB -4.9%) vs baseline: +4.6%


✅ ospathsplitdrive_noaspect

Time: ✅ 0.756µs (SLO: <10.000µs 📉 -92.4%) vs baseline: -0.5%

Memory: ✅ 41.406MB (SLO: <43.500MB -4.8%) vs baseline: +4.9%


✅ ospathsplitext_aspect

Time: ✅ 4.643µs (SLO: <10.000µs 📉 -53.6%) vs baseline: +0.7%

Memory: ✅ 41.386MB (SLO: <43.500MB -4.9%) vs baseline: +4.9%


✅ ospathsplitext_noaspect

Time: ✅ 4.715µs (SLO: <10.000µs 📉 -52.9%) vs baseline: +1.0%

Memory: ✅ 41.327MB (SLO: <43.500MB -5.0%) vs baseline: +4.7%


📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.396µs (SLO: <20.000µs 📉 -83.0%) vs baseline: 📈 +10.9%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%


✅ 1-count-metrics-100-times

Time: ✅ 200.644µs (SLO: <220.000µs -8.8%) vs baseline: ~same

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.8%


✅ 1-distribution-metric-1-times

Time: ✅ 3.389µs (SLO: <20.000µs 📉 -83.1%) vs baseline: -0.4%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.6%


✅ 1-distribution-metrics-100-times

Time: ✅ 214.381µs (SLO: <230.000µs -6.8%) vs baseline: -0.4%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%


✅ 1-gauge-metric-1-times

Time: ✅ 2.240µs (SLO: <20.000µs 📉 -88.8%) vs baseline: -0.8%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%


✅ 1-gauge-metrics-100-times

Time: ✅ 136.308µs (SLO: <150.000µs -9.1%) vs baseline: -0.4%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.8%


✅ 1-rate-metric-1-times

Time: ✅ 3.184µs (SLO: <20.000µs 📉 -84.1%) vs baseline: -0.6%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.9%


✅ 1-rate-metrics-100-times

Time: ✅ 214.173µs (SLO: <250.000µs 📉 -14.3%) vs baseline: -0.5%

Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.3%


✅ 100-count-metrics-100-times

Time: ✅ 20.109ms (SLO: <22.000ms -8.6%) vs baseline: -0.6%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.5%


✅ 100-distribution-metrics-100-times

Time: ✅ 2.281ms (SLO: <2.550ms 📉 -10.6%) vs baseline: +0.1%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.9%


✅ 100-gauge-metrics-100-times

Time: ✅ 1.406ms (SLO: <1.550ms -9.3%) vs baseline: +0.3%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.3%


✅ 100-rate-metrics-100-times

Time: ✅ 2.207ms (SLO: <2.550ms 📉 -13.5%) vs baseline: ~same

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ flush-1-metric

Time: ✅ 4.539µs (SLO: <20.000µs 📉 -77.3%) vs baseline: -0.5%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ flush-100-metrics

Time: ✅ 173.374µs (SLO: <250.000µs 📉 -30.7%) vs baseline: -0.4%

Memory: ✅ 35.114MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.7%


✅ flush-1000-metrics

Time: ✅ 2.187ms (SLO: <2.500ms 📉 -12.5%) vs baseline: +0.2%

Memory: ✅ 36.058MB (SLO: <36.500MB 🟡 -1.2%) vs baseline: +5.0%

🟡 Near SLO Breach (15 suites)
🟡 coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.207µs (SLO: <20.000µs 📉 -34.0%) vs baseline: ~same

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%


✅ context_with_data_no_listeners

Time: ✅ 3.261µs (SLO: <10.000µs 📉 -67.4%) vs baseline: -0.6%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.2%


✅ get_item_exists

Time: ✅ 0.576µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.3%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.6%


✅ get_item_missing

Time: ✅ 0.636µs (SLO: <10.000µs 📉 -93.6%) vs baseline: -0.3%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.9%


✅ set_item

Time: ✅ 24.003µs (SLO: <30.000µs 📉 -20.0%) vs baseline: -0.4%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.9%


🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 19.648ms (SLO: <22.300ms 📉 -11.9%) vs baseline: ~same

Memory: ✅ 68.243MB (SLO: <70.500MB -3.2%) vs baseline: +4.9%


✅ exception-replay-enabled

Time: ✅ 1.358ms (SLO: <1.450ms -6.3%) vs baseline: -0.2%

Memory: ✅ 66.257MB (SLO: <67.500MB 🟡 -1.8%) vs baseline: +4.9%


✅ iast

Time: ✅ 19.586ms (SLO: <22.250ms 📉 -12.0%) vs baseline: -0.5%

Memory: ✅ 68.223MB (SLO: <70.000MB -2.5%) vs baseline: +4.8%


✅ profiler

Time: ✅ 15.304ms (SLO: <16.550ms -7.5%) vs baseline: +0.7%

Memory: ✅ 56.443MB (SLO: <57.500MB 🟡 -1.8%) vs baseline: +4.8%


✅ resource-renaming

Time: ✅ 19.448ms (SLO: <21.750ms 📉 -10.6%) vs baseline: -0.6%

Memory: ✅ 68.223MB (SLO: <70.500MB -3.2%) vs baseline: +4.7%


✅ span-code-origin

Time: ✅ 19.994ms (SLO: <28.200ms 📉 -29.1%) vs baseline: +1.1%

Memory: ✅ 68.175MB (SLO: <71.000MB -4.0%) vs baseline: +4.8%


✅ tracer

Time: ✅ 19.609ms (SLO: <21.750ms -9.8%) vs baseline: -0.4%

Memory: ✅ 68.302MB (SLO: <70.000MB -2.4%) vs baseline: +4.9%


✅ tracer-and-profiler

Time: ✅ 21.639ms (SLO: <23.500ms -7.9%) vs baseline: ~same

Memory: ✅ 69.344MB (SLO: <71.000MB -2.3%) vs baseline: +4.6%


✅ tracer-dont-create-db-spans

Time: ✅ 19.713ms (SLO: <21.500ms -8.3%) vs baseline: +0.4%

Memory: ✅ 68.242MB (SLO: <70.000MB -2.5%) vs baseline: +4.9%


✅ tracer-minimal

Time: ✅ 16.807ms (SLO: <17.500ms -4.0%) vs baseline: ~same

Memory: ✅ 67.908MB (SLO: <70.000MB -3.0%) vs baseline: +5.0%


✅ tracer-native

Time: ✅ 19.549ms (SLO: <21.750ms 📉 -10.1%) vs baseline: +0.5%

Memory: ✅ 68.282MB (SLO: <72.500MB -5.8%) vs baseline: +4.9%


✅ tracer-no-caches

Time: ✅ 17.640ms (SLO: <19.650ms 📉 -10.2%) vs baseline: +0.1%

Memory: ✅ 67.830MB (SLO: <70.000MB -3.1%) vs baseline: +4.7%


✅ tracer-no-databases

Time: ✅ 19.084ms (SLO: <20.100ms -5.1%) vs baseline: -0.3%

Memory: ✅ 67.928MB (SLO: <70.000MB -3.0%) vs baseline: +5.0%


✅ tracer-no-middleware

Time: ✅ 19.305ms (SLO: <21.500ms 📉 -10.2%) vs baseline: -0.4%

Memory: ✅ 68.046MB (SLO: <70.000MB -2.8%) vs baseline: +5.0%


✅ tracer-no-templates

Time: ✅ 19.496ms (SLO: <22.000ms 📉 -11.4%) vs baseline: +1.3%

Memory: ✅ 68.164MB (SLO: <70.500MB -3.3%) vs baseline: +4.9%


🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 16.220ms (SLO: <19.850ms 📉 -18.3%) vs baseline: -0.4%

Memory: ✅ 69.936MB (SLO: <70.000MB 🟡 ~same) vs baseline: +4.9%


✅ errortracking-enabled-user

Time: ✅ 16.326ms (SLO: <19.400ms 📉 -15.8%) vs baseline: +0.2%

Memory: ✅ 69.802MB (SLO: <70.000MB 🟡 -0.3%) vs baseline: +4.7%


✅ tracer-enabled

Time: ✅ 16.363ms (SLO: <19.450ms 📉 -15.9%) vs baseline: -0.3%

Memory: ✅ 69.863MB (SLO: <70.000MB 🟡 -0.2%) vs baseline: +5.0%


🟡 errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.072ms (SLO: <2.300ms -9.9%) vs baseline: +0.3%

Memory: ✅ 55.640MB (SLO: <56.500MB 🟡 -1.5%) vs baseline: +4.7%


✅ errortracking-enabled-user

Time: ✅ 2.079ms (SLO: <2.250ms -7.6%) vs baseline: +0.2%

Memory: ✅ 55.738MB (SLO: <56.500MB 🟡 -1.3%) vs baseline: +4.9%


✅ tracer-enabled

Time: ✅ 2.068ms (SLO: <2.300ms 📉 -10.1%) vs baseline: ~same

Memory: ✅ 55.581MB (SLO: <56.500MB 🟡 -1.6%) vs baseline: +4.7%


🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 3.382ms (SLO: <4.750ms 📉 -28.8%) vs baseline: -0.2%

Memory: ✅ 55.638MB (SLO: <66.500MB 📉 -16.3%) vs baseline: +5.0%


✅ appsec-post

Time: ✅ 2.854ms (SLO: <6.750ms 📉 -57.7%) vs baseline: +0.1%

Memory: ✅ 55.756MB (SLO: <66.500MB 📉 -16.2%) vs baseline: +5.0%


✅ appsec-telemetry

Time: ✅ 3.386ms (SLO: <4.750ms 📉 -28.7%) vs baseline: +0.3%

Memory: ✅ 55.734MB (SLO: <66.500MB 📉 -16.2%) vs baseline: +5.0%


✅ debugger

Time: ✅ 1.870ms (SLO: <2.000ms -6.5%) vs baseline: ~same

Memory: ✅ 47.960MB (SLO: <49.500MB -3.1%) vs baseline: +5.0%


✅ iast-get

Time: ✅ 1.861ms (SLO: <2.000ms -6.9%) vs baseline: ~same

Memory: ✅ 44.852MB (SLO: <49.000MB -8.5%) vs baseline: +5.1%


✅ profiler

Time: ✅ 1.909ms (SLO: <2.100ms -9.1%) vs baseline: -0.2%

Memory: ✅ 48.767MB (SLO: <50.000MB -2.5%) vs baseline: +4.8%


✅ resource-renaming

Time: ✅ 3.359ms (SLO: <3.650ms -8.0%) vs baseline: ~same

Memory: ✅ 55.615MB (SLO: <56.000MB 🟡 -0.7%) vs baseline: +4.8%


✅ tracer

Time: ✅ 3.370ms (SLO: <3.650ms -7.7%) vs baseline: ~same

Memory: ✅ 55.745MB (SLO: <56.500MB 🟡 -1.3%) vs baseline: +5.0%


✅ tracer-native

Time: ✅ 3.372ms (SLO: <3.650ms -7.6%) vs baseline: ~same

Memory: ✅ 55.678MB (SLO: <60.000MB -7.2%) vs baseline: +5.1%


🟡 flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 2.060ms (SLO: <4.200ms 📉 -51.0%) vs baseline: +0.2%

Memory: ✅ 55.640MB (SLO: <66.000MB 📉 -15.7%) vs baseline: +4.9%


✅ iast-enabled

Time: ✅ 2.068ms (SLO: <2.800ms 📉 -26.2%) vs baseline: -0.2%

Memory: ✅ 55.679MB (SLO: <62.500MB 📉 -10.9%) vs baseline: +4.8%


✅ tracer-enabled

Time: ✅ 2.059ms (SLO: <2.250ms -8.5%) vs baseline: ~same

Memory: ✅ 55.679MB (SLO: <56.500MB 🟡 -1.5%) vs baseline: +4.9%


🟡 httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 81.575µs (SLO: <100.000µs 📉 -18.4%) vs baseline: -0.7%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.6%


✅ b3_headers

Time: ✅ 14.242µs (SLO: <20.000µs 📉 -28.8%) vs baseline: -1.2%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.8%


✅ b3_single_headers

Time: ✅ 13.367µs (SLO: <20.000µs 📉 -33.2%) vs baseline: -0.6%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%


✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 64.456µs (SLO: <80.000µs 📉 -19.4%) vs baseline: -0.5%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.0%


✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 69.868µs (SLO: <80.000µs 📉 -12.7%) vs baseline: +5.1%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.6%


✅ empty_headers

Time: ✅ 1.649µs (SLO: <10.000µs 📉 -83.5%) vs baseline: +2.5%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.0%


✅ full_t_id_datadog_headers

Time: ✅ 22.597µs (SLO: <30.000µs 📉 -24.7%) vs baseline: -1.2%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.5%


✅ invalid_priority_header

Time: ✅ 6.597µs (SLO: <10.000µs 📉 -34.0%) vs baseline: +0.3%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.5%


✅ invalid_span_id_header

Time: ✅ 6.561µs (SLO: <10.000µs 📉 -34.4%) vs baseline: -0.6%

Memory: ✅ 35.055MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +5.0%


✅ invalid_tags_header

Time: ✅ 6.598µs (SLO: <10.000µs 📉 -34.0%) vs baseline: +0.3%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.5%


✅ invalid_trace_id_header

Time: ✅ 6.583µs (SLO: <10.000µs 📉 -34.2%) vs baseline: +0.2%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.9%


✅ large_header_no_matches

Time: ✅ 27.597µs (SLO: <30.000µs -8.0%) vs baseline: -0.5%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.9%


✅ large_valid_headers_all

Time: ✅ 28.771µs (SLO: <40.000µs 📉 -28.1%) vs baseline: +0.3%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.9%


✅ medium_header_no_matches

Time: ✅ 9.872µs (SLO: <20.000µs 📉 -50.6%) vs baseline: -0.4%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.3%


✅ medium_valid_headers_all

Time: ✅ 11.320µs (SLO: <20.000µs 📉 -43.4%) vs baseline: -0.2%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.9%


✅ none_propagation_style

Time: ✅ 1.722µs (SLO: <10.000µs 📉 -82.8%) vs baseline: +0.4%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.7%


✅ tracecontext_headers

Time: ✅ 34.988µs (SLO: <40.000µs 📉 -12.5%) vs baseline: +0.2%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.6%


✅ valid_headers_all

Time: ✅ 6.623µs (SLO: <10.000µs 📉 -33.8%) vs baseline: +0.6%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.7%


✅ valid_headers_basic

Time: ✅ 6.172µs (SLO: <10.000µs 📉 -38.3%) vs baseline: -0.2%

Memory: ✅ 35.036MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +5.2%


✅ wsgi_empty_headers

Time: ✅ 1.622µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +0.6%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.6%


✅ wsgi_invalid_priority_header

Time: ✅ 6.639µs (SLO: <10.000µs 📉 -33.6%) vs baseline: -0.6%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.4%


✅ wsgi_invalid_span_id_header

Time: ✅ 1.612µs (SLO: <10.000µs 📉 -83.9%) vs baseline: -0.7%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.2%


✅ wsgi_invalid_tags_header

Time: ✅ 6.618µs (SLO: <10.000µs 📉 -33.8%) vs baseline: -0.3%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.1%


✅ wsgi_invalid_trace_id_header

Time: ✅ 6.611µs (SLO: <10.000µs 📉 -33.9%) vs baseline: ~same

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.5%


✅ wsgi_large_header_no_matches

Time: ✅ 28.877µs (SLO: <40.000µs 📉 -27.8%) vs baseline: ~same

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%


✅ wsgi_large_valid_headers_all

Time: ✅ 29.893µs (SLO: <40.000µs 📉 -25.3%) vs baseline: -0.3%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.2%


✅ wsgi_medium_header_no_matches

Time: ✅ 10.150µs (SLO: <20.000µs 📉 -49.2%) vs baseline: -0.3%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.8%


✅ wsgi_medium_valid_headers_all

Time: ✅ 11.576µs (SLO: <20.000µs 📉 -42.1%) vs baseline: ~same

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.9%


✅ wsgi_valid_headers_all

Time: ✅ 6.643µs (SLO: <10.000µs 📉 -33.6%) vs baseline: ~same

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.7%


✅ wsgi_valid_headers_basic

Time: ✅ 6.212µs (SLO: <10.000µs 📉 -37.9%) vs baseline: +0.7%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.7%


🟡 httppropagationinject - 16/16

✅ ids_only

Time: ✅ 21.919µs (SLO: <30.000µs 📉 -26.9%) vs baseline: +4.2%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.2%


✅ with_all

Time: ✅ 27.756µs (SLO: <40.000µs 📉 -30.6%) vs baseline: -0.4%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.6%


✅ with_dd_origin

Time: ✅ 24.868µs (SLO: <30.000µs 📉 -17.1%) vs baseline: +0.3%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.9%


✅ with_priority_and_origin

Time: ✅ 24.289µs (SLO: <40.000µs 📉 -39.3%) vs baseline: ~same

Memory: ✅ 35.036MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +5.0%


✅ with_sampling_priority

Time: ✅ 21.028µs (SLO: <30.000µs 📉 -29.9%) vs baseline: ~same

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%


✅ with_tags

Time: ✅ 25.943µs (SLO: <40.000µs 📉 -35.1%) vs baseline: ~same

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%


✅ with_tags_invalid

Time: ✅ 27.417µs (SLO: <40.000µs 📉 -31.5%) vs baseline: -0.2%

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.1%


✅ with_tags_max_size

Time: ✅ 26.445µs (SLO: <40.000µs 📉 -33.9%) vs baseline: +0.2%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.9%


🟡 otelspan - 22/22

✅ add-event

Time: ✅ 38.616ms (SLO: <47.150ms 📉 -18.1%) vs baseline: -0.3%

Memory: ✅ 39.516MB (SLO: <47.000MB 📉 -15.9%) vs baseline: +4.8%


✅ add-metrics

Time: ✅ 258.664ms (SLO: <344.800ms 📉 -25.0%) vs baseline: +0.3%

Memory: ✅ 43.753MB (SLO: <47.500MB -7.9%) vs baseline: +4.5%


✅ add-tags

Time: ✅ 315.936ms (SLO: <321.000ms 🟡 -1.6%) vs baseline: +0.7%

Memory: ✅ 43.851MB (SLO: <47.500MB -7.7%) vs baseline: +4.7%


✅ get-context

Time: ✅ 78.583ms (SLO: <92.350ms 📉 -14.9%) vs baseline: ~same

Memory: ✅ 39.918MB (SLO: <46.500MB 📉 -14.2%) vs baseline: +4.6%


✅ is-recording

Time: ✅ 36.346ms (SLO: <44.500ms 📉 -18.3%) vs baseline: +0.7%

Memory: ✅ 39.495MB (SLO: <47.500MB 📉 -16.9%) vs baseline: +4.8%


✅ record-exception

Time: ✅ 57.050ms (SLO: <67.650ms 📉 -15.7%) vs baseline: -0.1%

Memory: ✅ 39.984MB (SLO: <47.000MB 📉 -14.9%) vs baseline: +4.5%


✅ set-status

Time: ✅ 42.512ms (SLO: <50.400ms 📉 -15.7%) vs baseline: ~same

Memory: ✅ 39.535MB (SLO: <47.000MB 📉 -15.9%) vs baseline: +4.7%


✅ start

Time: ✅ 36.600ms (SLO: <43.450ms 📉 -15.8%) vs baseline: +3.4%

Memory: ✅ 39.490MB (SLO: <47.000MB 📉 -16.0%) vs baseline: +4.7%


✅ start-finish

Time: ✅ 80.513ms (SLO: <88.000ms -8.5%) vs baseline: -0.3%

Memory: ✅ 37.415MB (SLO: <46.500MB 📉 -19.5%) vs baseline: +4.8%


✅ start-finish-telemetry

Time: ✅ 81.963ms (SLO: <89.000ms -7.9%) vs baseline: -0.1%

Memory: ✅ 37.415MB (SLO: <46.500MB 📉 -19.5%) vs baseline: +4.7%


✅ update-name

Time: ✅ 36.955ms (SLO: <45.150ms 📉 -18.2%) vs baseline: ~same

Memory: ✅ 39.708MB (SLO: <47.000MB 📉 -15.5%) vs baseline: +4.7%


🟡 ratelimiter - 12/12

✅ defaults

Time: ✅ 2.351µs (SLO: <10.000µs 📉 -76.5%) vs baseline: +0.1%

Memory: ✅ 35.095MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.7%


✅ high_rate_limit

Time: ✅ 2.418µs (SLO: <10.000µs 📉 -75.8%) vs baseline: +0.6%

Memory: ✅ 35.154MB (SLO: <35.500MB 🟡 -1.0%) vs baseline: +5.0%


✅ long_window

Time: ✅ 2.352µs (SLO: <10.000µs 📉 -76.5%) vs baseline: ~same

Memory: ✅ 35.095MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +5.0%


✅ low_rate_limit

Time: ✅ 2.370µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +0.6%

Memory: ✅ 35.075MB (SLO: <35.500MB 🟡 -1.2%) vs baseline: +4.5%


✅ no_rate_limit

Time: ✅ 0.831µs (SLO: <10.000µs 📉 -91.7%) vs baseline: -0.5%

Memory: ✅ 35.114MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.8%


✅ short_window

Time: ✅ 2.498µs (SLO: <10.000µs 📉 -75.0%) vs baseline: +0.2%

Memory: ✅ 35.114MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +5.1%


🟡 recursivecomputation - 8/8

✅ deep

Time: ✅ 308.623ms (SLO: <320.950ms -3.8%) vs baseline: +0.2%

Memory: ✅ 36.156MB (SLO: <36.500MB 🟡 -0.9%) vs baseline: +5.4%


✅ deep-profiled

Time: ✅ 325.317ms (SLO: <359.150ms -9.4%) vs baseline: -0.1%

Memory: ✅ 39.872MB (SLO: <40.500MB 🟡 -1.6%) vs baseline: +4.8%


✅ medium

Time: ✅ 6.928ms (SLO: <7.400ms -6.4%) vs baseline: +0.3%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.9%


✅ shallow

Time: ✅ 0.927ms (SLO: <1.050ms 📉 -11.8%) vs baseline: +1.1%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.8%


🟡 samplingrules - 8/8

✅ average_match

Time: ✅ 136.142µs (SLO: <290.000µs 📉 -53.1%) vs baseline: +0.4%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%


✅ high_match

Time: ✅ 170.765µs (SLO: <480.000µs 📉 -64.4%) vs baseline: -0.5%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.8%


✅ low_match

Time: ✅ 99.068µs (SLO: <120.000µs 📉 -17.4%) vs baseline: +1.0%

Memory: ✅ 603.618MB (SLO: <700.000MB 📉 -13.8%) vs baseline: +4.8%


✅ very_low_match

Time: ✅ 2.632ms (SLO: <8.500ms 📉 -69.0%) vs baseline: ~same

Memory: ✅ 71.129MB (SLO: <75.000MB -5.2%) vs baseline: +4.7%


🟡 sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.520µs (SLO: <20.000µs 📉 -47.4%) vs baseline: +1.2%

Memory: ✅ 35.350MB (SLO: <36.000MB 🟡 -1.8%) vs baseline: +4.3%


✅ all-enabled

Time: ✅ 40.636µs (SLO: <50.000µs 📉 -18.7%) vs baseline: +2.4%

Memory: ✅ 35.350MB (SLO: <36.000MB 🟡 -1.8%) vs baseline: +4.6%


✅ collectipvariant_exists

Time: ✅ 40.326µs (SLO: <50.000µs 📉 -19.3%) vs baseline: -0.6%

Memory: ✅ 35.566MB (SLO: <36.000MB 🟡 -1.2%) vs baseline: +5.2%


✅ no-collectipvariant

Time: ✅ 39.601µs (SLO: <50.000µs 📉 -20.8%) vs baseline: -0.4%

Memory: ✅ 35.429MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +5.2%


✅ no-useragentvariant

Time: ✅ 38.376µs (SLO: <50.000µs 📉 -23.2%) vs baseline: ~same

Memory: ✅ 35.193MB (SLO: <36.000MB -2.2%) vs baseline: +4.0%


✅ obfuscation-no-query

Time: ✅ 40.018µs (SLO: <50.000µs 📉 -20.0%) vs baseline: -0.6%

Memory: ✅ 35.370MB (SLO: <36.000MB 🟡 -1.8%) vs baseline: +4.5%


✅ obfuscation-regular-case-explicit-query

Time: ✅ 74.525µs (SLO: <90.000µs 📉 -17.2%) vs baseline: -0.3%

Memory: ✅ 35.763MB (SLO: <36.500MB -2.0%) vs baseline: +5.5%


✅ obfuscation-regular-case-implicit-query

Time: ✅ 75.162µs (SLO: <90.000µs 📉 -16.5%) vs baseline: ~same

Memory: ✅ 35.665MB (SLO: <36.500MB -2.3%) vs baseline: +4.7%


✅ obfuscation-send-querystring-disabled

Time: ✅ 152.875µs (SLO: <170.000µs 📉 -10.1%) vs baseline: -0.2%

Memory: ✅ 35.625MB (SLO: <36.500MB -2.4%) vs baseline: +4.7%


✅ obfuscation-worst-case-explicit-query

Time: ✅ 147.360µs (SLO: <160.000µs -7.9%) vs baseline: ~same

Memory: ✅ 35.763MB (SLO: <36.500MB -2.0%) vs baseline: +5.1%


✅ obfuscation-worst-case-implicit-query

Time: ✅ 153.826µs (SLO: <170.000µs -9.5%) vs baseline: -0.1%

Memory: ✅ 35.645MB (SLO: <36.500MB -2.3%) vs baseline: +4.7%


✅ useragentvariant_exists_1

Time: ✅ 39.024µs (SLO: <50.000µs 📉 -22.0%) vs baseline: -1.1%

Memory: ✅ 35.370MB (SLO: <36.000MB 🟡 -1.8%) vs baseline: +4.5%


✅ useragentvariant_exists_2

Time: ✅ 39.985µs (SLO: <50.000µs 📉 -20.0%) vs baseline: -1.3%

Memory: ✅ 35.311MB (SLO: <36.000MB 🟡 -1.9%) vs baseline: +4.3%


✅ useragentvariant_exists_3

Time: ✅ 39.560µs (SLO: <50.000µs 📉 -20.9%) vs baseline: -0.4%

Memory: ✅ 35.330MB (SLO: <36.000MB 🟡 -1.9%) vs baseline: +4.6%


✅ useragentvariant_not_exists_1

Time: ✅ 39.230µs (SLO: <50.000µs 📉 -21.5%) vs baseline: -0.3%

Memory: ✅ 35.527MB (SLO: <36.000MB 🟡 -1.3%) vs baseline: +5.4%


✅ useragentvariant_not_exists_2

Time: ✅ 39.020µs (SLO: <50.000µs 📉 -22.0%) vs baseline: -0.9%

Memory: ✅ 35.429MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +5.0%


🟡 span - 26/26

✅ add-event

Time: ✅ 17.718ms (SLO: <22.500ms 📉 -21.3%) vs baseline: +1.1%

Memory: ✅ 37.002MB (SLO: <53.000MB 📉 -30.2%) vs baseline: +4.6%


✅ add-metrics

Time: ✅ 87.681ms (SLO: <93.500ms -6.2%) vs baseline: +0.7%

Memory: ✅ 41.083MB (SLO: <53.000MB 📉 -22.5%) vs baseline: +4.4%


✅ add-tags

Time: ✅ 141.387ms (SLO: <155.000ms -8.8%) vs baseline: ~same

Memory: ✅ 41.260MB (SLO: <53.000MB 📉 -22.2%) vs baseline: +5.0%


✅ get-context

Time: ✅ 16.437ms (SLO: <20.500ms 📉 -19.8%) vs baseline: +0.2%

Memory: ✅ 36.780MB (SLO: <53.000MB 📉 -30.6%) vs baseline: +4.8%


✅ is-recording

Time: ✅ 16.696ms (SLO: <20.500ms 📉 -18.6%) vs baseline: -0.2%

Memory: ✅ 36.741MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +4.5%


✅ record-exception

Time: ✅ 34.912ms (SLO: <40.000ms 📉 -12.7%) vs baseline: ~same

Memory: ✅ 37.418MB (SLO: <53.000MB 📉 -29.4%) vs baseline: +5.1%


✅ set-status

Time: ✅ 18.000ms (SLO: <22.000ms 📉 -18.2%) vs baseline: -0.4%

Memory: ✅ 36.954MB (SLO: <53.000MB 📉 -30.3%) vs baseline: +5.4%


✅ start

Time: ✅ 16.769ms (SLO: <20.500ms 📉 -18.2%) vs baseline: +2.6%

Memory: ✅ 36.820MB (SLO: <53.000MB 📉 -30.5%) vs baseline: +4.7%


✅ start-finish

Time: ✅ 48.963ms (SLO: <52.500ms -6.7%) vs baseline: -0.6%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.0%


✅ start-finish-telemetry

Time: ✅ 50.301ms (SLO: <54.500ms -7.7%) vs baseline: +0.5%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.7%


✅ start-finish-traceid128

Time: ✅ 52.070ms (SLO: <57.000ms -8.6%) vs baseline: -0.2%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.4%


✅ start-traceid128

Time: ✅ 16.662ms (SLO: <22.500ms 📉 -25.9%) vs baseline: -0.8%

Memory: ✅ 36.831MB (SLO: <53.000MB 📉 -30.5%) vs baseline: +4.7%


✅ update-name

Time: ✅ 16.926ms (SLO: <22.000ms 📉 -23.1%) vs baseline: +0.6%

Memory: ✅ 36.879MB (SLO: <53.000MB 📉 -30.4%) vs baseline: +4.9%


🟡 tracer - 6/6

✅ large

Time: ✅ 28.015ms (SLO: <32.950ms 📉 -15.0%) vs baseline: ~same

Memory: ✅ 36.156MB (SLO: <36.500MB 🟡 -0.9%) vs baseline: +5.0%


✅ medium

Time: ✅ 2.766ms (SLO: <3.200ms 📉 -13.6%) vs baseline: -0.2%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.5%


✅ small

Time: ✅ 320.814µs (SLO: <370.000µs 📉 -13.3%) vs baseline: +1.9%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.6%

⚠️ Unstable Tests (1 suite)
⚠️ packagesupdateimporteddependencies - 24/24 (1 unstable)

✅ import_many

Time: ✅ 155.302µs (SLO: <170.000µs -8.6%) vs baseline: ~same

Memory: ✅ 39.471MB (SLO: <43.000MB -8.2%) vs baseline: +5.1%


✅ import_many_cached

Time: ✅ 120.471µs (SLO: <130.000µs -7.3%) vs baseline: -0.5%

Memory: ✅ 39.651MB (SLO: <43.000MB -7.8%) vs baseline: +5.9%


✅ import_many_stdlib

Time: ✅ 0.761ms (SLO: <1.750ms 📉 -56.5%) vs baseline: +0.7%

Memory: ✅ 39.454MB (SLO: <43.000MB -8.2%) vs baseline: +4.8%


⚠️ import_many_stdlib_cached

Time: ⚠️ 0.174ms (SLO: <1.100ms 📉 -84.2%) vs baseline: +0.8%

Memory: ✅ 39.396MB (SLO: <43.000MB -8.4%) vs baseline: +4.8%


✅ import_many_unknown

Time: ✅ 831.802µs (SLO: <890.000µs -6.5%) vs baseline: +0.4%

Memory: ✅ 39.698MB (SLO: <43.000MB -7.7%) vs baseline: +5.1%


✅ import_many_unknown_cached

Time: ✅ 794.758µs (SLO: <870.000µs -8.6%) vs baseline: ~same

Memory: ✅ 39.656MB (SLO: <43.000MB -7.8%) vs baseline: +4.7%


✅ import_one

Time: ✅ 19.822µs (SLO: <30.000µs 📉 -33.9%) vs baseline: +0.2%

Memory: ✅ 39.473MB (SLO: <43.000MB -8.2%) vs baseline: +4.3%


✅ import_one_cache

Time: ✅ 6.308µs (SLO: <10.000µs 📉 -36.9%) vs baseline: ~same

Memory: ✅ 39.311MB (SLO: <43.000MB -8.6%) vs baseline: +4.2%


✅ import_one_stdlib

Time: ✅ 18.752µs (SLO: <20.000µs -6.2%) vs baseline: -0.3%

Memory: ✅ 39.376MB (SLO: <43.000MB -8.4%) vs baseline: +4.2%


✅ import_one_stdlib_cache

Time: ✅ 6.298µs (SLO: <10.000µs 📉 -37.0%) vs baseline: +0.2%

Memory: ✅ 39.348MB (SLO: <43.000MB -8.5%) vs baseline: +5.1%


✅ import_one_unknown

Time: ✅ 45.598µs (SLO: <50.000µs -8.8%) vs baseline: -0.9%

Memory: ✅ 39.299MB (SLO: <43.000MB -8.6%) vs baseline: +4.3%


✅ import_one_unknown_cache

Time: ✅ 6.247µs (SLO: <10.000µs 📉 -37.5%) vs baseline: -0.7%

Memory: ✅ 39.351MB (SLO: <43.000MB -8.5%) vs baseline: +5.3%

✅ All Tests Passing (5 suites)
iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 37.204µs (SLO: <40.000µs -7.0%) vs baseline: +6.6%

Memory: ✅ 41.465MB (SLO: <43.500MB -4.7%) vs baseline: +5.1%


✅ re_expand_noaspect

Time: ✅ 34.806µs (SLO: <40.000µs 📉 -13.0%) vs baseline: +0.3%

Memory: ✅ 41.386MB (SLO: <43.500MB -4.9%) vs baseline: +4.7%


✅ re_findall_aspect

Time: ✅ 3.352µs (SLO: <10.000µs 📉 -66.5%) vs baseline: -0.3%

Memory: ✅ 41.406MB (SLO: <43.500MB -4.8%) vs baseline: +4.9%


✅ re_findall_noaspect

Time: ✅ 3.259µs (SLO: <10.000µs 📉 -67.4%) vs baseline: +0.8%

Memory: ✅ 41.425MB (SLO: <43.500MB -4.8%) vs baseline: +4.7%


✅ re_finditer_aspect

Time: ✅ 4.497µs (SLO: <10.000µs 📉 -55.0%) vs baseline: -0.4%

Memory: ✅ 41.386MB (SLO: <43.500MB -4.9%) vs baseline: +4.8%


✅ re_finditer_noaspect

Time: ✅ 3.297µs (SLO: <10.000µs 📉 -67.0%) vs baseline: +0.9%

Memory: ✅ 41.445MB (SLO: <43.500MB -4.7%) vs baseline: +4.9%


✅ re_fullmatch_aspect

Time: ✅ 2.743µs (SLO: <10.000µs 📉 -72.6%) vs baseline: -0.4%

Memory: ✅ 41.366MB (SLO: <43.500MB -4.9%) vs baseline: +4.7%


✅ re_fullmatch_noaspect

Time: ✅ 3.031µs (SLO: <10.000µs 📉 -69.7%) vs baseline: -0.3%

Memory: ✅ 41.484MB (SLO: <43.500MB -4.6%) vs baseline: +5.2%


✅ re_group_aspect

Time: ✅ 4.805µs (SLO: <10.000µs 📉 -52.0%) vs baseline: +0.6%

Memory: ✅ 41.445MB (SLO: <43.500MB -4.7%) vs baseline: +4.9%


✅ re_group_noaspect

Time: ✅ 4.824µs (SLO: <10.000µs 📉 -51.8%) vs baseline: -1.0%

Memory: ✅ 41.445MB (SLO: <43.500MB -4.7%) vs baseline: +4.9%


✅ re_groups_aspect

Time: ✅ 4.882µs (SLO: <10.000µs 📉 -51.2%) vs baseline: +0.4%

Memory: ✅ 41.504MB (SLO: <43.500MB -4.6%) vs baseline: +5.0%


✅ re_groups_noaspect

Time: ✅ 4.926µs (SLO: <10.000µs 📉 -50.7%) vs baseline: -0.3%

Memory: ✅ 41.406MB (SLO: <43.500MB -4.8%) vs baseline: +4.8%


✅ re_match_aspect

Time: ✅ 2.816µs (SLO: <10.000µs 📉 -71.8%) vs baseline: +0.7%

Memory: ✅ 41.445MB (SLO: <43.500MB -4.7%) vs baseline: +4.9%


✅ re_match_noaspect

Time: ✅ 3.075µs (SLO: <10.000µs 📉 -69.2%) vs baseline: -0.9%

Memory: ✅ 41.366MB (SLO: <43.500MB -4.9%) vs baseline: +4.7%


✅ re_search_aspect

Time: ✅ 2.605µs (SLO: <10.000µs 📉 -74.0%) vs baseline: +0.4%

Memory: ✅ 41.484MB (SLO: <43.500MB -4.6%) vs baseline: +5.0%


✅ re_search_noaspect

Time: ✅ 2.844µs (SLO: <10.000µs 📉 -71.6%) vs baseline: -1.4%

Memory: ✅ 41.366MB (SLO: <43.500MB -4.9%) vs baseline: +4.8%


✅ re_sub_aspect

Time: ✅ 3.492µs (SLO: <10.000µs 📉 -65.1%) vs baseline: +0.5%

Memory: ✅ 41.366MB (SLO: <43.500MB -4.9%) vs baseline: +4.7%


✅ re_sub_noaspect

Time: ✅ 3.985µs (SLO: <10.000µs 📉 -60.1%) vs baseline: +0.6%

Memory: ✅ 41.524MB (SLO: <43.500MB -4.5%) vs baseline: +5.3%


✅ re_subn_aspect

Time: ✅ 3.761µs (SLO: <10.000µs 📉 -62.4%) vs baseline: +1.5%

Memory: ✅ 41.386MB (SLO: <43.500MB -4.9%) vs baseline: +4.7%


✅ re_subn_noaspect

Time: ✅ 4.083µs (SLO: <10.000µs 📉 -59.2%) vs baseline: +0.1%

Memory: ✅ 41.465MB (SLO: <43.500MB -4.7%) vs baseline: +4.9%


iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.727µs (SLO: <10.000µs 📉 -82.7%) vs baseline: +9.7%

Memory: ✅ 41.366MB (SLO: <43.500MB -4.9%) vs baseline: +5.0%


✅ rsplit_noaspect

Time: ✅ 1.632µs (SLO: <10.000µs 📉 -83.7%) vs baseline: +1.3%

Memory: ✅ 41.425MB (SLO: <43.500MB -4.8%) vs baseline: +5.0%


✅ split_aspect

Time: ✅ 1.613µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +1.9%

Memory: ✅ 41.465MB (SLO: <43.500MB -4.7%) vs baseline: +5.2%


✅ split_noaspect

Time: ✅ 1.644µs (SLO: <10.000µs 📉 -83.6%) vs baseline: +2.0%

Memory: ✅ 41.425MB (SLO: <43.500MB -4.8%) vs baseline: +5.0%


✅ splitlines_aspect

Time: ✅ 1.512µs (SLO: <10.000µs 📉 -84.9%) vs baseline: +0.1%

Memory: ✅ 41.366MB (SLO: <43.500MB -4.9%) vs baseline: +4.7%


✅ splitlines_noaspect

Time: ✅ 1.571µs (SLO: <10.000µs 📉 -84.3%) vs baseline: -1.2%

Memory: ✅ 41.425MB (SLO: <43.500MB -4.8%) vs baseline: +4.7%


iastpropagation - 8/8

✅ no-propagation

Time: ✅ 48.575µs (SLO: <60.000µs 📉 -19.0%) vs baseline: +0.7%

Memory: ✅ 38.358MB (SLO: <42.000MB -8.7%) vs baseline: +5.0%


✅ propagation_enabled

Time: ✅ 135.415µs (SLO: <190.000µs 📉 -28.7%) vs baseline: +0.2%

Memory: ✅ 38.299MB (SLO: <42.000MB -8.8%) vs baseline: +4.9%


✅ propagation_enabled_100

Time: ✅ 1.584ms (SLO: <2.300ms 📉 -31.1%) vs baseline: ~same

Memory: ✅ 38.181MB (SLO: <42.000MB -9.1%) vs baseline: +4.9%


✅ propagation_enabled_1000

Time: ✅ 29.168ms (SLO: <34.550ms 📉 -15.6%) vs baseline: -0.6%

Memory: ✅ 38.260MB (SLO: <42.000MB -8.9%) vs baseline: +4.8%


otelsdkspan - 24/24

✅ add-event

Time: ✅ 38.648ms (SLO: <42.000ms -8.0%) vs baseline: ~same

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +4.9%


✅ add-link

Time: ✅ 35.051ms (SLO: <38.550ms -9.1%) vs baseline: +0.6%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +4.9%


✅ add-metrics

Time: ✅ 217.465ms (SLO: <232.000ms -6.3%) vs baseline: +0.7%

Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +5.7%


✅ add-tags

Time: ✅ 209.480ms (SLO: <221.600ms -5.5%) vs baseline: -0.2%

Memory: ✅ 37.395MB (SLO: <39.000MB -4.1%) vs baseline: +4.9%


✅ get-context

Time: ✅ 28.090ms (SLO: <31.300ms 📉 -10.3%) vs baseline: +0.4%

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.5%


✅ is-recording

Time: ✅ 28.170ms (SLO: <31.000ms -9.1%) vs baseline: +0.4%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.7%


✅ record-exception

Time: ✅ 60.695ms (SLO: <65.850ms -7.8%) vs baseline: -0.1%

Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +5.0%


✅ set-status

Time: ✅ 30.589ms (SLO: <34.150ms 📉 -10.4%) vs baseline: +0.1%

Memory: ✅ 37.395MB (SLO: <39.000MB -4.1%) vs baseline: +5.5%


✅ start

Time: ✅ 28.234ms (SLO: <30.150ms -6.4%) vs baseline: +1.9%

Memory: ✅ 37.434MB (SLO: <39.000MB -4.0%) vs baseline: +5.1%


✅ start-finish

Time: ✅ 32.594ms (SLO: <35.350ms -7.8%) vs baseline: +0.3%

Memory: ✅ 37.415MB (SLO: <39.000MB -4.1%) vs baseline: +5.1%


✅ start-finish-telemetry

Time: ✅ 32.494ms (SLO: <35.450ms -8.3%) vs baseline: -0.5%

Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +4.6%


✅ update-name

Time: ✅ 29.881ms (SLO: <33.400ms 📉 -10.5%) vs baseline: +0.3%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.7%


packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 342.734ms (SLO: <354.300ms -3.3%) vs baseline: -1.0%

Memory: ✅ 40.524MB (SLO: <43.500MB -6.8%) vs baseline: +4.8%


✅ cache_on

Time: ✅ 0.384µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.2%

Memory: ✅ 40.030MB (SLO: <43.000MB -6.9%) vs baseline: +4.6%

ℹ️ Scenarios Missing SLO Configuration (10 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

  • coreapiscenario-core_dispatch_listeners
  • coreapiscenario-core_dispatch_no_listeners
  • coreapiscenario-core_dispatch_with_results_listeners
  • coreapiscenario-core_dispatch_with_results_no_listeners
  • djangosimple-baseline
  • errortrackingdjangosimple-baseline
  • errortrackingflasksqli-baseline
  • flasksimple-baseline
  • flasksqli-baseline
  • sethttpmeta-obfuscation-disabled

@KowalskiThomas KowalskiThomas force-pushed the kowalski/test-profiling-unflake-test_gunicorn-again branch from 288c130 to 17915b1 Compare January 8, 2026 16:25
@KowalskiThomas KowalskiThomas force-pushed the kowalski/test-profiling-unflake-test_gunicorn-again branch from 17915b1 to 7c5c7bf Compare January 8, 2026 16:37
@KowalskiThomas KowalskiThomas merged commit fc843c0 into 4.1 Jan 8, 2026
405 checks passed
@KowalskiThomas KowalskiThomas deleted the kowalski/test-profiling-unflake-test_gunicorn-again branch January 8, 2026 17:38
taegyunkim added a commit that referenced this pull request Jan 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/no-changelog A changelog entry is not required for this PR. Profiling Continous Profling

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants