ci(iast): update benchmark functions #15563

avara1986 · 2025-12-09T14:17:56Z

No description provided.

github-actions · 2025-12-09T14:18:28Z

CODEOWNERS have been resolved as:

benchmarks/appsec_iast_aspects/scenario.py                              @DataDog/asm-python

github-actions · 2025-12-09T14:50:22Z

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 251 ± 4 ms.

The average import time from base is: 256 ± 4 ms.

The import time difference between this PR and base is: -4.6 ± 0.2 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 2.817 ms (1.12%)

ddtrace.bootstrap.sitecustomize 1.433 ms (0.57%)

ddtrace.bootstrap.preload 1.433 ms (0.57%)

ddtrace.internal.remoteconfig.client 0.675 ms (0.27%)

ddtrace 1.385 ms (0.55%)

ddtrace._logger 0.697 ms (0.28%)

ddtrace.internal.telemetry 0.697 ms (0.28%)

ddtrace.internal.telemetry.writer 0.697 ms (0.28%)

ddtrace.internal.utils.version 0.697 ms (0.28%)

ddtrace.version 0.697 ms (0.28%)

ddtrace.internal._unpatched 0.030 ms (0.01%)

json 0.030 ms (0.01%)

json.decoder 0.030 ms (0.01%)

re 0.030 ms (0.01%)

enum 0.030 ms (0.01%)

types 0.030 ms (0.01%)

pr-commenter · 2025-12-09T15:56:51Z

Performance SLOs

Comparing candidate avara1986/APPSEC-60151_update_benchmark_2 (239bf9d) with baseline main (2d3267b)

❌ Test Failures (1 suite)

❌ iastaspects - 26/82

❌ add_aspect

Time: ❌ 18.369µs (SLO: <10.000µs 📈 +83.7%) vs baseline: 📈 +20.5%

Memory: ❌ 42.774MB (SLO: <41.500MB +3.1%) vs baseline: +5.0%

❌ add_inplace_aspect

Time: ❌ 15.173µs (SLO: <10.000µs 📈 +51.7%) vs baseline: -0.4%

Memory: ❌ 42.797MB (SLO: <41.500MB +3.1%) vs baseline: +5.0%

❌ add_inplace_noaspect

Time: ✅ 0.340µs (SLO: <10.000µs 📉 -96.6%) vs baseline: ~same

Memory: ❌ 42.761MB (SLO: <41.500MB +3.0%) vs baseline: +4.7%

❌ add_noaspect

Time: ✅ 0.548µs (SLO: <10.000µs 📉 -94.5%) vs baseline: ~same

Memory: ❌ 42.728MB (SLO: <41.500MB +3.0%) vs baseline: +4.9%

❌ bytes_aspect

Time: ❌ 16.917µs (SLO: <10.000µs 📈 +69.2%) vs baseline: +0.4%

Memory: ❌ 42.825MB (SLO: <41.500MB +3.2%) vs baseline: +4.9%

❌ bytes_noaspect

Time: ✅ 1.390µs (SLO: <10.000µs 📉 -86.1%) vs baseline: -1.1%

Memory: ❌ 42.597MB (SLO: <41.500MB +2.6%) vs baseline: +4.0%

❌ capitalize_aspect

Time: ❌ 14.843µs (SLO: <10.000µs 📈 +48.4%) vs baseline: -0.1%

Memory: ❌ 42.668MB (SLO: <41.500MB +2.8%) vs baseline: +4.9%

❌ capitalize_noaspect

Time: ✅ 2.513µs (SLO: <10.000µs 📉 -74.9%) vs baseline: -0.5%

Memory: ❌ 42.781MB (SLO: <41.500MB +3.1%) vs baseline: +4.9%

❌ casefold_aspect

Time: ❌ 14.951µs (SLO: <10.000µs 📈 +49.5%) vs baseline: +0.9%

Memory: ❌ 42.664MB (SLO: <41.500MB +2.8%) vs baseline: +4.8%

❌ casefold_noaspect

Time: ✅ 3.070µs (SLO: <10.000µs 📉 -69.3%) vs baseline: -0.4%

Memory: ❌ 42.803MB (SLO: <41.500MB +3.1%) vs baseline: +5.2%

❌ encode_noaspect

Time: ✅ 1.465µs (SLO: <10.000µs 📉 -85.3%) vs baseline: -0.5%

Memory: ❌ 42.659MB (SLO: <41.500MB +2.8%) vs baseline: +4.7%

❌ format_aspect

Time: ❌ 169.218µs (SLO: <10.000µs 📈 +1592.2%) vs baseline: +0.1%

Memory: ❌ 42.949MB (SLO: <41.500MB +3.5%) vs baseline: +4.9%

❌ format_map_noaspect

Time: ✅ 3.804µs (SLO: <10.000µs 📉 -62.0%) vs baseline: +0.2%

Memory: ❌ 42.747MB (SLO: <41.500MB +3.0%) vs baseline: +4.7%

❌ format_noaspect

Time: ✅ 3.161µs (SLO: <10.000µs 📉 -68.4%) vs baseline: +1.0%

Memory: ❌ 42.822MB (SLO: <41.500MB +3.2%) vs baseline: +5.5%

❌ index_aspect

Time: ❌ 15.367µs (SLO: <10.000µs 📈 +53.7%) vs baseline: -0.6%

Memory: ❌ 42.774MB (SLO: <41.500MB +3.1%) vs baseline: +4.8%

❌ index_noaspect

Time: ✅ 0.462µs (SLO: <10.000µs 📉 -95.4%) vs baseline: +0.8%

Memory: ❌ 42.637MB (SLO: <41.500MB +2.7%) vs baseline: +4.6%

❌ join_noaspect

Time: ✅ 1.523µs (SLO: <10.000µs 📉 -84.8%) vs baseline: ~same

Memory: ❌ 42.826MB (SLO: <41.500MB +3.2%) vs baseline: +4.8%

❌ ljust_aspect

Time: ❌ 21.031µs (SLO: <20.000µs +5.2%) vs baseline: +0.2%

Memory: ❌ 42.755MB (SLO: <41.500MB +3.0%) vs baseline: +5.0%

❌ ljust_noaspect

Time: ✅ 2.637µs (SLO: <10.000µs 📉 -73.6%) vs baseline: -0.9%

Memory: ❌ 42.815MB (SLO: <41.500MB +3.2%) vs baseline: +5.4%

❌ lower_aspect

Time: ❌ 17.941µs (SLO: <10.000µs 📈 +79.4%) vs baseline: -0.4%

Memory: ❌ 42.743MB (SLO: <41.500MB +3.0%) vs baseline: +4.9%

❌ lower_noaspect

Time: ✅ 2.389µs (SLO: <10.000µs 📉 -76.1%) vs baseline: +0.9%

Memory: ❌ 42.838MB (SLO: <41.500MB +3.2%) vs baseline: +5.2%

❌ lstrip_aspect

Time: ✅ 17.810µs (SLO: <20.000µs 📉 -11.0%) vs baseline: -0.3%

Memory: ❌ 42.738MB (SLO: <41.500MB +3.0%) vs baseline: +4.8%

❌ lstrip_noaspect

Time: ✅ 1.811µs (SLO: <10.000µs 📉 -81.9%) vs baseline: +0.4%

Memory: ❌ 42.886MB (SLO: <41.500MB +3.3%) vs baseline: +5.7%

❌ modulo_noaspect

Time: ✅ 0.736µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.4%

Memory: ❌ 42.609MB (SLO: <41.500MB +2.7%) vs baseline: +4.4%

❌ replace_aspect

Time: ❌ 212.492µs (SLO: <10.000µs 📈 +2024.9%) vs baseline: +0.2%

Memory: ❌ 42.642MB (SLO: <41.500MB +2.8%) vs baseline: +4.3%

❌ replace_noaspect

Time: ✅ 5.028µs (SLO: <10.000µs 📉 -49.7%) vs baseline: -1.0%

Memory: ❌ 42.717MB (SLO: <41.500MB +2.9%) vs baseline: +5.1%

❌ repr_noaspect

Time: ✅ 0.517µs (SLO: <10.000µs 📉 -94.8%) vs baseline: ~same

Memory: ❌ 42.860MB (SLO: <41.500MB +3.3%) vs baseline: +5.2%

❌ rstrip_aspect

Time: ✅ 19.238µs (SLO: <20.000µs -3.8%) vs baseline: +1.1%

Memory: ❌ 42.805MB (SLO: <41.500MB +3.1%) vs baseline: +5.1%

❌ rstrip_noaspect

Time: ✅ 1.893µs (SLO: <10.000µs 📉 -81.1%) vs baseline: -1.9%

Memory: ❌ 42.866MB (SLO: <41.500MB +3.3%) vs baseline: +5.5%

❌ slice_aspect

Time: ❌ 15.900µs (SLO: <10.000µs 📈 +59.0%) vs baseline: -0.3%

Memory: ❌ 42.870MB (SLO: <41.500MB +3.3%) vs baseline: +5.2%

❌ slice_noaspect

Time: ✅ 0.604µs (SLO: <10.000µs 📉 -94.0%) vs baseline: +0.7%

Memory: ❌ 42.599MB (SLO: <41.500MB +2.6%) vs baseline: +4.2%

❌ strip_aspect

Time: ✅ 17.804µs (SLO: <20.000µs 📉 -11.0%) vs baseline: -0.6%

Memory: ❌ 42.790MB (SLO: <41.500MB +3.1%) vs baseline: +5.0%

❌ strip_noaspect

Time: ✅ 1.807µs (SLO: <10.000µs 📉 -81.9%) vs baseline: -0.4%

Memory: ❌ 42.729MB (SLO: <41.500MB +3.0%) vs baseline: +5.4%

❌ swapcase_aspect

Time: ❌ 21.950µs (SLO: <10.000µs 📈 +119.5%) vs baseline: 📈 +19.8%

Memory: ❌ 42.614MB (SLO: <41.500MB +2.7%) vs baseline: +4.6%

❌ swapcase_noaspect

Time: ✅ 2.627µs (SLO: <10.000µs 📉 -73.7%) vs baseline: -0.2%

Memory: ❌ 42.824MB (SLO: <41.500MB +3.2%) vs baseline: +5.4%

❌ title_aspect

Time: ❌ 18.169µs (SLO: <10.000µs 📈 +81.7%) vs baseline: ~same

Memory: ❌ 42.851MB (SLO: <41.500MB +3.3%) vs baseline: +5.1%

❌ title_noaspect

Time: ✅ 2.548µs (SLO: <10.000µs 📉 -74.5%) vs baseline: +0.6%

Memory: ❌ 42.759MB (SLO: <41.500MB +3.0%) vs baseline: +5.5%

❌ translate_aspect

Time: ❌ 20.292µs (SLO: <10.000µs 📈 +102.9%) vs baseline: ~same

Memory: ❌ 42.699MB (SLO: <41.500MB +2.9%) vs baseline: +4.9%

❌ translate_noaspect

Time: ✅ 4.047µs (SLO: <10.000µs 📉 -59.5%) vs baseline: +0.2%

Memory: ❌ 42.795MB (SLO: <41.500MB +3.1%) vs baseline: +5.0%

❌ upper_aspect

Time: ❌ 17.977µs (SLO: <10.000µs 📈 +79.8%) vs baseline: +0.2%

Memory: ❌ 42.698MB (SLO: <41.500MB +2.9%) vs baseline: +4.6%

❌ upper_noaspect

Time: ✅ 2.396µs (SLO: <10.000µs 📉 -76.0%) vs baseline: ~same

Memory: ❌ 42.801MB (SLO: <41.500MB +3.1%) vs baseline: +5.4%

📈 Performance Regressions (2 suites)

📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 5.113µs (SLO: <10.000µs 📉 -48.9%) vs baseline: 📈 +22.2%

Memory: ✅ 38.594MB (SLO: <41.000MB -5.9%) vs baseline: +5.0%

✅ ospathbasename_noaspect

Time: ✅ 1.079µs (SLO: <10.000µs 📉 -89.2%) vs baseline: -0.6%

Memory: ✅ 38.594MB (SLO: <41.000MB -5.9%) vs baseline: +5.0%

✅ ospathjoin_aspect

Time: ✅ 6.159µs (SLO: <10.000µs 📉 -38.4%) vs baseline: +2.5%

Memory: ✅ 38.633MB (SLO: <41.000MB -5.8%) vs baseline: +5.7%

✅ ospathjoin_noaspect

Time: ✅ 2.298µs (SLO: <10.000µs 📉 -77.0%) vs baseline: +0.2%

Memory: ✅ 38.594MB (SLO: <41.000MB -5.9%) vs baseline: +4.9%

✅ ospathnormcase_aspect

Time: ✅ 3.472µs (SLO: <10.000µs 📉 -65.3%) vs baseline: +0.9%

Memory: ✅ 38.555MB (SLO: <41.000MB -6.0%) vs baseline: +4.6%

✅ ospathnormcase_noaspect

Time: ✅ 0.569µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -0.6%

Memory: ✅ 38.614MB (SLO: <41.000MB -5.8%) vs baseline: +4.9%

✅ ospathsplit_aspect

Time: ✅ 4.817µs (SLO: <10.000µs 📉 -51.8%) vs baseline: +0.2%

Memory: ✅ 38.653MB (SLO: <41.000MB -5.7%) vs baseline: +5.2%

✅ ospathsplit_noaspect

Time: ✅ 1.579µs (SLO: <10.000µs 📉 -84.2%) vs baseline: -1.0%

Memory: ✅ 38.614MB (SLO: <41.000MB -5.8%) vs baseline: +5.1%

✅ ospathsplitdrive_aspect

Time: ✅ 3.689µs (SLO: <10.000µs 📉 -63.1%) vs baseline: +0.7%

Memory: ✅ 38.594MB (SLO: <41.000MB -5.9%) vs baseline: +5.6%

✅ ospathsplitdrive_noaspect

Time: ✅ 0.702µs (SLO: <10.000µs 📉 -93.0%) vs baseline: -0.8%

Memory: ✅ 38.516MB (SLO: <41.000MB -6.1%) vs baseline: +4.7%

✅ ospathsplitext_aspect

Time: ✅ 4.575µs (SLO: <10.000µs 📉 -54.3%) vs baseline: +2.1%

Memory: ✅ 38.535MB (SLO: <41.000MB -6.0%) vs baseline: +4.7%

✅ ospathsplitext_noaspect

Time: ✅ 1.394µs (SLO: <10.000µs 📉 -86.1%) vs baseline: +1.4%

Memory: ✅ 38.476MB (SLO: <41.000MB -6.2%) vs baseline: +4.6%

📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.313µs (SLO: <20.000µs 📉 -83.4%) vs baseline: 📈 +15.6%

Memory: ✅ 35.036MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +4.8%

✅ 1-count-metrics-100-times

Time: ✅ 198.747µs (SLO: <220.000µs -9.7%) vs baseline: -0.2%

Memory: ✅ 35.036MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +4.8%

✅ 1-distribution-metric-1-times

Time: ✅ 3.162µs (SLO: <20.000µs 📉 -84.2%) vs baseline: -0.2%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.3%

✅ 1-distribution-metrics-100-times

Time: ✅ 213.552µs (SLO: <230.000µs -7.2%) vs baseline: +0.4%

Memory: ✅ 35.055MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +4.9%

✅ 1-gauge-metric-1-times

Time: ✅ 2.148µs (SLO: <20.000µs 📉 -89.3%) vs baseline: -0.4%

Memory: ✅ 35.036MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +4.9%

✅ 1-gauge-metrics-100-times

Time: ✅ 136.922µs (SLO: <150.000µs -8.7%) vs baseline: +0.4%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.6%

✅ 1-rate-metric-1-times

Time: ✅ 2.998µs (SLO: <20.000µs 📉 -85.0%) vs baseline: +1.0%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.8%

✅ 1-rate-metrics-100-times

Time: ✅ 212.525µs (SLO: <250.000µs 📉 -15.0%) vs baseline: +0.4%

Memory: ✅ 35.036MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +4.8%

✅ 100-count-metrics-100-times

Time: ✅ 20.061ms (SLO: <22.000ms -8.8%) vs baseline: -0.9%

Memory: ✅ 34.682MB (SLO: <35.500MB -2.3%) vs baseline: +4.6%

✅ 100-distribution-metrics-100-times

Time: ✅ 2.238ms (SLO: <2.550ms 📉 -12.3%) vs baseline: -1.0%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.2%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.411ms (SLO: <1.550ms -9.0%) vs baseline: +0.7%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +5.2%

✅ 100-rate-metrics-100-times

Time: ✅ 2.188ms (SLO: <2.550ms 📉 -14.2%) vs baseline: -0.1%

Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.7%

✅ flush-1-metric

Time: ✅ 4.486µs (SLO: <20.000µs 📉 -77.6%) vs baseline: -0.1%

Memory: ✅ 35.055MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +4.9%

✅ flush-100-metrics

Time: ✅ 173.673µs (SLO: <250.000µs 📉 -30.5%) vs baseline: -0.2%

Memory: ✅ 35.095MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.8%

✅ flush-1000-metrics

Time: ✅ 2.178ms (SLO: <2.500ms 📉 -12.9%) vs baseline: ~same

Memory: ✅ 36.058MB (SLO: <36.500MB 🟡 -1.2%) vs baseline: +5.6%

🟡 Near SLO Breach (14 suites)

🟡 djangosimple - 29/29

✅ appsec

Time: ✅ 19.543ms (SLO: <22.300ms 📉 -12.4%) vs baseline: -0.1%

Memory: ✅ 68.144MB (SLO: <70.500MB -3.3%) vs baseline: +4.7%

✅ exception-replay-enabled

Time: ✅ 1.370ms (SLO: <1.450ms -5.5%) vs baseline: +0.9%

Memory: ✅ 66.252MB (SLO: <67.500MB 🟡 -1.8%) vs baseline: +4.8%

✅ iast

Time: ✅ 19.559ms (SLO: <22.250ms 📉 -12.1%) vs baseline: -0.5%

Memory: ✅ 68.243MB (SLO: <70.000MB -2.5%) vs baseline: +5.1%

✅ profiler

Time: ✅ 15.491ms (SLO: <16.550ms -6.4%) vs baseline: +0.3%

Memory: ✅ 56.336MB (SLO: <57.500MB -2.0%) vs baseline: +4.8%

✅ resource-renaming

Time: ✅ 19.527ms (SLO: <21.750ms 📉 -10.2%) vs baseline: +0.2%

Memory: ✅ 68.164MB (SLO: <70.500MB -3.3%) vs baseline: +4.7%

✅ span-code-origin

Time: ✅ 19.932ms (SLO: <28.200ms 📉 -29.3%) vs baseline: +1.1%

Memory: ✅ 68.104MB (SLO: <71.000MB -4.1%) vs baseline: +4.7%

✅ tracer

Time: ✅ 19.633ms (SLO: <21.750ms -9.7%) vs baseline: +0.4%

Memory: ✅ 68.144MB (SLO: <70.000MB -2.7%) vs baseline: +4.9%

✅ tracer-and-profiler

Time: ✅ 21.771ms (SLO: <23.500ms -7.4%) vs baseline: +0.2%

✅ tracer-dont-create-db-spans

Time: ✅ 19.671ms (SLO: <21.500ms -8.5%) vs baseline: +0.5%

Memory: ✅ 68.243MB (SLO: <70.000MB -2.5%) vs baseline: +4.9%

✅ tracer-minimal

Time: ✅ 16.804ms (SLO: <17.500ms -4.0%) vs baseline: +0.5%

Memory: ✅ 67.849MB (SLO: <70.000MB -3.1%) vs baseline: +4.9%

✅ tracer-native

Time: ✅ 19.507ms (SLO: <21.750ms 📉 -10.3%) vs baseline: ~same

Memory: ✅ 68.243MB (SLO: <72.500MB -5.9%) vs baseline: +4.9%

✅ tracer-no-caches

Time: ✅ 17.648ms (SLO: <19.650ms 📉 -10.2%) vs baseline: +0.3%

Memory: ✅ 67.967MB (SLO: <70.000MB -2.9%) vs baseline: +4.6%

✅ tracer-no-databases

Time: ✅ 19.145ms (SLO: <20.100ms -4.7%) vs baseline: +0.3%

Memory: ✅ 67.790MB (SLO: <70.000MB -3.2%) vs baseline: +4.8%

✅ tracer-no-middleware

Time: ✅ 19.210ms (SLO: <21.500ms 📉 -10.7%) vs baseline: -0.5%

Memory: ✅ 68.184MB (SLO: <70.000MB -2.6%) vs baseline: +4.8%

✅ tracer-no-templates

Time: ✅ 19.532ms (SLO: <22.000ms 📉 -11.2%) vs baseline: +0.8%

Memory: ✅ 68.104MB (SLO: <70.500MB -3.4%) vs baseline: +4.9%

🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 16.346ms (SLO: <19.850ms 📉 -17.7%) vs baseline: +0.2%

Memory: ✅ 69.855MB (SLO: <70.000MB 🟡 -0.2%) vs baseline: +5.0%

✅ errortracking-enabled-user

Time: ✅ 16.319ms (SLO: <19.400ms 📉 -15.9%) vs baseline: -0.2%

Memory: ✅ 69.884MB (SLO: <70.000MB 🟡 -0.2%) vs baseline: +5.0%

✅ tracer-enabled

Time: ✅ 16.355ms (SLO: <19.450ms 📉 -15.9%) vs baseline: -0.4%

Memory: ✅ 69.739MB (SLO: <70.000MB 🟡 -0.4%) vs baseline: +4.8%

🟡 errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.063ms (SLO: <2.300ms 📉 -10.3%) vs baseline: -0.1%

Memory: ✅ 55.758MB (SLO: <56.500MB 🟡 -1.3%) vs baseline: +4.9%

✅ errortracking-enabled-user

Time: ✅ 2.068ms (SLO: <2.250ms -8.1%) vs baseline: -0.2%

Memory: ✅ 55.758MB (SLO: <56.500MB 🟡 -1.3%) vs baseline: +4.8%

✅ tracer-enabled

Time: ✅ 2.058ms (SLO: <2.300ms 📉 -10.5%) vs baseline: -0.2%

Memory: ✅ 55.778MB (SLO: <56.500MB 🟡 -1.3%) vs baseline: +4.9%

🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 3.390ms (SLO: <4.750ms 📉 -28.6%) vs baseline: +0.1%

Memory: ✅ 55.394MB (SLO: <66.500MB 📉 -16.7%) vs baseline: +4.9%

✅ appsec-post

Time: ✅ 2.855ms (SLO: <6.750ms 📉 -57.7%) vs baseline: +0.3%

Memory: ✅ 55.631MB (SLO: <66.500MB 📉 -16.3%) vs baseline: +4.5%

✅ appsec-telemetry

Time: ✅ 3.398ms (SLO: <4.750ms 📉 -28.5%) vs baseline: +0.8%

Memory: ✅ 55.452MB (SLO: <66.500MB 📉 -16.6%) vs baseline: +5.1%

✅ debugger

Time: ✅ 1.868ms (SLO: <2.000ms -6.6%) vs baseline: ~same

Memory: ✅ 47.899MB (SLO: <49.500MB -3.2%) vs baseline: +4.8%

✅ iast-get

Time: ✅ 1.854ms (SLO: <2.000ms -7.3%) vs baseline: ~same

Memory: ✅ 44.540MB (SLO: <49.000MB -9.1%) vs baseline: +5.0%

✅ profiler

Time: ✅ 1.904ms (SLO: <2.100ms -9.3%) vs baseline: -0.4%

Memory: ✅ 48.807MB (SLO: <50.000MB -2.4%) vs baseline: +4.8%

✅ resource-renaming

Time: ✅ 3.347ms (SLO: <3.650ms -8.3%) vs baseline: ~same

Memory: ✅ 55.451MB (SLO: <56.000MB 🟡 -1.0%) vs baseline: +4.9%

✅ tracer

Time: ✅ 3.362ms (SLO: <3.650ms -7.9%) vs baseline: -0.3%

Memory: ✅ 55.451MB (SLO: <56.500MB 🟡 -1.9%) vs baseline: +4.9%

✅ tracer-native

Time: ✅ 3.360ms (SLO: <3.650ms -8.0%) vs baseline: -0.2%

Memory: ✅ 55.436MB (SLO: <60.000MB -7.6%) vs baseline: +4.9%

🟡 flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 2.061ms (SLO: <4.200ms 📉 -50.9%) vs baseline: ~same

Memory: ✅ 55.797MB (SLO: <66.000MB 📉 -15.5%) vs baseline: +5.0%

✅ iast-enabled

Time: ✅ 2.066ms (SLO: <2.800ms 📉 -26.2%) vs baseline: ~same

Memory: ✅ 55.797MB (SLO: <62.500MB 📉 -10.7%) vs baseline: +4.8%

✅ tracer-enabled

Time: ✅ 2.057ms (SLO: <2.250ms -8.6%) vs baseline: ~same

Memory: ✅ 55.758MB (SLO: <56.500MB 🟡 -1.3%) vs baseline: +4.7%

🟡 httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 80.744µs (SLO: <100.000µs 📉 -19.3%) vs baseline: -0.8%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.9%

✅ b3_headers

Time: ✅ 14.184µs (SLO: <20.000µs 📉 -29.1%) vs baseline: -0.4%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.8%

✅ b3_single_headers

Time: ✅ 13.373µs (SLO: <20.000µs 📉 -33.1%) vs baseline: +0.4%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.3%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 63.983µs (SLO: <80.000µs 📉 -20.0%) vs baseline: +0.2%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 69.325µs (SLO: <80.000µs 📉 -13.3%) vs baseline: +5.1%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%

✅ empty_headers

Time: ✅ 1.655µs (SLO: <10.000µs 📉 -83.5%) vs baseline: +3.0%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.8%

✅ full_t_id_datadog_headers

Time: ✅ 22.524µs (SLO: <30.000µs 📉 -24.9%) vs baseline: -0.1%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%

✅ invalid_priority_header

Time: ✅ 6.550µs (SLO: <10.000µs 📉 -34.5%) vs baseline: +0.4%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.8%

✅ invalid_span_id_header

Time: ✅ 6.523µs (SLO: <10.000µs 📉 -34.8%) vs baseline: -0.9%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.6%

✅ invalid_tags_header

Time: ✅ 6.553µs (SLO: <10.000µs 📉 -34.5%) vs baseline: +0.4%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%

✅ invalid_trace_id_header

Time: ✅ 6.490µs (SLO: <10.000µs 📉 -35.1%) vs baseline: -1.0%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.7%

✅ large_header_no_matches

Time: ✅ 27.638µs (SLO: <30.000µs -7.9%) vs baseline: +0.4%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.6%

✅ large_valid_headers_all

Time: ✅ 28.734µs (SLO: <40.000µs 📉 -28.2%) vs baseline: -0.2%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.4%

✅ medium_header_no_matches

Time: ✅ 9.903µs (SLO: <20.000µs 📉 -50.5%) vs baseline: ~same

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.8%

✅ medium_valid_headers_all

Time: ✅ 11.301µs (SLO: <20.000µs 📉 -43.5%) vs baseline: -0.6%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%

✅ none_propagation_style

Time: ✅ 1.719µs (SLO: <10.000µs 📉 -82.8%) vs baseline: +0.2%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%

✅ tracecontext_headers

Time: ✅ 34.971µs (SLO: <40.000µs 📉 -12.6%) vs baseline: +0.2%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%

✅ valid_headers_all

Time: ✅ 6.544µs (SLO: <10.000µs 📉 -34.6%) vs baseline: +0.2%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%

✅ valid_headers_basic

Time: ✅ 6.113µs (SLO: <10.000µs 📉 -38.9%) vs baseline: -0.2%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.4%

✅ wsgi_empty_headers

Time: ✅ 1.630µs (SLO: <10.000µs 📉 -83.7%) vs baseline: +0.6%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.7%

✅ wsgi_invalid_priority_header

Time: ✅ 6.598µs (SLO: <10.000µs 📉 -34.0%) vs baseline: +0.7%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.7%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.624µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +1.3%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.7%

✅ wsgi_invalid_tags_header

Time: ✅ 6.572µs (SLO: <10.000µs 📉 -34.3%) vs baseline: -0.4%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.0%

✅ wsgi_invalid_trace_id_header

Time: ✅ 6.574µs (SLO: <10.000µs 📉 -34.3%) vs baseline: +0.3%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.7%

✅ wsgi_large_header_no_matches

Time: ✅ 28.703µs (SLO: <40.000µs 📉 -28.2%) vs baseline: ~same

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.6%

✅ wsgi_large_valid_headers_all

Time: ✅ 30.005µs (SLO: <40.000µs 📉 -25.0%) vs baseline: +0.2%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%

✅ wsgi_medium_header_no_matches

Time: ✅ 10.137µs (SLO: <20.000µs 📉 -49.3%) vs baseline: +0.3%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.6%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.752µs (SLO: <20.000µs 📉 -41.2%) vs baseline: +1.1%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.1%

✅ wsgi_valid_headers_all

Time: ✅ 6.659µs (SLO: <10.000µs 📉 -33.4%) vs baseline: +1.5%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.7%

✅ wsgi_valid_headers_basic

Time: ✅ 6.130µs (SLO: <10.000µs 📉 -38.7%) vs baseline: +0.2%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.6%

🟡 httppropagationinject - 16/16

✅ ids_only

Time: ✅ 22.073µs (SLO: <30.000µs 📉 -26.4%) vs baseline: +6.1%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.0%

✅ with_all

Time: ✅ 27.598µs (SLO: <40.000µs 📉 -31.0%) vs baseline: -0.1%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.7%

✅ with_dd_origin

Time: ✅ 24.775µs (SLO: <30.000µs 📉 -17.4%) vs baseline: +0.6%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.2%

✅ with_priority_and_origin

Time: ✅ 24.178µs (SLO: <40.000µs 📉 -39.6%) vs baseline: +1.0%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%

✅ with_sampling_priority

Time: ✅ 20.947µs (SLO: <30.000µs 📉 -30.2%) vs baseline: +0.5%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.9%

✅ with_tags

Time: ✅ 25.957µs (SLO: <40.000µs 📉 -35.1%) vs baseline: +0.6%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.7%

✅ with_tags_invalid

Time: ✅ 27.269µs (SLO: <40.000µs 📉 -31.8%) vs baseline: -0.1%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.7%

✅ with_tags_max_size

Time: ✅ 26.348µs (SLO: <40.000µs 📉 -34.1%) vs baseline: +0.6%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%

🟡 otelspan - 22/22

✅ add-event

Time: ✅ 40.394ms (SLO: <47.150ms 📉 -14.3%) vs baseline: +0.2%

Memory: ✅ 39.492MB (SLO: <47.000MB 📉 -16.0%) vs baseline: +4.9%

✅ add-metrics

Time: ✅ 261.685ms (SLO: <344.800ms 📉 -24.1%) vs baseline: -0.5%

Memory: ✅ 43.805MB (SLO: <47.500MB -7.8%) vs baseline: +4.7%

✅ add-tags

Time: ✅ 316.296ms (SLO: <321.000ms 🟡 -1.5%) vs baseline: -0.9%

Memory: ✅ 43.765MB (SLO: <47.500MB -7.9%) vs baseline: +5.0%

✅ get-context

Time: ✅ 80.282ms (SLO: <92.350ms 📉 -13.1%) vs baseline: -0.2%

Memory: ✅ 39.859MB (SLO: <46.500MB 📉 -14.3%) vs baseline: +4.8%

✅ is-recording

Time: ✅ 38.071ms (SLO: <44.500ms 📉 -14.4%) vs baseline: +0.6%

Memory: ✅ 39.502MB (SLO: <47.500MB 📉 -16.8%) vs baseline: +4.7%

✅ record-exception

Time: ✅ 58.929ms (SLO: <67.650ms 📉 -12.9%) vs baseline: ~same

Memory: ✅ 40.011MB (SLO: <47.000MB 📉 -14.9%) vs baseline: +4.6%

✅ set-status

Time: ✅ 44.316ms (SLO: <50.400ms 📉 -12.1%) vs baseline: +0.2%

Memory: ✅ 39.480MB (SLO: <47.000MB 📉 -16.0%) vs baseline: +4.7%

✅ start

Time: ✅ 38.302ms (SLO: <43.450ms 📉 -11.8%) vs baseline: +2.6%

Memory: ✅ 39.537MB (SLO: <47.000MB 📉 -15.9%) vs baseline: +4.8%

✅ start-finish

Time: ✅ 82.855ms (SLO: <88.000ms -5.8%) vs baseline: -0.2%

Memory: ✅ 37.375MB (SLO: <46.500MB 📉 -19.6%) vs baseline: +5.1%

✅ start-finish-telemetry

Time: ✅ 84.490ms (SLO: <89.000ms -5.1%) vs baseline: -0.2%

Memory: ✅ 37.257MB (SLO: <46.500MB 📉 -19.9%) vs baseline: +4.9%

✅ update-name

Time: ✅ 38.728ms (SLO: <45.150ms 📉 -14.2%) vs baseline: ~same

Memory: ✅ 39.680MB (SLO: <47.000MB 📉 -15.6%) vs baseline: +5.0%

🟡 ratelimiter - 12/12

✅ defaults

Time: ✅ 2.360µs (SLO: <10.000µs 📉 -76.4%) vs baseline: ~same

Memory: ✅ 35.114MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +5.0%

✅ high_rate_limit

Time: ✅ 2.430µs (SLO: <10.000µs 📉 -75.7%) vs baseline: -0.2%

Memory: ✅ 35.154MB (SLO: <35.500MB 🟡 -1.0%) vs baseline: +4.9%

✅ long_window

Time: ✅ 2.376µs (SLO: <10.000µs 📉 -76.2%) vs baseline: ~same

Memory: ✅ 35.252MB (SLO: <35.500MB 🟡 -0.7%) vs baseline: +5.1%

✅ low_rate_limit

Time: ✅ 2.383µs (SLO: <10.000µs 📉 -76.2%) vs baseline: +1.2%

Memory: ✅ 35.055MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +4.6%

✅ no_rate_limit

Time: ✅ 0.819µs (SLO: <10.000µs 📉 -91.8%) vs baseline: -1.5%

Memory: ✅ 35.134MB (SLO: <35.500MB 🟡 -1.0%) vs baseline: +5.1%

✅ short_window

Time: ✅ 2.494µs (SLO: <10.000µs 📉 -75.1%) vs baseline: ~same

Memory: ✅ 35.114MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.9%

🟡 recursivecomputation - 8/8

✅ deep

Time: ✅ 309.507ms (SLO: <320.950ms -3.6%) vs baseline: +0.3%

Memory: ✅ 35.901MB (SLO: <36.500MB 🟡 -1.6%) vs baseline: +4.8%

✅ deep-profiled

Time: ✅ 328.308ms (SLO: <359.150ms -8.6%) vs baseline: ~same

Memory: ✅ 39.872MB (SLO: <40.500MB 🟡 -1.6%) vs baseline: +5.0%

✅ medium

Time: ✅ 7.007ms (SLO: <7.400ms -5.3%) vs baseline: +0.2%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.8%

✅ shallow

Time: ✅ 0.948ms (SLO: <1.050ms -9.8%) vs baseline: +1.5%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%

🟡 samplingrules - 8/8

✅ average_match

Time: ✅ 137.981µs (SLO: <290.000µs 📉 -52.4%) vs baseline: +1.5%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.1%

✅ high_match

Time: ✅ 174.977µs (SLO: <480.000µs 📉 -63.5%) vs baseline: +1.1%

Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.6%

✅ low_match

Time: ✅ 98.536µs (SLO: <120.000µs 📉 -17.9%) vs baseline: +0.1%

Memory: ✅ 603.475MB (SLO: <700.000MB 📉 -13.8%) vs baseline: +4.8%

✅ very_low_match

Time: ✅ 2.670ms (SLO: <8.500ms 📉 -68.6%) vs baseline: -0.5%

Memory: ✅ 70.955MB (SLO: <75.000MB -5.4%) vs baseline: +4.8%

🟡 sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.551µs (SLO: <20.000µs 📉 -47.2%) vs baseline: -0.1%

Memory: ✅ 35.389MB (SLO: <36.000MB 🟡 -1.7%) vs baseline: +3.9%

✅ all-enabled

Time: ✅ 41.113µs (SLO: <50.000µs 📉 -17.8%) vs baseline: +1.9%

Memory: ✅ 35.527MB (SLO: <36.000MB 🟡 -1.3%) vs baseline: +4.6%

✅ collectipvariant_exists

Time: ✅ 41.036µs (SLO: <50.000µs 📉 -17.9%) vs baseline: ~same

Memory: ✅ 35.704MB (SLO: <36.000MB 🟡 -0.8%) vs baseline: +5.0%

✅ no-collectipvariant

Time: ✅ 40.648µs (SLO: <50.000µs 📉 -18.7%) vs baseline: +0.7%

Memory: ✅ 35.606MB (SLO: <36.000MB 🟡 -1.1%) vs baseline: +4.8%

✅ no-useragentvariant

Time: ✅ 39.225µs (SLO: <50.000µs 📉 -21.6%) vs baseline: +0.4%

Memory: ✅ 35.704MB (SLO: <36.000MB 🟡 -0.8%) vs baseline: +4.9%

✅ obfuscation-no-query

Time: ✅ 40.780µs (SLO: <50.000µs 📉 -18.4%) vs baseline: -0.3%

Memory: ✅ 35.704MB (SLO: <36.000MB 🟡 -0.8%) vs baseline: +4.7%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 76.077µs (SLO: <90.000µs 📉 -15.5%) vs baseline: ~same

Memory: ✅ 35.684MB (SLO: <36.500MB -2.2%) vs baseline: +5.0%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.687µs (SLO: <90.000µs 📉 -14.8%) vs baseline: +0.4%

Memory: ✅ 35.802MB (SLO: <36.500MB 🟡 -1.9%) vs baseline: +5.4%

✅ obfuscation-send-querystring-disabled

Time: ✅ 154.722µs (SLO: <170.000µs -9.0%) vs baseline: ~same

Memory: ✅ 35.704MB (SLO: <36.500MB -2.2%) vs baseline: +4.7%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.849µs (SLO: <160.000µs -7.0%) vs baseline: ~same

Memory: ✅ 35.684MB (SLO: <36.500MB -2.2%) vs baseline: +5.0%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 155.580µs (SLO: <170.000µs -8.5%) vs baseline: +0.3%

Memory: ✅ 35.645MB (SLO: <36.500MB -2.3%) vs baseline: +4.8%

✅ useragentvariant_exists_1

Time: ✅ 39.820µs (SLO: <50.000µs 📉 -20.4%) vs baseline: +0.2%

Memory: ✅ 35.429MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +4.1%

✅ useragentvariant_exists_2

Time: ✅ 40.967µs (SLO: <50.000µs 📉 -18.1%) vs baseline: ~same

Memory: ✅ 35.724MB (SLO: <36.000MB 🟡 -0.8%) vs baseline: +4.9%

✅ useragentvariant_exists_3

Time: ✅ 40.447µs (SLO: <50.000µs 📉 -19.1%) vs baseline: +0.6%

Memory: ✅ 35.743MB (SLO: <36.000MB 🟡 -0.7%) vs baseline: +5.1%

✅ useragentvariant_not_exists_1

Time: ✅ 39.821µs (SLO: <50.000µs 📉 -20.4%) vs baseline: +0.3%

Memory: ✅ 35.704MB (SLO: <36.000MB 🟡 -0.8%) vs baseline: +5.1%

✅ useragentvariant_not_exists_2

Time: ✅ 39.820µs (SLO: <50.000µs 📉 -20.4%) vs baseline: +0.2%

Memory: ✅ 35.704MB (SLO: <36.000MB 🟡 -0.8%) vs baseline: +4.9%

🟡 span - 26/26

✅ add-event

Time: ✅ 18.205ms (SLO: <22.500ms 📉 -19.1%) vs baseline: +0.5%

Memory: ✅ 36.857MB (SLO: <53.000MB 📉 -30.5%) vs baseline: +5.2%

✅ add-metrics

Time: ✅ 88.656ms (SLO: <93.500ms -5.2%) vs baseline: +0.2%

Memory: ✅ 41.091MB (SLO: <53.000MB 📉 -22.5%) vs baseline: +5.0%

✅ add-tags

Time: ✅ 141.956ms (SLO: <155.000ms -8.4%) vs baseline: -0.3%

Memory: ✅ 41.043MB (SLO: <53.000MB 📉 -22.6%) vs baseline: +4.7%

✅ get-context

Time: ✅ 16.992ms (SLO: <20.500ms 📉 -17.1%) vs baseline: -0.5%

Memory: ✅ 36.743MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +4.9%

✅ is-recording

Time: ✅ 17.340ms (SLO: <20.500ms 📉 -15.4%) vs baseline: +1.2%

Memory: ✅ 36.744MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +4.8%

✅ record-exception

Time: ✅ 36.684ms (SLO: <40.000ms -8.3%) vs baseline: +0.4%

Memory: ✅ 37.253MB (SLO: <53.000MB 📉 -29.7%) vs baseline: +4.8%

✅ set-status

Time: ✅ 18.691ms (SLO: <22.000ms 📉 -15.0%) vs baseline: +0.5%

Memory: ✅ 36.742MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +5.0%

✅ start

Time: ✅ 17.350ms (SLO: <20.500ms 📉 -15.4%) vs baseline: +2.7%

Memory: ✅ 36.762MB (SLO: <53.000MB 📉 -30.6%) vs baseline: +5.0%

✅ start-finish

Time: ✅ 51.146ms (SLO: <52.500ms -2.6%) vs baseline: +0.1%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.1%

✅ start-finish-telemetry

Time: ✅ 52.462ms (SLO: <54.500ms -3.7%) vs baseline: -0.4%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.7%

✅ start-finish-traceid128

Time: ✅ 54.275ms (SLO: <57.000ms -4.8%) vs baseline: ~same

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.2%

✅ start-traceid128

Time: ✅ 17.293ms (SLO: <22.500ms 📉 -23.1%) vs baseline: +0.8%

Memory: ✅ 36.743MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +5.0%

✅ update-name

Time: ✅ 17.343ms (SLO: <22.000ms 📉 -21.2%) vs baseline: ~same

Memory: ✅ 36.817MB (SLO: <53.000MB 📉 -30.5%) vs baseline: +5.0%

🟡 tracer - 6/6

✅ large

Time: ✅ 29.173ms (SLO: <32.950ms 📉 -11.5%) vs baseline: +0.1%

Memory: ✅ 35.920MB (SLO: <36.500MB 🟡 -1.6%) vs baseline: +4.6%

✅ medium

Time: ✅ 2.889ms (SLO: <3.200ms -9.7%) vs baseline: -0.2%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.4%

✅ small

Time: ✅ 331.366µs (SLO: <370.000µs 📉 -10.4%) vs baseline: +1.8%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.9%

⚠️ Unstable Tests (2 suites)

⚠️

coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.199µs (SLO: <20.000µs 📉 -34.0%) vs baseline: -0.2%

Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.8%

✅ context_with_data_no_listeners

Time: ✅ 3.245µs (SLO: <10.000µs 📉 -67.5%) vs baseline: -1.7%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +5.0%

✅ get_item_exists

Time: ✅ 0.578µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -1.6%

Memory: ✅ 34.701MB (SLO: <35.500MB -2.2%) vs baseline: +4.7%

✅ get_item_missing

Time: ✅ 0.632µs (SLO: <10.000µs 📉 -93.7%) vs baseline: -1.0%

Memory: ✅ 34.701MB (SLO: <35.500MB -2.2%) vs baseline: +4.8%

✅ set_item

Time: ✅ 24.077µs (SLO: <30.000µs 📉 -19.7%) vs baseline: -1.0%

Memory: ✅ 34.701MB (SLO: <35.500MB -2.2%) vs baseline: +4.7%

⚠️

packagesupdateimporteddependencies - 24/24 (1 unstable)

✅ import_many

Time: ✅ 155.209µs (SLO: <170.000µs -8.7%) vs baseline: +0.3%

Memory: ✅ 39.430MB (SLO: <41.000MB -3.8%) vs baseline: +4.7%

✅ import_many_cached

Time: ✅ 120.939µs (SLO: <130.000µs -7.0%) vs baseline: +0.3%

Memory: ✅ 39.359MB (SLO: <41.000MB -4.0%) vs baseline: +4.8%

✅ import_many_stdlib

Time: ✅ 0.753ms (SLO: <1.750ms 📉 -57.0%) vs baseline: ~same

Memory: ✅ 39.298MB (SLO: <41.000MB -4.2%) vs baseline: +4.6%

⚠️ import_many_stdlib_cached

Time: ⚠️ 0.172ms (SLO: <1.100ms 📉 -84.4%) vs baseline: ~same

Memory: ✅ 39.402MB (SLO: <41.000MB -3.9%) vs baseline: +4.9%

✅ import_many_unknown

Time: ✅ 826.934µs (SLO: <890.000µs -7.1%) vs baseline: -1.2%

Memory: ✅ 39.807MB (SLO: <41.000MB -2.9%) vs baseline: +5.8%

✅ import_many_unknown_cached

Time: ✅ 790.590µs (SLO: <870.000µs -9.1%) vs baseline: -0.2%

Memory: ✅ 39.507MB (SLO: <41.000MB -3.6%) vs baseline: +4.7%

✅ import_one

Time: ✅ 19.710µs (SLO: <30.000µs 📉 -34.3%) vs baseline: ~same

Memory: ✅ 39.386MB (SLO: <41.000MB -3.9%) vs baseline: +5.2%

✅ import_one_cache

Time: ✅ 6.267µs (SLO: <10.000µs 📉 -37.3%) vs baseline: -0.4%

Memory: ✅ 39.439MB (SLO: <41.000MB -3.8%) vs baseline: +4.5%

✅ import_one_stdlib

Time: ✅ 18.575µs (SLO: <20.000µs -7.1%) vs baseline: ~same

Memory: ✅ 39.233MB (SLO: <41.000MB -4.3%) vs baseline: +4.3%

✅ import_one_stdlib_cache

Time: ✅ 6.270µs (SLO: <10.000µs 📉 -37.3%) vs baseline: -0.4%

Memory: ✅ 39.511MB (SLO: <41.000MB -3.6%) vs baseline: +5.5%

✅ import_one_unknown

Time: ✅ 45.446µs (SLO: <50.000µs -9.1%) vs baseline: +0.3%

Memory: ✅ 39.400MB (SLO: <41.000MB -3.9%) vs baseline: +5.0%

✅ import_one_unknown_cache

Time: ✅ 6.283µs (SLO: <10.000µs 📉 -37.2%) vs baseline: -0.2%

Memory: ✅ 39.470MB (SLO: <41.000MB -3.7%) vs baseline: +5.5%

✅ All Tests Passing (5 suites)

✅ iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 33.786µs (SLO: <40.000µs 📉 -15.5%) vs baseline: +7.0%

Memory: ✅ 38.614MB (SLO: <41.000MB -5.8%) vs baseline: +4.9%

✅ re_expand_noaspect

Time: ✅ 28.447µs (SLO: <40.000µs 📉 -28.9%) vs baseline: -1.3%

Memory: ✅ 38.614MB (SLO: <41.000MB -5.8%) vs baseline: +4.9%

✅ re_findall_aspect

Time: ✅ 2.900µs (SLO: <10.000µs 📉 -71.0%) vs baseline: -0.4%

Memory: ✅ 38.614MB (SLO: <41.000MB -5.8%) vs baseline: +5.7%

✅ re_findall_noaspect

Time: ✅ 1.411µs (SLO: <10.000µs 📉 -85.9%) vs baseline: +0.4%

Memory: ✅ 38.574MB (SLO: <41.000MB -5.9%) vs baseline: +4.5%

✅ re_finditer_aspect

Time: ✅ 4.452µs (SLO: <10.000µs 📉 -55.5%) vs baseline: +1.3%

Memory: ✅ 38.574MB (SLO: <41.000MB -5.9%) vs baseline: +4.6%

✅ re_finditer_noaspect

Time: ✅ 1.404µs (SLO: <10.000µs 📉 -86.0%) vs baseline: -0.4%

Memory: ✅ 38.633MB (SLO: <41.000MB -5.8%) vs baseline: +5.1%

✅ re_fullmatch_aspect

Time: ✅ 2.674µs (SLO: <10.000µs 📉 -73.3%) vs baseline: +0.3%

Memory: ✅ 38.535MB (SLO: <41.000MB -6.0%) vs baseline: +5.0%

✅ re_fullmatch_noaspect

Time: ✅ 1.304µs (SLO: <10.000µs 📉 -87.0%) vs baseline: -0.9%

Memory: ✅ 38.673MB (SLO: <41.000MB -5.7%) vs baseline: +5.0%

✅ re_group_aspect

Time: ✅ 2.968µs (SLO: <10.000µs 📉 -70.3%) vs baseline: +1.1%

Memory: ✅ 38.653MB (SLO: <41.000MB -5.7%) vs baseline: +5.2%

✅ re_group_noaspect

Time: ✅ 1.609µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +0.9%

Memory: ✅ 38.476MB (SLO: <41.000MB -6.2%) vs baseline: +4.5%

✅ re_groups_aspect

Time: ✅ 3.083µs (SLO: <10.000µs 📉 -69.2%) vs baseline: +1.6%

Memory: ✅ 38.496MB (SLO: <41.000MB -6.1%) vs baseline: +4.6%

✅ re_groups_noaspect

Time: ✅ 1.705µs (SLO: <10.000µs 📉 -82.9%) vs baseline: ~same

Memory: ✅ 38.516MB (SLO: <41.000MB -6.1%) vs baseline: +4.8%

✅ re_match_aspect

Time: ✅ 2.707µs (SLO: <10.000µs 📉 -72.9%) vs baseline: +0.9%

Memory: ✅ 38.653MB (SLO: <41.000MB -5.7%) vs baseline: +4.9%

✅ re_match_noaspect

Time: ✅ 1.315µs (SLO: <10.000µs 📉 -86.9%) vs baseline: -1.6%

Memory: ✅ 38.614MB (SLO: <41.000MB -5.8%) vs baseline: +5.0%

✅ re_search_aspect

Time: ✅ 2.538µs (SLO: <10.000µs 📉 -74.6%) vs baseline: -0.2%

Memory: ✅ 38.633MB (SLO: <41.000MB -5.8%) vs baseline: +5.1%

✅ re_search_noaspect

Time: ✅ 1.199µs (SLO: <10.000µs 📉 -88.0%) vs baseline: -0.3%

Memory: ✅ 38.692MB (SLO: <41.000MB -5.6%) vs baseline: +5.2%

✅ re_sub_aspect

Time: ✅ 3.618µs (SLO: <10.000µs 📉 -63.8%) vs baseline: +6.9%

Memory: ✅ 38.535MB (SLO: <41.000MB -6.0%) vs baseline: +4.8%

✅ re_sub_noaspect

Time: ✅ 1.528µs (SLO: <10.000µs 📉 -84.7%) vs baseline: -0.2%

Memory: ✅ 38.496MB (SLO: <41.000MB -6.1%) vs baseline: +4.5%

✅ re_subn_aspect

Time: ✅ 3.625µs (SLO: <10.000µs 📉 -63.7%) vs baseline: +1.2%

Memory: ✅ 38.535MB (SLO: <41.000MB -6.0%) vs baseline: +4.6%

✅ re_subn_noaspect

Time: ✅ 1.619µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +0.6%

Memory: ✅ 38.339MB (SLO: <41.000MB -6.5%) vs baseline: +4.2%

✅ iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.361µs (SLO: <10.000µs 📉 -86.4%) vs baseline: -1.6%

Memory: ✅ 38.673MB (SLO: <41.000MB -5.7%) vs baseline: +5.2%

✅ rsplit_noaspect

Time: ✅ 0.580µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +0.3%

Memory: ✅ 38.574MB (SLO: <41.000MB -5.9%) vs baseline: +4.8%

✅ split_aspect

Time: ✅ 1.366µs (SLO: <10.000µs 📉 -86.3%) vs baseline: -0.2%

Memory: ✅ 38.614MB (SLO: <41.000MB -5.8%) vs baseline: +5.0%

✅ split_noaspect

Time: ✅ 0.573µs (SLO: <10.000µs 📉 -94.3%) vs baseline: +1.1%

Memory: ✅ 38.516MB (SLO: <41.000MB -6.1%) vs baseline: +4.5%

✅ splitlines_aspect

Time: ✅ 1.339µs (SLO: <10.000µs 📉 -86.6%) vs baseline: -3.7%

Memory: ✅ 38.496MB (SLO: <41.000MB -6.1%) vs baseline: +4.8%

✅ splitlines_noaspect

Time: ✅ 0.588µs (SLO: <10.000µs 📉 -94.1%) vs baseline: ~same

Memory: ✅ 38.555MB (SLO: <41.000MB -6.0%) vs baseline: +4.9%

✅ iastpropagation - 8/8

✅ no-propagation

Time: ✅ 49.068µs (SLO: <60.000µs 📉 -18.2%) vs baseline: +0.2%

Memory: ✅ 38.299MB (SLO: <42.000MB -8.8%) vs baseline: +5.5%

✅ propagation_enabled

Time: ✅ 137.896µs (SLO: <190.000µs 📉 -27.4%) vs baseline: -0.4%

Memory: ✅ 38.103MB (SLO: <42.000MB -9.3%) vs baseline: +4.5%

✅ propagation_enabled_100

Time: ✅ 1.585ms (SLO: <2.300ms 📉 -31.1%) vs baseline: +0.9%

Memory: ✅ 38.181MB (SLO: <42.000MB -9.1%) vs baseline: +4.6%

✅ propagation_enabled_1000

Time: ✅ 29.058ms (SLO: <34.550ms 📉 -15.9%) vs baseline: ~same

Memory: ✅ 38.555MB (SLO: <42.000MB -8.2%) vs baseline: +5.1%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.384ms (SLO: <42.000ms -3.8%) vs baseline: +0.5%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.1%

✅ add-link

Time: ✅ 36.320ms (SLO: <38.550ms -5.8%) vs baseline: +0.9%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%

✅ add-metrics

Time: ✅ 219.783ms (SLO: <232.000ms -5.3%) vs baseline: +0.8%

Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +4.6%

✅ add-tags

Time: ✅ 209.336ms (SLO: <221.600ms -5.5%) vs baseline: -1.0%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.2%

✅ get-context

Time: ✅ 29.039ms (SLO: <31.300ms -7.2%) vs baseline: -0.2%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%

✅ is-recording

Time: ✅ 29.065ms (SLO: <31.000ms -6.2%) vs baseline: -0.6%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ record-exception

Time: ✅ 63.161ms (SLO: <65.850ms -4.1%) vs baseline: +0.5%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%

✅ set-status

Time: ✅ 32.259ms (SLO: <34.150ms -5.5%) vs baseline: +1.4%

Memory: ✅ 37.768MB (SLO: <39.000MB -3.2%) vs baseline: +5.2%

✅ start

Time: ✅ 29.169ms (SLO: <30.150ms -3.3%) vs baseline: +1.3%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%

✅ start-finish

Time: ✅ 33.696ms (SLO: <35.350ms -4.7%) vs baseline: -0.2%

Memory: ✅ 37.788MB (SLO: <39.000MB -3.1%) vs baseline: +5.2%

✅ start-finish-telemetry

Time: ✅ 33.955ms (SLO: <35.450ms -4.2%) vs baseline: -0.2%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ update-name

Time: ✅ 31.115ms (SLO: <33.400ms -6.8%) vs baseline: +0.5%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%

✅ packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 343.477ms (SLO: <354.300ms -3.1%) vs baseline: -0.9%

Memory: ✅ 40.353MB (SLO: <41.500MB -2.8%) vs baseline: +4.1%

✅ cache_on

Time: ✅ 0.382µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.3%

Memory: ✅ 39.243MB (SLO: <41.000MB -4.3%) vs baseline: +5.2%

ℹ️ Scenarios Missing SLO Configuration (10 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

coreapiscenario-core_dispatch_listeners
coreapiscenario-core_dispatch_no_listeners
coreapiscenario-core_dispatch_with_results_listeners
coreapiscenario-core_dispatch_with_results_no_listeners
djangosimple-baseline
errortrackingdjangosimple-baseline
errortrackingflasksqli-baseline
flasksimple-baseline
flasksqli-baseline
sethttpmeta-obfuscation-disabled

update benchmark functions

3ac884e

avara1986 added changelog/no-changelog A changelog entry is not required for this PR. ASM Application Security Monitoring labels Dec 9, 2025

update benchmark functions

2e816af

update benchmark functions

239bf9d

ci(iast): update benchmark functions #15563

Are you sure you want to change the base?

ci(iast): update benchmark functions #15563

Uh oh!

Conversation

avara1986 commented Dec 9, 2025

Uh oh!

github-actions bot commented Dec 9, 2025

Uh oh!

github-actions bot commented Dec 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Bootstrap import analysis

Summary

Import time breakdown

Uh oh!

pr-commenter bot commented Dec 9, 2025

Performance SLOs

❌ add_aspect

❌ add_inplace_aspect

❌ add_inplace_noaspect

❌ add_noaspect

❌ bytes_aspect

❌ bytes_noaspect

❌ capitalize_aspect

❌ capitalize_noaspect

❌ casefold_aspect

❌ casefold_noaspect

❌ encode_noaspect

❌ format_aspect

❌ format_map_noaspect

❌ format_noaspect

❌ index_aspect

❌ index_noaspect

❌ join_noaspect

❌ ljust_aspect

❌ ljust_noaspect

❌ lower_aspect

❌ lower_noaspect

❌ lstrip_aspect

❌ lstrip_noaspect

❌ modulo_noaspect

❌ replace_aspect

❌ replace_noaspect

❌ repr_noaspect

❌ rstrip_aspect

❌ rstrip_noaspect

❌ slice_aspect

❌ slice_noaspect

❌ strip_aspect

❌ strip_noaspect

❌ swapcase_aspect

❌ swapcase_noaspect

❌ title_aspect

❌ title_noaspect

❌ translate_aspect

❌ translate_noaspect

❌ upper_aspect

❌ upper_noaspect

✅ ospathbasename_aspect

✅ ospathbasename_noaspect

✅ ospathjoin_aspect

✅ ospathjoin_noaspect

✅ ospathnormcase_aspect

✅ ospathnormcase_noaspect

✅ ospathsplit_aspect

✅ ospathsplit_noaspect

✅ ospathsplitdrive_aspect

✅ ospathsplitdrive_noaspect

✅ ospathsplitext_aspect

✅ ospathsplitext_noaspect

✅ 1-count-metric-1-times

✅ 1-count-metrics-100-times

✅ 1-distribution-metric-1-times

✅ 1-distribution-metrics-100-times

✅ 1-gauge-metric-1-times

✅ 1-gauge-metrics-100-times

✅ 1-rate-metric-1-times

✅ 1-rate-metrics-100-times

✅ 100-count-metrics-100-times

✅ 100-distribution-metrics-100-times

github-actions bot commented Dec 9, 2025 •

edited

Loading