Set benchmarking jobs to be interruptible outside master #9994

igoragoli · 2025-11-18T14:04:41Z

What Does This Do

Set benchmarking jobs to be interruptible outside master.
- Only jobs that extend .benchmarks and .macrobenchmarks are concerned. Kafka benchmarks and debugger benchmarks are not included, since they do not run on master.

Motivation

APMSP-2369
#incident-45572

Additional Notes

Testing: benchmarking jobs being interrupted after a "test interruptibility" commit, a1649f3.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: APMSP-2369

pr-commenter · 2025-11-18T14:58:15Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
git_commit_date	1763637994	1763649716
git_commit_sha	`c05874d`	`3684c74`
release_version	1.56.0~c05874d84e	1.56.0-SNAPSHOT~3684c74f7d

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763651680	1763651680
ci_job_id	1247766872	1247766872
ci_pipeline_id	83370301	83370301
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-phqpccyc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-phqpccyc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 6 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~3684c74f7d, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.103 s) : 0, 1103043
Total [baseline] (8.853 s) : 0, 8852889
Agent [candidate] (1.104 s) : 0, 1104211
Total [candidate] (8.864 s) : 0, 8864331
section iast
Agent [baseline] (1.256 s) : 0, 1256451
Total [baseline] (9.586 s) : 0, 9585832
Agent [candidate] (1.244 s) : 0, 1244041
Total [candidate] (9.59 s) : 0, 9589652

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.103 s	-
Agent	iast	1.256 s	153.408 ms (13.9%)
Total	tracing	8.853 s	-
Total	iast	9.586 s	732.942 ms (8.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.104 s	-
Agent	iast	1.244 s	139.83 ms (12.7%)
Total	tracing	8.864 s	-
Total	iast	9.59 s	725.321 ms (8.2%)

gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~3684c74f7d, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.488 ms) : 0, 1488
crashtracking [candidate] (1.468 ms) : 0, 1468
BytebuddyAgent [baseline] (708.749 ms) : 0, 708749
BytebuddyAgent [candidate] (709.837 ms) : 0, 709837
GlobalTracer [baseline] (249.791 ms) : 0, 249791
GlobalTracer [candidate] (250.187 ms) : 0, 250187
AppSec [baseline] (32.124 ms) : 0, 32124
AppSec [candidate] (32.184 ms) : 0, 32184
Debugger [baseline] (63.181 ms) : 0, 63181
Debugger [candidate] (62.886 ms) : 0, 62886
Remote Config [baseline] (634.081 µs) : 0, 634
Remote Config [candidate] (636.122 µs) : 0, 636
Telemetry [baseline] (8.331 ms) : 0, 8331
Telemetry [candidate] (8.299 ms) : 0, 8299
Flare Poller [baseline] (3.719 ms) : 0, 3719
Flare Poller [candidate] (3.733 ms) : 0, 3733
section iast
crashtracking [baseline] (1.496 ms) : 0, 1496
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (846.242 ms) : 0, 846242
BytebuddyAgent [candidate] (834.999 ms) : 0, 834999
GlobalTracer [baseline] (239.249 ms) : 0, 239249
GlobalTracer [candidate] (239.555 ms) : 0, 239555
AppSec [baseline] (32.561 ms) : 0, 32561
AppSec [candidate] (31.564 ms) : 0, 31564
Debugger [baseline] (60.208 ms) : 0, 60208
Debugger [candidate] (59.688 ms) : 0, 59688
Remote Config [baseline] (552.431 µs) : 0, 552
Remote Config [candidate] (532.773 µs) : 0, 533
Telemetry [baseline] (7.625 ms) : 0, 7625
Telemetry [candidate] (7.576 ms) : 0, 7576
Flare Poller [baseline] (3.557 ms) : 0, 3557
Flare Poller [candidate] (3.478 ms) : 0, 3478
IAST [baseline] (29.573 ms) : 0, 29573
IAST [candidate] (30.246 ms) : 0, 30246

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~3684c74f7d, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.114 s) : 0, 1113982
Total [baseline] (10.875 s) : 0, 10875466
Agent [candidate] (1.105 s) : 0, 1104724
Total [candidate] (10.804 s) : 0, 10804466
section appsec
Agent [baseline] (1.286 s) : 0, 1285821
Total [baseline] (11.137 s) : 0, 11137133
Agent [candidate] (1.293 s) : 0, 1292897
Total [candidate] (11.174 s) : 0, 11174356
section iast
Agent [baseline] (1.241 s) : 0, 1240725
Total [baseline] (11.265 s) : 0, 11265160
Agent [candidate] (1.266 s) : 0, 1266307
Total [candidate] (11.288 s) : 0, 11288445
section profiling
Agent [baseline] (1.239 s) : 0, 1239391
Total [baseline] (11.21 s) : 0, 11210244
Agent [candidate] (1.234 s) : 0, 1234413
Total [candidate] (11.24 s) : 0, 11240441

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.114 s	-
Agent	appsec	1.286 s	171.839 ms (15.4%)
Agent	iast	1.241 s	126.742 ms (11.4%)
Agent	profiling	1.239 s	125.409 ms (11.3%)
Total	tracing	10.875 s	-
Total	appsec	11.137 s	261.667 ms (2.4%)
Total	iast	11.265 s	389.695 ms (3.6%)
Total	profiling	11.21 s	334.778 ms (3.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.105 s	-
Agent	appsec	1.293 s	188.173 ms (17.0%)
Agent	iast	1.266 s	161.583 ms (14.6%)
Agent	profiling	1.234 s	129.69 ms (11.7%)
Total	tracing	10.804 s	-
Total	appsec	11.174 s	369.89 ms (3.4%)
Total	iast	11.288 s	483.979 ms (4.5%)
Total	profiling	11.24 s	435.975 ms (4.0%)

gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~3684c74f7d, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.472 ms) : 0, 1472
crashtracking [candidate] (1.459 ms) : 0, 1459
BytebuddyAgent [baseline] (715.697 ms) : 0, 715697
BytebuddyAgent [candidate] (710.005 ms) : 0, 710005
GlobalTracer [baseline] (251.722 ms) : 0, 251722
GlobalTracer [candidate] (249.672 ms) : 0, 249672
AppSec [baseline] (32.379 ms) : 0, 32379
AppSec [candidate] (32.106 ms) : 0, 32106
Debugger [baseline] (64.757 ms) : 0, 64757
Debugger [candidate] (63.942 ms) : 0, 63942
Remote Config [baseline] (637.165 µs) : 0, 637
Remote Config [candidate] (642.841 µs) : 0, 643
Telemetry [baseline] (8.346 ms) : 0, 8346
Telemetry [candidate] (8.265 ms) : 0, 8265
Flare Poller [baseline] (3.737 ms) : 0, 3737
Flare Poller [candidate] (3.706 ms) : 0, 3706
section appsec
crashtracking [baseline] (1.471 ms) : 0, 1471
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (734.229 ms) : 0, 734229
BytebuddyAgent [candidate] (737.814 ms) : 0, 737814
GlobalTracer [baseline] (241.268 ms) : 0, 241268
GlobalTracer [candidate] (242.731 ms) : 0, 242731
AppSec [baseline] (174.922 ms) : 0, 174922
AppSec [candidate] (174.969 ms) : 0, 174969
Debugger [baseline] (61.346 ms) : 0, 61346
Debugger [candidate] (62.655 ms) : 0, 62655
Remote Config [baseline] (671.474 µs) : 0, 671
Remote Config [candidate] (675.228 µs) : 0, 675
Telemetry [baseline] (8.13 ms) : 0, 8130
Telemetry [candidate] (8.423 ms) : 0, 8423
Flare Poller [baseline] (3.843 ms) : 0, 3843
Flare Poller [candidate] (3.927 ms) : 0, 3927
IAST [baseline] (24.823 ms) : 0, 24823
IAST [candidate] (25.091 ms) : 0, 25091
section iast
crashtracking [baseline] (1.456 ms) : 0, 1456
crashtracking [candidate] (1.495 ms) : 0, 1495
BytebuddyAgent [baseline] (832.276 ms) : 0, 832276
BytebuddyAgent [candidate] (853.437 ms) : 0, 853437
GlobalTracer [baseline] (237.875 ms) : 0, 237875
GlobalTracer [candidate] (240.269 ms) : 0, 240269
AppSec [baseline] (33.984 ms) : 0, 33984
AppSec [candidate] (34.179 ms) : 0, 34179
Debugger [baseline] (61.147 ms) : 0, 61147
Debugger [candidate] (61.222 ms) : 0, 61222
Remote Config [baseline] (553.329 µs) : 0, 553
Remote Config [candidate] (546.649 µs) : 0, 547
Telemetry [baseline] (7.619 ms) : 0, 7619
Telemetry [candidate] (7.765 ms) : 0, 7765
Flare Poller [baseline] (3.488 ms) : 0, 3488
Flare Poller [candidate] (3.536 ms) : 0, 3536
IAST [baseline] (27.368 ms) : 0, 27368
IAST [candidate] (28.37 ms) : 0, 28370
section profiling
crashtracking [baseline] (1.449 ms) : 0, 1449
crashtracking [candidate] (1.43 ms) : 0, 1430
BytebuddyAgent [baseline] (737.578 ms) : 0, 737578
BytebuddyAgent [candidate] (735.071 ms) : 0, 735071
GlobalTracer [baseline] (224.511 ms) : 0, 224511
GlobalTracer [candidate] (223.34 ms) : 0, 223340
AppSec [baseline] (32.378 ms) : 0, 32378
AppSec [candidate] (32.101 ms) : 0, 32101
Debugger [baseline] (63.777 ms) : 0, 63777
Debugger [candidate] (63.03 ms) : 0, 63030
Remote Config [baseline] (663.488 µs) : 0, 663
Remote Config [candidate] (658.437 µs) : 0, 658
Telemetry [baseline] (8.127 ms) : 0, 8127
Telemetry [candidate] (8.05 ms) : 0, 8050
Flare Poller [baseline] (3.802 ms) : 0, 3802
Flare Poller [candidate] (3.803 ms) : 0, 3803
ProfilingAgent [baseline] (96.942 ms) : 0, 96942
ProfilingAgent [candidate] (97.083 ms) : 0, 97083
Profiling [baseline] (97.528 ms) : 0, 97528
Profiling [candidate] (97.668 ms) : 0, 97668

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
git_commit_date	1763637994	1763649716
git_commit_sha	`c05874d`	`3684c74`
release_version	1.56.0~c05874d84e	1.56.0-SNAPSHOT~3684c74f7d

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763653974	1763653974
ci_job_id	1247915071	1247915071
ci_pipeline_id	83370301	83370301
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-4j28n8xp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-4j28n8xp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:petclinic:profiling:high_load	worse [+0.858ms; +1.752ms] or [+4.484%; +9.161%]	unsure [+0.455ms; +2.157ms] or [+1.463%; +6.941%]	unstable [-40.110op/s; +9.298op/s] or [-16.700%; +3.871%]	20.430ms	32.378ms	224.781op/s	19.125ms	31.072ms	240.188op/s
scenario:load:petclinic:iast:high_load	better [-1.554ms; -0.538ms] or [-8.403%; -2.908%]	same [-1216.963µs; +307.023µs] or [-4.125%; +1.041%]	unstable [-15.934op/s; +38.871op/s] or [-6.386%; +15.580%]	17.445ms	29.045ms	260.969op/s	18.491ms	29.500ms	249.500op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~3684c74f7d, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.23 ms) : 19031, 19428
.   : milestone, 19230,
appsec (18.807 ms) : 18613, 19001
.   : milestone, 18807,
code_origins (18.137 ms) : 17956, 18319
.   : milestone, 18137,
iast (18.71 ms) : 18523, 18897
.   : milestone, 18710,
profiling (19.433 ms) : 19232, 19633
.   : milestone, 19433,
tracing (17.529 ms) : 17351, 17706
.   : milestone, 17529,
section candidate
no_agent (18.439 ms) : 18252, 18627
.   : milestone, 18439,
appsec (18.864 ms) : 18670, 19058
.   : milestone, 18864,
code_origins (18.815 ms) : 18626, 19004
.   : milestone, 18815,
iast (17.877 ms) : 17699, 18055
.   : milestone, 17877,
profiling (20.775 ms) : 20567, 20984
.   : milestone, 20775,
tracing (17.61 ms) : 17429, 17791
.   : milestone, 17610,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.23 ms [19.031 ms, 19.428 ms]	-
appsec	18.807 ms [18.613 ms, 19.001 ms]	-422.777 µs (-2.2%)
code_origins	18.137 ms [17.956 ms, 18.319 ms]	-1.092 ms (-5.7%)
iast	18.71 ms [18.523 ms, 18.897 ms]	-519.901 µs (-2.7%)
profiling	19.433 ms [19.232 ms, 19.633 ms]	203.079 µs (1.1%)
tracing	17.529 ms [17.351 ms, 17.706 ms]	-1.701 ms (-8.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.439 ms [18.252 ms, 18.627 ms]	-
appsec	18.864 ms [18.67 ms, 19.058 ms]	424.356 µs (2.3%)
code_origins	18.815 ms [18.626 ms, 19.004 ms]	375.42 µs (2.0%)
iast	17.877 ms [17.699 ms, 18.055 ms]	-562.374 µs (-3.0%)
profiling	20.775 ms [20.567 ms, 20.984 ms]	2.336 ms (12.7%)
tracing	17.61 ms [17.429 ms, 17.791 ms]	-829.507 µs (-4.5%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~3684c74f7d, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.207 ms) : 1196, 1219
.   : milestone, 1207,
iast (3.234 ms) : 3191, 3276
.   : milestone, 3234,
iast_FULL (5.857 ms) : 5799, 5916
.   : milestone, 5857,
iast_GLOBAL (3.605 ms) : 3544, 3666
.   : milestone, 3605,
profiling (2.115 ms) : 2095, 2135
.   : milestone, 2115,
tracing (1.807 ms) : 1792, 1823
.   : milestone, 1807,
section candidate
no_agent (1.207 ms) : 1195, 1219
.   : milestone, 1207,
iast (3.249 ms) : 3206, 3291
.   : milestone, 3249,
iast_FULL (5.974 ms) : 5914, 6034
.   : milestone, 5974,
iast_GLOBAL (3.64 ms) : 3575, 3705
.   : milestone, 3640,
profiling (2.139 ms) : 2118, 2160
.   : milestone, 2139,
tracing (1.818 ms) : 1803, 1833
.   : milestone, 1818,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.207 ms [1.196 ms, 1.219 ms]	-
iast	3.234 ms [3.191 ms, 3.276 ms]	2.026 ms (167.8%)
iast_FULL	5.857 ms [5.799 ms, 5.916 ms]	4.65 ms (385.1%)
iast_GLOBAL	3.605 ms [3.544 ms, 3.666 ms]	2.398 ms (198.6%)
profiling	2.115 ms [2.095 ms, 2.135 ms]	907.273 µs (75.1%)
tracing	1.807 ms [1.792 ms, 1.823 ms]	600.021 µs (49.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.207 ms [1.195 ms, 1.219 ms]	-
iast	3.249 ms [3.206 ms, 3.291 ms]	2.041 ms (169.1%)
iast_FULL	5.974 ms [5.914 ms, 6.034 ms]	4.767 ms (394.9%)
iast_GLOBAL	3.64 ms [3.575 ms, 3.705 ms]	2.433 ms (201.5%)
profiling	2.139 ms [2.118 ms, 2.16 ms]	931.442 µs (77.2%)
tracing	1.818 ms [1.803 ms, 1.833 ms]	610.892 µs (50.6%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
git_commit_date	1763637994	1763649716
git_commit_sha	`c05874d`	`3684c74`
release_version	1.56.0~c05874d84e	1.56.0-SNAPSHOT~3684c74f7d

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1763651851	1763651851
ci_job_id	1247766874	1247766874
ci_pipeline_id	83370301	83370301
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-s40wey9j 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-s40wey9j 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~3684c74f7d, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.912 s) : 14912000, 14912000
.   : milestone, 14912000,
appsec (15.04 s) : 15040000, 15040000
.   : milestone, 15040000,
iast (18.401 s) : 18401000, 18401000
.   : milestone, 18401000,
iast_GLOBAL (17.953 s) : 17953000, 17953000
.   : milestone, 17953000,
profiling (14.671 s) : 14671000, 14671000
.   : milestone, 14671000,
tracing (14.939 s) : 14939000, 14939000
.   : milestone, 14939000,
section candidate
no_agent (15.377 s) : 15377000, 15377000
.   : milestone, 15377000,
appsec (14.689 s) : 14689000, 14689000
.   : milestone, 14689000,
iast (18.306 s) : 18306000, 18306000
.   : milestone, 18306000,
iast_GLOBAL (17.946 s) : 17946000, 17946000
.   : milestone, 17946000,
profiling (14.681 s) : 14681000, 14681000
.   : milestone, 14681000,
tracing (14.716 s) : 14716000, 14716000
.   : milestone, 14716000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.912 s [14.912 s, 14.912 s]	-
appsec	15.04 s [15.04 s, 15.04 s]	128.0 ms (0.9%)
iast	18.401 s [18.401 s, 18.401 s]	3.489 s (23.4%)
iast_GLOBAL	17.953 s [17.953 s, 17.953 s]	3.041 s (20.4%)
profiling	14.671 s [14.671 s, 14.671 s]	-241.0 ms (-1.6%)
tracing	14.939 s [14.939 s, 14.939 s]	27.0 ms (0.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.377 s [15.377 s, 15.377 s]	-
appsec	14.689 s [14.689 s, 14.689 s]	-688.0 ms (-4.5%)
iast	18.306 s [18.306 s, 18.306 s]	2.929 s (19.0%)
iast_GLOBAL	17.946 s [17.946 s, 17.946 s]	2.569 s (16.7%)
profiling	14.681 s [14.681 s, 14.681 s]	-696.0 ms (-4.5%)
tracing	14.716 s [14.716 s, 14.716 s]	-661.0 ms (-4.3%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~3684c74f7d, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1470, 1493
.   : milestone, 1482,
appsec (3.743 ms) : 3523, 3963
.   : milestone, 3743,
iast (2.225 ms) : 2160, 2290
.   : milestone, 2225,
iast_GLOBAL (2.277 ms) : 2211, 2342
.   : milestone, 2277,
profiling (2.068 ms) : 2016, 2120
.   : milestone, 2068,
tracing (2.051 ms) : 2000, 2102
.   : milestone, 2051,
section candidate
no_agent (1.483 ms) : 1472, 1495
.   : milestone, 1483,
appsec (3.726 ms) : 3507, 3945
.   : milestone, 3726,
iast (2.22 ms) : 2155, 2285
.   : milestone, 2220,
iast_GLOBAL (2.271 ms) : 2205, 2336
.   : milestone, 2271,
profiling (2.11 ms) : 2056, 2164
.   : milestone, 2110,
tracing (2.063 ms) : 2011, 2114
.   : milestone, 2063,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.482 ms [1.47 ms, 1.493 ms]	-
appsec	3.743 ms [3.523 ms, 3.963 ms]	2.261 ms (152.6%)
iast	2.225 ms [2.16 ms, 2.29 ms]	742.986 µs (50.1%)
iast_GLOBAL	2.277 ms [2.211 ms, 2.342 ms]	794.731 µs (53.6%)
profiling	2.068 ms [2.016 ms, 2.12 ms]	586.221 µs (39.6%)
tracing	2.051 ms [2.0 ms, 2.102 ms]	569.398 µs (38.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.483 ms [1.472 ms, 1.495 ms]	-
appsec	3.726 ms [3.507 ms, 3.945 ms]	2.243 ms (151.2%)
iast	2.22 ms [2.155 ms, 2.285 ms]	736.572 µs (49.7%)
iast_GLOBAL	2.271 ms [2.205 ms, 2.336 ms]	787.283 µs (53.1%)
profiling	2.11 ms [2.056 ms, 2.164 ms]	626.651 µs (42.2%)
tracing	2.063 ms [2.011 ms, 2.114 ms]	579.33 µs (39.1%)

…ct-interrupt-policy

datadog-datadog-prod-us1 · 2025-11-20T15:02:06Z

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.65% (+0.02%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 3684c74 | Docs | Datadog PR Page | Was this helpful? Give us feedback!}

* set benchmarking jobs to be interruptible outside master * remove interruptible: true from benchmarks.yml * set macrobenchmarking jobs to be interuptible outside master * test interruptibility

igoragoli added 3 commits November 18, 2025 14:58

set benchmarking jobs to be interruptible outside master

b0367bd

remove interruptible: true from benchmarks.yml

5ec96e9

set macrobenchmarking jobs to be interuptible outside master

041edc8

igoragoli added type: enhancement Enhancements and improvements tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Nov 18, 2025

test interruptibility

a1649f3

igoragoli marked this pull request as ready for review November 18, 2025 14:12

igoragoli requested a review from a team as a code owner November 18, 2025 14:12

igoragoli requested review from TonyCTHsu and removed request for a team November 18, 2025 14:12

igoragoli requested review from a team and mhlidd November 19, 2025 09:35

PerfectSlayer approved these changes Nov 20, 2025

View reviewed changes

sarahchen6 approved these changes Nov 20, 2025

View reviewed changes

igoragoli enabled auto-merge (squash) November 20, 2025 14:41

Merge branch 'master' into augusto.deoliveira/apmsp-2369.ensure-corre…

3684c74

…ct-interrupt-policy

igoragoli merged commit 73b5fbd into master Nov 20, 2025
538 checks passed

igoragoli deleted the augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy branch November 20, 2025 16:04

github-actions bot added this to the 1.57.0 milestone Nov 20, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Set benchmarking jobs to be interruptible outside master #9994

Set benchmarking jobs to be interruptible outside master #9994

igoragoli commented Nov 18, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Nov 18, 2025 •

edited

Loading

Uh oh!

datadog-datadog-prod-us1 bot commented Nov 20, 2025 •

edited by datadog-official bot

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Set benchmarking jobs to be interruptible outside master #9994

Set benchmarking jobs to be interruptible outside master #9994

Conversation

igoragoli commented Nov 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Nov 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

datadog-datadog-prod-us1 bot commented Nov 20, 2025 • edited by datadog-official bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

igoragoli commented Nov 18, 2025 •

edited

Loading

pr-commenter bot commented Nov 18, 2025 •

edited

Loading

datadog-datadog-prod-us1 bot commented Nov 20, 2025 •

edited by datadog-official bot

Loading