Skip to content

Increase flare reporter smoke test duration #9452

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
AlexeyKuznetsov-DD merged 4 commits into from
Sep 3, 2025
Merged

Increase flare reporter smoke test duration #9452

AlexeyKuznetsov-DD merged 4 commits into from
Sep 3, 2025

Conversation

@MattAlp
Copy link

@MattAlp MattAlp commented Sep 2, 2025 •
edited
Loading

What Does This Do

This extends the runtime of the flare smoke tests from 15s to 20s.

Motivation

We delay starting the profiling subsystem when running on Oracle's JDK 8, which means this smoke test tends to fail if the triage report timer is set too low.

Additional Notes

This is currently causing our master CI to fail (n.b. this wasn't caught in #9440 because we only run tests on this JDK in the master branch). It's likely that we would have caught it if that PR was tagged as run-tests: oracle8 and/or comp: profiling.

⚠️ I opened this PR by continuing to commit on the branch that introduced this functionality, the diff you're interested in for reviewing is 84e5026

Contributor Checklist

Jira ticket: PROF-12412

@MattAlp MattAlp requested review from a team as code owners September 2, 2025 19:25
@MattAlp MattAlp added type: bug Bug report and fix comp: testing Testing comp: profiling Profiling run-tests: oracle8 Run tests using Oracle 8 JDK labels Sep 2, 2025
@DataDog DataDog deleted a comment from github-actions bot Sep 2, 2025
@datadog-official
Copy link

datadog-official bot commented Sep 2, 2025 •
edited by datadog-datadog-prod-us1 bot
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.26% (+1.63%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: d8ad90c | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Sep 2, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/baseline-flarereporter-smoketesting
git_commit_date 1756829606 1756841172
git_commit_sha 0a4e9d0 d8ad90c
release_version 1.53.0-SNAPSHOT~0a4e9d0069 1.53.0-SNAPSHOT~d8ad90c648
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1756842898 1756842898
ci_job_id 1109787627 1109787627
ci_pipeline_id 75338534 75338534
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-2jgndhkc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-2jgndhkc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 11 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~d8ad90c648, baseline=1.53.0-SNAPSHOT~0a4e9d0069

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.057 s) : 0, 1056932
Total [baseline] (8.651 s) : 0, 8651258
Agent [candidate] (1.057 s) : 0, 1056862
Total [candidate] (8.672 s) : 0, 8672111
section iast
Agent [baseline] (1.19 s) : 0, 1190308
Total [baseline] (9.354 s) : 0, 9353851
Agent [candidate] (1.182 s) : 0, 1181642
Total [candidate] (9.352 s) : 0, 9351702
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent iast 1.19 s 133.376 ms (12.6%)
Total tracing 8.651 s -
Total iast 9.354 s 702.593 ms (8.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent iast 1.182 s 124.78 ms (11.8%)
Total tracing 8.672 s -
Total iast 9.352 s 679.591 ms (7.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~d8ad90c648, baseline=1.53.0-SNAPSHOT~0a4e9d0069

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.474 ms) : 0, 1474
BytebuddyAgent [baseline] (740.791 ms) : 0, 740791
BytebuddyAgent [candidate] (738.979 ms) : 0, 738979
GlobalTracer [baseline] (244.816 ms) : 0, 244816
GlobalTracer [candidate] (245.437 ms) : 0, 245437
AppSec [baseline] (30.3 ms) : 0, 30300
AppSec [candidate] (30.705 ms) : 0, 30705
Debugger [baseline] (6.087 ms) : 0, 6087
Debugger [candidate] (6.145 ms) : 0, 6145
Remote Config [baseline] (679.986 µs) : 0, 680
Remote Config [candidate] (683.443 µs) : 0, 683
Telemetry [baseline] (11.631 ms) : 0, 11631
Telemetry [candidate] (12.326 ms) : 0, 12326
section iast
crashtracking [baseline] (1.475 ms) : 0, 1475
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (859.127 ms) : 0, 859127
BytebuddyAgent [candidate] (852.439 ms) : 0, 852439
GlobalTracer [baseline] (234.928 ms) : 0, 234928
GlobalTracer [candidate] (233.596 ms) : 0, 233596
IAST [baseline] (29.003 ms) : 0, 29003
IAST [candidate] (27.941 ms) : 0, 27941
AppSec [baseline] (28.764 ms) : 0, 28764
AppSec [candidate] (28.579 ms) : 0, 28579
Debugger [baseline] (6.782 ms) : 0, 6782
Debugger [candidate] (7.543 ms) : 0, 7543
Remote Config [baseline] (620.239 µs) : 0, 620
Remote Config [candidate] (606.194 µs) : 0, 606
Telemetry [baseline] (8.425 ms) : 0, 8425
Telemetry [candidate] (8.322 ms) : 0, 8322
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~d8ad90c648, baseline=1.53.0-SNAPSHOT~0a4e9d0069

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1058212
Total [baseline] (10.817 s) : 0, 10816540
Agent [candidate] (1.062 s) : 0, 1062209
Total [candidate] (10.723 s) : 0, 10722583
section appsec
Agent [baseline] (1.223 s) : 0, 1222858
Total [baseline] (10.818 s) : 0, 10818400
Agent [candidate] (1.225 s) : 0, 1225033
Total [candidate] (10.798 s) : 0, 10797840
section iast
Agent [baseline] (1.189 s) : 0, 1189459
Total [baseline] (10.974 s) : 0, 10973647
Agent [candidate] (1.179 s) : 0, 1178784
Total [candidate] (11.013 s) : 0, 11013232
section profiling
Agent [baseline] (1.199 s) : 0, 1199253
Total [baseline] (10.873 s) : 0, 10872979
Agent [candidate] (1.207 s) : 0, 1206656
Total [candidate] (10.901 s) : 0, 10900664
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent appsec 1.223 s 164.646 ms (15.6%)
Agent iast 1.189 s 131.247 ms (12.4%)
Agent profiling 1.199 s 141.041 ms (13.3%)
Total tracing 10.817 s -
Total appsec 10.818 s 1.86 ms (0.0%)
Total iast 10.974 s 157.108 ms (1.5%)
Total profiling 10.873 s 56.44 ms (0.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent appsec 1.225 s 162.824 ms (15.3%)
Agent iast 1.179 s 116.575 ms (11.0%)
Agent profiling 1.207 s 144.446 ms (13.6%)
Total tracing 10.723 s -
Total appsec 10.798 s 75.257 ms (0.7%)
Total iast 11.013 s 290.649 ms (2.7%)
Total profiling 10.901 s 178.08 ms (1.7%) 
gantt
    title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~d8ad90c648, baseline=1.53.0-SNAPSHOT~0a4e9d0069

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.471 ms) : 0, 1471
crashtracking [candidate] (1.466 ms) : 0, 1466
BytebuddyAgent [baseline] (739.444 ms) : 0, 739444
BytebuddyAgent [candidate] (744.088 ms) : 0, 744088
GlobalTracer [baseline] (245.264 ms) : 0, 245264
GlobalTracer [candidate] (245.24 ms) : 0, 245240
AppSec [baseline] (30.328 ms) : 0, 30328
AppSec [candidate] (30.332 ms) : 0, 30332
Debugger [baseline] (6.11 ms) : 0, 6110
Debugger [candidate] (6.108 ms) : 0, 6108
Remote Config [baseline] (681.674 µs) : 0, 682
Remote Config [candidate] (663.701 µs) : 0, 664
Telemetry [baseline] (13.643 ms) : 0, 13643
Telemetry [candidate] (12.96 ms) : 0, 12960
section appsec
crashtracking [baseline] (1.441 ms) : 0, 1441
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (755.465 ms) : 0, 755465
BytebuddyAgent [candidate] (756.469 ms) : 0, 756469
GlobalTracer [baseline] (235.443 ms) : 0, 235443
GlobalTracer [candidate] (236.043 ms) : 0, 236043
AppSec [baseline] (169.422 ms) : 0, 169422
AppSec [candidate] (170.458 ms) : 0, 170458
Debugger [baseline] (6.566 ms) : 0, 6566
Debugger [candidate] (5.755 ms) : 0, 5755
Remote Config [baseline] (642.724 µs) : 0, 643
Remote Config [candidate] (632.579 µs) : 0, 633
Telemetry [baseline] (9.168 ms) : 0, 9168
Telemetry [candidate] (9.338 ms) : 0, 9338
IAST [baseline] (23.523 ms) : 0, 23523
IAST [candidate] (23.697 ms) : 0, 23697
section iast
crashtracking [baseline] (1.466 ms) : 0, 1466
crashtracking [candidate] (1.446 ms) : 0, 1446
BytebuddyAgent [baseline] (858.816 ms) : 0, 858816
BytebuddyAgent [candidate] (850.365 ms) : 0, 850365
GlobalTracer [baseline] (234.577 ms) : 0, 234577
GlobalTracer [candidate] (233.184 ms) : 0, 233184
AppSec [baseline] (26.495 ms) : 0, 26495
AppSec [candidate] (27.087 ms) : 0, 27087
Debugger [baseline] (8.338 ms) : 0, 8338
Debugger [candidate] (5.762 ms) : 0, 5762
Remote Config [baseline] (600.955 µs) : 0, 601
Remote Config [candidate] (601.421 µs) : 0, 601
Telemetry [baseline] (8.205 ms) : 0, 8205
Telemetry [candidate] (8.3 ms) : 0, 8300
IAST [baseline] (29.741 ms) : 0, 29741
IAST [candidate] (30.968 ms) : 0, 30968
section profiling
ProfilingAgent [baseline] (108.313 ms) : 0, 108313
ProfilingAgent [candidate] (108.46 ms) : 0, 108460
crashtracking [baseline] (1.429 ms) : 0, 1429
crashtracking [candidate] (1.446 ms) : 0, 1446
BytebuddyAgent [baseline] (763.311 ms) : 0, 763311
BytebuddyAgent [candidate] (768.292 ms) : 0, 768292
GlobalTracer [baseline] (222.597 ms) : 0, 222597
GlobalTracer [candidate] (224.034 ms) : 0, 224034
AppSec [baseline] (29.965 ms) : 0, 29965
AppSec [candidate] (30.309 ms) : 0, 30309
Debugger [baseline] (6.267 ms) : 0, 6267
Debugger [candidate] (6.366 ms) : 0, 6366
Remote Config [baseline] (727.49 µs) : 0, 727
Remote Config [candidate] (742.439 µs) : 0, 742
Telemetry [baseline] (16.25 ms) : 0, 16250
Telemetry [candidate] (16.299 ms) : 0, 16299
Profiling [baseline] (108.977 ms) : 0, 108977
Profiling [candidate] (109.112 ms) : 0, 109112
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/baseline-flarereporter-smoketesting
git_commit_date 1756829606 1756841172
git_commit_sha 0a4e9d0 d8ad90c
release_version 1.53.0-SNAPSHOT~0a4e9d0069 1.53.0-SNAPSHOT~d8ad90c648
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1756842575 1756842575
ci_job_id 1109787628 1109787628
ci_pipeline_id 75338534 75338534
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-anlecmie 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-anlecmie 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:tracing:high_load worse
[+158.697µs; +395.860µs] or [+2.166%; +5.404%]		 unstable
[-94.528op/s; +49.153op/s] or [-14.960%; +7.779%]		 7.603ms 609.188op/s 7.325ms 631.875op/s
scenario:load:insecure-bank:profiling:high_load better
[-509.574µs; -226.291µs] or [-5.800%; -2.575%]		 unstable
[-42.740op/s; +88.490op/s] or [-8.096%; +16.762%]		 8.419ms 550.781op/s 8.786ms 527.906op/s
scenario:load:petclinic:code_origins:high_load worse
[+1.529ms; +2.398ms] or [+3.405%; +5.340%]		 unstable
[-11.134op/s; +2.384op/s] or [-10.686%; +2.288%]		 46.878ms 99.812op/s 44.914ms 104.188op/s
scenario:load:petclinic:profiling:high_load better
[-2.549ms; -1.570ms] or [-5.098%; -3.139%]		 unstable
[-2.813op/s; +10.888op/s] or [-3.006%; +11.634%]		 47.948ms 97.625op/s 50.008ms 93.588op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~d8ad90c648, baseline=1.53.0-SNAPSHOT~0a4e9d0069
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.416 ms) : 36136, 36697
.   : milestone, 36416,
appsec (48.976 ms) : 48534, 49417
.   : milestone, 48976,
code_origins (44.914 ms) : 44529, 45299
.   : milestone, 44914,
iast (45.337 ms) : 44934, 45739
.   : milestone, 45337,
profiling (50.008 ms) : 49549, 50466
.   : milestone, 50008,
tracing (43.036 ms) : 42671, 43401
.   : milestone, 43036,
section candidate
no_agent (37.099 ms) : 36808, 37391
.   : milestone, 37099,
appsec (48.922 ms) : 48493, 49351
.   : milestone, 48922,
code_origins (46.878 ms) : 46455, 47300
.   : milestone, 46878,
iast (45.76 ms) : 45361, 46159
.   : milestone, 45760,
profiling (47.948 ms) : 47496, 48400
.   : milestone, 47948,
tracing (44.074 ms) : 43689, 44459
.   : milestone, 44074,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.416 ms [36.136 ms, 36.697 ms] -
appsec 48.976 ms [48.534 ms, 49.417 ms] 12.559 ms (34.5%)
code_origins 44.914 ms [44.529 ms, 45.299 ms] 8.497 ms (23.3%)
iast 45.337 ms [44.934 ms, 45.739 ms] 8.92 ms (24.5%)
profiling 50.008 ms [49.549 ms, 50.466 ms] 13.591 ms (37.3%)
tracing 43.036 ms [42.671 ms, 43.401 ms] 6.62 ms (18.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.099 ms [36.808 ms, 37.391 ms] -
appsec 48.922 ms [48.493 ms, 49.351 ms] 11.823 ms (31.9%)
code_origins 46.878 ms [46.455 ms, 47.3 ms] 9.778 ms (26.4%)
iast 45.76 ms [45.361 ms, 46.159 ms] 8.661 ms (23.3%)
profiling 47.948 ms [47.496 ms, 48.4 ms] 10.849 ms (29.2%)
tracing 44.074 ms [43.689 ms, 44.459 ms] 6.974 ms (18.8%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~d8ad90c648, baseline=1.53.0-SNAPSHOT~0a4e9d0069
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.268 ms) : 4218, 4318
.   : milestone, 4268,
iast (9.797 ms) : 9624, 9970
.   : milestone, 9797,
iast_FULL (13.907 ms) : 13632, 14181
.   : milestone, 13907,
iast_GLOBAL (10.529 ms) : 10343, 10715
.   : milestone, 10529,
profiling (8.786 ms) : 8651, 8921
.   : milestone, 8786,
tracing (7.325 ms) : 7221, 7429
.   : milestone, 7325,
section candidate
no_agent (4.339 ms) : 4290, 4387
.   : milestone, 4339,
iast (9.508 ms) : 9351, 9665
.   : milestone, 9508,
iast_FULL (13.957 ms) : 13681, 14233
.   : milestone, 13957,
iast_GLOBAL (10.565 ms) : 10382, 10748
.   : milestone, 10565,
profiling (8.419 ms) : 8290, 8547
.   : milestone, 8419,
tracing (7.603 ms) : 7487, 7719
.   : milestone, 7603,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.268 ms [4.218 ms, 4.318 ms] -
iast 9.797 ms [9.624 ms, 9.97 ms] 5.529 ms (129.5%)
iast_FULL 13.907 ms [13.632 ms, 14.181 ms] 9.639 ms (225.8%)
iast_GLOBAL 10.529 ms [10.343 ms, 10.715 ms] 6.261 ms (146.7%)
profiling 8.786 ms [8.651 ms, 8.921 ms] 4.519 ms (105.9%)
tracing 7.325 ms [7.221 ms, 7.429 ms] 3.057 ms (71.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.339 ms [4.29 ms, 4.387 ms] -
iast 9.508 ms [9.351 ms, 9.665 ms] 5.169 ms (119.2%)
iast_FULL 13.957 ms [13.681 ms, 14.233 ms] 9.618 ms (221.7%)
iast_GLOBAL 10.565 ms [10.382 ms, 10.748 ms] 6.227 ms (143.5%)
profiling 8.419 ms [8.29 ms, 8.547 ms] 4.08 ms (94.0%)
tracing 7.603 ms [7.487 ms, 7.719 ms] 3.264 ms (75.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/baseline-flarereporter-smoketesting
git_commit_date 1756829606 1756841172
git_commit_sha 0a4e9d0 d8ad90c
release_version 1.53.0-SNAPSHOT~0a4e9d0069 1.53.0-SNAPSHOT~d8ad90c648
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1756843051 1756843051
ci_job_id 1109787629 1109787629
ci_pipeline_id 75338534 75338534
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-f91ukkiv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-f91ukkiv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.373ms; -1.030ms] or [-37.190%; -27.908%]		 2.490ms 3.691ms
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~d8ad90c648, baseline=1.53.0-SNAPSHOT~0a4e9d0069
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.485 ms) : 1473, 1496
.   : milestone, 1485,
appsec (3.691 ms) : 3472, 3910
.   : milestone, 3691,
iast (2.228 ms) : 2164, 2291
.   : milestone, 2228,
iast_GLOBAL (2.268 ms) : 2204, 2332
.   : milestone, 2268,
profiling (2.062 ms) : 2011, 2112
.   : milestone, 2062,
tracing (2.054 ms) : 2005, 2104
.   : milestone, 2054,
section candidate
no_agent (1.487 ms) : 1475, 1498
.   : milestone, 1487,
appsec (2.49 ms) : 2436, 2543
.   : milestone, 2490,
iast (2.233 ms) : 2171, 2296
.   : milestone, 2233,
iast_GLOBAL (2.257 ms) : 2193, 2320
.   : milestone, 2257,
profiling (2.067 ms) : 2016, 2118
.   : milestone, 2067,
tracing (2.03 ms) : 1981, 2079
.   : milestone, 2030,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.485 ms [1.473 ms, 1.496 ms] -
appsec 3.691 ms [3.472 ms, 3.91 ms] 2.206 ms (148.6%)
iast 2.228 ms [2.164 ms, 2.291 ms] 742.889 µs (50.0%)
iast_GLOBAL 2.268 ms [2.204 ms, 2.332 ms] 783.08 µs (52.7%)
profiling 2.062 ms [2.011 ms, 2.112 ms] 576.786 µs (38.8%)
tracing 2.054 ms [2.005 ms, 2.104 ms] 569.502 µs (38.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.487 ms [1.475 ms, 1.498 ms] -
appsec 2.49 ms [2.436 ms, 2.543 ms] 1.003 ms (67.4%)
iast 2.233 ms [2.171 ms, 2.296 ms] 746.429 µs (50.2%)
iast_GLOBAL 2.257 ms [2.193 ms, 2.32 ms] 770.035 µs (51.8%)
profiling 2.067 ms [2.016 ms, 2.118 ms] 579.913 µs (39.0%)
tracing 2.03 ms [1.981 ms, 2.079 ms] 543.542 µs (36.6%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~d8ad90c648, baseline=1.53.0-SNAPSHOT~0a4e9d0069
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.996 s) : 14996000, 14996000
.   : milestone, 14996000,
appsec (14.816 s) : 14816000, 14816000
.   : milestone, 14816000,
iast (18.095 s) : 18095000, 18095000
.   : milestone, 18095000,
iast_GLOBAL (18.208 s) : 18208000, 18208000
.   : milestone, 18208000,
profiling (15.296 s) : 15296000, 15296000
.   : milestone, 15296000,
tracing (15.06 s) : 15060000, 15060000
.   : milestone, 15060000,
section candidate
no_agent (15.266 s) : 15266000, 15266000
.   : milestone, 15266000,
appsec (14.988 s) : 14988000, 14988000
.   : milestone, 14988000,
iast (18.283 s) : 18283000, 18283000
.   : milestone, 18283000,
iast_GLOBAL (18.331 s) : 18331000, 18331000
.   : milestone, 18331000,
profiling (15.412 s) : 15412000, 15412000
.   : milestone, 15412000,
tracing (14.981 s) : 14981000, 14981000
.   : milestone, 14981000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.996 s [14.996 s, 14.996 s] -
appsec 14.816 s [14.816 s, 14.816 s] -180.0 ms (-1.2%)
iast 18.095 s [18.095 s, 18.095 s] 3.099 s (20.7%)
iast_GLOBAL 18.208 s [18.208 s, 18.208 s] 3.212 s (21.4%)
profiling 15.296 s [15.296 s, 15.296 s] 300.0 ms (2.0%)
tracing 15.06 s [15.06 s, 15.06 s] 64.0 ms (0.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.266 s [15.266 s, 15.266 s] -
appsec 14.988 s [14.988 s, 14.988 s] -278.0 ms (-1.8%)
iast 18.283 s [18.283 s, 18.283 s] 3.017 s (19.8%)
iast_GLOBAL 18.331 s [18.331 s, 18.331 s] 3.065 s (20.1%)
profiling 15.412 s [15.412 s, 15.412 s] 146.0 ms (1.0%)
tracing 14.981 s [14.981 s, 14.981 s] -285.0 ms (-1.9%)

@amarziali amarziali added the tag: no release notes Changes to exclude from release notes label Sep 3, 2025
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD merged commit 030f9bb into master Sep 3, 2025
675 of 680 checks passed
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD deleted the mattalp/baseline-flarereporter-smoketesting branch September 3, 2025 12:15
@github-actions github-actions bot added this to the 1.53.0 milestone Sep 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jbachorik jbachorik jbachorik approved these changes

@amarziali amarziali amarziali approved these changes

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

Assignees

No one assigned

Labels

comp: profiling Profiling comp: testing Testing run-tests: oracle8 Run tests using Oracle 8 JDK tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

Projects

None yet

Milestone

1.53.0

Development

Successfully merging this pull request may close these issues.

5 participants

@MattAlp @jbachorik @amarziali @AlexeyKuznetsov-DD