Skip to content

Conversation

@github-actions
Copy link
Contributor

This PR updates the Gradle dependencies. ⚠️ Don't forget to squash commits before merging. ⚠️

  • Update PR title if a code change is needed to support one of those new dependencies

@github-actions github-actions bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Jun 22, 2025
@github-actions github-actions bot requested review from a team as code owners June 22, 2025 04:37
@github-actions github-actions bot requested review from PerfectSlayer, daniel-mohedano, jpbempel, robertpi and sezen-datadog and removed request for a team June 22, 2025 04:38
@pr-commenter
Copy link

pr-commenter bot commented Jun 22, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250622
git_commit_date 1750453785 1750567038
git_commit_sha aa9dd27 fd23fed
release_version 1.51.0-SNAPSHOT~aa9dd27535 1.51.0-SNAPSHOT~fd23fed5e9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1750569059 1750569059
ci_job_id 992564232 992564232
ci_pipeline_id 68400200 68400200
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ecr1ksdw-project-304-concurrent-7-01beazs9 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ecr1ksdw-project-304-concurrent-7-01beazs9 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 41 metrics, 12 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~fd23fed5e9, baseline=1.51.0-SNAPSHOT~aa9dd27535

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.026 s) : 0, 1026071
Total [baseline] (10.651 s) : 0, 10651233
Agent [candidate] (1.027 s) : 0, 1026687
Total [candidate] (10.596 s) : 0, 10596318
section appsec
Agent [baseline] (1.189 s) : 0, 1188771
Total [baseline] (10.828 s) : 0, 10827610
Agent [candidate] (1.188 s) : 0, 1187904
Total [candidate] (10.716 s) : 0, 10716465
section iast
Agent [baseline] (1.151 s) : 0, 1150724
Total [baseline] (10.893 s) : 0, 10892553
Agent [candidate] (1.165 s) : 0, 1165353
Total [candidate] (10.981 s) : 0, 10981272
section profiling
Agent [baseline] (1.295 s) : 0, 1294619
Total [baseline] (11.109 s) : 0, 11108505
Agent [candidate] (1.268 s) : 0, 1268461
Total [candidate] (10.98 s) : 0, 10979706
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.026 s -
Agent appsec 1.189 s 162.7 ms (15.9%)
Agent iast 1.151 s 124.653 ms (12.1%)
Agent profiling 1.295 s 268.548 ms (26.2%)
Total tracing 10.651 s -
Total appsec 10.828 s 176.377 ms (1.7%)
Total iast 10.893 s 241.32 ms (2.3%)
Total profiling 11.109 s 457.272 ms (4.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.027 s -
Agent appsec 1.188 s 161.217 ms (15.7%)
Agent iast 1.165 s 138.665 ms (13.5%)
Agent profiling 1.268 s 241.774 ms (23.5%)
Total tracing 10.596 s -
Total appsec 10.716 s 120.146 ms (1.1%)
Total iast 10.981 s 384.954 ms (3.6%)
Total profiling 10.98 s 383.388 ms (3.6%)
gantt
    title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~fd23fed5e9, baseline=1.51.0-SNAPSHOT~aa9dd27535

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (687.151 ms) : 0, 687151
BytebuddyAgent [candidate] (686.699 ms) : 0, 686699
GlobalTracer [baseline] (242.409 ms) : 0, 242409
GlobalTracer [candidate] (242.516 ms) : 0, 242516
AppSec [baseline] (57.426 ms) : 0, 57426
AppSec [candidate] (59.298 ms) : 0, 59298
Debugger [baseline] (6.99 ms) : 0, 6990
Debugger [candidate] (6.213 ms) : 0, 6213
Remote Config [baseline] (670.311 µs) : 0, 670
Remote Config [candidate] (668.879 µs) : 0, 669
Telemetry [baseline] (10.531 ms) : 0, 10531
Telemetry [candidate] (10.394 ms) : 0, 10394
section appsec
BytebuddyAgent [baseline] (714.78 ms) : 0, 714780
BytebuddyAgent [candidate] (714.535 ms) : 0, 714535
GlobalTracer [baseline] (237.013 ms) : 0, 237013
GlobalTracer [candidate] (236.874 ms) : 0, 236874
IAST [baseline] (22.088 ms) : 0, 22088
IAST [candidate] (22.097 ms) : 0, 22097
AppSec [baseline] (180.224 ms) : 0, 180224
AppSec [candidate] (179.742 ms) : 0, 179742
Debugger [baseline] (5.842 ms) : 0, 5842
Debugger [candidate] (5.814 ms) : 0, 5814
Remote Config [baseline] (613.153 µs) : 0, 613
Remote Config [candidate] (609.695 µs) : 0, 610
Telemetry [baseline] (7.369 ms) : 0, 7369
Telemetry [candidate] (7.318 ms) : 0, 7318
section iast
BytebuddyAgent [baseline] (804.624 ms) : 0, 804624
BytebuddyAgent [candidate] (814.576 ms) : 0, 814576
GlobalTracer [baseline] (231.371 ms) : 0, 231371
GlobalTracer [candidate] (235.17 ms) : 0, 235170
IAST [baseline] (27.383 ms) : 0, 27383
IAST [candidate] (27.312 ms) : 0, 27312
AppSec [baseline] (51.937 ms) : 0, 51937
AppSec [candidate] (51.948 ms) : 0, 51948
Debugger [baseline] (5.956 ms) : 0, 5956
Debugger [candidate] (5.942 ms) : 0, 5942
Remote Config [baseline] (605.119 µs) : 0, 605
Remote Config [candidate] (606.358 µs) : 0, 606
Telemetry [baseline] (8.001 ms) : 0, 8001
Telemetry [candidate] (8.033 ms) : 0, 8033
section profiling
BytebuddyAgent [baseline] (690.849 ms) : 0, 690849
BytebuddyAgent [candidate] (676.588 ms) : 0, 676588
GlobalTracer [baseline] (366.835 ms) : 0, 366835
GlobalTracer [candidate] (361.026 ms) : 0, 361026
AppSec [baseline] (62.882 ms) : 0, 62882
AppSec [candidate] (62.087 ms) : 0, 62087
Debugger [baseline] (6.269 ms) : 0, 6269
Debugger [candidate] (6.178 ms) : 0, 6178
Remote Config [baseline] (743.284 µs) : 0, 743
Remote Config [candidate] (703.62 µs) : 0, 704
Telemetry [baseline] (8.314 ms) : 0, 8314
Telemetry [candidate] (8.143 ms) : 0, 8143
ProfilingAgent [baseline] (109.408 ms) : 0, 109408
ProfilingAgent [candidate] (105.218 ms) : 0, 105218
Profiling [baseline] (109.433 ms) : 0, 109433
Profiling [candidate] (105.241 ms) : 0, 105241
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~fd23fed5e9, baseline=1.51.0-SNAPSHOT~aa9dd27535

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.036 s) : 0, 1035872
Total [baseline] (8.585 s) : 0, 8584662
Agent [candidate] (1.038 s) : 0, 1037936
Total [candidate] (8.548 s) : 0, 8548202
section iast
Agent [baseline] (1.152 s) : 0, 1151690
Total [baseline] (9.203 s) : 0, 9202880
Agent [candidate] (1.168 s) : 0, 1167996
Total [candidate] (9.229 s) : 0, 9229389
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.036 s -
Agent iast 1.152 s 115.818 ms (11.2%)
Total tracing 8.585 s -
Total iast 9.203 s 618.217 ms (7.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.038 s -
Agent iast 1.168 s 130.06 ms (12.5%)
Total tracing 8.548 s -
Total iast 9.229 s 681.187 ms (8.0%)
gantt
    title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~fd23fed5e9, baseline=1.51.0-SNAPSHOT~aa9dd27535

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (692.123 ms) : 0, 692123
BytebuddyAgent [candidate] (694.918 ms) : 0, 694918
GlobalTracer [baseline] (245.152 ms) : 0, 245152
GlobalTracer [candidate] (244.208 ms) : 0, 244208
AppSec [baseline] (58.457 ms) : 0, 58457
AppSec [candidate] (58.564 ms) : 0, 58564
Debugger [baseline] (7.785 ms) : 0, 7785
Debugger [candidate] (6.384 ms) : 0, 6384
Remote Config [baseline] (670.862 µs) : 0, 671
Remote Config [candidate] (690.183 µs) : 0, 690
Telemetry [baseline] (10.636 ms) : 0, 10636
Telemetry [candidate] (12.145 ms) : 0, 12145
section iast
BytebuddyAgent [baseline] (806.041 ms) : 0, 806041
BytebuddyAgent [candidate] (818.685 ms) : 0, 818685
GlobalTracer [baseline] (231.733 ms) : 0, 231733
GlobalTracer [candidate] (234.059 ms) : 0, 234059
IAST [baseline] (28.908 ms) : 0, 28908
IAST [candidate] (26.408 ms) : 0, 26408
AppSec [baseline] (49.635 ms) : 0, 49635
AppSec [candidate] (53.079 ms) : 0, 53079
Debugger [baseline] (5.928 ms) : 0, 5928
Debugger [candidate] (6.004 ms) : 0, 6004
Remote Config [baseline] (605.045 µs) : 0, 605
Remote Config [candidate] (633.87 µs) : 0, 634
Telemetry [baseline] (8.049 ms) : 0, 8049
Telemetry [candidate] (8.063 ms) : 0, 8063
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250622
git_commit_date 1750453785 1750567038
git_commit_sha aa9dd27 fd23fed
release_version 1.51.0-SNAPSHOT~aa9dd27535 1.51.0-SNAPSHOT~fd23fed5e9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1750568692 1750568692
ci_job_id 992564233 992564233
ci_pipeline_id 68400200 68400200
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ecr1ksdw-project-304-concurrent-8-ax4bcubd 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ecr1ksdw-project-304-concurrent-8-ax4bcubd 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+318.308µs; +693.553µs] or [+3.255%; +7.092%]
unstable
[-74.211op/s; +27.898op/s] or [-15.622%; +5.873%]
10.286ms 451.875op/s 9.780ms 475.031op/s
scenario:load:insecure-bank:iast:high_load better
[-559.847µs; -240.625µs] or [-6.001%; -2.579%]
unstable
[-34.166op/s; +78.228op/s] or [-6.864%; +15.717%]
8.929ms 519.750op/s 9.329ms 497.719op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~fd23fed5e9, baseline=1.51.0-SNAPSHOT~aa9dd27535
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.578 ms) : 4525, 4631
.   : milestone, 4578,
iast (9.329 ms) : 9176, 9482
.   : milestone, 9329,
iast_FULL (13.688 ms) : 13416, 13959
.   : milestone, 13688,
iast_GLOBAL (9.78 ms) : 9610, 9950
.   : milestone, 9780,
profiling (8.911 ms) : 8775, 9048
.   : milestone, 8911,
tracing (7.561 ms) : 7455, 7668
.   : milestone, 7561,
section candidate
no_agent (4.606 ms) : 4547, 4664
.   : milestone, 4606,
iast (8.929 ms) : 8785, 9073
.   : milestone, 8929,
iast_FULL (13.672 ms) : 13396, 13948
.   : milestone, 13672,
iast_GLOBAL (10.286 ms) : 10107, 10464
.   : milestone, 10286,
profiling (8.814 ms) : 8669, 8960
.   : milestone, 8814,
tracing (7.768 ms) : 7658, 7877
.   : milestone, 7768,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.578 ms [4.525 ms, 4.631 ms] -
iast 9.329 ms [9.176 ms, 9.482 ms] 4.751 ms (103.8%)
iast_FULL 13.688 ms [13.416 ms, 13.959 ms] 9.11 ms (199.0%)
iast_GLOBAL 9.78 ms [9.61 ms, 9.95 ms] 5.202 ms (113.6%)
profiling 8.911 ms [8.775 ms, 9.048 ms] 4.333 ms (94.7%)
tracing 7.561 ms [7.455 ms, 7.668 ms] 2.984 ms (65.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.606 ms [4.547 ms, 4.664 ms] -
iast 8.929 ms [8.785 ms, 9.073 ms] 4.323 ms (93.9%)
iast_FULL 13.672 ms [13.396 ms, 13.948 ms] 9.066 ms (196.8%)
iast_GLOBAL 10.286 ms [10.107 ms, 10.464 ms] 5.68 ms (123.3%)
profiling 8.814 ms [8.669 ms, 8.96 ms] 4.209 ms (91.4%)
tracing 7.768 ms [7.658 ms, 7.877 ms] 3.162 ms (68.6%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~fd23fed5e9, baseline=1.51.0-SNAPSHOT~aa9dd27535
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.658 ms) : 36360, 36956
.   : milestone, 36658,
appsec (47.174 ms) : 46750, 47597
.   : milestone, 47174,
code_origins (43.819 ms) : 43459, 44180
.   : milestone, 43819,
iast (44.732 ms) : 44355, 45110
.   : milestone, 44732,
profiling (49.228 ms) : 48765, 49691
.   : milestone, 49228,
tracing (43.654 ms) : 43305, 44003
.   : milestone, 43654,
section candidate
no_agent (36.575 ms) : 36278, 36871
.   : milestone, 36575,
appsec (46.158 ms) : 45737, 46579
.   : milestone, 46158,
code_origins (44.066 ms) : 43713, 44420
.   : milestone, 44066,
iast (43.731 ms) : 43343, 44119
.   : milestone, 43731,
profiling (48.909 ms) : 48440, 49377
.   : milestone, 48909,
tracing (43.107 ms) : 42759, 43454
.   : milestone, 43107,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.658 ms [36.36 ms, 36.956 ms] -
appsec 47.174 ms [46.75 ms, 47.597 ms] 10.516 ms (28.7%)
code_origins 43.819 ms [43.459 ms, 44.18 ms] 7.162 ms (19.5%)
iast 44.732 ms [44.355 ms, 45.11 ms] 8.074 ms (22.0%)
profiling 49.228 ms [48.765 ms, 49.691 ms] 12.57 ms (34.3%)
tracing 43.654 ms [43.305 ms, 44.003 ms] 6.996 ms (19.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.575 ms [36.278 ms, 36.871 ms] -
appsec 46.158 ms [45.737 ms, 46.579 ms] 9.583 ms (26.2%)
code_origins 44.066 ms [43.713 ms, 44.42 ms] 7.492 ms (20.5%)
iast 43.731 ms [43.343 ms, 44.119 ms] 7.157 ms (19.6%)
profiling 48.909 ms [48.44 ms, 49.377 ms] 12.334 ms (33.7%)
tracing 43.107 ms [42.759 ms, 43.454 ms] 6.532 ms (17.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250622
git_commit_date 1750453785 1750567038
git_commit_sha aa9dd27 fd23fed
release_version 1.51.0-SNAPSHOT~aa9dd27535 1.51.0-SNAPSHOT~fd23fed5e9
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1750569853 1750569853
ci_job_id 992564234 992564234
ci_pipeline_id 68400200 68400200
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ecr1ksdw-project-304-concurrent-9-jnqc4gvq 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ecr1ksdw-project-304-concurrent-9-jnqc4gvq 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~fd23fed5e9, baseline=1.51.0-SNAPSHOT~aa9dd27535
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.485 ms) : 1473, 1497
.   : milestone, 1485,
appsec (2.409 ms) : 2360, 2457
.   : milestone, 2409,
iast (2.196 ms) : 2135, 2257
.   : milestone, 2196,
iast_GLOBAL (2.248 ms) : 2187, 2310
.   : milestone, 2248,
profiling (2.063 ms) : 2013, 2113
.   : milestone, 2063,
tracing (2.034 ms) : 1985, 2082
.   : milestone, 2034,
section candidate
no_agent (1.486 ms) : 1474, 1498
.   : milestone, 1486,
appsec (2.409 ms) : 2361, 2458
.   : milestone, 2409,
iast (2.193 ms) : 2132, 2255
.   : milestone, 2193,
iast_GLOBAL (2.245 ms) : 2183, 2307
.   : milestone, 2245,
profiling (2.045 ms) : 1996, 2095
.   : milestone, 2045,
tracing (2.006 ms) : 1959, 2054
.   : milestone, 2006,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.485 ms [1.473 ms, 1.497 ms] -
appsec 2.409 ms [2.36 ms, 2.457 ms] 923.809 µs (62.2%)
iast 2.196 ms [2.135 ms, 2.257 ms] 711.079 µs (47.9%)
iast_GLOBAL 2.248 ms [2.187 ms, 2.31 ms] 763.218 µs (51.4%)
profiling 2.063 ms [2.013 ms, 2.113 ms] 578.101 µs (38.9%)
tracing 2.034 ms [1.985 ms, 2.082 ms] 548.895 µs (37.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.486 ms [1.474 ms, 1.498 ms] -
appsec 2.409 ms [2.361 ms, 2.458 ms] 923.349 µs (62.1%)
iast 2.193 ms [2.132 ms, 2.255 ms] 707.148 µs (47.6%)
iast_GLOBAL 2.245 ms [2.183 ms, 2.307 ms] 758.638 µs (51.0%)
profiling 2.045 ms [1.996 ms, 2.095 ms] 559.264 µs (37.6%)
tracing 2.006 ms [1.959 ms, 2.054 ms] 520.222 µs (35.0%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~fd23fed5e9, baseline=1.51.0-SNAPSHOT~aa9dd27535
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.036 s) : 15036000, 15036000
.   : milestone, 15036000,
appsec (14.728 s) : 14728000, 14728000
.   : milestone, 14728000,
iast (18.984 s) : 18984000, 18984000
.   : milestone, 18984000,
iast_GLOBAL (18.32 s) : 18320000, 18320000
.   : milestone, 18320000,
profiling (15.273 s) : 15273000, 15273000
.   : milestone, 15273000,
tracing (15.171 s) : 15171000, 15171000
.   : milestone, 15171000,
section candidate
no_agent (15.813 s) : 15813000, 15813000
.   : milestone, 15813000,
appsec (14.874 s) : 14874000, 14874000
.   : milestone, 14874000,
iast (18.472 s) : 18472000, 18472000
.   : milestone, 18472000,
iast_GLOBAL (17.822 s) : 17822000, 17822000
.   : milestone, 17822000,
profiling (15.172 s) : 15172000, 15172000
.   : milestone, 15172000,
tracing (15.028 s) : 15028000, 15028000
.   : milestone, 15028000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.036 s [15.036 s, 15.036 s] -
appsec 14.728 s [14.728 s, 14.728 s] -308.0 ms (-2.0%)
iast 18.984 s [18.984 s, 18.984 s] 3.948 s (26.3%)
iast_GLOBAL 18.32 s [18.32 s, 18.32 s] 3.284 s (21.8%)
profiling 15.273 s [15.273 s, 15.273 s] 237.0 ms (1.6%)
tracing 15.171 s [15.171 s, 15.171 s] 135.0 ms (0.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.813 s [15.813 s, 15.813 s] -
appsec 14.874 s [14.874 s, 14.874 s] -939.0 ms (-5.9%)
iast 18.472 s [18.472 s, 18.472 s] 2.659 s (16.8%)
iast_GLOBAL 17.822 s [17.822 s, 17.822 s] 2.009 s (12.7%)
profiling 15.172 s [15.172 s, 15.172 s] -641.0 ms (-4.1%)
tracing 15.028 s [15.028 s, 15.028 s] -785.0 ms (-5.0%)

@pr-commenter
Copy link

pr-commenter bot commented Jun 22, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1750567805 1750568188
end_time 2025-06-22T04:51:26 2025-06-22T04:57:48
git_branch master ci/update-gradle-dependencies-20250622
git_commit_sha aa9dd27 0970a6d
start_time 2025-06-22T04:50:06 2025-06-22T04:56:29
See matching parameters
Baseline Candidate
ci_job_id 992564566 992564566
ci_pipeline_id 68400202 68400202
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1750567045 1750567045

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-28.617µs; +17.663µs] or [-10.232%; +6.315%]
unstable
[-43.316µs; +29.745µs] or [-13.495%; +9.267%]
unstable
[-53.990µs; +41.248µs] or [-16.106%; +12.305%]
unstable
[-128.181µs; +123.574µs] or [-13.172%; +12.698%]
same
scenario:basic same same same unstable
[-6.568µs; +227.759µs] or [-0.842%; +29.192%]
unstable
[-162.328op/s; +162.328op/s] or [-6.655%; +6.655%]
scenario:loop unsure
[+12.706µs; +27.615µs] or [+0.119%; +0.259%]
same same same same
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (320.979 µs) : 282, 360
.   : milestone, 321,
basic (308.816 µs) : 299, 319
.   : milestone, 309,
loop (10.835 ms) : 10808, 10862
.   : milestone, 10835,
section candidate
noprobe (314.194 µs) : 285, 344
.   : milestone, 314,
basic (311.367 µs) : 302, 320
.   : milestone, 311,
loop (10.844 ms) : 10826, 10863
.   : milestone, 10844,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 320.979 µs [281.649 µs, 360.309 µs]
basic 308.816 µs [298.983 µs, 318.649 µs]
loop 10.835 ms [10.808 ms, 10.862 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 314.194 µs [284.657 µs, 343.731 µs]
basic 311.367 µs [302.406 µs, 320.327 µs]
loop 10.844 ms [10.826 ms, 10.863 ms]

@pr-commenter
Copy link

pr-commenter bot commented Jun 22, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250622
git_commit_date 1750453785 1750567075
git_commit_sha aa9dd27 5158e66
See matching parameters
Baseline Candidate
ci_job_date 1750568349 1750568349
ci_job_id 992566532 992566532
ci_pipeline_id 68400214 68400214
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Jun 22, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250622
git_commit_date 1750453785 1750567067
git_commit_sha aa9dd27 5b60db7
See matching parameters
Baseline Candidate
ci_job_date 1750568337 1750568337
ci_job_id 992566041 992566041
ci_pipeline_id 68400211 68400211
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume unsure
[-16945.117op/s; -591.232op/s] or [-5.417%; -0.189%]
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@smola smola mentioned this pull request Jun 23, 2025
1 task
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD deleted the ci/update-gradle-dependencies-20250622 branch July 22, 2025 19:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants