Skip to content

Nikita tkachenko/test env 87b536644c4927894b6b24d99c5088a787f44dea #8496

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 2 commits into from
Closed

Nikita tkachenko/test env 87b536644c4927894b6b24d99c5088a787f44dea #8496

wants to merge 2 commits into from

Conversation

@nikita-tkachenko-datadog
Copy link
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog commented Mar 4, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@nikita-tkachenko-datadog
Fix Gradle Launcher instrumentation to not interfere with Gradle Test…
da6a1b6 
… Kit (#8465)
@evanchooly
Look in another location for grpc service methods (#8468)
87b5366 
if the service methods aren't found on the ImplBase, look for an AsyncService interface which *should* have the service methods.
@nikita-tkachenko-datadog nikita-tkachenko-datadog added the tag: do not merge Do not merge changes label Mar 4, 2025
@pr-commenter
Copy link

pr-commenter bot commented Mar 4, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/test-env-87b536644c4927894b6b24d99c5088a787f44dea
git_commit_date 1741082792 1740751331
git_commit_sha 8f945b0 87b5366
release_version 1.47.0-SNAPSHOT~8f945b02a7 1.47.0-SNAPSHOT~87b536644c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741091645 1741091645
ci_job_id 831518062 831518062
ci_pipeline_id 57626486 57626486
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ozdivcxc-project-304-concurrent-0-iye45262 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ozdivcxc-project-304-concurrent-0-iye45262 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 21 performance improvements and 6 performance regressions! Performance is the same for 26 metrics, 10 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent better
[-665.159ms; -522.556ms] or [-6.753%; -5.305%]		 9.257s 9.851s
scenario:startup:insecure-bank:iast:Agent.start better
[-91.730ms; -60.592ms] or [-7.281%; -4.810%]		 1.184s 1.260s
scenario:startup:insecure-bank:iast:Remote Config worse
[+78.155µs; +111.713µs] or [+15.036%; +21.492%]		 614.717µs 519.783µs
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Agent better
[-689.269ms; -605.062ms] or [-7.005%; -6.149%]		 9.193s 9.840s
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Agent.start better
[-97.928ms; -86.530ms] or [-7.755%; -6.852%]		 1.171s 1.263s
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Remote Config worse
[+52.811µs; +92.523µs] or [+9.880%; +17.309%]		 607.217µs 534.550µs
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Agent better
[-679.251ms; -571.892ms] or [-6.896%; -5.806%]		 9.224s 9.849s
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Agent.start better
[-91.798ms; -83.298ms] or [-7.321%; -6.643%]		 1.166s 1.254s
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Remote Config worse
[+70.912µs; +105.963µs] or [+13.443%; +20.088%]		 615.935µs 527.497µs
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Telemetry better
[-3.595ms; -3.304ms] or [-29.860%; -27.442%]		 8.590ms 12.039ms
scenario:startup:insecure-bank:tracing:Agent better
[-710.184ms; -628.630ms] or [-7.633%; -6.756%]		 8.635s 9.304s
scenario:startup:insecure-bank:tracing:Agent.start better
[-102.037ms; -92.384ms] or [-8.974%; -8.125%]		 1.040s 1.137s
scenario:startup:insecure-bank:tracing:Remote Config worse
[+88.075µs; +120.907µs] or [+15.139%; +20.783%]		 686.248µs 581.757µs
scenario:startup:petclinic:appsec:Agent better
[-996.280ms; -798.957ms] or [-8.570%; -6.873%]		 10.727s 11.625s
scenario:startup:petclinic:appsec:Agent.start better
[-106.660ms; -78.955ms] or [-8.355%; -6.185%]		 1.184s 1.277s
scenario:startup:petclinic:appsec:Telemetry better
[-4.099ms; -3.769ms] or [-33.520%; -30.824%]		 8.293ms 12.227ms
scenario:startup:petclinic:iast:Agent better
[-1.140s; -0.964s] or [-9.517%; -8.048%]		 10.931s 11.983s
scenario:startup:petclinic:iast:Agent.start better
[-99.556ms; -88.695ms] or [-7.870%; -7.011%]		 1.171s 1.265s
scenario:startup:petclinic:iast:Remote Config worse
[+70.809µs; +110.107µs] or [+13.439%; +20.898%]		 617.334µs 526.876µs
scenario:startup:petclinic:profiling:Agent better
[-971.851ms; -699.638ms] or [-8.258%; -5.945%]		 10.933s 11.769s
scenario:startup:petclinic:profiling:Agent.start better
[-126.756ms; -96.506ms] or [-9.184%; -6.993%]		 1.268s 1.380s
scenario:startup:petclinic:profiling:ProfilingAgent better
[-28.420ms; -23.281ms] or [-23.063%; -18.893%]		 97.377ms 123.227ms
scenario:startup:petclinic:profiling:Remote Config worse
[+49.848µs; +101.760µs] or [+8.221%; +16.782%]		 682.165µs 606.361µs
scenario:startup:petclinic:profiling:Telemetry better
[-3.592ms; -3.075ms] or [-28.719%; -24.590%]		 9.172ms 12.506ms
scenario:startup:petclinic:profiling:Profiling better
[-28.414ms; -23.276ms] or [-23.054%; -18.886%]		 97.403ms 123.248ms
scenario:startup:petclinic:tracing:Agent better
[-1.131s; -0.886s] or [-9.863%; -7.727%]		 10.459s 11.468s
scenario:startup:petclinic:tracing:Agent.start better
[-102.346ms; -90.656ms] or [-9.004%; -7.976%]		 1.040s 1.137s
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~87b536644c, baseline=1.47.0-SNAPSHOT~8f945b02a7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.137 s) : 0, 1137092
Total [baseline] (9.304 s) : 0, 9304391
Agent [candidate] (1.04 s) : 0, 1039882
Total [candidate] (8.635 s) : 0, 8634984
section iast
Agent [baseline] (1.26 s) : 0, 1259818
Total [baseline] (9.851 s) : 0, 9850540
Agent [candidate] (1.184 s) : 0, 1183656
Total [candidate] (9.257 s) : 0, 9256683
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.263 s) : 0, 1262759
Total [baseline] (9.84 s) : 0, 9840235
Agent [candidate] (1.171 s) : 0, 1170530
Total [candidate] (9.193 s) : 0, 9193070
section iast_TELEMETRY_OFF
Agent [baseline] (1.254 s) : 0, 1253845
Total [baseline] (9.849 s) : 0, 9849377
Agent [candidate] (1.166 s) : 0, 1166297
Total [candidate] (9.224 s) : 0, 9223805
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.137 s -
Agent iast 1.26 s 122.725 ms (10.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.263 s 125.666 ms (11.1%)
Agent iast_TELEMETRY_OFF 1.254 s 116.753 ms (10.3%)
Total tracing 9.304 s -
Total iast 9.851 s 546.149 ms (5.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.84 s 535.844 ms (5.8%)
Total iast_TELEMETRY_OFF 9.849 s 544.986 ms (5.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent iast 1.184 s 143.774 ms (13.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.171 s 130.648 ms (12.6%)
Agent iast_TELEMETRY_OFF 1.166 s 126.415 ms (12.2%)
Total tracing 8.635 s -
Total iast 9.257 s 621.699 ms (7.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.193 s 558.086 ms (6.5%)
Total iast_TELEMETRY_OFF 9.224 s 588.821 ms (6.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~87b536644c, baseline=1.47.0-SNAPSHOT~8f945b02a7

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.432 ms) : 0, 718432
BytebuddyAgent [candidate] (717.085 ms) : 0, 717085
GlobalTracer [baseline] (240.163 ms) : 0, 240163
GlobalTracer [candidate] (239.021 ms) : 0, 239021
AppSec [baseline] (55.475 ms) : 0, 55475
AppSec [candidate] (55.291 ms) : 0, 55291
Remote Config [baseline] (581.757 µs) : 0, 582
Remote Config [candidate] (686.248 µs) : 0, 686
Telemetry [baseline] (12.298 ms) : 0, 12298
Telemetry [candidate] (12.936 ms) : 0, 12936
Debugger [baseline] (95.089 ms) : 0, 95089
section iast
BytebuddyAgent [baseline] (835.377 ms) : 0, 835377
BytebuddyAgent [candidate] (849.813 ms) : 0, 849813
GlobalTracer [baseline] (230.14 ms) : 0, 230140
GlobalTracer [candidate] (229.414 ms) : 0, 229414
IAST [baseline] (23.525 ms) : 0, 23525
IAST [candidate] (22.823 ms) : 0, 22823
AppSec [baseline] (56.108 ms) : 0, 56108
AppSec [candidate] (57.156 ms) : 0, 57156
Remote Config [baseline] (519.783 µs) : 0, 520
Remote Config [candidate] (614.717 µs) : 0, 615
Telemetry [baseline] (15.712 ms) : 0, 15712
Telemetry [candidate] (8.666 ms) : 0, 8666
Debugger [baseline] (83.475 ms) : 0, 83475
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (836.254 ms) : 0, 836254
BytebuddyAgent [candidate] (836.317 ms) : 0, 836317
GlobalTracer [baseline] (232.162 ms) : 0, 232162
GlobalTracer [candidate] (230.005 ms) : 0, 230005
IAST [baseline] (23.177 ms) : 0, 23177
IAST [candidate] (22.825 ms) : 0, 22825
AppSec [baseline] (57.479 ms) : 0, 57479
AppSec [candidate] (57.121 ms) : 0, 57121
Remote Config [baseline] (534.55 µs) : 0, 535
Remote Config [candidate] (607.217 µs) : 0, 607
Telemetry [baseline] (13.696 ms) : 0, 13696
Telemetry [candidate] (8.73 ms) : 0, 8730
Debugger [baseline] (84.52 ms) : 0, 84520
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (833.09 ms) : 0, 833090
BytebuddyAgent [candidate] (833.72 ms) : 0, 833720
GlobalTracer [baseline] (230.741 ms) : 0, 230741
GlobalTracer [candidate] (229.405 ms) : 0, 229405
IAST [baseline] (23.819 ms) : 0, 23819
IAST [candidate] (25.309 ms) : 0, 25309
AppSec [baseline] (55.312 ms) : 0, 55312
AppSec [candidate] (53.813 ms) : 0, 53813
Remote Config [baseline] (527.497 µs) : 0, 527
Remote Config [candidate] (615.935 µs) : 0, 616
Telemetry [baseline] (12.039 ms) : 0, 12039
Telemetry [candidate] (8.59 ms) : 0, 8590
Debugger [baseline] (83.43 ms) : 0, 83430
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~87b536644c, baseline=1.47.0-SNAPSHOT~8f945b02a7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.137 s) : 0, 1136664
Total [baseline] (11.468 s) : 0, 11467768
Agent [candidate] (1.04 s) : 0, 1040163
Total [candidate] (10.459 s) : 0, 10459189
section appsec
Agent [baseline] (1.277 s) : 0, 1276656
Total [baseline] (11.625 s) : 0, 11625115
Agent [candidate] (1.184 s) : 0, 1183848
Total [candidate] (10.727 s) : 0, 10727497
section iast
Agent [baseline] (1.265 s) : 0, 1265064
Total [baseline] (11.983 s) : 0, 11983099
Agent [candidate] (1.171 s) : 0, 1170939
Total [candidate] (10.931 s) : 0, 10930657
section profiling
Agent [baseline] (1.38 s) : 0, 1380126
Total [baseline] (11.769 s) : 0, 11768539
Agent [candidate] (1.268 s) : 0, 1268495
Total [candidate] (10.933 s) : 0, 10932794
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.137 s -
Agent appsec 1.277 s 139.992 ms (12.3%)
Agent iast 1.265 s 128.4 ms (11.3%)
Agent profiling 1.38 s 243.462 ms (21.4%)
Total tracing 11.468 s -
Total appsec 11.625 s 157.347 ms (1.4%)
Total iast 11.983 s 515.331 ms (4.5%)
Total profiling 11.769 s 300.771 ms (2.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent appsec 1.184 s 143.685 ms (13.8%)
Agent iast 1.171 s 130.775 ms (12.6%)
Agent profiling 1.268 s 228.331 ms (22.0%)
Total tracing 10.459 s -
Total appsec 10.727 s 268.308 ms (2.6%)
Total iast 10.931 s 471.468 ms (4.5%)
Total profiling 10.933 s 473.606 ms (4.5%) 
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~87b536644c, baseline=1.47.0-SNAPSHOT~8f945b02a7

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.663 ms) : 0, 717663
BytebuddyAgent [candidate] (717.123 ms) : 0, 717123
GlobalTracer [baseline] (240.082 ms) : 0, 240082
GlobalTracer [candidate] (240.6 ms) : 0, 240600
AppSec [baseline] (55.85 ms) : 0, 55850
AppSec [candidate] (55.987 ms) : 0, 55987
Remote Config [baseline] (592.723 µs) : 0, 593
Remote Config [candidate] (700.048 µs) : 0, 700
Telemetry [baseline] (12.441 ms) : 0, 12441
Telemetry [candidate] (10.852 ms) : 0, 10852
Debugger [baseline] (95.146 ms) : 0, 95146
section appsec
BytebuddyAgent [baseline] (739.447 ms) : 0, 739447
BytebuddyAgent [candidate] (735.736 ms) : 0, 735736
GlobalTracer [baseline] (237.118 ms) : 0, 237118
GlobalTracer [candidate] (236.085 ms) : 0, 236085
IAST [baseline] (21.538 ms) : 0, 21538
IAST [candidate] (21.474 ms) : 0, 21474
AppSec [baseline] (176.377 ms) : 0, 176377
AppSec [candidate] (177.364 ms) : 0, 177364
Remote Config [baseline] (642.623 µs) : 0, 643
Remote Config [candidate] (660.991 µs) : 0, 661
Telemetry [baseline] (12.227 ms) : 0, 12227
Telemetry [candidate] (8.293 ms) : 0, 8293
Debugger [baseline] (85.035 ms) : 0, 85035
section iast
BytebuddyAgent [baseline] (837.911 ms) : 0, 837911
BytebuddyAgent [candidate] (836.49 ms) : 0, 836490
GlobalTracer [baseline] (231.299 ms) : 0, 231299
GlobalTracer [candidate] (229.834 ms) : 0, 229834
IAST [baseline] (22.949 ms) : 0, 22949
IAST [candidate] (22.963 ms) : 0, 22963
AppSec [baseline] (57.243 ms) : 0, 57243
AppSec [candidate] (57.41 ms) : 0, 57410
Remote Config [baseline] (526.876 µs) : 0, 527
Remote Config [candidate] (617.334 µs) : 0, 617
Telemetry [baseline] (16.341 ms) : 0, 16341
Telemetry [candidate] (8.697 ms) : 0, 8697
Debugger [baseline] (83.832 ms) : 0, 83832
section profiling
BytebuddyAgent [baseline] (709.654 ms) : 0, 709654
BytebuddyAgent [candidate] (713.898 ms) : 0, 713898
GlobalTracer [baseline] (350.337 ms) : 0, 350337
GlobalTracer [candidate] (351.415 ms) : 0, 351415
AppSec [baseline] (55.215 ms) : 0, 55215
AppSec [candidate] (55.48 ms) : 0, 55480
Remote Config [baseline] (606.361 µs) : 0, 606
Remote Config [candidate] (682.165 µs) : 0, 682
Telemetry [baseline] (12.506 ms) : 0, 12506
Telemetry [candidate] (9.172 ms) : 0, 9172
Debugger [baseline] (88.374 ms) : 0, 88374
ProfilingAgent [baseline] (123.227 ms) : 0, 123227
ProfilingAgent [candidate] (97.377 ms) : 0, 97377
Profiling [baseline] (123.248 ms) : 0, 123248
Profiling [candidate] (97.403 ms) : 0, 97403
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-04T12:03:14 2025-03-04T12:11:07
git_branch master nikita-tkachenko/test-env-87b536644c4927894b6b24d99c5088a787f44dea
git_commit_date 1741082792 1740751331
git_commit_sha 8f945b0 87b5366
release_version 1.47.0-SNAPSHOT~8f945b02a7 1.47.0-SNAPSHOT~87b536644c
start_time 2025-03-04T12:02:59 2025-03-04T12:10:53
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741090664 1741090664
ci_job_id 831518063 831518063
ci_pipeline_id 57626486 57626486
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zrt-bbxu-project-304-concurrent-0-3uxnivld 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zrt-bbxu-project-304-concurrent-0-3uxnivld 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~87b536644c, baseline=1.47.0-SNAPSHOT~8f945b02a7
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.367 ms) : 1347, 1387
.   : milestone, 1367,
appsec (1.733 ms) : 1708, 1758
.   : milestone, 1733,
appsec_no_iast (1.732 ms) : 1707, 1757
.   : milestone, 1732,
code_origins (1.701 ms) : 1667, 1735
.   : milestone, 1701,
iast (1.51 ms) : 1484, 1536
.   : milestone, 1510,
profiling (1.524 ms) : 1499, 1548
.   : milestone, 1524,
tracing (1.495 ms) : 1470, 1519
.   : milestone, 1495,
section candidate
no_agent (1.354 ms) : 1335, 1374
.   : milestone, 1354,
appsec (1.758 ms) : 1734, 1781
.   : milestone, 1758,
appsec_no_iast (1.752 ms) : 1728, 1777
.   : milestone, 1752,
code_origins (1.676 ms) : 1644, 1709
.   : milestone, 1676,
iast (1.496 ms) : 1473, 1520
.   : milestone, 1496,
profiling (1.51 ms) : 1487, 1534
.   : milestone, 1510,
tracing (1.469 ms) : 1443, 1495
.   : milestone, 1469,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.367 ms [1.347 ms, 1.387 ms] -
appsec 1.733 ms [1.708 ms, 1.758 ms] 366.191 µs (26.8%)
appsec_no_iast 1.732 ms [1.707 ms, 1.757 ms] 365.318 µs (26.7%)
code_origins 1.701 ms [1.667 ms, 1.735 ms] 334.134 µs (24.4%)
iast 1.51 ms [1.484 ms, 1.536 ms] 142.955 µs (10.5%)
profiling 1.524 ms [1.499 ms, 1.548 ms] 156.472 µs (11.4%)
tracing 1.495 ms [1.47 ms, 1.519 ms] 127.527 µs (9.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.354 ms [1.335 ms, 1.374 ms] -
appsec 1.758 ms [1.734 ms, 1.781 ms] 403.479 µs (29.8%)
appsec_no_iast 1.752 ms [1.728 ms, 1.777 ms] 398.429 µs (29.4%)
code_origins 1.676 ms [1.644 ms, 1.709 ms] 322.302 µs (23.8%)
iast 1.496 ms [1.473 ms, 1.52 ms] 142.338 µs (10.5%)
profiling 1.51 ms [1.487 ms, 1.534 ms] 156.353 µs (11.5%)
tracing 1.469 ms [1.443 ms, 1.495 ms] 115.003 µs (8.5%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~87b536644c, baseline=1.47.0-SNAPSHOT~8f945b02a7
    dateFormat X
    axisFormat %s
section baseline
no_agent (379.986 µs) : 360, 400
.   : milestone, 380,
iast (519.208 µs) : 497, 541
.   : milestone, 519,
iast_FULL (726.567 µs) : 705, 749
.   : milestone, 727,
iast_GLOBAL (557.143 µs) : 536, 579
.   : milestone, 557,
iast_HARDCODED_SECRET_DISABLED (517.586 µs) : 495, 540
.   : milestone, 518,
iast_INACTIVE (466.977 µs) : 445, 489
.   : milestone, 467,
iast_TELEMETRY_OFF (500.745 µs) : 479, 523
.   : milestone, 501,
tracing (458.747 µs) : 437, 480
.   : milestone, 459,
section candidate
no_agent (385.757 µs) : 366, 406
.   : milestone, 386,
iast (513.394 µs) : 492, 535
.   : milestone, 513,
iast_FULL (729.481 µs) : 707, 751
.   : milestone, 729,
iast_GLOBAL (562.099 µs) : 540, 585
.   : milestone, 562,
iast_HARDCODED_SECRET_DISABLED (509.784 µs) : 487, 532
.   : milestone, 510,
iast_INACTIVE (464.754 µs) : 444, 486
.   : milestone, 465,
iast_TELEMETRY_OFF (504.948 µs) : 482, 528
.   : milestone, 505,
tracing (462.962 µs) : 442, 484
.   : milestone, 463,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 379.986 µs [359.517 µs, 400.455 µs] -
iast 519.208 µs [497.224 µs, 541.192 µs] 139.222 µs (36.6%)
iast_FULL 726.567 µs [704.593 µs, 748.541 µs] 346.581 µs (91.2%)
iast_GLOBAL 557.143 µs [535.557 µs, 578.728 µs] 177.157 µs (46.6%)
iast_HARDCODED_SECRET_DISABLED 517.586 µs [494.89 µs, 540.282 µs] 137.6 µs (36.2%)
iast_INACTIVE 466.977 µs [445.239 µs, 488.716 µs] 86.991 µs (22.9%)
iast_TELEMETRY_OFF 500.745 µs [478.827 µs, 522.662 µs] 120.759 µs (31.8%)
tracing 458.747 µs [437.475 µs, 480.019 µs] 78.761 µs (20.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 385.757 µs [365.663 µs, 405.85 µs] -
iast 513.394 µs [491.756 µs, 535.032 µs] 127.637 µs (33.1%)
iast_FULL 729.481 µs [707.481 µs, 751.481 µs] 343.724 µs (89.1%)
iast_GLOBAL 562.099 µs [539.625 µs, 584.573 µs] 176.343 µs (45.7%)
iast_HARDCODED_SECRET_DISABLED 509.784 µs [487.371 µs, 532.196 µs] 124.027 µs (32.2%)
iast_INACTIVE 464.754 µs [443.997 µs, 485.512 µs] 78.998 µs (20.5%)
iast_TELEMETRY_OFF 504.948 µs [481.942 µs, 527.954 µs] 119.191 µs (30.9%)
tracing 462.962 µs [441.915 µs, 484.009 µs] 77.205 µs (20.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/test-env-87b536644c4927894b6b24d99c5088a787f44dea
git_commit_date 1741082792 1740751331
git_commit_sha 8f945b0 87b5366
release_version 1.47.0-SNAPSHOT~8f945b02a7 1.47.0-SNAPSHOT~87b536644c
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1741091218 1741091218
ci_job_id 831518064 831518064
ci_pipeline_id 57626486 57626486
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-xk9phren-project-304-concurrent-2-5aw8oi69 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-xk9phren-project-304-concurrent-2-5aw8oi69 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~87b536644c, baseline=1.47.0-SNAPSHOT~8f945b02a7
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.933 s) : 14933000, 14933000
.   : milestone, 14933000,
appsec (14.976 s) : 14976000, 14976000
.   : milestone, 14976000,
iast (18.828 s) : 18828000, 18828000
.   : milestone, 18828000,
iast_GLOBAL (17.886 s) : 17886000, 17886000
.   : milestone, 17886000,
profiling (15.085 s) : 15085000, 15085000
.   : milestone, 15085000,
tracing (15.081 s) : 15081000, 15081000
.   : milestone, 15081000,
section candidate
no_agent (15.408 s) : 15408000, 15408000
.   : milestone, 15408000,
appsec (14.937 s) : 14937000, 14937000
.   : milestone, 14937000,
iast (18.34 s) : 18340000, 18340000
.   : milestone, 18340000,
iast_GLOBAL (17.561 s) : 17561000, 17561000
.   : milestone, 17561000,
profiling (15.19 s) : 15190000, 15190000
.   : milestone, 15190000,
tracing (14.894 s) : 14894000, 14894000
.   : milestone, 14894000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.933 s [14.933 s, 14.933 s] -
appsec 14.976 s [14.976 s, 14.976 s] 43.0 ms (0.3%)
iast 18.828 s [18.828 s, 18.828 s] 3.895 s (26.1%)
iast_GLOBAL 17.886 s [17.886 s, 17.886 s] 2.953 s (19.8%)
profiling 15.085 s [15.085 s, 15.085 s] 152.0 ms (1.0%)
tracing 15.081 s [15.081 s, 15.081 s] 148.0 ms (1.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.408 s [15.408 s, 15.408 s] -
appsec 14.937 s [14.937 s, 14.937 s] -471.0 ms (-3.1%)
iast 18.34 s [18.34 s, 18.34 s] 2.932 s (19.0%)
iast_GLOBAL 17.561 s [17.561 s, 17.561 s] 2.153 s (14.0%)
profiling 15.19 s [15.19 s, 15.19 s] -218.0 ms (-1.4%)
tracing 14.894 s [14.894 s, 14.894 s] -514.0 ms (-3.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~87b536644c, baseline=1.47.0-SNAPSHOT~8f945b02a7
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.478 ms) : 1466, 1489
.   : milestone, 1478,
appsec (2.352 ms) : 2308, 2396
.   : milestone, 2352,
iast (2.126 ms) : 2071, 2182
.   : milestone, 2126,
iast_GLOBAL (2.171 ms) : 2115, 2227
.   : milestone, 2171,
profiling (1.98 ms) : 1936, 2023
.   : milestone, 1980,
tracing (1.956 ms) : 1913, 1998
.   : milestone, 1956,
section candidate
no_agent (1.478 ms) : 1466, 1490
.   : milestone, 1478,
appsec (2.353 ms) : 2309, 2396
.   : milestone, 2353,
iast (2.119 ms) : 2064, 2173
.   : milestone, 2119,
iast_GLOBAL (2.171 ms) : 2115, 2226
.   : milestone, 2171,
profiling (1.971 ms) : 1928, 2014
.   : milestone, 1971,
tracing (1.94 ms) : 1899, 1982
.   : milestone, 1940,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.489 ms] -
appsec 2.352 ms [2.308 ms, 2.396 ms] 874.367 µs (59.2%)
iast 2.126 ms [2.071 ms, 2.182 ms] 648.724 µs (43.9%)
iast_GLOBAL 2.171 ms [2.115 ms, 2.227 ms] 693.309 µs (46.9%)
profiling 1.98 ms [1.936 ms, 2.023 ms] 501.911 µs (34.0%)
tracing 1.956 ms [1.913 ms, 1.998 ms] 478.022 µs (32.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.49 ms] -
appsec 2.353 ms [2.309 ms, 2.396 ms] 874.926 µs (59.2%)
iast 2.119 ms [2.064 ms, 2.173 ms] 640.618 µs (43.3%)
iast_GLOBAL 2.171 ms [2.115 ms, 2.226 ms] 692.702 µs (46.9%)
profiling 1.971 ms [1.928 ms, 2.014 ms] 493.062 µs (33.4%)
tracing 1.94 ms [1.899 ms, 1.982 ms] 462.306 µs (31.3%)

@nikita-tkachenko-datadog nikita-tkachenko-datadog deleted the nikita-tkachenko/test-env-87b536644c4927894b6b24d99c5088a787f44dea branch March 4, 2025 14:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

tag: do not merge Do not merge changes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@nikita-tkachenko-datadog @evanchooly