Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] initial implementation and unit tests for inject/extract #8330

Draft
wants to merge 2 commits into
base: master
Choose a base branch
from
Draft

[WIP] initial implementation and unit tests for inject/extract #8330

wants to merge 2 commits into from
+426 −1

Conversation

mhlidd
Copy link
Contributor

@mhlidd mhlidd commented Feb 3, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@mhlidd mhlidd added the tag: do not merge Do not merge changes label Feb 3, 2025
@mhlidd mhlidd changed the title initial implementation and unit tests for inject/extract [WIP] initial implementation and unit tests for inject/extract Feb 3, 2025
@pr-commenter
Copy link

pr-commenter bot commented Feb 3, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/otel_baggage_extract/inject
git_commit_date 1738618069 1738619730
git_commit_sha 28acd37 22bc009
release_version 1.47.0-SNAPSHOT~28acd37546 1.47.0-SNAPSHOT~22bc0098de
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1738622195 1738622195
ci_job_id 792320981 792320981
ci_pipeline_id 54781898 54781898
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-hf2spk2o-project-304-concurrent-0-nwewlqge 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-hf2spk2o-project-304-concurrent-0-nwewlqge 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 12 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:profiling:Remote Config better
[-64.699µs; -22.680µs] or [-9.125%; -3.199%]		 665.318µs 709.008µs
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~22bc0098de, baseline=1.47.0-SNAPSHOT~28acd37546

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.04 s) : 0, 1039520
Total [baseline] (10.464 s) : 0, 10463984
Agent [candidate] (1.047 s) : 0, 1046578
Total [candidate] (10.506 s) : 0, 10505608
section appsec
Agent [baseline] (1.182 s) : 0, 1182040
Total [baseline] (10.734 s) : 0, 10733897
Agent [candidate] (1.184 s) : 0, 1184425
Total [candidate] (10.759 s) : 0, 10759237
section iast
Agent [baseline] (1.179 s) : 0, 1179301
Total [baseline] (10.962 s) : 0, 10962123
Agent [candidate] (1.179 s) : 0, 1179404
Total [candidate] (11.031 s) : 0, 11030829
section profiling
Agent [baseline] (1.261 s) : 0, 1260975
Total [baseline] (10.832 s) : 0, 10832264
Agent [candidate] (1.26 s) : 0, 1259572
Total [candidate] (10.864 s) : 0, 10864106
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent appsec 1.182 s 142.519 ms (13.7%)
Agent iast 1.179 s 139.781 ms (13.4%)
Agent profiling 1.261 s 221.455 ms (21.3%)
Total tracing 10.464 s -
Total appsec 10.734 s 269.913 ms (2.6%)
Total iast 10.962 s 498.139 ms (4.8%)
Total profiling 10.832 s 368.28 ms (3.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent appsec 1.184 s 137.847 ms (13.2%)
Agent iast 1.179 s 132.826 ms (12.7%)
Agent profiling 1.26 s 212.994 ms (20.4%)
Total tracing 10.506 s -
Total appsec 10.759 s 253.629 ms (2.4%)
Total iast 11.031 s 525.221 ms (5.0%)
Total profiling 10.864 s 358.498 ms (3.4%) 
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~22bc0098de, baseline=1.47.0-SNAPSHOT~28acd37546

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (714.05 ms) : 0, 714050
BytebuddyAgent [candidate] (718.855 ms) : 0, 718855
GlobalTracer [baseline] (242.384 ms) : 0, 242384
GlobalTracer [candidate] (242.408 ms) : 0, 242408
AppSec [baseline] (55.086 ms) : 0, 55086
AppSec [candidate] (55.533 ms) : 0, 55533
Remote Config [baseline] (707.887 µs) : 0, 708
Remote Config [candidate] (723.314 µs) : 0, 723
Telemetry [baseline] (12.113 ms) : 0, 12113
Telemetry [candidate] (13.771 ms) : 0, 13771
section appsec
BytebuddyAgent [baseline] (730.916 ms) : 0, 730916
BytebuddyAgent [candidate] (734.628 ms) : 0, 734628
GlobalTracer [baseline] (239.993 ms) : 0, 239993
GlobalTracer [candidate] (238.782 ms) : 0, 238782
AppSec [baseline] (176.202 ms) : 0, 176202
AppSec [candidate] (175.873 ms) : 0, 175873
Remote Config [baseline] (650.713 µs) : 0, 651
Remote Config [candidate] (666.452 µs) : 0, 666
Telemetry [baseline] (8.299 ms) : 0, 8299
Telemetry [candidate] (8.317 ms) : 0, 8317
IAST [baseline] (21.551 ms) : 0, 21551
IAST [candidate] (21.793 ms) : 0, 21793
section iast
BytebuddyAgent [baseline] (839.101 ms) : 0, 839101
BytebuddyAgent [candidate] (841.032 ms) : 0, 841032
GlobalTracer [baseline] (234.652 ms) : 0, 234652
GlobalTracer [candidate] (233.937 ms) : 0, 233937
AppSec [baseline] (55.26 ms) : 0, 55260
AppSec [candidate] (54.661 ms) : 0, 54661
Remote Config [baseline] (637.136 µs) : 0, 637
Remote Config [candidate] (612.25 µs) : 0, 612
Telemetry [baseline] (8.889 ms) : 0, 8889
Telemetry [candidate] (8.713 ms) : 0, 8713
IAST [baseline] (25.192 ms) : 0, 25192
IAST [candidate] (25.019 ms) : 0, 25019
section profiling
ProfilingAgent [baseline] (95.596 ms) : 0, 95596
ProfilingAgent [candidate] (95.477 ms) : 0, 95477
BytebuddyAgent [baseline] (705.264 ms) : 0, 705264
BytebuddyAgent [candidate] (705.877 ms) : 0, 705877
GlobalTracer [baseline] (353.326 ms) : 0, 353326
GlobalTracer [candidate] (352.254 ms) : 0, 352254
AppSec [baseline] (55.01 ms) : 0, 55010
AppSec [candidate] (54.206 ms) : 0, 54206
Remote Config [baseline] (709.008 µs) : 0, 709
Remote Config [candidate] (665.318 µs) : 0, 665
Telemetry [baseline] (8.872 ms) : 0, 8872
Telemetry [candidate] (8.916 ms) : 0, 8916
Profiling [baseline] (95.62 ms) : 0, 95620
Profiling [candidate] (95.501 ms) : 0, 95501
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~22bc0098de, baseline=1.47.0-SNAPSHOT~28acd37546

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.052 s) : 0, 1052173
Total [baseline] (8.659 s) : 0, 8658566
Agent [candidate] (1.039 s) : 0, 1039240
Total [candidate] (8.599 s) : 0, 8599167
section iast
Agent [baseline] (1.17 s) : 0, 1170224
Total [baseline] (9.192 s) : 0, 9192218
Agent [candidate] (1.17 s) : 0, 1169513
Total [candidate] (9.219 s) : 0, 9219190
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.171 s) : 0, 1170949
Total [baseline] (9.172 s) : 0, 9172095
Agent [candidate] (1.17 s) : 0, 1169639
Total [candidate] (9.173 s) : 0, 9173448
section iast_TELEMETRY_OFF
Agent [baseline] (1.18 s) : 0, 1180252
Total [baseline] (9.238 s) : 0, 9238097
Agent [candidate] (1.175 s) : 0, 1175358
Total [candidate] (9.184 s) : 0, 9183727
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent iast 1.17 s 118.051 ms (11.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.171 s 118.776 ms (11.3%)
Agent iast_TELEMETRY_OFF 1.18 s 128.079 ms (12.2%)
Total tracing 8.659 s -
Total iast 9.192 s 533.653 ms (6.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.172 s 513.529 ms (5.9%)
Total iast_TELEMETRY_OFF 9.238 s 579.531 ms (6.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.039 s -
Agent iast 1.17 s 130.273 ms (12.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.17 s 130.398 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.175 s 136.118 ms (13.1%)
Total tracing 8.599 s -
Total iast 9.219 s 620.023 ms (7.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.173 s 574.281 ms (6.7%)
Total iast_TELEMETRY_OFF 9.184 s 584.56 ms (6.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~22bc0098de, baseline=1.47.0-SNAPSHOT~28acd37546

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (724.231 ms) : 0, 724231
BytebuddyAgent [candidate] (714.193 ms) : 0, 714193
GlobalTracer [baseline] (243.146 ms) : 0, 243146
GlobalTracer [candidate] (240.644 ms) : 0, 240644
AppSec [baseline] (55.744 ms) : 0, 55744
AppSec [candidate] (55.504 ms) : 0, 55504
Remote Config [baseline] (712.909 µs) : 0, 713
Remote Config [candidate] (726.141 µs) : 0, 726
Telemetry [baseline] (12.97 ms) : 0, 12970
Telemetry [candidate] (12.847 ms) : 0, 12847
section iast
BytebuddyAgent [baseline] (832.782 ms) : 0, 832782
BytebuddyAgent [candidate] (833.807 ms) : 0, 833807
GlobalTracer [baseline] (233.614 ms) : 0, 233614
GlobalTracer [candidate] (231.879 ms) : 0, 231879
AppSec [baseline] (54.484 ms) : 0, 54484
AppSec [candidate] (56.821 ms) : 0, 56821
Remote Config [baseline] (614.199 µs) : 0, 614
Remote Config [candidate] (608.504 µs) : 0, 609
Telemetry [baseline] (8.61 ms) : 0, 8610
Telemetry [candidate] (8.663 ms) : 0, 8663
IAST [baseline] (24.816 ms) : 0, 24816
IAST [candidate] (22.436 ms) : 0, 22436
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (833.281 ms) : 0, 833281
BytebuddyAgent [candidate] (833.696 ms) : 0, 833696
GlobalTracer [baseline] (233.49 ms) : 0, 233490
GlobalTracer [candidate] (231.586 ms) : 0, 231586
AppSec [baseline] (54.841 ms) : 0, 54841
AppSec [candidate] (55.484 ms) : 0, 55484
Remote Config [baseline] (612.7 µs) : 0, 613
Remote Config [candidate] (610.563 µs) : 0, 611
Telemetry [baseline] (8.639 ms) : 0, 8639
Telemetry [candidate] (8.751 ms) : 0, 8751
IAST [baseline] (24.866 ms) : 0, 24866
IAST [candidate] (24.146 ms) : 0, 24146
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (837.416 ms) : 0, 837416
BytebuddyAgent [candidate] (838.384 ms) : 0, 838384
GlobalTracer [baseline] (237.274 ms) : 0, 237274
GlobalTracer [candidate] (232.731 ms) : 0, 232731
AppSec [baseline] (55.683 ms) : 0, 55683
AppSec [candidate] (53.971 ms) : 0, 53971
Remote Config [baseline] (641.643 µs) : 0, 642
Remote Config [candidate] (613.049 µs) : 0, 613
Telemetry [baseline] (8.76 ms) : 0, 8760
Telemetry [candidate] (8.758 ms) : 0, 8758
IAST [baseline] (25.152 ms) : 0, 25152
IAST [candidate] (25.491 ms) : 0, 25491
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-02-03T22:06:35 2025-02-03T22:13:43
git_branch master mhlidd/otel_baggage_extract/inject
git_commit_date 1738618069 1738619730
git_commit_sha 28acd37 22bc009
release_version 1.47.0-SNAPSHOT~28acd37546 1.47.0-SNAPSHOT~22bc0098de
start_time 2025-02-03T22:06:21 2025-02-03T22:13:29
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1738621183 1738621183
ci_job_id 792320982 792320982
ci_pipeline_id 54781898 54781898
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-hf2spk2o-project-304-concurrent-1-crggboff 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-hf2spk2o-project-304-concurrent-1-crggboff 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~22bc0098de, baseline=1.47.0-SNAPSHOT~28acd37546
    dateFormat X
    axisFormat %s
section baseline
no_agent (389.218 µs) : 369, 409
.   : milestone, 389,
iast (519.97 µs) : 498, 542
.   : milestone, 520,
iast_FULL (755.774 µs) : 734, 778
.   : milestone, 756,
iast_GLOBAL (573.991 µs) : 550, 598
.   : milestone, 574,
iast_HARDCODED_SECRET_DISABLED (517.864 µs) : 496, 540
.   : milestone, 518,
iast_INACTIVE (466.74 µs) : 445, 488
.   : milestone, 467,
iast_TELEMETRY_OFF (513.637 µs) : 490, 537
.   : milestone, 514,
tracing (468.817 µs) : 445, 493
.   : milestone, 469,
section candidate
no_agent (381.876 µs) : 362, 401
.   : milestone, 382,
iast (517.261 µs) : 496, 539
.   : milestone, 517,
iast_FULL (759.064 µs) : 737, 781
.   : milestone, 759,
iast_GLOBAL (561.111 µs) : 539, 583
.   : milestone, 561,
iast_HARDCODED_SECRET_DISABLED (517.577 µs) : 495, 540
.   : milestone, 518,
iast_INACTIVE (465.942 µs) : 445, 487
.   : milestone, 466,
iast_TELEMETRY_OFF (503.367 µs) : 481, 526
.   : milestone, 503,
tracing (465.954 µs) : 444, 488
.   : milestone, 466,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 389.218 µs [369.364 µs, 409.073 µs] -
iast 519.97 µs [498.277 µs, 541.663 µs] 130.752 µs (33.6%)
iast_FULL 755.774 µs [733.775 µs, 777.773 µs] 366.555 µs (94.2%)
iast_GLOBAL 573.991 µs [550.477 µs, 597.504 µs] 184.772 µs (47.5%)
iast_HARDCODED_SECRET_DISABLED 517.864 µs [495.972 µs, 539.755 µs] 128.645 µs (33.1%)
iast_INACTIVE 466.74 µs [445.467 µs, 488.014 µs] 77.522 µs (19.9%)
iast_TELEMETRY_OFF 513.637 µs [489.945 µs, 537.33 µs] 124.419 µs (32.0%)
tracing 468.817 µs [444.576 µs, 493.059 µs] 79.599 µs (20.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 381.876 µs [362.362 µs, 401.39 µs] -
iast 517.261 µs [495.636 µs, 538.885 µs] 135.385 µs (35.5%)
iast_FULL 759.064 µs [737.079 µs, 781.048 µs] 377.187 µs (98.8%)
iast_GLOBAL 561.111 µs [539.452 µs, 582.769 µs] 179.234 µs (46.9%)
iast_HARDCODED_SECRET_DISABLED 517.577 µs [495.135 µs, 540.02 µs] 135.701 µs (35.5%)
iast_INACTIVE 465.942 µs [444.673 µs, 487.211 µs] 84.066 µs (22.0%)
iast_TELEMETRY_OFF 503.367 µs [480.636 µs, 526.098 µs] 121.491 µs (31.8%)
tracing 465.954 µs [443.916 µs, 487.991 µs] 84.078 µs (22.0%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~22bc0098de, baseline=1.47.0-SNAPSHOT~28acd37546
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.355 ms) : 1335, 1376
.   : milestone, 1355,
appsec (1.766 ms) : 1742, 1790
.   : milestone, 1766,
appsec_no_iast (1.759 ms) : 1733, 1785
.   : milestone, 1759,
iast (1.516 ms) : 1493, 1540
.   : milestone, 1516,
profiling (1.513 ms) : 1489, 1537
.   : milestone, 1513,
tracing (1.506 ms) : 1481, 1530
.   : milestone, 1506,
section candidate
no_agent (1.358 ms) : 1338, 1379
.   : milestone, 1358,
appsec (1.778 ms) : 1753, 1802
.   : milestone, 1778,
appsec_no_iast (1.772 ms) : 1749, 1796
.   : milestone, 1772,
iast (1.527 ms) : 1502, 1551
.   : milestone, 1527,
profiling (1.527 ms) : 1504, 1549
.   : milestone, 1527,
tracing (1.5 ms) : 1475, 1524
.   : milestone, 1500,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.355 ms [1.335 ms, 1.376 ms] -
appsec 1.766 ms [1.742 ms, 1.79 ms] 410.702 µs (30.3%)
appsec_no_iast 1.759 ms [1.733 ms, 1.785 ms] 403.773 µs (29.8%)
iast 1.516 ms [1.493 ms, 1.54 ms] 161.111 µs (11.9%)
profiling 1.513 ms [1.489 ms, 1.537 ms] 157.536 µs (11.6%)
tracing 1.506 ms [1.481 ms, 1.53 ms] 150.448 µs (11.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.358 ms [1.338 ms, 1.379 ms] -
appsec 1.778 ms [1.753 ms, 1.802 ms] 419.238 µs (30.9%)
appsec_no_iast 1.772 ms [1.749 ms, 1.796 ms] 413.999 µs (30.5%)
iast 1.527 ms [1.502 ms, 1.551 ms] 168.356 µs (12.4%)
profiling 1.527 ms [1.504 ms, 1.549 ms] 168.295 µs (12.4%)
tracing 1.5 ms [1.475 ms, 1.524 ms] 141.226 µs (10.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/otel_baggage_extract/inject
git_commit_date 1738618069 1738619730
git_commit_sha 28acd37 22bc009
release_version 1.47.0-SNAPSHOT~28acd37546 1.47.0-SNAPSHOT~22bc0098de
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1738621744 1738621744
ci_job_id 792320983 792320983
ci_pipeline_id 54781898 54781898
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zwes66s-project-304-concurrent-0-lvql8sxk 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zwes66s-project-304-concurrent-0-lvql8sxk 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~22bc0098de, baseline=1.47.0-SNAPSHOT~28acd37546
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.462 ms) : 1450, 1473
.   : milestone, 1462,
appsec (2.349 ms) : 2306, 2392
.   : milestone, 2349,
iast (2.103 ms) : 2048, 2158
.   : milestone, 2103,
iast_GLOBAL (2.158 ms) : 2102, 2214
.   : milestone, 2158,
profiling (1.976 ms) : 1931, 2021
.   : milestone, 1976,
tracing (1.95 ms) : 1907, 1992
.   : milestone, 1950,
section candidate
no_agent (1.468 ms) : 1457, 1480
.   : milestone, 1468,
appsec (2.376 ms) : 2332, 2419
.   : milestone, 2376,
iast (2.106 ms) : 2051, 2161
.   : milestone, 2106,
iast_GLOBAL (2.144 ms) : 2089, 2200
.   : milestone, 2144,
profiling (1.975 ms) : 1931, 2018
.   : milestone, 1975,
tracing (1.946 ms) : 1904, 1989
.   : milestone, 1946,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.462 ms [1.45 ms, 1.473 ms] -
appsec 2.349 ms [2.306 ms, 2.392 ms] 887.39 µs (60.7%)
iast 2.103 ms [2.048 ms, 2.158 ms] 641.318 µs (43.9%)
iast_GLOBAL 2.158 ms [2.102 ms, 2.214 ms] 696.434 µs (47.6%)
profiling 1.976 ms [1.931 ms, 2.021 ms] 514.363 µs (35.2%)
tracing 1.95 ms [1.907 ms, 1.992 ms] 487.958 µs (33.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.457 ms, 1.48 ms] -
appsec 2.376 ms [2.332 ms, 2.419 ms] 907.284 µs (61.8%)
iast 2.106 ms [2.051 ms, 2.161 ms] 638.098 µs (43.5%)
iast_GLOBAL 2.144 ms [2.089 ms, 2.2 ms] 676.163 µs (46.1%)
profiling 1.975 ms [1.931 ms, 2.018 ms] 506.358 µs (34.5%)
tracing 1.946 ms [1.904 ms, 1.989 ms] 478.206 µs (32.6%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~22bc0098de, baseline=1.47.0-SNAPSHOT~28acd37546
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.891 s) : 14891000, 14891000
.   : milestone, 14891000,
appsec (14.669 s) : 14669000, 14669000
.   : milestone, 14669000,
iast (18.713 s) : 18713000, 18713000
.   : milestone, 18713000,
iast_GLOBAL (17.629 s) : 17629000, 17629000
.   : milestone, 17629000,
profiling (15.629 s) : 15629000, 15629000
.   : milestone, 15629000,
tracing (15.12 s) : 15120000, 15120000
.   : milestone, 15120000,
section candidate
no_agent (14.872 s) : 14872000, 14872000
.   : milestone, 14872000,
appsec (15.214 s) : 15214000, 15214000
.   : milestone, 15214000,
iast (18.887 s) : 18887000, 18887000
.   : milestone, 18887000,
iast_GLOBAL (17.93 s) : 17930000, 17930000
.   : milestone, 17930000,
profiling (14.976 s) : 14976000, 14976000
.   : milestone, 14976000,
tracing (15.215 s) : 15215000, 15215000
.   : milestone, 15215000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.891 s [14.891 s, 14.891 s] -
appsec 14.669 s [14.669 s, 14.669 s] -222.0 ms (-1.5%)
iast 18.713 s [18.713 s, 18.713 s] 3.822 s (25.7%)
iast_GLOBAL 17.629 s [17.629 s, 17.629 s] 2.738 s (18.4%)
profiling 15.629 s [15.629 s, 15.629 s] 738.0 ms (5.0%)
tracing 15.12 s [15.12 s, 15.12 s] 229.0 ms (1.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.872 s [14.872 s, 14.872 s] -
appsec 15.214 s [15.214 s, 15.214 s] 342.0 ms (2.3%)
iast 18.887 s [18.887 s, 18.887 s] 4.015 s (27.0%)
iast_GLOBAL 17.93 s [17.93 s, 17.93 s] 3.058 s (20.6%)
profiling 14.976 s [14.976 s, 14.976 s] 104.0 ms (0.7%)
tracing 15.215 s [15.215 s, 15.215 s] 343.0 ms (2.3%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
tag: do not merge Do not merge changes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@mhlidd