Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add APPSEC_WAF_TELEMETRY to system-tests #8329

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Add APPSEC_WAF_TELEMETRY to system-tests #8329

wants to merge 1 commit into from

Conversation

Mariovido
Copy link
Contributor

@Mariovido Mariovido commented Feb 3, 2025 •
edited by jira bot
Loading

What Does This Do

This introduces a new scenario for running WAF telemetry tests within the system-tests.

Motivation

Currently, changes to WAF telemetry do not verify whether the system-tests execute correctly. We aim to prevent misalignment between the system-tests and the tracer.

Additional Notes

Contributor Checklist

Jira ticket: APPSEC-56478

@Mariovido Mariovido added type: enhancement comp: asm waf Application Security Management (WAF) labels Feb 3, 2025
@Mariovido Mariovido marked this pull request as ready for review February 3, 2025 17:34
@Mariovido Mariovido requested a review from a team as a code owner February 3, 2025 17:34
@smola smola added comp: testing Testing tag: no release notes Changes to exclude from release notes and removed type: enhancement labels Feb 3, 2025
@pr-commenter
Copy link

pr-commenter bot commented Feb 3, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mario.vidal/add_new_scenario
git_commit_date 1738600460 1738603656
git_commit_sha 5d18c24 4103ced
release_version 1.47.0-SNAPSHOT~5d18c24208 1.47.0-SNAPSHOT~4103ced691
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1738606188 1738606188
ci_job_id 791772799 791772799
ci_pipeline_id 54745058 54745058
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zwes66s-project-304-concurrent-0-nsryh0e7 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zwes66s-project-304-concurrent-0-nsryh0e7 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 11 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~4103ced691, baseline=1.47.0-SNAPSHOT~5d18c24208

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.052 s) : 0, 1052253
Total [baseline] (8.697 s) : 0, 8696932
Agent [candidate] (1.041 s) : 0, 1041488
Total [candidate] (8.641 s) : 0, 8640626
section iast
Agent [baseline] (1.181 s) : 0, 1181394
Total [baseline] (9.248 s) : 0, 9248413
Agent [candidate] (1.179 s) : 0, 1178591
Total [candidate] (9.259 s) : 0, 9259340
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.172 s) : 0, 1172179
Total [baseline] (9.201 s) : 0, 9200580
Agent [candidate] (1.18 s) : 0, 1180002
Total [candidate] (9.215 s) : 0, 9214967
section iast_TELEMETRY_OFF
Agent [baseline] (1.175 s) : 0, 1174699
Total [baseline] (9.263 s) : 0, 9262862
Agent [candidate] (1.182 s) : 0, 1182134
Total [candidate] (9.273 s) : 0, 9273211
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent iast 1.181 s 129.141 ms (12.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.172 s 119.926 ms (11.4%)
Agent iast_TELEMETRY_OFF 1.175 s 122.445 ms (11.6%)
Total tracing 8.697 s -
Total iast 9.248 s 551.481 ms (6.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.201 s 503.647 ms (5.8%)
Total iast_TELEMETRY_OFF 9.263 s 565.93 ms (6.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.041 s -
Agent iast 1.179 s 137.103 ms (13.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.18 s 138.514 ms (13.3%)
Agent iast_TELEMETRY_OFF 1.182 s 140.645 ms (13.5%)
Total tracing 8.641 s -
Total iast 9.259 s 618.714 ms (7.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.215 s 574.341 ms (6.6%)
Total iast_TELEMETRY_OFF 9.273 s 632.585 ms (7.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~4103ced691, baseline=1.47.0-SNAPSHOT~5d18c24208

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (721.133 ms) : 0, 721133
BytebuddyAgent [candidate] (715.947 ms) : 0, 715947
GlobalTracer [baseline] (245.04 ms) : 0, 245040
GlobalTracer [candidate] (243.011 ms) : 0, 243011
AppSec [baseline] (55.633 ms) : 0, 55633
AppSec [candidate] (55.024 ms) : 0, 55024
Remote Config [baseline] (730.215 µs) : 0, 730
Remote Config [candidate] (712.297 µs) : 0, 712
Telemetry [baseline] (14.427 ms) : 0, 14427
Telemetry [candidate] (11.485 ms) : 0, 11485
section iast
BytebuddyAgent [baseline] (841.038 ms) : 0, 841038
BytebuddyAgent [candidate] (839.048 ms) : 0, 839048
GlobalTracer [baseline] (235.06 ms) : 0, 235060
GlobalTracer [candidate] (235.21 ms) : 0, 235210
IAST [baseline] (23.647 ms) : 0, 23647
IAST [candidate] (25.633 ms) : 0, 25633
AppSec [baseline] (56.752 ms) : 0, 56752
AppSec [candidate] (53.842 ms) : 0, 53842
Remote Config [baseline] (629.908 µs) : 0, 630
Remote Config [candidate] (621.899 µs) : 0, 622
Telemetry [baseline] (8.804 ms) : 0, 8804
Telemetry [candidate] (8.817 ms) : 0, 8817
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (834.107 ms) : 0, 834107
BytebuddyAgent [candidate] (838.921 ms) : 0, 838921
GlobalTracer [baseline] (234.011 ms) : 0, 234011
GlobalTracer [candidate] (235.76 ms) : 0, 235760
IAST [baseline] (25.639 ms) : 0, 25639
IAST [candidate] (24.526 ms) : 0, 24526
AppSec [baseline] (53.839 ms) : 0, 53839
AppSec [candidate] (56.012 ms) : 0, 56012
Remote Config [baseline] (610.966 µs) : 0, 611
Remote Config [candidate] (626.068 µs) : 0, 626
Telemetry [baseline] (8.704 ms) : 0, 8704
Telemetry [candidate] (8.837 ms) : 0, 8837
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (835.776 ms) : 0, 835776
BytebuddyAgent [candidate] (841.88 ms) : 0, 841880
GlobalTracer [baseline] (234.773 ms) : 0, 234773
GlobalTracer [candidate] (236.361 ms) : 0, 236361
IAST [baseline] (27.179 ms) : 0, 27179
IAST [candidate] (27.226 ms) : 0, 27226
AppSec [baseline] (52.402 ms) : 0, 52402
AppSec [candidate] (52.06 ms) : 0, 52060
Remote Config [baseline] (611.801 µs) : 0, 612
Remote Config [candidate] (602.203 µs) : 0, 602
Telemetry [baseline] (8.675 ms) : 0, 8675
Telemetry [candidate] (8.537 ms) : 0, 8537
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~4103ced691, baseline=1.47.0-SNAPSHOT~5d18c24208

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.047 s) : 0, 1047063
Total [baseline] (10.411 s) : 0, 10411191
Agent [candidate] (1.047 s) : 0, 1047101
Total [candidate] (10.458 s) : 0, 10457588
section appsec
Agent [baseline] (1.182 s) : 0, 1182233
Total [baseline] (10.77 s) : 0, 10770414
Agent [candidate] (1.19 s) : 0, 1190131
Total [candidate] (10.782 s) : 0, 10782230
section iast
Agent [baseline] (1.17 s) : 0, 1170010
Total [baseline] (10.971 s) : 0, 10971100
Agent [candidate] (1.174 s) : 0, 1174194
Total [candidate] (11.021 s) : 0, 11020886
section profiling
Agent [baseline] (1.263 s) : 0, 1262951
Total [baseline] (10.84 s) : 0, 10840325
Agent [candidate] (1.268 s) : 0, 1268375
Total [candidate] (10.899 s) : 0, 10899325
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent appsec 1.182 s 135.17 ms (12.9%)
Agent iast 1.17 s 122.947 ms (11.7%)
Agent profiling 1.263 s 215.888 ms (20.6%)
Total tracing 10.411 s -
Total appsec 10.77 s 359.224 ms (3.5%)
Total iast 10.971 s 559.909 ms (5.4%)
Total profiling 10.84 s 429.135 ms (4.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent appsec 1.19 s 143.03 ms (13.7%)
Agent iast 1.174 s 127.093 ms (12.1%)
Agent profiling 1.268 s 221.274 ms (21.1%)
Total tracing 10.458 s -
Total appsec 10.782 s 324.641 ms (3.1%)
Total iast 11.021 s 563.297 ms (5.4%)
Total profiling 10.899 s 441.736 ms (4.2%) 
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~4103ced691, baseline=1.47.0-SNAPSHOT~5d18c24208

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (719.19 ms) : 0, 719190
BytebuddyAgent [candidate] (719.823 ms) : 0, 719823
GlobalTracer [baseline] (244.21 ms) : 0, 244210
GlobalTracer [candidate] (244.23 ms) : 0, 244230
AppSec [baseline] (55.449 ms) : 0, 55449
AppSec [candidate] (56.138 ms) : 0, 56138
Remote Config [baseline] (719.14 µs) : 0, 719
Remote Config [candidate] (719.115 µs) : 0, 719
Telemetry [baseline] (12.158 ms) : 0, 12158
Telemetry [candidate] (10.825 ms) : 0, 10825
section appsec
BytebuddyAgent [baseline] (731.515 ms) : 0, 731515
BytebuddyAgent [candidate] (737.655 ms) : 0, 737655
GlobalTracer [baseline] (240.275 ms) : 0, 240275
GlobalTracer [candidate] (241.811 ms) : 0, 241811
IAST [baseline] (21.459 ms) : 0, 21459
IAST [candidate] (21.774 ms) : 0, 21774
AppSec [baseline] (175.533 ms) : 0, 175533
AppSec [candidate] (175.467 ms) : 0, 175467
Remote Config [baseline] (657.049 µs) : 0, 657
Remote Config [candidate] (658.449 µs) : 0, 658
Telemetry [baseline] (8.28 ms) : 0, 8280
Telemetry [candidate] (8.342 ms) : 0, 8342
section iast
BytebuddyAgent [baseline] (831.74 ms) : 0, 831740
BytebuddyAgent [candidate] (835.413 ms) : 0, 835413
GlobalTracer [baseline] (233.67 ms) : 0, 233670
GlobalTracer [candidate] (234.564 ms) : 0, 234564
IAST [baseline] (25.028 ms) : 0, 25028
IAST [candidate] (24.209 ms) : 0, 24209
AppSec [baseline] (54.928 ms) : 0, 54928
AppSec [candidate] (55.427 ms) : 0, 55427
Remote Config [baseline] (632.793 µs) : 0, 633
Remote Config [candidate] (612.084 µs) : 0, 612
Telemetry [baseline] (8.728 ms) : 0, 8728
Telemetry [candidate] (8.62 ms) : 0, 8620
section profiling
BytebuddyAgent [baseline] (706.593 ms) : 0, 706593
BytebuddyAgent [candidate] (711.721 ms) : 0, 711721
GlobalTracer [baseline] (353.927 ms) : 0, 353927
GlobalTracer [candidate] (354.755 ms) : 0, 354755
AppSec [baseline] (55.079 ms) : 0, 55079
AppSec [candidate] (54.288 ms) : 0, 54288
Remote Config [baseline] (690.621 µs) : 0, 691
Remote Config [candidate] (705.319 µs) : 0, 705
Telemetry [baseline] (8.857 ms) : 0, 8857
Telemetry [candidate] (8.886 ms) : 0, 8886
ProfilingAgent [baseline] (95.56 ms) : 0, 95560
ProfilingAgent [candidate] (95.413 ms) : 0, 95413
Profiling [baseline] (95.585 ms) : 0, 95585
Profiling [candidate] (95.438 ms) : 0, 95438
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-02-03T17:39:44 2025-02-03T17:46:48
git_branch master mario.vidal/add_new_scenario
git_commit_date 1738600460 1738603656
git_commit_sha 5d18c24 4103ced
release_version 1.47.0-SNAPSHOT~5d18c24208 1.47.0-SNAPSHOT~4103ced691
start_time 2025-02-03T17:39:31 2025-02-03T17:46:35
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1738605166 1738605166
ci_job_id 791772800 791772800
ci_pipeline_id 54745058 54745058
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zwes66s-project-304-concurrent-1-y6ocr1tx 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zwes66s-project-304-concurrent-1-y6ocr1tx 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~4103ced691, baseline=1.47.0-SNAPSHOT~5d18c24208
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.355 ms) : 1336, 1375
.   : milestone, 1355,
appsec (1.743 ms) : 1718, 1767
.   : milestone, 1743,
appsec_no_iast (1.766 ms) : 1742, 1790
.   : milestone, 1766,
iast (1.5 ms) : 1476, 1524
.   : milestone, 1500,
profiling (1.555 ms) : 1530, 1580
.   : milestone, 1555,
tracing (1.482 ms) : 1457, 1506
.   : milestone, 1482,
section candidate
no_agent (1.322 ms) : 1303, 1342
.   : milestone, 1322,
appsec (1.741 ms) : 1718, 1765
.   : milestone, 1741,
appsec_no_iast (1.76 ms) : 1732, 1788
.   : milestone, 1760,
iast (1.502 ms) : 1477, 1527
.   : milestone, 1502,
profiling (1.55 ms) : 1525, 1575
.   : milestone, 1550,
tracing (1.485 ms) : 1459, 1510
.   : milestone, 1485,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.355 ms [1.336 ms, 1.375 ms] -
appsec 1.743 ms [1.718 ms, 1.767 ms] 387.194 µs (28.6%)
appsec_no_iast 1.766 ms [1.742 ms, 1.79 ms] 410.611 µs (30.3%)
iast 1.5 ms [1.476 ms, 1.524 ms] 144.759 µs (10.7%)
profiling 1.555 ms [1.53 ms, 1.58 ms] 199.91 µs (14.7%)
tracing 1.482 ms [1.457 ms, 1.506 ms] 126.342 µs (9.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.322 ms [1.303 ms, 1.342 ms] -
appsec 1.741 ms [1.718 ms, 1.765 ms] 418.756 µs (31.7%)
appsec_no_iast 1.76 ms [1.732 ms, 1.788 ms] 437.402 µs (33.1%)
iast 1.502 ms [1.477 ms, 1.527 ms] 179.54 µs (13.6%)
profiling 1.55 ms [1.525 ms, 1.575 ms] 227.862 µs (17.2%)
tracing 1.485 ms [1.459 ms, 1.51 ms] 162.198 µs (12.3%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~4103ced691, baseline=1.47.0-SNAPSHOT~5d18c24208
    dateFormat X
    axisFormat %s
section baseline
no_agent (378.735 µs) : 359, 398
.   : milestone, 379,
iast (506.151 µs) : 484, 528
.   : milestone, 506,
iast_FULL (741.24 µs) : 719, 763
.   : milestone, 741,
iast_GLOBAL (546.628 µs) : 525, 568
.   : milestone, 547,
iast_HARDCODED_SECRET_DISABLED (499.566 µs) : 478, 521
.   : milestone, 500,
iast_INACTIVE (457.218 µs) : 436, 479
.   : milestone, 457,
iast_TELEMETRY_OFF (493.694 µs) : 471, 516
.   : milestone, 494,
tracing (457.619 µs) : 436, 480
.   : milestone, 458,
section candidate
no_agent (374.088 µs) : 355, 394
.   : milestone, 374,
iast (504.108 µs) : 482, 526
.   : milestone, 504,
iast_FULL (737.873 µs) : 716, 760
.   : milestone, 738,
iast_GLOBAL (552.982 µs) : 532, 574
.   : milestone, 553,
iast_HARDCODED_SECRET_DISABLED (507.967 µs) : 485, 531
.   : milestone, 508,
iast_INACTIVE (457.907 µs) : 436, 479
.   : milestone, 458,
iast_TELEMETRY_OFF (497.945 µs) : 473, 522
.   : milestone, 498,
tracing (457.197 µs) : 435, 479
.   : milestone, 457,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 378.735 µs [358.974 µs, 398.495 µs] -
iast 506.151 µs [484.48 µs, 527.821 µs] 127.416 µs (33.6%)
iast_FULL 741.24 µs [719.241 µs, 763.24 µs] 362.506 µs (95.7%)
iast_GLOBAL 546.628 µs [525.258 µs, 567.999 µs] 167.894 µs (44.3%)
iast_HARDCODED_SECRET_DISABLED 499.566 µs [477.983 µs, 521.149 µs] 120.831 µs (31.9%)
iast_INACTIVE 457.218 µs [435.828 µs, 478.608 µs] 78.483 µs (20.7%)
iast_TELEMETRY_OFF 493.694 µs [471.247 µs, 516.14 µs] 114.959 µs (30.4%)
tracing 457.619 µs [435.739 µs, 479.5 µs] 78.885 µs (20.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 374.088 µs [354.53 µs, 393.646 µs] -
iast 504.108 µs [481.927 µs, 526.288 µs] 130.02 µs (34.8%)
iast_FULL 737.873 µs [716.093 µs, 759.652 µs] 363.785 µs (97.2%)
iast_GLOBAL 552.982 µs [531.586 µs, 574.378 µs] 178.894 µs (47.8%)
iast_HARDCODED_SECRET_DISABLED 507.967 µs [485.342 µs, 530.592 µs] 133.879 µs (35.8%)
iast_INACTIVE 457.907 µs [436.372 µs, 479.442 µs] 83.819 µs (22.4%)
iast_TELEMETRY_OFF 497.945 µs [473.495 µs, 522.395 µs] 123.857 µs (33.1%)
tracing 457.197 µs [435.019 µs, 479.374 µs] 83.109 µs (22.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mario.vidal/add_new_scenario
git_commit_date 1738600460 1738603656
git_commit_sha 5d18c24 4103ced
release_version 1.47.0-SNAPSHOT~5d18c24208 1.47.0-SNAPSHOT~4103ced691
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1738605755 1738605755
ci_job_id 791772801 791772801
ci_pipeline_id 54745058 54745058
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zwes66s-project-304-concurrent-2-n0204moz 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zwes66s-project-304-concurrent-2-n0204moz 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~4103ced691, baseline=1.47.0-SNAPSHOT~5d18c24208
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.469 s) : 15469000, 15469000
.   : milestone, 15469000,
appsec (14.968 s) : 14968000, 14968000
.   : milestone, 14968000,
iast (18.379 s) : 18379000, 18379000
.   : milestone, 18379000,
iast_GLOBAL (18.313 s) : 18313000, 18313000
.   : milestone, 18313000,
profiling (15.165 s) : 15165000, 15165000
.   : milestone, 15165000,
tracing (14.828 s) : 14828000, 14828000
.   : milestone, 14828000,
section candidate
no_agent (15.089 s) : 15089000, 15089000
.   : milestone, 15089000,
appsec (15.056 s) : 15056000, 15056000
.   : milestone, 15056000,
iast (19.015 s) : 19015000, 19015000
.   : milestone, 19015000,
iast_GLOBAL (18.34 s) : 18340000, 18340000
.   : milestone, 18340000,
profiling (15.618 s) : 15618000, 15618000
.   : milestone, 15618000,
tracing (14.742 s) : 14742000, 14742000
.   : milestone, 14742000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.469 s [15.469 s, 15.469 s] -
appsec 14.968 s [14.968 s, 14.968 s] -501.0 ms (-3.2%)
iast 18.379 s [18.379 s, 18.379 s] 2.91 s (18.8%)
iast_GLOBAL 18.313 s [18.313 s, 18.313 s] 2.844 s (18.4%)
profiling 15.165 s [15.165 s, 15.165 s] -304.0 ms (-2.0%)
tracing 14.828 s [14.828 s, 14.828 s] -641.0 ms (-4.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.089 s [15.089 s, 15.089 s] -
appsec 15.056 s [15.056 s, 15.056 s] -33.0 ms (-0.2%)
iast 19.015 s [19.015 s, 19.015 s] 3.926 s (26.0%)
iast_GLOBAL 18.34 s [18.34 s, 18.34 s] 3.251 s (21.5%)
profiling 15.618 s [15.618 s, 15.618 s] 529.0 ms (3.5%)
tracing 14.742 s [14.742 s, 14.742 s] -347.0 ms (-2.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~4103ced691, baseline=1.47.0-SNAPSHOT~5d18c24208
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.468 ms) : 1456, 1480
.   : milestone, 1468,
appsec (2.361 ms) : 2317, 2404
.   : milestone, 2361,
iast (2.107 ms) : 2052, 2161
.   : milestone, 2107,
iast_GLOBAL (2.145 ms) : 2091, 2200
.   : milestone, 2145,
profiling (1.952 ms) : 1909, 1995
.   : milestone, 1952,
tracing (1.941 ms) : 1899, 1983
.   : milestone, 1941,
section candidate
no_agent (1.467 ms) : 1456, 1479
.   : milestone, 1467,
appsec (2.35 ms) : 2307, 2394
.   : milestone, 2350,
iast (2.11 ms) : 2055, 2165
.   : milestone, 2110,
iast_GLOBAL (2.144 ms) : 2089, 2199
.   : milestone, 2144,
profiling (2.464 ms) : 2274, 2653
.   : milestone, 2464,
tracing (1.939 ms) : 1897, 1981
.   : milestone, 1939,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.456 ms, 1.48 ms] -
appsec 2.361 ms [2.317 ms, 2.404 ms] 892.625 µs (60.8%)
iast 2.107 ms [2.052 ms, 2.161 ms] 638.536 µs (43.5%)
iast_GLOBAL 2.145 ms [2.091 ms, 2.2 ms] 677.2 µs (46.1%)
profiling 1.952 ms [1.909 ms, 1.995 ms] 483.757 µs (33.0%)
tracing 1.941 ms [1.899 ms, 1.983 ms] 473.066 µs (32.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.467 ms [1.456 ms, 1.479 ms] -
appsec 2.35 ms [2.307 ms, 2.394 ms] 883.067 µs (60.2%)
iast 2.11 ms [2.055 ms, 2.165 ms] 642.854 µs (43.8%)
iast_GLOBAL 2.144 ms [2.089 ms, 2.199 ms] 676.722 µs (46.1%)
profiling 2.464 ms [2.274 ms, 2.653 ms] 996.354 µs (67.9%)
tracing 1.939 ms [1.897 ms, 1.981 ms] 472.002 µs (32.2%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@smola smola smola approved these changes

@manuel-alvarez-alvarez manuel-alvarez-alvarez Awaiting requested review from manuel-alvarez-alvarez manuel-alvarez-alvarez is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: asm waf Application Security Management (WAF) comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@Mariovido @smola