Smoke test for the Ebean ORM #7594

Mariovido · 2024-09-10T13:16:04Z

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Squash your commits prior merging or merge using GitHub's Squash and merge
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: APPSEC-54675

pr-commenter · 2024-09-10T16:04:24Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mario.vidal/ebean_check
git_commit_date	1727691229	1727692661
git_commit_sha	`70ac474`	`e5d0c51`
release_version	1.40.0-SNAPSHOT~70ac474684	1.40.0-SNAPSHOT~e5d0c51427

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1727700695	1727700695
ci_job_id	655404546	655404546
ci_pipeline_id	45403195	45403195
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 11 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~e5d0c51427, baseline=1.40.0-SNAPSHOT~70ac474684

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.071 s) : 0, 1070969
Total [baseline] (10.431 s) : 0, 10431149
Agent [candidate] (1.068 s) : 0, 1068239
Total [candidate] (10.395 s) : 0, 10395251
section appsec
Agent [baseline] (1.203 s) : 0, 1203260
Total [baseline] (10.593 s) : 0, 10592915
Agent [candidate] (1.206 s) : 0, 1205517
Total [candidate] (10.589 s) : 0, 10589118
section iast
Agent [baseline] (1.197 s) : 0, 1197069
Total [baseline] (10.907 s) : 0, 10906798
Agent [candidate] (1.197 s) : 0, 1196608
Total [candidate] (10.859 s) : 0, 10858780
section profiling
Agent [baseline] (1.264 s) : 0, 1264372
Total [baseline] (10.548 s) : 0, 10547842
Agent [candidate] (1.267 s) : 0, 1267499
Total [candidate] (10.613 s) : 0, 10612556

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.071 s	-
Agent	appsec	1.203 s	132.291 ms (12.4%)
Agent	iast	1.197 s	126.1 ms (11.8%)
Agent	profiling	1.264 s	193.403 ms (18.1%)
Total	tracing	10.431 s	-
Total	appsec	10.593 s	161.765 ms (1.6%)
Total	iast	10.907 s	475.648 ms (4.6%)
Total	profiling	10.548 s	116.693 ms (1.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.068 s	-
Agent	appsec	1.206 s	137.278 ms (12.9%)
Agent	iast	1.197 s	128.369 ms (12.0%)
Agent	profiling	1.267 s	199.26 ms (18.7%)
Total	tracing	10.395 s	-
Total	appsec	10.589 s	193.867 ms (1.9%)
Total	iast	10.859 s	463.529 ms (4.5%)
Total	profiling	10.613 s	217.305 ms (2.1%)

gantt
    title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~e5d0c51427, baseline=1.40.0-SNAPSHOT~70ac474684

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (683.664 ms) : 0, 683664
BytebuddyAgent [candidate] (681.758 ms) : 0, 681758
GlobalTracer [baseline] (311.111 ms) : 0, 311111
GlobalTracer [candidate] (310.567 ms) : 0, 310567
AppSec [baseline] (54.131 ms) : 0, 54131
AppSec [candidate] (53.96 ms) : 0, 53960
Remote Config [baseline] (667.736 µs) : 0, 668
Remote Config [candidate] (659.414 µs) : 0, 659
Telemetry [baseline] (7.671 ms) : 0, 7671
Telemetry [candidate] (7.584 ms) : 0, 7584
section appsec
BytebuddyAgent [baseline] (699.149 ms) : 0, 699149
BytebuddyAgent [candidate] (700.108 ms) : 0, 700108
GlobalTracer [baseline] (307.006 ms) : 0, 307006
GlobalTracer [candidate] (308.014 ms) : 0, 308014
AppSec [baseline] (163.091 ms) : 0, 163091
AppSec [candidate] (163.313 ms) : 0, 163313
Remote Config [baseline] (635.485 µs) : 0, 635
Remote Config [candidate] (636.763 µs) : 0, 637
Telemetry [baseline] (8.879 ms) : 0, 8879
Telemetry [candidate] (8.887 ms) : 0, 8887
IAST [baseline] (21.582 ms) : 0, 21582
IAST [candidate] (21.648 ms) : 0, 21648
section iast
BytebuddyAgent [baseline] (797.315 ms) : 0, 797315
BytebuddyAgent [candidate] (795.938 ms) : 0, 795938
GlobalTracer [baseline] (300.089 ms) : 0, 300089
GlobalTracer [candidate] (300.105 ms) : 0, 300105
AppSec [baseline] (55.284 ms) : 0, 55284
AppSec [candidate] (54.204 ms) : 0, 54204
Remote Config [baseline] (640.153 µs) : 0, 640
Remote Config [candidate] (624.707 µs) : 0, 625
Telemetry [baseline] (7.048 ms) : 0, 7048
Telemetry [candidate] (7.107 ms) : 0, 7107
IAST [baseline] (22.928 ms) : 0, 22928
IAST [candidate] (24.887 ms) : 0, 24887
section profiling
BytebuddyAgent [baseline] (674.198 ms) : 0, 674198
BytebuddyAgent [candidate] (675.468 ms) : 0, 675468
GlobalTracer [baseline] (392.344 ms) : 0, 392344
GlobalTracer [candidate] (393.508 ms) : 0, 393508
AppSec [baseline] (54.542 ms) : 0, 54542
AppSec [candidate] (54.727 ms) : 0, 54727
Remote Config [baseline] (646.845 µs) : 0, 647
Remote Config [candidate] (649.847 µs) : 0, 650
Telemetry [baseline] (7.441 ms) : 0, 7441
Telemetry [candidate] (7.484 ms) : 0, 7484
ProfilingAgent [baseline] (96.521 ms) : 0, 96521
ProfilingAgent [candidate] (96.954 ms) : 0, 96954
Profiling [baseline] (96.545 ms) : 0, 96545
Profiling [candidate] (96.977 ms) : 0, 96977

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~e5d0c51427, baseline=1.40.0-SNAPSHOT~70ac474684

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.08 s) : 0, 1080409
Total [baseline] (8.62 s) : 0, 8619858
Agent [candidate] (1.067 s) : 0, 1067050
Total [candidate] (8.52 s) : 0, 8519602
section iast
Agent [baseline] (1.191 s) : 0, 1191412
Total [baseline] (9.04 s) : 0, 9039748
Agent [candidate] (1.193 s) : 0, 1193198
Total [candidate] (9.062 s) : 0, 9062205
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.193 s) : 0, 1193276
Total [baseline] (9.092 s) : 0, 9091608
Agent [candidate] (1.197 s) : 0, 1196671
Total [candidate] (9.057 s) : 0, 9056738
section iast_TELEMETRY_OFF
Agent [baseline] (1.199 s) : 0, 1199086
Total [baseline] (9.102 s) : 0, 9101950
Agent [candidate] (1.192 s) : 0, 1192402
Total [candidate] (9.09 s) : 0, 9090051

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.08 s	-
Agent	iast	1.191 s	111.003 ms (10.3%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.193 s	112.867 ms (10.4%)
Agent	iast_TELEMETRY_OFF	1.199 s	118.678 ms (11.0%)
Total	tracing	8.62 s	-
Total	iast	9.04 s	419.889 ms (4.9%)
Total	iast_HARDCODED_SECRET_DISABLED	9.092 s	471.749 ms (5.5%)
Total	iast_TELEMETRY_OFF	9.102 s	482.091 ms (5.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.067 s	-
Agent	iast	1.193 s	126.148 ms (11.8%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.197 s	129.621 ms (12.1%)
Agent	iast_TELEMETRY_OFF	1.192 s	125.352 ms (11.7%)
Total	tracing	8.52 s	-
Total	iast	9.062 s	542.603 ms (6.4%)
Total	iast_HARDCODED_SECRET_DISABLED	9.057 s	537.136 ms (6.3%)
Total	iast_TELEMETRY_OFF	9.09 s	570.449 ms (6.7%)

gantt
    title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~e5d0c51427, baseline=1.40.0-SNAPSHOT~70ac474684

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (691.702 ms) : 0, 691702
BytebuddyAgent [candidate] (681.433 ms) : 0, 681433
GlobalTracer [baseline] (312.363 ms) : 0, 312363
GlobalTracer [candidate] (309.59 ms) : 0, 309590
AppSec [baseline] (54.059 ms) : 0, 54059
AppSec [candidate] (54.001 ms) : 0, 54001
Remote Config [baseline] (669.228 µs) : 0, 669
Remote Config [candidate] (655.766 µs) : 0, 656
Telemetry [baseline] (7.756 ms) : 0, 7756
Telemetry [candidate] (7.668 ms) : 0, 7668
section iast
BytebuddyAgent [baseline] (793.509 ms) : 0, 793509
BytebuddyAgent [candidate] (794.373 ms) : 0, 794373
GlobalTracer [baseline] (298.386 ms) : 0, 298386
GlobalTracer [candidate] (299.301 ms) : 0, 299301
AppSec [baseline] (53.764 ms) : 0, 53764
AppSec [candidate] (54.569 ms) : 0, 54569
IAST [baseline] (24.478 ms) : 0, 24478
IAST [candidate] (23.601 ms) : 0, 23601
Remote Config [baseline] (619.55 µs) : 0, 620
Remote Config [candidate] (619.827 µs) : 0, 620
Telemetry [baseline] (6.99 ms) : 0, 6990
Telemetry [candidate] (6.989 ms) : 0, 6989
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (794.774 ms) : 0, 794774
BytebuddyAgent [candidate] (796.027 ms) : 0, 796027
GlobalTracer [baseline] (298.824 ms) : 0, 298824
GlobalTracer [candidate] (300.446 ms) : 0, 300446
AppSec [baseline] (54.525 ms) : 0, 54525
AppSec [candidate] (54.182 ms) : 0, 54182
IAST [baseline] (23.678 ms) : 0, 23678
IAST [candidate] (24.545 ms) : 0, 24545
Remote Config [baseline] (621.13 µs) : 0, 621
Remote Config [candidate] (605.465 µs) : 0, 605
Telemetry [baseline] (7.105 ms) : 0, 7105
Telemetry [candidate] (7.038 ms) : 0, 7038
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (797.906 ms) : 0, 797906
BytebuddyAgent [candidate] (792.897 ms) : 0, 792897
GlobalTracer [baseline] (301.352 ms) : 0, 301352
GlobalTracer [candidate] (299.922 ms) : 0, 299922
AppSec [baseline] (55.646 ms) : 0, 55646
AppSec [candidate] (54.225 ms) : 0, 54225
IAST [baseline] (22.675 ms) : 0, 22675
IAST [candidate] (24.081 ms) : 0, 24081
Remote Config [baseline] (618.612 µs) : 0, 619
Remote Config [candidate] (620.291 µs) : 0, 620
Telemetry [baseline] (6.999 ms) : 0, 6999
Telemetry [candidate] (6.876 ms) : 0, 6876

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2024-09-30T12:19:27	2024-09-30T12:26:20
git_branch	master	mario.vidal/ebean_check
git_commit_date	1727691229	1727692661
git_commit_sha	`70ac474`	`e5d0c51`
release_version	1.40.0-SNAPSHOT~70ac474684	1.40.0-SNAPSHOT~e5d0c51427
start_time	2024-09-30T12:19:14	2024-09-30T12:26:06

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1727699528	1727699528
ci_job_id	655404556	655404556
ci_pipeline_id	45403195	45403195
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~e5d0c51427, baseline=1.40.0-SNAPSHOT~70ac474684
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.338 ms) : 1319, 1357
.   : milestone, 1338,
appsec (1.745 ms) : 1721, 1769
.   : milestone, 1745,
appsec_no_iast (1.736 ms) : 1713, 1760
.   : milestone, 1736,
iast (1.474 ms) : 1452, 1496
.   : milestone, 1474,
profiling (1.523 ms) : 1497, 1548
.   : milestone, 1523,
tracing (1.479 ms) : 1455, 1503
.   : milestone, 1479,
section candidate
no_agent (1.342 ms) : 1322, 1361
.   : milestone, 1342,
appsec (1.726 ms) : 1702, 1750
.   : milestone, 1726,
appsec_no_iast (1.727 ms) : 1703, 1751
.   : milestone, 1727,
iast (1.486 ms) : 1464, 1508
.   : milestone, 1486,
profiling (1.561 ms) : 1535, 1587
.   : milestone, 1561,
tracing (1.47 ms) : 1445, 1494
.   : milestone, 1470,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.338 ms [1.319 ms, 1.357 ms]	-
appsec	1.745 ms [1.721 ms, 1.769 ms]	407.156 µs (30.4%)
appsec_no_iast	1.736 ms [1.713 ms, 1.76 ms]	398.531 µs (29.8%)
iast	1.474 ms [1.452 ms, 1.496 ms]	136.03 µs (10.2%)
profiling	1.523 ms [1.497 ms, 1.548 ms]	184.941 µs (13.8%)
tracing	1.479 ms [1.455 ms, 1.503 ms]	141.033 µs (10.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.342 ms [1.322 ms, 1.361 ms]	-
appsec	1.726 ms [1.702 ms, 1.75 ms]	384.017 µs (28.6%)
appsec_no_iast	1.727 ms [1.703 ms, 1.751 ms]	385.516 µs (28.7%)
iast	1.486 ms [1.464 ms, 1.508 ms]	144.343 µs (10.8%)
profiling	1.561 ms [1.535 ms, 1.587 ms]	219.545 µs (16.4%)
tracing	1.47 ms [1.445 ms, 1.494 ms]	127.991 µs (9.5%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~e5d0c51427, baseline=1.40.0-SNAPSHOT~70ac474684
    dateFormat X
    axisFormat %s
section baseline
no_agent (372.623 µs) : 352, 393
.   : milestone, 373,
iast (490.693 µs) : 469, 513
.   : milestone, 491,
iast_FULL (551.073 µs) : 530, 572
.   : milestone, 551,
iast_GLOBAL (508.476 µs) : 487, 530
.   : milestone, 508,
iast_HARDCODED_SECRET_DISABLED (488.918 µs) : 468, 510
.   : milestone, 489,
iast_INACTIVE (450.39 µs) : 429, 472
.   : milestone, 450,
iast_TELEMETRY_OFF (480.052 µs) : 459, 501
.   : milestone, 480,
tracing (445.288 µs) : 424, 467
.   : milestone, 445,
section candidate
no_agent (368.638 µs) : 349, 388
.   : milestone, 369,
iast (486.856 µs) : 465, 508
.   : milestone, 487,
iast_FULL (555.96 µs) : 535, 577
.   : milestone, 556,
iast_GLOBAL (514.569 µs) : 492, 537
.   : milestone, 515,
iast_HARDCODED_SECRET_DISABLED (484.405 µs) : 463, 505
.   : milestone, 484,
iast_INACTIVE (453.156 µs) : 432, 475
.   : milestone, 453,
iast_TELEMETRY_OFF (476.338 µs) : 455, 498
.   : milestone, 476,
tracing (442.876 µs) : 422, 464
.   : milestone, 443,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	372.623 µs [351.881 µs, 393.365 µs]	-
iast	490.693 µs [468.858 µs, 512.528 µs]	118.07 µs (31.7%)
iast_FULL	551.073 µs [529.895 µs, 572.252 µs]	178.45 µs (47.9%)
iast_GLOBAL	508.476 µs [487.306 µs, 529.647 µs]	135.853 µs (36.5%)
iast_HARDCODED_SECRET_DISABLED	488.918 µs [467.548 µs, 510.289 µs]	116.295 µs (31.2%)
iast_INACTIVE	450.39 µs [429.144 µs, 471.635 µs]	77.766 µs (20.9%)
iast_TELEMETRY_OFF	480.052 µs [458.964 µs, 501.139 µs]	107.428 µs (28.8%)
tracing	445.288 µs [424.029 µs, 466.546 µs]	72.665 µs (19.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	368.638 µs [348.783 µs, 388.493 µs]	-
iast	486.856 µs [465.455 µs, 508.256 µs]	118.218 µs (32.1%)
iast_FULL	555.96 µs [534.782 µs, 577.137 µs]	187.322 µs (50.8%)
iast_GLOBAL	514.569 µs [492.066 µs, 537.073 µs]	145.932 µs (39.6%)
iast_HARDCODED_SECRET_DISABLED	484.405 µs [463.374 µs, 505.437 µs]	115.767 µs (31.4%)
iast_INACTIVE	453.156 µs [431.598 µs, 474.715 µs]	84.519 µs (22.9%)
iast_TELEMETRY_OFF	476.338 µs [455.077 µs, 497.599 µs]	107.7 µs (29.2%)
tracing	442.876 µs [422.24 µs, 463.511 µs]	74.238 µs (20.1%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mario.vidal/ebean_check
git_commit_date	1727691229	1727692661
git_commit_sha	`70ac474`	`e5d0c51`
release_version	1.40.0-SNAPSHOT~70ac474684	1.40.0-SNAPSHOT~e5d0c51427

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1727694849	1727694849
ci_job_id	655309171	655309171
ci_pipeline_id	45403195	45403195
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~e5d0c51427, baseline=1.40.0-SNAPSHOT~70ac474684
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1458, 1481
.   : milestone, 1469,
appsec (2.313 ms) : 2272, 2353
.   : milestone, 2313,
iast (2.082 ms) : 2030, 2134
.   : milestone, 2082,
iast_GLOBAL (2.108 ms) : 2056, 2159
.   : milestone, 2108,
profiling (1.946 ms) : 1904, 1987
.   : milestone, 1946,
tracing (1.91 ms) : 1871, 1949
.   : milestone, 1910,
section candidate
no_agent (1.467 ms) : 1456, 1479
.   : milestone, 1467,
appsec (2.332 ms) : 2292, 2373
.   : milestone, 2332,
iast (2.072 ms) : 2020, 2123
.   : milestone, 2072,
iast_GLOBAL (2.118 ms) : 2066, 2169
.   : milestone, 2118,
profiling (1.942 ms) : 1901, 1983
.   : milestone, 1942,
tracing (1.909 ms) : 1871, 1948
.   : milestone, 1909,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.469 ms [1.458 ms, 1.481 ms]	-
appsec	2.313 ms [2.272 ms, 2.353 ms]	843.342 µs (57.4%)
iast	2.082 ms [2.03 ms, 2.134 ms]	612.547 µs (41.7%)
iast_GLOBAL	2.108 ms [2.056 ms, 2.159 ms]	638.14 µs (43.4%)
profiling	1.946 ms [1.904 ms, 1.987 ms]	476.373 µs (32.4%)
tracing	1.91 ms [1.871 ms, 1.949 ms]	440.38 µs (30.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.467 ms [1.456 ms, 1.479 ms]	-
appsec	2.332 ms [2.292 ms, 2.373 ms]	865.315 µs (59.0%)
iast	2.072 ms [2.02 ms, 2.123 ms]	604.666 µs (41.2%)
iast_GLOBAL	2.118 ms [2.066 ms, 2.169 ms]	650.427 µs (44.3%)
profiling	1.942 ms [1.901 ms, 1.983 ms]	475.28 µs (32.4%)
tracing	1.909 ms [1.871 ms, 1.948 ms]	442.042 µs (30.1%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~e5d0c51427, baseline=1.40.0-SNAPSHOT~70ac474684
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.107 s) : 15107000, 15107000
.   : milestone, 15107000,
appsec (15.065 s) : 15065000, 15065000
.   : milestone, 15065000,
iast (18.804 s) : 18804000, 18804000
.   : milestone, 18804000,
iast_GLOBAL (18.09 s) : 18090000, 18090000
.   : milestone, 18090000,
profiling (15.205 s) : 15205000, 15205000
.   : milestone, 15205000,
tracing (15.416 s) : 15416000, 15416000
.   : milestone, 15416000,
section candidate
no_agent (15.175 s) : 15175000, 15175000
.   : milestone, 15175000,
appsec (15.281 s) : 15281000, 15281000
.   : milestone, 15281000,
iast (18.79 s) : 18790000, 18790000
.   : milestone, 18790000,
iast_GLOBAL (17.885 s) : 17885000, 17885000
.   : milestone, 17885000,
profiling (15.959 s) : 15959000, 15959000
.   : milestone, 15959000,
tracing (15.631 s) : 15631000, 15631000
.   : milestone, 15631000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.107 s [15.107 s, 15.107 s]	-
appsec	15.065 s [15.065 s, 15.065 s]	-42.0 ms (-0.3%)
iast	18.804 s [18.804 s, 18.804 s]	3.697 s (24.5%)
iast_GLOBAL	18.09 s [18.09 s, 18.09 s]	2.983 s (19.7%)
profiling	15.205 s [15.205 s, 15.205 s]	98.0 ms (0.6%)
tracing	15.416 s [15.416 s, 15.416 s]	309.0 ms (2.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.175 s [15.175 s, 15.175 s]	-
appsec	15.281 s [15.281 s, 15.281 s]	106.0 ms (0.7%)
iast	18.79 s [18.79 s, 18.79 s]	3.615 s (23.8%)
iast_GLOBAL	17.885 s [17.885 s, 17.885 s]	2.71 s (17.9%)
profiling	15.959 s [15.959 s, 15.959 s]	784.0 ms (5.2%)
tracing	15.631 s [15.631 s, 15.631 s]	456.0 ms (3.0%)

pr-commenter · 2024-09-11T09:40:14Z

Kafka / producer-benchmark

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mario.vidal/ebean_check
git_commit_date	1725526572	1726125387
git_commit_sha	`7497a93`	`f5b5636`

See matching parameters

	Baseline	Candidate
ci_job_date	1726126490	1726126490
ci_job_id	636562320	636562320
ci_pipeline_id	44149378	44149378
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion	11.0.21	11.0.21
jmhVersion	1.36	1.36
jvm	/usr/lib/jvm/java-11-openjdk-amd64/bin/java	/usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName	OpenJDK 64-Bit Server VM	OpenJDK 64-Bit Server VM
vmVersion	11.0.21+9-post-Ubuntu-0ubuntu122.04	11.0.21+9-post-Ubuntu-0ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results

scenario	Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce	same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce	same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce	same

pr-commenter · 2024-09-11T09:53:25Z

Kafka / consumer-benchmark

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mario.vidal/ebean_check
git_commit_date	1725526572	1726125387
git_commit_sha	`7497a93`	`f5b5636`

See matching parameters

	Baseline	Candidate
ci_job_date	1726126540	1726126540
ci_job_id	636562321	636562321
ci_pipeline_id	44149378	44149378
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion	11.0.21	11.0.21
jmhVersion	1.36	1.36
jvm	/usr/lib/jvm/java-11-openjdk-amd64/bin/java	/usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName	OpenJDK 64-Bit Server VM	OpenJDK 64-Bit Server VM
vmVersion	11.0.21+9-post-Ubuntu-0ubuntu122.04	11.0.21+9-post-Ubuntu-0ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results

scenario	Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume	same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume	same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume	same

github-actions · 2024-09-30T10:18:07Z

Hi! 👋 Looks like you updated a Git Submodule.
If this was not intentional please make sure to:

Update the submodule to the latest commit on the master branch using the git submodule update command,
Check you properly set up your environment for contributing.

github-actions · 2024-09-30T10:28:54Z

Hi! 👋 Looks like you updated a Git Submodule.
If this was not intentional please make sure to:

Update the submodule to the latest commit on the master branch using the git submodule update command,
Check you properly set up your environment for contributing.

github-actions · 2024-09-30T10:30:10Z

Hi! 👋 Looks like you updated a Git Submodule.
If this was not intentional please make sure to:

Update the submodule to the latest commit on the master branch using the git submodule update command,
Check you properly set up your environment for contributing.

Mariovido added 3 commits September 6, 2024 14:33

Replicate vulnerability incident

2a7de72

Change instrumentation Json2Parser

99750fa

Add support for versions post 2.16

0331b58

Fix tests + modify helper

dc3023f

Mariovido added 7 commits September 11, 2024 11:56

Fix tests

7e590d2

Fix tests

0739a47

Fix tests

b73bd3f

Fix tests

52d3cc4

Fix tests

d9327e2

Fix tests

cca6713

Add ebean to the exclusion trie

f5b5636

Mariovido added tag: do not merge Do not merge changes type: documentation labels Sep 30, 2024

Mariovido force-pushed the mario.vidal/ebean_check branch from 4216071 to a40cc8a Compare September 30, 2024 10:28

Mariovido force-pushed the mario.vidal/ebean_check branch from a40cc8a to 6ce057d Compare September 30, 2024 10:29

Clean instrumentation

16d71d0

Mariovido force-pushed the mario.vidal/ebean_check branch from 6ce057d to 16d71d0 Compare September 30, 2024 10:35

Mariovido added 2 commits September 30, 2024 12:35

Merge branch 'master' into mario.vidal/ebean_check

8667c5b

Remove initial.xml

e5d0c51

Mariovido changed the title ~~Change JsonParser instrumentation to not taint interned strings~~ Smoke test for the Ebean ORM Sep 30, 2024

Mariovido closed this Sep 30, 2024

Mariovido deleted the mario.vidal/ebean_check branch September 30, 2024 13:19

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Smoke test for the Ebean ORM #7594

Smoke test for the Ebean ORM #7594

Mariovido commented Sep 10, 2024 •

edited by jira bot

Loading

pr-commenter bot commented Sep 10, 2024 •

edited

Loading

pr-commenter bot commented Sep 11, 2024 •

edited

Loading

pr-commenter bot commented Sep 11, 2024 •

edited

Loading

github-actions bot commented Sep 30, 2024

github-actions bot commented Sep 30, 2024

github-actions bot commented Sep 30, 2024

Smoke test for the Ebean ORM #7594

Smoke test for the Ebean ORM #7594

Conversation

Mariovido commented Sep 10, 2024 • edited by jira bot Loading

What Does This Do

Motivation

Additional Notes

Contributor Checklist

pr-commenter bot commented Sep 10, 2024 • edited Loading

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

pr-commenter bot commented Sep 11, 2024 • edited Loading

Kafka / producer-benchmark

Parameters

Summary

pr-commenter bot commented Sep 11, 2024 • edited Loading

Kafka / consumer-benchmark

Parameters

Summary

github-actions bot commented Sep 30, 2024

github-actions bot commented Sep 30, 2024

github-actions bot commented Sep 30, 2024

Mariovido commented Sep 10, 2024 •

edited by jira bot

Loading

pr-commenter bot commented Sep 10, 2024 •

edited

Loading

pr-commenter bot commented Sep 11, 2024 •

edited

Loading

pr-commenter bot commented Sep 11, 2024 •

edited

Loading