-
Notifications
You must be signed in to change notification settings - Fork 293
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improve ASM support in vert.x 5.0 #8285
base: master
Are you sure you want to change the base?
Conversation
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 12 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~89632aeb4e, baseline=1.47.0-SNAPSHOT~9af5347cda
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.051 s) : 0, 1050760
Total [baseline] (10.471 s) : 0, 10471296
Agent [candidate] (1.048 s) : 0, 1047926
Total [candidate] (10.467 s) : 0, 10467399
section appsec
Agent [baseline] (1.19 s) : 0, 1189795
Total [baseline] (10.783 s) : 0, 10783106
Agent [candidate] (1.185 s) : 0, 1185167
Total [candidate] (10.765 s) : 0, 10764901
section iast
Agent [baseline] (1.174 s) : 0, 1174452
Total [baseline] (10.95 s) : 0, 10949727
Agent [candidate] (1.183 s) : 0, 1182565
Total [candidate] (11.003 s) : 0, 11002865
section profiling
Agent [baseline] (1.274 s) : 0, 1274422
Total [baseline] (10.922 s) : 0, 10921700
Agent [candidate] (1.27 s) : 0, 1270462
Total [candidate] (10.906 s) : 0, 10906271
gantt
title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~89632aeb4e, baseline=1.47.0-SNAPSHOT~9af5347cda
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (720.971 ms) : 0, 720971
BytebuddyAgent [candidate] (720.49 ms) : 0, 720490
GlobalTracer [baseline] (244.974 ms) : 0, 244974
GlobalTracer [candidate] (245.565 ms) : 0, 245565
AppSec [baseline] (55.656 ms) : 0, 55656
AppSec [candidate] (55.677 ms) : 0, 55677
Remote Config [baseline] (728.319 µs) : 0, 728
Remote Config [candidate] (725.226 µs) : 0, 725
Telemetry [baseline] (13.085 ms) : 0, 13085
Telemetry [candidate] (10.137 ms) : 0, 10137
section appsec
BytebuddyAgent [baseline] (735.429 ms) : 0, 735429
BytebuddyAgent [candidate] (733.387 ms) : 0, 733387
GlobalTracer [baseline] (242.262 ms) : 0, 242262
GlobalTracer [candidate] (240.762 ms) : 0, 240762
IAST [baseline] (21.606 ms) : 0, 21606
IAST [candidate] (21.525 ms) : 0, 21525
AppSec [baseline] (177.007 ms) : 0, 177007
AppSec [candidate] (176.037 ms) : 0, 176037
Remote Config [baseline] (662.261 µs) : 0, 662
Remote Config [candidate] (671.028 µs) : 0, 671
Telemetry [baseline] (8.312 ms) : 0, 8312
Telemetry [candidate] (8.312 ms) : 0, 8312
section iast
BytebuddyAgent [baseline] (835.147 ms) : 0, 835147
BytebuddyAgent [candidate] (841.588 ms) : 0, 841588
GlobalTracer [baseline] (235.012 ms) : 0, 235012
GlobalTracer [candidate] (235.855 ms) : 0, 235855
IAST [baseline] (24.764 ms) : 0, 24764
IAST [candidate] (24.209 ms) : 0, 24209
AppSec [baseline] (54.789 ms) : 0, 54789
AppSec [candidate] (56.192 ms) : 0, 56192
Remote Config [baseline] (629.874 µs) : 0, 630
Remote Config [candidate] (638.088 µs) : 0, 638
Telemetry [baseline] (8.791 ms) : 0, 8791
Telemetry [candidate] (8.738 ms) : 0, 8738
section profiling
BytebuddyAgent [baseline] (714.162 ms) : 0, 714162
BytebuddyAgent [candidate] (711.185 ms) : 0, 711185
GlobalTracer [baseline] (355.505 ms) : 0, 355505
GlobalTracer [candidate] (355.819 ms) : 0, 355819
AppSec [baseline] (55.349 ms) : 0, 55349
AppSec [candidate] (54.575 ms) : 0, 54575
Remote Config [baseline] (702.33 µs) : 0, 702
Remote Config [candidate] (714.038 µs) : 0, 714
Telemetry [baseline] (8.972 ms) : 0, 8972
Telemetry [candidate] (8.991 ms) : 0, 8991
ProfilingAgent [baseline] (96.804 ms) : 0, 96804
ProfilingAgent [candidate] (96.528 ms) : 0, 96528
Profiling [baseline] (96.827 ms) : 0, 96827
Profiling [candidate] (96.552 ms) : 0, 96552
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~89632aeb4e, baseline=1.47.0-SNAPSHOT~9af5347cda
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.047 s) : 0, 1046585
Total [baseline] (8.708 s) : 0, 8708122
Agent [candidate] (1.043 s) : 0, 1042836
Total [candidate] (8.68 s) : 0, 8679615
section iast
Agent [baseline] (1.17 s) : 0, 1169810
Total [baseline] (9.265 s) : 0, 9264741
Agent [candidate] (1.183 s) : 0, 1182907
Total [candidate] (9.256 s) : 0, 9256158
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.18 s) : 0, 1180485
Total [baseline] (9.234 s) : 0, 9234227
Agent [candidate] (1.187 s) : 0, 1186619
Total [candidate] (9.238 s) : 0, 9237679
section iast_TELEMETRY_OFF
Agent [baseline] (1.179 s) : 0, 1178963
Total [baseline] (9.309 s) : 0, 9309205
Agent [candidate] (1.173 s) : 0, 1173324
Total [candidate] (9.279 s) : 0, 9279257
gantt
title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~89632aeb4e, baseline=1.47.0-SNAPSHOT~9af5347cda
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.957 ms) : 0, 718957
BytebuddyAgent [candidate] (715.549 ms) : 0, 715549
GlobalTracer [baseline] (244.452 ms) : 0, 244452
GlobalTracer [candidate] (243.375 ms) : 0, 243375
AppSec [baseline] (55.553 ms) : 0, 55553
AppSec [candidate] (55.606 ms) : 0, 55606
Remote Config [baseline] (724.65 µs) : 0, 725
Remote Config [candidate] (717.638 µs) : 0, 718
Telemetry [baseline] (11.579 ms) : 0, 11579
Telemetry [candidate] (12.302 ms) : 0, 12302
section iast
BytebuddyAgent [baseline] (832.661 ms) : 0, 832661
BytebuddyAgent [candidate] (841.622 ms) : 0, 841622
GlobalTracer [baseline] (233.283 ms) : 0, 233283
GlobalTracer [candidate] (235.939 ms) : 0, 235939
IAST [baseline] (26.51 ms) : 0, 26510
IAST [candidate] (25.217 ms) : 0, 25217
AppSec [baseline] (52.793 ms) : 0, 52793
AppSec [candidate] (55.078 ms) : 0, 55078
Remote Config [baseline] (608.836 µs) : 0, 609
Remote Config [candidate] (622.438 µs) : 0, 622
Telemetry [baseline] (8.635 ms) : 0, 8635
Telemetry [candidate] (8.775 ms) : 0, 8775
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (839.754 ms) : 0, 839754
BytebuddyAgent [candidate] (845.285 ms) : 0, 845285
GlobalTracer [baseline] (235.335 ms) : 0, 235335
GlobalTracer [candidate] (235.623 ms) : 0, 235623
IAST [baseline] (26.899 ms) : 0, 26899
IAST [candidate] (25.422 ms) : 0, 25422
AppSec [baseline] (53.638 ms) : 0, 53638
AppSec [candidate] (55.382 ms) : 0, 55382
Remote Config [baseline] (626.685 µs) : 0, 627
Remote Config [candidate] (637.128 µs) : 0, 637
Telemetry [baseline] (8.856 ms) : 0, 8856
Telemetry [candidate] (8.838 ms) : 0, 8838
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (838.374 ms) : 0, 838374
BytebuddyAgent [candidate] (833.924 ms) : 0, 833924
GlobalTracer [baseline] (236.7 ms) : 0, 236700
GlobalTracer [candidate] (235.405 ms) : 0, 235405
IAST [baseline] (27.72 ms) : 0, 27720
IAST [candidate] (26.207 ms) : 0, 26207
AppSec [baseline] (51.524 ms) : 0, 51524
AppSec [candidate] (53.197 ms) : 0, 53197
Remote Config [baseline] (608.244 µs) : 0, 608
Remote Config [candidate] (618.184 µs) : 0, 618
Telemetry [baseline] (8.632 ms) : 0, 8632
Telemetry [candidate] (8.649 ms) : 0, 8649
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics. Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~89632aeb4e, baseline=1.47.0-SNAPSHOT~9af5347cda
dateFormat X
axisFormat %s
section baseline
no_agent (1.346 ms) : 1326, 1366
. : milestone, 1346,
appsec (1.742 ms) : 1719, 1765
. : milestone, 1742,
appsec_no_iast (1.764 ms) : 1742, 1787
. : milestone, 1764,
iast (1.509 ms) : 1485, 1532
. : milestone, 1509,
profiling (1.531 ms) : 1507, 1556
. : milestone, 1531,
tracing (1.5 ms) : 1475, 1526
. : milestone, 1500,
section candidate
no_agent (1.356 ms) : 1337, 1376
. : milestone, 1356,
appsec (1.738 ms) : 1714, 1761
. : milestone, 1738,
appsec_no_iast (1.749 ms) : 1724, 1773
. : milestone, 1749,
iast (1.482 ms) : 1458, 1507
. : milestone, 1482,
profiling (1.556 ms) : 1531, 1582
. : milestone, 1556,
tracing (1.49 ms) : 1467, 1514
. : milestone, 1490,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~89632aeb4e, baseline=1.47.0-SNAPSHOT~9af5347cda
dateFormat X
axisFormat %s
section baseline
no_agent (379.922 µs) : 360, 399
. : milestone, 380,
iast (503.138 µs) : 481, 525
. : milestone, 503,
iast_FULL (740.718 µs) : 719, 763
. : milestone, 741,
iast_GLOBAL (556.139 µs) : 533, 579
. : milestone, 556,
iast_HARDCODED_SECRET_DISABLED (507.427 µs) : 486, 529
. : milestone, 507,
iast_INACTIVE (459.938 µs) : 438, 481
. : milestone, 460,
iast_TELEMETRY_OFF (501.001 µs) : 478, 524
. : milestone, 501,
tracing (448.598 µs) : 428, 469
. : milestone, 449,
section candidate
no_agent (373.188 µs) : 353, 393
. : milestone, 373,
iast (501.356 µs) : 480, 523
. : milestone, 501,
iast_FULL (738.753 µs) : 717, 761
. : milestone, 739,
iast_GLOBAL (555.106 µs) : 532, 578
. : milestone, 555,
iast_HARDCODED_SECRET_DISABLED (499.403 µs) : 478, 521
. : milestone, 499,
iast_INACTIVE (453.09 µs) : 432, 474
. : milestone, 453,
iast_TELEMETRY_OFF (493.464 µs) : 471, 516
. : milestone, 493,
tracing (450.805 µs) : 430, 472
. : milestone, 451,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~89632aeb4e, baseline=1.47.0-SNAPSHOT~9af5347cda
dateFormat X
axisFormat %s
section baseline
no_agent (14.747 s) : 14747000, 14747000
. : milestone, 14747000,
appsec (14.965 s) : 14965000, 14965000
. : milestone, 14965000,
iast (18.471 s) : 18471000, 18471000
. : milestone, 18471000,
iast_GLOBAL (18.15 s) : 18150000, 18150000
. : milestone, 18150000,
profiling (15.224 s) : 15224000, 15224000
. : milestone, 15224000,
tracing (14.641 s) : 14641000, 14641000
. : milestone, 14641000,
section candidate
no_agent (15.43 s) : 15430000, 15430000
. : milestone, 15430000,
appsec (14.828 s) : 14828000, 14828000
. : milestone, 14828000,
iast (18.98 s) : 18980000, 18980000
. : milestone, 18980000,
iast_GLOBAL (18.062 s) : 18062000, 18062000
. : milestone, 18062000,
profiling (14.989 s) : 14989000, 14989000
. : milestone, 14989000,
tracing (15.009 s) : 15009000, 15009000
. : milestone, 15009000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~89632aeb4e, baseline=1.47.0-SNAPSHOT~9af5347cda
dateFormat X
axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1482
. : milestone, 1470,
appsec (2.372 ms) : 2328, 2415
. : milestone, 2372,
iast (2.117 ms) : 2062, 2173
. : milestone, 2117,
iast_GLOBAL (2.157 ms) : 2102, 2212
. : milestone, 2157,
profiling (1.995 ms) : 1950, 2039
. : milestone, 1995,
tracing (1.958 ms) : 1915, 2000
. : milestone, 1958,
section candidate
no_agent (1.479 ms) : 1468, 1491
. : milestone, 1479,
appsec (2.364 ms) : 2320, 2407
. : milestone, 2364,
iast (2.112 ms) : 2057, 2167
. : milestone, 2112,
iast_GLOBAL (2.158 ms) : 2103, 2213
. : milestone, 2158,
profiling (1.98 ms) : 1936, 2024
. : milestone, 1980,
tracing (1.952 ms) : 1910, 1994
. : milestone, 1952,
|
b5c2f12
to
3b6d1dc
Compare
3b6d1dc
to
ab39c74
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM. Thanks a lot!
bd7e855
to
89632ae
Compare
What Does This Do
This PR takes care of all the failing tests for ASM with the latest versions of vert.x, it limits the latest deps tests to v4.x in
vertx-web-4.0
and creates a new module for v5.x invertx-web-5.0
. The new v5.x module relies in v4.x for most of the instrumentations and only takes care of the changed APIs (e.g.io.vertx.core.buffer.Buffer
)Motivation
Additional Notes
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: APPSEC-56368