-
Notifications
You must be signed in to change notification settings - Fork 319
Fix Gradle smoke tests with Gradle 9 #9292
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
Code coverage: total 57.15%, base diff 0.03%, patch 0.00% (view details) This comment will be updated automatically if new data arrives.🔗 Commit SHA: 6da68e4 | Docs | Was this helpful? Give us feedback! |
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 12 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.51.1-SNAPSHOT~6da68e4c2e, baseline=1.51.1-SNAPSHOT~3a35f77b25
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.046 s) : 0, 1045586
Total [baseline] (8.661 s) : 0, 8661065
Agent [candidate] (1.05 s) : 0, 1050209
Total [candidate] (8.6 s) : 0, 8600156
section iast
Agent [baseline] (1.173 s) : 0, 1173137
Total [baseline] (9.333 s) : 0, 9332949
Agent [candidate] (1.177 s) : 0, 1176981
Total [candidate] (9.376 s) : 0, 9375766
gantt
title insecure-bank - break down per module: candidate=1.51.1-SNAPSHOT~6da68e4c2e, baseline=1.51.1-SNAPSHOT~3a35f77b25
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.435 ms) : 0, 1435
crashtracking [candidate] (1.437 ms) : 0, 1437
BytebuddyAgent [baseline] (732.453 ms) : 0, 732453
BytebuddyAgent [candidate] (735.197 ms) : 0, 735197
GlobalTracer [baseline] (242.151 ms) : 0, 242151
GlobalTracer [candidate] (243.099 ms) : 0, 243099
AppSec [baseline] (29.863 ms) : 0, 29863
AppSec [candidate] (30.37 ms) : 0, 30370
Debugger [baseline] (6.074 ms) : 0, 6074
Debugger [candidate] (6.077 ms) : 0, 6077
Remote Config [baseline] (648.09 µs) : 0, 648
Remote Config [candidate] (666.379 µs) : 0, 666
Telemetry [baseline] (11.94 ms) : 0, 11940
Telemetry [candidate] (12.28 ms) : 0, 12280
section iast
crashtracking [baseline] (1.431 ms) : 0, 1431
crashtracking [candidate] (1.441 ms) : 0, 1441
BytebuddyAgent [baseline] (846.831 ms) : 0, 846831
BytebuddyAgent [candidate] (850.388 ms) : 0, 850388
GlobalTracer [baseline] (231.234 ms) : 0, 231234
GlobalTracer [candidate] (233.028 ms) : 0, 233028
IAST [baseline] (29.061 ms) : 0, 29061
IAST [candidate] (29.766 ms) : 0, 29766
AppSec [baseline] (28.09 ms) : 0, 28090
AppSec [candidate] (26.038 ms) : 0, 26038
Debugger [baseline] (6.688 ms) : 0, 6688
Debugger [candidate] (6.662 ms) : 0, 6662
Remote Config [baseline] (654.33 µs) : 0, 654
Remote Config [candidate] (583.348 µs) : 0, 583
Telemetry [baseline] (8.154 ms) : 0, 8154
Telemetry [candidate] (8.076 ms) : 0, 8076
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.51.1-SNAPSHOT~6da68e4c2e, baseline=1.51.1-SNAPSHOT~3a35f77b25
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.041 s) : 0, 1041170
Total [baseline] (10.657 s) : 0, 10657465
Agent [candidate] (1.048 s) : 0, 1047687
Total [candidate] (10.756 s) : 0, 10756129
section appsec
Agent [baseline] (1.222 s) : 0, 1222235
Total [baseline] (10.791 s) : 0, 10791204
Agent [candidate] (1.218 s) : 0, 1218384
Total [candidate] (10.822 s) : 0, 10821702
section iast
Agent [baseline] (1.181 s) : 0, 1180817
Total [baseline] (10.877 s) : 0, 10877196
Agent [candidate] (1.185 s) : 0, 1185287
Total [candidate] (11.015 s) : 0, 11015088
section profiling
Agent [baseline] (1.201 s) : 0, 1200923
Total [baseline] (10.89 s) : 0, 10890454
Agent [candidate] (1.204 s) : 0, 1203631
Total [candidate] (10.947 s) : 0, 10947244
gantt
title petclinic - break down per module: candidate=1.51.1-SNAPSHOT~6da68e4c2e, baseline=1.51.1-SNAPSHOT~3a35f77b25
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.431 ms) : 0, 1431
crashtracking [candidate] (1.44 ms) : 0, 1440
BytebuddyAgent [baseline] (730.99 ms) : 0, 730990
BytebuddyAgent [candidate] (735.963 ms) : 0, 735963
GlobalTracer [baseline] (241.361 ms) : 0, 241361
GlobalTracer [candidate] (242.083 ms) : 0, 242083
AppSec [baseline] (29.877 ms) : 0, 29877
AppSec [candidate] (29.957 ms) : 0, 29957
Debugger [baseline] (6.028 ms) : 0, 6028
Debugger [candidate] (6.036 ms) : 0, 6036
Remote Config [baseline] (645.583 µs) : 0, 646
Remote Config [candidate] (653.939 µs) : 0, 654
Telemetry [baseline] (9.8 ms) : 0, 9800
Telemetry [candidate] (9.813 ms) : 0, 9813
section appsec
crashtracking [baseline] (1.426 ms) : 0, 1426
crashtracking [candidate] (1.437 ms) : 0, 1437
BytebuddyAgent [baseline] (754.864 ms) : 0, 754864
BytebuddyAgent [candidate] (751.916 ms) : 0, 751916
GlobalTracer [baseline] (235.265 ms) : 0, 235265
GlobalTracer [candidate] (234.955 ms) : 0, 234955
IAST [baseline] (23.486 ms) : 0, 23486
IAST [candidate] (23.549 ms) : 0, 23549
AppSec [baseline] (167.059 ms) : 0, 167059
AppSec [candidate] (170.18 ms) : 0, 170180
Debugger [baseline] (9.454 ms) : 0, 9454
Debugger [candidate] (6.389 ms) : 0, 6389
Remote Config [baseline] (619.311 µs) : 0, 619
Remote Config [candidate] (619.269 µs) : 0, 619
Telemetry [baseline] (8.978 ms) : 0, 8978
Telemetry [candidate] (8.282 ms) : 0, 8282
section iast
crashtracking [baseline] (1.446 ms) : 0, 1446
crashtracking [candidate] (1.448 ms) : 0, 1448
BytebuddyAgent [baseline] (853.678 ms) : 0, 853678
BytebuddyAgent [candidate] (856.135 ms) : 0, 856135
GlobalTracer [baseline] (232.301 ms) : 0, 232301
GlobalTracer [candidate] (233.078 ms) : 0, 233078
IAST [baseline] (28.437 ms) : 0, 28437
IAST [candidate] (30.215 ms) : 0, 30215
AppSec [baseline] (27.674 ms) : 0, 27674
AppSec [candidate] (27.459 ms) : 0, 27459
Debugger [baseline] (7.375 ms) : 0, 7375
Debugger [candidate] (6.818 ms) : 0, 6818
Remote Config [baseline] (605.318 µs) : 0, 605
Remote Config [candidate] (614.792 µs) : 0, 615
Telemetry [baseline] (8.115 ms) : 0, 8115
Telemetry [candidate] (8.372 ms) : 0, 8372
section profiling
crashtracking [baseline] (1.418 ms) : 0, 1418
crashtracking [candidate] (1.411 ms) : 0, 1411
BytebuddyAgent [baseline] (764.886 ms) : 0, 764886
BytebuddyAgent [candidate] (766.716 ms) : 0, 766716
GlobalTracer [baseline] (222.863 ms) : 0, 222863
GlobalTracer [candidate] (223.114 ms) : 0, 223114
AppSec [baseline] (30.371 ms) : 0, 30371
AppSec [candidate] (30.401 ms) : 0, 30401
Debugger [baseline] (6.321 ms) : 0, 6321
Debugger [candidate] (6.39 ms) : 0, 6390
Remote Config [baseline] (689.475 µs) : 0, 689
Remote Config [candidate] (695.349 µs) : 0, 695
Telemetry [baseline] (15.23 ms) : 0, 15230
Telemetry [candidate] (15.613 ms) : 0, 15613
ProfilingAgent [baseline] (109.397 ms) : 0, 109397
ProfilingAgent [candidate] (109.409 ms) : 0, 109409
Profiling [baseline] (110.04 ms) : 0, 110040
Profiling [candidate] (110.065 ms) : 0, 110065
LoadParameters
See matching parameters
SummaryFound 1 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.51.1-SNAPSHOT~6da68e4c2e, baseline=1.51.1-SNAPSHOT~3a35f77b25
dateFormat X
axisFormat %s
section baseline
no_agent (4.359 ms) : 4308, 4411
. : milestone, 4359,
iast (9.305 ms) : 9152, 9457
. : milestone, 9305,
iast_FULL (14.012 ms) : 13738, 14285
. : milestone, 14012,
iast_GLOBAL (9.599 ms) : 9436, 9763
. : milestone, 9599,
profiling (9.186 ms) : 9041, 9331
. : milestone, 9186,
tracing (7.514 ms) : 7397, 7632
. : milestone, 7514,
section candidate
no_agent (4.274 ms) : 4226, 4322
. : milestone, 4274,
iast (9.149 ms) : 8993, 9305
. : milestone, 9149,
iast_FULL (13.728 ms) : 13452, 14004
. : milestone, 13728,
iast_GLOBAL (10.119 ms) : 9942, 10295
. : milestone, 10119,
profiling (9.164 ms) : 9019, 9309
. : milestone, 9164,
tracing (7.585 ms) : 7477, 7692
. : milestone, 7585,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.51.1-SNAPSHOT~6da68e4c2e, baseline=1.51.1-SNAPSHOT~3a35f77b25
dateFormat X
axisFormat %s
section baseline
no_agent (37.825 ms) : 37514, 38135
. : milestone, 37825,
appsec (48.925 ms) : 48495, 49356
. : milestone, 48925,
code_origins (43.995 ms) : 43607, 44383
. : milestone, 43995,
iast (44.523 ms) : 44133, 44913
. : milestone, 44523,
profiling (48.29 ms) : 47839, 48741
. : milestone, 48290,
tracing (43.828 ms) : 43472, 44184
. : milestone, 43828,
section candidate
no_agent (36.179 ms) : 35891, 36468
. : milestone, 36179,
appsec (47.984 ms) : 47566, 48402
. : milestone, 47984,
code_origins (43.924 ms) : 43555, 44293
. : milestone, 43924,
iast (44.861 ms) : 44457, 45265
. : milestone, 44861,
profiling (48.141 ms) : 47667, 48616
. : milestone, 48141,
tracing (43.413 ms) : 43046, 43779
. : milestone, 43413,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.51.1-SNAPSHOT~6da68e4c2e, baseline=1.51.1-SNAPSHOT~3a35f77b25
dateFormat X
axisFormat %s
section baseline
no_agent (1.475 ms) : 1464, 1487
. : milestone, 1475,
appsec (3.666 ms) : 3452, 3881
. : milestone, 3666,
iast (2.195 ms) : 2132, 2257
. : milestone, 2195,
iast_GLOBAL (2.243 ms) : 2180, 2307
. : milestone, 2243,
profiling (2.051 ms) : 2000, 2103
. : milestone, 2051,
tracing (2.002 ms) : 1954, 2050
. : milestone, 2002,
section candidate
no_agent (1.468 ms) : 1457, 1480
. : milestone, 1468,
appsec (3.654 ms) : 3437, 3871
. : milestone, 3654,
iast (2.197 ms) : 2134, 2260
. : milestone, 2197,
iast_GLOBAL (2.239 ms) : 2176, 2303
. : milestone, 2239,
profiling (2.053 ms) : 2002, 2105
. : milestone, 2053,
tracing (2.022 ms) : 1973, 2071
. : milestone, 2022,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.51.1-SNAPSHOT~6da68e4c2e, baseline=1.51.1-SNAPSHOT~3a35f77b25
dateFormat X
axisFormat %s
section baseline
no_agent (15.038 s) : 15038000, 15038000
. : milestone, 15038000,
appsec (14.826 s) : 14826000, 14826000
. : milestone, 14826000,
iast (18.542 s) : 18542000, 18542000
. : milestone, 18542000,
iast_GLOBAL (18.252 s) : 18252000, 18252000
. : milestone, 18252000,
profiling (15.052 s) : 15052000, 15052000
. : milestone, 15052000,
tracing (14.985 s) : 14985000, 14985000
. : milestone, 14985000,
section candidate
no_agent (15.209 s) : 15209000, 15209000
. : milestone, 15209000,
appsec (14.785 s) : 14785000, 14785000
. : milestone, 14785000,
iast (18.097 s) : 18097000, 18097000
. : milestone, 18097000,
iast_GLOBAL (18.023 s) : 18023000, 18023000
. : milestone, 18023000,
profiling (14.977 s) : 14977000, 14977000
. : milestone, 14977000,
tracing (15.1 s) : 15100000, 15100000
. : milestone, 15100000,
|
dd-smoke-tests/gradle/src/test/resources/test-succeed-junit-5/build.gradleTest
Show resolved
Hide resolved
dd-smoke-tests/gradle/src/test/resources/test-succeed-gradle-plugin-test/build.gradleTest
Show resolved
Hide resolved
|
Hi! 👋 Thanks for your pull request! 🎉 To help us review it, please make sure to:
If you need help, please check our contributing guidelines. |
Signed-off-by: Nayeem Kamal <[email protected]>
What Does This Do
LATEST_VERSIONtests will be skipped unless JVM >= 17 is usedGradleLauncherSmokeTestto actually use the JVM set with-PtestJvmin the commands executed, instead of relying on the defaultJAVA_HOMEorg.junit.platform:junit-platform-launcheras a dependency for thetest-succeed-gradle-pluginproject. Starting in Gradle 9.0, automatic test framework implementation dependencies are depracatedtest-succeed-junit-5project to avoid using the default 5.12.2 version bundled with Gradle 9.0Motivation
With the release of Gradle 9.0, the
LATEST_VERSIONGradle smoke tests were broken.Contributor Checklist
type:and (comp:orinst:) labels in addition to any usefull labelsclose,fixor any linking keywords when referencing an issue.Use
solvesinstead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]