Skip to content

Add springboot smoke tests for the open feature SDK #9961

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
manuel-alvarez-alvarez merged 5 commits into from
Dec 9, 2025
Merged

Add springboot smoke tests for the open feature SDK #9961

manuel-alvarez-alvarez merged 5 commits into from
Dec 9, 2025

Conversation

@manuel-alvarez-alvarez
Copy link
Member

@manuel-alvarez-alvarez manuel-alvarez-alvarez commented Nov 14, 2025 •
edited
Loading

What Does This Do

Adds smoke tests for the OpenFeature Java provider (PR)

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch from 6fcda55 to 188fdc6 Compare November 14, 2025 04:42
@manuel-alvarez-alvarez manuel-alvarez-alvarez mentioned this pull request Nov 14, 2025
Merged
@manuel-alvarez-alvarez manuel-alvarez-alvarez marked this pull request as ready for review November 14, 2025 04:43
@manuel-alvarez-alvarez manuel-alvarez-alvarez requested review from AlexeyKuznetsov-DD and smola and removed request for a team November 14, 2025 04:43
@manuel-alvarez-alvarez manuel-alvarez-alvarez mentioned this pull request Nov 14, 2025
Closed
@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch from 188fdc6 to de1816f Compare November 14, 2025 04:45
@pr-commenter
Copy link

pr-commenter bot commented Nov 14, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/open-feature-sdk-smoke
git_commit_date 1765268180 1765270230
git_commit_sha 2229c62 1d5d526
release_version 1.57.0-SNAPSHOT~2229c621bd 1.57.0-SNAPSHOT~1d5d526566
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765272270 1765272270
ci_job_id 1278497357 1278497357
ci_pipeline_id 85506160 85506160
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-5dv71mfk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-5dv71mfk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 7 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~1d5d526566, baseline=1.57.0-SNAPSHOT~2229c621bd

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.08 s) : 0, 1080256
Total [baseline] (10.834 s) : 0, 10834275
Agent [candidate] (1.082 s) : 0, 1081767
Total [candidate] (10.892 s) : 0, 10892066
section appsec
Agent [baseline] (1.266 s) : 0, 1265961
Total [baseline] (11.14 s) : 0, 11139584
Agent [candidate] (1.262 s) : 0, 1261809
Total [candidate] (11.142 s) : 0, 11142428
section iast
Agent [baseline] (1.23 s) : 0, 1230354
Total [baseline] (11.205 s) : 0, 11205429
Agent [candidate] (1.23 s) : 0, 1229537
Total [candidate] (11.204 s) : 0, 11203949
section profiling
Agent [baseline] (1.206 s) : 0, 1206403
Total [baseline] (11.039 s) : 0, 11038506
Agent [candidate] (1.203 s) : 0, 1203391
Total [candidate] (11.02 s) : 0, 11020227
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.08 s -
Agent appsec 1.266 s 185.704 ms (17.2%)
Agent iast 1.23 s 150.097 ms (13.9%)
Agent profiling 1.206 s 126.146 ms (11.7%)
Total tracing 10.834 s -
Total appsec 11.14 s 305.309 ms (2.8%)
Total iast 11.205 s 371.154 ms (3.4%)
Total profiling 11.039 s 204.231 ms (1.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.082 s -
Agent appsec 1.262 s 180.042 ms (16.6%)
Agent iast 1.23 s 147.77 ms (13.7%)
Agent profiling 1.203 s 121.623 ms (11.2%)
Total tracing 10.892 s -
Total appsec 11.142 s 250.362 ms (2.3%)
Total iast 11.204 s 311.883 ms (2.9%)
Total profiling 11.02 s 128.161 ms (1.2%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~1d5d526566, baseline=1.57.0-SNAPSHOT~2229c621bd

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (648.142 ms) : 0, 648142
BytebuddyAgent [candidate] (648.19 ms) : 0, 648190
GlobalTracer [baseline] (281.45 ms) : 0, 281450
GlobalTracer [candidate] (282.036 ms) : 0, 282036
AppSec [baseline] (32.409 ms) : 0, 32409
AppSec [candidate] (32.339 ms) : 0, 32339
Debugger [baseline] (68.137 ms) : 0, 68137
Debugger [candidate] (68.938 ms) : 0, 68938
Remote Config [baseline] (645.774 µs) : 0, 646
Remote Config [candidate] (656.975 µs) : 0, 657
Telemetry [baseline] (8.965 ms) : 0, 8965
Telemetry [candidate] (9.137 ms) : 0, 9137
Flare Poller [baseline] (3.769 ms) : 0, 3769
Flare Poller [candidate] (3.817 ms) : 0, 3817
section appsec
crashtracking [baseline] (1.209 ms) : 0, 1209
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (689.66 ms) : 0, 689660
BytebuddyAgent [candidate] (687.243 ms) : 0, 687243
GlobalTracer [baseline] (259.571 ms) : 0, 259571
GlobalTracer [candidate] (258.573 ms) : 0, 258573
IAST [baseline] (24.589 ms) : 0, 24589
IAST [candidate] (24.543 ms) : 0, 24543
AppSec [baseline] (174.451 ms) : 0, 174451
AppSec [candidate] (174.79 ms) : 0, 174790
Debugger [baseline] (67.116 ms) : 0, 67116
Debugger [candidate] (66.457 ms) : 0, 66457
Remote Config [baseline] (696.884 µs) : 0, 697
Remote Config [candidate] (714.514 µs) : 0, 715
Telemetry [baseline] (9.085 ms) : 0, 9085
Telemetry [candidate] (9.047 ms) : 0, 9047
Flare Poller [baseline] (3.856 ms) : 0, 3856
Flare Poller [candidate] (3.836 ms) : 0, 3836
section iast
crashtracking [baseline] (1.24 ms) : 0, 1240
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (795.683 ms) : 0, 795683
BytebuddyAgent [candidate] (795.74 ms) : 0, 795740
GlobalTracer [baseline] (256.453 ms) : 0, 256453
GlobalTracer [candidate] (255.802 ms) : 0, 255802
IAST [baseline] (27.188 ms) : 0, 27188
IAST [candidate] (27.164 ms) : 0, 27164
AppSec [baseline] (35.522 ms) : 0, 35522
AppSec [candidate] (34.618 ms) : 0, 34618
Debugger [baseline] (66.172 ms) : 0, 66172
Debugger [candidate] (66.815 ms) : 0, 66815
Remote Config [baseline] (558.625 µs) : 0, 559
Remote Config [candidate] (584.16 µs) : 0, 584
Telemetry [baseline] (8.417 ms) : 0, 8417
Telemetry [candidate] (8.418 ms) : 0, 8418
Flare Poller [baseline] (3.452 ms) : 0, 3452
Flare Poller [candidate] (3.467 ms) : 0, 3467
section profiling
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (702.373 ms) : 0, 702373
BytebuddyAgent [candidate] (701.254 ms) : 0, 701254
GlobalTracer [baseline] (221.24 ms) : 0, 221240
GlobalTracer [candidate] (220.54 ms) : 0, 220540
AppSec [baseline] (32.393 ms) : 0, 32393
AppSec [candidate] (32.158 ms) : 0, 32158
Debugger [baseline] (68.253 ms) : 0, 68253
Debugger [candidate] (67.825 ms) : 0, 67825
Remote Config [baseline] (608.46 µs) : 0, 608
Remote Config [candidate] (613.68 µs) : 0, 614
Telemetry [baseline] (8.969 ms) : 0, 8969
Telemetry [candidate] (9.001 ms) : 0, 9001
Flare Poller [baseline] (3.773 ms) : 0, 3773
Flare Poller [candidate] (3.792 ms) : 0, 3792
ProfilingAgent [baseline] (97.993 ms) : 0, 97993
ProfilingAgent [candidate] (97.403 ms) : 0, 97403
Profiling [baseline] (98.569 ms) : 0, 98569
Profiling [candidate] (97.977 ms) : 0, 97977
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~1d5d526566, baseline=1.57.0-SNAPSHOT~2229c621bd

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.08 s) : 0, 1080314
Total [baseline] (8.774 s) : 0, 8774119
Agent [candidate] (1.088 s) : 0, 1087763
Total [candidate] (8.744 s) : 0, 8744388
section iast
Agent [baseline] (1.222 s) : 0, 1221952
Total [baseline] (9.429 s) : 0, 9429296
Agent [candidate] (1.219 s) : 0, 1219024
Total [candidate] (9.428 s) : 0, 9427525
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.08 s -
Agent iast 1.222 s 141.639 ms (13.1%)
Total tracing 8.774 s -
Total iast 9.429 s 655.177 ms (7.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.088 s -
Agent iast 1.219 s 131.261 ms (12.1%)
Total tracing 8.744 s -
Total iast 9.428 s 683.137 ms (7.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~1d5d526566, baseline=1.57.0-SNAPSHOT~2229c621bd

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.206 ms) : 0, 1206
crashtracking [candidate] (1.212 ms) : 0, 1212
BytebuddyAgent [baseline] (648.239 ms) : 0, 648239
BytebuddyAgent [candidate] (653.352 ms) : 0, 653352
GlobalTracer [baseline] (282.084 ms) : 0, 282084
GlobalTracer [candidate] (283.587 ms) : 0, 283587
AppSec [baseline] (32.497 ms) : 0, 32497
AppSec [candidate] (32.715 ms) : 0, 32715
Debugger [baseline] (67.353 ms) : 0, 67353
Debugger [candidate] (66.791 ms) : 0, 66791
Remote Config [baseline] (678.331 µs) : 0, 678
Remote Config [candidate] (1.485 ms) : 0, 1485
Telemetry [baseline] (8.968 ms) : 0, 8968
Telemetry [candidate] (9.118 ms) : 0, 9118
Flare Poller [baseline] (3.76 ms) : 0, 3760
Flare Poller [candidate] (3.832 ms) : 0, 3832
section iast
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (788.409 ms) : 0, 788409
BytebuddyAgent [candidate] (788.437 ms) : 0, 788437
GlobalTracer [baseline] (256.475 ms) : 0, 256475
GlobalTracer [candidate] (255.156 ms) : 0, 255156
IAST [baseline] (27.172 ms) : 0, 27172
IAST [candidate] (27.564 ms) : 0, 27564
AppSec [baseline] (34.729 ms) : 0, 34729
AppSec [candidate] (34.441 ms) : 0, 34441
Debugger [baseline] (66.047 ms) : 0, 66047
Debugger [candidate] (64.362 ms) : 0, 64362
Remote Config [baseline] (592.11 µs) : 0, 592
Remote Config [candidate] (578.848 µs) : 0, 579
Telemetry [baseline] (8.425 ms) : 0, 8425
Telemetry [candidate] (8.403 ms) : 0, 8403
Flare Poller [baseline] (3.463 ms) : 0, 3463
Flare Poller [candidate] (3.497 ms) : 0, 3497
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/open-feature-sdk-smoke
git_commit_date 1765268180 1765270230
git_commit_sha 2229c62 1d5d526
release_version 1.57.0-SNAPSHOT~2229c621bd 1.57.0-SNAPSHOT~1d5d526566
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765272852 1765272852
ci_job_id 1278497358 1278497358
ci_pipeline_id 85506160 85506160
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-o7j4opfm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-o7j4opfm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-126.167µs; -61.810µs] or [-4.393%; -2.152%]		 unsure
[-504.407µs; -90.056µs] or [-6.181%; -1.104%]		 unstable
[-77.261op/s; +167.636op/s] or [-6.162%; +13.370%]		 2.778ms 7.863ms 1299.000op/s 2.872ms 8.160ms 1253.812op/s
scenario:load:insecure-bank:iast_FULL:high_load worse
[+151.528µs; +387.754µs] or [+2.966%; +7.589%]		 unsure
[+91.079µs; +774.181µs] or [+0.752%; +6.392%]		 unstable
[-109.008op/s; +32.508op/s] or [-13.486%; +4.022%]		 5.379ms 12.544ms 770.062op/s 5.109ms 12.111ms 808.312op/s
scenario:load:insecure-bank:profiling:high_load better
[-187.290µs; -53.418µs] or [-10.545%; -3.008%]		 unstable
[-1390.659µs; -548.886µs] or [-25.165%; -9.932%]		 unstable
[+47.763op/s; +493.924op/s] or [+2.418%; +25.000%]		 1.656ms 4.556ms 2246.531op/s 1.776ms 5.526ms 1975.688op/s
scenario:load:petclinic:appsec:high_load worse
[+414.136µs; +996.379µs] or [+2.286%; +5.499%]		 same
[-416.599µs; +1059.661µs] or [-1.377%; +3.503%]		 unstable
[-31.756op/s; +19.131op/s] or [-12.685%; +7.642%]		 18.825ms 30.569ms 244.031op/s 18.119ms 30.247ms 250.344op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~1d5d526566, baseline=1.57.0-SNAPSHOT~2229c621bd
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.207 ms) : 1195, 1219
.   : milestone, 1207,
iast (3.282 ms) : 3235, 3330
.   : milestone, 3282,
iast_FULL (5.719 ms) : 5662, 5775
.   : milestone, 5719,
iast_GLOBAL (3.659 ms) : 3600, 3718
.   : milestone, 3659,
profiling (2.293 ms) : 2270, 2317
.   : milestone, 2293,
tracing (1.894 ms) : 1876, 1912
.   : milestone, 1894,
section candidate
no_agent (1.179 ms) : 1168, 1191
.   : milestone, 1179,
iast (3.241 ms) : 3198, 3284
.   : milestone, 3241,
iast_FULL (6.007 ms) : 5946, 6068
.   : milestone, 6007,
iast_GLOBAL (3.528 ms) : 3476, 3579
.   : milestone, 3528,
profiling (2.009 ms) : 1992, 2025
.   : milestone, 2009,
tracing (1.8 ms) : 1785, 1816
.   : milestone, 1800,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.207 ms [1.195 ms, 1.219 ms] -
iast 3.282 ms [3.235 ms, 3.33 ms] 2.076 ms (172.0%)
iast_FULL 5.719 ms [5.662 ms, 5.775 ms] 4.512 ms (373.9%)
iast_GLOBAL 3.659 ms [3.6 ms, 3.718 ms] 2.452 ms (203.2%)
profiling 2.293 ms [2.27 ms, 2.317 ms] 1.087 ms (90.0%)
tracing 1.894 ms [1.876 ms, 1.912 ms] 687.15 µs (56.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.179 ms [1.168 ms, 1.191 ms] -
iast 3.241 ms [3.198 ms, 3.284 ms] 2.062 ms (174.8%)
iast_FULL 6.007 ms [5.946 ms, 6.068 ms] 4.827 ms (409.3%)
iast_GLOBAL 3.528 ms [3.476 ms, 3.579 ms] 2.348 ms (199.1%)
profiling 2.009 ms [1.992 ms, 2.025 ms] 829.39 µs (70.3%)
tracing 1.8 ms [1.785 ms, 1.816 ms] 620.935 µs (52.6%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~1d5d526566, baseline=1.57.0-SNAPSHOT~2229c621bd
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.175 ms) : 17990, 18359
.   : milestone, 18175,
appsec (18.643 ms) : 18453, 18833
.   : milestone, 18643,
code_origins (18.072 ms) : 17894, 18250
.   : milestone, 18072,
iast (17.969 ms) : 17788, 18150
.   : milestone, 17969,
profiling (19.649 ms) : 19449, 19849
.   : milestone, 19649,
tracing (17.654 ms) : 17480, 17828
.   : milestone, 17654,
section candidate
no_agent (19.065 ms) : 18872, 19258
.   : milestone, 19065,
appsec (19.131 ms) : 18938, 19324
.   : milestone, 19131,
code_origins (17.894 ms) : 17715, 18072
.   : milestone, 17894,
iast (18.162 ms) : 17981, 18343
.   : milestone, 18162,
profiling (18.999 ms) : 18804, 19195
.   : milestone, 18999,
tracing (17.869 ms) : 17688, 18050
.   : milestone, 17869,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.175 ms [17.99 ms, 18.359 ms] -
appsec 18.643 ms [18.453 ms, 18.833 ms] 468.125 µs (2.6%)
code_origins 18.072 ms [17.894 ms, 18.25 ms] -102.706 µs (-0.6%)
iast 17.969 ms [17.788 ms, 18.15 ms] -205.579 µs (-1.1%)
profiling 19.649 ms [19.449 ms, 19.849 ms] 1.475 ms (8.1%)
tracing 17.654 ms [17.48 ms, 17.828 ms] -520.614 µs (-2.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.065 ms [18.872 ms, 19.258 ms] -
appsec 19.131 ms [18.938 ms, 19.324 ms] 66.13 µs (0.3%)
code_origins 17.894 ms [17.715 ms, 18.072 ms] -1.171 ms (-6.1%)
iast 18.162 ms [17.981 ms, 18.343 ms] -903.184 µs (-4.7%)
profiling 18.999 ms [18.804 ms, 19.195 ms] -65.36 µs (-0.3%)
tracing 17.869 ms [17.688 ms, 18.05 ms] -1.196 ms (-6.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/open-feature-sdk-smoke
git_commit_date 1765268180 1765270230
git_commit_sha 2229c62 1d5d526
release_version 1.57.0-SNAPSHOT~2229c621bd 1.57.0-SNAPSHOT~1d5d526566
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1765272571 1765272571
ci_job_id 1278497359 1278497359
ci_pipeline_id 85506160 85506160
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-mo8pvgrt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-mo8pvgrt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~1d5d526566, baseline=1.57.0-SNAPSHOT~2229c621bd
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.082 s) : 15082000, 15082000
.   : milestone, 15082000,
appsec (14.698 s) : 14698000, 14698000
.   : milestone, 14698000,
iast (18.288 s) : 18288000, 18288000
.   : milestone, 18288000,
iast_GLOBAL (17.894 s) : 17894000, 17894000
.   : milestone, 17894000,
profiling (14.507 s) : 14507000, 14507000
.   : milestone, 14507000,
tracing (15.028 s) : 15028000, 15028000
.   : milestone, 15028000,
section candidate
no_agent (15.33 s) : 15330000, 15330000
.   : milestone, 15330000,
appsec (14.552 s) : 14552000, 14552000
.   : milestone, 14552000,
iast (18.339 s) : 18339000, 18339000
.   : milestone, 18339000,
iast_GLOBAL (17.866 s) : 17866000, 17866000
.   : milestone, 17866000,
profiling (14.54 s) : 14540000, 14540000
.   : milestone, 14540000,
tracing (14.853 s) : 14853000, 14853000
.   : milestone, 14853000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.082 s [15.082 s, 15.082 s] -
appsec 14.698 s [14.698 s, 14.698 s] -384.0 ms (-2.5%)
iast 18.288 s [18.288 s, 18.288 s] 3.206 s (21.3%)
iast_GLOBAL 17.894 s [17.894 s, 17.894 s] 2.812 s (18.6%)
profiling 14.507 s [14.507 s, 14.507 s] -575.0 ms (-3.8%)
tracing 15.028 s [15.028 s, 15.028 s] -54.0 ms (-0.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.33 s [15.33 s, 15.33 s] -
appsec 14.552 s [14.552 s, 14.552 s] -778.0 ms (-5.1%)
iast 18.339 s [18.339 s, 18.339 s] 3.009 s (19.6%)
iast_GLOBAL 17.866 s [17.866 s, 17.866 s] 2.536 s (16.5%)
profiling 14.54 s [14.54 s, 14.54 s] -790.0 ms (-5.2%)
tracing 14.853 s [14.853 s, 14.853 s] -477.0 ms (-3.1%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~1d5d526566, baseline=1.57.0-SNAPSHOT~2229c621bd
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1471, 1494
.   : milestone, 1483,
appsec (3.687 ms) : 3471, 3904
.   : milestone, 3687,
iast (2.218 ms) : 2154, 2282
.   : milestone, 2218,
iast_GLOBAL (2.268 ms) : 2203, 2332
.   : milestone, 2268,
profiling (2.071 ms) : 2018, 2123
.   : milestone, 2071,
tracing (2.059 ms) : 2008, 2110
.   : milestone, 2059,
section candidate
no_agent (1.477 ms) : 1466, 1489
.   : milestone, 1477,
appsec (3.718 ms) : 3496, 3940
.   : milestone, 3718,
iast (2.227 ms) : 2163, 2292
.   : milestone, 2227,
iast_GLOBAL (2.264 ms) : 2199, 2328
.   : milestone, 2264,
profiling (2.092 ms) : 2038, 2146
.   : milestone, 2092,
tracing (2.064 ms) : 2013, 2115
.   : milestone, 2064,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.471 ms, 1.494 ms] -
appsec 3.687 ms [3.471 ms, 3.904 ms] 2.205 ms (148.7%)
iast 2.218 ms [2.154 ms, 2.282 ms] 735.191 µs (49.6%)
iast_GLOBAL 2.268 ms [2.203 ms, 2.332 ms] 784.925 µs (52.9%)
profiling 2.071 ms [2.018 ms, 2.123 ms] 588.065 µs (39.7%)
tracing 2.059 ms [2.008 ms, 2.11 ms] 576.688 µs (38.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.466 ms, 1.489 ms] -
appsec 3.718 ms [3.496 ms, 3.94 ms] 2.24 ms (151.6%)
iast 2.227 ms [2.163 ms, 2.292 ms] 749.825 µs (50.7%)
iast_GLOBAL 2.264 ms [2.199 ms, 2.328 ms] 786.043 µs (53.2%)
profiling 2.092 ms [2.038 ms, 2.146 ms] 614.351 µs (41.6%)
tracing 2.064 ms [2.013 ms, 2.115 ms] 586.472 µs (39.7%)

@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch 3 times, most recently from 6fea068 to c73df5f Compare November 16, 2025 23:11
@datadog-datadog-prod-us1

This comment has been minimized.

Sign in to view
@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch 3 times, most recently from ddb9b65 to cf1db21 Compare November 18, 2025 23:35
@manuel-alvarez-alvarez manuel-alvarez-alvarez requested a review from a team as a code owner November 18, 2025 23:56
@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch from 8e8f321 to 6b99c46 Compare November 18, 2025 23:59
@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch from 6b99c46 to 6f66fc2 Compare November 19, 2025 11:24
@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch 3 times, most recently from 359af31 to 61689a5 Compare November 19, 2025 15:03
Base automatically changed from malvarez/open-feature-sdk to master November 20, 2025 00:03
@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch from 61689a5 to 52aa2a3 Compare November 20, 2025 00:12
@github-actions
Copy link
Contributor

github-actions bot commented Nov 20, 2025 •
edited
Loading

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@manuel-alvarez-alvarez manuel-alvarez-alvarez added comp: testing Testing tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements labels Nov 20, 2025
@PerfectSlayer PerfectSlayer added comp: openfeature OpenFeature and removed comp: testing Testing labels Nov 21, 2025
PerfectSlayer
PerfectSlayer approved these changes Nov 21, 2025
View reviewed changes
Copy link
Contributor

@PerfectSlayer PerfectSlayer left a comment •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👏 praise: ‏Thanks for adding smoke tests

The app looks to crash at startup though 🤔

@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch 2 times, most recently from 40b9326 to fd73966 Compare November 21, 2025 16:33
@manuel-alvarez-alvarez
Copy link
Member Author

manuel-alvarez-alvarez commented Nov 21, 2025

👏 praise: ‏Thanks for adding smoke tests

The app looks to crash at startup though 🤔

Thanks for the review. Yes, I forgot to remove the debugging configuration which I use locally to troubleshoot issues, should be fine by now 😄

@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch 2 times, most recently from c48da34 to 76eaefb Compare November 26, 2025 14:52
@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch from 76eaefb to cf018b2 Compare November 27, 2025 09:28
@manuel-alvarez-alvarez manuel-alvarez-alvarez merged commit ed42e7f into master Dec 9, 2025
539 checks passed
@manuel-alvarez-alvarez manuel-alvarez-alvarez deleted the malvarez/open-feature-sdk-smoke branch December 9, 2025 10:26
@github-actions github-actions bot added this to the 1.57.0 milestone Dec 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD Awaiting requested review from AlexeyKuznetsov-DD AlexeyKuznetsov-DD is a code owner automatically assigned from DataDog/apm-lang-platform-java

@smola smola Awaiting requested review from smola smola is a code owner automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

comp: openfeature OpenFeature tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.57.0

Development

Successfully merging this pull request may close these issues.

3 participants

@manuel-alvarez-alvarez @PerfectSlayer