Add testing for latest Microsoft.Data.Sqlite #6369

andrewlock · 2024-11-28T15:07:36Z

Summary of changes

Update the test app versions to include 9.0.0

Reason for change

We want to test the latest package versions

Implementation details

Bumped the supported package versions, and re-generated. I dropped explicit testing of a few of the intermediate versions just to reduce the load

Test coverage

More

Other details

Also updates the supported versions in some cases where the json should have already been updated

https://datadoghq.atlassian.net/browse/AIDM-502

andrewlock · 2024-11-28T15:38:59Z

Execution-Time Benchmarks Report ⏱️

Execution-time results for samples comparing the following branches/commits:

Execution-time benchmarks measure the whole time it takes to execute a program. And are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are shown in red. The following thresholds were used for comparing the execution times:

Welch test with statistical test for significance of 5%
Only results indicating a difference greater than 5% and 5 ms are considered.

Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.

Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).

gantt
    title Execution time (ms) FakeDbCommand (.NET Framework 4.6.2) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6369) - mean (69ms)  : 66, 71
     .   : milestone, 69,
    master - mean (69ms)  : 66, 72
     .   : milestone, 69,

    section CallTarget+Inlining+NGEN
    This PR (6369) - mean (979ms)  : 949, 1008
     .   : milestone, 979,
    master - mean (981ms)  : 961, 1002
     .   : milestone, 981,

gantt
    title Execution time (ms) FakeDbCommand (.NET Core 3.1) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6369) - mean (108ms)  : 105, 110
     .   : milestone, 108,
    master - mean (108ms)  : 106, 109
     .   : milestone, 108,

    section CallTarget+Inlining+NGEN
    This PR (6369) - mean (678ms)  : 664, 691
     .   : milestone, 678,
    master - mean (680ms)  : 664, 697
     .   : milestone, 680,

gantt
    title Execution time (ms) FakeDbCommand (.NET 6) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6369) - mean (91ms)  : 89, 93
     .   : milestone, 91,
    master - mean (91ms)  : 90, 93
     .   : milestone, 91,

    section CallTarget+Inlining+NGEN
    This PR (6369) - mean (629ms)  : 616, 643
     .   : milestone, 629,
    master - mean (632ms)  : 619, 645
     .   : milestone, 632,

gantt
    title Execution time (ms) HttpMessageHandler (.NET Framework 4.6.2) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6369) - mean (190ms)  : 186, 194
     .   : milestone, 190,
    master - mean (191ms)  : 186, 195
     .   : milestone, 191,

    section CallTarget+Inlining+NGEN
    This PR (6369) - mean (1,091ms)  : 1057, 1125
     .   : milestone, 1091,
    master - mean (1,089ms)  : 1059, 1119
     .   : milestone, 1089,

gantt
    title Execution time (ms) HttpMessageHandler (.NET Core 3.1) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6369) - mean (276ms)  : 272, 281
     .   : milestone, 276,
    master - mean (275ms)  : 271, 278
     .   : milestone, 275,

    section CallTarget+Inlining+NGEN
    This PR (6369) - mean (868ms)  : 844, 893
     .   : milestone, 868,
    master - mean (869ms)  : 837, 901
     .   : milestone, 869,

gantt
    title Execution time (ms) HttpMessageHandler (.NET 6) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6369) - mean (266ms)  : 262, 269
     .   : milestone, 266,
    master - mean (265ms)  : 261, 270
     .   : milestone, 265,

    section CallTarget+Inlining+NGEN
    This PR (6369) - mean (854ms)  : 810, 898
     .   : milestone, 854,
    master - mean (853ms)  : 824, 881
     .   : milestone, 853,

datadog-ddstaging · 2024-11-28T16:11:34Z

Datadog Report

Branch report: andrew/ci/test-latest-microsoft-data-sqlite
Commit report: 207f517
Test service: dd-trace-dotnet

✅ 0 Failed, 452583 Passed, 2754 Skipped, 19h 36m 25.29s Total Time
❄️ 1 New Flaky

New Flaky Tests (1)

TestInstrumentedUnitTests - Datadog.Trace.Security.IntegrationTests.Iast.IastInstrumentationUnitTests - Last Failure
Expand for error
```
 Expected exit code: 0, actual exit code: 1.
```

andrewlock · 2024-11-28T16:31:46Z

Benchmarks Report for tracer 🐌

Benchmarks for #6369 compared to master:

1 benchmarks are faster, with geometric mean 1.131
2 benchmarks are slower, with geometric mean 1.161
All benchmarks have the same allocations

The following thresholds were used for comparing the benchmark speeds:

Mann–Whitney U test with statistical test for significance of 5%
Only results indicating a difference greater than 10% and 0.3 ns are considered.

Allocation changes below 0.5% are ignored.

Benchmark details

Benchmarks.Trace.ActivityBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Gen 1	Gen 2	Allocated
master	`StartStopWithChild`	net6.0	7.95μs	43ns	228ns	0.0238	0.00794	0	5.61 KB
master	`StartStopWithChild`	netcoreapp3.1	9.96μs	54.6ns	345ns	0.0202	0.0101	0	5.81 KB
master	`StartStopWithChild`	net472	16.2μs	49.5ns	192ns	1.04	0.305	0.0964	6.21 KB
#6369	`StartStopWithChild`	net6.0	7.92μs	44.9ns	318ns	0.015	0.00749	0	5.61 KB
#6369	`StartStopWithChild`	netcoreapp3.1	9.83μs	54.5ns	332ns	0.0242	0.00969	0	5.81 KB
#6369	`StartStopWithChild`	net472	16μs	46.9ns	169ns	1.03	0.296	0.0881	6.2 KB

Benchmarks.Trace.AgentWriterBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`WriteAndFlushEnrichedTraces`	net6.0	489μs	519ns	2.01μs	0	2.7 KB
master	`WriteAndFlushEnrichedTraces`	netcoreapp3.1	660μs	300ns	1.12μs	0	2.7 KB
master	`WriteAndFlushEnrichedTraces`	net472	856μs	435ns	1.68μs	0.428	3.3 KB
#6369	`WriteAndFlushEnrichedTraces`	net6.0	482μs	347ns	1.34μs	0	2.7 KB
#6369	`WriteAndFlushEnrichedTraces`	netcoreapp3.1	670μs	244ns	943ns	0	2.7 KB
#6369	`WriteAndFlushEnrichedTraces`	net472	849μs	555ns	2.15μs	0.422	3.3 KB

Benchmarks.Trace.AspNetCoreBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`SendRequest`	net6.0	149μs	905ns	9.01μs	0.14	14.47 KB
master	`SendRequest`	netcoreapp3.1	170μs	1.01μs	9.72μs	0.16	17.27 KB
master	`SendRequest`	net472	0.000648ns	0.000333ns	0.00129ns	0	0 b
#6369	`SendRequest`	net6.0	151μs	836ns	7.29μs	0.213	14.47 KB
#6369	`SendRequest`	netcoreapp3.1	170μs	1.06μs	10.5μs	0.157	17.27 KB
#6369	`SendRequest`	net472	0.000123ns	0.000107ns	0.000385ns	0	0 b

Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Gen 1	Gen 2	Allocated
master	`WriteAndFlushEnrichedTraces`	net6.0	573μs	3.21μs	20.8μs	0.563	0	0	41.56 KB
master	`WriteAndFlushEnrichedTraces`	netcoreapp3.1	687μs	3.4μs	14.4μs	0.331	0	0	41.85 KB
master	`WriteAndFlushEnrichedTraces`	net472	866μs	4.24μs	18.9μs	8.45	2.53	0.422	53.33 KB
#6369	`WriteAndFlushEnrichedTraces`	net6.0	570μs	3.19μs	19.9μs	0.571	0	0	41.6 KB
#6369	`WriteAndFlushEnrichedTraces`	netcoreapp3.1	702μs	3.84μs	21μs	0.343	0	0	41.94 KB
#6369	`WriteAndFlushEnrichedTraces`	net472	887μs	4.69μs	24.4μs	8.19	2.59	0.431	53.33 KB

Benchmarks.Trace.DbCommandBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Gen 1	Allocated
master	`ExecuteNonQuery`	net6.0	1.38μs	1.62ns	6.27ns	0.014	0	1.02 KB
master	`ExecuteNonQuery`	netcoreapp3.1	1.75μs	1.28ns	4.94ns	0.0141	0	1.02 KB
master	`ExecuteNonQuery`	net472	2.06μs	1.74ns	6.52ns	0.157	0.00103	987 B
#6369	`ExecuteNonQuery`	net6.0	1.25μs	0.906ns	3.39ns	0.0144	0	1.02 KB
#6369	`ExecuteNonQuery`	netcoreapp3.1	1.73μs	0.987ns	3.82ns	0.0138	0	1.02 KB
#6369	`ExecuteNonQuery`	net472	2.09μs	1.12ns	3.89ns	0.156	0.00104	987 B

Benchmarks.Trace.ElasticsearchBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`CallElasticsearch`	net6.0	1.07μs	0.383ns	1.48ns	0.0139	976 B
master	`CallElasticsearch`	netcoreapp3.1	1.53μs	3.8ns	14.7ns	0.0127	976 B
master	`CallElasticsearch`	net472	2.53μs	1.78ns	6.91ns	0.158	995 B
master	`CallElasticsearchAsync`	net6.0	1.35μs	0.994ns	3.85ns	0.0129	952 B
master	`CallElasticsearchAsync`	netcoreapp3.1	1.62μs	0.928ns	3.47ns	0.0139	1.02 KB
master	`CallElasticsearchAsync`	net472	2.57μs	1.16ns	4.5ns	0.166	1.05 KB
#6369	`CallElasticsearch`	net6.0	1.19μs	2.3ns	8.6ns	0.0135	976 B
#6369	`CallElasticsearch`	netcoreapp3.1	1.56μs	1.42ns	5.51ns	0.0133	976 B
#6369	`CallElasticsearch`	net472	2.59μs	0.895ns	3.35ns	0.157	995 B
#6369	`CallElasticsearchAsync`	net6.0	1.26μs	0.631ns	2.44ns	0.0134	952 B
#6369	`CallElasticsearchAsync`	netcoreapp3.1	1.64μs	0.832ns	3.22ns	0.0139	1.02 KB
#6369	`CallElasticsearchAsync`	net472	2.66μs	1.45ns	5.43ns	0.167	1.05 KB

Benchmarks.Trace.GraphQLBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`ExecuteAsync`	net6.0	1.36μs	0.59ns	2.28ns	0.0129	952 B
master	`ExecuteAsync`	netcoreapp3.1	1.71μs	1.26ns	4.73ns	0.0128	952 B
master	`ExecuteAsync`	net472	1.8μs	0.991ns	3.84ns	0.145	915 B
#6369	`ExecuteAsync`	net6.0	1.27μs	0.641ns	2.48ns	0.0134	952 B
#6369	`ExecuteAsync`	netcoreapp3.1	1.66μs	0.642ns	2.32ns	0.0126	952 B
#6369	`ExecuteAsync`	net472	1.82μs	0.409ns	1.58ns	0.145	915 B

Benchmarks.Trace.HttpClientBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`SendAsync`	net6.0	4.39μs	0.787ns	2.84ns	0.0329	2.31 KB
master	`SendAsync`	netcoreapp3.1	5.3μs	1.78ns	6.65ns	0.0372	2.85 KB
master	`SendAsync`	net472	7.32μs	1.84ns	7.12ns	0.496	3.12 KB
#6369	`SendAsync`	net6.0	4.41μs	2.24ns	8.39ns	0.033	2.31 KB
#6369	`SendAsync`	netcoreapp3.1	5.34μs	2.41ns	9.03ns	0.0373	2.85 KB
#6369	`SendAsync`	net472	7.36μs	1.77ns	6.87ns	0.493	3.12 KB

Benchmarks.Trace.ILoggerBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`EnrichedLog`	net6.0	1.44μs	0.902ns	3.25ns	0.0232	1.64 KB
master	`EnrichedLog`	netcoreapp3.1	2.2μs	1.08ns	4.02ns	0.0222	1.64 KB
master	`EnrichedLog`	net472	2.57μs	0.955ns	3.57ns	0.249	1.57 KB
#6369	`EnrichedLog`	net6.0	1.57μs	0.814ns	3.04ns	0.0234	1.64 KB
#6369	`EnrichedLog`	netcoreapp3.1	2.25μs	1.18ns	4.58ns	0.0224	1.64 KB
#6369	`EnrichedLog`	net472	2.77μs	1.04ns	3.88ns	0.25	1.57 KB

Benchmarks.Trace.Log4netBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Gen 1	Allocated
master	`EnrichedLog`	net6.0	119μs	167ns	648ns	0	0	4.28 KB
master	`EnrichedLog`	netcoreapp3.1	124μs	80.7ns	313ns	0	0	4.28 KB
master	`EnrichedLog`	net472	152μs	118ns	424ns	0.681	0.227	4.46 KB
#6369	`EnrichedLog`	net6.0	120μs	150ns	581ns	0	0	4.28 KB
#6369	`EnrichedLog`	netcoreapp3.1	124μs	72.7ns	282ns	0	0	4.28 KB
#6369	`EnrichedLog`	net472	153μs	167ns	648ns	0.686	0.229	4.46 KB

Benchmarks.Trace.NLogBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`EnrichedLog`	net6.0	3.14μs	0.853ns	3.19ns	0.0299	2.2 KB
master	`EnrichedLog`	netcoreapp3.1	4.24μs	1.61ns	6.25ns	0.03	2.2 KB
master	`EnrichedLog`	net472	4.86μs	1.96ns	7.59ns	0.319	2.02 KB
#6369	`EnrichedLog`	net6.0	3.05μs	0.912ns	3.53ns	0.0304	2.2 KB
#6369	`EnrichedLog`	netcoreapp3.1	4.1μs	2.24ns	8.37ns	0.0307	2.2 KB
#6369	`EnrichedLog`	net472	4.86μs	1.02ns	3.95ns	0.319	2.02 KB

Benchmarks.Trace.RedisBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`SendReceive`	net6.0	1.36μs	0.625ns	2.16ns	0.0164	1.14 KB
master	`SendReceive`	netcoreapp3.1	1.68μs	1.22ns	4.24ns	0.015	1.14 KB
master	`SendReceive`	net472	2.05μs	0.976ns	3.52ns	0.183	1.16 KB
#6369	`SendReceive`	net6.0	1.37μs	0.604ns	2.34ns	0.0159	1.14 KB
#6369	`SendReceive`	netcoreapp3.1	1.8μs	0.747ns	2.89ns	0.0153	1.14 KB
#6369	`SendReceive`	net472	2.15μs	1.21ns	4.51ns	0.183	1.16 KB

Benchmarks.Trace.SerilogBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`EnrichedLog`	net6.0	2.75μs	0.938ns	3.51ns	0.0219	1.6 KB
master	`EnrichedLog`	netcoreapp3.1	3.95μs	1.67ns	6.48ns	0.0217	1.65 KB
master	`EnrichedLog`	net472	4.41μs	2.38ns	9.21ns	0.324	2.04 KB
#6369	`EnrichedLog`	net6.0	2.84μs	1.02ns	3.82ns	0.0219	1.6 KB
#6369	`EnrichedLog`	netcoreapp3.1	3.76μs	2.03ns	7.59ns	0.0226	1.65 KB
#6369	`EnrichedLog`	net472	4.29μs	0.996ns	3.73ns	0.322	2.04 KB

Benchmarks.Trace.SpanBenchmark - Slower ⚠️ Same allocations ✔️

Slower ⚠️ in #6369

Benchmark	diff/base	Base Median (ns)	Diff Median (ns)	Modality
Benchmarks.Trace.SpanBenchmark.StartFinishSpan‑net6.0	1.135	395.67	449.28

Faster 🎉 in #6369

Benchmark	base/diff	Base Median (ns)	Diff Median (ns)	Modality
Benchmarks.Trace.SpanBenchmark.StartFinishScope‑net472	1.131	934.38	825.83

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`StartFinishSpan`	net6.0	395ns	0.512ns	1.84ns	0.00814	576 B
master	`StartFinishSpan`	netcoreapp3.1	556ns	2.07ns	8.01ns	0.00789	576 B
master	`StartFinishSpan`	net472	724ns	2.09ns	8.08ns	0.0915	578 B
master	`StartFinishScope`	net6.0	540ns	0.911ns	3.53ns	0.00984	696 B
master	`StartFinishScope`	netcoreapp3.1	775ns	1.25ns	4.85ns	0.00926	696 B
master	`StartFinishScope`	net472	934ns	1.22ns	4.73ns	0.104	658 B
#6369	`StartFinishSpan`	net6.0	449ns	0.603ns	2.33ns	0.00797	576 B
#6369	`StartFinishSpan`	netcoreapp3.1	591ns	0.704ns	2.73ns	0.00769	576 B
#6369	`StartFinishSpan`	net472	679ns	1.21ns	4.67ns	0.0916	578 B
#6369	`StartFinishScope`	net6.0	533ns	0.475ns	1.84ns	0.00977	696 B
#6369	`StartFinishScope`	netcoreapp3.1	774ns	2.13ns	8.25ns	0.00954	696 B
#6369	`StartFinishScope`	net472	828ns	1.61ns	6.24ns	0.104	658 B

Benchmarks.Trace.TraceAnnotationsBenchmark - Slower ⚠️ Same allocations ✔️

Slower ⚠️ in #6369

Benchmark	diff/base	Base Median (ns)	Diff Median (ns)	Modality
Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin‑net6.0	1.187	576.21	683.71

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`RunOnMethodBegin`	net6.0	576ns	0.608ns	2.35ns	0.00977	696 B
master	`RunOnMethodBegin`	netcoreapp3.1	913ns	1.52ns	5.9ns	0.00932	696 B
master	`RunOnMethodBegin`	net472	1.1μs	1.9ns	7.37ns	0.104	658 B
#6369	`RunOnMethodBegin`	net6.0	684ns	0.983ns	3.81ns	0.00977	696 B
#6369	`RunOnMethodBegin`	netcoreapp3.1	919ns	2.24ns	8.68ns	0.00923	696 B
#6369	`RunOnMethodBegin`	net472	997ns	1.19ns	4.46ns	0.104	658 B

andrewlock · 2024-11-28T20:25:44Z

Throughput/Crank Report ⚡

Throughput results for AspNetCoreSimpleController comparing the following branches/commits:

Cases where throughput results for the PR are worse than latest master (5% drop or greater), results are shown in red.

Note that these results are based on a single point-in-time result for each branch. For full results, see one of the many, many dashboards!

gantt
    title Throughput Linux x64 (Total requests) 
    dateFormat  X
    axisFormat %s
    section Baseline
    This PR (6369) (11.099M)   : 0, 11098717
    master (11.381M)   : 0, 11380797
    benchmarks/2.9.0 (11.033M)   : 0, 11032866

    section Automatic
    This PR (6369) (7.322M)   : 0, 7321761
    master (7.372M)   : 0, 7371851
    benchmarks/2.9.0 (7.786M)   : 0, 7785853

    section Trace stats
    master (7.651M)   : 0, 7651180

    section Manual
    master (11.409M)   : 0, 11409121

    section Manual + Automatic
    This PR (6369) (6.755M)   : 0, 6754533
    master (6.820M)   : 0, 6819669

    section DD_TRACE_ENABLED=0
    master (10.284M)   : 0, 10284096

gantt
    title Throughput Linux arm64 (Total requests) 
    dateFormat  X
    axisFormat %s
    section Baseline
    This PR (6369) (9.504M)   : 0, 9504041
    master (9.528M)   : 0, 9528332
    benchmarks/2.9.0 (9.495M)   : 0, 9494821

    section Automatic
    This PR (6369) (6.326M)   : 0, 6325756
    master (6.301M)   : 0, 6300873

    section Trace stats
    master (6.689M)   : 0, 6689036

    section Manual
    master (9.357M)   : 0, 9356534

    section Manual + Automatic
    This PR (6369) (5.998M)   : 0, 5998013
    master (5.894M)   : 0, 5894490

    section DD_TRACE_ENABLED=0
    master (8.921M)   : 0, 8920806

gantt
    title Throughput Windows x64 (Total requests) 
    dateFormat  X
    axisFormat %s
    section Baseline
    This PR (6369) (9.951M)   : 0, 9951458
    master (9.919M)   : 0, 9919361
    benchmarks/2.9.0 (10.020M)   : 0, 10019592

    section Automatic
    This PR (6369) (6.445M)   : 0, 6444607
    master (6.191M)   : 0, 6191193
    benchmarks/2.9.0 (7.255M)   : 0, 7255257

    section Trace stats
    master (6.913M)   : 0, 6912642

    section Manual
    master (9.741M)   : 0, 9741372

    section Manual + Automatic
    This PR (6369) (5.776M)   : 0, 5776307
    master (5.793M)   : 0, 5793028

    section DD_TRACE_ENABLED=0
    master (9.131M)   : 0, 9130759

## Summary of changes Update the test app versions to include 9.0.0 ## Reason for change We want to test the latest package versions ## Implementation details Bumped the supported package versions, and re-generated. I dropped explicit testing of a few of the intermediate versions just to reduce the load ## Test coverage More ## Other details Also updates the supported versions in some cases where the json should have already been updated https://datadoghq.atlassian.net/browse/AIDM-502

andrewlock added 2 commits November 28, 2024 14:41

Update Microsoft.Data.Sqlite to ensure we test latest

f6702aa

Update generated package versions

207f517

andrewlock added area:tests unit tests, integration tests area:test-apps apps used to test integrations labels Nov 28, 2024

andrewlock requested review from a team as code owners November 28, 2024 15:07

kevingosse approved these changes Nov 28, 2024

View reviewed changes

andrewlock merged commit 0bafe6c into master Nov 29, 2024
77 checks passed

andrewlock deleted the andrew/ci/test-latest-microsoft-data-sqlite branch November 29, 2024 11:27

github-actions bot added this to the vNext-v3 milestone Nov 29, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add testing for latest Microsoft.Data.Sqlite #6369

Add testing for latest Microsoft.Data.Sqlite #6369

andrewlock commented Nov 28, 2024 •

edited

Loading

andrewlock commented Nov 28, 2024

datadog-ddstaging bot commented Nov 28, 2024 •

edited

Loading

andrewlock commented Nov 28, 2024

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Slower ⚠️ in #6369

Faster 🎉 in #6369

Raw results

Slower ⚠️ in #6369

Raw results

andrewlock commented Nov 28, 2024

Add testing for latest Microsoft.Data.Sqlite #6369

Add testing for latest Microsoft.Data.Sqlite #6369

Conversation

andrewlock commented Nov 28, 2024 • edited Loading

Summary of changes

Reason for change

Implementation details

Test coverage

Other details

andrewlock commented Nov 28, 2024

Execution-Time Benchmarks Report ⏱️

datadog-ddstaging bot commented Nov 28, 2024 • edited Loading

Datadog Report

New Flaky Tests (1)

andrewlock commented Nov 28, 2024

Benchmarks Report for tracer 🐌

Benchmark details

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Slower ⚠️ in #6369

Faster 🎉 in #6369

Raw results

Slower ⚠️ in #6369

Raw results

andrewlock commented Nov 28, 2024

Throughput/Crank Report ⚡

andrewlock commented Nov 28, 2024 •

edited

Loading

datadog-ddstaging bot commented Nov 28, 2024 •

edited

Loading