You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
PR #129436 adds a WebAssembly + CoreCLR libraries-test leg to the scheduled outerloop pipeline, enabling [OuterLoop] and long-running suites (re-enabled from #125495) with extended Helix/xharness timeouts.
A handful of individual tests are still too slow or too resource-heavy to finish within the per-suite xharness timeout (4h) on the single-threaded wasm interpreter, so they were skipped on Browser via [SkipOnPlatform(TestPlatforms.Browser, …)]. This issue tracks those skips so they can be revisited when wasm test execution gets faster (e.g. JIT/AOT for test runs, threading) or the tests are made cheaper.
These skips only affect the new wasm/CoreCLR outerloop lane — desktop and other platforms are unchanged, and these tests never ran on any wasm innerloop lane.
Tests skipped because they are too slow (CPU time) on the wasm interpreter
System.Linq.Parallel.Tests — the full [OuterLoop] combinatorial matrix expands to ~195k cases on a single-threaded wasm session (~72 MB results file exceeding xharness's 30 MB upload limit, ~1.3 GB heap, tab crash at teardown). PLINQ has no real parallelism on a single thread, so this is dropped on the wasm/CoreCLR lane via WithoutCategories=OuterLoop.
Related — different root cause (a hang, not slowness)
System.Private.Xml.LinqxNodeBuilder/FunctionalTests.RunTests — also skipped on Browser in [browser][coreclr] Add wasm/CoreCLR libraries tests to outerloop CI #129436, but because the wasm runtime hangs at shutdown after this suite completes (a hang, not slowness). Listed here for completeness; likely warrants its own investigation.
Re-enablement criteria
Revisit each skip when wasm test execution is materially faster (JIT/AOT for test assemblies, multithreaded runtime) or when the individual tests are restructured to be cheaper.
Related: #125495, #129436.
Note
This issue was drafted with the help of GitHub Copilot.
Background
PR #129436 adds a WebAssembly + CoreCLR libraries-test leg to the scheduled outerloop pipeline, enabling
[OuterLoop]and long-running suites (re-enabled from #125495) with extended Helix/xharness timeouts.A handful of individual tests are still too slow or too resource-heavy to finish within the per-suite xharness timeout (4h) on the single-threaded wasm interpreter, so they were skipped on Browser via
[SkipOnPlatform(TestPlatforms.Browser, …)]. This issue tracks those skips so they can be revisited when wasm test execution gets faster (e.g. JIT/AOT for test runs, threading) or the tests are made cheaper.These skips only affect the new wasm/CoreCLR outerloop lane — desktop and other platforms are unchanged, and these tests never ran on any wasm innerloop lane.
Tests skipped because they are too slow (CPU time) on the wasm interpreter
CompilerTests.CompileDeepTree_NoStackOverflowEncodingExtensionsTests.GetBytes_Encoding_ReadOnlySequence_IBufferWriter_LargeMultiSegmentEncodingExtensionsTests.GetChars_Encoding_ReadOnlySequence_IBufferWriter_LargeMultiSegmentBitStackTests.BitStackPushPopLargeStream.ReadTests.ReadTypeFromJsonWithLargeIgnoredProperties_OuterLoopUtf8JsonReaderTests.TestJsonReaderLargestUtf8SegmentSizeOneUtf8JsonReaderTests.TestPartialJsonReaderSlicesMultiSegmentUtf8JsonReaderTests.TestPartialJsonReaderSlicesSpecialNumbersUtf8JsonWriterTests.Writing3MBBase64BytesUtf8JsonWriterTests.EscapeCharacters[OuterLoop]on Mono)Utf8JsonWriterTests.WriteNumbers[OuterLoop]on Mono)Tests skipped due to memory exhaustion on the constrained wasm heap (related)
FrozenDictionaryTests.ToFrozenDictionary_WithExtremelyLargeStringsFrozenSetTests.ToFrozenSet_WithExtremelyLargeStringsWhole
[OuterLoop]category skipped for one suite[OuterLoop]combinatorial matrix expands to ~195k cases on a single-threaded wasm session (~72 MB results file exceeding xharness's 30 MB upload limit, ~1.3 GB heap, tab crash at teardown). PLINQ has no real parallelism on a single thread, so this is dropped on the wasm/CoreCLR lane viaWithoutCategories=OuterLoop.Related — different root cause (a hang, not slowness)
xNodeBuilder/FunctionalTests.RunTests— also skipped on Browser in [browser][coreclr] Add wasm/CoreCLR libraries tests to outerloop CI #129436, but because the wasm runtime hangs at shutdown after this suite completes (a hang, not slowness). Listed here for completeness; likely warrants its own investigation.Re-enablement criteria
Revisit each skip when wasm test execution is materially faster (JIT/AOT for test assemblies, multithreaded runtime) or when the individual tests are restructured to be cheaper.
Related: #125495, #129436.
Note
This issue was drafted with the help of GitHub Copilot.