Test failure JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

[v-wenyuxu]

Failed in: runtime-coreclr outerloop 20230712.4

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.315.Amd64.Open)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 317: -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll: No such file or directory
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 258:  8885 Killed                  $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
19:32:02
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
--verify-type-and-field-layout
--method-layout:random
--targetarch:x64
--targetos:linux
-O
Running CrossGen2:  dotnet /root/helix/work/correlation/crossgen2/crossgen2.dll @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp  
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 467
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 448
19:36:36
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 7/12/2023 7:32:02 PM
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh
Expected: True
Actual:   False

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/xunit.assert/Asserts/BooleanAsserts.cs:line 132
   at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/xunit.assert/Asserts/BooleanAsserts.cs:line 116
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

[mangod9]

looks like another case of BadImageFormatException we have seen in the past. Believe that issue had gone away on its own?

[trylek]

This looks like a non-deterministic OOM in the Linux container. The regression test is a stress-type test involving a method with over 60K lines of code. I don't think we can do anything about it in .NET 8 timeframe but it's obviously a corner case, moving to .NET 9.

[v-wenyuxu]

Failed again in: runtime-coreclr outerloop 20230806.2

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.315.Amd64.Open)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 316: -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll: No such file or directory
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 258:  8879 Killed                  $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
20:03:57
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
--verify-type-and-field-layout
--method-layout:random
--targetarch:x64
--targetos:linux
Running CrossGen2:  dotnet /root/helix/work/correlation/crossgen2/crossgen2.dll @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp  
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 467
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 448
20:04:14
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 8/6/2023 8:03:57 PM
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh
Expected: True
Actual:   False

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/xunit.assert/Asserts/BooleanAsserts.cs:line 132
   at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/xunit.assert/Asserts/BooleanAsserts.cs:line 116
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

[v-wenyuxu]

Failed again in: runtime-coreclr r2r-extra 20230812.1

Failed tests:

R2R-CG2 linux x64 Checked gcstress0xc @ Ubuntu.1804.Amd64.Open
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

/datadisks/disk1/work/A64D08F7/w/A9AA0978/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 316: -r:/datadisks/disk1/work/A64D08F7/w/A9AA0978/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll: No such file or directory
/datadisks/disk1/work/A64D08F7/w/A9AA0978/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 258: 10651 Killed                  $__Command

Return code:      1
Raw output file:      /datadisks/disk1/work/A64D08F7/w/A9AA0978/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/datadisks/disk1/work/A64D08F7/w/A9AA0978/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
04:10:23
Response file: /datadisks/disk1/work/A64D08F7/w/A9AA0978/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/datadisks/disk1/work/A64D08F7/w/A9AA0978/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/datadisks/disk1/work/A64D08F7/w/A9AA0978/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
-r:/datadisks/disk1/work/A64D08F7/p/System.*.dll
-r:/datadisks/disk1/work/A64D08F7/p/Microsoft.*.dll
-r:/datadisks/disk1/work/A64D08F7/p/xunit.*.dll
-r:/datadisks/disk1/work/A64D08F7/p/mscorlib.dll
--verify-type-and-field-layout
--method-layout:random
--targetarch:x64
--targetos:linux
Running CrossGen2:  dotnet /datadisks/disk1/work/A64D08F7/p/crossgen2/crossgen2.dll @/datadisks/disk1/work/A64D08F7/w/A9AA0978/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp  
Running R2RDump:  dotnet /datadisks/disk1/work/A64D08F7/p/R2RDump/R2RDump.dll --header --sc --in /datadisks/disk1/work/A64D08F7/w/A9AA0978/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /datadisks/disk1/work/A64D08F7/w/A9AA0978/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 467
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 448
04:10:38
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 8/13/2023 4:10:23 AM
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /datadisks/disk1/work/A64D08F7/w/A9AA0978/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh
Expected: True
Actual:   False

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/xunit.assert/Asserts/BooleanAsserts.cs:line 132
   at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/xunit.assert/Asserts/BooleanAsserts.cs:line 116
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)