Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test Failed: GetAsync_SetCookieContainer_CookieSent failed #12043

Closed
VincentBu opened this issue Feb 15, 2019 · 18 comments
Closed

Test Failed: GetAsync_SetCookieContainer_CookieSent failed #12043

VincentBu opened this issue Feb 15, 2019 · 18 comments
Assignees
Labels
area-System.Net.Http blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' test-run-core Test failures in .NET Core test runs
Milestone

Comments

@VincentBu
Copy link
Contributor

VincentBu commented Feb 15, 2019

Job: (JitStress - arm64)
https://ci.dot.net/job/dotnet_coreclr/job/master/view/arm64/job/jitstress/job/arm64_cross_checked_ubuntu16.04_corefx_tieredcompilation_tst/122/

Failed tests:
System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_Cookies_Http2.GetAsync_SetCookieContainer_CookieSent

Log:

System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_Cookies_Http2.GetAsync_SetCookieContainer_CookieSent(cookieName: "foo", cookieValue: "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"..., useCookies: True) [FAIL]
�[m�[37m      System.Net.Http.HttpRequestException : An error occurred while sending the request.
�[m�[30;1m      Stack Trace:
�[m�[37m        /mnt/j/workspace/dotnet_coreclr/master/jitstress/arm64_cross_checked_ubuntu16.04_corefx_tieredcompilation/_/fx/src/System.Net.Http/src/System/Net/Http/SocketsHttpHandler/Http2Connection.cs(1177,0): at System.Net.Http.Http2Connection.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
�[m�[37m        /mnt/j/workspace/dotnet_coreclr/master/jitstress/arm64_cross_checked_ubuntu16.04_corefx_tieredcompilation/_/fx/src/System.Net.Http/src/System/Net/Http/SocketsHttpHandler/HttpConnectionPool.cs(500,0): at System.Net.Http.HttpConnectionPool.SendWithRetryAsync(HttpRequestMessage request, Boolean doRequestAuth, CancellationToken cancellationToken)
�[m�[37m        /mnt/j/workspace/dotnet_coreclr/master/jitstress/arm64_cross_checked_ubuntu16.04_corefx_tieredcompilation/_/fx/src/System.Net.Http/src/System/Net/Http/SocketsHttpHandler/RedirectHandler.cs(33,0): at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
�[m�[37m        /mnt/j/workspace/dotnet_coreclr/master/jitstress/arm64_cross_checked_ubuntu16.04_corefx_tieredcompilation/_/fx/src/System.Net.Http/src/System/Net/Http/HttpClient.cs(475,0): at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
�[m�[37m        /mnt/j/workspace/dotnet_coreclr/master/jitstress/arm64_cross_checked_ubuntu16.04_corefx_tieredcompilation/_/fx/src/System.Net.Http/tests/FunctionalTests/HttpClientHandlerTest.Cookies.cs(70,0): at System.Net.Http.Functional.Tests.HttpClientHandlerTest_Cookies.<>c__DisplayClass9_0.<<GetAsync_SetCookieContainer_CookieSent>b__0>d.MoveNext()
@RussKeldorph
Copy link
Contributor

@karelz Could you take a look?

@karelz
Copy link
Member

karelz commented Feb 22, 2019

@wfurt to help

@wfurt wfurt self-assigned this Feb 22, 2019
@sandreenko
Copy link
Contributor

The test was disabled in dotnet/coreclr#22697.

@jeffschwMSFT jeffschwMSFT changed the title [arm64] Sending request failed [arm64] Test Failed: Sending request failed Aug 22, 2019
@msftgits msftgits transferred this issue from dotnet/coreclr Jan 31, 2020
@msftgits msftgits added this to the 5.0 milestone Jan 31, 2020
@karelz karelz added area-System.Net.Http test-run-core Test failures in .NET Core test runs and removed area-System.Net test-corefx labels Feb 23, 2020
@ericstj
Copy link
Member

ericstj commented Mar 25, 2020

Test just failed in CI: https://helixre107v0xdeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-33515-merge-8b65a7ac45014411b5/System.Net.Http.WinHttpHandler.Functional.Tests/console.e82308cb.log?sv=2019-02-02&se=2020-04-04T01%3A22%3A29Z&sr=c&sp=rl&sig=OW8KJTYfd%2FSpnffEHFtB42BhfMgeR6hD4RHzQtg1kYA%3D

ystem.Net.Http.Functional.Tests.PlatformHandlerTest_Cookies_Http2.GetAsync_SetCookieContainer_CookieSent(cookieName: "foo", cookieValue: "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"..., useCookies: True) [FAIL]
      System.Net.Http.HttpRequestException : Error while copying content to a stream.
      ---- System.IO.IOException : The read operation failed, see inner exception.
      -------- System.Net.Http.WinHttpException : Error 12030 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'La conexion con el servidor finalizo anormalmente'.
      Stack Trace:
        /_/src/libraries/System.Net.Http/src/System/Net/Http/HttpContent.cs(460,0): at System.Net.Http.HttpContent.LoadIntoBufferAsyncCore(Task serializeToStreamTask, MemoryStream tempBuffer)
        /_/src/libraries/System.Net.Http/src/System/Net/Http/HttpClient.cs(574,0): at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts, CancellationToken callerToken, Int64 timeoutTime)
        /_/src/libraries/Common/tests/System/Net/Http/HttpClientHandlerTest.Cookies.cs(78,0): at System.Net.Http.Functional.Tests.HttpClientHandlerTest_Cookies.<>c__DisplayClass10_0.<<GetAsync_SetCookieContainer_CookieSent>b__0>d.MoveNext()
        --- End of stack trace from previous location ---
        /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs(83,0): at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks)
        /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs(111,0): at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks)
        /_/src/libraries/Common/tests/System/Net/Http/GenericLoopbackServer.cs(32,0): at System.Net.Test.Common.LoopbackServerFactory.<>c__DisplayClass4_0.<<CreateClientAndServerAsync>b__0>d.MoveNext()
        --- End of stack trace from previous location ---
        /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs(38,0): at System.Threading.Tasks.TaskTimeoutExtensions.TimeoutAfter(Task task, TimeSpan timeout)
        /_/src/libraries/Common/tests/System/Net/Http/Http2LoopbackServer.cs(243,0): at System.Net.Test.Common.Http2LoopbackServerFactory.CreateServerAsync(Func`3 funcAsync, Int32 millisecondsTimeout, GenericLoopbackOptions options)
        /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs(38,0): at System.Threading.Tasks.TaskTimeoutExtensions.TimeoutAfter(Task task, TimeSpan timeout)
        /_/src/libraries/Common/tests/System/Net/Http/HttpClientHandlerTest.Cookies.cs(69,0): at System.Net.Http.Functional.Tests.HttpClientHandlerTest_Cookies.GetAsync_SetCookieContainer_CookieSent(String cookieName, String cookieValue, Boolean useCookies)
        --- End of stack trace from previous location ---
        ----- Inner Stack Trace -----
        /_/src/libraries/Common/src/System/Threading/Tasks/RendezvousAwaitable.cs(64,0): at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
        /_/src/libraries/System.Net.Http.WinHttpHandler/src/System/Net/Http/WinHttpResponseStream.cs(127,0): at System.Net.Http.WinHttpResponseStream.CopyToAsyncCore(Stream destination, Byte[] buffer, CancellationToken cancellationToken)
        /_/src/libraries/System.Net.Http/src/System/Net/Http/HttpContent.cs(460,0): at System.Net.Http.HttpContent.LoadIntoBufferAsyncCore(Task serializeToStreamTask, MemoryStream tempBuffer)
        ----- Inner Stack Trace -----

@ericstj ericstj changed the title [arm64] Test Failed: Sending request failed Test Failed: GetAsync_SetCookieContainer_CookieSent failed Mar 25, 2020
@jaredpar jaredpar added the blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' label Mar 25, 2020
@jaredpar
Copy link
Member

This test is now having a pretty significant impact on the build. If we can't fix we should look to disable soon.

Console Log Summary

 System.Net.Http.Functional.Tests.PlatformHandlerTest_Cookies_Http2.GetAsync_SetCookieContainer_CookieSent(cookieName: "ABC", cookieValue: "123", useCookies: False) [FAIL]
      System.Net.Http.HttpRequestException : Error while copying content to a stream.
      ---- System.IO.IOException : The read operation failed, see inner exception.
      -------- System.Net.Http.WinHttpException : Error 12030 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'La conexion con el servidor finalizo anormalmente'.
      Stack Trace:
        /_/src/libraries/System.Net.Http/src/System/Net/Http/HttpContent.cs(460,0): at System.Net.Http.HttpContent.LoadIntoBufferAsyncCore(Task serializeToStreamTask, MemoryStream tempBuffer)
        /_/src/libraries/System.Net.Http/src/System/Net/Http/HttpClient.cs(574,0): at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts, CancellationToken callerToken, Int64 timeoutTime)
        /_/src/libraries/Common/tests/System/Net/Http/HttpClientHandlerTest.Cookies.cs(78,0): at System.Net.Http.Functional.Tests.HttpClientHandlerTest_Cookies.<>c__DisplayClass10_0.<<GetAsync_SetCookieContainer_CookieSent>b__0>d.MoveNext()
        --- End of stack trace from previous location ---
        /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs(83,0): at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks)
        /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs(111,0): at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks)
        /_/src/libraries/Common/tests/System/Net/Http/GenericLoopbackServer.cs(32,0): at System.Net.Test.Common.LoopbackServerFactory.<>c__DisplayClass4_0.<<CreateClientAndServerAsync>b__0>d.MoveNext()
        --- End of stack trace from previous location ---
        /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs(38,0): at System.Threading.Tasks.TaskTimeoutExtensions.TimeoutAfter(Task task, TimeSpan timeout)
        /_/src/libraries/Common/tests/System/Net/Http/Http2LoopbackServer.cs(243,0): at System.Net.Test.Common.Http2LoopbackServerFactory.CreateServerAsync(Func`3 funcAsync, Int32 millisecondsTimeout, GenericLoopbackOptions options)
        /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs(38,0): at System.Threading.Tasks.TaskTimeoutExtensions.TimeoutAfter(Task task, TimeSpan timeout)
        /_/src/libraries/Common/tests/System/Net/Http/HttpClientHandlerTest.Cookies.cs(69,0): at System.Net.Http.Functional.Tests.HttpClientHandlerTest_Cookies.GetAsync_SetCookieContainer_CookieSent(String cookieName, String cookieValue, Boolean useCookies)
        --- End of stack trace from previous location ---
        ----- Inner Stack Trace -----
        /_/src/libraries/Common/src/System/Threading/Tasks/RendezvousAwaitable.cs(64,0): at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
        /_/src/libraries/System.Net.Http.WinHttpHandler/src/System/Net/Http/WinHttpResponseStream.cs(127,0): at System.Net.Http.WinHttpResponseStream.CopyToAsyncCore(Stream destination, Byte[] buffer, CancellationToken cancellationToken)
        /_/src/libraries/System.Net.Http/src/System/Net/Http/HttpContent.cs(460,0): at System.Net.Http.HttpContent.LoadIntoBufferAsyncCore(Task serializeToStreamTask, MemoryStream tempBuffer)
        ----- Inner Stack Trace -----

Builds

Build Pull Request Test Failure Count
#571145 #33485 1
#571242 #33990 1
#571351 #33881 2
#571369 #33831 1
#571410 #34032 1
#571488 #34040 1
#571536 #33175 1
#571546 #33459 1
#571555 #34022 1
#571580 #34029 1
#571835 Rolling 2
#571875 #34046 1
#571900 #33515 1
#571973 #34000 2
#572023 #34050 1
#572061 Rolling 1
#572108 #33459 2
#572194 Rolling 2
#572256 #33953 1
#572283 Rolling 1
#572349 Rolling 2
#572415 Rolling 1
#572535 #34065 4
#572573 #34022 1
#572708 Rolling 1
#572726 #33820 1
#572811 Rolling 1
#572998 #33732 1
#573124 #33984 1
#573152 #34050 1

Configurations

  • netcoreapp5.0-Windows_NT-Debug-x64-CoreCLR_checked-Windows.10.Amd64.Open
  • netcoreapp5.0-Windows_NT-Debug-x64-CoreCLR_release-(Windows.Nano.1809.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:nanoserver-1809-helix-amd64-08e8e40-20200107182504
  • netcoreapp5.0-Windows_NT-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server19H1.ES.Open
  • netcoreapp5.0-Windows_NT-Debug-x86-CoreCLR_release-Windows.10.Amd64.Server19H1.Open
  • netcoreapp5.0-Windows_NT-Release-x64-CoreCLR_release-(Windows.Nano.1809.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:nanoserver-1809-helix-amd64-08e8e40-20200107182504
  • netcoreapp5.0-Windows_NT-Release-x64-CoreCLR_release-Windows.10.Amd64.Server19H1.Open
  • netcoreapp5.0-Windows_NT-Release-x64-CoreCLR_release-Windows.10.Amd64.ServerRS5.Open
  • netcoreapp5.0-Windows_NT-Release-x86-CoreCLR_checked-Windows.10.Amd64.Open
  • netcoreapp5.0-Windows_NT-Release-x86-CoreCLR_release-Windows.10.Amd64.Server19H1.ES.Open
  • netcoreapp5.0-Windows_NT-Release-x86-CoreCLR_release-Windows.10.Amd64.ServerRS5.Open

Helix Logs

Build Pull Request Console Core Test Results
#571145 #33485 console.a0e386d7.log testResults.xml
#571242 #33990 console.1ec28f7b.log testResults.xml
#571351 #33881 console.60b09f86.log testResults.xml
#571351 #33881 console.dab6b9aa.log testResults.xml
#571369 #33831 console.7c477dd4.log testResults.xml
#571410 #34032 console.e81d3e79.log testResults.xml
#571488 #34040 console.6bfa266e.log testResults.xml
#571536 #33175 console.1f217b36.log testResults.xml
#571546 #33459 console.f9afa963.log testResults.xml
#571555 #34022 console.83670fa5.log testResults.xml
#571580 #34029 console.a98a552a.log testResults.xml
#571835 Rolling console.3b5b4e9a.log testResults.xml
#571835 Rolling console.5da895d5.log testResults.xml
#571875 #34046 console.928cb3bc.log testResults.xml
#571900 #33515 console.e82308cb.log testResults.xml
#571973 #34000 console.8edccc97.log testResults.xml
#571973 #34000 console.712e1f7a.log testResults.xml
#572023 #34050 console.6dbb7397.log testResults.xml
#572061 Rolling console.c760c7e4.log testResults.xml
#572108 #33459 console.825bf7c5.log testResults.xml
#572108 #33459 console.0bcd61c8.log testResults.xml
#572194 Rolling console.30e9e426.log testResults.xml
#572194 Rolling console.b0dba346.log testResults.xml
#572256 #33953 console.6551002f.log testResults.xml
#572283 Rolling console.10167348.log testResults.xml
#572349 Rolling console.3cd93eb5.log testResults.xml
#572349 Rolling console.e541382d.log testResults.xml
#572415 Rolling console.16e5b184.log testResults.xml
#572535 #34065 console.727372a0.log testResults.xml
#572535 #34065 console.528dff5f.log testResults.xml
#572535 #34065 console.3293b941.log testResults.xml
#572535 #34065 console.d4ac6334.log testResults.xml
#572573 #34022 console.0103c39b.log testResults.xml
#572708 Rolling console.2aaa0502.log testResults.xml
#572998 #33732 console.09e9ff60.log testResults.xml
#573124 #33984 console.ee352ccc.log testResults.xml
#573152 #34050 console.13b3e33e.log testResults.xml

System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_Cookies_Http2.GetAsync_SetCookieContainer_CookieSent

Console Log Summary

Builds

Build Pull Request Test Failure Count
#572535 #34065 13

Configurations

  • netcoreapp5.0-Linux-Debug-x64-CoreCLR_release-(Alpine.311.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.11-helix-bfcd90a-20200123191053
  • netcoreapp5.0-Linux-Debug-x64-CoreCLR_release-(Fedora.29.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:fedora-29-helix-a12566d-20191210224553
  • netcoreapp5.0-Linux-Debug-x64-CoreCLR_release-Centos.7.Amd64.Open
  • netcoreapp5.0-Linux-Debug-x64-CoreCLR_release-Debian.9.Amd64.Open
  • netcoreapp5.0-Linux-Debug-x64-CoreCLR_release-RedHat.7.Amd64.Open
  • netcoreapp5.0-Linux-Debug-x64-CoreCLR_release-SLES.15.Amd64.Open
  • netcoreapp5.0-Linux-Debug-x64-CoreCLR_release-Ubuntu.1604.Amd64.Open
  • netcoreapp5.0-Linux-Debug-x64-CoreCLR_release-Ubuntu.1804.Amd64.Open
  • netcoreapp5.0-Windows_NT-Debug-x64-CoreCLR_release-(Windows.Nano.1809.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:nanoserver-1809-helix-amd64-08e8e40-20200107182504
  • netcoreapp5.0-Windows_NT-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server19H1.ES.Open
  • netcoreapp5.0-Windows_NT-Debug-x64-CoreCLR_release-Windows.81.Amd64.Open
  • netcoreapp5.0-Windows_NT-Debug-x86-CoreCLR_release-Windows.10.Amd64.Server19H1.Open
  • netcoreapp5.0-Windows_NT-Release-x86-CoreCLR_release-Windows.10.Amd64.Server19H1.ES.Open

Helix Logs

Build Pull Request Console Core Test Results
#572535 #34065 console.a71ae435.log testResults.xml
#572535 #34065 console.6c291c61.log testResults.xml
#572535 #34065 console.925a2cd1.log testResults.xml
#572535 #34065 console.1945e16b.log testResults.xml
#572535 #34065 console.ac506bbd.log testResults.xml
#572535 #34065 console.9f013884.log testResults.xml
#572535 #34065 console.d4db23a6.log testResults.xml
#572535 #34065 console.996ceb57.log testResults.xml
#572535 #34065 console.73bf1e82.log testResults.xml
#572535 #34065 console.885c0ae0.log testResults.xml
#572535 #34065 console.14c666c6.log testResults.xml
#572535 #34065 console.eed09874.log testResults.xml
#572535 #34065 console.b44e316e.log testResults.xml

runfo tests -d runtime -c 100 -pr -n "GetAsync_SetCookieContainer_CookieSent" -m -g tests

@ericstj
Copy link
Member

ericstj commented Mar 25, 2020

ping @dotnet/ncl

@karelz karelz removed the arch-arm64 label Mar 26, 2020
@karelz
Copy link
Member

karelz commented Mar 26, 2020

Looks like it had a recent spike ... on WinHttpHandler. @alnikola can you please take a look?
(I am curious if the WinHttpException above is accidental, or if it is related to recently added WinHttp tests ...)

@karelz karelz assigned alnikola and unassigned wfurt Mar 26, 2020
@ManickaP
Copy link
Member

I'm investigating this since yesterday, this is the same issue as here: #33930

@ManickaP
Copy link
Member

Unless @alnikola wants to take over or immediately know where the problem is, I'd like to tackle this, since I've already put some time into it.

@alnikola
Copy link
Contributor

@karelz System.Net.Http.Functional.Tests.PlatformHandlerTest_Cookies_Http2.GetAsync_SetCookieContainer_CookieSent test was never executed before for WinHttpHandler until the last week when I enabled as much HTTP/2 tests as I could to have at least some coverage. I tried to disable all failing ones, but must have overlooked this one. @ManickaP will disable it.

@karelz
Copy link
Member

karelz commented Mar 26, 2020

Thanks @alnikola and @ManickaP

@karelz
Copy link
Member

karelz commented Mar 26, 2020

@ManickaP should we duplicate it against #33930? (assuming the WinHttp part of the problem helps to solve also the original issue filed here ...)

@jaredpar
Copy link
Member

Do we have an ETA for a fix or disable? This test is the #1 source of CI reliability issues for runtime for last two days. If the fix is not imminent can we disable ASAP?

@ManickaP
Copy link
Member

@jaredpar it's already disabled: #34119
@karelz Yep, I'm gonne close this as a dupe a keep investigating in #33930

@jaredpar
Copy link
Member

@ManickaP great thanks!

@jaredpar
Copy link
Member

Ah it just got merged an hour ago hence no rolling builds have completed since the merge. That's why I'm still seeing it as atop issue. Should fade out now.

@ManickaP
Copy link
Member

Closing since the problem is the same as in #33930.
The affected tests have been disabled in #34119

@karelz
Copy link
Member

karelz commented Mar 26, 2020

Duplicate of #33930

@karelz karelz marked this as a duplicate of #33930 Mar 26, 2020
@ghost ghost locked as resolved and limited conversation to collaborators Dec 14, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
area-System.Net.Http blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' test-run-core Test failures in .NET Core test runs
Projects
None yet
Development

No branches or pull requests

10 participants