Test failure: System.Net.Http.Functional.Tests.DiagnosticsTest / SendAsync_ExpectedDiagnosticCancelledLogging

[KristinXie1]

Types of failures

Related to dotnet/corefx#26042

History of failures

Day	Build	OS	Error message
5/26	20170526.52	Centos73	Assert: Expected: 42, Actual: 134
5/31	2017053.02	Suse42.2	Assert: Expected: 42, Actual: 127
5/31	20170601.01	Suse42.2	Assert: Expected: 42, Actual: 134
6/7	20170607.02	Suse42.2	Assert: Expected: 42, Actual: 134
6/12	20170612.02	Ubuntu16.04	Assert: Expected: 42, Actual: 134
6/13	20170613.01	SLES12	Assert: Expected: 42, Actual: 134
6/17	20170617.01	RedHat72	Assert: Expected: 42, Actual: 134
6/19	20170619.01	RedHat73	Assert: Expected: 42, Actual: 134
6/19	20170619.01	Ubuntu17.04	Assert: Expected: 42, Actual: 127
6/22	20170622.03	Suse42.2	Assert: Expected: 42, Actual: 134
6/26	20170626.01	RedHat73	Assert: Expected: 42, Actual: 134
7/3	20170703.02	RedHat72	[ManagedHandler] Assert: Expected: 42, Actual: -122
7/7	20170707.01	RedHat73	[ManagedHandler] Assert: Expected: 42, Actual: -122
7/7	20170708.01	Centos73	[ManagedHandler] Assert: Expected: 42, Actual: -122
7/13	20170713.01	Win7	[ManagedHandler] Assert: Expected: 42, Actual: -532462766
7/14	20170714.02	Ubuntu16.10	[ManagedHandler] Assert: Expected: 42, Actual: -122
7/19	20170719.03	Centos73	Assert: Expected: 42, Actual: -122
7/20	20170720.02	RedHat72	[ManagedHandler] Assert: Expected: 42, Actual: -122
8/13	20170813.01	Debian90	Assert exit code: Expected: 42, Actual: 134
8/19	20170819.02	Ubuntu17.10	Assert exit code: Expected: 42, Actual: 134
8/20	20170820.02	Debian90	Assert exit code: Expected: 42, Actual: 134
8/29	20170829.01	RedHat69	Remote process failed with an unhandled exception.
8/29	20170829.01	RedHat69	Remote process failed with an unhandled exception.
8/29	20170829.02	RedHat69	Remote process failed with an unhandled exception.
8/29	20170829.02	RedHat69	Remote process failed with an unhandled exception.
9/11	20170911.01	Win8.1	[ManagedHandler] Remote process failed with an unhandled exception.

Original report

Failed test: System.Net.Http.Functional.Tests.ManagedHandler_DiagnosticsTest.SendAsync_ExpectedDiagnosticCancelledLogging

Detail: https://ci.dot.net/job/dotnet_corefx/job/master/job/outerloop_netcoreapp_windows_nt_release/134/testReport/System.Net.Http.Functional.Tests/ManagedHandler_DiagnosticsTest/SendAsync_ExpectedDiagnosticCancelledLogging/

Configuration: outerloop_netcoreapp_windows_nt_release

MESSAGE:

System.Diagnostics.RemoteExecutorTestBase+RemoteInvokeHandle+RemoteExecutionException : Remote process failed with an unhandled exception.

STACK TRACE:

Child exception: Xunit.Sdk.TrueException: Cancellation was not logged within 1 second timeout. Expected: True Actual: False 
at System.Net.Http.Functional.Tests.DiagnosticsTest.<>c.<SendAsync_ExpectedDiagnosticCancelledLogging>b__5_0() 
in D:\j\workspace\outerloop_net---7a39cc82\src\System.Net.Http\tests\FunctionalTests\DiagnosticsTests.cs:line 300 Child process: System.Net.Http.Functional.Tests, Version=4.2.1.0, Culture=neutral, PublicKeyToken=9d77cc7ad39b68eb System.Net.Http.Functional.Tests.DiagnosticsTest+<>c Int32 <SendAsync_ExpectedDiagnosticCancelledLogging>b__5_0()

[davidsh]

MESSAGE:
System.Diagnostics.RemoteExecutorTestBase+RemoteInvokeHandle+RemoteExecutionException : Remote process failed with an unhandled exception.
+++++++++++++++++++
STACK TRACE:
Child exception: Xunit.Sdk.TrueException: Cancellation was not logged within 1 second timeout. Expected: True Actual: False at System.Net.Http.Functional.Tests.DiagnosticsTest.<>c.<SendAsync_ExpectedDiagnosticCancelledLogging>b__5_0() in D:\j\workspace\outerloop_net---7a39cc82\src\System.Net.Http\tests\FunctionalTests\DiagnosticsTests.cs:line 300 Child process: System.Net.Http.Functional.Tests, Version=4.2.1.0, Culture=neutral, PublicKeyToken=9d77cc7ad39b68eb System.Net.Http.Functional.Tests.DiagnosticsTest+<>c Int32 <SendAsync_ExpectedDiagnosticCancelledLogging>b__5_0()

[KristinXie1]

failed again: https://mc.dot.net/#/product/netcore/master/source/official~2Fcorefx~2Fmaster~2F/type/test~2Ffunctional~2Fcli~2F/build/20170829.01/workItem/System.Net.Http.Functional.Tests/analysis/xunit/System.Net.Http.Functional.Tests.DiagnosticsTest~2FSendAsync_ExpectedDiagnosticCancelledActivityLogging

The test System.Net.Http.Functional.Tests.DiagnosticsTest/SendAsync_ExpectedDiagnosticCancelledActivityLogging has failed.

System.Diagnostics.RemoteExecutorTestBase+RemoteInvokeHandle+RemoteExecutionException : Remote process failed with an unhandled exception.

    Stack Trace:

    
Child exception:
  System.TypeInitializationException: The type initializer for 'System.Net.Http.CurlHandler' threw an exception. ---> System.TypeInitializationException: The type initializer for 'Http' threw an exception. ---> System.TypeInitializationException: The type initializer for 'HttpInitializer' threw an exception. ---> System.DllNotFoundException: Unable to load DLL 'System.Net.Http.Native': The specified module or one of its dependencies could not be found.
 (Exception from HRESULT: 0x8007007E)
   at Interop.Http.GetSslVersionDescription()
   at Interop.HttpInitializer..cctor() in /root/corefx-954865/src/Common/src/Interop/Unix/System.Net.Http.Native/Interop.Initialization.cs:line 27
   --- End of inner exception stack trace ---
   at Interop.HttpInitializer.Initialize() in /root/corefx-954865/src/Common/src/Interop/Unix/System.Net.Http.Native/Interop.Initialization.cs:line 47
   at Interop.Http..cctor() in /root/corefx-954865/src/Common/src/Interop/Unix/System.Net.Http.Native/Interop.Initialization.cs:line 19
   --- End of inner exception stack trace ---
   at Interop.Http.GetSupportedFeatures()
   at System.Net.Http.CurlHandler..cctor() in /root/corefx-954865/src/System.Net.Http/src/System/Net/Http/Unix/CurlHandler.cs:line 164
   --- End of inner exception stack trace ---
   at System.Net.Http.CurlHandler..ctor() in /root/corefx-954865/src/System.Net.Http/src/System/Net/Http/Unix/CurlHandler.cs:line 136
   at System.Net.Http.HttpClientHandler..ctor() in /root/corefx-954865/src/System.Net.Http/src/System/Net/Http/HttpClientHandler.Unix.cs:line 30
   at System.Net.Http.Functional.Tests.DiagnosticsTest.<>c.<SendAsync_ExpectedDiagnosticCancelledActivityLogging>b__12_0() in /root/corefx-954865/src/System.Net.Http/tests/FunctionalTests/DiagnosticsTests.cs:line 606

Child process:
  System.Net.Http.Functional.Tests, Version=4.2.1.0, Culture=neutral, PublicKeyToken=9d77cc7ad39b68eb System.Net.Http.Functional.Tests.DiagnosticsTest+<>c Int32 <SendAsync_ExpectedDiagnosticCancelledActivityLogging>b__12_0()

Build : Master - 20170829.01 (Core Tests)
Failing configurations:

• RedHat.69.Amd64-x64
  • Release
  • Debug

[KristinXie1]

failed again: https://mc.dot.net/#/product/netcore/master/source/official~2Fcorefx~2Fmaster~2F/type/test~2Ffunctional~2Fcli~2F/build/20170911.01/workItem/System.Net.Http.Functional.Tests/analysis/xunit/System.Net.Http.Functional.Tests.ManagedHandler_DiagnosticsTest~2FSendAsync_ExpectedDiagnosticCancelledLogging

Message :
System.Diagnostics.RemoteExecutorTestBase+RemoteInvokeHandle+RemoteExecutionException : Remote process failed with an unhandled exception.
Stack Trace :

Child exception:
Xunit.Sdk.TrueException: Cancellation was not logged within 1 second timeout.
Expected: True
Actual: False
at System.Net.Http.Functional.Tests.DiagnosticsTest.<>c.<SendAsync_ExpectedDiagnosticCancelledLogging>b__5_0()

Child process:
System.Net.Http.Functional.Tests, Version=4.2.1.0, Culture=neutral, PublicKeyToken=9d77cc7ad39b68eb System.Net.Http.Functional.Tests.DiagnosticsTest+<>c Int32 <SendAsync_ExpectedDiagnosticCancelledLogging>b__5_0()

[davidsh]

I am going to disable this test until it can be made more robust. It is not a reliable test because cancellation cannot be guaranteed to occur with a certain time especially on a busy machine.

[KristinXie1]

Following test failed again in 2.0.0 branch, detail: https://mc.dot.net/#/product/netcore/200/source/official~2Fcorefx~2Frelease~2F2.0.0~2F/type/test~2Ffunctional~2Fcli~2F/build/20170927.01/workItem/System.Net.Http.Functional.Tests/analysis/xunit/System.Net.Http.Functional.Tests.DiagnosticsTest~2FSendAsync_ExpectedDiagnosticCancelledLogging

The test System.Net.Http.Functional.Tests.DiagnosticsTest/SendAsync_ExpectedDiagnosticCancelledLogging has failed.

Assert.Equal() Failure
    Expected: 42
    Actual:   127
at System.Diagnostics.RemoteExecutorTestBase.RemoteInvokeHandle.Dispose() in /root/corefx/src/Common/tests/System/Diagnostics/RemoteExecutorTestBase.cs:line 208

Build : 2.0.0 - 20170927.01 (Core Tests)
Failing configurations:

• SLES.12.Amd64-x64
  • Release

[KristinXie1]

Now it failed with:

The test System.Net.Http.Functional.Tests.DiagnosticsTest/SendAsync_ExpectedDiagnosticCancelledActivityLogging has failed.

Exit code was 134 but it should have been 42
Expected: True
Actual: False

    Stack Trace:

       at System.Diagnostics.RemoteExecutorTestBase.RemoteInvokeHandle.Dispose() in /root/corefx-1088759/src/CoreFx.Private.TestUtilities/src/System/Diagnostics/RemoteExecutorTestBase.cs:line 191
   at System.Net.Http.Functional.Tests.DiagnosticsTest.SendAsync_ExpectedDiagnosticCancelledActivityLogging() in /root/corefx-1088759/src/System.Net.Http/tests/FunctionalTests/DiagnosticsTests.cs:line 589

Build : Master - 20171026.01 (Core Tests)
Failing configurations:

• RedHat.73.Amd64-x64
  • Debug

Detail: https://mc.dot.net/#/product/netcore/master/source/official~2Fcorefx~2Fmaster~2F/type/test~2Ffunctional~2Fcli~2F/build/20171026.01/workItem/System.Net.Http.Functional.Tests/analysis/xunit/System.Net.Http.Functional.Tests.DiagnosticsTest~2FSendAsync_ExpectedDiagnosticCancelledActivityLogging

[karelz]

Deleting comments with ManagedHandler test failures after the test was disabled to remove clutter.