The active test run was aborted. Reason: Test host process crashed

[fanyang-mono]

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=351450

Build leg reported

chrome-DebuggerTests.EvaluateOnCallFrameTests.WorkItemExecution

Pull Request

dotnet/runtime#89217

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The active test run was aborted. Reason: Test host process crashed",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Report

Build	Definition	Step Name	Console log	Pull Request
2722595	dotnet-orleans	Test	Log
1058235	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78808
2721914	dotnet-orleans	Test	Log
1057305	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78801
2721871	dotnet-orleans	Test	Log
2721191	dotnet-orleans	Test	Log
2720741	dotnet-orleans	Test	Log
2720275	dotnet-orleans	Test	Log
2720267	dotnet-orleans	Test	Log
2720246	dotnet-orleans	Test	Log
2719700	dotnet-orleans	Test	Log
2719699	dotnet-orleans	Test	Log
1051984	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78714
1050468	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78701
1048953	dotnet/roslyn	Run Integration Tests	Log
1048085	dotnet/roslyn	Run Integration Tests	Log
1047339	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78595
2713591	dotnet-interactive	Test / Blame	Log
1045774	dotnet/roslyn	Run Integration Tests	Log
1045706	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78648
1045695	dotnet/roslyn	Run Integration Tests	Log
1045523	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78597
1045440	dotnet/roslyn	Run Integration Tests	Log
1044450	dotnet/roslyn	Run Integration Tests	Log
1044091	dotnet/roslyn	Run Integration Tests	Log
1043013	dotnet/roslyn	Run Integration Tests	Log
1041627	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78357
1041253	dotnet/roslyn	Run Integration Tests	Log
1040317	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78562
1040236	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78558
1039874	dotnet/roslyn	Run Integration Tests	Log
1039725	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78388
1039277	dotnet/roslyn	Run Integration Tests	Log
1038918	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78357
1038511	dotnet/roslyn	Run Integration Tests	Log
1038478	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78516
1038318	dotnet/roslyn	Run Integration Tests	Log
1038268	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78542
1037917	dotnet/roslyn	Run Unit Tests	Log
1037926	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78522
1037925	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78525
1037876	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78532
1037397	dotnet/roslyn	Run Integration Tests	Log
1037307	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78507
1037256	dotnet/roslyn	Run Integration Tests	Log
1037250	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78514
1037240	dotnet/roslyn	Run Integration Tests	Log
1037078	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78511
1036839	dotnet/roslyn	Run Integration Tests	Log
1036720	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78498
1036403	dotnet/roslyn	Run Integration Tests	Log
1036285	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78498
1035007	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78140
1034620	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78458
1034237	dotnet/roslyn	Run Integration Tests	Log
1034065	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#76691

Build	Definition	Test	Pull Request
1058489	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#48575
1058233	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48575
1058256	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49238
1058234	dotnet/roslyn	workitem_8.WorkItemExecution	dotnet/roslyn#78808
1057752	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49181
1057500	dotnet/runtime	HostActivation.Tests.WorkItemExecution	dotnet/runtime#115315
1056875	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#49228
1056841	dotnet/runtime	HostActivation.Tests.WorkItemExecution	dotnet/runtime#115339
1056403	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49080
1056320	dotnet/runtime	HostActivation.Tests.WorkItemExecution	dotnet/runtime#116193
1056005	dotnet/sdk	dotnet-watch.Tests.dll.6.WorkItemExecution	dotnet/sdk#49080
1055779	dotnet/runtime	HostActivation.Tests.WorkItemExecution	dotnet/runtime#116096
1055588	dotnet/sdk	dotnet-watch.Tests.dll.6.WorkItemExecution	dotnet/sdk#49080
1055274	dotnet/sdk	dotnet-watch.Tests.dll.6.WorkItemExecution	dotnet/sdk#49080
2719688	dotnet-sdk	dotnet-watch.Tests.dll.1.WorkItemExecution
1054715	dotnet/sdk	dotnet-watch.Tests.dll.3.WorkItemExecution	dotnet/sdk#49139
1053802	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49194
1053750	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#48910
1053603	dotnet/runtime	HostActivation.Tests.WorkItemExecution	dotnet/runtime#116081
1053309	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49150
1053159	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#49181
1052240	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#49150
1051594	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#48910
1051037	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	dotnet/sdk#49141
1049198	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.Listener.AuthenticationOnExistingQueueTests_CreateOrAttach_UseNewUrlPrefix.AuthTypes_AllowAnonymous_NoChallenge	dotnet/aspnetcore#61853
2715316	dotnet-aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1049034	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#49110
2714659	dotnet-sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#50200
1048083	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.OpaqueUpgradeTests.OpaqueUpgrade_VariousMethodsUpgradeSendAndReceive_Success
1048044	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49097
1047654	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#62019
1047665	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49055
1047515	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49086
1047138	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#49079
1046937	dotnet/aspnetcore	Templates.Mvc.Test.BlazorTemplateTest.BlazorWebTemplate_IndividualAuth(args: ["--interactivity Auto"])
1046404	dotnet/aspnetcore	Microsoft.AspNetCore.Components.Endpoints.Tests--net10.0.WorkItemExecution	dotnet/aspnetcore#62016
2712819	dotnet-sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#50200
2712565	dotnet-aspnetcore	Microsoft.AspNetCore.Components.Endpoints.Tests--net8.0.WorkItemExecution
1044962	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#49007
2712173	dotnet-aspnetcore	Microsoft.AspNetCore.Server.Kestrel.Transport.Quic.Tests--net8.0.WorkItemExecution
1044609	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#49040
2711186	dotnet-sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	#50157
1043895	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#61929
1043600	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#49014
1043549	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#61964
1043554	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48919
1043415	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#48843
1042381	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#61633
1042570	dotnet/sdk	Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.Aspire	dotnet/sdk#48982
1042686	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48984
1042541	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#48929
1042282	dotnet/runtime	HostActivation.Tests.WorkItemExecution	dotnet/runtime#115251
1041972	dotnet/roslyn	workitem_7.WorkItemExecution	dotnet/roslyn#78582
1041964	dotnet/sdk	dotnet-watch.Tests.dll.4.WorkItemExecution	dotnet/sdk#48966
1041088	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48925
1041049	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#48938
1040634	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48909
1040298	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#48910
1040066	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.RequestTests.Request_MultiplePrefixes
1039881	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#48882
1039826	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48907
1039331	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#48813
1038537	dotnet/aspnetcore	Microsoft.AspNetCore.Components.Endpoints.Tests--net8.0.WorkItemExecution
2706287	dotnet-roslyn	workitem_204.WorkItemExecution
1037623	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48883
1037210	dotnet/roslyn	workitem_6.WorkItemExecution	dotnet/roslyn#78513
2704797	dotnet-aspnetcore	Microsoft.AspNetCore.Http.Results.Tests--net8.0.WorkItemExecution
1036710	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48737
1036711	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48751
1036716	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48859
1035704	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48697
1035154	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48609
1035010	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.Listener.ResponseHeaderTests.AddingControlCharactersToHeadersThrows
1034754	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48697
1034405	dotnet/roslyn	workitem_9.WorkItemExecution	dotnet/roslyn#78436
1033821	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48697
1033729	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48813

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
7	33	133

Known issue validation

Build: 🔎
Result validation: ⚠️ Validation could not be done without an Azure DevOps build URL on the issue. Please add it to the "Build: 🔎" line.
Validation performed at: 2/8/2024 9:24:30 PM UTC

[andriipatsula]

Hello @fanyang-mono, could you please update the "ErrorMessage" : "" by following the step by step documentation on how to create a known issue

[fanyang-mono]

Updated.

[pavelsavara]

This is duplicate of dotnet/runtime#89409, except here it's not only wasm debugger

[dougbu]

@pavelsavara and @fanyang-mono, should this issue be closed in favour of dotnet/runtime#94560❔ if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

[pavelsavara]

@pavelsavara and @fanyang-mono, should this issue be closed in favour of

You mean dotnet/runtime#89409

I think we should keep this one, because this one has some hits which are not just wasm debugger related.
Here we see other repo failures, on roslyn and aspnetcore CI.

if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

I have not investigated it myself yet. But got questions which could help to narrow it down

• are there crash dump files on the machine ?
• are there some hints on what's going on in the log files before crash ?
• is this OOM or stack overflow in disguise ?
• did we run out of disk space or number of inodes ?
• hit some limit in docker container ?
• is this always the same OS, version, image ?
• could this be hardware issue ?

[fanyang-mono]

This issue was originally created to track issues happened to wasm debugger tests (belonging to dotnet/runtime repo). However, the error message was generic enough to include issues from other repos, such as dotnet/roslyn and dotnet/aspnetcore. We need insights from owners from dotnet/roslyn and dotnet/aspnetcore to confirm that they are aware of these issue. And if they are okay to close this issue as well. We could close then.

[mitchdenny]

We just got an instance of this in the dotnet/aspire repo. It wasn't a WASM related failure for us. Just looks like the test process crashed and took a few tests with it.

[nagilson]

@marcpopMSFT was working on getting the test infrastructure to generate crash dumps when it times out to help with investigation. I think it was generating the dumps but not yet correctly uploading them to the artifacts.

We are waiting to hear from the infra team on an issue with this.