Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[outerloop] System.Runtime.Numerics.Tests crash with exit code 137 in linux debug coreclr #104588

Open
elinor-fung opened this issue Jul 9, 2024 · 3 comments
Open

[outerloop] System.Runtime.Numerics.Tests crash with exit code 137 in linux debug coreclr #104588

elinor-fung opened this issue Jul 9, 2024 · 3 comments
Assignees
@tannergooding
Labels
area-System.Numerics blocking-outerloop Blocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs Known Build Error Use this to report build issues in the .NET Helix tab
Milestone
10.0.0

Comments

@elinor-fung
Copy link
Member

elinor-fung commented Jul 9, 2024 •
edited by build-analysis bot
Loading

Perhaps related to #98964

  Starting:    System.Runtime.Numerics.Tests (parallel test collections = on, max threads = 2)
./RunTests.sh: line 168:    21 Killed                  "$RUNTIME_PATH/dotnet" exec --runtimeconfig System.Runtime.Numerics.Tests.runtimeconfig.json --depsfile System.Runtime.Numerics.Tests.deps.json xunit.console.dll System.Runtime.Numerics.Tests.dll -xml testResults.xml -nologo -nocolor -trait category=OuterLoop -notrait category=IgnoreForCI -notrait category=failing $RSP_FILE
/root/helix/work/workitem/e
----- end Mon Jul 8 23:40:00 UTC 2024 ----- exit code 137 ----------------------------------------------------------
exit code 137 means SIGKILL Killed eg by kill

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=733224
Build error leg or test failing: System.Runtime.Numerics.Tests.WorkItemExecution
Pull request: #104501

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "",
  "ErrorPattern": "Killed.+System\\.Runtime\\.Numerics\\.Tests\\.runtimeconfig\\.json.+OuterLoop",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=733224
Error message validated: [Killed.+System\.Runtime\.Numerics\.Tests\.runtimeconfig\.json.+OuterLoop]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 7/9/2024 4:39:02 AM UTC

Report

Build Definition Test Pull Request
972897 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
972892 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
972890 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
972899 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
971718 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
971714 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
971724 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
971728 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
970626 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
970632 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
970636 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
970624 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
969483 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
969482 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
969480 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
969461 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
968444 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
968442 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
968433 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
968438 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
967319 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
967318 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
967338 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
967329 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
966653 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
966645 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
966640 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
966643 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
966356 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
966340 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
966346 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
966350 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
965560 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
965556 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
965536 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
965535 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
964651 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
964630 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
964656 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
964633 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
963588 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
963589 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
963583 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
963604 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
962216 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
962212 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
962201 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
962197 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
961444 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution #112881
960922 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
960915 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
960926 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
960921 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
960173 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
960189 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
960168 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
960187 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
959813 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
959811 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
959795 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
959807 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
958820 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
958827 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
958817 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
958816 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
957725 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
957727 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
957722 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
957714 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
956373 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
956372 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
956362 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
956360 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
955171 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
955158 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
955150 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
955149 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
954422 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
954403 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
954421 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
954414 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
953879 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
953880 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
953869 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
953871 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
953576 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
953578 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
953558 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
953577 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
952449 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
952432 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
952425 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
952442 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
951157 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
951159 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
951149 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
951140 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
949656 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
949651 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
949666 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
Displaying 100 of 121 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
4 28 113
@elinor-fung elinor-fung added blocking-outerloop Blocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs Known Build Error Use this to report build issues in the .NET Helix tab labels Jul 9, 2024
@dotnet-issue-labeler dotnet-issue-labeler bot added the needs-area-label An area label is needed to ensure this gets routed to the appropriate area owners label Jul 9, 2024
@dotnet-policy-service dotnet-policy-service bot added the untriaged New issue has not been triaged by the area owner label Jul 9, 2024
@dotnet-policy-service Dotnet Policy Service
Copy link
Contributor

Tagging subscribers to this area: @dotnet/area-system-numerics
See info in area-owners.md if you want to be subscribed.

@vcsjones vcsjones removed the needs-area-label An area label is needed to ensure this gets routed to the appropriate area owners label Jul 11, 2024
@jeffhandley jeffhandley added this to the 9.0.0 milestone Jul 20, 2024
@jeffhandley jeffhandley removed the untriaged New issue has not been triaged by the area owner label Jul 20, 2024
@tannergooding
Copy link
Member

There is no dump and the only hint as to why the SIGKILL might have been raised is

dmesg: read kernel buffer failed: Operation not permitted

This seems like a more general flaky issue and not related to anything in the tests. I've not been able to repro locally so there's not much that can be done without some additional context or a reliable repro

@jeffhandley jeffhandley modified the milestones: 9.0.0, 10.0.0 Sep 17, 2024
@ericstj
Copy link
Member

ericstj commented Nov 7, 2024

This is the highest-hitting libraries known build issue. Worth a look if you can determine the cause. https://helix.dot.net/BuildAnalysis/KnownIssues @tannergooding @jeffhandley

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@tannergooding tannergooding

Labels
area-System.Numerics blocking-outerloop Blocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs Known Build Error Use this to report build issues in the .NET Helix tab
Projects
None yet
Milestone
10.0.0
Development

No branches or pull requests
6 participants
@vcsjones @jeffhandley @ericstj @jeffschwMSFT @tannergooding @elinor-fung