Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[outerloop] System.Runtime.Tests crash with exit code 137 in linux debug coreclr #98964

Open
carlossanlop opened this issue Feb 27, 2024 · 5 comments
Open

[outerloop] System.Runtime.Tests crash with exit code 137 in linux debug coreclr #98964

carlossanlop opened this issue Feb 27, 2024 · 5 comments
Labels
arch-x64 area-System.Runtime blocking-outerloop Blocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs Known Build Error Use this to report build issues in the .NET Helix tab os-linux Linux OS (any supported distro) os-linux-musl Linux distributions using musl library. runtime-coreclr specific to the CoreCLR runtime
Milestone
Future

Comments

@carlossanlop
Copy link
Member

carlossanlop commented Feb 27, 2024 •
edited by build-analysis bot
Loading

Found in a PR that fixed an unrelated failure affecting all outerloop runs, hiding other failures. #97135

Error Blob

{
  "ErrorMessage": "",
  "BuildRetry": false,
  "ErrorPattern": "Killed.+System\\.Runtime\\.Tests\\.runtimeconfig\\.json.+OuterLoop",
  "ExcludeConsoleLog": false
}

Reproduction Steps

========================== End custom configuration settings ===============================
----- start Mon Feb 26 23:56:03 UTC 2024 =============== To repro directly: =====================================================
pushd .
/root/helix/work/correlation/dotnet exec --runtimeconfig System.Runtime.Tests.runtimeconfig.json --depsfile System.Runtime.Tests.deps.json xunit.console.dll System.Runtime.Tests.dll -xml testResults.xml -nologo -nocolor -trait category=OuterLoop -notrait category=AdditionalTimezoneChecks -notrait category=IgnoreForCI -notrait category=failing 
popd
===========================================================================================================
/root/helix/work/workitem/e /root/helix/work/workitem/e
  Discovering: System.Runtime.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Runtime.Tests (found 29 of 9308 test cases)
  Starting:    System.Runtime.Tests (parallel test collections = on [2 threads], stop on fail = off)
./RunTests.sh: line 180:    21 Killed                  "$RUNTIME_PATH/dotnet" exec --runtimeconfig System.Runtime.Tests.runtimeconfig.json --depsfile System.Runtime.Tests.deps.json xunit.console.dll System.Runtime.Tests.dll -xml testResults.xml -nologo -nocolor -trait category=OuterLoop -notrait category=AdditionalTimezoneChecks -notrait category=IgnoreForCI -notrait category=failing $RSP_FILE
/root/helix/work/workitem/e
----- end Mon Feb 26 23:56:28 UTC 2024 ----- exit code 137 ----------------------------------------------------------
exit code 137 means SIGKILL Killed either due to out of memory/resources (see /var/log/messages) or by explicit kill.
ulimit -c value: unlimited
cat /proc/sys/kernel/core_pattern: /home/helixbot/dotnetbuild/dumps/core.%u.%p
cat /proc/sys/kernel/core_uses_pid: 1
cat: /proc/sys/kernel/coredump_filter: No such file or directory
cat /proc/sys/kernel/coredump_filter:
Looking around for any Linux dumps...
Looking for files matching core.* ...
----- start =============== XUnitLogChecker Output =====================================================
dmesg: klogctl: Operation not permitted
No dumps found in /home/helixbot/dotnetbuild/dumps.
----- end =============== XUnitLogChecker Output - exit code 0 ===========================
+ export '_commandExitCode=137'
+ python /root/helix/work/correlation/reporter/run.py https://dev.azure.com/dnceng-public/ public 13931354 eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsIng1dCI6Im9PdmN6NU1fN3AtSGpJS2xGWHo5M3VfVjBabyJ9.eyJuYW1laWQiOiJjNzczZjJjMi01MTIwLTQyMDctYWZlMi1hZmFmMzVhOGJjMGEiLCJzY3AiOiJhcHBfdG9rZW4iLCJhdWkiOiJhMTBlYjk0MS0xNzM2LTRjNzYtOWFiZC1iZDBlZGYxNjg0ODgiLCJzaWQiOiIxZTViN2VlMC1iNmQyLTQzNjgtODZjOS0zOTQ5MGIxM2FlODAiLCJCdWlsZElkIjoiY2JiMTgyNjEtYzQ4Zi00YWJiLTg2NTEtOGNkY2I1NDc0NjQ5OzU4MDE5NSIsImpvYnJlZiI6IjMxNTZhMmQwLTExYWItNGExMC04NTA0LWY3Y2UxM2ZiMTk2OTo1OTJlZWQ4OS03OGY1LTUyMDItOWRhNS1hZDE3ZGYzYmVmNGEiLCJwcGlkIjoidnN0ZnM6Ly8vQnVpbGQvQnVpbGQvNTgwMTk1Iiwib3JjaGlkIjoiMzE1NmEyZDAtMTFhYi00YTEwLTg1MDQtZjdjZTEzZmIxOTY5LmJ1aWxkLmJ1aWxkX2xpbnV4X211c2xfeDY0X2RlYnVnX2NvcmVjbHJfZGVidWcuX19kZWZhdWx0IiwicmVwb0lkcyI6IiIsImlzcyI6ImFwcC52c3Rva2VuLnZpc3VhbHN0dWRpby5jb20iLCJhdWQiOiJhcHAudnN0b2tlbi52aXN1YWxzdHVkaW8uY29tfHZzbzo2ZmNjOTJlNS03M2E3LTRmODgtOGQxMy1kOTA0NWI0NWZiMjciLCJuYmYiOjE3MDg5ODg5MzgsImV4cCI6MTcwOTAwMDkzOH0.rjlcWYrlHLfuHwUtUIiDkhhUDwy8cnQZ3rCBJjmd8FuCN0BDFzjz0jEMQEbQ9WZ7LHqdWN40vrD1MHH2p9a2tC9JYY7ca4b2w8Yy05wlbG-_cjF_ksT3jfhgz4EOLBiSmE7-bW_m1b3gtKHo-rdFDyMt_vciLiIB_C3543QhcPGJJdph5ok1SjBVKbl1q9wzw4Tut1lLyo8-ToLRotVPvv2Fahz3TSp--EDbdhY2SYtNrPyGVW7t9F8o3TZdG5iyrtyTnCAlr2Qdu-cOUJhyXM_4vhztXvLdgDMuDgGINPpA7sDXoqo_7LB9RP1iNc35uIEM-430j7jeG9MDrZzEZQ
2024-02-26T23:56:35.053Z	INFO   	run.py	run(48)	main	Beginning reading of test results.
2024-02-26T23:56:35.054Z	INFO   	run.py	__init__(42)	read_results	Searching '/root/helix/work/workitem/e' for test results files
2024-02-26T23:56:35.054Z	INFO   	run.py	__init__(42)	read_results	Searching '/root/helix/work/workitem/uploads' for test results files
2024-02-26T23:56:35.062Z	WARNING	run.py	__init__(55)	read_results	No results file found in any of the following formats: xunit, junit, trx
2024-02-26T23:56:35.063Z	INFO   	run.py	packing_test_reporter(30)	report_results	Packing 0 test reports to '/root/helix/work/workitem/e/__test_report.json'
2024-02-26T23:56:35.067Z	INFO   	run.py	packing_test_reporter(33)	report_results	Packed 1541 bytes
+ python /root/helix/work/correlation/gen-debug-dump-docs.py -buildid 580195 -workitem System.Runtime.Tests -jobid 6fc0e798-b0d8-4fd9-9e43-a36cfb9441c4 -outdir /root/helix/work/workitem/uploads -templatedir /root/helix/work/correlation -dumpdir /home/helixbot/dotnetbuild/dumps -productver 9.0.0
gen-debug-dump-docs.py: Did not find dumps, skipping dump docs generation.
+ exit 137
+ export '_commandExitCode=137'
+ chmod -R 777 /home/helixbot/dotnetbuild/dumps
+ exit 137

[END EXECUTION]
Exit Code:137

Report

Build Definition Test Pull Request
972897 dotnet/runtime System.Runtime.Tests.WorkItemExecution
972892 dotnet/runtime System.Runtime.Tests.WorkItemExecution
972899 dotnet/runtime System.Runtime.Tests.WorkItemExecution
972890 dotnet/runtime System.Runtime.Tests.WorkItemExecution
971718 dotnet/runtime System.Runtime.Tests.WorkItemExecution
971714 dotnet/runtime System.Runtime.Tests.WorkItemExecution
971724 dotnet/runtime System.Runtime.Tests.WorkItemExecution
971728 dotnet/runtime System.Runtime.Tests.WorkItemExecution
970626 dotnet/runtime System.Runtime.Tests.WorkItemExecution
970632 dotnet/runtime System.Runtime.Tests.WorkItemExecution
970636 dotnet/runtime System.Runtime.Tests.WorkItemExecution
970624 dotnet/runtime System.Runtime.Tests.WorkItemExecution
969483 dotnet/runtime System.Runtime.Tests.WorkItemExecution
969482 dotnet/runtime System.Runtime.Tests.WorkItemExecution
969480 dotnet/runtime System.Runtime.Tests.WorkItemExecution
969461 dotnet/runtime System.Runtime.Tests.WorkItemExecution
968444 dotnet/runtime System.Runtime.Tests.WorkItemExecution
968442 dotnet/runtime System.Runtime.Tests.WorkItemExecution
968433 dotnet/runtime System.Runtime.Tests.WorkItemExecution
968438 dotnet/runtime System.Runtime.Tests.WorkItemExecution
967319 dotnet/runtime System.Runtime.Tests.WorkItemExecution
967318 dotnet/runtime System.Runtime.Tests.WorkItemExecution
967338 dotnet/runtime System.Runtime.Tests.WorkItemExecution
967329 dotnet/runtime System.Runtime.Tests.WorkItemExecution
966653 dotnet/runtime System.Runtime.Tests.WorkItemExecution
966645 dotnet/runtime System.Runtime.Tests.WorkItemExecution
966640 dotnet/runtime System.Runtime.Tests.WorkItemExecution
966643 dotnet/runtime System.Runtime.Tests.WorkItemExecution
966356 dotnet/runtime System.Runtime.Tests.WorkItemExecution
966340 dotnet/runtime System.Runtime.Tests.WorkItemExecution
966346 dotnet/runtime System.Runtime.Tests.WorkItemExecution
966350 dotnet/runtime System.Runtime.Tests.WorkItemExecution
965560 dotnet/runtime System.Runtime.Tests.WorkItemExecution
965556 dotnet/runtime System.Runtime.Tests.WorkItemExecution
965536 dotnet/runtime System.Runtime.Tests.WorkItemExecution
965535 dotnet/runtime System.Runtime.Tests.WorkItemExecution
964651 dotnet/runtime System.Runtime.Tests.WorkItemExecution
964630 dotnet/runtime System.Runtime.Tests.WorkItemExecution
964656 dotnet/runtime System.Runtime.Tests.WorkItemExecution
964633 dotnet/runtime System.Runtime.Tests.WorkItemExecution
963588 dotnet/runtime System.Runtime.Tests.WorkItemExecution
963589 dotnet/runtime System.Runtime.Tests.WorkItemExecution
963583 dotnet/runtime System.Runtime.Tests.WorkItemExecution
963604 dotnet/runtime System.Runtime.Tests.WorkItemExecution
962216 dotnet/runtime System.Runtime.Tests.WorkItemExecution
962212 dotnet/runtime System.Runtime.Tests.WorkItemExecution
962201 dotnet/runtime System.Runtime.Tests.WorkItemExecution
962197 dotnet/runtime System.Runtime.Tests.WorkItemExecution
961444 dotnet/runtime System.Runtime.Tests.WorkItemExecution #112881
960922 dotnet/runtime System.Runtime.Tests.WorkItemExecution
960915 dotnet/runtime System.Runtime.Tests.WorkItemExecution
960926 dotnet/runtime System.Runtime.Tests.WorkItemExecution
960921 dotnet/runtime System.Runtime.Tests.WorkItemExecution
960173 dotnet/runtime System.Runtime.Tests.WorkItemExecution
960189 dotnet/runtime System.Runtime.Tests.WorkItemExecution
960168 dotnet/runtime System.Runtime.Tests.WorkItemExecution
960187 dotnet/runtime System.Runtime.Tests.WorkItemExecution
959813 dotnet/runtime System.Runtime.Tests.WorkItemExecution
959811 dotnet/runtime System.Runtime.Tests.WorkItemExecution
959795 dotnet/runtime System.Runtime.Tests.WorkItemExecution
959807 dotnet/runtime System.Runtime.Tests.WorkItemExecution
958820 dotnet/runtime System.Runtime.Tests.WorkItemExecution
958827 dotnet/runtime System.Runtime.Tests.WorkItemExecution
958817 dotnet/runtime System.Runtime.Tests.WorkItemExecution
958816 dotnet/runtime System.Runtime.Tests.WorkItemExecution
957725 dotnet/runtime System.Runtime.Tests.WorkItemExecution
957727 dotnet/runtime System.Runtime.Tests.WorkItemExecution
957722 dotnet/runtime System.Runtime.Tests.WorkItemExecution
957714 dotnet/runtime System.Runtime.Tests.WorkItemExecution
956373 dotnet/runtime System.Runtime.Tests.WorkItemExecution
956372 dotnet/runtime System.Runtime.Tests.WorkItemExecution
956362 dotnet/runtime System.Runtime.Tests.WorkItemExecution
956360 dotnet/runtime System.Runtime.Tests.WorkItemExecution
955171 dotnet/runtime System.Runtime.Tests.WorkItemExecution
955158 dotnet/runtime System.Runtime.Tests.WorkItemExecution
955150 dotnet/runtime System.Runtime.Tests.WorkItemExecution
955149 dotnet/runtime System.Runtime.Tests.WorkItemExecution
954422 dotnet/runtime System.Runtime.Tests.WorkItemExecution
954403 dotnet/runtime System.Runtime.Tests.WorkItemExecution
954421 dotnet/runtime System.Runtime.Tests.WorkItemExecution
954414 dotnet/runtime System.Runtime.Tests.WorkItemExecution
953879 dotnet/runtime System.Runtime.Tests.WorkItemExecution
953880 dotnet/runtime System.Runtime.Tests.WorkItemExecution
953869 dotnet/runtime System.Runtime.Tests.WorkItemExecution
953871 dotnet/runtime System.Runtime.Tests.WorkItemExecution
953576 dotnet/runtime System.Runtime.Tests.WorkItemExecution
953578 dotnet/runtime System.Runtime.Tests.WorkItemExecution
953558 dotnet/runtime System.Runtime.Tests.WorkItemExecution
953577 dotnet/runtime System.Runtime.Tests.WorkItemExecution
952449 dotnet/runtime System.Runtime.Tests.WorkItemExecution
952432 dotnet/runtime System.Runtime.Tests.WorkItemExecution
952425 dotnet/runtime System.Runtime.Tests.WorkItemExecution
952442 dotnet/runtime System.Runtime.Tests.WorkItemExecution
951157 dotnet/runtime System.Runtime.Tests.WorkItemExecution
951159 dotnet/runtime System.Runtime.Tests.WorkItemExecution
951149 dotnet/runtime System.Runtime.Tests.WorkItemExecution
951140 dotnet/runtime System.Runtime.Tests.WorkItemExecution
949656 dotnet/runtime System.Runtime.Tests.WorkItemExecution
949651 dotnet/runtime System.Runtime.Tests.WorkItemExecution
949666 dotnet/runtime System.Runtime.Tests.WorkItemExecution
Displaying 100 of 121 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
4 28 113

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=580195
Error message validated: [Killed.+System\.Runtime\.Tests\.runtimeconfig\.json.+OuterLoop]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 2/27/2024 11:09:08 PM UTC
@carlossanlop carlossanlop added area-System.Runtime os-linux Linux OS (any supported distro) arch-x64 blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' runtime-coreclr specific to the CoreCLR runtime os-linux-musl Linux distributions using musl library. Known Build Error Use this to report build issues in the .NET Helix tab labels Feb 27, 2024
@ghost
Copy link

ghost commented Feb 27, 2024

Tagging subscribers to this area: @dotnet/area-system-runtime
See info in area-owners.md if you want to be subscribed.

Issue Details

Error Blob

{
  "ErrorMessage": "",
  "BuildRetry": false,
  "ErrorPattern": "Killed.+System\.Runtime\.Tests\.runtimeconfig\.json.+OuterLoop",
  "ExcludeConsoleLog": false
}

Reproduction Steps

========================== End custom configuration settings ===============================
----- start Mon Feb 26 23:56:03 UTC 2024 =============== To repro directly: =====================================================
pushd .
/root/helix/work/correlation/dotnet exec --runtimeconfig System.Runtime.Tests.runtimeconfig.json --depsfile System.Runtime.Tests.deps.json xunit.console.dll System.Runtime.Tests.dll -xml testResults.xml -nologo -nocolor -trait category=OuterLoop -notrait category=AdditionalTimezoneChecks -notrait category=IgnoreForCI -notrait category=failing 
popd
===========================================================================================================
/root/helix/work/workitem/e /root/helix/work/workitem/e
  Discovering: System.Runtime.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Runtime.Tests (found 29 of 9308 test cases)
  Starting:    System.Runtime.Tests (parallel test collections = on [2 threads], stop on fail = off)
./RunTests.sh: line 180:    21 Killed                  "$RUNTIME_PATH/dotnet" exec --runtimeconfig System.Runtime.Tests.runtimeconfig.json --depsfile System.Runtime.Tests.deps.json xunit.console.dll System.Runtime.Tests.dll -xml testResults.xml -nologo -nocolor -trait category=OuterLoop -notrait category=AdditionalTimezoneChecks -notrait category=IgnoreForCI -notrait category=failing $RSP_FILE
/root/helix/work/workitem/e
----- end Mon Feb 26 23:56:28 UTC 2024 ----- exit code 137 ----------------------------------------------------------
exit code 137 means SIGKILL Killed either due to out of memory/resources (see /var/log/messages) or by explicit kill.
ulimit -c value: unlimited
cat /proc/sys/kernel/core_pattern: /home/helixbot/dotnetbuild/dumps/core.%u.%p
cat /proc/sys/kernel/core_uses_pid: 1
cat: /proc/sys/kernel/coredump_filter: No such file or directory
cat /proc/sys/kernel/coredump_filter:
Looking around for any Linux dumps...
Looking for files matching core.* ...
----- start =============== XUnitLogChecker Output =====================================================
dmesg: klogctl: Operation not permitted
No dumps found in /home/helixbot/dotnetbuild/dumps.
----- end =============== XUnitLogChecker Output - exit code 0 ===========================
+ export '_commandExitCode=137'
+ python /root/helix/work/correlation/reporter/run.py https://dev.azure.com/dnceng-public/ public 13931354 eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsIng1dCI6Im9PdmN6NU1fN3AtSGpJS2xGWHo5M3VfVjBabyJ9.eyJuYW1laWQiOiJjNzczZjJjMi01MTIwLTQyMDctYWZlMi1hZmFmMzVhOGJjMGEiLCJzY3AiOiJhcHBfdG9rZW4iLCJhdWkiOiJhMTBlYjk0MS0xNzM2LTRjNzYtOWFiZC1iZDBlZGYxNjg0ODgiLCJzaWQiOiIxZTViN2VlMC1iNmQyLTQzNjgtODZjOS0zOTQ5MGIxM2FlODAiLCJCdWlsZElkIjoiY2JiMTgyNjEtYzQ4Zi00YWJiLTg2NTEtOGNkY2I1NDc0NjQ5OzU4MDE5NSIsImpvYnJlZiI6IjMxNTZhMmQwLTExYWItNGExMC04NTA0LWY3Y2UxM2ZiMTk2OTo1OTJlZWQ4OS03OGY1LTUyMDItOWRhNS1hZDE3ZGYzYmVmNGEiLCJwcGlkIjoidnN0ZnM6Ly8vQnVpbGQvQnVpbGQvNTgwMTk1Iiwib3JjaGlkIjoiMzE1NmEyZDAtMTFhYi00YTEwLTg1MDQtZjdjZTEzZmIxOTY5LmJ1aWxkLmJ1aWxkX2xpbnV4X211c2xfeDY0X2RlYnVnX2NvcmVjbHJfZGVidWcuX19kZWZhdWx0IiwicmVwb0lkcyI6IiIsImlzcyI6ImFwcC52c3Rva2VuLnZpc3VhbHN0dWRpby5jb20iLCJhdWQiOiJhcHAudnN0b2tlbi52aXN1YWxzdHVkaW8uY29tfHZzbzo2ZmNjOTJlNS03M2E3LTRmODgtOGQxMy1kOTA0NWI0NWZiMjciLCJuYmYiOjE3MDg5ODg5MzgsImV4cCI6MTcwOTAwMDkzOH0.rjlcWYrlHLfuHwUtUIiDkhhUDwy8cnQZ3rCBJjmd8FuCN0BDFzjz0jEMQEbQ9WZ7LHqdWN40vrD1MHH2p9a2tC9JYY7ca4b2w8Yy05wlbG-_cjF_ksT3jfhgz4EOLBiSmE7-bW_m1b3gtKHo-rdFDyMt_vciLiIB_C3543QhcPGJJdph5ok1SjBVKbl1q9wzw4Tut1lLyo8-ToLRotVPvv2Fahz3TSp--EDbdhY2SYtNrPyGVW7t9F8o3TZdG5iyrtyTnCAlr2Qdu-cOUJhyXM_4vhztXvLdgDMuDgGINPpA7sDXoqo_7LB9RP1iNc35uIEM-430j7jeG9MDrZzEZQ
2024-02-26T23:56:35.053Z	INFO   	run.py	run(48)	main	Beginning reading of test results.
2024-02-26T23:56:35.054Z	INFO   	run.py	__init__(42)	read_results	Searching '/root/helix/work/workitem/e' for test results files
2024-02-26T23:56:35.054Z	INFO   	run.py	__init__(42)	read_results	Searching '/root/helix/work/workitem/uploads' for test results files
2024-02-26T23:56:35.062Z	WARNING	run.py	__init__(55)	read_results	No results file found in any of the following formats: xunit, junit, trx
2024-02-26T23:56:35.063Z	INFO   	run.py	packing_test_reporter(30)	report_results	Packing 0 test reports to '/root/helix/work/workitem/e/__test_report.json'
2024-02-26T23:56:35.067Z	INFO   	run.py	packing_test_reporter(33)	report_results	Packed 1541 bytes
+ python /root/helix/work/correlation/gen-debug-dump-docs.py -buildid 580195 -workitem System.Runtime.Tests -jobid 6fc0e798-b0d8-4fd9-9e43-a36cfb9441c4 -outdir /root/helix/work/workitem/uploads -templatedir /root/helix/work/correlation -dumpdir /home/helixbot/dotnetbuild/dumps -productver 9.0.0
gen-debug-dump-docs.py: Did not find dumps, skipping dump docs generation.
+ exit 137
+ export '_commandExitCode=137'
+ chmod -R 777 /home/helixbot/dotnetbuild/dumps
+ exit 137

[END EXECUTION]
Exit Code:137
Author: carlossanlop
Assignees: -
Labels:

area-System.Runtime, os-linux, arch-x64, blocking-clean-ci, runtime-coreclr, os-linux-musl, Known Build Error
Milestone: -

@ghost ghost added the untriaged New issue has not been triaged by the area owner label Feb 27, 2024
@danmoseley
Copy link
Member 


dmesg: read kernel buffer failed: Operation not permitted

Again.. so we can't see whether it was OOM. But presumably it was

@ericstj ericstj added the blocking-outerloop Blocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs label Mar 18, 2024
@jeffschwMSFT jeffschwMSFT removed the blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' label Apr 1, 2024
@ilonatommy
Copy link
Member

Hit on net9.0-linux-Debug-x64-coreclr_release queue, LibraryImportGenerator.Tests but not caught by the query:
https://helixre107v0xdcypoyl9e7f.blob.core.windows.net/dotnet-runtime-refs-pull-99685-merge-4e96f500c0fc4768b9/LibraryImportGenerator.Tests/1/console.9506f96c.log?helixlogtype=result

./RunTests.sh: line 180:    24 Killed                  "$RUNTIME_PATH/dotnet" exec --runtimeconfig LibraryImportGenerator.Tests.runtimeconfig.json --depsfile LibraryImportGenerator.Tests.deps.json xunit.console.dll LibraryImportGenerator.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing $RSP_FILE
----- end Wed Apr 3 08:14:35 UTC 2024 ----- exit code 137 ----------------------------------------------------------
exit code 137 means SIGKILL Killed either due to out of memory/resources (see /var/log/messages) or by explicit kill.
ulimit -c value: unlimited
cat /proc/sys/kernel/core_pattern: /home/helixbot/dotnetbuild/dumps/core.%u.%p
cat /proc/sys/kernel/core_uses_pid: 1
cat: /proc/sys/kernel/coredump_filter: No such file or directory
cat /proc/sys/kernel/coredump_filter:
Looking around for any Linux dumps...
Looking for files matching core.* ...
dmesg: read kernel buffer failed: Operation not permitted

@pavelsavara
Copy link
Member

again https://helixre107v0xdcypoyl9e7f.blob.core.windows.net/dotnet-runtime-refs-pull-98492-merge-31c70303cf32472f92/LibraryImportGenerator.Tests/1/console.c806de40.log?helixlogtype=result

@pavelsavara
Copy link
Member

should we edit the filter here to match exit code 137 ? It didn't found and reported LibraryImportGenerator.Tests in build

@pavelsavara pavelsavara mentioned this issue Apr 4, 2024
Merged
@am11 am11 mentioned this issue May 29, 2024
Closed
@elinor-fung elinor-fung mentioned this issue Jul 9, 2024
Open
@jeffhandley jeffhandley added this to the Future milestone Jul 19, 2024
@jeffhandley jeffhandley removed the untriaged New issue has not been triaged by the area owner label Jul 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
arch-x64 area-System.Runtime blocking-outerloop Blocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs Known Build Error Use this to report build issues in the .NET Helix tab os-linux Linux OS (any supported distro) os-linux-musl Linux distributions using musl library. runtime-coreclr specific to the CoreCLR runtime
Projects
None yet
Milestone
Future
Development

No branches or pull requests
7 participants
@pavelsavara @jeffhandley @carlossanlop @danmoseley @ericstj @jeffschwMSFT @ilonatommy