Skip to content

[ci-scan] Hang: JIT/jit64/regress/vsw/539509/test1_539509 never exits after Passed on browser-wasm R2R-CG2 #135042

Closed

Description

@lewing

Build Information

Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=1619748
Build error leg or test failing: run_test_p0_coreclr_R2R_CG2_browser_wasm_checked (R2R-CG2 browser wasm Checked no_tiered_compilation)-JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd
Pull request: #134618

KBE authoring guidance (ci-failure-scan)
  • Error Details is for readers. Paste the full exception, stack trace, or build error excerpt so the failure is understandable without opening the raw log.
  • Build Analysis parses only the single JSON block under Error Message.
  • ErrorPattern uses .NET Singleline | IgnoreCase | NonBacktracking matching with a 50ms-per-line timeout.
  • Keep the regex anchored, prefer [^\n]* over .*, and avoid catastrophic backtracking.
  • Set BuildRetry to true only for a clear infrastructure retry case. ExcludeConsoleLog disables Helix console-log scanning.

The test crossgens and runs under node with corerun.js. It handles every expected exception and prints Passed., but the node process never exits. The out-of-process wrapper kills it after the 1800 s timeout, so the test fails even though its body passed. Helix work item jit64_5, job 6ca59463-8af3-4f89-bf8b-e15def16552f.

The PR build that hit this doesn't change crossgen2, the JIT, the VM, or corerun; its diff is limited to the browser WebAssembly SDK pack targets, boot-config tasks, and the browser loader. The test didn't fail in the main runtime build 1619318.

Error Details

Running: node --experimental-wasm-exnref --stack-size=8192 /root/helix/work/correlation/corerun.js -c /root/helix/work/correlation -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true /root/helix/work/workitem/e/JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.dll
Testing AA::Method1
Exception handled: System.InvalidCastException: Unable to cast object of type 'BB' to type 'AA`6[System.SByte,System.Byte,System.UInt32,System.UInt32,System.Int64,System.Boolean]'.
...
Testing BB::Method1
Exception handled: System.InvalidCastException: Unable to cast object of type 'AA`6[System.SByte,System.Byte,System.UInt32,System.UInt32,System.Int64,System.Boolean]' to type 'BB'.
   at BB.Method1(UInt32[,][][]& param1, String[][]& param2, Char[,]& param3, AA`6 param4, AA`6& param5, Int32 param6)
   at App.TestEntryPoint()
Passed.
Process 828 exceeded timeout of 1800 seconds. Killing...
../regress/vsw/539509/test1_539509/test1_539509.sh: line 488:   828 Killed                     "${cmd[@]}"
Kill watchdog with PID 829

Error Message

{
  "ErrorMessage": "",
  "ErrorPattern": "test1_539509\\.sh: line \\d+:\\s+\\d+ Killed",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}
Agentic workflow metadata (ci-failure-scan)

Workflow artifact: ci-failure-scan
Artifact kind: kbe-verification
Verified match count: 2 hits in failure.log

Note

This issue was drafted with GitHub Copilot.

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=1619748
Error message validated: [test1_539509\.sh: line \d+:\s+\d+ Killed]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 10/1/2026 6:44:01 PM UTC

Report

Build Repository Test Pull Request
1670060 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd
1669867 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #137149
1669413 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #137129
1669352 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #136770
1668054 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #137085
1665640 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #137012
1664358 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd
1664151 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #136924
1663758 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #135475
1663037 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #136953
1662695 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #136915
1661561 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #133422
1660954 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #136886
1660723 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #135555
1660563 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd
1660490 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #136862
1660377 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #133086
1659384 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #136825
1658778 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd
1658549 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd
1656966 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #136738
1655935 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #136692
1654235 dotnet/runtime JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #136527
1653598 dotnet/runtime JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #136615
1653565 dotnet/runtime JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd
1646146 dotnet/runtime OutOfProcessTest.JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #136338
1645748 dotnet/runtime JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #133660
1641627 dotnet/runtime JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #136125
1641178 dotnet/runtime JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #135805
1639021 dotnet/runtime JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #133659
1634105 dotnet/runtime JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd #135725

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 13 31

Activity

  1. added
    blocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'
    Known Build ErrorUse this to report build issues in the .NET Helix tab
    on Oct 1, 2026
  2. dotnet-policy-service commented on Oct 1, 2026

    @dotnet-policy-service
    Contributor

    Tagging subscribers to this area: @dotnet/runtime-infrastructure
    See info in area-owners.md if you want to be subscribed.

  3. VincentBu commented on Oct 12, 2026

    @VincentBu
    Contributor

    Failed in: runtime-coreclr gcstress0x3-gcstress0xc 20261010.1

    Failed tests:

    coreclr windows x86 Checked gcstress0x3 @ Windows.10.Amd64.Open
    - JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd
    
    

    Error message:

    cmdLine:C:\h\w\B022097C\w\AFF209BC\e\JIT\jit64\jit64_5\../regress/vsw/539509/test1_539509/test1_539509.cmd Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 10/10/2026 2:19:23 PM, end: 10/10/2026 3:19:23 PM)
    
    Return code:      -100
    Raw output file:      C:\h\w\B022097C\w\AFF209BC\uploads\regress\vsw\539509\test1_539509\output.txt
    Raw output:
    BEGIN EXECUTION
     "C:\h\w\B022097C\p\corerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true"  test1_539509.dll 
    Testing AA::Method1
    Exception handled: System.InvalidCastException: Unable to cast object of type 'BB' to type 'AA`6[System.SByte,System.Byte,System.UInt32,System.UInt32,System.Int64,System.Boolean]'.
       at App.TestEntryPoint()
    Testing AA::Static1
    Exception handled: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
    Testing AA::Static2
    Exception handled: System.InvalidCastException: Unable to cast object of type 'AA`6[System.SByte,System.Byte,System.UInt32,System.UInt32,System.Int64,System.Boolean]' to type 'System.SByte[][,,,]'.
       at AA`6.Static2(UInt64 param1, Int16 param2, UInt32& param3, TA& param4)
       at App.TestEntryPoint()
    Testing AA::Static3
    Exception handled: System.NullReferenceException: Object reference not set to an instance of an object.
       at AA`6.Static3(TestEnum param1, Int16 param2)
       at App.TestEntryPoint()
    Testing AA::Static4
    Testing AA::Static5
    Exception handled: System.NullReferenceException: Object reference not set to an instance of an object.
       at AA`6.Static5(TE& param1, Char[,,,][]& param2, Array param3, UInt64[,,,,]& param4, Int64[,][][][][,,,]& param5)
       at App.TestEntryPoint()
    Testing BB::Method1
    Exception handled: System.InvalidCastException: Unable to cast object of type 'AA`6[System.SByte,System.Byte,System.UInt32,System.UInt32,System.Int64,System.Boolean]' to type 'BB'.
       at BB.Method1(UInt32[,][][]& param1, String[][]& param2, Char[,]& param3, AA`6 param4, AA`6& param5, Int32 param6)
       at App.TestEntryPoint()
    Passed.
    
    cmdLine:C:\h\w\B022097C\w\AFF209BC\e\JIT\jit64\jit64_5\../regress/vsw/539509/test1_539509/test1_539509.cmd Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 10/10/2026 2:19:23 PM, end: 10/10/2026 3:19:23 PM)
    Test Harness Exitcode is : -100
    To run the test:
    Set up CORE_ROOT and run.
    > C:\h\w\B022097C\w\AFF209BC\e\JIT\jit64\jit64_5\../regress/vsw/539509/test1_539509/test1_539509.cmd
    

    Stack trace:

    at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 135
       at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix) in /__w/1/s/src/tests/Common/CoreCLRTestLibrary/OutOfProcessTest.cs:line 202
       at Program.<<Main>$>g__TestExecutor232|0_233(StreamWriter tempLogSw, StreamWriter statsCsvSw, StreamWriter outOfProcessPlanWriter, <>c__DisplayClass0_0&)
    
  4. VincentBu commented on Oct 26, 2026

    @VincentBu
    Contributor

    Failed in: runtime-coreclr gcstress0x3-gcstress0xc 20261024.1

    Failed tests:

    coreclr windows x86 Checked gcstress0x3 @ Windows.10.Amd64.Open
    - JIT/jit64/regress/vsw/539509/test1_539509/test1_539509.cmd
    
    

    Error message:

    cmdLine:C:\h\w\A7750904\w\A4E508F2\e\JIT\jit64\jit64_5\../regress/vsw/539509/test1_539509/test1_539509.cmd Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 10/24/2026 2:19:02 PM, end: 10/24/2026 3:19:02 PM)
    
    Return code:      -100
    Raw output file:      C:\h\w\A7750904\w\A4E508F2\uploads\regress\vsw\539509\test1_539509\output.txt
    Raw output:
    BEGIN EXECUTION
     "C:\h\w\A7750904\p\corerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true"  test1_539509.dll 
    Testing AA::Method1
    Exception handled: System.InvalidCastException: Unable to cast object of type 'BB' to type 'AA`6[System.SByte,System.Byte,System.UInt32,System.UInt32,System.Int64,System.Boolean]'.
       at App.TestEntryPoint()
    Testing AA::Static1
    Exception handled: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
    Testing AA::Static2
    Exception handled: System.InvalidCastException: Unable to cast object of type 'AA`6[System.SByte,System.Byte,System.UInt32,System.UInt32,System.Int64,System.Boolean]' to type 'System.SByte[][,,,]'.
       at AA`6.Static2(UInt64 param1, Int16 param2, UInt32& param3, TA& param4)
       at App.TestEntryPoint()
    Testing AA::Static3
    Exception handled: System.NullReferenceException: Object reference not set to an instance of an object.
       at AA`6.Static3(TestEnum param1, Int16 param2)
       at App.TestEntryPoint()
    Testing AA::Static4
    Testing AA::Static5
    Exception handled: System.NullReferenceException: Object reference not set to an instance of an object.
       at AA`6.Static5(TE& param1, Char[,,,][]& param2, Array param3, UInt64[,,,,]& param4, Int64[,][][][][,,,]& param5)
       at App.TestEntryPoint()
    Testing BB::Method1
    Exception handled: System.InvalidCastException: Unable to cast object of type 'AA`6[System.SByte,System.Byte,System.UInt32,System.UInt32,System.Int64,System.Boolean]' to type 'BB'.
       at BB.Method1(UInt32[,][][]& param1, String[][]& param2, Char[,]& param3, AA`6 param4, AA`6& param5, Int32 param6)
       at App.TestEntryPoint()
    Passed.
    
    cmdLine:C:\h\w\A7750904\w\A4E508F2\e\JIT\jit64\jit64_5\../regress/vsw/539509/test1_539509/test1_539509.cmd Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 10/24/2026 2:19:02 PM, end: 10/24/2026 3:19:02 PM)
    Test Harness Exitcode is : -100
    To run the test:
    Set up CORE_ROOT and run.
    > C:\h\w\A7750904\w\A4E508F2\e\JIT\jit64\jit64_5\../regress/vsw/539509/test1_539509/test1_539509.cmd
    

    Stack trace:

    at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 135
       at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix) in /__w/1/s/src/tests/Common/CoreCLRTestLibrary/OutOfProcessTest.cs:line 202
       at Program.<<Main>$>g__TestExecutor232|0_233(StreamWriter tempLogSw, StreamWriter statsCsvSw, StreamWriter outOfProcessPlanWriter, <>c__DisplayClass0_0&)
    
  5. caraioniurie47 commented on Oct 28, 2026

    @caraioniurie47
    Contributor

    The same hang hit GC/Features/LOHCompaction/lohpin/lohpin.cmd on the R2R-CG2 browser wasm Checked leg (Ubuntu.2604) of build 1651447 for #136454. The test body passes and node never exits:

    269 objects have moved out of 270
    Test passed
    Process 1116 exceeded timeout of 1800 seconds. Killing...
    ../LOHCompaction/lohpin/lohpin.sh: line 514:  1116 Killed                     "${cmd[@]}"
    Expected: 100
    Actual: 99
    

    The ErrorPattern here names only test1_539509, so Build Analysis leaves it unmatched. Could the pattern cover it too, for example (test1_539509|lohpin)\.sh: line \d+:\s+\d+ Killed?

    Note

    AI-generated, written at my direction and reviewed by me before posting. The log lines are from the work item's Helix console log; the pattern was tested against that log's Killed line.

  6. added
    area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI
    and removed on Oct 28, 2026
  7. dotnet-policy-service commented on Oct 28, 2026

    @dotnet-policy-service
    Contributor

    Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch
    See info in area-owners.md if you want to be subscribed.

  8. added and removed
    untriagedNew issue has not been triaged by the area owner
    on Oct 29, 2026
  9. added this to the 12.0.0 milestone on Oct 29, 2026
  10. added
    Priority:1Work that is critical for the release, but we could probably ship without
    on Oct 29, 2026
  11. lewing commented on Nov 3, 2026

    @lewing
    MemberAuthor

    @VincentBu the non browser errors should be resolved by #136869

  12. lewing commented on Nov 3, 2026

    @lewing
    MemberAuthor

    the browser hangs should be fixed by #136897

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Known Build ErrorUse this to report build issues in the .NET Helix tabPriority:1Work that is critical for the release, but we could probably ship withoutarea-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMIblocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'blocking-clean-ci-optionalBlocking optional rolling runs

Type

No type

Projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions