Skip to content

[6.0] JIT.HardwareIntrinsics failure in mono llvmaot linux arm64 - "System.Exception: One or more scenarios did not complete as expected." #81907

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
carlossanlop opened this issue Feb 9, 2023 · 3 comments
Closed

[6.0] JIT.HardwareIntrinsics failure in mono llvmaot linux arm64 - "System.Exception: One or more scenarios did not complete as expected." #81907

carlossanlop opened this issue Feb 9, 2023 · 3 comments
Assignees
@kotlarmilos
Labels
arch-arm64 area-Codegen-AOT-mono area-Codegen-LLVM-mono Known Build Error Use this to report build issues in the .NET Helix tab os-linux Linux OS (any supported distro)

Comments

@carlossanlop
Copy link
Contributor

carlossanlop commented Feb 9, 2023 •
edited by build-analysis bot
Loading

Output (expand) 
+ dotnet /root/helix/work/correlation/xunit/xunit.console.dll JIT/HardwareIntrinsics/JIT.HardwareIntrinsics.XUnitWrapper.dll -parallel collections -nocolor -noshadow -xml testResults.xml -trait TestGroup=JIT.HardwareIntrinsics
Microsoft.DotNet.XUnitConsoleRunner v2.5.0 (64-bit .NET 6.0.13)
  Discovering: JIT.HardwareIntrinsics.XUnitWrapper (method display = ClassAndMethod, method display options = None)
  Discovered:  JIT.HardwareIntrinsics.XUnitWrapper (found 354 test cases)
  Starting:    JIT.HardwareIntrinsics.XUnitWrapper (parallel test collections = on, max threads = 2)
    JIT/HardwareIntrinsics/Arm/Rdm/Rdm_ro/Rdm_ro.sh [FAIL]
      
      Return code:      1
      Raw output file:      /root/helix/work/workitem/uploads/Reports/JIT.HardwareIntrinsics/Arm/Rdm/Rdm_ro/Rdm_ro.output.txt
      Raw output:
      BEGIN EXECUTION
      /root/helix/work/correlation/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false Rdm_ro.dll ''
      Supported ISAs:
        AdvSimd:   True
        Aes:       True
        ArmBase:   True
        Crc32:     True
        Dp:        True
        Rdm:       True
        Sha1:      True
        Sha256:    True
      
      Beginning test case MultiplyRoundedDoublingAndAddSaturateHigh.Vector64.Int16 at 2/9/2023 12:53:36 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:38 AM
      Beginning test case MultiplyRoundedDoublingAndAddSaturateHigh.Vector64.Int32 at 2/9/2023 12:53:38 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:38 AM
      Beginning test case MultiplyRoundedDoublingAndAddSaturateHigh.Vector128.Int16 at 2/9/2023 12:53:38 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:38 AM
      Beginning test case MultiplyRoundedDoublingAndAddSaturateHigh.Vector128.Int32 at 2/9/2023 12:53:38 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:38 AM
      Beginning test case MultiplyRoundedDoublingAndSubtractSaturateHigh.Vector64.Int16 at 2/9/2023 12:53:38 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:38 AM
      Beginning test case MultiplyRoundedDoublingAndSubtractSaturateHigh.Vector64.Int32 at 2/9/2023 12:53:38 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:38 AM
      Beginning test case MultiplyRoundedDoublingAndSubtractSaturateHigh.Vector128.Int16 at 2/9/2023 12:53:38 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:38 AM
      Beginning test case MultiplyRoundedDoublingAndSubtractSaturateHigh.Vector128.Int32 at 2/9/2023 12:53:38 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:39 AM
      Beginning test case MultiplyRoundedDoublingBySelectedScalarAndAddSaturateHigh.Vector64.Int16.Vector64.Int16.3 at 2/9/2023 12:53:39 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:39 AM
      Beginning test case MultiplyRoundedDoublingBySelectedScalarAndAddSaturateHigh.Vector64.Int16.Vector128.Int16.7 at 2/9/2023 12:53:39 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:39 AM
      Beginning test case MultiplyRoundedDoublingBySelectedScalarAndAddSaturateHigh.Vector64.Int32.Vector64.Int32.1 at 2/9/2023 12:53:39 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:39 AM
      Beginning test case MultiplyRoundedDoublingBySelectedScalarAndAddSaturateHigh.Vector64.Int32.Vector128.Int32.3 at 2/9/2023 12:53:39 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:39 AM
      Beginning test case MultiplyRoundedDoublingBySelectedScalarAndAddSaturateHigh.Vector128.Int16.Vector64.Int16.3 at 2/9/2023 12:53:39 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:39 AM
      Beginning test case MultiplyRoundedDoublingBySelectedScalarAndAddSaturateHigh.Vector128.Int16.Vector128.Int16.7 at 2/9/2023 12:53:39 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:39 AM
      Beginning test case MultiplyRoundedDoublingBySelectedScalarAndAddSaturateHigh.Vector128.Int32.Vector64.Int32.1 at 2/9/2023 12:53:39 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:39 AM
      Beginning test case MultiplyRoundedDoublingBySelectedScalarAndAddSaturateHigh.Vector128.Int32.Vector128.Int32.3 at 2/9/2023 12:53:39 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:39 AM
      Beginning test case MultiplyRoundedDoublingBySelectedScalarAndSubtractSaturateHigh.Vector64.Int16.Vector64.Int16.3 at 2/9/2023 12:53:39 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:39 AM
      Beginning test case MultiplyRoundedDoublingBySelectedScalarAndSubtractSaturateHigh.Vector64.Int16.Vector128.Int16.7 at 2/9/2023 12:53:39 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:39 AM
      Beginning test case MultiplyRoundedDoublingBySelectedScalarAndSubtractSaturateHigh.Vector64.Int32.Vector64.Int32.1 at 2/9/2023 12:53:39 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:39 AM
      Beginning test case MultiplyRoundedDoublingBySelectedScalarAndSubtractSaturateHigh.Vector64.Int32.Vector128.Int32.3 at 2/9/2023 12:53:39 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:40 AM
      Beginning test case MultiplyRoundedDoublingBySelectedScalarAndSubtractSaturateHigh.Vector128.Int16.Vector64.Int16.3 at 2/9/2023 12:53:40 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:40 AM
      Beginning test case MultiplyRoundedDoublingBySelectedScalarAndSubtractSaturateHigh.Vector128.Int16.Vector128.Int16.7 at 2/9/2023 12:53:40 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:40 AM
      Beginning test case MultiplyRoundedDoublingBySelectedScalarAndSubtractSaturateHigh.Vector128.Int32.Vector64.Int32.1 at 2/9/2023 12:53:40 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:40 AM
      Beginning test case MultiplyRoundedDoublingBySelectedScalarAndSubtractSaturateHigh.Vector128.Int32.Vector128.Int32.3 at 2/9/2023 12:53:40 AM
      Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro
      
      Beginning scenario: RunUnsupportedScenario
      Beginning scenario: RunBasicScenario_UnsafeRead
      ERROR!!!-System.Exception: One or more scenarios did not complete as expected.
      
      Ending test case at 2/9/2023 12:53:40 AM
      Expected: 100
      Actual: 0
      END EXECUTION - FAILED

...
Log is quite quite long...
...

=== TEST EXECUTION SUMMARY ===
   JIT.HardwareIntrinsics.XUnitWrapper  Total: 354, Errors: 0, Failed: 6, Skipped: 0, Time: 1118.488s

{
  "ErrorMessage": "ERROR!!!-System.Exception: One or more scenarios did not complete as expected.",
  "BuildRetry": false,
  "ErrorPattern": "",
  "ExcludeConsoleLog": false
}

Report

Build Definition Test Pull Request
233216 dotnet/runtime JIT/HardwareIntrinsics/Arm/Rdm/Rdm_ro/Rdm_ro.sh #84568
231081 dotnet/runtime JIT/HardwareIntrinsics/Arm/Rdm/Rdm_ro/Rdm_ro.sh
230948 dotnet/runtime JIT/HardwareIntrinsics/Arm/Rdm/Rdm_ro/Rdm_ro.sh #84460
230681 dotnet/runtime JIT/HardwareIntrinsics/Arm/Rdm/Rdm_r/Rdm_r.sh #84443
230517 dotnet/runtime JIT/HardwareIntrinsics/Arm/Rdm/Rdm_ro/Rdm_ro.sh
230304 dotnet/runtime JIT/HardwareIntrinsics/Arm/Rdm/Rdm_ro/Rdm_ro.sh #84386
230316 dotnet/runtime JIT/HardwareIntrinsics/Arm/Dp/Dp_ro/Dp_ro.sh
229532 dotnet/runtime JIT/HardwareIntrinsics/Arm/Rdm/Rdm_ro/Rdm_ro.sh
229484 dotnet/runtime JIT/HardwareIntrinsics/Arm/Rdm/Rdm_ro/Rdm_ro.sh
229232 dotnet/runtime JIT/HardwareIntrinsics/Arm/Rdm/Rdm_ro/Rdm_ro.sh #84357
229272 dotnet/runtime JIT/HardwareIntrinsics/Arm/Rdm/Rdm_ro/Rdm_ro.sh #84386
228809 dotnet/runtime JIT/HardwareIntrinsics/Arm/Rdm/Rdm_ro/Rdm_ro.sh #84360
228808 dotnet/runtime JIT/HardwareIntrinsics/Arm/Rdm/Rdm_ro/Rdm_ro.sh #84359
228737 dotnet/runtime JIT/HardwareIntrinsics/Arm/Rdm/Rdm_ro/Rdm_ro.sh #84357
228220 dotnet/runtime JIT/HardwareIntrinsics/Arm/Rdm/Rdm_ro/Rdm_ro.sh
228117 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #84337
227747 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution
227550 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #84315
224361 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution
224223 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution
223383 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #84146
223124 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution
222146 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #83829
221489 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution
220935 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution
220788 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution
220473 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #83829
220447 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #83965
220434 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #83731
220430 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #83079
220338 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution
220149 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #83303
215755 dotnet/runtime JIT/HardwareIntrinsics/Arm/Rdm/Rdm_ro/Rdm_ro.sh
215648 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #83857
215171 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #83829
212465 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #83731
211532 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution
211182 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #83513
211146 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #83681
210842 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #83513
208791 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #83513
207991 dotnet/runtime JIT/HardwareIntrinsics/Arm/Rdm/Rdm_r/Rdm_r.sh
207492 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #83513
207016 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #83513
204610 dotnet/runtime JIT/HardwareIntrinsics/Arm/Rdm/Rdm_ro/Rdm_ro.sh
204115 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #83404
203868 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #83303
203217 dotnet/runtime JIT/HardwareIntrinsics/Arm/Rdm/Rdm_ro/Rdm_ro.sh
202868 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #83268
202634 dotnet/runtime JIT.HardwareIntrinsics.WorkItemExecution #83303

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
1 18 50
@carlossanlop carlossanlop added arch-arm64 os-linux Linux OS (any supported distro) area-Codegen-AOT-mono area-Codegen-LLVM-mono Known Build Error Use this to report build issues in the .NET Helix tab labels Feb 9, 2023
@ghost ghost added the untriaged New issue has not been triaged by the area owner label Feb 9, 2023
This was referenced Feb 9, 2023
Merged
Merged
@carlossanlop
Copy link
Contributor Author

@lewing @steveisok this mono failure is pretty impactful. Who can take a look?

This was referenced Mar 29, 2023
Merged
Merged
@ericstj
Copy link
Member

ericstj commented Apr 6, 2023

Still hitting this #84357

@steveisok
Copy link
Member

@lewing @steveisok this mono failure is pretty impactful. Who can take a look?

@SamMonoRT I suspect more test skipping backports may be necessary. Can you have someone take a look?

@kotlarmilos kotlarmilos self-assigned this Apr 7, 2023
@kotlarmilos kotlarmilos mentioned this issue Apr 7, 2023
Merged
@ghost ghost removed the untriaged New issue has not been triaged by the area owner label Apr 11, 2023
@ghost ghost locked as resolved and limited conversation to collaborators May 11, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@kotlarmilos kotlarmilos

Labels
arch-arm64 area-Codegen-AOT-mono area-Codegen-LLVM-mono Known Build Error Use this to report build issues in the .NET Helix tab os-linux Linux OS (any supported distro)
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@steveisok @carlossanlop @ericstj @kotlarmilos