[NativeAOT-iOS] MacCatalyst fails to start/log `nativeaot.SmokeTests` tests

[matouskozak]

Build Information

Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=804204
Build error leg or test failing:

• nativeaot.SmokeTests.Reflection,
• nativeaot.SmokeTests.StackTraceMetadata
• nativeaot.SmokeTests.Preinitialization

Affected CI: maccatalyst-arm64 Release AllSubsets_NativeAOT_RuntimeTests (runtime-extra-platforms)

The test are failing either with:
XHarness exit code: 83 (APP_LAUNCH_FAILURE)

[05:10:37.6845280] The application cannot be opened for an unexpected reason, error=Error Domain=NSOSStatusErrorDomain Code=-600 "procNotFound: no eligible process with specified descriptor" UserInfo={_LSLine=387, _LSFunction=_LSAnnotateAndSendAppleEventWithOptions}

or
XHarness exit code: 82 (RETURN_CODE_NOT_SET)

Failed to detect application's exit code. The log file was empty / not found at /tmp/helix/working/9D2308EA/w/9FFA08F1/uploads/Reports/nativeaot.SmokeTests.Reflection/Reflection/net.dot.nativeaot_SmokeTests_Reflection.log

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorPattern": "nativeaot/SmokeTests/.+\\[FAIL\\]",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=804204
Error message validated: [nativeaot/SmokeTests/.+\[FAIL\]]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 9/12/2024 10:07:58 AM UTC

Report

Build	Repository	Test	Pull Request
1518979	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
1518559	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
1516926	dotnet/runtime	nativeaot.SmokeTests.AttributeTrimming.WorkItemExecution
1515623	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
1508982	dotnet/runtime	nativeaot.SmokeTests.Reflection.WorkItemExecution
1508374	dotnet/runtime	nativeaot.SmokeTests.DynamicGenerics.WorkItemExecution
1500024	dotnet/runtime	nativeaot.SmokeTests.Preinitialization.WorkItemExecution
1499408	dotnet/runtime	nativeaot.SmokeTests.Preinitialization.WorkItemExecution
1499030	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
1496266	dotnet/runtime	nativeaot.SmokeTests.Preinitialization.WorkItemExecution
1495952	dotnet/runtime	nativeaot.SmokeTests.Reflection.WorkItemExecution
1495180	dotnet/runtime	nativeaot.SmokeTests.Reflection.WorkItemExecution
1485187	dotnet/runtime	nativeaot.SmokeTests.Reflection.WorkItemExecution
1483966	dotnet/runtime	nativeaot.SmokeTests.AttributeTrimming.WorkItemExecution
1483740	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
1482372	dotnet/runtime	nativeaot.SmokeTests.Preinitialization.WorkItemExecution
1480312	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
1478795	dotnet/runtime	nativeaot.SmokeTests.Reflection.WorkItemExecution
1478600	dotnet/runtime	nativeaot.SmokeTests.AttributeTrimming.WorkItemExecution
1478299	dotnet/runtime	nativeaot.SmokeTests.Preinitialization.WorkItemExecution
1477836	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
2	6	21

[matouskozak]

Could it be related to #102882 @ivanpovazan @kotlarmilos ?

[ivanpovazan]

Could it be related to #102882 @ivanpovazan @kotlarmilos ?

I don't think so, that issue did disable the test, but we had a failure with it on tvos-arm64 even before in:
#90460

If I remember correctly the behavior was similar to what you are getting ie the device log showed correct output in the logs but test return value was not what the test runner expected.

I would check if we are properly rooting every possible test infra assembly when we build these tests with NativeAOT.

[ivanpovazan]

@matouskozak @kotlarmilos could you check this:

I would check if we are properly rooting every possible test infra assembly when we build these tests with NativeAOT.