Skip to content

[Flaky Test] Quarantine 3 flaky tests#14397

Merged
ViktorHofer merged 2 commits into
mainfrom
quarantine-flaky-tests-2026-07-16-61dcad8385df8548
Jul 20, 2026
Merged

[Flaky Test] Quarantine 3 flaky tests#14397
ViktorHofer merged 2 commits into
mainfrom
quarantine-flaky-tests-2026-07-16-61dcad8385df8548

Conversation

@github-actions

Copy link
Copy Markdown
Contributor

Quarantines 3 flaky tests detected across multiple independent CI sources.


Microsoft.Build.BuildCheck.UnitTests.EndToEndTests.TestBuildCheckTemplate

Flaky-test key (automated de-duplication — do not edit):

flaky-test-id: Microsoft.Build.BuildCheck.UnitTests.EndToEndTests.TestBuildCheckTemplate

Action: Quarantine (6a)
Tracked by #14392

  • Distinct sources: 6 (2 PRs + 4 rolling builds)
  • Rolling builds: 1498681, 1501229, 1507966, 1509637
  • Legs: CoreOnMac, CoreOnWindows | TFM: net10.0
  • Assembly: Microsoft.Build.BuildCheck.UnitTests
  • First seen: 2026-07-11 | Last seen: 2026-07-15
  • Multiple distinct error hashes (6): sporadic/non-deterministic
  • Sample: build 1506605

Microsoft.Build.Engine.UnitTests.NetTaskHost_E2E_Tests.NetTaskHost_SymlinkedSdkPath_ShouldNotCauseMSB4216

Flaky-test key (automated de-duplication — do not edit):

flaky-test-id: Microsoft.Build.Engine.UnitTests.NetTaskHost_E2E_Tests.NetTaskHost_SymlinkedSdkPath_ShouldNotCauseMSB4216

Action: Quarantine (6a)
Tracked by #14393

  • Distinct sources: 4 (4 distinct PRs, 0 rolling builds)
  • Multiple distinct error hashes (7): sporadic/non-deterministic
  • Legs: CoreOnLinux, CoreOnMac | TFM: net10.0
  • Assembly: Microsoft.Build.Engine.UnitTests
  • First seen: 2026-07-03 | Last seen: 2026-07-15
  • Sample: build 1506605

Microsoft.Build.UnitTests.TerminalLogger_Tests.ReplayBinaryLogWithFewerNodesThanOriginalBuild

Flaky-test key (automated de-duplication — do not edit):

flaky-test-id: Microsoft.Build.UnitTests.TerminalLogger_Tests.ReplayBinaryLogWithFewerNodesThanOriginalBuild

Action: Quarantine (6a)
Tracked by #14394

  • Distinct sources: 3 (1 PR + 2 rolling builds)
  • Rolling builds: 1498777, 1507790
  • Multiple distinct error hashes (3): sporadic/non-deterministic
  • Legs: CoreOnMac | TFM: net10.0
  • Assembly: Microsoft.Build.Engine.UnitTests
  • First seen: 2026-07-08 | Last seen: 2026-07-15
  • Sample: build 1510234

Warning

Firewall blocked 2 domains

The following domains were blocked by the firewall during workflow execution:

  • awmgmcpg
  • southcentralus0.in.applicationinsights.azure.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"
    - "southcentralus0.in.applicationinsights.azure.com"

See Network Configuration for more information.

Generated by Flaky Test Triage · 82.6 AIC · ⌖ 6.34 AIC · ⊞ 13.5K ·

- Microsoft.Build.BuildCheck.UnitTests.EndToEndTests.TestBuildCheckTemplate (issue #14392)
- Microsoft.Build.Engine.UnitTests.NetTaskHost_E2E_Tests.NetTaskHost_SymlinkedSdkPath_ShouldNotCauseMSB4216 (issue #14393)
- Microsoft.Build.UnitTests.TerminalLogger_Tests.ReplayBinaryLogWithFewerNodesThanOriginalBuild (issue #14394)

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions github-actions Bot added the flaky-test Tests that have failed but passed on rerun. label Jul 16, 2026
@ViktorHofer
ViktorHofer merged commit 1044d3e into main Jul 20, 2026
10 checks passed
@ViktorHofer
ViktorHofer deleted the quarantine-flaky-tests-2026-07-16-61dcad8385df8548 branch July 20, 2026 08:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

flaky-test Tests that have failed but passed on rerun.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants