Skip to content

Update Helix Job Monitor and turn it on for the runtime pipeline - #131969

Merged
mmitche merged 1 commit into
mainfrom
mmitche-patch-1
Aug 25, 2026
Merged

mmitche merged 1 commit into
mainfrom
mmitche-patch-1

Conversation

@mmitche

@mmitche mmitche commented Aug 6, 2026 •

Copy link
Copy Markdown
Member

Summary

  • update Microsoft.DotNet.Helix.JobMonitor to 11.0.0-beta.26424.2 from Arcade build 20260824.2
  • pick up the scalable result-processing rewrite from Rewrite the Helix Job Monitor for scalable result processing arcade#17331, including build-scoped discovery, parallel incremental result uploads, retry-aware state, rate-limit handling, and final drain/status reporting
  • add the template's configurable result-upload parallelism and run runtime CI with parallelism 48
  • enable the monitor in the runtime pipeline while allowing path-filtered builds with no Helix submissions

Copilot AI lite review requested due to automatic review settings August 6, 2026 21:12
@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
Successfully started running 3 pipeline(s).
13 pipeline(s) were filtered out due to trigger conditions.
There may be pipelines that require an authorized user to comment /azp run to run.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates the pinned .NET local tool version for microsoft.dotnet.helix.jobmonitor to a newer 11.0.0-beta build, so the repo’s dotnet tool restore / Helix job monitor usage picks up the intended fix.

Changes:

  • Bump microsoft.dotnet.helix.jobmonitor from 11.0.0-beta.26404.8 to 11.0.0-beta.26406.8 in the local tool manifest.

@tarekgh

tarekgh commented Aug 6, 2026

Copy link
Copy Markdown
Member

@dotnet-policy-service

Copy link
Copy Markdown
Contributor

Tagging subscribers to this area: @dotnet/area-meta
See info in area-owners.md if you want to be subscribed.

Copilot AI review requested due to automatic review settings August 7, 2026 15:17

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 1 out of 2 changed files in this pull request and generated no new comments.

Suppressed comments (1)

.config/dotnet-tools.json:31

  • The Helix Job Monitor version bump is only applied to the local tool manifest here, but the repo still pins Microsoft.DotNet.Helix.JobMonitor to 11.0.0-beta.26404.8 in eng/Version.Details.xml and eng/Version.Details.props (similar tools like XHarness are kept in sync). This leaves two different "source of truth" versions in the repo and can cause confusion / dependency-flow churn; please update the Arcade dependency pins as well (or explain why this tool is intentionally diverging from Version.Details).
    "microsoft.dotnet.helix.jobmonitor": {
      "version": "11.0.0-beta.26406.8",
      "commands": [

Comment thread .config/dotnet-tools.json Outdated
Copilot AI review requested due to automatic review settings August 7, 2026 22:30

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 1 out of 2 changed files in this pull request and generated no new comments.

Suppressed comments (1)

.config/dotnet-tools.json:31

  • The PR title indicates updating helix.jobmonitor to 11.0.0-beta.26406.8, but the tool manifest pins 11.0.0-beta.26407.3. Please align the pinned version with the intended update (or update the PR title/description to match) to avoid confusion when tracking tool rollouts.
    "microsoft.dotnet.helix.jobmonitor": {
      "version": "11.0.0-beta.26407.3",
      "commands": [

Copilot AI review requested due to automatic review settings August 11, 2026 14:51

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 1 out of 2 changed files in this pull request and generated no new comments.

Suppressed comments (1)

.config/dotnet-tools.json:31

  • The PR title says the helix.jobmonitor version is being updated to 11.0.0-beta.26406.8, but the tool manifest is actually updated to 11.0.0-beta.26411.1. Please align these (either update the PR title/description to match the version being shipped, or change the version here if 26406.8 is the intended target).
    "microsoft.dotnet.helix.jobmonitor": {
      "version": "11.0.0-beta.26411.1",
      "commands": [

Copilot AI review requested due to automatic review settings August 11, 2026 15:37

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 1 out of 2 changed files in this pull request and generated no new comments.

Suppressed comments (1)

.config/dotnet-tools.json:31

  • The PR title says the helix.jobmonitor version is being updated to 11.0.0-beta.26406.8, but this change pins microsoft.dotnet.helix.jobmonitor to 11.0.0-beta.26411.1. Please align the PR title/description with the version actually being used, or update the manifest to the intended version.
    "microsoft.dotnet.helix.jobmonitor": {
      "version": "11.0.0-beta.26411.1",
      "commands": [

Copilot AI review requested due to automatic review settings August 11, 2026 19:44

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 1 out of 1 changed files in this pull request and generated no new comments.

Suppressed comments (1)

.config/dotnet-tools.json:31

  • PR title says update helix.jobmonitor to 11.0.0-beta.26406.8, but the actual change sets it to 11.0.0-beta.26411.1 (from 26407.8). Please align the PR title/description with the version being introduced, or adjust the version here to match the stated target.
    "microsoft.dotnet.helix.jobmonitor": {
      "version": "11.0.0-beta.26411.1",
      "commands": [

Copilot AI review requested due to automatic review settings August 12, 2026 04:11

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 2 out of 2 changed files in this pull request and generated no new comments.

Suppressed comments (2)

.config/dotnet-tools.json:30

  • The PR title says the Helix job monitor is being updated to 11.0.0-beta.26406.8, but the tool manifest is updated to 11.0.0-beta.31411.1. Please align the PR metadata and the actual version being consumed (either update the title/description or change the manifest version) so it’s clear what build is being taken and why.
      "version": "11.0.0-beta.31411.1",

NuGet.config:15

  • Adding the new 'general-testing' package source affects restores for the entire repo (extra feed to probe and a potentially different source of packages). If this feed is only needed to acquire the updated helix.jobmonitor tool, consider scoping it to just that restore path (or document why the global source addition is required) to avoid unintended restore/source selection changes.
    <add key="general-testing" value="https://pkgs.dev.azure.com/dnceng/public/_packaging/general-testing/nuget/v3/index.json" />

Copilot AI review requested due to automatic review settings August 12, 2026 04:21

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 2 out of 2 changed files in this pull request and generated no new comments.

Suppressed comments (1)

.config/dotnet-tools.json:31

  • The PR title/description says the update is to helix.jobmonitor 11.0.0-beta.26406.8, but the change here updates to 11.0.0-beta.31411.2 (from 11.0.0-beta.26407.8). Please confirm which version is intended and align either this value or the PR metadata so the change is traceable.
    "microsoft.dotnet.helix.jobmonitor": {
      "version": "11.0.0-beta.31411.2",
      "commands": [

Copilot AI review requested due to automatic review settings August 12, 2026 06:58

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 4 changed files in this pull request and generated no new comments.

Suppressed comments (2)

eng/pipelines/runtime.yml:58

  • enableHelixJobMonitor is assigned twice with conflicting values (false then true). Since there are no uses between these assignments, the first assignment is redundant and makes it harder to understand which behavior is intended.
  # Keep the monitor enabled in the PR merge even when the target branch
  # temporarily changes the default above.
  - name: enableHelixJobMonitor
    value: true

.config/dotnet-tools.json:30

  • The PR title/description says the helix job monitor is being updated to 11.0.0-beta.26406.8, but this change pins microsoft.dotnet.helix.jobmonitor to 11.0.0-beta.31411.16. Please reconcile the intended version (or update the PR title/description to match what is actually being used).
      "version": "11.0.0-beta.31411.16",

Copilot AI review requested due to automatic review settings August 21, 2026 14:23

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 4 changed files in this pull request and generated no new comments.

Suppressed comments (2)

eng/pipelines/runtime.yml:58

  • The variable enableHelixJobMonitor is declared twice (first false, then true). In Azure Pipelines the later value wins, which makes the earlier entry misleading and easy to accidentally “toggle” without effect. Consider keeping a single declaration with the intended value and keep helix-platforms.yml as a separate entry.
  - name: enableHelixJobMonitor
    value: false
  - template: /eng/pipelines/helix-platforms.yml
  # Keep the monitor enabled in the PR merge even when the target branch
  # temporarily changes the default above.
  - name: enableHelixJobMonitor
    value: true

.config/dotnet-tools.json:31

  • The PR title says the job monitor is being updated to 11.0.0-beta.26406.8, but the manifest pins microsoft.dotnet.helix.jobmonitor to 11.0.0-beta.31411.17. Please align the pinned version (and any related feed changes) with the intended version, or update the PR title/description accordingly.
    "microsoft.dotnet.helix.jobmonitor": {
      "version": "11.0.0-beta.31411.17",
      "commands": [

Copilot AI review requested due to automatic review settings August 21, 2026 15:31

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 4 changed files in this pull request and generated 1 comment.

Suppressed comments (1)

Previously missed (1) — in code that hasn't changed since the last review.

eng/pipelines/runtime.yml:58

  • enableHelixJobMonitor is defined twice in the same variables block. The second definition currently overrides the first, making the initial false assignment redundant and potentially confusing (and order-dependent for template evaluation). Prefer a single definition with the effective value.
  # Keep the monitor enabled in the PR merge even when the target branch
  # temporarily changes the default above.
  - name: enableHelixJobMonitor
    value: true

Comment thread .config/dotnet-tools.json Outdated
Copilot AI review requested due to automatic review settings August 24, 2026 20:56
@mmitche mmitche changed the title Update version of helix.jobmonitor to 11.0.0-beta.26406.8 Update Helix Job Monitor to 11.0.0-beta.26424.2 Aug 24, 2026
Use the promoted scalable Job Monitor, add configurable result-upload parallelism, and enable the monitor in the runtime pipeline.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: f6ec29d9-df3d-405a-a823-571c6a18e447

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 2 out of 3 changed files in this pull request and generated 1 comment.

Comment thread eng/common/core-templates/job/helix-job-monitor.yml
Copilot AI review requested due to automatic review settings August 24, 2026 21:02

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 2 out of 3 changed files in this pull request and generated no new comments.

@premun
premun removed the request for review from akoeplinger August 25, 2026 14:19
@premun premun changed the title Update Helix Job Monitor to 11.0.0-beta.26424.2 Update Helix Job Monitor and turn it on for the runtime pipeline Aug 25, 2026
@mmitche
mmitche merged commit 4ea3d42 into main Aug 25, 2026
184 checks passed
@mmitche
mmitche deleted the mmitche-patch-1 branch August 25, 2026 15:13
@dotnet-milestone-bot dotnet-milestone-bot Bot added this to the 12.0-preview1 milestone Aug 26, 2026
akoeplinger added a commit that referenced this pull request Sep 21, 2026
## Description

Backport the Helix job monitor integration from main/release/11.0,
including the groundwork from #129690 and #132150 and the re-enablement
in #131969.

Includes the subsequent fixes for empty stages (#132019), conditional
monitor inclusion (#132882, #132884), parameter forwarding (#133002),
performance monitoring (#132807, #133480), and internal credentials
(#133633, #133688, #133885).

- Use `Microsoft.DotNet.Helix.JobMonitor` version
`10.0.0-beta.26461.103`, matching release/10.0's existing Arcade/VMR
build.
- Preserve the existing SDK, shared Arcade templates, queues, and
release/10.0 job layouts.
- Follow upstream enablement, except scheduled libraries outerloop runs
retain release/10.0's existing warning-only reporting policy.
- Leave SuperPMI's post-Helix processing unchanged. The separate
perf-slow enablement in #133726 is not included.

## Customer Impact

CI infrastructure only; no shipped runtime changes. Moves Helix waiting
and test-result reporting into the standalone monitor for the enabled
pipelines.

## Regression

Not a product regression fix; backports existing CI infrastructure and
its follow-up fixes.

## Testing

- Validated YAML/JSON/XML configuration and preservation of unrelated
settings.
- Checked 43 entry pipelines, 149 forwarding sites, and 516
public/internal, PR/scheduled/manual, and normal/staging combinations,
plus disabled-mode behavior.
- Exercised MSBuild child-property forwarding and the pinned SDK's
waiting/reporter properties, including environment-based opt-in.
- Restored the monitor and verified its CLI compatibility under .NET 10.

No product build or live Azure DevOps pipeline execution was performed
locally.

## Risk

Changes CI scheduling and result reporting, not product behavior. Uses
the monitor package matching the branch's existing toolset and retains
the release/10.0-specific scheduled outerloop failure policy. End-to-end
Azure DevOps validation is still required.

> [!NOTE]
> This PR description and backport were prepared with GitHub Copilot.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: aae9b201-32a8-45eb-ae1a-db80a0ab4156
@github-actions github-actions Bot locked and limited conversation to collaborators Sep 25, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants