Skip to content

Stop running all SSI system test VMs on MQ#11946

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit into
masterfrom
sarahchen6/reconfigure-gitlab-system-tests
Jul 14, 2026
Merged

Stop running all SSI system test VMs on MQ#11946
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit into
masterfrom
sarahchen6/reconfigure-gitlab-system-tests

Conversation

@sarahchen6

Copy link
Copy Markdown
Contributor

What Does This Do

Run all SSI GitLab system tests on master only, no longer on the Merge Queue

Motivation

These tests are relatively flaky and difficult to mark as flaky on the dd-trace-java side. They are negatively affecting MQ success rates. The tests were intended to be run nightly, so running only on master should be okay.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@sarahchen6
sarahchen6 requested a review from a team as a code owner July 14, 2026 15:56
@sarahchen6 sarahchen6 added the tag: no release notes Changes to exclude from release notes label Jul 14, 2026
@sarahchen6
sarahchen6 requested a review from a team as a code owner July 14, 2026 15:56
@sarahchen6 sarahchen6 added the comp: tooling Build & Tooling label Jul 14, 2026
@sarahchen6
sarahchen6 requested review from bric3 and erikayasuda and removed request for a team July 14, 2026 15:56

@datadog-datadog-prod-us1 datadog-datadog-prod-us1 Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Datadog Autotest: PASS

More details

Three-line CI config deletion that removes SYSTEM_TESTS_RUN_ALL_VMS: "true" from the MQ workflow rule — the downstream system-tests pipeline (via remote one-pipeline.yml) will now use its default VM set on MQ while master retains the full-VM run; the Gradle test_ssi_smoke jobs continue running on MQ unaffected because they have their own explicit rules and do not consume this variable.

Was this helpful? React 👍 or 👎

Open Bits AI session

🤖 Datadog Autotest · Commit 1648cdd · What is Autotest? · Any feedback? Reach out in #autotest

@datadog-datadog-prod-us1

datadog-datadog-prod-us1 Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

🎯 Code Coverage (details)
Patch Coverage: 100.00%
Overall Coverage: 57.17% (-0.02%)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 1648cdd | Docs | Datadog PR Page | Give us feedback!

@dd-octo-sts

dd-octo-sts Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite Status
Startup 🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results
Scenario Candidate master Δ (95% CI of mean)
startup:insecure-bank:iast:Agent 13.92 s 14.03 s [-1.4%; -0.1%] (maybe better)
startup:insecure-bank:tracing:Agent 13.02 s 13.06 s [-1.1%; +0.6%] (no difference)
startup:petclinic:appsec:Agent 16.89 s 16.21 s [-0.2%; +8.7%] (no difference)
startup:petclinic:iast:Agent 16.80 s 16.96 s [-1.7%; -0.2%] (maybe better)
startup:petclinic:profiling:Agent 16.81 s 16.66 s [-0.2%; +2.0%] (no difference)
startup:petclinic:sca:Agent 16.93 s 16.91 s [-0.7%; +0.9%] (no difference)
startup:petclinic:tracing:Agent 16.17 s 16.33 s [-1.8%; -0.2%] (maybe better)

Commit: 1648cdd6 · CI Pipeline · Benchmarking Platform UI


Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

@mcculls mcculls left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Makes sense

@sarahchen6

Copy link
Copy Markdown
Contributor Author

/merge

@gh-worker-devflow-routing-ef8351

gh-worker-devflow-routing-ef8351 Bot commented Jul 14, 2026

Copy link
Copy Markdown

View all feedbacks in Devflow UI.

2026-07-14 17:11:52 UTC ℹ️ Start processing command /merge


2026-07-14 17:11:57 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 2h (p90).


2026-07-14 18:13:08 UTC ℹ️ MergeQueue: This merge request was merged

@gh-worker-dd-mergequeue-cf854d
gh-worker-dd-mergequeue-cf854d Bot merged commit 979299b into master Jul 14, 2026
587 of 590 checks passed
@gh-worker-dd-mergequeue-cf854d
gh-worker-dd-mergequeue-cf854d Bot deleted the sarahchen6/reconfigure-gitlab-system-tests branch July 14, 2026 18:13
@github-actions github-actions Bot added this to the 1.65.0 milestone Jul 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants