Skip to content

Mark testDynamicInstrumentationEnablementWithLineProbe as Flaky#11947

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit into
masterfrom
sarahchen6/mark-test-flaky
Jul 14, 2026
Merged

Mark testDynamicInstrumentationEnablementWithLineProbe as Flaky#11947
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit into
masterfrom
sarahchen6/mark-test-flaky

Conversation

@sarahchen6

Copy link
Copy Markdown
Contributor

What Does This Do

Mark testDynamicInstrumentationEnablementWithLineProbe() as Flaky

Motivation

Green CI

Additional Notes

For failure examples, see:

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@sarahchen6
sarahchen6 requested a review from a team as a code owner July 14, 2026 16:06
@sarahchen6
sarahchen6 requested review from dudikeleti and removed request for a team July 14, 2026 16:06
@sarahchen6 sarahchen6 added comp: testing Testing tag: no release notes Changes to exclude from release notes tag: flaky test/disabled Disabled flaky tests labels Jul 14, 2026
@sarahchen6
sarahchen6 requested a review from jpbempel July 14, 2026 16:07

@datadog-prod-us1-5 datadog-prod-us1-5 Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Datadog Autotest: PASS

More details

The @Flaky annotation is correctly applied — it uses the already-imported datadog.trace.test.util.Flaky, follows the identical pattern used by testExceptionReplayEnablementFailure in the same class, emits the JUnit5 "flaky" tag consumed by Gradle's skip/run flaky-test properties, and the test_flaky CI job explicitly targets :debuggerTest with CONTINUE_ON_FAILURE: true. The class-level @NonRetryable does not interfere (it controls the test-retry plugin, not JUnit5 tag-based test selection).

Was this helpful? React 👍 or 👎

📊 Validated against 4 scenarios · Open Bits AI session

🤖 Datadog Autotest · Commit d21c429 · What is Autotest? · Any feedback? Reach out in #autotest

@dd-octo-sts

dd-octo-sts Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite Status
Startup 🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results
Scenario Candidate master Δ (95% CI of mean)
startup:insecure-bank:iast:Agent 13.98 s 13.93 s [-0.4%; +1.1%] (no difference)
startup:insecure-bank:tracing:Agent 12.98 s 13.03 s [-1.1%; +0.4%] (no difference)
startup:petclinic:appsec:Agent 16.98 s 16.87 s [-0.4%; +1.7%] (no difference)
startup:petclinic:iast:Agent 16.96 s 16.43 s [-1.2%; +7.6%] (no difference)
startup:petclinic:profiling:Agent 16.81 s 16.93 s [-1.8%; +0.5%] (no difference)
startup:petclinic:sca:Agent 16.86 s 16.87 s [-1.0%; +1.0%] (no difference)
startup:petclinic:tracing:Agent 16.19 s 16.11 s [-0.8%; +1.8%] (no difference)

Commit: d21c4298 · CI Pipeline · Benchmarking Platform UI


Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

@sarahchen6

Copy link
Copy Markdown
Contributor Author

/merge

@gh-worker-devflow-routing-ef8351

gh-worker-devflow-routing-ef8351 Bot commented Jul 14, 2026

Copy link
Copy Markdown

View all feedbacks in Devflow UI.

2026-07-14 17:27:27 UTC ℹ️ Start processing command /merge


2026-07-14 17:27:31 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 2h (p90).


2026-07-14 19:01:59 UTC ℹ️ MergeQueue: This merge request was merged

@gh-worker-dd-mergequeue-cf854d
gh-worker-dd-mergequeue-cf854d Bot merged commit fbd28da into master Jul 14, 2026
587 of 590 checks passed
@gh-worker-dd-mergequeue-cf854d
gh-worker-dd-mergequeue-cf854d Bot deleted the sarahchen6/mark-test-flaky branch July 14, 2026 19:01
@github-actions github-actions Bot added this to the 1.65.0 milestone Jul 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: testing Testing tag: flaky test/disabled Disabled flaky tests tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants