Skip to content

devops(bidi): stop publishing csv reports to the bidi-reports branch - #42917

Merged
Yury Semikhatsky (yury-s) merged 2 commits into
microsoft:mainfrom
yury-s:remove-bidi-reports-branch
Oct 2, 2026
Merged

Yury Semikhatsky (yury-s) merged 2 commits into
microsoft:mainfrom
yury-s:remove-bidi-reports-branch

Conversation

@yury-s

@yury-s Yury Semikhatsky (yury-s) commented Sep 24, 2026 •

Copy link
Copy Markdown
Member

Summary

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@hbenl Holger Benl (hbenl) left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We actually use both the json report (for our dashboard) and the csv report (for a spreadsheet).
Henrik Skupin (@whimboo) could we let the spreadsheet download the csv report from GitHub artifacts?

@whimboo

Copy link
Copy Markdown
Collaborator

Yury Semikhatsky (@yury-s) we currently have a simple import via CSV in the spreadsheet - nothing scripted. What will be the new location of the .csv file? Is that a non-changing URL or does it vary per day?

@yury-s

Copy link
Copy Markdown
Member Author

Yury Semikhatsky (Yury Semikhatsky (@yury-s)) we currently have a simple import via CSV in the spreadsheet - nothing scripted. What will be the new location of the .csv file? Is that a non-changing URL or does it vary per day?

It would be changing every day as it would be a github artifact link, similar to what you use to download json report. If that is an issue, I am fine with keeping the things as is (the .csv file has a fixed url in github). I just wanted to make sure you don't just download GHA artifact and still need the link.

@whimboo

Copy link
Copy Markdown
Collaborator

It would be changing every day as it would be a github artifact link, similar to what you use to download json report. If that is an issue, I am fine with keeping the things as is (the .csv file has a fixed url in github). I just wanted to make sure you don't just download GHA artifact and still need the link.

That would be great. Thanks a lot!

@hbenl

Copy link
Copy Markdown
Collaborator

Yury Semikhatsky (@yury-s) We've added the csv report to our dashboard pages (so it's downloaded together with the json reports), so we don't need the bidi-reports branch anymore.

@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

Test results for "tests 1"

3 flaky ⚠️ [chromium-library] › library/popup.spec.ts:260 › should not throw when click closes popup `@chromium-ubuntu-22.04-node24`
⚠️ [firefox-library] › library/browsercontext-cookies-third-party.spec.ts:257 › third party 'Partitioned;' cookies `@firefox-ubuntu-22.04-node20`
⚠️ [firefox-library] › library/browsercontext-cookies-third-party.spec.ts:470 › top level 'Partitioned;' cookie and same origin iframe `@firefox-ubuntu-22.04-node20`

52540 passed, 1270 skipped


Merge workflow run.

@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

Test results for "MCP"

1 failed
❌ [firefox] › mcp/annotate.spec.ts:251 › should route annotate to a running port dashboard @mcp-windows-latest-firefox

8936 passed, 1489 skipped


Merge workflow run.

@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

Hi, I'm the Playwright bot and I took a first look at the CI failures.

🟡 The failures look unrelated to this PR, but I could not confirm them as pre-existing flakes

This PR only changes BiDi report generation and artifact publishing. It does not reach the failing MCP dashboard flow or the Firefox Nightly behaviors under test. However, the test-results snapshot was unavailable and its refresh failed, so I found no qualifying failure on an unrelated SHA; the guide therefore requires an uncertain verdict.

Details

Uncertain

  • [firefox] › mcp/annotate.spec.ts:251 › should route annotate to a running port dashboard — timed out waiting for the dashboard's first session. This PR does not change MCP or dashboard code, but I could not confirm the same test failing on an unrelated SHA.
  • [moz-firefox-nightly] BiDi failures in emulation-focus.spec.ts:201, page-keyboard.spec.ts:334, page-keyboard.spec.ts:346, browsercontext-network-event.spec.ts:107, permissions.spec.ts:296, page-add-init-script-callback.spec.ts:50, and page-screenshot.spec.ts:941 — these fail during test execution, before the changed CSV artifact upload, and none exercises the CSV reporter changes. They look like Firefox Nightly regressions or flakes, but without cross-SHA history I cannot classify them as pre-existing.

The three tests reported as flaky by the merged library run passed on retry and are not real failures.

Triaged by the Playwright bot - agent run

@yury-s

Copy link
Copy Markdown
Member Author

Yury Semikhatsky (Yury Semikhatsky (@yury-s)) We've added the csv report to our dashboard pages (so it's downloaded together with the json reports), so we don't need the bidi-reports branch anymore.

Thanks. I'll go ahead and merge this change then.

@yury-s
Yury Semikhatsky (yury-s) merged commit e02a683 into microsoft:main Oct 2, 2026
86 of 89 checks passed
@yury-s
Yury Semikhatsky (yury-s) deleted the remove-bidi-reports-branch branch October 2, 2026 22:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants