devops(bidi): stop publishing csv reports to the bidi-reports branch - #42917
Conversation
The BiDi dashboard is populated from the GitHub artifacts, so the branch is unused.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
Holger Benl (hbenl)
left a comment
There was a problem hiding this comment.
We actually use both the json report (for our dashboard) and the csv report (for a spreadsheet).
Henrik Skupin (@whimboo) could we let the spreadsheet download the csv report from GitHub artifacts?
|
Yury Semikhatsky (@yury-s) we currently have a simple import via CSV in the spreadsheet - nothing scripted. What will be the new location of the .csv file? Is that a non-changing URL or does it vary per day? |
It would be changing every day as it would be a github artifact link, similar to what you use to download json report. If that is an issue, I am fine with keeping the things as is (the .csv file has a fixed url in github). I just wanted to make sure you don't just download GHA artifact and still need the link. |
That would be great. Thanks a lot! |
|
Yury Semikhatsky (@yury-s) We've added the csv report to our dashboard pages (so it's downloaded together with the json reports), so we don't need the bidi-reports branch anymore. |
Test results for "tests 1"3 flaky52540 passed, 1270 skipped Merge workflow run. |
Test results for "MCP"1 failed 8936 passed, 1489 skipped Merge workflow run. |
|
Hi, I'm the Playwright bot and I took a first look at the CI failures. 🟡 The failures look unrelated to this PR, but I could not confirm them as pre-existing flakesThis PR only changes BiDi report generation and artifact publishing. It does not reach the failing MCP dashboard flow or the Firefox Nightly behaviors under test. However, the test-results snapshot was unavailable and its refresh failed, so I found no qualifying failure on an unrelated SHA; the guide therefore requires an uncertain verdict. DetailsUncertain
The three tests reported as flaky by the merged library run passed on retry and are not real failures. Triaged by the Playwright bot - agent run |
Thanks. I'll go ahead and merge this change then. |
e02a683
into
microsoft:main
Summary
publish_reportsjob added in devops(bidi): publish BiDi reports to a git branch instead of Azure #42760, which pushed the csv reports to thebidi-reportsbranch. The BiDi dashboard reads the GitHub artifacts, which chore(ci): reenable json reports for BiDi tests #42825 publishes again, so nothing uses the branch.test-results/report.csvas the artifact again, like before devops(bidi): publish BiDi reports to a git branch instead of Azure #42760.