You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[ci-scan-feedback] Strip script-runner/exit-code suffixes in KBE dedup search to cut same-test duplicatesΒ #132132
Scanner wrong-closure rate 32.1% (9/28) π΄ over the last 30d β all 9 wrong closures are duplicate, no not_planned. These are same-test-path re-files, not misclassifications:
Rubric finding: variation 6 of the existing-KBE search strips underscore-delimited platform/bit-width suffixes but not the trailing .cmd/.dll script-runner suffix or the exit-code/signal descriptor that distinguish otherwise-identical coreclr slash-delimited runtime-test paths, so the same test is filed once per (leg Γ exit-code Γ suffix) permutation.
Proposed edits
create-kbe.instructions.md:53-64 β extend variation 6 to also strip a trailing script-runner suffix (.cmd/.dll/.sh/.exe) and exit-code/signal descriptor (exit 134, exit 101, SIGABRT) from coreclr slash-delimited test paths and search the bare stem, with the Refresh/arrres_il_r cases as worked examples. Directly targets the 9 duplicate closures.
create-kbe.instructions.md:66-68 β update the "only strip the specific ... suffixes" caveat to include the new script-runner and exit-code/signal suffixes, keeping it consistent with variation 6.
Expected behavior change
The next scanner run will resolve .../Refresh/Refresh/Refresh and .../Refresh/Refresh/Refresh.cmd (and the same test under different exit codes / legs) to a single existing KBE instead of filing a fresh duplicate, cutting the same-test-path duplicate closures that drove the 30d wrong-closure rate to 32%.
The bundle file is available in the agent artifact in the workflow run linked above.
To create a pull request with the changes:
# Download the artifact from the workflow run
gh run download 31495495649 -n agent -D /tmp/agent-31495495649
# Fetch the bundle into a temporary ref, then update the local branch
git fetch /tmp/agent-31495495649/aw-ci-scan-feedback-dedup-suffix-strip.bundle refs/heads/ci-scan-feedback-dedup-suffix-strip:refs/bundles/create-pr-ci-scan-feedback-dedup-suffix-strip-26c269fb50fbeb2b-631ef2eb
git update-ref refs/heads/ci-scan-feedback-dedup-suffix-strip-26c269fb50fbeb2b refs/bundles/create-pr-ci-scan-feedback-dedup-suffix-strip-26c269fb50fbeb2b-631ef2eb
git checkout ci-scan-feedback-dedup-suffix-strip-26c269fb50fbeb2b
# Ensure the working tree matches the updated branch
git reset --hard
# Remove the temporary bundle ref
git update-ref -d refs/bundles/create-pr-ci-scan-feedback-dedup-suffix-strip-26c269fb50fbeb2b-631ef2eb
# Push the branch to origin
git push origin ci-scan-feedback-dedup-suffix-strip-26c269fb50fbeb2b
# Create the pull request
gh pr create --title '[ci-scan-feedback] Strip script-runner/exit-code suffixes in KBE dedup search to cut same-test duplicates' --base main --head ci-scan-feedback-dedup-suffix-strip-26c269fb50fbeb2b --repo dotnet/runtime
Triggering signals
duplicate, nonot_planned. These are same-test-path re-files, not misclassifications:GC/API/GC/GetGeneration/GetGeneration.dllβ dup of [ci-scan] Test failure: GC/API/GC/GetGeneration/GetGeneration.dll fails under interpreter (post-fix recurrence)Β #131914 (same test, different leg) β [ci-scan] Test failure: GC/API/GC/GetGeneration/GetGeneration.dll fails under interpreter on osx-arm64Β #131743JIT/Methodical/Arrays/misc/arrres_il_r/arrres_il_r(exit 134) β dup of [ci-scan] Test failure: JIT/Methodical/Arrays/misc/arrres_il_r/arrres_il_r.cmdΒ #131628 (...arrres_il_r.cmd, different leg) β [ci-scan] Test failure: JIT/Methodical/Arrays/misc/arrres_il_r crashes (abort, exit 134)Β #131744GC/API/Refresh/Refresh/Refresh(exit 101) β dup of [ci-scan] Test failure: GC/API/Refresh/Refresh/Refresh.cmd assertion Expected 100 Actual 101Β #130828 (...Refresh.cmd, same leg) β [ci-scan] Test failure: GC/API/Refresh/Refresh/Refresh fails on gc-standalone (exit 101)Β #131998.cmd/.dllscript-runner suffix or the exit-code/signal descriptor that distinguish otherwise-identical coreclr slash-delimited runtime-test paths, so the same test is filed once per (leg Γ exit-code Γ suffix) permutation.Proposed edits
create-kbe.instructions.md:53-64β extend variation 6 to also strip a trailing script-runner suffix (.cmd/.dll/.sh/.exe) and exit-code/signal descriptor (exit 134,exit 101,SIGABRT) from coreclr slash-delimited test paths and search the bare stem, with theRefresh/arrres_il_rcases as worked examples. Directly targets the 9 duplicate closures.create-kbe.instructions.md:66-68β update the "only strip the specific ... suffixes" caveat to include the new script-runner and exit-code/signal suffixes, keeping it consistent with variation 6.Expected behavior change
The next scanner run will resolve
.../Refresh/Refresh/Refreshand.../Refresh/Refresh/Refresh.cmd(and the same test under different exit codes / legs) to a single existing KBE instead of filing a fresh duplicate, cutting the same-test-path duplicate closures that drove the 30d wrong-closure rate to 32%.Note
AI/Copilot-generated (
ci-scan-feedback).Note
This was originally intended as a pull request, but the git push operation failed.
Original error: The process '/usr/bin/git' failed with exit code 1
Workflow Run: View run details and download bundle artifact
The bundle file is available in the
agentartifact in the workflow run linked above.To create a pull request with the changes: