Skip to content

benchmark: fix max-regressions detection in compare.js - #65587

Closed
jasnell wants to merge 1 commit into
nodejs:mainfrom
jasnell:jasnell/improve-benchmark-compare-max-regressions
Closed

benchmark: fix max-regressions detection in compare.js#65587
jasnell wants to merge 1 commit into
nodejs:mainfrom
jasnell:jasnell/improve-benchmark-compare-max-regressions

Conversation

@jasnell

@jasnell jasnell commented Aug 27, 2026

Copy link
Copy Markdown
Member

Improve the accuracy of the new --max-regression N detection in benchmark/compare.js to eliminate false positive rate (using --old and --new pointing to the same binary as the control).

@jasnell
jasnell requested a review from mcollina August 27, 2026 13:19
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/performance

@nodejs-github-bot nodejs-github-bot added benchmark Issues and PRs related to Node.js benchmarks and benchmarking infrastructure. performance Issues and PRs related to the performance of Node.js. labels Aug 27, 2026
@nodejs-github-bot

This comment was marked as outdated.

@jasnell jasnell added the author ready PRs with CI started, the required approvals, and no outstanding review comments. label Aug 27, 2026
@nodejs-github-bot

This comment was marked as outdated.

@jasnell
jasnell force-pushed the jasnell/improve-benchmark-compare-max-regressions branch from c62ff23 to c0d3913 Compare August 29, 2026 04:09
@nodejs-github-bot

This comment was marked as outdated.

Signed-off-by: James M Snell <jasnell@gmail.com>
Assisted-by: Opencode
@jasnell
jasnell force-pushed the jasnell/improve-benchmark-compare-max-regressions branch from c0d3913 to 684d684 Compare August 29, 2026 13:54
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

jasnell added a commit that referenced this pull request Aug 29, 2026
Signed-off-by: James M Snell <jasnell@gmail.com>
Assisted-by: Opencode
PR-URL: #65587
Reviewed-By: Rafael Gonzaga <rafael.nunu@hotmail.com>
Reviewed-By: Filip Skokan <panva.ip@gmail.com>
Reviewed-By: Gürgün Dayıoğlu <hey@gurgun.day>
@jasnell

jasnell commented Aug 29, 2026

Copy link
Copy Markdown
Member Author

Landed in 045ff95

@jasnell jasnell closed this Aug 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author ready PRs with CI started, the required approvals, and no outstanding review comments. benchmark Issues and PRs related to Node.js benchmarks and benchmarking infrastructure. performance Issues and PRs related to the performance of Node.js.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants