Add Winston AI detector submission

[Philrobots]

Thank you for this project. It's really great to be able to evaluate models using external public benchmarks.

Purpose

We are opening this PR to run some evaluations and see how our detector scores on the hidden test set. We are still evaluating the model's accuracy and may push follow-up commits with updated predictions as we iterate.

We will comment on this PR to confirm when the submission is final.

Thank you

[github-actions]

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

Winston AI

Release date: 2026-09-24

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 99.89 and a TPR of 99.98% at FPR=5% and 99.89% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 99.98 and a TPR of 100.00% at FPR=5% and 100.00% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

[Philrobots]

@liamdugan This submission is final. Ready to merge, thank you in advance!

[Philrobots]

@liamdugan Just a quick follow-up, is it possible to merge the pull request?

Thanks

[liamdugan]

@Philrobots sorry for the delay here. Looks like the bot wasn't able to push the results.json file to the PR. (see error)

[submission/winston-ai b417486] leaderboard: add eval results (#205)
 1 file changed, 217721 insertions(+)
 create mode 100644 leaderboard/submissions/winston-ai/results.json
remote: Permission to gowinston-ai/raid.git denied to github-actions[bot].
fatal: unable to access 'https://github.com/gowinston-ai/raid/': The requested URL returned error: 403
Error: Process completed with exit code 128.

Can you give us (RAID maintainers + bot) permission to push commits to your branch? Then I'll run the eval again and merge

[Philrobots]

Thanks @liamdugan!

I've enabled "Allow edits by maintainers" on this PR, so you and the bot should now be able to push to the branch. Could you re-run the eval and merge?

[liamdugan]

Got it @Philrobots rerunning now

[Philrobots]

@liamdugan Thank you. Workflows seem to be waiting for approval

[github-actions]

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

Winston AI

Release date: 2026-09-24

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 99.89 and a TPR of 99.98% at FPR=5% and 99.89% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 99.98 and a TPR of 100.00% at FPR=5% and 100.00% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

[Philrobots]

@liamdugan I reopen a pull request with my personal account, giving maintainers access here: #211

Will close it if the new build succeeds.

Thank you, sorry for the trouble

[github-actions]

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

Winston AI

Release date: 2026-09-24

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 99.89 and a TPR of 99.98% at FPR=5% and 99.89% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 99.98 and a TPR of 100.00% at FPR=5% and 100.00% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

[liamdugan]

@Philrobots no worries! I changed the access token of the bot so that it matched my own. Since you gave me edit permissions to the repo, the bot was able to push directly to this branch. Should be good to merge shortly

[Philrobots]

@liamdugan You can merge whenever you want.

Thank you

[liamdugan]

Congrats on the strong performance @Philrobots