Skip to content

Consolidate DeBERTa-ConPara into a single leaderboard entry - #209

Open
MohamedMady19 wants to merge 4 commits into
liamdugan:mainfrom
MohamedMady19:conpara-single-entry
Open

MohamedMady19 wants to merge 4 commits into
liamdugan:mainfrom
MohamedMady19:conpara-single-entry

Conversation

@MohamedMady19

Copy link
Copy Markdown

Replace the five DeBERTa-ConPara entries by a single DeBERTa-ConPara entry (released checkpoint, scored in #191)

@liamdugan

Copy link
Copy Markdown
Owner

Hi @MohamedMady19 I merged your previous PR #198. Can you resolve the merge conflicts and update this one? Feel free to ping me after you do so and I'll merge it

@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

DeBERTa-ConPara

Release date: 2026-08-25

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 99.61 and a TPR of 99.01% at FPR=5% and 96.57% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 99.64 and a TPR of 99.04% at FPR=5% and 96.98% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

github-actions and others added 3 commits October 2, 2026 19:08
# Conflicts:
#	leaderboard/submissions/DeBERTa-ConPara/metadata.json
#	leaderboard/submissions/DeBERTa-ConPara/results.json
#	leaderboard/submissions/Linda-RAID/predictions.json
#	leaderboard/submissions/tabularis-modernbert-r1/predictions.json
#	leaderboard/submissions/tabularis-modernbert-r1/results.json
#	leaderboard/submissions/winston-ai/predictions.json
#	leaderboard/submissions/winston-ai/results.json
…stream merge

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_019U84iKQ2CHDMrqGGYpaaqf
@MohamedMady19

Copy link
Copy Markdown
Author

Hi @MohamedMady19 I merged your previous PR #198. Can you resolve the merge conflicts and update this one? Feel free to ping me after you do so and I'll merge it

Hi @liamdugan, Thanks for merging #198. Conflicts resolved, and the branch is now on top of main. This PR leaves a single entry, DeBERTa-ConPara, with the predictions scored in #191, and adds the paper link (arXiv:2610.00883, AACL-IJCNLP 2026). Ready to merge from my side.

This branch is waiting to be deployed

1 waiting deployment
raid-main — 11685fa8 Waiting Oct 2, 2026 by MohamedMady19 via evaluate #362
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants