Skip to content

Add DeBERTa-ConPara-v2.18b-raw: no-preprocessing ablation, raw inference - #185

Closed
MohamedMady19 wants to merge 2 commits into
liamdugan:mainfrom
MohamedMady19:conpara-v218b-raw
Closed

MohamedMady19 wants to merge 2 commits into
liamdugan:mainfrom
MohamedMady19:conpara-v218b-raw

Conversation

@MohamedMady19

@MohamedMady19 MohamedMady19 commented Aug 19, 2026 •

Copy link
Copy Markdown

DeBERTa-ConPara v2.18b-raw - controlled ablation of the unicode preprocessing pipeline. Same architecture, corpus, seed, and hyperparameters as v2.18; the only difference is that training text is stored raw (no unicode normalisation, no whitespace collapse) and inference skips preprocessing. Submitted alongside v2.18 as a matched pair.

@github-actions

Copy link
Copy Markdown

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

DeBERTa-ConPara-v2.18b-raw

Release date: 2026-08-19

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 99.39 and a TPR of 98.83% at FPR=5% and 93.64% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 99.57 and a TPR of 99.19% at FPR=5% and 95.77% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

@liamdugan liamdugan closed this Oct 2, 2026
Repository owner locked and limited conversation to collaborators Oct 2, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants