Skip to content

Update modernbert predictions#116

Closed
Onlyartist9 wants to merge 2 commits intoliamdugan:mainfrom
Onlyartist9:codex-modernbert-raid-20260424
Closed

Update modernbert predictions#116
Onlyartist9 wants to merge 2 commits intoliamdugan:mainfrom
Onlyartist9:codex-modernbert-raid-20260424

Conversation

@Onlyartist9
Copy link
Copy Markdown
Contributor

Updated leaderboard/submissions/modernbert/predictions.json only.

Prediction recipe used a private paraphrase specialist checkpoint (Onlyartist9/modernbert-raid-private-candidate-j-paraphrase-specialist-lite-20260424) combined with the existing H warm-start checkpoint via a min ensemble after raw/normalized scoring.

@github-actions
Copy link
Copy Markdown

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

ModernBERT AI Detection

Release date: 2025-05-19

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 96.62 and a TPR of 88.32% at FPR=5% and 76.29% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 99.02 and a TPR of 97.02% at FPR=5% and 87.85% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

@Onlyartist9 Onlyartist9 deleted the codex-modernbert-raid-20260424 branch April 24, 2026 16:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant