Call for benchmarks

Audit our detectors. We pay for the credits.

A detector should be judged by people who don't sell it. We fund independent evaluations of our text, image and video detection with free API credits.

Why we're asking

We publish our own numbers, with the data behind them. But we run those tests ourselves, on sets we chose, and new models ship every few weeks. A detector that looked strong in spring can fall behind by autumn without anyone noticing.

A simple AI-or-human score also hides most of what matters in practice: who gets wrongly flagged, how much editing it takes before a text stops being caught, what survives a WhatsApp forward. Teachers, editors, fraud teams and investigators make decisions on these results. They deserve evidence from someone other than us.

Questions we want answered

A study can take on one of these or several. Proposals outside the list are welcome too.

Text

Frontier models and long, agentic output

How well do detectors catch text from the newest models, and what happens when that text comes out of a deep-research run, an agent harness or a long multi-turn session rather than a single prompt?

Text

Mixed authorship

Real documents are rarely all human or all AI. We want studies across the whole range: a grammar pass, a rewritten paragraph, an outline filled in by a model, full co-writing, and text run through humanizers.

Text

Fairness across writers

Sliced results by language, non-native writing, region, dialect, education level or discipline. A study that finds no bias is as useful to us as one that finds it.

Image & video

Current generators in the wild

Detection of the latest image and video models after what real distribution does to a file: messenger recompression, screenshots, crops, re-uploads and deliberate laundering.

Image & video

False positives on real media

How often genuine photos and clips get flagged: phone cameras, professional and edited photography, scans, old footage, faces of every background.

Image & video

Faces and identity

Face swaps, identity-preserving generation and synthetic ID or profile photos, the cases behind impersonation and fraud.

What makes a good benchmark

  • Clean labels. You know how every sample was made, and you can show it: prompts, models, dates, and for human data where it came from and why you trust it.
  • Current models. Output from the generators people actually use today, not last year's.
  • Hard enough. A set every detector scores 99% on teaches nobody anything.
  • Reproducible. Data, or a way to rebuild it, and the scores you got, so others can check your work.

What you get

  • Free API credits sized to your study, for text, image and video detection.
  • Raw scores, not just verdicts, so you can draw your own curves.
  • A direct contact for questions about the API and thresholds.
  • Compare us against any other detector you like.
  • Strong studies can be featured on our research page.

How to apply

Send a short email. A few paragraphs are enough; we answer within a week. Tell us:

  • who you are, with your affiliation or a link to past work
  • the question your benchmark answers
  • text, image or video, and the dataset: sources, size, how labels were established
  • which detectors you plan to compare, and the rough volume you need
  • where and when you plan to publish
Apply for credits