Popular AI text detectors catch plain AI-generated text with near-perfect accuracy. But when language models deliberately copy a specific author's writing style, up to one in five AI texts slips through undetected. Scientific writing is where the detectors fail the hardest.
A research team from Epoch AI tested three of the most widely used AI text detectors: Pangram (version 3.3.2), GPTZero (model 2026-05-11-base), and Originality.ai (Turbo 3.0.2). The test covered three categories: genuine human writing, AI text generated from simple prompts, and AI text that deliberately mimicked a specific author's style.
The team built a corpus of 495 human passages from 99 authors, evenly split across blogging, fiction, and scientific writing. All texts were written before ChatGPT's release in November 2022, which effectively rules out contamination by language models.
When dealing with plain AI-generated text, all three detectors performed almost flawlessly, with the false-negative rate topping out at 0.7 percent. Human texts were also classified correctly for the most part. Pangram and GPTZero didn't produce a single false alarm. Originality.ai, however, flagged 19 out of 495 human passages as AI-generated, a troublingly high false-positive rate of 3.8 percent.
Style imitation tanks detection rates
That result changes when language models receive writing samples from an author as reference material. For this test, three frontier models (Claude Opus 4.8, GPT-5.5, and Gemini 3.1 Pro) each received five real text passages from an author and were asked to write new text in the same style.
Of the 297 passages generated this way, an average of 38 went undetected, according to Epoch AI, which works out to a false-negative rate of about 13 percent. Pangram missed 10 percent of style-imitated texts, GPTZero missed 11 percent, and Originality.ai missed 18 percent.
Stay updated
Get the day's AI and automation news in your inbox. No spam, unsubscribe anytime.
For fiction, the false-negative rate across all detectors sat at just 1 to 5 percent. Scientific writing told a very different story. Pangram failed to catch 25 percent of style-imitated academic AI texts, GPTZero missed 24 percent, and Originality.ai missed 29 percent.
The worst individual results showed up in specific model-genre combinations within scientific writing. Pangram missed 48 percent of Gemini-generated academic passages, according to the published data. At Originality.ai, 39 percent of academic GPT-5.5 texts went undetected.
Different methods, same blind spots
Pangram uses a neural network trained on human and machine-generated text, though its founder has called the system a black box since its verdicts can't be traced. GPTZero measures how predictable word choices are and how much that varies within a text, based on the idea that language models write more uniformly than humans. Originality.ai searches for statistical patterns it learned during training on human and AI-generated text.
Despite these differences, all three detectors show the same pattern. They catch text from simple prompts almost every time but miss imitations far more often. Scientific writing, the genre where AI detection probably sees the most real-world use, remains the hardest to flag correctly.
An earlier Authors Guild test found that Pangram and Originality.ai reliably classified human texts as human. The Epoch AI study fills in the other half of that picture: a low false-alarm rate on human writing says little about how many AI texts actually slip through.
Related on Neura Market