AI Text Detectors' Secret Sauce: Perplexity, Burstiness, and Why They Often Fail
What if your most creative prose gets labeled 'AI-generated' by tools like GPTZero? Under the hood, it's all about perplexity and burstiness—stats that expose machine-like predictability.
theAIcatchupApr 09, 20263 min read
⚡ Key Takeaways
Perplexity flags low-surprise AI text (5-15), humans run higher (30-80+).𝕏
Burstiness captures human variance; AI stays flat—key for 2D classification.𝕏
Classifiers like RoBERTa boost accuracy but inherit training biases, predicting an arms race loss.𝕏
The 60-Second TL;DR
Perplexity flags low-surprise AI text (5-15), humans run higher (30-80+).
Burstiness captures human variance; AI stays flat—key for 2D classification.
Classifiers like RoBERTa boost accuracy but inherit training biases, predicting an arms race loss.