Discussion about this post

User's avatar
Daniel Roberts's avatar

I appreciate the author’s putting into words the LLM radar I start to feel when reading some articles.

Sean's avatar

Its so stupid, because moat people vastly overestimate their ability to identify AI material, especially in shorter passages.

Mark Lawrence has done some (very unscientific) tests regarding this, and even when you're selecting for the type of person who reads an author's blog, the results were basically a coin toss.

https://mark---lawrence.blogspot.com/2025/08/the-ai-vs-authors-results-part-2.html?m=1

Most of the linguistic fingerprints that people use to try and identify AI are not inherent properties of LLMs, but instead due to the default system prompt (e.g. "its not just __, but ___________"). These sort of writing tics are trivially easy to prompt around.

6 more comments...

No posts

Ready for more?