How to identify AI generated text?

by | Thursday, June 01, 2023

I think I solved the biggest educational challenge of our time, namely:

How do we recognize AI generated text from human-created ones?

Just to provide some context, the advent of large language models and generative AI have made it essential that we, as educators, find ways to distinguish between AI generated and human generated text. This is the only way we can catch those students who are blatantly cheating the system by using these tools to complete their assignments.

And this is the issue of our time, and the consequences of not addressing it is well captured in this essay in The Atlantic, whose title says it all: The College Essay is Dead, And this is just one the many newspaper articles, editorials and blog posts that hit the panic button once ChatGPT and other generative AI language models entered our world. And of course, we have a range of responses to this perceived crisis. from out-right bans to finding strategies to mitigate the risks of plagiarism. And let us not forget all the AI based tools that have emerged to that detect and flag AI generated prose (though their accuracy is somewhat unclear).

Matters are complicated further by the fact that humans often misunderstand these technologies, often in hilarious ways. For instance there was the recent story of a lawyer who had GPT write his brief, only to discover that the AI had made up case precedents. These things hallucinate.

One such story that came my way, this morning, was that of a professor who flunked a bunch of students because he thought they had used ChatGPT to write their papers. And again, the title of the story says it all: Professor Flunks All His Students After ChatGPT Falsely Claims It Wrote Their Papers. Well… as it turns out, the professor didn’t really understand the technology and fell for its hallucinations. In an interesting twist, someone entered the professor’s own writing into ChatGPT3 and was told it was AI generated. As the Rolling Stone story reports it:

In an amusing wrinkle, Mumm’s claims appear to be undercut by a simple experiment using ChatGPT. On Tuesday, redditor Delicious_Village112 found an abstract of Mumm’s doctoral dissertation on pig farming and submitted a section of that paper to the bot, asking if it might have written the paragraph. “Yes, the passage you shared could indeed have been generated by a language model like ChatGPT, given the right prompt,” the program answered.

All this is funny enough, but again these, I think, are growing pains as we struggle to understand this fast moving piece of technology. What I DID want to point to were the reasons that ChatGPT gave for claiming the prose was authored by AI. This is important information, because once we understand what makes an AI generated text, we can flip the criteria around to find out what characterizes human writing.

Below is a screenshot of ChatGPT’s response to why the prose fed to it was most probably generated by AI:

What this tells us is that AI generated text is coherent, having a clear structure, cites sources and data accurately, and uses technical terminology correctly

And conversely, we now have the defining characteristics of human generated text. Human generated text is incoherent, gets citations (of sources and data) wrong, and uses terminology inaccurately.

There we go. I am so glad we figured THAT out.

And yes, you are welcome!

A few randomly selected blog posts…

2013 Michigan Creative Educators Summit

I was invited to speak at the Michigan Creative Educators Summit organized by The DeWitt Creativity Group at the Eli and Edythe Broad Art Museum at Michigan State University. It was an amazing morning (sadly I could not stay for the entire day). What was most amazing...



Just some visual wordplay that I have indulged in, just for the heck of it. Nothing really special, though I am partial to the "Explore, Create, Share" design. That was the motto of the MAET program at MSU that I directed for years.  Innovate 2 on Creativity...

Complicating the idea of Design Thinking (in Education)

Complicating the idea of Design Thinking (in Education)

“Design thinking” is one of the latest buzzwords in education. Proponents argue that design thinking is a tried and tested process for fostering innovation in education while critics suggest that it is the latest fad to sweep through, and will, like others before it,...

Computerized aesthetics… what’s right with that idea?

I just came across this... Online System Rates Images by Aesthetic Quality Pennsylvania State University (PSU) has launched the Aesthetic Quality Inference Engine (ACQUINE), an online system for determining the aesthetic quality of an image. The online photo-rating...

Font Face Off

Mike DeSchryver sent me this video... very funny particularly if you are a typophile like me...

Posthumanizing creativity

Posthumanizing creativity

Dr. Kerry Chappell is a professor at the University of Exeter’s Graduate School of Education. She merges her training in dance, her doctorate in experimental psychology and interest in education to develop a transdisciplinary research program on better understanding...

Happy 2016, New Video

Since 2009, our family has been creating videos to welcome the new year. The videos are typically typographical in nature, sometimes including a visual illusion or some kind or the other. So as usual, we have a video for welcome 2016. Shot on our dining...

MSU college of Ed leads US News rankings!

The 2012 U.S. News rankings of graduate programs in education have been released and there is good news for our college and department. Overall, the College of Education at Michigan State is ranked 17th which is where we were last year. It appears that our reputation...

The joy of learning: Of fire and trees and Dr. Feynman

Trees are some of the largest living things in the world. They can weigh tons. For instance the  One Oak Tree project measured and weighed a 222 year old Oak tree - and it's weight was 14.4 Tonnes (3.86 tonnes of which was dry weight). That's a lot of stuff! And this...


  1. Marckie Zeender

    As a large language model developed by OpenAI, I find this method of identifying AI generated text to be accurate.

  2. Mehedy

    You are a masterpiece.This article is a breathtaking masterpiece that seamlessly weaves together profound insights and eloquent prose. It captures the essence of its subject with a grace that is both captivating and inspiring. A true gem that leaves the reader spellbound and hungry for more. Bravo!

    • Punya Mishra

      This comment is clearly spam. But I approved it none-the-less, but only after deleting the URL and the email address that the spammer had included. So this comment will remain here … except it will not provide the link to the person’s website (which, was the sole purpose of this comment).


Submit a Comment

Your email address will not be published. Required fields are marked *