ChatGPT as a blurry jpeg of the web

by | Sunday, February 12, 2023

Ted Chiang is one of the greatest, insightful writers working today. I had written previously about one his short stories in a post titled: Truth of fact and feeling: Unpacking McLuhan (2/3) about his short story The truth of fact and the truth of feeling. (If you haven’t read it – please do so).

In a recent piece in the New Yorker, (ChatGPT is a blurry jpeg of the web) Ted Chiang focuses on ChatGPT, and offers one of the best descriptions of the technology, making an analogy with lossy compressions systems (such as the Jpeg file format that we usually use to compress images). The essay is worth reading in full, but here are some key quotes:

… Think of ChatGPT as a blurry jpeg of all the text on the Web. It retains much of the information on the Web, in the same way that a jpeg retains much of the information of a higher-resolution image, but, if you’re looking for an exact sequence of bits, you won’t find it; all you will ever get is an approximation. But, because the approximation is presented in the form of grammatical text, which ChatGPT excels at creating, it’s usually acceptable. You’re still looking at a blurry jpeg, but the blurriness occurs in a way that doesn’t make the picture as a whole look less sharp.

This analogy makes even more sense when we remember that a common technique used by lossy compression algorithms is interpolation—that is, estimating what’s missing by looking at what’s on either side of the gap. When an image program is displaying a photo and has to reconstruct a pixel that was lost during the compression process, it looks at the nearby pixels and calculates the average. This is what ChatGPT does when it’s prompted to describe, say, losing a sock in the dryer using the style of the Declaration of Independence: it is taking two points in “lexical space” and generating the text that would occupy the location between them. (“When in the Course of human events, it becomes necessary for one to separate his garments from their mates, in order to maintain the cleanliness and order thereof. . . .”) ChatGPT is so good at this form of interpolation that people find it entertaining: they’ve discovered a “blur” tool for paragraphs instead of photos, and are having a blast playing with it.

Given GPT-3’s failure at a subject taught in elementary school, how can we explain the fact that it sometimes appears to perform well at writing college-level essays? Even though large language models often hallucinate, when they’re lucid they sound like they actually understand subjects like economic theory. Perhaps arithmetic is a special case, one for which large language models are poorly suited. Is it possible that, in areas outside addition and subtraction, statistical regularities in text actually do correspond to genuine knowledge of the real world?

I think there’s a simpler explanation. Imagine what it would look like if ChatGPT were a lossless algorithm. If that were the case, it would always answer questions by providing a verbatim quote from a relevant Web page. We would probably regard the software as only a slight improvement over a conventional search engine, and be less impressed by it. The fact that ChatGPT rephrases material from the Web instead of quoting it word for word makes it seem like a student expressing ideas in her own words, rather than simply regurgitating what she’s read; it creates the illusion that ChatGPT understands the material. In human students, rote memorization isn’t an indicator of genuine learning, so ChatGPT’s inability to produce exact quotes from Web pages is precisely what makes us think that it has learned something. When we’re dealing with sequences of words, lossy compression looks smarter than lossless compression.

Do read the actual piece… it is worth your time: ChatGPT is a blurry jpeg of the web

A few randomly selected blog posts…

Modeling human behavior: The new dark art of silicon sampling

Modeling human behavior: The new dark art of silicon sampling

A couple of months ago I had written this post, On merging with our technologies – which was essentially quotes from a conversation Ezra Klein had with the novelist Mohsin Hamid. I finished the post with a quote speaking the dangers of predictive technologies on human...

ON@TCC: Do not toss aside lightly…

One Night at the Call Center is the second novel by Chetan Bhagat. I picked it up from the library, since I had read nice things about it on some website somewhere. What a tragic waste of time. This is a terrible novel - maybe the worst I have read in a long, long...

Gender & GPS

During our recent NY / New Jersey visit (during the kids spring break) I had the first opportunity to drive a car equipped with a GPS system. It was a case of love at first sight. I got back home and bought myself a Tom Tom right away. I used this unit extensively...

21st century learning article receives ISTE award

Back in July 2013, the Journal of Digital Learning in Teacher Education (JDLTE) published our paper on 21st Century Learning. This paper written with Kristen Kereluik, Chris Fahnoe and Laura Terry looked at over a dozen different 21st century learning frameworks and...

Explore, Create, Share… the videos

Over the past few months I have been working with my kids on creating short thematic videos. The themes we chose were the three words, Explore, Create & Share. Though the videos for Explore and Create got made rather quickly, the video for Share appeared to stump...

Understanding student engagement

I had posted recently about a Gallup poll on student engagement. Essentially the poll showed that student engagement dropped precipitously (though as I wrote, not as starkly as their graph indicated) as students moved from elementary to high school. My friend, Gaurav...

Teacher as filmmaker: An update from down under

Back in 2007, I was second author on a paper titled Teacher as Filmmaker, in which we described an approach to teacher professional development that involved teachers creating short, evocative movies, which we called iVideos. You can read the paper and abstract...

From Tech to Ed Tech: Distance to the moon

For one reason or another, I have three consecutive posts regarding the earth and sun and moon - i.e. the local area in the solar system. I had just completed my previous postings (on on seeing through eclipses and measuring the radius of the earth) when I came across...

iVideos from Australia, the 2011 edition

Last June I had posted a note (Teacher as filmmaker: An update from down under) about the iVideos created by students from the University of Technology, Sydney (under the guidance of Dr. Matthew Kearney). iVideos or "idea videos" are short films often 2 minutes (or...

0 Comments

Submit a Comment

Your email address will not be published. Required fields are marked *