{"id":12265,"date":"2023-12-19T14:22:36","date_gmt":"2023-12-19T21:22:36","guid":{"rendered":"https:\/\/punyamishra.com\/?p=12265"},"modified":"2023-12-21T06:31:04","modified_gmt":"2023-12-21T13:31:04","slug":"generative-ai-is-weird","status":"publish","type":"post","link":"https:\/\/punyamishra.com\/2023\/12\/19\/generative-ai-is-weird\/","title":{"rendered":"Generative AI is WEIRD!"},"content":{"rendered":"\n
\n

Note<\/strong>: This blog post was almost entirely written by ChagGPT based on an analysis of a set of images I had uploaded onto it. The image above (Weird AI) is an original typographic design created by me. The background sky was created by Adobe Firefly. <\/p>\n<\/blockquote>\n\n\n\n

To give some context, I took six slides from the set I had used for a recent keynote presentation I gave at the AI Summit in Michigan<\/a>. Essentially these slides were an extended riff about how Generative AI was weird, along multiple dimensions. <\/p>\n\n\n\n

I then made one large image from these slides (see below) and asked ChatGPT to interpret these images and write a blog post for me. The exact prompt and GPT’s response is given below. GPT’s words are in blue and have been included as is, with no editing. I have also added some references to each of the points related to the slides. <\/p>\n\n\n\n

The 6 slides that were uploaded to ChatGPT<\/strong><\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
<\/div>\n\n\n\n

Prompt: <\/strong>There are a set of 6 slides that I used in a recent presentation to make the point that Gen AI is weird. Can you take this set of six slides and come up with a nice descriptive blog post on this topic where each of these images would be used to make a point about the weird nature of gen AI<\/em><\/p>\n\n\n\n

ChatGPT’s response<\/strong><\/p>\n\n\n\n

Creating a descriptive blog post based on the provided slides can be a great way to delve into the peculiarities of generative AI and the biases inherent in these systems. Here’s a structured outline for your blog post:<\/p>\n\n\n\n

\n\n\n\n

The Weird Quirks of Generative AI: A Look at Bias and Unpredictability<\/h1>\n\n\n\n

Generative AI has become a cornerstone of modern technology, from chatbots to content creation tools. However, as advanced as these systems are, they often exhibit behaviors and outputs that can be deemed as weird or unexpected. A recent presentation highlighted these oddities through a series of insightful slides.<\/p>\n\n\n\n

Western, Educated, Industrialized, Rich, Democratic (WEIRD)<\/h2>\n\n\n\n

The acronym WEIRD captures the essence of generative AI’s primary dataset bias. These systems tend to reflect the biases of their training data, which disproportionately represents Western, Educated, Industrialized, Rich, and Democratic societies. This skew in perspective can lead to AI systems that perform better for users from these backgrounds while potentially alienating others.<\/p>\n\n\n\n

Reference: Psychology is Weird [Link<\/a>]<\/p>\n\n\n\n

Emotionally Charged Requests<\/h2>\n\n\n\n

It appears that generative AI can sometimes perform better when prompted with emotional requests. This suggests that the way we interact with AI can affect its performance, possibly because emotional prompts are more detailed and provide better context for the AI to grasp the user’s intent.<\/p>\n\n\n\n

Reference: Large language models can be enhanced by emotional stimuli (Arxiv article: Link<\/a>)<\/p>\n\n\n\n

The Concept of ‘Tipping’ AI<\/h2>\n\n\n\n

A curious phenomenon observed is the improvement in AI performance when the concept of ‘tipping’ is introduced. While not a literal monetary tip, this metaphorical tipping refers to providing extra information or incentives that seem to spur the AI to ‘try harder’ or ‘think deeper’, resulting in better output.<\/p>\n\n\n\n

Reference: Tipping ChatGPT gives longer results (Twitter\/X thread: Link<\/a>)<\/p>\n\n\n\n

Telling AI to “Take a Deep Breath”<\/h2>\n\n\n\n

Instructing an AI to ‘take a deep breath’ had an interesting outcome: a noticeable improvement in math scores in a study. This anthropomorphic instruction hints at the potential of using human-like encouragements to optimize AI performance, which is as fascinating as it is bizarre.<\/p>\n\n\n\n

Reference: Telling AI model to \u201ctake a deep breath\u201d causes math scores to soar in study (Ars Technica article: Link<\/a>)<\/p>\n\n\n\n

Seasonal Performance Variability<\/h2>\n\n\n\n

Interestingly, generative AI, specifically GPT-4, showed a dip in performance during December. This suggests that AI systems can ‘learn’ patterns from their interactions with humans, including the tendency to ‘wind down’ during holiday seasons. While this is likely a reflection of the training data, it showcases how AI can mirror human behaviors in unexpected ways.<\/p>\n\n\n\n

Reference: Example of the December effect (i.e. GPT results are worse after December break). LINK<\/a><\/p>\n\n\n\n

Implicit Bias in AI Systems<\/h2>\n\n\n\n

The final point of discussion is the implicit bias present in all AI systems. These biases can come from various sources, such as the data they’re trained on, the engineers who build them, and even the societal norms that sneak into their algorithms. Recognizing and addressing these biases is crucial for creating fair and equitable AI systems.<\/p>\n\n\n\n

Reference: Warr, Melissa and Oster, Nicole Jakubczyk and Isaac, Roger, Implicit Bias in Large Language Models: Experimental Proof and Implications for Education (November 6, 2023). Available at SSRN: https:\/\/ssrn.com\/abstract=4625078<\/a> or http:\/\/dx.doi.org\/10.2139\/ssrn.4625078<\/a><\/p>\n\n\n\n

\n\n\n\n

In conclusion, the presentation’s visuals offer a thought-provoking look at the oddities and biases of generative AI. These ‘weird’ behaviors underline the importance of understanding and improving the ways we build and interact with AI systems.<\/p>\n\n\n\n

(Note: In your blog post, you would replace the placeholders like #image-1<\/code> with actual images from your slide deck.)<\/p>\n\n\n\n

For any further assistance or to flesh out each section with more detail, feel free to reach out!<\/p>\n\n\n\n

Not too bad! <\/p>\n\n\n\n

What, I wonder is weirder, the fact that generative AI is weird in these specific ways, or that we take these capabilities for granted. None of this (uploading images and having GPT interpret and write a coherent piece of prose) was possible even six months ago. Let that fact sink in… <\/p>\n","protected":false},"excerpt":{"rendered":"

Note: This blog post was almost entirely written by ChagGPT based on an analysis of a set of images I had uploaded onto it. The image above (Weird AI) is an original typographic design created by me. The background sky was created by Adobe Firefly. To give some context, I took six slides from the […]<\/p>\n","protected":false},"author":7,"featured_media":12266,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"off","_et_pb_old_content":"","_et_gb_content_width":"","_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"categories":[659,5,4,632,13,38,49],"tags":[],"_links":{"self":[{"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/posts\/12265"}],"collection":[{"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/comments?post=12265"}],"version-history":[{"count":9,"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/posts\/12265\/revisions"}],"predecessor-version":[{"id":12283,"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/posts\/12265\/revisions\/12283"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/media\/12266"}],"wp:attachment":[{"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/media?parent=12265"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/categories?post=12265"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/tags?post=12265"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}