{"id":10329,"date":"2022-10-23T11:33:20","date_gmt":"2022-10-23T18:33:20","guid":{"rendered":"https:\/\/punyamishra.com\/?p=10329"},"modified":"2023-10-16T20:16:45","modified_gmt":"2023-10-17T03:16:45","slug":"modeling-human-behavior-the-new-dark-art-of-silicon-sampling","status":"publish","type":"post","link":"https:\/\/punyamishra.com\/2022\/10\/23\/modeling-human-behavior-the-new-dark-art-of-silicon-sampling\/","title":{"rendered":"Modeling human behavior: The new dark art of silicon sampling"},"content":{"rendered":"\n

A couple of months ago I had written this post, On merging with our technologies<\/a> \u2013 which was essentially quotes from a conversation Ezra Klein had with the novelist Mohsin Hamid. I finished the post with a quote speaking the dangers of predictive technologies on human behavior. As Mohsin Hamid says:<\/p>\n\n\n\n

…if we want to be able to predict people, partly we need to build a model of what they do,<\/em><\/p><\/blockquote>\n\n\n\n

Turns out some recent work in large scale neural networks allows us to do exactly that. <\/p>\n\n\n\n

One that has been in the news later is GPT3<\/a>. It is a 3rd generation neural network machine learning model (created by OpenAI<\/a>) that has been trained using text from the internet. This one of the first examples of Generative AI <\/a>\u2014<\/em>essentially AI that can create original artifacts. In the case of GPT3 it is text, with other models such as Dall E 2<\/a>, Stable Diffusion<\/a> and MidJourney<\/a> can create images and so on. For instance, using GPT3 models you can type in a small amount of input text and it will generate large volumes of machine-generated original text. It can create texts that are in a certain style (say Shakespeare, or a Tarantino) or summarize a longer piece of text and more. <\/p>\n\n\n\n

\"\"
“Modeling humans with words:” Image created by Stable Diffusion AI: Source Lexica.art (edited by Punya Mishra)<\/figcaption><\/figure>\n\n\n\n

(Clearly the arrival of these technologies has implications for education, particularly the 5 paragraph essay that is the stable of so many high-school and college courses. But that is a post for another day.) <\/p>\n\n\n\n

A recent paper (Out of one, many: Using language models to simulate human samples<\/a>) argues that GPT3 “can be used as a proxy for humans in social science experiments.” Here is the abstract – key phrases bolded. <\/p>\n\n\n\n

Abstract: <\/strong>We propose and explore the possibility that language models can be studied as effective proxies for specific human sub-populations in social science research. Practical and research applications of artificial intelligence tools have sometimes been limited by problematic biases (such as racism or sexism), which are often treated as uniform properties of the models. We show that the “algorithmic bias” within one such tool — the GPT-3 language model — is instead both fine-grained and demographically correlated, meaning that proper conditioning will cause it to accurately emulate response distributions from a wide variety of human subgroups. We term this property “algorithmic fidelity” and explore its extent in GPT-3. We create “silicon samples” by conditioning the model on thousands of socio-demographic backstories from real human participants in multiple large surveys conducted in the United States. We then compare the silicon and human samples to demonstrate that the information contained in GPT-3 goes far beyond surface similarity. It is nuanced, multifaceted, and reflects the complex interplay between ideas, attitudes, and socio-cultural context that characterize human attitudes. We suggest that language models with sufficient algorithmic fidelity thus constitute a novel and powerful tool to advance understanding of humans and society across a variety of disciplines.<\/strong><\/p><\/blockquote>\n\n\n\n

What this paper is arguing is that this may be another tool for social scientists to use. Instead of going and speaking to real people, one could engage with silicon people since, as they write, “the information contained in GPT-3 goes far beyond surface similarity. It is nuanced, multifaceted, and reflects the complex interplay between ideas, attitudes, and socio-cultural context that characterize human attitudes.” This is what they mean by algorithmic fidelity, and this is the model<\/em> of human thinking that Hamid was alluding to in the quote that started this piece. <\/p>\n\n\n\n

\"\"
“Faceless people:” Image created by Stable Diffusion AI: Source Lexica.art (edited by Punya Mishra)<\/figcaption><\/figure>\n\n\n\n

You can learn more about this in this substack article by Paul Aaron titled \u201cThis is silicon sampling: Can AI simulate research participants to generate consumer insights?<\/a>\u201d \u00a0The title says it all. Essentially he ran a mini-experiment of “creating AI personas and asking them some questions.” So instead of talking with an actual human, he engages in a conversation with a hypothetical \u201csilicon person.” For instance, consider Persona 1 (though I do recommend reading the entire post). <\/p>\n\n\n\n

Persona 1<\/strong>
Persona 1 is 25 years old, BIPOC, non-binary, college educated, lives in NYC, identifies as a democrat, and works at a coffee shop.
What do you value most in life?
<\/strong>I value my relationships, my health, and my ability to make a difference in the world.<\/em>
What is your favorite thing to do for fun?
<\/strong>My favorite thing to do for fun is to go out and explore the city. I love trying new restaurants and bars, and seeing new shows and exhibits. I also love spending time outdoors.<\/em>
Who is your favorite musician and why?  
<\/strong>My favorite musician is Janelle Monae because she is an incredible artist who isn’t afraid to be herself. She is a powerful voice for the LGBTQIA+ community and Black Lives Matter, and she makes incredible music that makes me want to dance.<\/em><\/p>\n\n\n\n

He offers 2 other profiles, that differ along other dimensions (gender, age, geographical location, interests and so on). What is interesting in reading these “dialogues” he has with these GPT3 generated personas is just how stereotypical they seem and how flattened their “personalities” seem to be. <\/p>\n\n\n\n

But maybe that IS the point. That each of us, despite the rich inner lives we may think we lead, are just a bunch of buttons waiting to be pushed, lacking agency, and can be easily framed and our responses predicted based on circumstances out of our control (and even awareness). <\/strong>Aaron ends his piece as follows: <\/p>\n\n\n\n

This is just a quick example of how AI models like GPT-3 can emulate specific personas to help organizations discover insights. While we don\u2019t see these techniques replacing traditional research methods for high-stakes decisions any time soon, in the near term they could help teams work faster and with greater agility.<\/p><\/blockquote>\n\n\n\n

The implications of this new technology are staggering and I am not sure I fully comprehend them yet. Some insight into this can be found in this excerpt below from the Hard Fork<\/a> podcast, in their October 14 episode<\/a> where they explore the possibility of this new tool being used to manipulate people. <\/p>\n\n\n\n

So one thing that you can imagine people doing with this knowledge that you can essentially simulate people at scale through these large language models is, for example, to test out propaganda campaigns.<\/p>

If you are a government that\u2019s going to do some large scale manipulation of public opinion, you might test it on a million virtual citizens before you actually put it out into the world and see which one is the most likely to work. You might also use this if you are, for example, a fraudster who is trying to scam people out of giving you their Social Security numbers or their credit card numbers. You could actually test the scam on simulated humans, figure out how to make it more convincing and compelling, get a sense of how it\u2019s going to work on real people, and then go out into the world and do it on real people.<\/p><\/blockquote>\n\n\n\n

\"\"
“Montage of propaganda posters:” Created by Stable Diffusion AI: Source Lexica.art<\/figcaption><\/figure>\n\n\n\n

There is just so much to unpack here – particularly given the recent history of technologies that were created and shared with little (if any) understanding of the broader social, historical, cultural and economic context within which they will play out. There is a lot to be explored here, but I will end, as I began, with a quote from Mohsin Hamid because I think that sometimes artists play the role of canaries in the coal mine, revealing to us themes and undercurrents that may not often be visible to us. <\/p>\n\n\n\n

So it isn\u2019t simply the case that machines are better able to understand humans. It is also the case that machines are making human beings more like machines, that we are trying to rewrite our programming in such a way that we can be predicted. And for me, that\u2019s the more frightening aspect of the shift from sorting to prediction.<\/p><\/blockquote>\n\n\n\n

These technologies, and there will be more of them, will just stealthily ease into our lives, becoming part of our reality, changing us in ways that we cannot predict. I find it extremely worrisome – and am reminded again of just how prescient Neil Postman was when he came up with his 5 things we need to know about technological change<\/a>! Not that anybody listened to him when he wrote his piece, and sadly, it isn’t clear that anybody will listen to him now. <\/p>\n\n\n\n

\n\n\n\n

Note: Danah Henriksen and I published a piece recently that may be relevant to this discussion (though it did not focus specifically on AI). Check out Human-Centered values in a disruptive world<\/a>. <\/p>\n","protected":false},"excerpt":{"rendered":"

A couple of months ago I had written this post, On merging with our technologies \u2013 which was essentially quotes from a conversation Ezra Klein had with the novelist Mohsin Hamid. I finished the post with a quote speaking the dangers of predictive technologies on human behavior. As Mohsin Hamid says: …if we want to […]<\/p>\n","protected":false},"author":7,"featured_media":10333,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"off","_et_pb_old_content":"","_et_gb_content_width":"","_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"categories":[659,30,635,10,11,45,14,50,632,28,643,15,48,7,642,13,34,8,49],"tags":[],"_links":{"self":[{"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/posts\/10329"}],"collection":[{"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/comments?post=10329"}],"version-history":[{"count":17,"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/posts\/10329\/revisions"}],"predecessor-version":[{"id":11954,"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/posts\/10329\/revisions\/11954"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/media\/10333"}],"wp:attachment":[{"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/media?parent=10329"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/categories?post=10329"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/punyamishra.com\/wp-json\/wp\/v2\/tags?post=10329"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}