How to fix your Indian accent using AI

by | Sunday, February 19, 2023

Featured image design © Punya Mishra (background image courtsey PxHere)

There are many meanings to the phrase “having a voice.” It can mean whether you are present and acknowledged within a space – but most literally it means what you say and how you speak? And sticking to the literal meaning, what does it mean if your voice is changed? Without your permission? Does it change the metaphorical “voice” – your presence in a given space? Does it change your sense of belonging? Does it change your identity?

If all this sounds super abstract, please read the post below about how AI technologies can quite literally change your voice and accent… and a personal experience I had with one of these technologies.


Sorry to bother you is a hilariously dark, somewhat surreal, satirical movie that very creatively explores issues of race, technological change in an age of rampant capitalism. Set in a slightly askew version of Oakland, CA the central conceit of the film is that the main character in the film, who is Black, finds success in his telemarketing career only when he speaks with a white accent. You can see one example in the embedded clip from the film:

Clearly, this is a satire, a pointed one but satire none-the-less.

Imagine my surprise when learned about Sanas, a Bay Area startup that offers a service to call-center companies (who are predominantly in Asia) that will change Asian-sounding accents, on the fly, to make them sound more “neutral.” Of course, in this case, neutral means “White American.” And the AI that powers it does all this in real time. As the website says, “Sound Local, Globally… with the power of effortless real-time accent translation.”

You can check out this new technology of “real-time accent translation” on their website. You can listen to a call center employee speaking in a standard Indian accent, and with the push of a button change the accent to what can only be called a standard “White” accent.

Just for fun, I played with their sample for a bit and in the MP3 embedded below I randomly switched between the “Indian” and the “American” accent. (Both words in quotes because there is no ONE Indian accent, just as there is no ONE American accent).

It would be funny if it weren’t so real and tone-deaf in its marketing pitch. The prose on the website urges you to “Change the World, Not Your Self,” and to “Make yourself heard,” because it is “Your Voice. Your Choice.” (As if the call center employee has any choice in the matter.)

And why do this? Of course, it all about empowerment. As the website says:

Empower team members around the globe to confidently communicate in their voice, no matter who they’re talking to or where they’re calling from, [to] Unlock deeper connections, build trust and affinity, expand diversity, and protect your team’s mental health.” [It is] a step towards empowering individuals, advancing equality, and deepening empathy (emphasis added).

Wow! That’s a lot!

And of course, they have the numbers to back it up. “Accent matching,” the website assures us, “can improve understanding by 31% and customer satisfaction by 21%.”

Irony dies a slow agonizing death in a video embedded on their site where they respond to the hypothetical question: “What does the future sound like?” by responding “It sounds like, YOU.”

Except that that is exactly the opposite of what the software does. It makes you sound like someone who is quite definitely NOT like you! I mean that’s the whole point of the software.

Now we know these AI tools are coming (just see the whole brouhaha about ChatGPT3) and that they will be used in interesting and strange ways, ways that will be offensive and problematic, biased in ways that are both subtle and deliberate. But in all fairness to this company, at least they are upfront about it. Their goal is to take accents that are potentially problematic for Americans and convert them to ones that are not. That’s what their business plan is – and clearly there are buyers.


What is more insidious is where there are tools out there that claim to do one thing but in actuality do something quite different.

Allow me to tell you the story of Adobe Podcast: Enhance, and what it did to my voice.

I am originally from India—so no surprise that I have an Indian accent. If you want to get even more specific I have a pretty typical North-Indian accent (since that is where I spent most of my formative years). My voice, my accent, is who I am. That is part of my identity. It makes me who I am. I have never seen it as being a handicap in any shape or form.

But I guess, Adobe thinks otherwise.

The software giant recently released a beta software called Adobe Podcast and one of the tools in their toolkit is called Enhance. The idea is that you can drop your slightly crappy voice recording (with background noise and other distractions) onto their site and the AI software would magically clean it up, making it sound as if it were recorded in a professional studio. There is even a demo on the site that you can listen to for yourself. And, to be fair, it does sound pretty good.

What I did not anticipate however, what it would do to my Indian accent. My friend and colleague Sean Leahy informed me that they while testing the Enhance software they found something strange was happening. When given a clip recorded in my voice (from an episode of the Learning Futures Podcast) the final output went beyond just cleaning up the background noises.

It subtly changed my accent. It took off the “edges” of my Indian accent and making it little higher in pitch and making me sounding more “American.” This was not something I had asked the software to do. It was just something that was built in.

And in some ways what Adobe Enhance is doing is more insidious – than Sanas. At least Sanas is upfront about its motives – while the AI behind Adobe Enhance does its magic while claiming to be neutral.

That said, I am honestly not a good judge of my voice – because I genuinely don’t like listening to myself recorded. So I grabbed a couple of clips (regular and enhanced) I asked a few friends about what they thought. According to Melissa Warr:

Adobe totally changed your voice–it doesn’t sound like you, it sounds fake… It really seems to take out your identity–since I know you well, it is taking away your voice.

You don’t have to take my (or Melissa’s) word for it. You can judge for yourself by listening to both versions below:

First, the standard recording:

And next the enhanced” version:

What do you think? Am I imagining things? Or did the software change my accent, ever so slightly?

This “feature” was not advertised anywhere. It was not something I had asked for. Just something built into the system.

There are just so many things to unpack here – so I am not even going to try.


Coming full circle to the movie we started with. What was satire in Sorry to Bother You, is now reality — as in the Sanas software, and appears to be embedded (without any clear indication of doing so) in the AI powered Adobe Podcast Enhance.

What can satire do when reality itself is so messed up.

I am reminded of another movie—Don’t Look Upwhich was initially written as a satire, an absurd tragi-comedy on our inability to respond to the climate crisis. However, by the time the movie came out we were in the living through the collectively muddled response to the COVID19 pandemic and the movie now spoke to this new reality. As David Sims said in a conversation in The Atlantic:

It does reflect what’s difficult about satire right now. How do you find ludicrousness in our ludicrous reality? How do you heighten and amuse when everything already feels so heightened all the time?

Sometimes parody and real-life blend in ways that boggle one’s mind.

A few randomly selected blog posts…

Generative AI: Will history repeat or (just) rhyme

Generative AI: Will history repeat or (just) rhyme

As generative AI continues to reshape our world, we're faced with a crucial question: Will we repeat the mistakes we made with previous technologies or will this time be something different? George Santayana famously warned, "Those who cannot remember the past are...

Vikram OR Vetaal, A Halloween Story (co-authored with AI)

Vikram OR Vetaal, A Halloween Story (co-authored with AI)

A few weeks back, Sean Leahy – friend, tech aficionado, futurist, and the co-host of the Learning Futures Podcast – reached out to me via email with an intriguing proposal. He was playing with the concept of harnessing generative AI to craft Halloween stories. The aim...

Friday the 13th

A design for Friday the 13th (shamelessly building on an original idea from Nikita Prokhorov)  Enjoy.

PersonalDNA & cool survey tricks

I just created a personalDNA map for myself. Turns out I am a Benevolent Inventor... beats being a benevolent dictator I say! However, this posting is concerned not with what the survey found out about me but rather about what I learned about the survey. Let's get the...

From Tech to Ed Tech: Distance to the moon

For one reason or another, I have three consecutive posts regarding the earth and sun and moon - i.e. the local area in the solar system. I had just completed my previous postings (on on seeing through eclipses and measuring the radius of the earth) when I came across...

ISTE LIVE 24: Denver

ISTE LIVE 24: Denver

Melissa Warr and I were in Denver earlier this week for the ISTE 2024 conference. We were there to receive the Outstanding Research Paper award from the Journal of Digital Learning in Teacher Education, for our paper TPACK in an age of ChatGPT and generative AI....

Computer Fiction: Two new ambigrams

For one reason or another I have not been bitten by the ambigram bug for a while - till suddenly a week or two ago, two new ambigrams popped into my head. A bit of work with Freehand later... here they are. Enjoy Computer Fiction

On taking beautiful risks

On taking beautiful risks

Dr. Ronald Beghetto, Professor of Educational Psychology in the Neag School of Education, University of Connecticut, is an internationally recognized expert on creative thought and action in educational settings. He is a Fellow of the American...

Of ballots and names…

Jon Krosnick, a professor at Stanford, argues that Hillary Clinton's surprise victory in the New Hampshire primary (contrary to what was being predicted in the pre-election surveys) could be simply due to the design of the ballot! Here is is the key quote: Our...

1 Comment

  1. Steve Salik

    Oh Hell No! This is just another step in the process of turning the world into a cup of premade vanilla pudding. The blandest and most uninteresting landscape I can think of.

    Reply

Submit a Comment

Your email address will not be published. Required fields are marked *