How to fix your Indian accent using AI

by | Sunday, February 19, 2023

Featured image design © Punya Mishra (background image courtsey PxHere)

There are many meanings to the phrase “having a voice.” It can mean whether you are present and acknowledged within a space – but most literally it means what you say and how you speak? And sticking to the literal meaning, what does it mean if your voice is changed? Without your permission? Does it change the metaphorical “voice” – your presence in a given space? Does it change your sense of belonging? Does it change your identity?

If all this sounds super abstract, please read the post below about how AI technologies can quite literally change your voice and accent… and a personal experience I had with one of these technologies.


Sorry to bother you is a hilariously dark, somewhat surreal, satirical movie that very creatively explores issues of race, technological change in an age of rampant capitalism. Set in a slightly askew version of Oakland, CA the central conceit of the film is that the main character in the film, who is Black, finds success in his telemarketing career only when he speaks with a white accent. You can see one example in the embedded clip from the film:

Clearly, this is a satire, a pointed one but satire none-the-less.

Imagine my surprise when learned about Sanas, a Bay Area startup that offers a service to call-center companies (who are predominantly in Asia) that will change Asian-sounding accents, on the fly, to make them sound more “neutral.” Of course, in this case, neutral means “White American.” And the AI that powers it does all this in real time. As the website says, “Sound Local, Globally… with the power of effortless real-time accent translation.”

You can check out this new technology of “real-time accent translation” on their website. You can listen to a call center employee speaking in a standard Indian accent, and with the push of a button change the accent to what can only be called a standard “White” accent.

Just for fun, I played with their sample for a bit and in the MP3 embedded below I randomly switched between the “Indian” and the “American” accent. (Both words in quotes because there is no ONE Indian accent, just as there is no ONE American accent).

It would be funny if it weren’t so real and tone-deaf in its marketing pitch. The prose on the website urges you to “Change the World, Not Your Self,” and to “Make yourself heard,” because it is “Your Voice. Your Choice.” (As if the call center employee has any choice in the matter.)

And why do this? Of course, it all about empowerment. As the website says:

Empower team members around the globe to confidently communicate in their voice, no matter who they’re talking to or where they’re calling from, [to] Unlock deeper connections, build trust and affinity, expand diversity, and protect your team’s mental health.” [It is] a step towards empowering individuals, advancing equality, and deepening empathy (emphasis added).

Wow! That’s a lot!

And of course, they have the numbers to back it up. “Accent matching,” the website assures us, “can improve understanding by 31% and customer satisfaction by 21%.”

Irony dies a slow agonizing death in a video embedded on their site where they respond to the hypothetical question: “What does the future sound like?” by responding “It sounds like, YOU.”

Except that that is exactly the opposite of what the software does. It makes you sound like someone who is quite definitely NOT like you! I mean that’s the whole point of the software.

Now we know these AI tools are coming (just see the whole brouhaha about ChatGPT3) and that they will be used in interesting and strange ways, ways that will be offensive and problematic, biased in ways that are both subtle and deliberate. But in all fairness to this company, at least they are upfront about it. Their goal is to take accents that are potentially problematic for Americans and convert them to ones that are not. That’s what their business plan is – and clearly there are buyers.


What is more insidious is where there are tools out there that claim to do one thing but in actuality do something quite different.

Allow me to tell you the story of Adobe Podcast: Enhance, and what it did to my voice.

I am originally from India—so no surprise that I have an Indian accent. If you want to get even more specific I have a pretty typical North-Indian accent (since that is where I spent most of my formative years). My voice, my accent, is who I am. That is part of my identity. It makes me who I am. I have never seen it as being a handicap in any shape or form.

But I guess, Adobe thinks otherwise.

The software giant recently released a beta software called Adobe Podcast and one of the tools in their toolkit is called Enhance. The idea is that you can drop your slightly crappy voice recording (with background noise and other distractions) onto their site and the AI software would magically clean it up, making it sound as if it were recorded in a professional studio. There is even a demo on the site that you can listen to for yourself. And, to be fair, it does sound pretty good.

What I did not anticipate however, what it would do to my Indian accent. My friend and colleague Sean Leahy informed me that they while testing the Enhance software they found something strange was happening. When given a clip recorded in my voice (from an episode of the Learning Futures Podcast) the final output went beyond just cleaning up the background noises.

It subtly changed my accent. It took off the “edges” of my Indian accent and making it little higher in pitch and making me sounding more “American.” This was not something I had asked the software to do. It was just something that was built in.

And in some ways what Adobe Enhance is doing is more insidious – than Sanas. At least Sanas is upfront about its motives – while the AI behind Adobe Enhance does its magic while claiming to be neutral.

That said, I am honestly not a good judge of my voice – because I genuinely don’t like listening to myself recorded. So I grabbed a couple of clips (regular and enhanced) I asked a few friends about what they thought. According to Melissa Warr:

Adobe totally changed your voice–it doesn’t sound like you, it sounds fake… It really seems to take out your identity–since I know you well, it is taking away your voice.

You don’t have to take my (or Melissa’s) word for it. You can judge for yourself by listening to both versions below:

First, the standard recording:

And next the enhanced” version:

What do you think? Am I imagining things? Or did the software change my accent, ever so slightly?

This “feature” was not advertised anywhere. It was not something I had asked for. Just something built into the system.

There are just so many things to unpack here – so I am not even going to try.


Coming full circle to the movie we started with. What was satire in Sorry to Bother You, is now reality — as in the Sanas software, and appears to be embedded (without any clear indication of doing so) in the AI powered Adobe Podcast Enhance.

What can satire do when reality itself is so messed up.

I am reminded of another movie—Don’t Look Upwhich was initially written as a satire, an absurd tragi-comedy on our inability to respond to the climate crisis. However, by the time the movie came out we were in the living through the collectively muddled response to the COVID19 pandemic and the movie now spoke to this new reality. As David Sims said in a conversation in The Atlantic:

It does reflect what’s difficult about satire right now. How do you find ludicrousness in our ludicrous reality? How do you heighten and amuse when everything already feels so heightened all the time?

Sometimes parody and real-life blend in ways that boggle one’s mind.

A few randomly selected blog posts…

Microblogging in the classroom

I have written quite a bit about how a technology can become an educational technology (see this, this, this and this). This is a non-trivial task that all educators face, and requires situational creativity in re-purposing / re-designing the existing tool to meet...

The incredible drowning man (returns)

It's good to be back at Twente, meeting old friends and making some new ones. I had a pretty light day yesterday, which was good because I had gone around 30 hours without any sleep. After checking into the hotel and getting a short but much needed nap, I took a walk...

Hello Hong Kong, goodbye Hong Kong

A short and sweet trip to Hong Kong, one full day, two nights, fly in fly out. I was a guest of the University of Hong Kong and gave a talk there yesterday, the last in my series of TPACK talks. I had a good audience, the talk went well, though I did not manage my...

Why don’t students like school… In 30 mins!

One of the challenges faced by all instructors is ensuring that students actually read the textbook. This summer we came up with a innovative assignment to address this issue. The book in question was  Daniel Willingham's Why Don't Students Like School? A cognitive...

Perfect Vacuum (OR who wrote this poem?)

Perfect Vacuum (OR who wrote this poem?)

I was cleaning out my drafts folder and came across this poem. I liked it. A lot. It has my sensibility. My sense of whimsy. But I DO NOT remember writing it. Nor do I remember finding it somewhere and copying it into an email. There is no author attributed - which...

ABC-Triplet Ambigram

I am currently teaching a course on Creativity in Teaching & Learning and as a part of that I was searching for an interesting image to highlight a note I was posting to the class. I wanted an image that represented, in some cool manner, the multi-dimensionality...

David Zola, Educator Extraordinaire

David Zola, Educator Extraordinaire

A teacher affects eternity—Henry Adams I remember the first time I saw David Zola teach. He was on stage in front of 200+ undergraduate students with a plastic cup of wine in his hand. The wine had been poured for him by a teaching assistant from a bottle hidden in a...

1 Comment

  1. Steve Salik

    Oh Hell No! This is just another step in the process of turning the world into a cup of premade vanilla pudding. The blandest and most uninteresting landscape I can think of.

    Reply

Submit a Comment

Your email address will not be published. Required fields are marked *