Skip to main content

Meta AI gets lip-synced translations and celebrity voices, like Judi Dench and John Cena


Meta's AI assistant, Meta AI, is getting a new voice mode of sorts.

At the Meta Connect 2024 developer conference in Menlo Park on Wednesday morning, Meta announced that Meta AI can now respond back to questions out loud across platforms where it's available: Instagram, Messenger, WhatsApp, and Facebook. You can choose from several voices, including the AI clones of celebrities that Meta hired for the purpose: Awkwafina, Dame Judi Dench, John Cena, Keegan-Michael Key, and Kristen Bell.

The new Meta AI voice feature isn't like OpenAI's Advanced Voice Mode for ChatGPT, which is highly expressive and can pick up on emotive tones in a person's voice. Rather, it's akin to Google's recently launched Gemini Live, which transcribes speech before having an AI answer it and reading the answer aloud using a synthetic voice.

Meta AI voiceImage Credits: Meta

Meta's betting the high-profile talent will make a difference; according to The Wall Street Journal, it paid millions for the use of the celebrity likenesses. Color us skeptical, but we'll reserve judgment until we get to try it ourselves.

In other Meta AI updates, the assistant can now analyze images thanks to an upgrade to the underlying AI models that power the experience. In regions where it's supported, you can, for example, share a picture of a flower you see and ask Meta AI what kind it is. Or you can upload a photo of a dish and request instructions on how to make it. (Bear in mind you'll occasionally get wrong answers.)

Meta also says it's piloting a Meta AI translation tool to automatically translate voices in Instagram Reels. The tool dubs a creator's speech and auto-lip-syncs it, simulating the voice in another language and making sure the lip movements match.

Meta says that it's starting with "small tests" of Reels translations on Instagram and Facebook, only with some creators' videos from Latin America in the U.S. in English and Spanish for now.

Comments

Popular posts from this blog

Katie Holmes enrolls Suri Cruise at pricey Manhattan private school Avenues ... - New York Daily News

James Devaney/WireImage Suri Cruise leaves Chelsea Piers. Katie Holmes reportedly enrolled her in a pricey private school near their Chelsea apartment. Suri Cruise is set to start first grade in style at a pricey new Manhattan private school this year. Katie Holmes enrolled 6-year-old Suri at Avenues, a nearly $40,000-a-year school set to open this fall, Life & Style reported. “Katie has eagerly been telling Suri all about the lunchrooms, basketball courts and different activities Avenues offers. Suri’s really excited about it,” a source told the magazine. The Chelsea school, which overlooks the High Line and isn’t far from Holmes’ apartment in the same neighborhood, boasts a rooftop playground and a fitness center, plus a gym with full-sized basketball and volleyball courts. The for-profit Tenth Ave. school stresses bilingual education, so Suri will learn in Mandarin or Spanish in addition to English. The so-called “world school” plans to open bran...

Review: 'The Raven' is a feeble fictional story - CNN

John Cusack stars as Edgar Allan Poe in "The Raven." John Cusack plays Edgar Allan Poe in "The Raven" Peter Travers: Cusack, who plays Poe with just the right blend of romantic longing and tortuous doubt Travers: Cusack captures that desperation vividly enough ( Rolling Stone ) -- There's a promising premise on the boil here. What if Edgar Allan Poe (1809-1849) spent the last days of his life trying to nab a serial killer who's been using macabre ideas from Poe's short stories to off his victims? "The Pit and the Pendulum," anyone? OK, "The Raven" sounds like a TV series that gets canceled soon after its debut. But it has compensations, chief of which is John Cusack , who plays Poe with just the right blend of romantic longing and tortuous doubt. Director James McTeigue (" V for Vendetta "), an assistant to the Wachowski brothers on " The Matrix ," pulls us i...

Celebrity sightings 2024

Updated June 6, 2024, 1:37 p.m. ET June 6/6 Kendall Jenner at the upstairs café at SARTIANO's dining with a group of pals in the afternoon.  6/4 Influencers including Alix Earle and boyfriend Braxton Berrios, Lisa Hochstein and Jody Glidden and Xandra Pohl at E11even and models Brooks Nader, Camille Kostek, Lexi Williams, Christen Harper, Ellie Thumann, Katie Austin, Penny Lane, Lauren Chan, Jena Sims, Hunter McGrady, Achieng Agutu, Kamie Crawford, and Nicole Williams English celebrating Swim Week at E11even in Miami. Jude Law and wife Phillipa Coan enjoying an early dinner at The Noortwyck on Bleeker Street.  6/3 Doja Cat dining at Italian restaurant SARTIANO's at The Mercer Hotel. The SoHo hotspot has become a staple for Doja Cat's NYC trips, having been seen dining with friends at SARTIANO's during Met Gala week last month. May 5/30 Les Couleurs Art Gallery in Miami celebrating its one-year anniversary with owner Aura Copela...