Neosapience develops AI voice actors that sound like humans, not robots

The startup's technology creates AI voice actors that are not only expressive, but also bilingual

A mother reunites with her late daughter through the use of virtual reality technology in the MBC documentary Meeting You.
A mother reunites with her late daughter through the use of virtual reality technology in the MBC documentary Meeting You.
Joo-wan Kim 2
2021-07-06 19:17:02 kjwan@hankyung.com
Startups

In February 2020, a South Korean broadcasting network aired a virtual reality (VR) reunion between a grieving mother and her late daughter. The documentary was heart-wrenching and shockingly real because the VR technology had recreated the deceased daughter's exact appearance and voice.

Artificial intelligence startup Neosapience, Inc. was behind the voice creation, using samples from voice recordings that were taken before she passed away.

"With our AI technology, we create voices that are filled with emotions just like people's voices -- unlike the typical AI voices that sound like robots," said Kim Tae-su, the chief executive of Neosapience, in an interview with The Korea Economic Daily on July 6.

Neosapience CEO Kim Tae-su discusses Typecast at the company's office in Gangnam, Seoul on July 6.
Neosapience CEO Kim Tae-su discusses Typecast at the company's office in Gangnam, Seoul on July 6.

Founded in 2017, Neosapience can generate audio content by analyzing voice actors' recordings as well as recreate the voices of people that have passed away. Neosapience was also the world's first company to develop AI technology that recreates a person's speech into different languages.

In 2018, Neosapience shared a video of former President Donald Trump speaking in Korean. He hadn't actually spoken in Korean, but it was very convincing as it captured his unique tone and cadence. The startup used its technology to analyze Trump's speech and create an AI voice sample.

▲ Donald Trump speaks Korean to meet North Korean Leader


AI ACTORS BECOME BILINGUAL AND EXPRESSIVE 

The startup's core service is Typecast, an audio creation service that produces high-quality audio content based on scripts. It offers around 80 types of Korean AI voice actors and 20 English-speaking voice actors alongside a wide selection of emotions that range from sadness, happiness and anger.

Typecast has become increasingly popular among video content creators and streamers. The service has even begun to replace professional voice actors on TV programs. Also, the country's subscription-based e-book service provider Millie’s Library has adopted Neosapience's technology for its audiobooks. Typecast has over 610,000 members.

"Lately, our focus is on improving the acting ability of our AI voice actors to enhance user satisfaction," said Kim.

The startup plans to expand its English services by offering over 50 types of English voices. Recently the company has seen its overseas sales grow 20% to 30% on a monthly basis. Last year, Neosapience logged revenue of 1.2 billion won ($1.1 million).

"We plan on releasing an AI actor service, which is an evolved version of the AI voice actor service. It'll help users create videos that reflect different emotions based on their scripts," said Kim.

Write to Joo-wan Kim at kjwan@hankyung.com
Danbee Lee edited this article.

Hyundai Motor to adopt digital twin in latest move of virtual technology use

Hyundai Motor to adopt digital twin in latest move of virtual technology use

A Hyundai Motor R&D official is checking the quality of a car design wearing a VR headset. Hyundai Motor Group plans to adopt digital twin technology, which allows the automaker to make a digital replica of a real car for simulation not only in a virtual space but also in the physical wor

Naver says it's constructing world’s first robot-friendly building

Naver says it's constructing world’s first robot-friendly building

Naver’s robot-friendly building will connect all the latest technologies in one infrastructure. The world’s first “robot-friendly” building will complete construction in the second half of this year by South Korea’s tech giant Naver Corp., according to the company.

Paint makers lure MZers with YouTube stars, fashion brand

Paint makers lure MZers with YouTube stars, fashion brand

(Courtesy of KCC) A car pulls in front of an old warehouse. In funky and vivid outfits and holding various tools in their hands, five boys and girls from the Ambiguous Dance Company step out of the vehicle. They dance boldly to vibrant music, with large rollers, brushes and paint pots in their

Atlas Labs makes it easy to transcribe phone calls via AI technology

Atlas Labs makes it easy to transcribe phone calls via AI technology

Atlas Labs CEO Robin Lyu. South Korean startup Atlas Labs is making it easier for people to keep track of their phone conversations via Switch, an app that uses artificial intelligence technology to provide real-time transcriptions.When using the Switch app, there's no need to take notes during

AI startup Voyager X raises over $25 mn in Series A funding round

AI startup Voyager X raises over $25 mn in Series A funding round

Kim Moo-gung (left), head of mobile scanner app vFlat; Nam Se-dong, the co-founder and CEO of Voyager X; Chang Jae-wha (right), head of video editing software Vrew. South Korea-based artificial intelligence startup Voyager X Inc. has successfully raised around 30 billion won ($26.4 million) in

(* comment hide *}