Krafton Unveils Voice AI Model: "Utilizing Voice Data to Advance Game AI"
Understanding Emotions and Intonation in Voice...
Natural Speech Generation Achieved
Top Korean Language Performance, Third in English Among Models Under 30B
Krafton announced on July 29 that it has released its voice artificial intelligence (AI) foundation model, 'A.X K2 Raon-Speech', on the global AI platform Hugging Face.
Krafton is participating as a member of the elite team led by SK Telecom in the 'Independent AI Foundation Model' project organized by the Ministry of Science and ICT, spearheading research on next-generation multimodal models. The newly released model is one of the project's second-phase achievements.
A.X K2 Raon-Speech is based on SK Telecom's A.X K2 lightweight language model, with Krafton's proprietary voice encoder and codec applied. It has been trained to understand and generate speech, utilizing information contained in users' voices during this process. This addresses the typical weaknesses of AI voice dialogue systems that tend to dilute details such as emotion and intonation in the user's vocal data.
The model features 2.1 billion (21B) parameters and ranked number one in overall Korean language performance and number three in overall English language performance among public voice language models with up to 3 billion (30B) parameters. Evaluations were carried out in six domains—including speech recognition, speech synthesis, speech understanding, speech and text Q&A, and tool invocation—using a total of 46 benchmarks: 24 in Korean and 22 in English.
Krafton plans to leverage the voice AI capabilities developed through this research to further enhance its AI characters (CPC) that play alongside users. The company intends to implement a game experience where CPCs understand the user's voice and intent, respond with context-appropriate speech, and enable seamless interaction between users and AI within games.
Hot Picks Today
"Two Spend 500,000 Won in a Flash, Yet Wait Two Hours?" ... 'Dreamland' Shunned by Kids and Foreign Tourists
- The Era of Getting 200 Million Won After 30 Years Is Over... A Japanese Bank's "Perpetual Department Head" Who Just Clocked In Cries Out
- Spain Hit by Its Worst Tragedy... Lee Kangin, Moreno and Real Madrid Join Soccer World in Mourning
- They Said, “Make It Your Home for Life” - Then Suddenly Kicked 200 Passengers Off... What Happened to the Around-the-World Cruise?
- "130 Rice Bowls Sold Out in a Day"... 'Unfiltered Face' Adds 8 Million Won to Night Market Sales: China's Bungeunwoo
Kangwook Lee, Chief AI Officer (CAIO) of Krafton, said, "A.X K2 Raon-Speech is the result of Krafton's ongoing efforts in researching and advancing AI foundation technologies," adding, "We will continue to refine our AI foundation technologies to deliver new gaming experiences."
© The Asia Business Daily. All rights reserved. Unauthorized AI training and use prohibited.