Understanding Emotions and Intonation in Voice...

Natural Speech Generation Achieved

Top Korean Language Performance, Third in English Among Models Under 30B

Krafton announced on July 29 that it has released its voice artificial intelligence (AI) foundation model, 'A.X K2 Raon-Speech', on the global AI platform Hugging Face.


Krafton Corporate Image (CI). Provided by Krafton

Krafton Corporate Image (CI). Provided by Krafton

View original image


Krafton is participating as a member of the elite team led by SK Telecom in the 'Independent AI Foundation Model' project organized by the Ministry of Science and ICT, spearheading research on next-generation multimodal models. The newly released model is one of the project's second-phase achievements.


A.X K2 Raon-Speech is based on SK Telecom's A.X K2 lightweight language model, with Krafton's proprietary voice encoder and codec applied. It has been trained to understand and generate speech, utilizing information contained in users' voices during this process. This addresses the typical weaknesses of AI voice dialogue systems that tend to dilute details such as emotion and intonation in the user's vocal data.


The model features 2.1 billion (21B) parameters and ranked number one in overall Korean language performance and number three in overall English language performance among public voice language models with up to 3 billion (30B) parameters. Evaluations were carried out in six domains—including speech recognition, speech synthesis, speech understanding, speech and text Q&A, and tool invocation—using a total of 46 benchmarks: 24 in Korean and 22 in English.


Krafton plans to leverage the voice AI capabilities developed through this research to further enhance its AI characters (CPC) that play alongside users. The company intends to implement a game experience where CPCs understand the user's voice and intent, respond with context-appropriate speech, and enable seamless interaction between users and AI within games.



Kangwook Lee, Chief AI Officer (CAIO) of Krafton, said, "A.X K2 Raon-Speech is the result of Krafton's ongoing efforts in researching and advancing AI foundation technologies," adding, "We will continue to refine our AI foundation technologies to deliver new gaming experiences."


This content was produced with the assistance of AI translation services.

© The Asia Business Daily. All rights reserved. Unauthorized AI training and use prohibited.

Today’s Briefing