Krafton Releases Preview of Its Self-Developed LLM "Raon-1 Mini"
30B-Class LLM Trained from Scratch
Released on Hugging Face; Free to Use
Fast Responses and Low Inference Costs
Krafton said on October 21 that it had released a preview version of its self-developed 30B-class large language model (LLM), "Raon-1 Mini."
The model is a preview released ahead of its official launch and is available on Hugging Face under the Apache 2.0 License. Anyone can download and use the model for free, and it can be used freely for research as well as for developing commercial services and products.
Raon-1 Mini Preview is a 30-billion-parameter LLM for which Krafton carried out the entire process, from model design to training from scratch. It supports English and Korean. Krafton designed a proprietary model architecture to achieve both high performance and inference efficiency. It lowered inference costs by combining a mixture-of-experts (MoE) structure, which activates only 4 billion of the model's 30 billion parameters as needed, with its own linear attention technology.
Krafton emphasized that Raon-1 Mini Preview delivers superior performance to overseas models of a similar size and comes close to large domestic models on some metrics. It highlighted the model's natural Korean conversation abilities and fast response times in particular. The model also excels at following instructions accurately, including those specifying formats and personas.
Krafton plans to improve Raon-1 Mini's performance through updates. When the official version is released, the company will also publish a technical report detailing the model's training process and final performance.
Hot Picks Today
"Two Spend 500,000 Won in a Flash, Yet Wait Two Hours?" ... 'Dreamland' Shunned by Kids and Foreign Tourists
- The Era of Getting 200 Million Won After 30 Years Is Over... A Japanese Bank's "Perpetual Department Head" Who Just Clocked In Cries Out
- Spain Hit by Its Worst Tragedy... Lee Kangin, Moreno and Real Madrid Join Soccer World in Mourning
- They Said, “Make It Your Home for Life” - Then Suddenly Kicked 200 Passengers Off... What Happened to the Around-the-World Cruise?
- "130 Rice Bowls Sold Out in a Day"... 'Unfiltered Face' Adds 8 Million Won to Night Market Sales: China's Bungeunwoo
"The release of Raon-1 Mini is the result of independently developing a competitive language model by drawing on Krafton's AI research and development capabilities, which it has built up over more than five years," said Lee Kangwook, Krafton's chief AI officer (CAIO). "We will expand the use of AI across a range of industries with a cost-effective LLM that delivers high performance while keeping costs down."
© The Asia Business Daily. All rights reserved. Unauthorized AI training and use prohibited.