As Motif Technologies, which was eliminated in the second evaluation of the government's Independent Artificial Intelligence (AI) Foundation Model Project (DOKPAMO), officially filed an objection, the government announced it will discuss the fair handling of the matter as well as the possibility of additional disclosure of scores.


Kim Kyungman, Director of the Artificial Intelligence Policy Office at the Ministry of Science and ICT, said during a meeting with reporters after the 2nd Science and Technology and Artificial Intelligence Future Strategy Meeting, held at the President Hotel in Jung-gu, Seoul on the morning of August 27, "We will process Motif’s objection fairly in accordance with established procedures."


Kim Kyungman, Director of the Artificial Intelligence Policy Office at the Ministry of Science and ICT, is talking with reporters after the 2nd Science and Technology and Artificial Intelligence Future Strategy Meeting held at the President Hotel in Jung-gu, Seoul, on the morning of the 27th. Photo by Lee Myunghwan

Kim Kyungman, Director of the Artificial Intelligence Policy Office at the Ministry of Science and ICT, is talking with reporters after the 2nd Science and Technology and Artificial Intelligence Future Strategy Meeting held at the President Hotel in Jung-gu, Seoul, on the morning of the 27th. Photo by Lee Myunghwan

View original image

Kim explained, "The main focus of the objection review is to assess whether there was any unfairness in the evaluation procedures or formats," adding, "In accordance with the regulations, a review will be conducted within 15 days, and the final decision will be made through the relevant implementing agency."


He continued, "After the first evaluation, there was significant feedback regarding the need to strengthen the criteria for the model’s originality, and it was pointed out that the actual utilization of the model is just as important as its mere development. The purpose of the independent AI project includes not only performance goals but also explicit service objectives." The move to increase the weight of expert evaluations and add real user assessments was intended to further the project's objectives.


Kim also emphasized, "These (evaluation) criteria were not unilaterally changed by the government; they were agreed upon with participating companies and already publicly announced."


Regarding Motif’s demand for disclosure of itemized scores, Kim stated, "We had deep concerns about the stigma effect and adverse consequences experienced by companies eliminated in the first round." He further explained, "We have already provided individual companies with detailed results, including the highest score and the average figures."


However, he also indicated that further score disclosure would be considered. "We will determine the scope of overall disclosure after an internal review, taking into account fairness and potential impact on the ecosystem," Kim added.


As for the evaluation criteria for the forthcoming third round, Kim stated that they will be flexibly set in accordance with technological developments. He said, "While the second round of evaluation was underway, global AI development trends such as AI agents and advanced reasoning shifted rapidly," and added, "For the third round, we will set the ‘moving target’ after discussion with participating companies on development directions and evaluation methods."



Earlier that morning, Motif officially submitted a statement demanding the disclosure of the DOKPAMO second-round evaluation criteria and itemized scores. Specifically, they called for disclosure of ▲the evaluation results and detailed evaluation content; ▲the rationale for determining the scores for benchmark assessments; ▲the detailed criteria and results for expert evaluations; and ▲the methodologies, detailed criteria, and results for user assessments.


This content was produced with the assistance of AI translation services.

© The Asia Business Daily. All rights reserved. Unauthorized AI training and use prohibited.

Today’s Briefing