Detailed Scores of 2nd DOKPAMO Evaluation Released Following Motif’s Objection... SKT Takes Top Rank

SK Telecom Takes First Place with 70.6 Points
"Eliminated" Motif Scores 65.8 Points

The detailed scores for the second-phase evaluation of the Independent Artificial Intelligence (AI) Foundation Model (DOKPAMO) Project were released on the 27th.

Deputy Prime Minister and Minister of Science and ICT, Paik Kyunghun (center), is seated on the 27th at the Data-Related Ministers' Meeting held at the Government Seoul Office, presided over by Prime Minister Han Seongsuk. Photo by Yonhap News

This detailed result disclosure was carried out at the request of Motif Technologies, which did not pass the second-phase evaluation, and with the consent of the other elite teams.

According to the comprehensive results of the second-phase evaluation, the elite team from SK Telecom ranked first with a score of 70.6 points.

They were followed by Upstage with 69.9 points, LG AI Research Institute with 69.0 points, and Motif with 65.8 points.

The evaluation was conducted on a 100-point scale, composed of benchmark assessments (AAII 25 points and NIA 15 points), expert assessments (35 points), and user assessments (15 points from experts and 10 points from the general public).

By category, in the Artificial Analysis Intelligence Index (AAII) benchmark assessment, which adopts global standards, Motif ranked first with 11.9 points.

This was followed by Upstage with 9.4 points, SK Telecom with 8.8 points, and LG AI Research Institute with 7.8 points.

In the Korea Information Society Agency (NIA) benchmark assessment, which covers seven areas such as Korean language capability and reliability, SK Telecom (13.4 points) and Upstage (13.3 points) took the lead by a narrow margin. LG AI Research Institute scored 12.8 points, and Motif scored 12.7 points.

In the expert assessment, which involved 10 external experts from industry, academia, and research, LG AI Research Institute received the highest score with 29.5 points, followed by SK Telecom (29.3 points), Upstage (29.1 points), and Motif (27.1 points).

Among the user assessments, which measured real-world applicability, SK Telecom ranked first in the expert user assessment participated by 49 AI startup CEOs, while LG AI Research Institute was ranked first in the public assessment panel, in which 185 members of the general public took part, with a score of 7.6 points.

The Ministry of Science and ICT stated, "The DOKPAMO Project is not simply about ranking competition or eliminating teams, but rather aims to foster qualitative growth and expansion of the domestic AI ecosystem," adding, "Taking into account the rapid pace of AI technological advancement, development goals are adjusted every six months (a moving target approach), and the evaluation criteria and methods were finalized and implemented in full agreement with the elite teams after prior consultation."

Previously, Motif had filed an objection with the Ministry of Science and ICT regarding the selection results for the second phase of the DOKPAMO Project.

In response, the Ministry of Science and ICT announced it would process Motif's objection according to the prescribed procedures and make a final decision within 15 days.

This content was produced with the assistance of AI translation services.