As Nvidia enters the global artificial intelligence (AI) PC market, Nota, a company specializing in AI optimization technology, is drawing attention.

Jensen Huang Visits Korea and Enters AI PC Market... Arm Partner Nota in the Spotlight View original image

Recently, Jensen Huang, CEO of Nvidia, unveiled the Arm-based platform 'RTX Spark,' officially marking the company's entry into the AI PC market. AI PCs are next-generation computers that perform AI computations directly on the device (on-device) without relying on cloud servers. To realize this, optimization technologies that maximize power efficiency, heat management, and memory efficiency are essential.


Against this backdrop, Nota's AI optimization technology is coming into the spotlight. Nota is a company specializing in AI optimization software that enables high-performance AI services even in environments with limited hardware resources. In March, the company signed a contract to supply AI optimization software to Arm, a global semiconductor design company.


Nota has also demonstrated its technological capabilities by introducing large language model (LLM) inference optimization technology based on heterogeneous computing. This utilizes the strengths of different processing units such as central processing units (CPU), graphics processing units (GPU), and neural processing units (NPU) within an AI PC environment.


By applying "separated inference" technology that divides roles between the GPU and NPU on Intel-based AI PCs, Nota reduced energy consumption per token by approximately 32% compared to single GPU execution, while improving generation throughput by 12%. Compared to the single NPU approach, the company shortened the first response latency by about 89%, achieving overwhelming AI execution efficiency.



An industry official stated, "In the AI PC era, simply deploying an AI model on a device is not enough. The key competitive edge in the future on-device AI market will be how efficiently AI can be executed within limited resources."


This content was produced with the assistance of AI translation services.

© The Asia Business Daily. All rights reserved. Unauthorized AI training and use prohibited.

Today’s Briefing