Jensen Huang Visits Korea and Enters AI PC Market... Arm Partner Nota in the Spotlight
As Nvidia enters the global artificial intelligence (AI) PC market, Nota, a company specializing in AI optimization technology, is drawing attention.
Recently, Jensen Huang, CEO of Nvidia, unveiled the Arm-based platform 'RTX Spark,' officially marking the company's entry into the AI PC market. AI PCs are next-generation computers that perform AI computations directly on the device (on-device) without relying on cloud servers. To realize this, optimization technologies that maximize power efficiency, heat management, and memory efficiency are essential.
Against this backdrop, Nota's AI optimization technology is coming into the spotlight. Nota is a company specializing in AI optimization software that enables high-performance AI services even in environments with limited hardware resources. In March, the company signed a contract to supply AI optimization software to Arm, a global semiconductor design company.
Nota has also demonstrated its technological capabilities by introducing large language model (LLM) inference optimization technology based on heterogeneous computing. This utilizes the strengths of different processing units such as central processing units (CPU), graphics processing units (GPU), and neural processing units (NPU) within an AI PC environment.
By applying "separated inference" technology that divides roles between the GPU and NPU on Intel-based AI PCs, Nota reduced energy consumption per token by approximately 32% compared to single GPU execution, while improving generation throughput by 12%. Compared to the single NPU approach, the company shortened the first response latency by about 89%, achieving overwhelming AI execution efficiency.
Hot Picks Today
"Two Spend 500,000 Won in a Flash, Yet Wait Two Hours?" ... 'Dreamland' Shunned by Kids and Foreign Tourists
- The Era of Getting 200 Million Won After 30 Years Is Over... A Japanese Bank's "Perpetual Department Head" Who Just Clocked In Cries Out
- Spain Hit by Its Worst Tragedy... Lee Kangin, Moreno and Real Madrid Join Soccer World in Mourning
- They Said, “Make It Your Home for Life” - Then Suddenly Kicked 200 Passengers Off... What Happened to the Around-the-World Cruise?
- "130 Rice Bowls Sold Out in a Day"... 'Unfiltered Face' Adds 8 Million Won to Night Market Sales: China's Bungeunwoo
An industry official stated, "In the AI PC era, simply deploying an AI model on a device is not enough. The key competitive edge in the future on-device AI market will be how efficiently AI can be executed within limited resources."
© The Asia Business Daily. All rights reserved. Unauthorized AI training and use prohibited.