"Pinpoint Facial Expression Editing": Dexter Studio Obtains 4D Facial Mesh Patent
Preserving Head Movements While Refining Facial Expressions in VFX
Automatically Generating Acting Data with AI
Dexter Studio announced on July 3 that it has obtained a patent for video generation technology based on a 4D facial mesh (3D facial data including the time axis).
This technology allows for precise correction of facial expressions in data captured by scanning an actor's performance in 3D dozens of times per second, while keeping head movements such as nodding or tilting intact.
Previously, in order to correct facial expressions, a 'mesh stabilization' process was required to remove head movements for frame-to-frame consistency. During this process, performance details such as nodding and head rotation were lost along with the movement, making it difficult to convey emotion.
The new technology processes head movement and facial expressions separately. By maintaining head movement and adjusting only the facial expressions in detail, it enables more natural acting and emotional delivery. It is also possible to insert or change facial expressions in specific frames, reducing the cost and time required for reshoots or additional shooting.
By training an AI model with precise 4D facial mesh data from certain sections, it is also possible to generate performance data for scenes that were not filmed. This technology can be widely applied to digital human production, animation based on motion capture, and 'facial animation retargeting,' which transfers an actor’s movements onto another actor’s face.
Hot Picks Today
"Two Spend 500,000 Won in a Flash, Yet Wait Two Hours?" ... 'Dreamland' Shunned by Kids and Foreign Tourists
- The Era of Getting 200 Million Won After 30 Years Is Over... A Japanese Bank's "Perpetual Department Head" Who Just Clocked In Cries Out
- Spain Hit by Its Worst Tragedy... Lee Kangin, Moreno and Real Madrid Join Soccer World in Mourning
- They Said, “Make It Your Home for Life” - Then Suddenly Kicked 200 Passengers Off... What Happened to the Around-the-World Cruise?
- "130 Rice Bowls Sold Out in a Day"... 'Unfiltered Face' Adds 8 Million Won to Night Market Sales: China's Bungeunwoo
Song Jaewon, Head of R&D at Dexter Studio, said, "The key differentiator is that this technology offers greater efficiency and a level of completion suitable for commercial content compared to existing solutions," adding, "We are building the next-generation production pipeline by combining VFX technologies such as AI re-aging and face swap with artificial intelligence."
© The Asia Business Daily. All rights reserved. Unauthorized AI training and use prohibited.