Preserving Head Movements While Refining Facial Expressions in VFX
Automatically Generating Acting Data with AI

Dexter Studio announced on July 3 that it has obtained a patent for video generation technology based on a 4D facial mesh (3D facial data including the time axis).


"Pinpoint Facial Expression Editing": Dexter Studio Obtains 4D Facial Mesh Patent View original image

This technology allows for precise correction of facial expressions in data captured by scanning an actor's performance in 3D dozens of times per second, while keeping head movements such as nodding or tilting intact.


Previously, in order to correct facial expressions, a 'mesh stabilization' process was required to remove head movements for frame-to-frame consistency. During this process, performance details such as nodding and head rotation were lost along with the movement, making it difficult to convey emotion.


The new technology processes head movement and facial expressions separately. By maintaining head movement and adjusting only the facial expressions in detail, it enables more natural acting and emotional delivery. It is also possible to insert or change facial expressions in specific frames, reducing the cost and time required for reshoots or additional shooting.


By training an AI model with precise 4D facial mesh data from certain sections, it is also possible to generate performance data for scenes that were not filmed. This technology can be widely applied to digital human production, animation based on motion capture, and 'facial animation retargeting,' which transfers an actor’s movements onto another actor’s face.



Song Jaewon, Head of R&D at Dexter Studio, said, "The key differentiator is that this technology offers greater efficiency and a level of completion suitable for commercial content compared to existing solutions," adding, "We are building the next-generation production pipeline by combining VFX technologies such as AI re-aging and face swap with artificial intelligence."


This content was produced with the assistance of AI translation services.

© The Asia Business Daily. All rights reserved. Unauthorized AI training and use prohibited.

Today’s Briefing