Logo Logo
directory schraeg
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Compositing· Color correction· DV Editing

Shooting· Sound
Forschung· KI· Reviews· Streaming
/// News
Animating facial expressions via iPhone - MetaHuman Animator for Unreal Engine

Animating facial expressions via iPhone - MetaHuman Animator for Unreal Engine

[16:09 Fri,24.March 2023   by ]    

There&s a lot happening in the motion/performance capturing space right now - the latest news comes from Epic Games. For their MetaHuman Creator, with which photorealistic, digital human figures can be created, new possibilities were presented that significantly accelerate and simplify the animation process. The new MetaHuman Animator is intended to benefit not only developers of computer games or Hollywood studios, but also indie producers and hobby users.

MetaHuman Animator Face Capturing via iPhone

With a simple iPhone camera - i.e. without 3D setup or markers - it will soon be possible to perform face capturing within a few minutes and transfer it to a rigged "MetaHuman"; for the latter, of course, you will need sufficiently powerful hardware. If you want, you can still use a helmet camera and possibly achieve even more accurate results. The following presentation shows how well this works - even fine nuances of facial expressions are transferred well, even though it is of course still recognizable that it is an animation.

In order for the system to apply facial expressions as faithfully as possible to any avatar, the face to be tracked must first be analyzed. First, a MetaHuman actor identity is created, with a standardized rig and mesh - only a short recorded sequence is required. With the help of this character, the position changes of the rig during the tracked performance can be detected and transferred to the target MetaHuman character.

MetaHuman actor identity

Capturing performance


Since MetaHuman Animator also supports timecode, performance capturing of a face can be easily combined with body capturing. It is also supposed to realistically imitate tongue movements when speaking by using audio data. You can already guess: Deep Learning algorithms are at work here again, of course.

The new MetaHuman Animator features will be part of the MetaHuman plugin for the Unreal Engine, which (like the engine itself) can be downloaded for free. However, it won&t be publicly available for a few months.

MetaHuman Animator works with an iPhone 11 or later, also required is the free Live Link Face app for iOS, which will be updated with some additional capture modes to support this workflow.

By the way, an iPhone has recently been sufficient for simple motion capturing as well, or more precisely it has to be two phones. The matching app Move.ai was introduced just last week - it also supports the Unreal Engine, among other things.

Link more infos at bei www.unrealengine.com

deutsche Version dieser Seite: Gesichter einfach per iPhone animieren: MetaHuman Animator für Unreal Engine vorgestellt


  Vorige News lesen Nächste News lesen 
bildWie man einen Videoclip mit KI-Tools produziert - in nur 3 Stunden bildSennheiser Profile USB-Mikrofon - einfache Bedienung für Podcasts & Co

related news:1E0Final Cut Pro for iPad and Final Cut Pro Update 10.6.6 now available 24.May 2023
Apple M3-Macs only at the turn of the year for new MacBooks and iMacs 15.May 2023
Apple: Will the iPhone camera app finally get pro features? 12.May 2023
Apple Final Cut Pro and Logic Pro coming to iPad in May - in new versions 9.May 2023
Apple: Is Final Cut Pro coming to the new iPad Ultra next year? 5.May 2023
Zacuto+Accsoon iPhone EVF explained 3.May 2023
Runway Gen-1 for iOS: Create AI videos easily on your phone 28.April 2023
alle Newsmeldungen zum Thema Apple
1E0ARRI launches 7 30.May 2023
Gimbal-friendly: Samyang V-AF lens 45mm T1.9 FE available in June 30.May 2023
DJI: New Air 3 coming soon - for the first time with additional telephoto camera 27.May 2023
RØDE PodMic USB: Studio microphone with XLR and USB 25.May 2023
Atomos supports new ProRes RAW plug-ins 25.May 2023
Compact vlogging camera Sony ZV-1 II features new wide angle zoom lens 23.May 2023
New Fuji-X lenses: Voigtländer Ultron 27mm f2.0 and Tamron 11-20mm F/2.8 22.May 2023
alle Newsmeldungen zum Thema accessories

[nach oben]

Archiv Newsmeldungen


May - April - March - February - January

December - November - October - September - August - July - June - May - April - March - February - January























deutsche Version dieser Seite: Gesichter einfach per iPhone animieren: MetaHuman Animator für Unreal Engine vorgestellt

last update : 31.Mai 2023 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version