Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· KI· Reviews· Streaming
/// News
Animating facial expressions via iPhone - MetaHuman Animator for Unreal Engine

Animating facial expressions via iPhone - MetaHuman Animator for Unreal Engine

[16:09 Fri,24.March 2023   by ]    

There&s a lot happening in the motion/performance capturing space right now - the latest news comes from Epic Games. For their MetaHuman Creator, with which photorealistic, digital human figures can be created, new possibilities were presented that significantly accelerate and simplify the animation process. The new MetaHuman Animator is intended to benefit not only developers of computer games or Hollywood studios, but also indie producers and hobby users.

metahuman-animator-capturing_iPhone
MetaHuman Animator Face Capturing via iPhone


With a simple iPhone camera - i.e. without 3D setup or markers - it will soon be possible to perform face capturing within a few minutes and transfer it to a rigged "MetaHuman"; for the latter, of course, you will need sufficiently powerful hardware. If you want, you can still use a helmet camera and possibly achieve even more accurate results. The following presentation shows how well this works - even fine nuances of facial expressions are transferred well, even though it is of course still recognizable that it is an animation.



In order for the system to apply facial expressions as faithfully as possible to any avatar, the face to be tracked must first be analyzed. First, a MetaHuman actor identity is created, with a standardized rig and mesh - only a short recorded sequence is required. With the help of this character, the position changes of the rig during the tracked performance can be detected and transferred to the target MetaHuman character.

metahuman-animator-model
MetaHuman actor identity


metahuman-animator-facial_capturing
Capturing performance


metahuman-animator-facial_capturing2


Since MetaHuman Animator also supports timecode, performance capturing of a face can be easily combined with body capturing. It is also supposed to realistically imitate tongue movements when speaking by using audio data. You can already guess: Deep Learning algorithms are at work here again, of course.

The new MetaHuman Animator features will be part of the MetaHuman plugin for the Unreal Engine, which (like the engine itself) can be downloaded for free. However, it won&t be publicly available for a few months.

MetaHuman Animator works with an iPhone 11 or later, also required is the free Live Link Face app for iOS, which will be updated with some additional capture modes to support this workflow.

By the way, an iPhone has recently been sufficient for simple motion capturing as well, or more precisely it has to be two phones. The matching app Move.ai was introduced just last week - it also supports the Unreal Engine, among other things.

Link more infos at bei www.unrealengine.com

deutsche Version dieser Seite: Gesichter einfach per iPhone animieren: MetaHuman Animator für Unreal Engine vorgestellt

  

  Vorige News lesen Nächste News lesen 
bildWie man einen Videoclip mit KI-Tools produziert - in nur 3 Stunden bildSennheiser Profile USB-Mikrofon - einfache Bedienung für Podcasts & Co


related news:1E0Final Cut Pro for iPad and Final Cut Pro Update 10.6.6 now available 24.May 2023
Apple M3-Macs only at the turn of the year for new MacBooks and iMacs 15.May 2023
Apple: Will the iPhone camera app finally get pro features? 12.May 2023
Apple Final Cut Pro and Logic Pro coming to iPad in May - in new versions 9.May 2023
Apple: Is Final Cut Pro coming to the new iPad Ultra next year? 5.May 2023
Zacuto+Accsoon iPhone EVF explained 3.May 2023
Runway Gen-1 for iOS: Create AI videos easily on your phone 28.April 2023
alle Newsmeldungen zum Thema Apple
1E0ARRI launches 7 30.May 2023
Gimbal-friendly: Samyang V-AF lens 45mm T1.9 FE available in June 30.May 2023
DJI: New Air 3 coming soon - for the first time with additional telephoto camera 27.May 2023
RØDE PodMic USB: Studio microphone with XLR and USB 25.May 2023
Atomos supports new ProRes RAW plug-ins 25.May 2023
Compact vlogging camera Sony ZV-1 II features new wide angle zoom lens 23.May 2023
New Fuji-X lenses: Voigtländer Ultron 27mm f2.0 and Tamron 11-20mm F/2.8 22.May 2023
alle Newsmeldungen zum Thema accessories


[nach oben]
















Archiv Newsmeldungen

2023

May - April - March - February - January

2022
December - November - October - September - August - July - June - May - April - March - February - January

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Gesichter einfach per iPhone animieren: MetaHuman Animator für Unreal Engine vorgestellt



last update : 31.Mai 2023 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version