The project "LiveCap: Real-time Human Performance Capture from Monocular Video" realizes the first real-time animation of a moving human being including clothing by means of motion capturing on the basis of completely normal video recordings, e.g. of a webcam (the method does not use a second camera or special camera, which records depth information).
Using a live video, the movements of a person are captured in real time along with their everyday clothes. In contrast to classic motion capturing methods, no special suit with marks is required to capture the movements of the individual body parts exactly. Also the deformations of the clothes during the movements of humans are captured and can be used by digital model. The analysis by a neural network is done in real time on a PC with one CPU and two standard GPUs, which are used in parallel.