Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
ZEISS, RED, NVIDIA, Intel and Canon push volumetric video -are holo-videos the future?

ZEISS, RED, NVIDIA, Intel and Canon push volumetric video -are holo-videos the future?

[16:05 thu,20.May 2021   by ]    

The seven major companies Verizon, ZEISS, RED Digital Cinema, Unity, Intel, NVIDIA and Canon have founded the Volumetric FormatFormat im Glossar erklärt Association (VFA), the first industry association to create standards for a volumetric video ecosystem and make it known to a wider public in the first place.

Only standardization would ensure interoperability between hardware and software from different manufacturers for recording and editing volumetric video - a prerequisite for the rapid development of appropriate tools, the sale of which would then benefit all companies participating in the VFA. But universal interoperability would also be extremely desirable for the users of such tools.


VFA
VFA


Four working groups are tasked with developing specifications for volumetric data acquisition, exchange of that data, decoding and rendering, and metadata.

What is volumetric video anyway?


Volumetric video can be understood as a kind of holographic video of a scene or object, which then allows virtual camera movements through it. Nowadays, this is created in specialized studios, which are equipped with a large number of cameras (and possibly other sensors such as lidar), which are arranged in a kind of dome around the actual scene.

V-Szenen-Western
Videometric dome with many cameras


A scene is then recorded synchronously from their point of view, resulting in massive data rates of up to 600 GB per minute. From these clips, moving point clouds can then be calculated, which can be thought of as a calculated 3D world from the filmed scene or classical pixels to which additional spatial information is assigned (= voxels). Afterwards, one can move around in this scene with a virtual camera, moving almost completely freely in space, and thus define almost any camera position in post-production.

V-Szene-Western
Recordings of the different cameras


The software packages used in this process are still hand-crafted, which is why it is not possible to edit the recordings in common editing programs outside the studios themselves. Here, everyone (including Microsoft) still works with their own proprietary solutions - standardization by the VFA would therefore be a first important step to make working with volumetric video easier.

UebersichtGh5_ii



Volumetric video - what for?


The volumetric point cloud/video data can be used for classic 2D video (which is then, however, freed from the fixed camera position) as well as for 3D video and, in the future, also for holographic video. For example, at sporting events or concerts, the user could decide for himself from where he wants to watch the action or even control his virtual camera himself.

This could offer the user - especially via 3D - a previously unknown immersion through interactivity - both in fictional and real scenarios, which was previously only possible in (VR) computer games. Depending on the technology used to view these videos (2D monitor, 3D monitor, holo display or VR glasses), the weaknesses of previous 3D technology could also be overcome.



For filmmakers, volumetric video opens up new possibilities - for example, the now virtual camera can perform camera movements previously impossible only in CGI scenes. The director is completely free to decide which part of the scene should be shown from which perspective. The following clip nicely explains and demonstrates the new possibilities thus created by volumetric video:




Volumetric video via AI


A kind of democratization of volumetric video, i.e. a reduction of the so far enormously high hardware effort could be provided by Deep Learning algorithms, which would be able to calculate the required interpolation for camera viewing angles between the actual recording positions.

For example, Generative Query Networks (GQNs) can already generate a full 3D model from just a handful of 2D snapshots of a scene through a kind of three-dimensional "understanding" of the scene. The system can then imagine the scene from any angle and also reproduce it. It&s also worth noting that the system relies solely on input from its own image sensors, and it learns autonomously without human supervision.

Thus, it could interpret models (e.g., a scene in an editing program) as 3D space without human intervention. Such GQNs still have narrow limits, but these are being extended with each new generation.

Link more infos at bei www.volumetricformat.org

deutsche Version dieser Seite: Zeiss, Red, Nvidia, Intel und Canon pushen volumetrisches Video - kommt die virtuelle Kamera für alle?

  

  Vorige News lesen Nächste News lesen 
bildNeue Nvidia Studio Notebooks von Dell, HP, Lenovo, Gigabyte, MSI und Razer bildDemnächst neue preisgünstige Aldi Medion PCs mit Nvidia RTX 3070 und RTX 3080 GPUs


related news:1E0Panasonic S1H II - first rumours about 8K and integrated eND filter 14.June 2021
Sony presents its Airpeak S1 professional drone 10.June 2021
New Nikkor Z lenses - macros soon, pancakes later 4.June 2021
New Canon Firmware Updates Cinema and Broadcast/PTZ Users 2.June 2021
Canon releases first EOS R3 video specifications 2.June 2021
Second affordable full-frame prime for L-mount - Panasonic LUMIX S 50mm F1.8 2.June 2021
Sony FX6 firmware 1.10 brings 4K RAW output at 120 fps 30.May 2021
alle Newsmeldungen zum Thema Video-DSLR
1E0Acer ConceptD Creator Notebooks: Update mit neuen Intel Tiger Lake-H45-CPUs, Nvidia RTX A5000 und 3K 3.June 2021
New Nvidia RTX 3080 Ti and 3070 Ti graphics cards - availability exciting 1.June 2021
Neue Nvidia Studio Notebooks von Dell, HP, Lenovo, Gigabyte, MSI und Razer 20.May 2021
Apple's M1 successor expected to have significantly increased GPU power 19.May 2021
New mobile Tiger Lake-H45 CPUs from Intel with up to 8 cores and 5 GHz 18.May 2021
New Nvidia GPUs for cheaper studio notebooks: GeForce RTX 3050 (Ti) 14.May 2021
Storage space instead of GPU power: New cryptocurrency Chia could lead to HDD/SSD shortage 11.May 2021
alle Newsmeldungen zum Thema Computers
1E0New firmware 1.5 for RED Komodo 6K camera brings among others 6K Anamorphic R3D 29.March 2021
Kinefinity withdraws internal RAW capture on all current cameras - RED patent? 2.March 2021
Updates: Magic Bullet Looks / Colorista and Trapcode Particular get news features 23.November 2020
RED KOMODO 6K - now available for order 14.October 2020
Jarred Land - Interview about the RED KOMODO 6K 6.October 2020
Update: Red Giant Universe 3.3 offers news blend modes and more 22.August 2020
smallHD massively reduces prices for Cine 7 monitors including ARRI/RED camera control 13.June 2020
alle Newsmeldungen zum Thema Red


[nach oben]
















Archiv Newsmeldungen

2021

June - May - April - March - February - January

2020
December - November - October - September - August - July - June - May - April - March - February - January

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Zeiss, Red, Nvidia, Intel und Canon pushen volumetrisches Video - kommt die virtuelle Kamera für alle?



last update : 15.Juni 2021 - 15:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version