Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· GPU· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Reviews
/// News
Nvidia AI Video Compression saves streaming data rate with artificial intelligence

Nvidia AI Video Compression saves streaming data rate with artificial intelligence

[08:35 wed,7.October 2020   by ]    

This is not really surprising: Nvidia has introduced a new AI application to significantly reduce the data rate during streaming. Under the keyword AI video compression, Nvidia reduces the transmission of streaming data to key points on the face, such as the position of the eyes or mouth opening. From this data plus a previously transmitted reference image, a GAN (Generative Adversarial Network) then calculates a plausible representation of a speaking actor. And this with flowing movements.

Compared to an H.264 stream, this of course saves significantly on data rate and thus indirectly ensures a much clearer representation at low data rates. On the other hand, the transmitted stream often does not look real, but rather unnatural like mediocre deep fakes, where the proportions in the face often appear subtly "eccentric".



NvidiaAICodec_PIC1



As you can clearly see in the upper picture, the image of the AI compression does not correspond to the really recorded image, but is "only" a plausible prognosis of how the original might look like at this point in time on the other side of the transmitter.

Since only primary motion/position data is transmitted, it is also possible with this technology to turn the head interactively and let the user look in a different direction. In the case shown here, a direct alignment with a view into the camera is achieved from a lateral viewing direction.

At the latest when a user holds an object into the camera or the face is covered for a short time, the algorithm might have a problem. Thus, the whole thing will probably only be useful for pure "Talking Heads" applications, where the personal nuances of the other person are rather irrelevant.



Nvidia will also present a special application case that we believe has much greater potential for success: The replacement of the speaker by a credibly animated character.

NvidiaAICodec_PIC2



This could really blow a breath of fresh air into many boring video conferences...

Link more infos at bei www.youtube.com

deutsche Version dieser Seite: Nvidia AI Video Compression spart Streaming-Datenrate mit künstlicher Intelligenz

  

  Vorige News lesen Nächste News lesen 
bildSony FX9 Firmware 2.01 fixt Noise-Bug in 2.0 Firmware. bildHighspeed S35 Cinecam für 10.000 Dollar - Freefly Wave


related news:1E0Atomos Connect: HDMI to USB converter for streaming 29.September 2020
Loupedeck Live: Control panel for streaming and more 19.September 2020
Update for the Insta360 ONE R -- 360° live streaming, webcam function and higher bit rates 14.September 2020
Teradek Airmix: Live Streaming Control for Teradek Encoder via App 12.September 2020
Blackmagic Design: Tomorrow Livestream on New Camera Updates and Resolve 16.2.4 released 15.July 2020
Free LUMIX Tether for Streaming tool lets you use come Pansonic cameras as webcam 9.June 2020
Z Cam: E2 gets live streaming, price reductions -- and new E2-M4 introduced 25.May 2020
alle Newsmeldungen zum Thema Streaming
1E0Nikon Z6II and Z7II with Dual Card Slots and for the first time external Blackmagic Raw Support 14.October 2020
Blackmagic DaVinci Resolve 16.3 beta 3 brings lower GPU memory consumption and BRAW 12K for Linux 11.October 2020
Neural Compression to try out HiFiC- High-Fidelity Generative Image Compression 20.September 2020
Apple: iPad Air with A14 Bionic CPU: Even more performance for real-time 10 Bit H.265 4:2:2 editing? 17.September 2020
YouTube in 4K also for Apple users: VP9 codec support comes 12.August 2020
Blackmagic RAW 2.0 Beta 2 brings BRAW 12K for Adobe Premiere and Avid Media Composer to Windows 11.August 2020
Blackmagic DaVinci Resolve Update 16.3 Beta 2: Now also support for BRAW 12K on Windows 10.August 2020
alle Newsmeldungen zum Thema Codecs
1E0Adobe CC Update: AI audio transcription and new GPU acceleration for Adobe Premiere Pro 20.October 2020
Apple iPhone 12 Pro with 5G, Dolby Vision video recording and LiDAR 13.October 2020
Blackmagic DaVinci Resolve 16.3 beta 3 brings lower GPU memory consumption and BRAW 12K for Linux 11.October 2020
Linearization simply explained - Computer Color is Broken... 10.October 2020
AMD Zen 3 Ryzen 5000 CPUs - now through the bench faster than Intel 9.October 2020
Minisforum H31G - Smallest Mini-PC with GPU 26.September 2020
Blackmagic DaVinci Resolve Update 16.2.7 brings support for new Nvidia RTX 3080, RTX 3090 and RTX 30 17.September 2020
alle Newsmeldungen zum Thema Computers


[nach oben]
















Archiv Newsmeldungen

2020

October - September - August - July - June - May - April - March - February - January

2019
December - November - October - September - August - July - June - May - April - March - February - January

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Nvidia AI Video Compression spart Streaming-Datenrate mit künstlicher Intelligenz



last update : 25.Oktober 2020 - 13:18 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version