Logo Logo
deutsch
directory schraeg
Knowledge
Codecs
Hardware
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Software
Compositing· Color correction· DV Editing
DV-Movies

HowTo
Shooting· Sound
Misc
Forschung· Reviews· Streaming
/// News
Nvidia AI Video Compression saves streaming data rate with artificial intelligence

Nvidia AI Video Compression saves streaming data rate with artificial intelligence

[08:35 wed,7.October 2020   by ]    

This is not really surprising: Nvidia has introduced a new AI application to significantly reduce the data rate during streaming. Under the keyword AI video compression, Nvidia reduces the transmission of streaming data to key points on the face, such as the position of the eyes or mouth opening. From this data plus a previously transmitted reference image, a GAN (Generative Adversarial Network) then calculates a plausible representation of a speaking actor. And this with flowing movements.

Compared to an H.264 stream, this of course saves significantly on data rate and thus indirectly ensures a much clearer representation at low data rates. On the other hand, the transmitted stream often does not look real, but rather unnatural like mediocre deep fakes, where the proportions in the face often appear subtly "eccentric".



NvidiaAICodec_PIC1



As you can clearly see in the upper picture, the image of the AI compression does not correspond to the really recorded image, but is "only" a plausible prognosis of how the original might look like at this point in time on the other side of the transmitter.

Since only primary motion/position data is transmitted, it is also possible with this technology to turn the head interactively and let the user look in a different direction. In the case shown here, a direct alignment with a view into the camera is achieved from a lateral viewing direction.

At the latest when a user holds an object into the camera or the face is covered for a short time, the algorithm might have a problem. Thus, the whole thing will probably only be useful for pure "Talking Heads" applications, where the personal nuances of the other person are rather irrelevant.



Nvidia will also present a special application case that we believe has much greater potential for success: The replacement of the speaker by a credibly animated character.

NvidiaAICodec_PIC2



This could really blow a breath of fresh air into many boring video conferences...

Link more infos at bei www.youtube.com

deutsche Version dieser Seite: Nvidia AI Video Compression spart Streaming-Datenrate mit künstlicher Intelligenz

  

  Vorige News lesen Nächste News lesen 
bildSony FX9 Firmware 2.01 fixt Noise-Bug in 2.0 Firmware. bildHighspeed S35 Cinecam für 10.000 Dollar - Freefly Wave


related news:1E0DeepFake hack on 30.December 2020
Artificial intelligence controlled - GANs with semantic interpolation 24.October 2020
Neural Compression to try out HiFiC- High-Fidelity Generative Image Compression 20.September 2020
Colourlab Ai wants to revolutionize color correction with artificial intelligence 11.September 2020
Neural network DAIN interpolates stop-motion frames 9.September 2020
Automatic transcription: Transcriptive Plugin becomes cheaper per minute with prepaid option 22.March 2020
The new THX trailer Deep Note 2019 is ready - made by Andrew Kramer! 22.August 2019
alle Newsmeldungen zum Thema Machine Learning
1E0JPEG starts standardisation of AI image compression - JPEG AI 11.January 2021
Cameras in motion: all camera movements demonstrated in the film 3.January 2021
New firmware for Nikon Z7 and Z6 brings 4K BRAW recording via Blackmagic Assist 12G recorder 20.December 2020
Blackmagic RAW Speedtest on Apple's M1 (MacBook Pro 16GB) 19.November 2020
Mainconcept Codec Plugin for DaVinci Resolve 17.November 2020
Nikon Z6II and Z7II with Dual Card Slots and for the first time external Blackmagic Raw Support 14.October 2020
Blackmagic DaVinci Resolve 16.3 beta 3 brings lower GPU memory consumption and BRAW 12K for Linux 11.October 2020
alle Newsmeldungen zum Thema Codecs
1E0MSI Creator 15 Notebook: mobile Workstation mit RTX 3080 17.January 2021
Nvidia teases GeForce RTX 3060 with 12 GB Ram for 320 euros 13.January 2021
AMD's upcoming Ryzen 7 5800H - on par with Apple's M1? 16.December 2020
Rumor: Next year MacBook Pro 16 1.December 2020
New Nvidia Studio driver optimizes GPU performance in DaVinci Resolve 17 and other apps 21.November 2020
Blackmagic RAW Speedtest on Apple's M1 (MacBook Pro 16GB) 19.November 2020
Many new Nvidia GPUs in January... 15.November 2020
alle Newsmeldungen zum Thema Computers


[nach oben]
















Archiv Newsmeldungen

2021

January

2020
December - November - October - September - August - July - June - May - April - March - February - January

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Nvidia AI Video Compression spart Streaming-Datenrate mit künstlicher Intelligenz



last update : 17.Januar 2021 - 18:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version