Logo Logo
directory schraeg
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Compositing· Color correction· DV Editing

Shooting· Sound
Forschung· KI· Reviews· Streaming
/// News
Meta Encodec uses AI to compress audio files significantly more than MP3

Meta Encodec uses AI to compress audio files significantly more than MP3

[11:20 Mon,21.November 2022   by ]    

This sounds exciting: Meta / Facebook Research have presented an AI-based audio codec called Encodec, which (at least on the research paper) is really something. Compared to MP3 files, this codec is supposed to achieve a compression that is better by a factor of 10, especially at very low data rates and with comparable quality.

This would mean that MP3 audio files could be reduced to a tenth of their data storage requirements on average. This in turn would have an enormous impact on offline storage and audio streaming.

The structure of Encodec is strongly reminiscent of typical VACs/GANs. The compressor generates samples that a following discriminator classifies as real or reconstructed. The compression model then modifies its output until the discriminator considers all samples to be real. At the same time, the discriminator also learns to distinguish "real" from "reconstructed" more and more reliably. This interplay subsequently perfects the audio quality with minimal data input in the model.

The structure of Encodec (image source: Meta)

According to Meta, Encodec can thus reconstruct audio with a low bit rate (64 kb/s) without loss of quality and also has potential for further improvements. For example, they also trained a transformer-based speech model that could save another 40 per cent bandwidth while maintaining the same quality, if latency was not crucial, as it is in streaming. In other words, if the encoder does not have to work in real time, even greater compression gains are possible for MP3 audio applications.

Interestingly, special hardware is also not necessary for the application. A single CPU core is said to be sufficient for encoding and decoding with the new method in real time.

And that is still not enough. Meta has announced that it will also use AI to compress video more effectively in an upcoming research project.

deutsche Version dieser Seite: Meta Encodec komprimiert mit KI Audio-Dateien deutlich stärker als MP3


  Vorige News lesen Nächste News lesen 
bildARRI Rental stellt mit HEROES weitere LF Objektiv-Kollektion vor: T.One und LOOK bildUmfrage unter 1.000 Fotografen (Pros und Amateure): Welche Kamera nutzt ihr?

related news:1E0YouTube: new editing app available - and video AI tools coming soon 22.September 2023
DALL-E 3 is here and generates more accurate AI images thanks to ChatGPT integration 21.September 2023
Video clip - Adobe Premiere Pro explained: Automatically remove pauses and filler words with AI, etc. 19.September 2023
Adobe introduces credit-based model for generative AI (and Creative Cloud gets more expensive) 18.September 2023
From text to audio: Stable Audio generates music and sound effects with AI 18.September 2023
Grass Valley announces EDIUS 11 with KI-based functions, dedicated audio editor and more 15.September 2023
Premiere Pro, After Effects and Frame.io - More AI, 3D Workspace and AWS Cloud 13.September 2023
alle Newsmeldungen zum Thema KI
1E0Blackmagic DaVinci Resolve 18.5 Beta 5 - including BRAW for Panasonic GH6 11.July 2023
Panasonic GH6 Firmware Update 2.3 brings 4K 120p via HDMI and BRAW recording 5.July 2023
Google shows new image compression with generative AI 19.June 2023
Panasonic S5IIX (DC-S5M2X) available end of May - with Blackmagic RAW output 9.May 2023
AMD Alveo MA35D: FPGA accelerator for AV1, H.265 and H.264 codecs 12.April 2023
Blackmagic: Camera Update 8.0 and new recommendations for USB-C SSDs for BRAW capture 3.March 2023
Stream more effectively: FFmpeg 6.0 brings among other things acceleration of AV1 via GPU 1.March 2023
alle Newsmeldungen zum Thema Codecs
1E0Video clip: The new Atomos monitor/recorder line-up explained: new features, applications and more, 22.September 2023
SanDisk Professional G-DRIVE Project, G-RAID Mirror and PRO-CINEMA CFexpress Type B memory cards announced 19.September 2023
Blackmaigc DaVinci Resolve 18.6 update 15.September 2023
Monitor & Control - new remote control app for Sony FX3/FX30/FX6 14.September 2023
Intel unveils Thunderbolt 5 - three times faster and up to 240W power delivery 13.September 2023
Apple unveils flagship iPhone 15 Pro Lineup with 3 nm CPU, ACES, external ProRes recording, new LOG and more 12.September 2023
New 31.5-inch 8K monitor from ViewSonic: VG3281 to cost about ,400 2.September 2023
alle Newsmeldungen zum Thema PC

[nach oben]

Archiv Newsmeldungen


September - August - July - June - May - April - March - February - January

December - November - October - September - August - July - June - May - April - March - February - January























deutsche Version dieser Seite: Meta Encodec komprimiert mit KI Audio-Dateien deutlich stärker als MP3

last update : 24.September 2023 - 18:57 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version