Logo Logo
directory schraeg
Camcorders· Cinema-Kamera· Computers· Drohnen· GPU· Kamera-Zubehör· Video-DSLR· accessories
Compositing· Color correction· DV Editing

Shooting· Sound
Forschung· KI· Reviews· Streaming
/// News
Google optimizes Stable Diffusion for smartphones: An image in just 12 seconds

Google optimizes Stable Diffusion for smartphones: An image in just 12 seconds

[13:22 Wed,26.April 2023   by ]    

Researchers at Google have optimized Stable Diffusion 1.4 to the point where it takes less than 12 seconds to generate a 512x512 image on a modern smartphone like the Samsung S23 Ultra. Qualcomm had already developed a method in February that only took 15 seconds, but this was limited to Android smartphones equipped with the current Snapdragon 8. By comparison, Google&s new method can be used universally for other diffusion models as well as different hardware configurations, meaning that AI images can soon be generated on a wide range of mobile devices in acceptably short periods of time.

Images generated on smartphone via stable diffusion.

Not long ago, the use of such large diffusion models as Stable Diffusion on a smartphone was hardly conceivable, as their size of over 1 billion parameters is too challenging for most devices due to their limited computational and memory resources. As a rule, the complexity and performance of an AI model as well as its computational requirements depend on the number of parameters it has to learn from the training data - the more of them there are, the more complex the model becomes.

However, Google was able to achieve a huge speedup by optimizing such diffusion models for mobile GPUs in a whole series of ways. For example, the new GPU-optimized shader can perform several intermediate steps that are normally required to generate images via stable diffusion in a single step. These optimizations reduced the time required to generate an image on a Samsung S23 Ultra and an iPhone 14 Pro by 52% and 33%, respectively, while also significantly reducing memory usage. For example, as the fastest smartphone tested to date, a Samsung S23 Ultra required less than 12 seconds for a 512 x 512 image with 20 iterations using Stable Diffusion 1.4 without int8 quantization.

Images generated on the smartphone via Stable Diffusion

This again shows the enormous speed of current AI development: at start of the Stable Diffusion revolution last summer, a dedicated graphics card with at least 8 GB VRAM was still a prerequisite to generate images on one&s own computer using the free text-to-image AI S - moreover, generation still took quite a long time even on powerful graphics cards. The commercial image AIs like Midjourney or DALL-E2 run on dedicated servers with specialized GPUs. However, generating AI images locally on a PC or smartphone (as opposed to dedicated cloud services) has several advantages at once, such as lower server costs, offline functionality, and improved user privacy.

Link more infos at bei arxiv.org

deutsche Version dieser Seite: Google optimiert Stable Diffusion für Smartphones: Ein Bild in nur 12 Sekunden


  Vorige News lesen Nächste News lesen 
bildDropbox Replay jetzt verfügbar - Projekte online teilen und Feedback koordinieren bildARRI Color-Management für Virtual Production erklärt + Beste ARRI-Cam für Virtual Sets

related news:1E0The Paragraphica AI camera is here: taking pictures without a lens of the environment through AI? 5.June 2023
AMD's new Adrenalin drivers 23.5.1 double computing power in Stable Diffusion 3.June 2023
AI military drone kills operator to kill more effectively - in simulation 2.June 2023
Japan and Israel with liberal copyright positions on AI training 2.June 2023
Roll - virtual AI ministudio for interviews (iPhone and web) 1.June 2023
Making of - How the viral Wes Anderson AI videos are created 29.May 2023
Microsoft Olive: New free tool doubles performance of Stable Diffusion 24.May 2023
alle Newsmeldungen zum Thema KI

[nach oben]

Archiv Newsmeldungen


June - May - April - March - February - January

December - November - October - September - August - July - June - May - April - March - February - January























deutsche Version dieser Seite: Google optimiert Stable Diffusion für Smartphones: Ein Bild in nur 12 Sekunden

last update : 6.Juni 2023 - 08:02 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version