News from the AI & ML world
DeeperML
Michael Nuñez@AI News | VentureBeat
//
Lightricks has recently unveiled LTXV-13B, a groundbreaking AI video model that dramatically accelerates video generation on consumer-grade hardware. This innovative model utilizes "multiscale rendering" technology to achieve speeds up to 30 times faster than competing models, all without the need for expensive, high-end GPUs. The LTXV-13B represents a significant step towards democratizing AI video creation, making it accessible to a wider range of users who can now produce professional-quality AI videos on standard desktop computers and high-end laptops.
The key to LTXV-13B's efficiency lies in its multiscale rendering approach, which generates video in progressive layers of detail. This technique addresses the major challenge of high computational requirements that has historically limited AI video generation to cloud-based systems running on enterprise-grade GPUs with substantial video memory. According to Zeev Farbman, co-founder and CEO of Lightricks, the new model operates effectively within the memory constraints of consumer GPUs like the Nvidia 3090, 4090, and 5090, including their laptop versions.
Alongside this development, scientists from MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL) and Adobe Research have introduced CausVid, a generative AI tool capable of creating smooth, high-resolution videos rapidly. CausVid employs a hybrid approach, using a diffusion model to train an autoregressive system to swiftly predict the next frame while maintaining high quality and consistency. This allows users to generate clips from simple text prompts, turn photos into moving scenes, extend existing videos, and even alter creations mid-generation, opening up new possibilities for fast, interactive content creation.
References :
The key to LTXV-13B's efficiency lies in its multiscale rendering approach, which generates video in progressive layers of detail. This technique addresses the major challenge of high computational requirements that has historically limited AI video generation to cloud-based systems running on enterprise-grade GPUs with substantial video memory. According to Zeev Farbman, co-founder and CEO of Lightricks, the new model operates effectively within the memory constraints of consumer GPUs like the Nvidia 3090, 4090, and 5090, including their laptop versions.
Alongside this development, scientists from MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL) and Adobe Research have introduced CausVid, a generative AI tool capable of creating smooth, high-resolution videos rapidly. CausVid employs a hybrid approach, using a diffusion model to train an autoregressive system to swiftly predict the next frame while maintaining high quality and consistency. This allows users to generate clips from simple text prompts, turn photos into moving scenes, extend existing videos, and even alter creations mid-generation, opening up new possibilities for fast, interactive content creation.
Share:
References :
- news.mit.edu: The CausVid generative AI tool uses a diffusion model to teach an autoregressive (frame-by-frame) system to rapidly produce stable, high-resolution videos.
- AI News | VentureBeat: Lightricks unveils groundbreaking LTXV-13B AI video model that runs 30X faster than competitors on consumer hardware through innovative "multiscale rendering" technology.
Classification:
- HashTags: #AIVideo #Lightricks #LTXV-13B
- Company: Lightricks
- Target: Video Creators
- Product: LTXV-13B
- Feature: AI Video Generation
- Type: AI
- Severity: Informative