News from the AI & ML world
DeeperML
Kara Sherrer@eWEEK
//
Runway AI Inc. has launched Gen-4, a new AI model for video generation designed to address a significant limitation in AI video creation: character consistency across scenes. The New York-based startup, backed by investments from tech giants such as Nvidia and Google, aims to transform film production with this new system, which introduces character and scene consistency across multiple shots. This capability has been elusive for most AI video generators until now, potentially opening new avenues for Hollywood and other creative industries.
Gen-4 allows users to upload a reference image of an object or character and then generate videos where that element retains a consistent look throughout the entire clip. The model combines visual references with text instructions to preserve styles throughout videos, even as details like camera angle or lighting conditions change. Initially, users can generate five- and ten-second clips, but Runway's demo videos hint at future updates that could allow for more complex, longer-form content creation. This technology could also function as an image editing tool, allowing users to combine illustrations and generate multiple variations to streamline the revision process.
ImgSrc: assets.eweek.co
References :
Gen-4 allows users to upload a reference image of an object or character and then generate videos where that element retains a consistent look throughout the entire clip. The model combines visual references with text instructions to preserve styles throughout videos, even as details like camera angle or lighting conditions change. Initially, users can generate five- and ten-second clips, but Runway's demo videos hint at future updates that could allow for more complex, longer-form content creation. This technology could also function as an image editing tool, allowing users to combine illustrations and generate multiple variations to streamline the revision process.
ImgSrc: assets.eweek.co
Share:
References :
- Analytics India Magazine: Runway Introduces its Next-Gen Image-to-Video Generation AI Model
- SiliconANGLE: Runway launches new Gen-4 AI video generator
- THE DECODER: Runway releases Gen-4 video model with focus on consistency
- venturebeat.com: Runway's new Gen-4 AI creates consistent characters across entire videos from a single reference image, challenging OpenAI's viral Ghibli trend and potentially transforming how Hollywood makes films.
- eWEEK: AI Gets Cinematic: Runway’s Gen-4 Brings Film-Quality Consistency to Video Generation
- Charlie Fink: Runway’s Gen-4 release overshadows OpenAI’s image upgrade as Higgsfield, Udio, Prodia, and Pika debut powerful new AI tools for video, music, and image generation.
Classification:
- HashTags: #RunwayAI #Gen4 #AIVideoGeneration
- Company: Runway AI
- Target: Video Creators
- Product: Gen-4
- Feature: Gen-4 AI Model
- Type: AI
- Severity: Informative