Meta, the parent company of Facebook, announced the launch of a new AI model called Movie Gen, designed to generate realistic video and audio content in response to user prompts. The company claims that Movie Gen can compete with advanced media generation tools from prominent startups like OpenAI and ElevenLabs.

In samples shared by Meta, Movie Gen demonstrated its capabilities by producing videos of animals swimming and surfing, as well as personalized clips featuring users’ real photos depicting them engaged in activities such as painting. The model also incorporates background music and sound effects that sync with the generated video content. For instance, Movie Gen was able to add pom-poms to a man’s hands while he ran in the desert and transformed a dry parking lot into a puddle-covered area where a man skateboarded.

Meta reported that the generated videos can last up to 16 seconds, while the accompanying audio can extend to 45 seconds. Blind tests indicated that Movie Gen outperforms offerings from competitors such as Runway, OpenAI, ElevenLabs and Kling.

This announcement arrives amid Hollywood’s ongoing exploration of generative AI technology for video production, a conversation heightened by OpenAI’s February demonstration of its Sora tool, which can create feature film-quality videos from text prompts. While many in the entertainment industry see the potential to enhance filmmaking processes, concerns persist about the use of AI systems trained on copyrighted material without permission.

Lawmakers have expressed worries about the implications of AI-generated deepfakes, particularly in political contexts around the globe.

Meta representatives indicated that Movie Gen is unlikely to be available for open use by developers, unlike its Llama series of large-language models. Instead, the company plans to collaborate with the entertainment sector and content creators to explore Movie Gen’s applications and integrate it into its products by next year. The model was developed using a mix of licensed and publicly available datasets.

In related developments, Lions Gate Entertainment has partnered with AI startup Runway to allow access to its film and television library for model training. This initiative aims to enhance filmmakers’ creative process.