Adobe is working on a generative AI video model for its Firefly family that will bring new tools to its Premiere Pro video editing platform. These new Firefly tools — alongside some proposed third-party integrations with Runway, Pika Labs, and OpenAI’s Sora models — will allow Premiere Pro users to generate video and add or remove objects using text prompts (just like Photoshop’s Generative Fill feature) and extend the length of video clips.
Unlike many of Adobe’s previous Firefly-related announcements, no release date — beta or otherwise — has been established for the company’s new video generation tools, only that they’ll roll out “this year.” And while the creative software giant showcased what its own video model is currently capable of in an early video demo, its plans to integrate Premiere Pro with AI models from other providers isn’t a certainty.
Adobe instead calls the third-party AI integrations in its video preview an “early exploration” of what these may look like “in the future.” The idea is to provide Premiere Pro users with more choice, according to Adobe, allowing them to use models like Pika to extend shots or Sora or Runway AI when generating B-roll for their projects.
Adobe also says its Content Credentials labels can be applied to these generated clips to identify which AI models have been used to generate them.
This new development is part of Adobe's ongoing plan to harness AI for creative work. The company has been adding AI features to its products, aiming to streamline workflows for its users. The integration of AI into Premiere Pro could save time for editors who need to produce high-quality videos quickly.
Adobe's approach to integrating third-party AI technology is a significant step. It shows a willingness to expand beyond its own models and collaborate with other tech companies. This move could pave the way for a more versatile and flexible creative process for users.
The potential for generative AI in video editing is huge. Editors can use text prompts to make quick edits or generate new content, reducing the need for manual work. This can result in faster production times and more creative possibilities.
Adobe's commitment to AI innovation is clear. As they continue to develop these tools, users can expect more advanced features in the future. The integration of third-party models will likely be watched closely by the creative community.