In spite of recent controversies, Adobe is continuing its AI venture with new video generative and editing tools. The Firefly Video Model joins Adobe’s suite of generative AI tools, though only available in beta for now. The model also marks their foray into the video generation corner of the AI market, dominated by OpenAI’s Sora and Stability AI’s Stable Video Diffusion.
The design company is just one of many devoting themselves to AI recently. It’s an expensive endeavour, requiring much processing power and energy, evidenced by the size of Canva’s recent price hikes. However that will do little to deter juggernauts like Adobe from attempting to claim the market.
Machine-made media
According to Adobe’s vice president of generative AI Alexandru Costin, users can prompt the new tool to generate a five-second clip. It interprets text and image prompts, and users can specify camera angles, panning, motion, and zoom.”We’ve invested in making this model reach the level of quality and prompt understanding that videographers expect. We’ve invested in making sure we really pay attention to the prompt … respecting guidance from videographers much better than other (AI video) models,” said Costin to Reuters.
AI data concerns
In June, Adobe was embroiled in one of the biggest AI scandals of the year when users realized that their vague Terms of Service may allow Adobe to access users’ work to train AI models. Adobe quickly published a blog post promising users that the new terms of use were enacted for its product improvement and content moderation for legal reasons, regarding mainly CSAM.
Costin insists that “We only train [the models] on the Adobe Stock database of content that contains 400 million images, illustrations, and videos that are curated to not contain intellectual property, trademarks or recognizable characters.” The company has not fully escaped plagiarism allegations, some artists have found that when you enter their names into the Firefly stock image generator, the resulting images are uncannily similar to their original work.
Adobe is also adding Generative Extend to Premiere Pro, which can extend any clip by tw0 seconds using the information in the main clip. Along with the Firefly Video Model, it joins the Firefly line of generative AI applications and features, some of which include AI-generated stock images, and music.