Adobe is introducing some experimental AI tools for animation, imaging, and cleaning of videos and photos that could eventually be added to its Creative Cloud apps.
Although the tools apply to very different mediums, all three share a similar goal: to automate most of the tedious, complex tasks required to create content and give creators more control over the results than simply using a command prompt to connect an AI generator. The idea is to allow people to create animations, images, or do complex video editing without requiring a lot of time or experience.
The first tool, called Project Scenic, gives users more control over the images generated by Adobe's Firefly model. Instead of relying solely on text descriptions, Scenic actually generates a full 3D scene, allowing you to add, move, and resize specific objects. The final results are then used as a reference to create a 2D image that corresponds to the 3D plan.
Next up is Project Motion, a two-step tool that makes it easy to create animated graphics in a variety of styles. The first tier is a simple animation builder that allows creatives to add motion effects to text and simple images without prior animation experience. In the second phase, this animated video is then transformed with text descriptions and reference images and added color, texture and background sequences.
Project Clean Machine is an editing tool that automatically removes annoying distractions in images and videos, such as camera flashes and people walking into images. It's almost similar to an automated content-aware fill, only better because it also corrects any unwanted effects caused by the visual elements you want to remove. For example, if fireworks in the background cause a few seconds of the shot to be overexposed, Clean Machine will ensure that the color and lighting are consistent throughout the video even if the flash itself is removed.
These tools are being announced at Adobe's MAX conference as “sneaks” – what the company describes as in-development projects aimed at showcasing new technologies and gauging public interest. There's no guarantee that a sneak will be fully released, but many features like Photoshop's Distraction Removal and Content-Aware Fill-in After Effects have their roots in these projects.
We got a first look at these sneaks before the announcement, so we'll take a closer look when they're demoed later today. None of these tools are available for the public to try out yet, but that could change in the coming months.