#023: RunwayML Image-To-Video (Camera & Motion Features)

Welcome to this week’s edition of Architecture Insights. A weekly newsletter on artificial intelligence for architects, landscape architects, and designers.

RunwayML is an AI-powered tool that allows users to add motion effects to images and create short videos. See below how to get started using it.

This Week In AI

Adobe AI

Adobe releases more AI features to assist with PDFs.

These upgrades are intended to improve the AI’s ability to analyze, summarize, and answer questions you may have about the content within the PDF. Another feature getting AI-generated content from the PDF such as emails and key takeaways.

Stable Diffusion 3

StabilityAI announces and previews Stable Diffusion 3.

This is big news for the open-source world of image generators. It will also mean an upgrade to models such as ControlNet. StabilityAI claims “greatly improved performance in multi-subject prompts, image quality, and spelling abilities” for SB3.

RunwayML

RunwayML is a tool that helps architects use AI to make project visuals, animations, and renderings. It can turn text into videos, create high-quality images, and edit videos with special effects and 3D objects.

Visit the Runway website to get started.

Make sure to use "Gen2" to access the features mentioned below.

Like most other AI tools you will be given space to make a prompt. This can be in the form of text or an existing image.

There are 2 different edit features.

Camera Motion

This feature in runway easily creates a video by moving smoothly between selected points. We just set our preferences to decide the video's direction and flow.

Horizontal, Vertical, Pan, Tilt, Roll, Zoom are the selections we make on our end to tell runway the starting and end points.

The image below was our test subject.

These were the settings for the camera motion.

Here is the result.

Even though it might not keep every detail of the building and landscape as it moves, it still gives a unique view of the image. Plus, it only took about 2 minutes to upload our image and complete the video.

We included the videos as GIFs, this means the quality might not be as good as the original videos. However, the original videos from Runway are much better quality than these GIFs.

Motion Brush

Rather than displacing the entire image, the motion brush will isolate a particular section and create movement within that selected area while leaving the rest untouched.

In the following image, we brushed over the pool to create a wave-like motion.

Runway AI

Other ideas for using the motion tool may be on trees, vehicles, pedestrians, lights, and clouds.

AI Image of the week

Thank you for reading this week’s issue, check past issues here. Share this newsletter with colleagues, friends, or anyone interested in the combined world of architecture and artificial intelligence.

Until next Friday,

A.I.

Did you enjoy this week's post?

Login or Subscribe to participate in polls.