Runway

A market leading choice for video creators is now challenged by Google and Open AI

Overview

Runway is an all in one AI powered video generating and editing tool from Stability AI, the creators of Stable Diffusion.

It has over 30 different generative AI tools included in a subscription, but at its heart there is a timeline based editing system that mirrors standard video software like Adobe Premiere. Included in the timeline editor are some very useful AI effects, such as AI green screen and motion tracking. These features essentially render the green screen obsolete because they are so accurate, while keying and rotoscoping in After Effects aren’t necessary. The user interface is a little confusing, and it’s a shame that a lot of Runway’s tools haven’t yet been well integrated into the video editor.

Runway also provides a popular generative video application, and it takes less than 30 seconds to create a 10 second clip. In our view, while this is one of the best generative video tools available, it is still somewhat experimental, with limited commercial use. However, it’s likely that it will become increasingly less error prone, meaning within 6-12 months anyone will be able to generate animations or film footage that would once only have been achievable in a Hollywood movie.

Open AI and Google released Sora and Veo 2 respectively in December 2024, so Runway’s position as video generator of choice for video creatives is definitely challenged. However, neither Sora or Veo 2 are available in Europe yet, while Runway is.

Key features

  • AI-Powered Video Editing: A video project timeline editor, with embedded AI enhancements and effects.
  • Generative Video: You can create video using a text, image or video prompt.
  • Inpainting: Remove entire objects and figures from video with this powerful AI effect.
  • Colorisation: You can add color to black and white footage with ease, and the AI will fill in the gaps.
  • Audio Enhancement: Clean up poor quality audio, remove silences and create a transcript based on video.

Pros

  • Comprehensive Toolset: Offers a wide range of AI-driven features that cater to various creative needs – a useful subscription for a range of creative roles that brings a lot of tools together.
  • Best in Class Generative Video: Has on of the most powerful video models available in Europe, allowing you to generate clips fast.
  • AI Green Screen: This is built into the video editor, allowing you to easily isolate objects and figures in your video, then remove the background.
  • Time-Saving: Some of the tools make complex processes far easier. Technically difficult skills like color grading, cleaning up audio and frame interpolation are available.
  • Timeline Based Video Editor: For those who only need to do basic video edits, while using AI features, then Runway is a low cost option.

Cons

  • Lack of Tool Integration: It would be extremely useful for sound editing tools like clean audio to be available from the timeline editor, but mysteriously they are not available on that interface.
  • Learning Curve for Advanced Features: It will definitely save time against learning the ins and outs of After Effects, but some of the tools are still relatively hard to master.
  • Generative Video Errors: The generative video feature is excellent, but you need to know your prompting and be prepared to iterate. Having people walking backwards is still quite common.
  • Generative Video Costs:Each 10 second generation costs 100 credits, which is $1 if you’re buying them outside of a subscription, so costs can mount up quite quickly.

Who is Runway for?

Runway is a very useful tool for filmmakers that want to generate video that would otherwise be difficult to capture. Video editors may also find some of its green screening and colorization tools, but there’s not much use if they are already proficient with After Effects.

The Stable Diffusion integration (for only a little more than Midjourney) makes it a possible choice graphic designers and digital artists who want to explore new possibilities in image and animation creation. Additionally, audio producers can benefit from some of its tools, although there are more specific options for this role available.

Related Tools

Related Articles