Runway Act 6m2229 One With AI-Powered Facial Expression Capture Capability Added to Gen-3 Alpha Model

Runway Act-One feature can work with a single input video and a character image. 3b2t6v

Written by Siddharth Suvarna | Updated: 23 October 2024 14:07 IST

Runway Act-One With AI-Powered Facial Expression Capture Capability Added to Gen-3 Alpha Model

Photo Credit: Runway 55162g

Act-One can capture details such as eye-lines, micro-expressions, pacing and delivery of the

Highlights

Runway’s Act-One feature is gradually rolling out to all s
The AI firm claims the feature does not require any motion capture
The feature can generate both animated and realistic videos

ment

Runway AI, an AI video generation technology which is converting real people into AI characters while not losing out on realistic expressions.

Runway Act-One Capability in Gen-3 Alpha Introduced 726c4a

In a blog post, the AI firm detailed the new video generation capability. Runway stated that the Act-One tool can create live-action and animated content using video and voice performances as inputs. The tool is aimed at offering expressive character performance in AI-generated videos.

Introducing, Act-One. A new way to generate expressive character performances inside Gen-3 Alpha using a single driving video and character image. No motion capture or rigging required.

Learn more about Act-One below.

(1/7) pic.twitter.com/p1Q8lR8K7G
— Runway (@runwayml) October 22, 2024

AI-generated videos have changed the video content creation process significantly as individuals can now generate specific videos using text prompts in natural language. However, there are certain limitations that have prevented the adaptation of this technology. One such limitation is the lack of controls to change the expressions of a character in a video or to improve their performance in of delivery of a sentence, gestures, and eye movement.

However, with Act-One, Runway is trying to bridge that gap. The tool, which only works with the Gen-3 Alpha model, simplifies the facial animation process, which can often be complex and require multi-step workflows. Today, animating such characters requires recording videos of an individual from multiple angles, manual face rigging, and capturing their facial motion separately.

Runway claims Act-One replaces the workflow and turns it into a two-step process. s can now record a video of themselves or an actor from a single-point camera, which can also be a smartphone, and select an AI character. Once done, the tool is claimed to faithfully capture not only facial expressions but also minor details such as eye movements, micro-expressions as well as the style of delivery.

Highlighting the scope of this feature, the company stated in the blog post, “The model preserves realistic facial expressions and accurately translates performances into characters with proportions different from the original source video. This versatility opens up new possibilities for inventive character design and animation.”

One of the models strengths is producing cinematic and realistic outputs across a robust number of camera angles and focal lengths. Allowing you generate emotional performances with previously impossible character depth opening new avenues for creative expression.

(4/7) pic.twitter.com/JG1Fvj8OUm
— Runway (@runwayml) October 22, 2024

Notably, while Act-One can be used for animated characters, it can also be used for live-action characters in a cinematic sequence. Further, the tool can also capture details even if the angle of the actor's face is different from the angle of the AI character's face.

This feature is currently being rolled out to all s gradually, however, since it only works with Gen-3 Alpha, those on the free tier will get a limited number of tokens to generate videos with this tool.

Comments

For the latest reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: AI Video Generator

Akash Dutta Email Akash Dutta

Akash Dutta is a Senior Sub Editor at Gadgets 360. He is particularly interested in the social impact of technological developments and loves reading about emerging fields such as AI, metaverse, and fediverse. In his free time, he can be seen ing his favourite football club - Chelsea, watching movies and anime, and sharing ionate opinions on food. More