I’ve been experimenting with a new way to animate videos—and honestly, it’s kinda wild. Using a mix of Unreal Engine, AI tools, and some very questionable acting on my part, I figured out how to create stylized, cinematic animations… completely solo.
Tools Used_
Wonder Dynamics for AI motion Capture.
MetaHuman for creating the 3d characters.
Unreal Engine to build the 3d scene.
Runway’s Style Frame for creating the oil painting look.
Adobe Firefly to create frame by frame oil strokes.
MetaHuman for creating the 3d characters.
Unreal Engine to build the 3d scene.
Runway’s Style Frame for creating the oil painting look.
Adobe Firefly to create frame by frame oil strokes.
Animation Process_
To maintain full control over character performance and camera movement, I started with live-action footage -no motion capture suit required. I used AI to translate a real human performance into 3D data. Tools like Wonder Dynamics make this possible with just a single video input and deliver surprisingly solid body mocap.
Some cleanup was still needed - especially in the hands and fingers - but the core performance came through. Preserving that human nuance is crucial. Capturing authentic expression remains one of the biggest challenges in generative AI workflows, which is why grounding everything in real motion makes such a difference.
Motion Capture process
Visual style_
For this workflow, I wanted to explore whether AI could feel more handcrafted - less synthetic, more soulful. That’s what led me to the oil painting aesthetic. I believe AI works best when it’s grounded in human input - whether through animation, design, or creative direction. Keeping that human element in the loop is key to creating work that resonates.
Visually, I was inspired by the paintings of Edward Hopper. His brushwork, muted tones, and evocative color palettes capture a quiet emotional depth that I wanted to echo in this style. By channeling that look through an AI-assisted process, I aimed to strike a balance between traditional artistry and modern tools.
