HeyGen has published an open-source tool called Keyframes as part of its HyperFrames framework for video generation by AI agents.

Framework capabilities

HyperFrames provides a set of reusable skills that allow agents such as Hermes, Claude, or Codex to assemble video outputs according to predefined templates and workflows.

Keyframes functionality

Keyframes exposes a timeline where creators can control object animation manually using key poses, motion paths and easing parameters for smoother transitions.

Every adjustment on the timeline is converted into code that the AI agent can read, enabling the agent to both fix animation bugs and generate animation scripts from scratch.

Integration and imports

The framework supports importing design assets from Figma via MCP, which simplifies transferring visual elements into the video pipeline for further manipulation.

Open-sourcing Keyframes allows developers to inspect animation code, extend motion primitives, and adapt agent tasks to different production templates.

Usage scenarios

Typical workflows include product launches, narrated walkthroughs of websites or apps, and motion design sequences where agents coordinate voiceover, avatar placement and animated overlays.

By combining template-driven skills with editable keyframe code, teams can iterate faster while delegating routine fixes to the AI agent.