We built in HeyGen an open source framework specifically made for Agents solving our own pain point that we had when the agents tried to write Remotion. React is not agent-friendly at all, and Remotion is a custom framework where the agent has to first know how it works to make a video. That's changing with HyperFrames, it's just a superset of HTML, and agents know how to write HTML + GSAP by default in their training data, so it's more difficult to make failures with it! One cool thing is that in HyperFrames every web library can be used inside HyperFrames by default, we support all the Web, compared to Remotion where they need to make an adapter for it, and the agent would have to learn another primitive...
Comments
siegers•1h ago
I like this approach and that it's so flexible and approachable. My nit for the site would be to explain it a bit better - it's a bit hard to grok with everything going on until I went to the repo. There's also opportunity for non-tech users here just using the agent skill but I'm not sure they'll understand the use if they read through the site.
Yep, the blog is more technical, so non-tech users would just install the skill with claude code, openclaw, hermes agent or whatever harness and do a video. Related to what you did, you can also use Canvas inside HyperFrames, etc, so if you need something feel free to open a pr and I'll review it if you tag me
siegers•1h ago
I had made a skill for something similar to use just HTML5, Canvas and JavaScript, and export the video to MP4 (https://github.com/siegerts/skill-canvas-video).
Miguel07Code•40m ago