After two weeks experimenting with Claude to generate cinematic videos, I think going forward I’m going to skip using Remotion and just let Claude pick whatever it wants.
Remotion forces Claude to use flat HTML layers. So it’s basically an animated slide. So it’s still good for subtitles or adding random text to the videos, but if I want it to be cinematic, it doesn’t work.
But when I let Claude pick whatever stack it wants it goes with 3js+shaders+ffmpeg and it starts thinking about about the storyline, the scenes, the lighting and everything looks better. More polished.
I’ve had more luck when I don’t name the tool that I want to use and I start by asking for at least multiple different drafts.
Now yes it is more expensive obviously but the output is better.