AI Video Generation Benchmark
11 LLMs each turned the same 4 prompts into Remotion motion-design videos through FrameCall's production pipeline. Every model got the same brief and went through the same renderer. What came out is what you see here, failures included.
Three of the four briefs, generated by Claude Fable 5, the newest model in the lineup, with zero hand edits. Keep scrolling to watch all 11 models attempt the same videos side by side.
Leaderboard
The order comes from watching all four videos from every model and judging the output quality by hand.
Swipe the table sideways for all columns
| # | Model | Ran via | Videos rendered | Tries | Avg gen time | Avg code size | Total cost |
|---|---|---|---|---|---|---|---|
| 1 | Gemini 3.1 Pro Google | OpenRouter | 4/4 | 13 | 110.0s | 16.3k | $0.800 |
| 2 | Claude Fable 5 Anthropic | Claude Code | 4/4 | 4 | — | 23.8k | ~$2.055 |
| 3 | Claude Opus 4.8 Anthropic | Claude Code | 4/4 | 4 | — | 25.9k | ~$1.129 |
| 4 | GPT-5.5 OpenAI | OpenRouter | 4/4 | 4 | 227.3s | 28.4k | $1.568 |
| 5 | Gemini 3.5 Flash Google | OpenRouter | 4/4 | 5 | 63.3s | 30.0k | $0.525 |
| 6 | Claude Sonnet 4.6 Anthropic | Claude Code | 4/4 | 4 | — | 21.2k | ~$0.574 |
| 7 | Kimi K2.6 Moonshot AI | OpenRouter | 4/4 | 15 | 378.5s | 18.1k | $0.292 |
| 8 | GLM 5.1 Z.ai | OpenRouter | 4/4 | 8 | 263.8s | 26.5k | $0.302 |
| 9 | MiMo V2.5 Pro Xiaomi | OpenRouter | 3/4 | 21 | 359.5s | 25.2k | $0.023 |
| 10 | DeepSeek V4 Pro DeepSeek | OpenRouter | 3/4 | 5 | 142.4s | 18.0k | $0.062 |
| 11 | DeepSeek V4 Flash DeepSeek | OpenRouter | 4/4 | 5 | 117.1s | 29.9k | $0.019 |
1. YouTube Channel Intro
1920×1080 · 16:9 · 30fpsShow the exact prompt every model received
Create a polished 12-second YouTube channel intro for a tech review channel called "TECHPULSE". Include: logo reveal (a "TP" monogram), channel name animation, tagline "honest reviews • weekly uploads", social handles (@techpulse, /techpulse, techpulse.com), and a subscribe CTA with bell icon. Should look like something a channel with 500k+ subs would use. Professional but approachable vibe. Dark theme with blue accents.
2. SaaS Product Launch Teaser
1080×1080 · 1:1 · 30fpsShow the exact prompt every model received
Create a hype 12-second product launch teaser for a SaaS app called "FlowBoard" - a team productivity tool. Show off the product name with dramatic typography (gradient text looks good), highlight 3 key features: "Real-time Collaboration", "AI Task Prioritization", "Team Analytics". Include an app mockup, tagline "Built for teams that ship", waitlist CTA, and the URL flowboard.io. Modern startup aesthetic, square format for social. Make it feel like a Product Hunt launch video.
3. Instagram Story Ad
1080×1920 · 9:16 · 30fpsShow the exact prompt every model received
Create a 15-second Instagram Story ad for wireless earbuds called "SoundPods Pro". Product showcase with: product visual (earbud silhouette), name, price ($79, crossed out $149 showing discount), features (40hr battery, ANC, wireless charging), social proof (5-star rating, "2,847 reviews", customer quote), and Shop Now CTA with swipe-up prompt. Should feel premium like an Apple or Samsung ad. Clean light background, product is the hero. Vertical story format, readable text at mobile size.
4. App Feature Walkthrough
1920×1080 · 16:9 · 30fpsShow the exact prompt every model received
Create a 15-second feature walkthrough for a task app's "Smart Scheduling" feature. Show the user flow: phone mockup with task list, adding a new task "Finish quarterly report", toggling on "Smart Schedule" (with AI sparkle), watching it auto-slot into the calendar, getting a reminder notification. End with tagline "Smart Scheduling — Let AI handle the when". Should look like a real landing page demo video. Clean modern UI, satisfying interactions, professional feel.
Bonus: recreating a real music video
960×720 · 4:3 · 30fps · 21sOff the leaderboard, we pushed the top Claude model further: recreate the opening of a real lyric video — “...Baby One More Time” — shot for shot, as a single Remotion composition. Claude Fable 5 designed an original mascot, synced every lyric to the word it lands on, and rebuilt the scene cuts, whip pans, and camera punch-ins from a written spec of the original.
Want videos like these for your own product?
Every one of the 42 videos on this page came out of FrameCall. Type a prompt, pick a model, and get a real motion-design video you can edit, export, and ship. No timeline editor and no After Effects required.