AI Video Pipeline

Reference · fact-checked · 2026

Raw footage → stunning video, with Claude in the loop.

Claude can't edit your clips — but it's a killer motion-graphics generator and automation engine. Here's the honest, free-first pipeline that punches way above its $0 cost.

Remotion motion graphics ffmpeg automation ✅ captions / cut-lists ❌ not a footage editor

The honest verdict

What Claude can and can't do for video

✓ Where Claude genuinely shines

  • Remotion motion graphics — writes React → MP4: intros, lower-thirds, animated titles, diagrams, data-viz overlays, transitions.
  • ffmpeg automation — cuts, 9:16 reframes, LUTs, compression, audio normalize, burned-in captions, platform export presets.
  • Transcripts → cut-lists & styled captions — turn a transcript into a rough-cut EDL and SRT/ASS captions.

✕ Where it does NOT work (be real)

  • It's not a replacement for a real editor — struggles with multi-scene cutting, reordering, and color grading without very detailed prompts.
  • It can't turn weak footage into good storytelling. The edit — story, pacing, cuts — is still you. AI just removes the repetitive work.

The standout

Claude Code + Remotion

Remotion is an open-source framework that builds video from React code — animation is a function of the frame number, not a timeline you keyframe by hand. And Remotion officially recommends Claude Code to generate it by prompting.

Officially supported workflow

What it makes: branded intros/outros, lower-thirds, animated title cards, multi-step diagrams, split-screen transitions, data-viz overlays, social clips → rendered to H.264 MP4.

How real is it: there's an official Claude skill (npx skills add remotion, 28 rule files) that teaches Claude the correct patterns — useCurrentFrame(), interpolate(), <Composition>.

~6M
views · launch demo
25k+
installs · week 1
2–3 hrs
full graphics project

Setup (Windows · needs Node.js)

# 1. scaffold a Remotion project (Blank template + Tailwind)
npx create-video@latest

# 2. install the official Remotion skill for Claude
npx skills add remotion

# 3. run the live preview in one terminal…
npm run dev

# 4. …and Claude Code in another — then just prompt it
claude
> "a 6s neon intro: my logo wipes in, glitch transition, TikTok 9:16"

# 5. render the finished MP4
npx remotion render

Claude's other role

ffmpeg on autopilot

Claude writes the commands so you don't memorize ffmpeg's syntax. Ask in plain English; it hands you the exact line or a batch script.

# reframe a landscape clip to vertical 9:16 for TikTok
ffmpeg -i in.mp4 -vf "crop=ih*9/16:ih,scale=1080:1920" -c:a copy out.mp4

# burn styled captions into the video
ffmpeg -i in.mp4 -vf "subtitles=caps.ass" out.mp4

# normalize loudness + compress for upload (smaller, clean audio)
ffmpeg -i in.mp4 -af loudnorm -c:v libx264 -crf 20 out.mp4

Great for: bulk trims/concat, speed ramps, LUT/color, crops, aspect swaps, audio sync, and per-platform export presets.

The tools to pair with Claude

Do the actual edit here

ToolBest forCost
DaVinci ResolveYour main editor + best-in-class color. Studio adds Magic Mask, Voice Isolation, Smart Reframe. Steep 20–40 hr curve.Free
Studio $295 once
DescriptEdit video by editing the transcript; filler-word/silence removal, Studio Sound. Easiest for talking-head.Free 1 hr/mo
~$24/mo
OpusClipAuto-clip long video into short-form. Decent for reels, mediocre for polished long-form.Free (watermark)
~$15/mo*

* OpusClip pricing not fully verified — confirm before subscribing.

End-to-end

The pipeline — where Claude plugs in

Windows · more time than money. Violet = Claude's job. Cyan = your job.

Record raw footage
Capture your gameplay / talking-head / b-roll.
you
Transcribe
Resolve, Descript, or free Whisper. Gives you text to edit and caption from.
tool
Cut the story
Do the real editing in DaVinci Resolve (or edit by text in Descript). Storytelling stays human.
you
Generate motion graphics
Claude Code + Remotion → intro, lower-thirds, animated titles, transitions, data-viz overlays → render MP4/transparent → drop into Resolve. The stunning part.
claude
Automate + caption
Claude + ffmpeg → reframe to 9:16, burn styled captions, normalize audio, export presets for TikTok/YouTube.
claude
Color / LUT
Grade in Resolve for the cinematic look.
you
Export & post
Platform-correct presets, ship it.
you

Bottom line

Best free/cheap starter stack

DaVinci Resolve + Claude Code + Remotion + ffmpeg = $0

A genuinely pro pipeline for nothing. Add OpusClip free for auto short-form clips, or Descript free if you narrate.