Video Editing

--- name: video-editing description: AI-assisted video editing workflows for cutting, structuring, and augmenting real footage. Covers the full pipeline from raw capture through FFmpeg, Remotion, ElevenLabs, fal.ai, and final polish in Descript or CapCut. Use when the user wants to edit video, cut footage, create vlogs, or build video content. --- # Video Editing AI-assisted editing for real footage. Not generation from prompts. Editing existing video fast. ## When to Activate - User wants to edit, cut, or structure video footage - Turning long recordings into short-form content - Building vlogs, tutorials, or demo videos from raw capture - Adding overlays, subtitles, music, or voiceover to existing video - Reframing video for different platforms (YouTube, TikTok, Instagram) - User says "edit video", "cut this footage", "make a vlog", or "video workflow" ## Core Thesis AI video editing is useful when you stop asking it to create the whole video and start using it to compress, structure, and augment real footage. The value is not generation. The value is compression. ## The Pipeline `` Screen Studio / raw footage → Claude / Codex → FFmpeg → Remotion → ElevenLabs / fal.ai → Descript or CapCut ` Each layer has a specific job. Do not skip layers. Do not try to make one tool do everything. ## Layer 1: Capture (Screen Studio / Raw Footage) Collect the source material: - **Screen Studio**: polished screen recordings for app demos, coding sessions, browser workflows - **Raw camera footage**: vlog footage, interviews, event recordings - **Desktop capture via VideoDB**: session recording with real-time context (see videodb skill) Output: raw files ready for organization. ## Layer 2: Organization (Claude / Codex) Use Claude Code or Codex to: - **Transcribe and label**: generate transcript, identify topics and themes - **Plan structure**: decide what stays, what gets cut, what order works - **Identify dead sections**: find pauses, tangents, repeated takes - **Generate edit decision list**: timestamps for cuts, segments to keep - **Scaffold FFmpeg and Remotion code**: generate the commands and compositions ` Example prompt: "Here's the transcript of a 4-hour recording. Identify the 8 strongest segments for a 24-minute vlog. Give me FFmpeg cut commands for each segment." ` This layer is about structure, not final creative taste. ## Layer 3: Deterministic Cuts (FFmpeg) FFmpeg handles the boring but critical work: splitting, trimming, concatenating, and preprocessing. ### Extract segment by timestamp `bash ffmpeg -i raw.mp4 -ss 00:12:30 -to 00:15:45 -c copy segment_01.mp4 ` ### Batch cut from edit decision list `bash #!/bin/bash # cuts.txt: start,end,label while IFS=, read -r start end label; do ffmpeg -i raw.mp4 -ss "$start" -to "$end" -c copy "segments/${label}.mp4" done < cuts.txt ` ### Concatenate segments `bash # Create file list for f in segments/*.mp4; do echo "file '$f'"; done > concat.txt ffmpeg -f concat -safe 0 -i concat.txt -c copy assembled.mp4 ` ### Create proxy for faster editing `bash ffmpeg -i raw.mp4 -vf "scale=960:-2" -c:v libx264 -preset ultrafast -crf 28 proxy.mp4 ` ### Extract audio for transcription `bash ffmpeg -i raw.mp4 -vn -acodec pcm_s16le -ar 16000 audio.wav ` ### Normalize audio levels `bash ffmpeg -i segment.mp4 -af loudnorm=I=-16:TP=-1.5:LRA=11 -c:v copy normalized.mp4 ` ## Layer 4: Programmable Composition (Remotion) Remotion turns editing problems into composable code. Use it for things that traditional editors make painful: ### When to use Remotion - Overlays: text, images, branding, lower thirds - Data visualizations: charts, stats, animated numbers - Motion graphics: transitions, explainer animations - Composable scenes: reusable templates across videos - Product demos: annotated screenshots, UI highlights ### Basic Remotion composition `tsx import { AbsoluteFill, Sequence, Video, useCurrentFrame } from "remotion"; export const VlogComposition: React.FC = () => { const frame = useCurrentFrame(); return ( <AbsoluteFill> {/* Main footage */} <Sequence from={0} durationInFrames={300}> <Video src="/segments/intro.mp4" /> </Sequence> {/* Title overlay */} <Sequence from={30} durationInFrames={90}> <AbsoluteFill style={{ justifyContent: "center", alignItems: "center", }}> <h1 style={{ fontSize: 72, color: "white", textShadow: "2px 2px 8px rgba(0,0,0,0.8)", }}> The AI Editing Stack </h1> </AbsoluteFill> </Sequence> {/* Next segment */} <Sequence from={300} durationInFrames={450}> <Video src="/segments/demo.mp4" /> </Sequence> </AbsoluteFill> ); }; ` ### Render output `bash npx remotion render src/index.ts VlogComposition output.mp4 `` See the Remotion docs for detai