---
id: "concept-programmatic-video"
type: "concept"
source_timestamps: ["00:13:20", "00:15:16"]
tags: ["automation", "ffmpeg", "audio-processing"]
related: ["concept-remotion", "entity-product-whisper", "claim-automated-blooper-removal"]
definition: "The process of editing video and audio files using code, scripts, and AI models (like Whisper and FFmpeg) rather than manual GUI-based editors."
sources: ["sabrina"]
sourceVaultSlug: "claude-code-remotion-video-automation-2026May14"
originDay: 3
---
# Programmatic Video Editing

## Definition

The process of editing video and audio files using code, scripts, and AI models (like Whisper and FFmpeg) rather than manual, GUI-based editors.

## The Demonstration

The speaker has [[concept-claude-code|Claude Code]] edit a raw 'talking head' video. Claude Code writes a script that uses:

- **FFmpeg** — for slicing, trimming, and concatenating video segments
- **[[entity-product-whisper|OpenAI Whisper]]** — for transcribing audio and producing word-level timestamps

Claude Code then uses this timestamp data to programmatically:

1. Trim dead air and silences
2. Remove 'bloopers' (mistakes in speech)
3. Adjust word-to-word spacing for natural pacing
4. Dynamically generate and overlay subtitle captions from the transcription

See [[claim-automated-blooper-removal]] for the underlying claim.

## Where It's Robust vs. Brittle

Based on the enrichment overlay:

- **Robust**: FFmpeg `silencedetect`/`silenceremove` filters are mature; Whisper provides reliable word-level timestamps; transcript-driven cut detection works well for monologue formats.
- **Brittle**: nuanced "blooper" judgment (a wrong take, mistimed joke, narrative restart) is subjective and may require LLM-on-transcript reasoning plus human oversight. See [[question-complex-video-edits]].

## Related

- [[concept-remotion]] — the *generative* side; programmatic editing is the *destructive/transformative* side
- [[framework-automated-content-pipeline]] — programmatic editing is step 3
- [[contrarian-cli-video-editing]] — the broader paradigm shift this concept embodies


## Related across days
- [[entity-product-whisper]]
- [[concept-claude-code]]
- [[claim-automated-blooper-removal]]