← ClaudeAtlas

video-understandinglisted

Turn a video file into a full AI understanding: use video-understanding.sh for frames + transcript, then review as agent to produce understanding.md. Local ffmpeg + whisper. Use when user runs /video-understanding, or says "process this video with full understanding", "get frames and transcript then analyze".
stevederico/video-understanding · ★ 3 · Code & Development · score 80
Install: claude install-skill stevederico/video-understanding
# video-understanding Full pipeline for turning videos into agent-understandable output: timestamped frames + SRT transcript, followed by agent review that correlates visuals with speech and writes a complete `understanding.md`. Stage 1 is mechanical extraction. Stage 2 is the agent analysis. Generic for any video content. **Skill root:** `~/.agents/skills/video-understanding/` (also linked as Claude skills via `~/.agents/skills`). ## Prerequisites (local STT + ffmpeg) Stage 1 needs **ffmpeg** + **whisper.cpp (`whisper-cli`)** + a ggml model. Install / repair the local stack with **[local-ai-cli](https://github.com/stevederico/local-ai-cli)** (builds whisper.cpp + models, puts tools on PATH): ```bash git clone https://github.com/stevederico/local-ai-cli.git && cd local-ai-cli && bash setup.sh # ensures whisper-cli, ffmpeg (via brew), model under ~/.local/opt/whisper.cpp/ ``` Do not freestyle alternate whisper installs unless the user asks — use local-ai-cli as the source of truth. ## Optional: BYOK mode (install-free) The CLI also supports `VU_PROFILE=byok` (xAI STT + optional Mux frames) when keys are set — see repo README. Stage-1 extraction script still implements this; prefer **local** + local-ai-cli unless the user asks for BYOK. ## Configuration Use `VU_PROFILE=local` (default, fully local whisper) or `grok`. Default frame interval: 500ms (use --interval 500ms / 0.5 / 2 etc). Profiles: `~/.agents/skills/video-understanding/config/profiles/<name>.sh` (or use