video-understanding

Solid

Turn a video file into a full AI understanding: use video-understanding.sh for frames + transcript, then review as agent to produce understanding.md. Local ffmpeg + whisper. Use when user runs /video-understanding, or says "process this video with full understanding", "get frames and transcript then analyze".

Code & Development 1 stars 0 forks Updated 1 weeks ago MIT

Install

View on GitHub

Quality Score: 78/100

Stars 20%
10
Recency 20%
90
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# video-understanding Full pipeline for turning videos into agent-understandable output: timestamped frames + SRT transcript, followed by agent review that correlates visuals with speech and writes a complete `understanding.md`. Stage 1 is mechanical extraction. Stage 2 is the agent analysis. Generic for any video content. **Skill root:** `~/.agents/skills/video-understanding/` (also linked as Claude skills via `~/.agents/skills`). ## Prerequisites (local STT + ffmpeg) Stage 1 needs **ffmpeg** + **whisper.cpp (`whisper-cli`)** + a ggml model. Install / repair the local stack with **[local-ai-cli](https://github.com/stevederico/local-ai-cli)** (builds whisper.cpp + models, puts tools on PATH): ```bash git clone https://github.com/stevederico/local-ai-cli.git && cd local-ai-cli && bash setup.sh # ensures whisper-cli, ffmpeg (via brew), model under ~/.local/opt/whisper.cpp/ ``` Do not freestyle alternate whisper installs unless the user asks — use local-ai-cli as the source of truth. ## Optional: BYOK mode (install-free) The CLI also supports `VU_PROFILE=byok` (xAI STT + optional Mux frames) when keys are set — see repo README. Stage-1 extraction script still implements this; prefer **local** + local-ai-cli unless the user asks for BYOK. ## Configuration Use `VU_PROFILE=local` (default, fully local whisper) or `grok`. Default frame interval: 500ms (use --interval 500ms / 0.5 / 2 etc). Profiles: `~/.agents/skills/video-understanding/config/profiles/<name>.sh` (or use ...

Details

Author
stevederico
Repository
stevederico/video-understanding
Created
1 months ago
Last Updated
1 weeks ago
Language
Shell
License
MIT

Similar Skills

Semantically similar based on skill content — not just same category

Data & Documents Listed

video-analysis

Understand what is actually in a video, fully locally and for free. Use this skill whenever the user wants to summarise, describe, transcribe, caption, chapter, or answer questions about a video or its audio — "what happens in this video", "summarise this screen recording", "transcribe this meeting", "what does the speaker say", "find the moment X happens", "read the text on screen", "turn this call into notes", "describe this clip for accessibility", "make chapters", "who says what". It samples timestamped frames with ffmpeg, transcribes speech with a local Whisper backend (whisper.cpp / whisperx / faster-whisper / openai-whisper), then reads the frames and transcript to answer — no cloud APIs, no keys, no per-minute cost, nothing leaves the machine. This is the understanding counterpart to ffmpeg-workbench, which transforms/encodes media (convert, compress, clip, GIF, burn subtitles). If the user wants to CHANGE a file rather than understand it, use ffmpeg-workbench instead.

0 Updated 1 weeks ago
SalZaki
Code & Development Listed

video-understand

Use when a video project needs reusable media metadata, word-level transcription, objective speech analysis, or evidence-backed semantic understanding before optional editing skills run.

8 Updated today
WhiteTowerAI
Code & Development Solid

video-subtitle

Add, generate, translate, or burn subtitles into a video. Use when the user wants to add hardcoded/burned-in subtitles, transcribe speech to SRT, translate existing subtitles to another language, or create dual-language subtitles (original + translation). Triggers: "add subtitles to this video", "transcribe this video", "translate subtitles to <lang>", "burn subtitles", "generate SRT", "dual subtitle", "bilingual subtitles", "edit subtitles visually", "open subtitle editor". 给视频加字幕、生成字幕、翻译字幕、烧录字幕、做双语字幕、可视化编辑字幕时使用本 skill。触发词: "给视频加字幕", "视频转字幕", "提取字幕", "翻译字幕", "烧录字幕", "硬字幕", "双语字幕", "双字幕", "可视化编辑字幕", "打开字幕编辑器"。

2 Updated 4 days ago
Crazy-MT