screen-annotation
FeaturedPoint at things on the screen the user is showing you
Install
Quality Score: 92/100
Skill Content
Details
- Author
- vellum-ai
- Repository
- vellum-ai/vellum-assistant
- Created
- 7 months ago
- Last Updated
- today
- Language
- TypeScript
- License
- MIT
Integrates with
Similar Skills
Semantically similar based on skill content — not just same category
fix-what-i-pointed-at
Pick up the bugs a human flagged by pointing at them in the running app, each arriving with the element, the note they typed, and the source file and line. Use when the user says they marked or flagged something, when starting a session on an app someone has been clicking through, when a designer or PM has left feedback in the UI, or when the user describes a problem as "that button there" without saying which file.
show-me-dont-tell-me
Build step-by-step tutorials and live assistance from annotated screenshots — numbered markers, arrows, zoom — instead of paragraphs describing a button. Use to document an app, guide a setting, troubleshoot an interface, or assist live on the user's screen.
drive-screen
See and operate the user's real, physical Linux desktop through the mcp-screen MCP — screenshot any monitor and click/type/scroll/drag any visible app. Prefer screen_watch (~1 fps) after graphs/maps/canvases/loaders so thrashing UIs are caught like a human watches, not one freeze-frame. Use whenever the user points at something on their monitor(s) or wants you to read/drive a real GUI (Slack, browser, terminal, dashboards). Prefer over app/web APIs when looking at the real screen. NOT for pasted images, local files, shell-only, or remote SSH/TUI. Encodes locate → ground → act → confirm/watch plus hard-won gotchas.