visual-intelligence

Featured

Integrate your app with iOS Visual Intelligence for camera-based search and object recognition. Use when adding visual search capabilities.

AI & Automation 564 stars 47 forks Updated 3 days ago MIT

Install

View on GitHub

Quality Score: 96/100

Stars 20%
92
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# Visual Intelligence Integrate your app with iOS Visual Intelligence to let users find app content by pointing their camera at objects. ## When This Skill Activates - User wants camera-based search in their app - User asks about visual search integration - User wants to surface app content in system searches - User needs to handle visual intelligence queries ## Overview Visual Intelligence lets users: 1. Point camera at objects or use screenshots 2. System identifies what they're looking at 3. Your app provides matching content 4. Results appear in system UI Your app implements: - `IntentValueQuery` to receive search requests - `AppEntity` types for searchable content - Display representations for results ## Platform Availability (WWDC26 297) - Visual Intelligence runs on iOS, iPadOS, and macOS — the same entities, query, and OpenIntent code works unchanged on all three. Handle both **camera captures of physical objects** (iOS) and **screenshots of digital media** (iPad/Mac) as input. - On Mac, the input pixel buffer can be **much larger** than what you'd encounter on iPhone — consider whether resizing is necessary before matching. ## Quick Start ### 1. Import Frameworks ```swift import VisualIntelligence import AppIntents ``` ### 2. Create App Entity ```swift struct ProductEntity: AppEntity { var id: String var name: String var price: String var imageName: String static var typeDisplayRepresentation: TypeDisplayRepresentation { Type...

Details

Author
rshankras
Repository
rshankras/claude-code-apple-skills
Created
9 months ago
Last Updated
3 days ago
Language
Swift
License
MIT

Integrates with

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category