vision-framework

Extract text, faces, barcodes, and documents from images and video using Apple Vision APIs.

Updated May 6, 2026
One-click install
npx skills add https://github.com/Roy-wonji/claude-config --skill vision-framework-roy-wonji
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: vision-framework
Source: https://github.com/Roy-wonji/claude-config/tree/main/skills/swift-ios-skills/skills/vision-framework
Command: npx skills add https://github.com/Roy-wonji/claude-config --skill vision-framework-roy-wonji

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Vision-based features like OCR, barcode scanning, and document understanding are hard to implement correctly and efficiently across different iOS API generations.

Core Features & Use Cases

  • Modern Vision + Legacy Compatibility: Uses the iOS 18+ Swift-native async Vision request API and documents the legacy VNRequest approach when needed.
  • OCR, Faces, Barcodes, and Documents: Extracts text, detects faces/landmarks/capture quality, scans barcodes, and performs structured document recognition (iOS 26+).
  • Video & Live Camera Scanning: Supports tracking across frames and live scanning with VisionKit DataScannerViewController for real-time use cases.

Quick Start

Use the vision-framework skill to design an iOS feature that recognizes text and QR codes from the camera feed and returns results as bounding boxes with confidence filtering.

Frequently Asked Questions about vision-framework

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I add OCR and barcode scanning to an iOS camera feed?

To add OCR and barcode scanning to an iOS camera feed, use VisionKit DataScannerViewController for live scanning or process video frames with Vision requests. This skill extracts text and barcodes, returning results as bounding boxes with confidence filtering.

Does the Apple Vision framework support both modern async requests and legacy APIs?

The Apple Vision framework supports both modern iOS 18+ Swift-native async request APIs and legacy VNRequest approaches. This skill prioritizes the modern async layer while documenting the legacy method to ensure compatibility across different iOS API generations.

Can I detect faces and track objects across video frames using Vision?

Yes, you can detect faces, landmarks, and capture quality, plus track objects across video frames using Vision. This skill applies tracking capabilities to real-time video feeds, allowing continuous object recognition and facial feature extraction within iOS applications.

What's the best way to handle Vision's normalized coordinate system in iOS?

To handle Vision's normalized coordinate system safely, apply proper coordinate transformations when mapping detected bounding boxes to your UI. This skill ensures correct runtime behavior by implementing safe coordinate handling alongside VisionKit availability checks.

Do I need Core ML to perform document recognition with the Vision framework?

Structured document recognition requires iOS 26+ Vision APIs, while optional Core ML inference is supported through custom Vision requests. You do not strictly need Core ML for standard OCR, but it enables extended inference for specialized models.

Why does my VisionKit DataScannerViewController fail on older iOS versions?

VisionKit DataScannerViewController fails on older iOS versions when availability checks are not performed before runtime. This skill implements VisionKit availability checks to ensure correct runtime behavior and prevent crashes on unsupported iOS versions.