vision-framework

Implement on-device computer vision features for iOS applications.

155|22|Updated Feb 24, 2026
One-click install
npx skills add https://github.com/omarshahine/HomeClaw --skill vision-framework-omarshahine
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: vision-framework
Source: https://github.com/omarshahine/HomeClaw/tree/main/.agents/skills/vision-framework
Command: npx skills add https://github.com/omarshahine/HomeClaw --skill vision-framework-omarshahine

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill enables developers to integrate advanced computer vision capabilities directly into their iOS applications, automating tasks like text recognition, object detection, and image analysis without requiring external services.

Core Features & Use Cases

  • On-Device Vision Processing: Perform OCR, face detection, barcode scanning, image segmentation, and object tracking directly on the user's device.
  • Modern & Legacy APIs: Supports both the latest Swift-native Vision API (iOS 18+) and older VNRequest patterns for broad compatibility.
  • Use Case: Integrate real-time text recognition into a note-taking app, enable barcode scanning for inventory management, or add face detection for photo organization features.

Quick Start

Use the vision-framework skill to recognize all text present in the provided image file named 'receipt.jpg'.

Frequently Asked Questions about vision-framework

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I implement on-device OCR text recognition in my iOS app?

On-device OCR text recognition in iOS apps can be implemented using the Vision framework's text recognition capabilities, which process images directly on the user's device without requiring external services. It supports both modern Swift-native Vision API and legacy VNRequest patterns.

Does the iOS Vision framework support both modern and legacy APIs for image analysis?

Yes, the iOS Vision framework supports both the latest Swift-native Vision API introduced in iOS 18+ and older legacy VNRequest patterns. This broad compatibility allows developers to implement image analysis features across different iOS versions.

What computer vision features can I run locally on an iPhone?

You can run multiple computer vision features locally on an iPhone, including text recognition, face detection, barcode scanning, image segmentation, object tracking, and document scanning. These features process directly on the device using the Vision framework.

How do I add live camera barcode scanning to an iOS application?

Live camera barcode scanning can be added to iOS applications using VisionKit's DataScannerViewController. This component enables real-time scanning directly through the camera, alongside other Vision framework features like text recognition and face detection.

Can I use custom Core ML models for object tracking in iOS?

Yes, custom Core ML models can be used for object tracking and image analysis in iOS through the VNCoreMLRequest interface. This allows developers to perform custom model inference directly on the device alongside native Vision framework features.

What's the best way to perform image segmentation without external services on iOS?

The best way to perform on-device image segmentation without external services on iOS is using the native Vision framework. It handles image segmentation, object tracking, and document scanning directly on the user's device, ensuring data privacy and offline capability.