ios-vision

Applies the iOS Vision framework to detect objects, faces, and poses in images and video.

1.1k|81|Updated Nov 30, 2025

Search Tags:#vision #segmentation #ios-vision #visionkit #pose

Ready to run

npx skills add https://github.com/CharlesWiltgen/Axiom --skill ios-vision

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: ios-vision
Source: https://github.com/CharlesWiltgen/Axiom/tree/main/.claude-plugin/plugins/axiom/skills/ios-vision
Command: npx skills add https://github.com/CharlesWiltgen/Axiom --skill ios-vision

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

A comprehensive router for computer vision tasks on iOS, including image analysis, object detection, pose detection, and VisionKit usage.

Core Features & Use Cases

Vision-based analysis for subject segmentation, hand/body pose, and face detection.
Decision guidance on Vision vs VisionKit usage and API coverage.
Patterns for coordinate systems and performance considerations.

Quick Start

Invoke a VNGenerateForegroundInstanceMaskRequest on a sample image to isolate a subject.

Frequently Asked Questions about ios-vision

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I detect hand and body pose in iOS using Vision?▼

Hand and body pose detection on iOS uses VNDetectHumanHandPoseRequest and VNDetectHumanBodyPoseRequest from the Vision framework. These APIs analyze live camera feeds or recorded video to track joint positions and movement, enabling gesture recognition and motion analysis workflows.

What's the difference between Vision and VisionKit for iOS image analysis?▼

Vision provides lower-level APIs for object detection, face detection, and pose tracking across images and video. VisionKit offers higher-level, pre-built UI workflows. Choose Vision for custom pipelines and fine-grained control; VisionKit for rapid document and standard analysis tasks.

How do I isolate a subject from the background in iOS?▼

Subject segmentation and foreground lifting on iOS uses VNGenerateForegroundInstanceMaskRequest to create instance masks that separate subjects from backgrounds. This generates binary or multi-instance segmentation masks you can apply to images or video frames for compositing and analysis.

Can I use Vision framework APIs with live camera feeds?▼

Yes, Vision framework APIs work with live camera feeds, recorded media, and static images. Coordinate conversion and performance optimization are critical for real-time processing; batch requests and frame skipping strategies help manage latency on device.

What coordinate systems do I need to handle when using iOS Vision?▼

iOS Vision requires coordinate conversion between image space, view space, and device orientation. Proper mapping ensures detections align with UI elements and camera previews, especially for pose tracking and segmentation masks in live-camera workflows.

What are the limitations of Vision framework object and face detection?▼

Vision object detection works well for common subjects but may struggle with extreme angles, occlusion, or poor lighting. Face detection has accuracy trade-offs with performance; pose detection requires sufficient body visibility. Test detection quality on your target scenarios before production deployment.