skyvern

Automate browser workflows using vision-based interaction and Playwright.

Updated Apr 12, 2026
One-click install
npx skills add https://github.com/nbiish/native-psionic-programs --skill skyvern-nbiish
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skyvern
Source: https://github.com/nbiish/native-psionic-programs/tree/main/.agents/skills/skyvern
Command: npx skills add https://github.com/nbiish/native-psionic-programs --skill skyvern-nbiish

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Skyvern provides a self-hosted AI-powered browser automation framework that coordinates a planner, agent, and validator stack with computer vision to interact with pages semantically, replacing brittle manual web interactions.

Core Features & Use Cases

  • Vision-based browser automation using Playwright to navigate pages without brittle selectors
  • Self-hosted deployment routing all LLM calls through local providers (OpenRouter, Ollama, OpenAI-compatible, etc.)
  • Multi-agent workflows capable of form filling, data extraction, login sequences, and cross-site automation across websites

Quick Start

Run the quickstart wizard to install Skyvern locally and start automating web tasks

Frequently Asked Questions about skyvern

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate browser workflows without relying on brittle CSS or XPath selectors?

Browser automation can be achieved using vision-based interaction to navigate pages semantically. This approach uses a Planner, Agent, and Validator architecture with Playwright to execute multi-step web tasks like form filling and data extraction without manual selectors.

Can I run self-hosted AI browser automation routing LLM calls through local providers?

Self-hosted AI browser automation supports routing LLM calls entirely through local providers. You can configure local LLM routing using OpenRouter, Ollama, or OpenAI-compatible endpoints to ensure data privacy during web tasks.

What is vision-based web automation and how does it handle multi-step tasks?

Vision-based web automation uses computer vision to interact with page elements semantically rather than through DOM selectors. It coordinates multi-agent workflows to handle complex sequences like login automation, cross-site e-commerce tasks, and data extraction.

Does Playwright work with self-hosted LLMs for cross-site e-commerce automation?

Playwright integrates with self-hosted LLMs to enable cross-site e-commerce automation. The framework uses Playwright for browser control while routing AI decisions through local models, allowing multi-agent workflows to operate across different websites.

How to set up a local AI agent for web scraping and login sequences?

Run the quickstart wizard to install the framework locally and configure your local LLM provider. This sets up the Planner, Agent, and Validator stack needed to automate login sequences and extract data through vision-based page interaction.

What are the limitations of vision-based browser automation compared to traditional selectors?

Vision-based browser automation replaces brittle manual selectors but relies heavily on local LLM performance and computer vision accuracy. Complex multi-step workflows may require clear task definitions and optional components like scripts to validate actions accurately.