pilotty

Manage PTY sessions and screen state to automate terminal TUI applications.

151|12|Updated Jan 27, 2026

Search Tags:#automation #terminal #session-management #tui #pilotty #keyboard-control

Ready to run

npx skills add https://github.com/msmps/pilotty --skill pilotty

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: pilotty
Source: https://github.com/msmps/pilotty/tree/main/skills/pilotty
Command: npx skills add https://github.com/msmps/pilotty --skill pilotty

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

pilotty automates the manual tasks of interacting with terminal TUIs by managing PTY sessions, screen state, and keyboard input, enabling reliable AI-driven control over text-based applications like vim, htop, and dialog.

Core Features & Use Cases

Multi-session PTY orchestration with screen capture
Keyboard-driven interaction and scripted workflows for TUIs
AI-friendly JSON outputs and deterministic actions
Use case: automate repetitive CLI tasks, test TUIs, or orchestrate AI agent workflows

Quick Start

Spawn a vim session, open a file, and begin editing.

Frequently Asked Questions about pilotty

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I automate terminal TUI applications with AI-driven control?▼

You can automate terminal TUI applications by managing PTY sessions, capturing screen state, and mapping keyboard inputs to deterministic, AI-friendly JSON actions. This approach enables scripted workflows and reliable orchestration over interactive CLI programs.

What is the best way to orchestrate multiple interactive CLI sessions for automation?▼

The best way to orchestrate multiple interactive CLI sessions is using multi-session PTY management with screen capture. This allows you to track screen state across several terminal user interfaces simultaneously and drive them with scripted keyboard interactions.

Can I use AI to automate file editing in vim without manual keyboard input?▼

Yes, you can automate file editing in vim by spawning a PTY session, capturing the screen state, and translating AI decisions into keyboard-first interactions. This eliminates manual keyboard input and enables deterministic, scripted editing workflows.

Does pilotty support deterministic actions for testing terminal user interfaces?▼

pilotty supports deterministic actions for testing terminal user interfaces by enforcing robust keyboard-first interaction and providing AI-friendly JSON outputs. This ensures reliable, repeatable workflows when automating interactive CLI tasks across managed PTY sessions.

How do I handle screen state and error handling when automating interactive CLI workflows?▼

When automating interactive CLI workflows, screen state and error handling are managed by the underlying PTY session orchestration. The system captures terminal output continuously and enforces robust keyboard-first interaction to validate responses and recover from unexpected states.