Automate desktop and web GUI interactions lacking APIs or CLIs.
npx skills add https://github.com/meiiie/neko-core --skill computer-use-meiiie
Please help me install this Agent Skill. Skill: computer-use Source: https://github.com/meiiie/neko-core/tree/main/skills/computer-use Command: npx skills add https://github.com/meiiie/neko-core --skill computer-use-meiiie
This Skill eliminates the need for manual, repetitive GUI interactions when automating tasks on desktop or web applications that have no public API, CLI, or scriptable interface, saving hours of tedious clicking and typing.
Use the computer-use skill to open your company's internal web portal, navigate to the expense report page, fill in the required fields with the provided receipt data, and submit the form without manual clicking.
High-intent search queries and answers about installing and using this skill.
To automate GUI tasks on legacy desktop apps without APIs, this Skill uses a code-first control hierarchy that prefers shell commands before falling back to Windows UI Automation for text-driven element interaction. It reliably fills forms and scripts workflows without manual clicking.
Yes, you can automate web form filling using accessibility tree-driven control that interacts with web DOM elements via text. It grounds dynamic GUI elements without requiring vision or trained models, enabling reliable navigation and submission for complex web applications.
Vision-based fallback uses pixel-based grounding to interact with custom-drawn interfaces lacking an accessibility tree. It identifies UI elements visually and includes built-in safety guardrails and audit trails to ensure low-risk, reliable operation when standard accessibility methods fail.
The best way to control custom-drawn interfaces is using pixel-based vision grounding as a fallback after standard accessibility tree methods fail. This approach ensures automation coverage for non-standard UIs while maintaining safety guardrails and audit trails for reliable operation.
Yes, this GUI automation approach features shared autonomy that lets users take over control at any time. When the user is idle, it automatically resumes and re-perceives the screen state to continue the workflow seamlessly without losing progress.
You should not use GUI automation when a programmatic API, CLI, or scriptable interface is available, as this Skill prioritizes code-first control methods for maximum reliability. GUI control is reserved strictly for applications lacking any programmatic interface.
AllBeingsFutureClick desktop UI elements or screen coordinates with configurable mouse options.
gonzalezpazmonicaOrchestrate enterprise governance workflows for audit trails, compliance, and certifications.
Probably-GroupAutomate Windows desktop UI testing via UIA and Win32 interactions.
Mte90Retrieve structured browser automation action manuals by ID and keyword.
