browser-form-workflows

Automates complex browser form interactions including selects, checkboxes, uploads, and validated submissions.

19.1k|3.8k|Updated Jun 10, 2024
One-click install
npx skills add https://github.com/agent0ai/agent-zero --skill browser-form-workflows
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: browser-form-workflows
Source: https://github.com/agent0ai/agent-zero/tree/main/plugins/_browser/skills/browser-form-workflows
Command: npx skills add https://github.com/agent0ai/agent-zero --skill browser-form-workflows

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Filling out web forms in an automated browser often fails on non-text inputs like dropdowns, checkboxes, radio buttons, file uploads, and contenteditable fields, and submissions can silently fail without verification. This Skill provides a structured workflow for handling these complex form scenarios reliably.

Core Features & Use Cases

  • Ref-Based Form Interaction: Use select_option, set_checked, upload_file, type, type_submit, and submit actions against element refs captured via browser:content and browser:detail, avoiding fragile coordinate clicks.
  • Visual Verification: Combine browser:screenshot with vision_load to inspect layout, validation states, captcha-like UI, or canvas content that DOM inspection cannot reveal.
  • Post-Submission Validation: Confirm results with browser:content, browser:state, or a fresh screenshot after submission.
  • Use Case: Imagine automating a multi-step signup form with a dropdown country selector, terms-of-service checkbox, and avatar upload. This Skill guides the agent to capture refs, fill each field with the correct action, verify the file path exists before upload, and confirm successful submission visually.

Quick Start

Fill out the signup form on the current page, including the dropdown, checkbox, and profile photo upload, then verify the submission succeeded.

Frequently Asked Questions about browser-form-workflows

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I fill out a web form with browser automation?

Start with browser:content to capture element refs, then use type for text fields, select_option for dropdowns, set_checked for checkboxes and radios, and submit or type_submit to send the form. Prefer ref-based actions over coordinates for reliability.

How do I automate file uploads in a browser form?

Use the upload_file action with the target input's ref, but verify the file path exists on disk before calling it. Never guess file paths, since a nonexistent path will cause the upload step to fail.

When should I use coordinates instead of element refs in browser automation?

Use coordinates only when no stable ref exists or the UI is intentionally canvas-like. Ref-based actions are more resilient to layout changes and should always be attempted first.

How do I verify a browser form submission succeeded?

Check the result with browser:content or browser:state after submitting, or take an explicit browser:screenshot and load it with vision_load. Screenshots are not automatically added to model-visible history, so vision_load is required for visual confirmation.

Can browser automation handle contenteditable fields and validation errors?

Yes, contenteditable fields are supported through the standard typing actions after capturing refs with browser:detail. For validation states or hidden UI, use browser:screenshot with vision_load to inspect what the DOM does not expose.