What problem does it solve?
This Skill helps locate a clickable widget in the game UI by text or name using Haiku, without flooding the main context with every widget.
Core Features & Use Cases
- Scan all visible widgets with scan_widgets() to gather IDs, text, names, bounds, and actions.
- Filter results by matching the user’s query against the text or name fields and by actions (e.g., Cook, Bank, Talk-to).
- Return compact results including widget_id, text/name, actions, and bounds, plus guidance for initiating a CLICK_WIDGET command.
- Use case: locate a specific widget like "Raw shrimps" with the Cook action and obtain its widget_id and bounds to click.
Quick Start
Use the find-widget skill to locate a UI element by text or name and then click it using the widget_id. Start by scanning widgets with scan_widgets(), apply a text/name search, optionally filter by actions, and finally issue CLICK_WIDGET with the found widget_id.