find-widget

What problem does it solve?

This Skill helps locate a clickable widget in the game UI by text or name using Haiku, without flooding the main context with every widget.

Core Features & Use Cases

• Scan all visible widgets with scan_widgets() to gather IDs, text, names, bounds, and actions.
• Filter results by matching the user’s query against the text or name fields and by actions (e.g., Cook, Bank, Talk-to).
• Return compact results including widget_id, text/name, actions, and bounds, plus guidance for initiating a CLICK_WIDGET command.
• Use case: locate a specific widget like "Raw shrimps" with the Cook action and obtain its widget_id and bounds to click.

Quick Start

Use the find-widget skill to locate a UI element by text or name and then click it using the widget_id. Start by scanning widgets with scan_widgets(), apply a text/name search, optionally filter by actions, and finally issue CLICK_WIDGET with the found widget_id.