skills.rest
srgaba
srgabaCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

peekaboo

Capture and automate macOS UI interactions through the Peekaboo CLI.

Updated Mar 30, 2026
Search Tags:#accessibility#cli#macos#ui automation#screenshot#peekaboo#desktop automation
One-click install
npx skills add https://github.com/srgaba/open-claw --skill peekaboo-srgaba
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/srgaba/open-claw/tree/main/project/skills/peekaboo
Command: npx skills add https://github.com/srgaba/open-claw --skill peekaboo-srgaba

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Automating macOS desktop tasks normally requires manual clicking, typing, and screen inspection. This Skill gives an AI agent full control over the macOS UI through the Peekaboo CLI, enabling screen capture, element targeting, input simulation, and app/window management from the command line. ## Core Features & Use Cases - Screen Capture & Vision: Take screenshots of screens, windows, or menu bar regions, generate annotated UI maps with see, and optionally analyze captures with AI prompts. - UI Interaction: Click, type, drag, swipe, scroll, and press hotkeys by targeting elements via snapshot IDs, coordinates, or app/window identifiers. - System Management: Launch, quit, hide, and switch apps; manage windows, Spaces, Dock items, menus, menu bar extras, dialogs, and the clipboard. - Use Case: Automate a login flow by running peekaboo see --annotate to map the UI, then peekaboo click --on B3 and peekaboo type "user@example.com" to fill in credentials without manual input. ## Quick Start Ask the agent to run peekaboo permissions, then use peekaboo see with the annotate flag to capture the current screen and identify clickable elements before automating any clicks or typing.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate clicking and typing in macOS apps from the command line?▼

Use the Peekaboo CLI to automate macOS UI input. Run peekaboo see --annotate to generate an annotated UI map with element IDs, then use peekaboo click --on <id> and peekaboo type "text" targeting the app or window.

How do I capture a screenshot of a specific window on macOS?▼

Use peekaboo image with --app and --window-title to capture a specific window, or --mode screen with --screen-index for full displays. Add --retina for high resolution and --path to set the output file.

What permissions does Peekaboo need on macOS?▼

Peekaboo requires Screen Recording and Accessibility permissions to capture screens and control the UI. Run peekaboo permissions to check the current status of both before executing automation commands.

How do I install the Peekaboo CLI on macOS?▼

Install Peekaboo via Homebrew with the steipete/tap/peekaboo formula. After installation, verify the build with peekaboo --version and explore commands with peekaboo --help.

Why does peekaboo click fail to find my target element?▼

Clicks fail when the snapshot is stale or the element ID is wrong. Re-run peekaboo see --annotate to refresh the snapshot, then reference the new element ID, or target by coordinates with --coords x,y instead.

Can Peekaboo output structured data for scripts?▼

Yes, most Peekaboo commands support --json or -j flags for machine-readable output. This enables scripting workflows such as listing windows with peekaboo list windows --json and piping results into other tools.

Related Skills

Explore More Software Engineering Skills→
trpc-grouptrpc-group
1.8k

peekaboo

Capture and automate macOS UI interactions using the Peekaboo CLI.

Official
Intermediate
nguyenvanlinh1902nguyenvanlinh1902

chrome-devtools

Drive Puppeteer browser automation with persistent sessions and JSON outputs.

Community
Advanced
pplmxpplmx
2

desktop-e2e-testing

Generates Playwright end-to-end tests for Desktop Ethereal workflows and system events.

Community
Advanced
autonomy-cloudautonomy-cloud
2

macos-automation

Automate native macOS app interactions using AppleScript via osascript.

Official
Intermediate