driving-ios-simulator

Control booted iOS Simulator UI via idb_companion and xcrun simctl.

1|Updated Jul 22, 2026
One-click install
npx skills add https://github.com/wyattjoh/skills --skill driving-ios-simulator
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: driving-ios-simulator
Source: https://github.com/wyattjoh/skills/tree/main/skills/driving-ios-simulator
Command: npx skills add https://github.com/wyattjoh/skills --skill driving-ios-simulator

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires idb-companion, fb-idb, and includes scripts (resource) components.

What problem does it solve?

This skill solves the challenge of automating UI interactions on a booted iOS Simulator, specifically addressing the common failure where HID actions like tapping or swiping silently fail due to missing framework dependencies.

Core Features & Use Cases

  • Programmatic UI Control: Perform taps, swipes, text entry, and hardware button presses (Home, Lock, etc.) via the command line.
  • Accessibility Tree Inspection: Query the UI hierarchy to retrieve precise coordinates for elements, avoiding brittle coordinate guessing.
  • Environment Management: Automatically bootstraps the idb_companion with the correct Xcode environment to ensure HID interactions function reliably.

Quick Start

Use the driving-ios-simulator skill to identify the center coordinates of the login button and perform a tap action on the booted simulator.

Frequently Asked Questions about driving-ios-simulator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
Why do my programmatic taps and swipes silently fail on the iOS Simulator?▼

iOS Simulator UI automation taps and swipes often silently fail when HID interactions are attempted without the correct Xcode environment and idb_companion framework dependencies properly bootstrapped. This skill resolves the issue by automatically configuring the environment to ensure reliable HID interaction execution.

How do I find exact coordinates for UI elements during iOS Simulator testing?▼

To find exact coordinates for iOS Simulator UI testing, you can inspect the accessibility tree to query the UI hierarchy. This skill bridges idb_companion and xcrun simctl to retrieve precise element coordinates, avoiding brittle coordinate guessing during test automation.

Do I need idb-companion and Xcode command-line tools installed for iOS Simulator UI automation?▼

Yes, you need both idb-companion and Xcode command-line tools installed to perform iOS Simulator UI automation. This skill requires a properly configured environment to bridge idb_companion with xcrun simctl for programmatic control and hardware simulation.

Can I simulate hardware button presses like Home and Lock on a booted iOS Simulator?▼

You can simulate hardware button presses like Home and Lock on a booted iOS Simulator using command line UI automation. This skill facilitates programmatic control over hardware simulation, text entry, taps, and swipes via idb_companion and xcrun simctl integration.

What is the best way to automate UI interactions on a booted iOS Simulator?▼

The best way to automate UI interactions on a booted iOS Simulator is by bridging idb_companion and xcrun simctl. This approach enables programmatic control over accessibility tree inspection, coordinate-based interaction, and hardware simulation for complex testing workflows.

How does idb work with xcrun simctl for complex iOS testing workflows?▼

idb works with xcrun simctl by bridging the two frameworks to provide programmatic control over a booted iOS Simulator. This integration enables complex testing workflows including element discovery, coordinate-based interaction, and hardware simulation without silent HID failures.