What problem does it solve? Some macOS applications — emulators, games, OpenGL canvases, and custom-rendered Electron apps — expose little or nothing through the Accessibility tree, making standard UI automation impossible. This Skill lets an assistant control such apps directly with raw keyboard, mouse, and screenshot input. ## Core Features & Use Cases - Raw Input Control: Send key presses, key combos, ordered key sequences, typed text, clicks, and drags to a specific named app identified by bundle ID or process name. - Screen Observation: Capture window state and screenshots with a configurable settle delay so slow-feedback apps like emulators render a fresh frame before capture. - Session Management: Start a control session targeting one app and cleanly stop it when finished without quitting the controlled app. - Use Case: You need to navigate menus in a game emulator that renders its own UI. Observe the screen, send an ordered sequence of arrow keys and return presses in a single round-trip, and re-observe to confirm the result. ## Quick Start Use app control to open the emulator with bundle ID com.example.emulator, take a screenshot, then press the right arrow key three times and press return.
