ui-automator - Automate Android device UI via ADB and uiautomator
Automates Android UI interactions over ADB using uiautomator screen dumps and coordinate-based inputs.
Tags
Updated: 2026-09-17Capabilities
Typical Inputs
Typical Outputs
What this skill does
- Dump screen layout XML
- Parse UI XML screen nodes
- Locate element bounds and center
- Perform tap and swipe actions
- Send key events and text
- Verify foreground window state
Inputs
- ADB device serial number
- Target app package and activity
- UI search text or regex
- SSH tunnel parameters
Outputs
- Local UI XML dump files
- Parsed UI node bounds
- UI input touch events
- Pass and fail verdict counts
Requirements
- ADB tool
- Python 3 standard library
- Bash shell
- Android device or emulator reachable via ADB