harmonyos-device-automation - Automate HarmonyOS devices through visual interaction
Automates HarmonyOS NEXT devices from screenshots using Midscene and HDC, including app launches, UI actions, text input, screenshots, and assertions.
Tags
Updated: 2026-10-03Capabilities
Typical Inputs
Typical Outputs
What this skill does
- Connect HarmonyOS devices
- Launch apps and URLs
- Run HDC shell commands
- Capture device screenshots
- Perform visual UI actions
- Assert visible screen states
- Record transient UI states
Inputs
- Connected HarmonyOS device
- Natural-language task
- Device identifier
- Reference images
Outputs
- Device UI state changes
- Screenshot image files
- Command results
- Assertion results
- Recording manifest files
Requirements
- Bash shell access
- Node.js and npx
- HDC installation
- HDC device access
- Configured visual model
- Model environment variables