Summary
This gives Claude direct control over Ubuntu desktop applications through AT-SPI accessibility APIs with OCR fallback, letting you click buttons and interact with UI elements by their semantic labels instead of brittle pixel coordinates. The main use case is automating browser extensions and native desktop apps that Playwright can't reach, like MetaMask popups or Phantom wallet flows. It includes wait utilities with exponential backoff and click verification. Requires X11 and a handful of system packages (xdotool, tesseract, at-spi2-core), so you'll need to run the install script first. The semantic approach is more maintainable than screenshot-based automation, though you can still drop down to raw coordinates when needed.
Install to Claude Code
npx -y skills add lommaj/ubuntu-desktop-control --skill ubuntu-desktop-control --agent claude-codeInstalls into .claude/skills of the current project.
Keeps your Mac awake while Claude Code, Codex or Cursor works. Lets it sleep when they are done.
Try free for 7 days →
belt cli automatically finds the best tools and skills for your agent. image, video, music, tts...
one prompt install →
Free an open-source skills that make AI coding agents easier to understand, verify, and control.
Download for free →
Connect your Claude agent to live crypto prices and trading routes via 1inch
Get the MCP →
Block distracting apps from your iPhone permanently without a 3rd party app. Free and open source.
Block now (100% free) →Files
SKILL.md
Select a file.
Featured
Keeps your Mac awake while Claude Code, Codex or Cursor works. Lets it sleep when they are done.
Try free for 7 days →belt cli automatically finds the best tools and skills for your agent. image, video, music, tts...
one prompt install →Free an open-source skills that make AI coding agents easier to understand, verify, and control.
Download for free →Connect your Claude agent to live crypto prices and trading routes via 1inch
Get the MCP →Block distracting apps from your iPhone permanently without a 3rd party app. Free and open source.
Block now (100% free) →First SeenJun 3, 2026
