Control Your Computer with AI
MCP server that enables Claude AI models to control your computer, similar to Anthropic's computer use API, using nut.js for desktop automation.
Maintainer of this project? Claim this page to edit the listing.
1.8.0Add to Favorites
Why it matters
Grant an AI model like Claude full control over your computer to automate desktop tasks and execute complex workflows. This connector enables AI-driven interaction with your operating system, including screen capture, mouse clicks, and keyboard input.
Outcomes
What it gets done
Automate desktop tasks using AI-driven mouse and keyboard control.
Capture screenshots for visual analysis and decision-making.
Integrate with Rango for enhanced website navigation and automation.
Execute AI-defined workflows directly on your computer.
Install
Add it to your toolbox
Run in your project directory:
curl -fsSL https://spark.entire.vc/get/vb-computer-use-mcp | bash Capabilities
Tools your agent gets
Capture a screenshot of the current screen for visual analysis.
Perform a mouse click at specified coordinates on the screen.
Move the cursor to specified coordinates on the screen.
Send keyboard input and execute keyboard shortcuts.
Overview
computer-use-mcp MCP Server
A Model Context Protocol server that enables Claude to control your local computer using nut.js, implementing functionality similar to Anthropic's computer use guide. Use when you need Claude to automate desktop tasks locally. Do NOT use without sandboxing - models make frequent mistakes and are vulnerable to prompt injections, which could cause significant damage when given complete computer control.
What it does
computer-use-mcp is a Model Context Protocol server for Claude to control your computer. It implements a near-identical computer use tool to Anthropic's official computer use guide. The server uses nut.js to communicate with your operating system.
When to use - and when NOT to
Use this MCP server when you need Claude to automate desktop tasks, such as changing desktop backgrounds or interacting with local applications.
When NOT to use: Do not use this in production environments or on computers with sensitive data without sandboxing. At time of writing, models make frequent mistakes and are vulnerable to prompt injections. Since this MCP server gives the model complete control of your computer, this could do a lot of damage. You should treat this like giving a hyperactive toddler access to your computer - supervise it closely and consider only doing this in a sandboxed user account.
Inputs and outputs
You provide natural language instructions to Claude through your MCP client. Claude can then control your computer through the server.
Installation
Follow the instructions on install-mcp to generate the right config for your MCP client. The basic installation uses:
npx -y computer-use-mcp
For development, clone the repository and run:
npm install
Integrations
MCP Clients: Works with Claude Code, Claude Desktop, Cursor, Cline, VS Code, and other Model Context Protocol clients.
nut.js: The server communicates with your computer through the nut.js library for cross-platform desktop automation.
Rango browser extension: Installing and enabling the Rango browser extension (available in Chrome Web Store) enables keyboard navigation for websites, which is far more reliable than Claude trying to click coordinates. You can increase the font size setting in Rango to make navigation hints more visible.
displayoverride-mac: On macOS, this tool helps set smaller resolutions like 720p for better computer use performance.
Who it's for
This server is for users who want to use Claude to control their computer locally. The source recommends using models good at computer use, particularly the latest Claude models. This runs on your local machine and is described as easy to set up and use locally. Users should supervise it closely and consider only doing this in a sandboxed user account.
Source README
computer-use-mcp
๐ป A Model Context Protocol server for Claude to control your computer. This is very similar to computer use, but easy to set up and use locally.
Here's Claude Haiku 4.5 changing my desktop background (4x speed):
https://github.com/user-attachments/assets/cd0bc190-52c4-49db-b3bc-4b8a74544789
Installation
Follow the instructions on install-mcp, which generates the right config for your MCP client (Claude Code, Claude Desktop, Cursor, Cline, VS Code, and more).
Tips
This should just work out of the box.
However, to get best results:
- Use a model good at computer use - I recommend the latest Claude models.
- Use a small, common resolution - 720p works particularly well. On macOS, you can use displayoverride-mac to do this. If you can't use a different resolution, try zooming in to active windows.
- Install and enable the Rango browser extension. This enables keyboard navigation for websites, which is far more reliable than Claude trying to click coordinates. You can bump up the font size setting in Rango to make the hints more visible.
How it works
We implement a near identical computer use tool to Anthropic's official computer use guide, with some more nudging to prefer keyboard shortcuts.
This talks to your computer using nut.js
Releases
Versions follow the semantic versioning spec.
To release:
- Use
npm version <major | minor | patch>to bump the version - Run
git push --follow-tagsto push with tags - Wait for GitHub Actions to publish to the NPM registry.
FAQ
Common questions
Discussion
Questions & comments ยท 0
Sign In Sign in to leave a comment.