MCP Connector

Control Your Computer with AI

MCP server that enables Claude AI models to control your computer, similar to Anthropic's computer use API, using nut.js for desktop automation.

Works with github

Maintainer of this project? Claim this page to edit the listing.


91
Spark score
out of 100
Updated 29 days ago
Version 1.8.0
Models

Add to Favorites

Why it matters

Grant an AI model like Claude full control over your computer to automate desktop tasks and execute complex workflows. This connector enables AI-driven interaction with your operating system, including screen capture, mouse clicks, and keyboard input.

Outcomes

What it gets done

01

Automate desktop tasks using AI-driven mouse and keyboard control.

02

Capture screenshots for visual analysis and decision-making.

03

Integrate with Rango for enhanced website navigation and automation.

04

Execute AI-defined workflows directly on your computer.

Install

Add it to your toolbox

Run in your project directory:

curl -fsSL https://spark.entire.vc/get/vb-computer-use-mcp | bash

Capabilities

Tools your agent gets

screenshot

Capture a screenshot of the current screen for visual analysis.

mouse_click

Perform a mouse click at specified coordinates on the screen.

mouse_move

Move the cursor to specified coordinates on the screen.

keyboard_input

Send keyboard input and execute keyboard shortcuts.

Overview

computer-use-mcp MCP Server

A Model Context Protocol server that enables Claude to control your local computer using nut.js, implementing functionality similar to Anthropic's computer use guide. Use when you need Claude to automate desktop tasks locally. Do NOT use without sandboxing - models make frequent mistakes and are vulnerable to prompt injections, which could cause significant damage when given complete computer control.

What it does

computer-use-mcp is a Model Context Protocol server for Claude to control your computer. It implements a near-identical computer use tool to Anthropic's official computer use guide. The server uses nut.js to communicate with your operating system.

When to use - and when NOT to

Use this MCP server when you need Claude to automate desktop tasks, such as changing desktop backgrounds or interacting with local applications.

When NOT to use: Do not use this in production environments or on computers with sensitive data without sandboxing. At time of writing, models make frequent mistakes and are vulnerable to prompt injections. Since this MCP server gives the model complete control of your computer, this could do a lot of damage. You should treat this like giving a hyperactive toddler access to your computer - supervise it closely and consider only doing this in a sandboxed user account.

Inputs and outputs

You provide natural language instructions to Claude through your MCP client. Claude can then control your computer through the server.

Installation

Follow the instructions on install-mcp to generate the right config for your MCP client. The basic installation uses:

npx -y computer-use-mcp

For development, clone the repository and run:

npm install

Integrations

MCP Clients: Works with Claude Code, Claude Desktop, Cursor, Cline, VS Code, and other Model Context Protocol clients.

nut.js: The server communicates with your computer through the nut.js library for cross-platform desktop automation.

Rango browser extension: Installing and enabling the Rango browser extension (available in Chrome Web Store) enables keyboard navigation for websites, which is far more reliable than Claude trying to click coordinates. You can increase the font size setting in Rango to make navigation hints more visible.

displayoverride-mac: On macOS, this tool helps set smaller resolutions like 720p for better computer use performance.

Who it's for

This server is for users who want to use Claude to control their computer locally. The source recommends using models good at computer use, particularly the latest Claude models. This runs on your local machine and is described as easy to set up and use locally. Users should supervise it closely and consider only doing this in a sandboxed user account.

Source README

computer-use-mcp

๐Ÿ’ป A Model Context Protocol server for Claude to control your computer. This is very similar to computer use, but easy to set up and use locally.

Here's Claude Haiku 4.5 changing my desktop background (4x speed):

https://github.com/user-attachments/assets/cd0bc190-52c4-49db-b3bc-4b8a74544789

Installation

Follow the instructions on install-mcp, which generates the right config for your MCP client (Claude Code, Claude Desktop, Cursor, Cline, VS Code, and more).

Tips

This should just work out of the box.

However, to get best results:

  • Use a model good at computer use - I recommend the latest Claude models.
  • Use a small, common resolution - 720p works particularly well. On macOS, you can use displayoverride-mac to do this. If you can't use a different resolution, try zooming in to active windows.
  • Install and enable the Rango browser extension. This enables keyboard navigation for websites, which is far more reliable than Claude trying to click coordinates. You can bump up the font size setting in Rango to make the hints more visible.

How it works

We implement a near identical computer use tool to Anthropic's official computer use guide, with some more nudging to prefer keyboard shortcuts.

This talks to your computer using nut.js

Releases

Versions follow the semantic versioning spec.

To release:

  1. Use npm version <major | minor | patch> to bump the version
  2. Run git push --follow-tags to push with tags
  3. Wait for GitHub Actions to publish to the NPM registry.

FAQ

Common questions

Discussion

Questions & comments ยท 0

Sign In Sign in to leave a comment.