Connect AI to Human Feedback
MCP server connecting AI agents to real human judgment via Rapidata - free text, image classification, ranking, comparison.
Maintainer of this project? Claim this page to edit the listing.
1.0.0Add to Favorites
Why it matters
Integrate AI agents with human intelligence to gather feedback on text and image-based tasks, enabling AI to ask real people questions and receive actionable insights.
Outcomes
What it gets done
Request human feedback on text responses.
Facilitate human classification and ranking of images.
Enable human comparison of text outputs.
Connect AI agents to human evaluators via the Rapidata API.
Install
Add it to your toolbox
Run in your project directory:
curl -fsSL https://spark.entire.vc/get/vb-human-use | bash Capabilities
Tools your agent gets
Requests real people to provide short text answers to a question
Requests real people to classify images in a directory
Requests real people to rank images in a directory
Requests real people to compare two texts and choose which one is better
Overview
Human-in-the-Loop MCP Server
An MCP server (Rapidata) connecting AI agents to real human judgment - free-text answers, image classification/ranking, and text comparisons - via the Rapidata API. Use when an AI agent needs a genuine human judgment call on a subjective task like design, wording, naming, or ranking outputs.
What it does
Human Use is an MCP server (by Rapidata) that connects AI agents to real human intelligence via the Rapidata API - asking humans for free-text responses to a question, classifying or ranking a directory of images, or comparing two texts and picking which is better. A hosted version is also available at chat.rapidata.ai without setting up your own environment. Demonstrated use cases include coming up with a car design, finding the best slogan, naming a function, and ranking different image-generation models against each other.
When to use - and when NOT to
Use it when an AI agent needs a genuine human judgment call on a subjective question, rather than guessing at an answer itself. For agents running inside Cursor, or if Claude Desktop is your MCP client, the project's own custom Streamlit app is the recommended way to use the server, since Claude Desktop had client-side issues with other MCP clients. GitHub stars, documentation, and a Twitter/X account are also linked from the project for anyone wanting to follow its development.
Capabilities
Four tools: get_free_text_responses (ask humans for short free-text answers to a question - useful for open-ended feedback like naming or slogan ideas), get_human_image_classification (ask humans to classify every image in a given directory), get_human_image_ranking (ask humans to rank the images in a directory against each other, useful for comparing outputs from different image-generation models), and get_human_text_comparison (ask humans to compare two pieces of text and select which one is better).
How to install
For Cursor, add to ~/.cursor/mcp.json:
{
"mcpServers": {
"human-use": {
"command": "uv",
"args": [
"--directory",
"YOUR_ABSOLUTE_PATH_HERE",
"run",
"rapidata_human_api.py"
]
}
}
}
For the Streamlit app: clone the repository (git clone https://github.com/RapidataAI/human-use.git), install uv if needed (curl -LsSf https://astral.sh/uv/install.sh | sh on macOS/Linux, or the PowerShell equivalent on Windows), copy .env.example to .env with your own credentials/settings (using absolute paths), create/activate a virtual environment (uv venv), install dependencies (uv sync), then run streamlit run app.py. If streamlit/python paths mismatch, run python -m streamlit run app.py instead; if uv isn't found, close all terminals/editors and reopen before retrying.
Who it's for
Developers building AI agents that need real human judgment on subjective tasks - design choices, slogans, naming, or ranking model outputs - rather than relying purely on the model's own guess. Questions or setup help can be directed to the Rapidata team directly by email, and full documentation is maintained separately at docs.rapidata.ai.
Source README
Human Use ๐ค Enable AI to ask anyone anything
๐ค Human Use is the easiest way to connect your AI agents with human intelligence via the Rapidata API.
Hosted Version
We now offer a hosted version of Human Use at chat.rapidata.ai - access all the features without setting up your own environment!
Human Use in Action
Coming up with a cool car design
https://github.com/user-attachments/assets/0d4c5c8f-4177-4fcf-8028-800dab16b009
Finding the best slogan
Function Naming
Ranking different image generation models.
MCP Server
Overview
The MCP server is a tool that allows you to connect your AI agents with human intelligence via the Rapidata API.
Tools
- get_free_text_responses
- Will ask actual humans to provide some short free text responses to the question.
- get_human_image_classification
- Will ask actual humans to classify the images in the directory.
- get_human_image_ranking
- Will ask actual humans to rank the images in the directory.
- get_human_text_comparison
- Will ask actual humans to compare two texts and select which one is better.
Configuration
Cursor
add the following to your cursor mcp.json file (usually in ~/.cursor/mcp.json)
{
"mcpServers": {
"human-use": {
"command": "uv",
"args": [
"--directory",
"YOUR_ABSOLUTE_PATH_HERE",
"run",
"rapidata_human_api.py"
]
}
}
}
You should now be able to see the human-use server in Cursor settings.
App
Overview
The app is a custom Streamlit app that allows you to use the MCP server. We have built because of issues with other clients. Namely the Claude desktop app.
App Setup
Clone Repository
git clone https://github.com/RapidataAI/human-use.git
Environment Configuration
Copy the .env.example file to .env and fill it in with your own credentials/settings
Note: paths should be ABSOLUTE paths
Installation with UV
Prerequisites
Install uv if you haven't already:
# For MacOS/Linux
curl -LsSf https://astral.sh/uv/install.sh | sh
# For Windows
powershell -ExecutionPolicy ByPass -c "irm https://astral.sh/uv/install.ps1 | iex"
Setup Instructions (in the human-use repository)
- Create and activate a virtual environment:
uv venv # On Unix/macOS source .venv/bin/activate # On Windows .venv\Scripts\activate - Install dependencies:
uv sync
Run the application
streamlit run app.py
Troubleshooting
If you encounter issues, with the dependencies make sure that "which python" and "which streamlit" are the same path. If they are not the same path, run "python -m streamlit run app.py" instead of "streamlit run app.py".
If UV is not found, make sure you close all terminals and editors, then re-open a new one and try again.
FAQ
Common questions
Discussion
Questions & comments ยท 0
Sign In Sign in to leave a comment.