An MCP server that provides a natural language interface for managing Kafka operations, enabling AI agents to interact with Kafka clusters for publishing and consuming messages, as well as managing topics, brokers, and partitions.

Installation

From source code

python3 -m venv .venv
source .venv/bin/activate  # On macOS/Linux
.venv\Scripts\activate     # On Windows
pip install -r requirements.txt
# Or using uv
uv pip install -r requirements.txt

Configuration

Claude Desktop

{
  "mcpServers": {
    "kafka-mcp": {
      "command": "python3",
      "args": ["/Users/I528600/Desktop/mcp/kafka-mcp/src/main.py"],
      "env": {
        "BOOTSTRAP_SERVERS": "localhost:9092",
        "MCP_TRANSPORT": "stdio"
      }
    }
  }
}

Available Tools

Tool	Description
consumer	Consume messages from Kafka topics
producer	Publish messages to Kafka topics
topic	List, create, delete, and describe topics in Kafka
broker	Get broker information
partition	Get partitions and partition offsets
group_offset	Get and reset offsets in Kafka

Features

• Natural language queries: Allows AI agents to query and update Kafka using natural language
• Seamless MCP integration: Works with any MCP client for smooth communication
• Full Kafka support: Handles producers, consumers, topics, brokers, partitions, and offsets
• Scalability and lightweight: Designed for high-performance data operations

Environment Variables

Required

• BOOTSTRAP_SERVERS - URL of your Kafka server
• MCP_TRANSPORT - Transport protocol for MCP communication

Usage Examples

Publish message 'i am using kafka server' on the topic 'test-kafka'

Consume the message from topic 'test-kafka'

List all topics from the kafka environment

List all topics in the kafka cluster

Create topic 'my-kafka' in kafka cluster

Notes

Run the server using 'python3 src/main.py' or 'uv run python3 src/main.py'. The server requires a running Kafka cluster and proper bootstrap server configuration.