MCP

Analyze ClearML Experiments with AI Assistants

MCP server that connects AI assistants to ClearML for querying ML experiments, comparing metrics, retrieving artifacts, and analyzing training runs across

Works with clearml

90
Spark score
out of 100
Updated 4 months ago
Version 1.0.0
Models

Add to Favorites

Why it matters

Empower AI assistants to deeply understand and analyze your ClearML experiments, models, and projects. Gain comprehensive context for ML development and performance evaluation.

Outcomes

What it gets done

01

Retrieve detailed information about ClearML tasks, parameters, and metrics.

02

Search and filter experiments, models, and projects based on various criteria.

03

Compare performance metrics across different tasks and models.

04

Access and manage experiment artifacts and model files.

Install

Add it to your toolbox

Run in your project directory:

curl -fsSL https://spark.entire.vc/get/vb-clearml-mcp | bash

Capabilities

Tools your agent gets

get_task_info

Get detailed task information, parameters, and status

list_tasks

List tasks with advanced filtering by project, status, tags, and user

get_task_parameters

Get hyperparameters and configuration for a task

get_task_metrics

Access training metrics, scalars, and plots for a task

get_task_artifacts

Get artifacts, model files, and outputs from a task

get_model_info

Get model metadata and configuration details

list_models

View available models with filtering options

get_model_artifacts

Access model files and download URLs

+6 tools

Overview

ClearML MCP Server

What it does

A Model Context Protocol server that enables AI assistants to interact with ClearML experiments, models, and projects for ML experiment context analysis.

How it connects

Use when you need AI assistants to query ClearML experiment data, compare model metrics, retrieve artifacts, search tasks by tags or status, or analyze training progress without manually navigating the ClearML dashboard.

Source README

A lightweight Model Context Protocol (MCP) server that enables AI assistants to interact with ClearML experiments, models, and projects for comprehensive ML experiment context analysis.

Installation

PyPI

pip install clearml-mcp

uvx (no installation)

uvx clearml-mcp

From source

git clone https://github.com/prassanna-ravishankar/clearml-mcp.git
cd clearml-mcp
uv sync
uv run python -m clearml_mcp.clearml_mcp

Configuration

Claude Desktop

{
  "mcpServers": {
    "clearml": {
      "command": "uvx",
      "args": ["clearml-mcp"]
    }
  }
}

Cursor

{
  "mcp.servers": {
    "clearml": {
      "command": "uvx",
      "args": ["clearml-mcp"]
    }
  }
}

Continue

{
  "mcpServers": {
    "clearml": {
      "command": "uvx",
      "args": ["clearml-mcp"]
    }
  }
}

Cody

{
  "cody.experimental.mcp": {
    "servers": {
      "clearml": {
        "command": "uvx",
        "args": ["clearml-mcp"]
      }
    }
  }
}

Available Tools

Tool Description
get_task_info Get detailed task information, parameters, and status
list_tasks List tasks with advanced filtering (project, status, tags, user)
get_task_parameters Get hyperparameters and configuration
get_task_metrics Access training metrics, scalars, and plots
get_task_artifacts Get artifacts, model files, and outputs
get_model_info Get model metadata and configuration details
list_models View available models with filtering
get_model_artifacts Access model files and download URLs
list_projects Discover available ClearML projects
get_project_stats Get project statistics and task summary
find_project_by_pattern Find projects matching a name pattern
find_experiment_in_project Find specific experiments in projects
compare_tasks Compare multiple tasks by specific metrics
search_tasks Advanced search by name, tags, comments, and more

Features

  • Experiment Discovery: Search and analyze ML experiments in projects
  • Performance Analysis: Compare model metrics and training progress
  • Real-time Metrics: Access training scalars, validation curves, and convergence analysis
  • Smart Search: Filter tasks by name, tags, status, and custom queries
  • Artifact Management: Retrieve model files, datasets, and experiment results
  • Cross-platform: Works with all major AI assistants and code editors

Usage Examples

Show me the latest experiments in the 'computer-vision' project
Compare accuracy metrics between tasks task-123 and task-456
What are the hyperparameters of the best-performing model?
Find all failed experiments from last week
Get the training curves for my latest BERT fine-tuning

Notes

Requires a ClearML account with valid API credentials in ~/.clearml/clearml.conf. Provides 14 comprehensive tools for ML experiment analysis. Compatible with Zed Editor, OpenHands, Roo-Cline, and any MCP-enabled applications.

Discussion

Questions & comments · 0

Sign In Sign in to leave a comment.