ScientiaCapital/unsloth-mcp-server

MCP server for LLM fine-tuning with Unsloth. 33 tools, 180 tests, RunPod GPU integration. Fine-tune 2x faster with 80% less memory.

2

stars

35

commits

TypeScript

primary language

Mar 14, 2026

updated

claude
llm-finetuning
mcp
runpod
typescript
unsloth

README

Unsloth MCP Server

33 MCP tools for LLM fine-tuning via Claude. 180 tests passing. Integrates Unsloth (2x faster, 80% less memory) with RunPod GPU management.


What It Does

  • 33 MCP tools for model fine-tuning, tokenizer training, GPU management
  • RunPod integration - create, start, stop pods programmatically
  • Knowledge capture pipeline - OCR, AI enhancement, training data generation
  • Checkpoint management - save/load/resume training sessions
  • Cost tracking - budgets, alerts, expense reporting

Goals

Enable Claude to orchestrate LLM fine-tuning workflows without manual Python scripting.

Quick Start

cd unsloth-mcp-server
npm install && npm run build
npm test  # 180 tests passing

Add to Claude Code MCP settings:

{
  "mcpServers": {
    "unsloth-server": {
      "command": "node",
      "args": ["/path/to/build/index.js"]
    }
  }
}

Current Status

ComponentStatus
MCP tools (33)Working
Test suite (180)Passing
RunPod pod managementWorking
Knowledge captureWorking
Checkpoint managementWorking
GRPO trainingDtype compatibility issues
SFT trainingEnvironment-dependent

Known Issues

  • GRPO: Dtype mismatches in some configurations
  • Requires Python 3.10-3.12 (not 3.13)
  • GPU required for fine-tuning

GTME Skills Developed

Building toward Go-To-Market Engineer through hands-on projects:

Skill AreaWhat I Learned
Developer toolingBuilt MCP server that developers actually use - learned API design for DX
Cost optimizationImplemented budget tracking, alerts - understand unit economics of GPU compute
Infrastructure automationRunPod API integration - programmatic cloud GPU provisioning
Testing discipline180 tests with Jest - shipping quality that earns trust
Technical documentationWriting docs that reduce support burden
Product iterationv2.0 → v2.3.0 based on real usage feedback

Tech Stack

Node.js/TypeScript, MCP SDK, Python/Unsloth, Jest, RunPod API

Requirements

  • Node.js 18+
  • Python 3.10-3.12
  • NVIDIA GPU with CUDA (for training)

Contributors

ScientiaCapital

22 commits

claude

11 commits

OtotaO

2 commits

ScientiaCapital/unsloth-mcp-server

MCP server for LLM fine-tuning with Unsloth. 33 tools, 180 tests, RunPod GPU integration. Fine-tune 2x faster with 80% less memory.

2

stars

35

commits

TypeScript

primary language

Mar 14, 2026

updated

claude
llm-finetuning
mcp
runpod
typescript
unsloth

README

Unsloth MCP Server

33 MCP tools for LLM fine-tuning via Claude. 180 tests passing. Integrates Unsloth (2x faster, 80% less memory) with RunPod GPU management.


What It Does

  • 33 MCP tools for model fine-tuning, tokenizer training, GPU management
  • RunPod integration - create, start, stop pods programmatically
  • Knowledge capture pipeline - OCR, AI enhancement, training data generation
  • Checkpoint management - save/load/resume training sessions
  • Cost tracking - budgets, alerts, expense reporting

Goals

Enable Claude to orchestrate LLM fine-tuning workflows without manual Python scripting.

Quick Start

cd unsloth-mcp-server
npm install && npm run build
npm test  # 180 tests passing

Add to Claude Code MCP settings:

{
  "mcpServers": {
    "unsloth-server": {
      "command": "node",
      "args": ["/path/to/build/index.js"]
    }
  }
}

Current Status

ComponentStatus
MCP tools (33)Working
Test suite (180)Passing
RunPod pod managementWorking
Knowledge captureWorking
Checkpoint managementWorking
GRPO trainingDtype compatibility issues
SFT trainingEnvironment-dependent

Known Issues

  • GRPO: Dtype mismatches in some configurations
  • Requires Python 3.10-3.12 (not 3.13)
  • GPU required for fine-tuning

GTME Skills Developed

Building toward Go-To-Market Engineer through hands-on projects:

Skill AreaWhat I Learned
Developer toolingBuilt MCP server that developers actually use - learned API design for DX
Cost optimizationImplemented budget tracking, alerts - understand unit economics of GPU compute
Infrastructure automationRunPod API integration - programmatic cloud GPU provisioning
Testing discipline180 tests with Jest - shipping quality that earns trust
Technical documentationWriting docs that reduce support burden
Product iterationv2.0 → v2.3.0 based on real usage feedback

Tech Stack

Node.js/TypeScript, MCP SDK, Python/Unsloth, Jest, RunPod API

Requirements

  • Node.js 18+
  • Python 3.10-3.12
  • NVIDIA GPU with CUDA (for training)

Contributors

ScientiaCapital

22 commits

claude

11 commits

OtotaO

2 commits

Languages

TypeScript

59.1%

JavaScript

24.2%

HTML

7.9%

Python

7.8%