mcp-builder

Guides creation of MCP servers in Python or TypeScript with evaluation tooling.

Updated Feb 4, 2026
One-click install
npx skills add https://github.com/pchemguy/AISandbox --skill mcp-builder-pchemguy
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: mcp-builder
Source: https://github.com/pchemguy/AISandbox/tree/main/docs/AgentSkills/anthropics/skills/skills/mcp-builder
Command: npx skills add https://github.com/pchemguy/AISandbox --skill mcp-builder-pchemguy

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires anthropic, mcp, and includes scripts (resource) and references (resource) components.

What problem does it solve? Building Model Context Protocol servers that LLMs can actually use effectively requires deep knowledge of the MCP specification, SDK patterns, tool design, and evaluation—this Skill provides a structured four-phase workflow covering research, implementation, review, and evaluation. ## Core Features & Use Cases - End-to-End MCP Development Workflow: Walks through research and planning, implementation, code review, and evaluation phases for building MCP servers in Python (FastMCP) or TypeScript (MCP SDK). - Language-Specific Reference Guides: Includes detailed implementation guides for TypeScript (Zod schemas, registerTool patterns, transports) and Python, plus MCP best practices covering naming, pagination, security, and error handling. - Evaluation Harness: Ships Python scripts to create XML-based evaluation question sets and run them against MCP servers over stdio, SSE, or streamable HTTP, producing accuracy reports with per-task tool-call metrics. - Use Case: You need to expose a company's internal API to Claude. Use this Skill to design well-named tools with proper schemas and annotations, implement the server, then generate 10 complex read-only evaluation questions and measure how accurately an LLM answers them using only your tools. ## Quick Start Help me build an MCP server for the GitHub API in TypeScript following the mcp-builder workflow, then create and run an evaluation for it.

Frequently Asked Questions about mcp-builder

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build an MCP server in TypeScript?▼

Use the MCP TypeScript SDK's McpServer class and registerTool method with Zod schemas for input validation. Follow the naming convention {service}-mcp-server, provide title, description, inputSchema, and annotations for each tool, then build with tsc and test using the MCP Inspector.

How do I test whether my MCP server works well with LLMs?▼

Create an XML evaluation file with 10 complex, read-only questions that have single verifiable answers, then run the evaluation.py script against your server. It connects via stdio, SSE, or HTTP, runs each question through Claude with your tools, and reports accuracy plus per-task tool-call metrics.

Should I use Python FastMCP or the TypeScript SDK for MCP servers?▼

TypeScript is recommended for its high-quality SDK support, static typing, and strong linting tools, though Python with FastMCP is fully supported. Both follow the same design principles: comprehensive API coverage, clear tool naming, and actionable error messages.

What transport should an MCP server use, stdio or HTTP?▼

Use stdio for local integrations and command-line tools where the server runs as a subprocess. Use streamable HTTP for remote servers serving multiple clients; SSE is deprecated in favor of streamable HTTP.

What makes a good MCP evaluation question?▼

Good questions are independent, read-only, complex enough to require multiple tool calls, and have a single stable answer verifiable by string comparison. Avoid questions about current state that changes over time, simple keyword lookups, or answers that are lists in arbitrary order.