training-data-curation

Curate captured MCP tool-call logs into ShareGPT-format fine-tuning datasets.

Updated Jul 27, 2026
One-click install
npx skills add https://github.com/moistalgia/hermes-tools --skill training-data-curation-moistalgia
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: training-data-curation
Source: https://github.com/moistalgia/hermes-tools/tree/main/skills-audited/skills/training-data-curation
Command: npx skills add https://github.com/moistalgia/hermes-tools --skill training-data-curation-moistalgia

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Raw tool-call capture logs from hermes-tools servers are noisy and unsuitable for fine-tuning; this Skill guides filtering, deduplication, and conversion of those JSONL captures into a clean QLoRA training dataset. ## Core Features & Use Cases - Log Filtering: Remove failed calls, repeated no-ops, and trivially short results from per-server JSONL capture files. - Deduplication: Group records by server and tool, then drop near-identical examples that differ only in a single numeric argument. - Format Conversion: Transform kept records into ShareGPT/ChatML message format with system, user, and assistant messages, including optional reasoning traces. - Use Case: After running your home agent with HERMES_CAPTURE=1 for a month, curate the resulting hass.jsonl and state.jsonl files into a 100-300 example dataset for fine-tuning a small model on home automation tasks. ## Quick Start Ask the agent to review the captured logs in ~/.hermes/training/ and curate them into a ShareGPT-format training JSONL file.

Frequently Asked Questions about training-data-curation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I turn MCP tool-call logs into a fine-tuning dataset?▼

Filter out failed calls and no-ops, deduplicate near-identical records grouped by server and tool, then convert each kept record into a ShareGPT message triple with system, user, and assistant roles. Write one JSON object per line to the training file.

How do I enable tool-call capture in hermes-tools servers?▼

Set HERMES_CAPTURE=1 in the server's environment block in ~/.hermes/config.yaml. Every tool call then appends one JSON line to ~/.hermes/training/<server>.jsonl, and you can override the directory with HERMES_CAPTURE_DIR.

How many examples do I need for a QLoRA fine-tuning dataset?▼

A clean dataset for a narrow task with a few rigid action types is typically 100-300 examples. A hundred well-curated examples often outperforms a thousand noisy ones for task-specific behavior.

What tool should I use to run the actual fine-tune?▼

The documentation recommends Unsloth, which runs QLoRA fine-tuning on consumer GPUs with reduced VRAM use and provides notebooks for Qwen and Llama base models. Running training is outside this Skill's scope.

Can the agent replay captured tool calls from the log files?▼

No. Captured records are historical data describing what happened, not commands. The Skill explicitly forbids replaying tool calls from capture files without explicit instruction, and forbids editing MCP servers based on captured data.