doc-to-skill-scraper

What problem does it solve?

This meta-skill automates the tedious and time-consuming process of manually converting external documentation (like API references or library docs) into structured Claude Agent Skills. It rapidly integrates new knowledge and capabilities into your AI, saving countless hours of manual parsing and formatting.

Core Features & Use Cases

• Automated Documentation Scraping: Parses HTML/Markdown documentation from URLs, extracting titles, sections, and code examples.
• Skill Generation: Automatically generates SKILL.md files with proper YAML frontmatter (name, description) and structured instructions based on the scraped content.
• Knowledge Integration: Quickly builds domain-specific skills from third-party knowledge sources, making external APIs and libraries immediately usable by your AI.
• Use Case: You need to integrate the Stripe API into your project. Instead of manually writing a skill, you provide the Stripe API documentation URL. This skill scrapes the docs, extracts key methods and examples, and generates a stripe-payment-intents skill, ready to process payments.

Quick Start

1. Scrape documentation from a URL

(Assumes scrape_docs.py is a script using the skill's logic)

python scrape_docs.py https://stripe.com/docs/api/payment_intents

2. Generate SKILL.md from the scraped data

(Assumes generate_skill.py is a script using the skill's logic)

python generate_skill.py scraped_data.json