skills.rest
CliffVale
CliffValeCOMMUNITY
Explore all skills by this author →
GitHub

firecrawl-knowledge-ingest

Extracts structured markdown and JSON content from documentation portals using Firecrawl browser navigation.

1|Updated Aug 24, 2026
Search Tags:#documentation#browser automation#firecrawl#knowledge base#json#web scraping#markdown extraction
One-click install
npx skills add https://github.com/CliffVale/opencode-free-setup --skill firecrawl-knowledge-ingest-cliffvale
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: firecrawl-knowledge-ingest
Source: https://github.com/CliffVale/opencode-free-setup/tree/main/skills/firecrawl-knowledge-ingest
Command: npx skills add https://github.com/CliffVale/opencode-free-setup --skill firecrawl-knowledge-ingest-cliffvale

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Scraping modern documentation portals is hard when content sits behind JavaScript rendering, login walls, pagination, or dynamic navigation. This Skill uses the Firecrawl browser to ingest those knowledge bases and convert them into clean, structured markdown or JSON. ## Core Features & Use Cases - Browser-Based Navigation: Opens portals, follows sidebar links, pagination, load-more controls, and search to reach every article. - Auth-Gated and JS-Heavy Support: Handles login-required portals and JavaScript-rendered docs that simple HTTP scrapers cannot reach. - Structured Extraction: Produces markdown or JSON with title, section, URL, content, and metadata such as last-updated date, author, and tags. - Use Case: Point it at a paginated support knowledge base, and it returns a merged JSON file of all articles organized by section, with failed pages and rerun inputs documented. ## Quick Start Use the firecrawl-knowledge-ingest skill to scrape the docs portal at the given URL and output all articles as structured markdown.

Frequently Asked Questions about firecrawl-knowledge-ingest

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape a JavaScript-heavy documentation site?▼

Use the Firecrawl browser to open the portal, follow sidebar navigation and pagination, and scrape each article as markdown. Browser rendering handles JavaScript content that plain HTTP scrapers cannot load.

How to extract articles from a login-gated knowledge base?▼

Firecrawl browser navigation supports authenticated portals, so it can reach content behind login walls. Provide the portal URL and authentication context, and the workflow scrapes articles while respecting authentication boundaries.

Does Firecrawl knowledge ingest require an API key?▼

Yes, a FIRECRAWL_API_KEY is required for hosted Firecrawl requests. The key is declared as a required input in the skill's frontmatter and must be set before running the ingestion workflow.

What output formats does Firecrawl docs scraping produce?▼

The workflow outputs markdown or structured JSON containing source, URL, extraction timestamp, total article count, and sections with each article's title, URL, section, content, and metadata. A merged file option is also supported.

What are the limitations of scraping paginated help centers?▼

Some pages may fail due to access restrictions or loading issues, and these are tracked in a failed pages report. Very large portals should set a max_pages limit to control extraction scope and runtime.

Related Skills

Explore More Software Engineering Skills→
firecrawlfirecrawl
121

firecrawl-knowledge-ingest

Automates ingestion of authenticated, JavaScript-heavy knowledge portals via Firecrawl's browser capabilities.

Official
Advanced
team-telnyxteam-telnyx
3

telnyx-rag

Index workspace files and answer questions using Telnyx Storage and AI embeddings.

Official
Advanced
jsdfhasuhjsdfhasuh

rag-architect

Define production RAG architectures with hybrid retrieval, reranking, and evaluation metrics.

Community
Advanced
kevinnftkevinnft
13

web-scraping

Extract structured data from static HTML, JS-rendered pages, and hybrid sites.

Community
Intermediate