web_scrape
CommunityFetch and extract web content quickly.
AuthorAreteDriver
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Automates the retrieval and parsing of web pages, turning raw HTML into usable text, tables, and metadata for downstream analysis.
Core Features & Use Cases
- Fetch HTML content and render JavaScript when needed using a headless browser.
- Extract readable text, article content, tables, and key metadata for indexing, auditing, or data pipelines.
- Analyze links, discover related pages, and assemble structured datasets from multiple sources.
- Use Case: Gather product specs from supplier sites and compile a structured catalog with text, prices, and feature tables.
Quick Start
To start, fetch a page, then extract the main article text or tables. Example: fetch a product page, extract its description and a price table, and save results for your analytics pipeline.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: web_scrape Download link: https://github.com/AreteDriver/Gorgon/archive/main.zip#web-scrape Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.