web-scraper
OfficialScrape web data with CSS selectors
AuthorAIDotNet
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill automates the process of extracting specific data from web pages, saving users from manually copying and pasting information.
Core Features & Use Cases
- Targeted Data Extraction: Use CSS selectors to pinpoint and extract desired information (text, attributes).
- Pagination Handling: Scrape data across multiple pages of a website.
- Rate Limiting: Control the speed of requests to avoid overloading servers or getting blocked.
- Structured Output: Save extracted data into organized formats like JSON.
- Use Case: Extract all product names and prices from an e-commerce category page, even if the products span multiple pages.
Quick Start
Use the web-scraper skill to extract all elements with the class 'product-title' from the URL 'https://example.com/products' and save them to 'products.json'.
Dependency Matrix
Required Modules
requestsbeautifulsoup4lxml
Components
scripts
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: web-scraper Download link: https://github.com/AIDotNet/MoYuCode/archive/main.zip#web-scraper Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.