skills.rest
ProgramadorBrasil
ProgramadorBrasilCOMMUNITY
Explore all skills by this author →
GitHub

web-scraper

Extract structured data from web pages into Markdown, JSON, or CSV.

Updated Aug 23, 2026
Search Tags:#automation#pagination#data-extraction#web-scraping#open-graph#transform#json-ld
One-click install
npx skills add https://github.com/ProgramadorBrasil/antigravity-skills --skill web-scraper-programadorbrasil
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: web-scraper
Source: https://github.com/ProgramadorBrasil/antigravity-skills/tree/main/skills/web-scraper
Command: npx skills add https://github.com/ProgramadorBrasil/antigravity-skills --skill web-scraper-programadorbrasil

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Web data is scattered across multiple pages and formats; this Skill provides a robust, multi-strategy framework to fetch, parse, and normalize web data into structured outputs.

Core Features & Use Cases

  • Multi-strategy extraction combines static WebFetch, browser automation for JS-heavy pages, and API-like endpoints to extract data from diverse sites.
  • Pagination and multi-URL support to follow pages and compare data across sources.
  • Structured outputs with transforms including JSON-LD extraction, URL resolution, and data normalization for downstream analytics.
  • Use Case: Gather product listings from several retailer sites and export a unified catalog.

Quick Start

Provide a target URL and data targets, and I will fetch, extract, transform, and format the results.

Frequently Asked Questions about web-scraper

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract structured data from web pages that require JavaScript rendering?▼

To extract data from JavaScript-rendered web pages, this scraping framework applies browser automation alongside static page analysis and API-like endpoints, ensuring dynamic content is captured into structured outputs. It handles JS-heavy pages through its multi-strategy extraction workflow.

Can I scrape multiple web pages and follow pagination automatically?▼

Yes, web scraping with pagination is fully supported. You can target multiple URLs and the framework will automatically follow pagination links across pages, normalizing the extracted data into a unified Markdown table, JSON, or CSV format.

What is the best way to extract JSON-LD and Open Graph data from websites?▼

The best way to extract JSON-LD and Open Graph data is using a targeted scraping workflow that checks for these specific structured data formats during the extraction phase. It automatically parses and normalizes this metadata into clean JSON or CSV outputs.

How do I turn web page content into clean JSON or CSV files?▼

To turn web pages into clean JSON or CSV files, provide a target URL and data targets. The framework fetches, extracts, and transforms the raw web data through a structured validation phase, outputting normalized tables ready for downstream analytics.

Does web scraping handle rate limiting and errors when fetching multiple URLs?▼

Yes, automated web scraping includes built-in error handling and rate limiting. When fetching data across multiple URLs or pages, the framework manages request pacing and error recovery to prevent blocks and ensure continuous data extraction.

Related Skills

Explore More Data & Analytics Skills→
verrio1verrio1

BrightData

Retrieve web page content from URLs using a four-tier scraping workflow.

Community
Advanced
aws-samplesaws-samples
90

file-processing

Process and analyze CSV, JSON, and text data files with automated cleaning and transformation.

Official
Advanced
onvoyage-aionvoyage-ai
1.3k

build-resource-pages

Transform markdown resource content into production-ready website pages with metadata.

Official
Advanced
involvexinvolvex

web-scraper

Extract structured data from web pages into JSON, CSV, or Markdown.

Community
Advanced