skills.rest
treeves
treevesCOMMUNITY
Explore all skills by this author →
Website𝕏@turbodadGitHub

scrape-webpage

Extract content, metadata, and images from webpages for migration.

Updated Jan 16, 2026
Search Tags:#migration#metadata#playwright#webpage#scrape#image-capture
One-click install
npx skills add https://github.com/treeves/ak-test --skill scrape-webpage-treeves
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrape-webpage
Source: https://github.com/treeves/ak-test/tree/main/.skills/scrape-webpage
Command: npx skills add https://github.com/treeves/ak-test --skill scrape-webpage-treeves

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, sharp, and includes scripts (resource) components.

What problem does it solve?

This Skill turns the manual, error-prone process of migrating web content into an automated workflow by extracting page content, metadata, and assets for migration to AEM Edge Delivery Services or similar platforms.

Core Features & Use Cases

  • Extracts title, description, Open Graph, JSON-LD, and canonical metadata from a page.
  • Downloads images locally (converting to PNG when needed) and maps them to local paths for offline migration.
  • Produces a cleaned HTML payload with local image references and a complete metadata.json for downstream steps.
  • Use Case: You need to analyze a competitor's page and prepare a ready-to-migrate package with images and metadata.

Quick Start

Use the scrape-webpage skill to analyze a page: node .claude/skills/scrape-webpage/scripts/analyze-webpage.js "https://example.com/page" --output ./work

Frequently Asked Questions about scrape-webpage

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract webpage content and images for migration?▼

Webpage migration extracts page content, metadata, and images using automated tools. Scrape Webpage downloads images locally, maps them to asset paths, cleans HTML references, and outputs a metadata.json payload ready for import into platforms like AEM Edge Delivery Services.

Can I use Playwright and Sharp to automate webpage scraping?▼

Yes. Playwright automates page analysis and asset discovery; Sharp handles image conversion and optimization. Together they extract Open Graph metadata, JSON-LD structured data, canonical tags, and convert images to PNG format while maintaining local asset mappings.

What metadata does webpage scraping capture?▼

Webpage scraping captures title, description, Open Graph tags, JSON-LD structured data, and canonical URLs. Scrape Webpage extracts these elements and outputs them in a structured metadata.json file alongside cleaned HTML and image reference mappings for downstream migration workflows.

How do I prepare downloaded images for offline migration?▼

Image preparation converts remote assets to local PNG files and updates HTML to reference local paths. Scrape Webpage handles this automatically: it downloads images, converts formats, maps original URLs to local asset locations, and produces a complete image-reference index.

What's the fastest way to migrate competitor pages to AEM?▼

Automated webpage scraping accelerates migration by extracting all assets, metadata, and cleaned markup in one pass. Scrape Webpage integrates with page-import orchestrators to analyze sources, prepare ready-to-import packages, and eliminate manual content re-entry and asset mapping.

Related Skills

Explore More Software Engineering Skills→
arbory-digital-incarbory-digital-inc

scrape-webpage

Extract webpage content, metadata, and images into local assets.

Official
Intermediate
adobe-summit2026-l613adobe-summit2026-l613

scrape-webpage

Scrape webpage content, metadata, and images into migration-ready JSON, HTML, and local assets.

Official
Advanced
ak8458ak8458

scrape-webpage

Scrape webpages to extract content, metadata, and local images for migration.

Community
Advanced
spideynolovespideynolove
2

lightpanda

Fetches web page HTML via a lightweight headless browser CLI.

Community
Basic