skills.rest
sakamotomomotaro0809-netizen
sakamotomomotaro0809-netizenCOMMUNITY
Explore all skills by this author →
GitHub

url-deep-analysis

Analyzes URL page structure, design, links, and SEO metadata into structured reports.

Updated Mar 23, 2026
Search Tags:#web scraping#playwright#competitor analysis#seo audit#url analysis#link crawling#spa detection
One-click install
npx skills add https://github.com/sakamotomomotaro0809-netizen/tateyomi --skill url-deep-analysis-sakamotomomotaro0809-netizen
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: url-deep-analysis
Source: https://github.com/sakamotomomotaro0809-netizen/tateyomi/tree/main/taisun_agent/.claude/skills/url-deep-analysis
Command: npx skills add https://github.com/sakamotomomotaro0809-netizen/tateyomi --skill url-deep-analysis-sakamotomomotaro0809-netizen

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve? Manually auditing a website's HTML structure, CSS design, link architecture, and SEO metadata is slow and error-prone. This Skill automates a five-layer analysis of any URL and produces a structured Markdown report with actionable improvement suggestions. ## Core Features & Use Cases - Five-Layer Analysis: URL normalization, page fetching (WebFetch, Playwright MCP, curl), HTML/CSS structure analysis, recursive link crawling, and report generation. - SPA Detection: Automatically detects React, Vue, Next.js, and other frameworks, switching to Playwright MCP for JavaScript-rendered pages. - Design & CTA Extraction: Extracts color palettes, typography, layout techniques (Flexbox/Grid), and call-to-action elements. - Use Case: Compare two competitor landing pages side-by-side with --mode=full to get a comparison table of page size, load time, CTA count, heading hierarchy, and OGP completeness. ## Quick Start Ask the AI to run a full deep analysis of https://example.com and generate a structured report covering structure, design, links, and SEO.

Frequently Asked Questions about url-deep-analysis

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I analyze a website's HTML structure and design automatically?▼

Provide a URL and the skill fetches the page, extracts heading hierarchy, semantic elements, color palettes, fonts, and layout techniques, then generates a structured Markdown report. Use --mode=structure or --mode=design to limit the scope.

What tools can crawl a website and map all internal links?▼

This skill uses Playwright MCP for link extraction and supports recursive crawling with --depth=2 or --depth=3, building a sitemap tree of internal links. Optional Firecrawl or Crawl4AI MCP servers enable faster BFS/DFS crawling of up to 200 pages.

Does website analysis work on React or Next.js single-page applications?▼

Yes. The skill detects SPA markers like #root, #__next, and #app, then automatically switches from WebFetch to Playwright MCP so JavaScript-rendered DOM content is fully analyzed.

Playwright MCP vs Firecrawl for web scraping, which should I use?▼

Playwright MCP is free and handles full JavaScript rendering but crawls manually. Firecrawl is the fastest option at about 7 seconds per page with Markdown conversion, but requires a paid API key beyond the free 500-credit tier.

Why does static HTML fetching fail on some websites?▼

Static fetching fails on JavaScript-rendered pages where the initial HTML contains only an empty root div. The skill detects this pattern and re-fetches with a headless browser so the fully rendered DOM is analyzed.

What are the crawling limits and rate limits for deep URL analysis?▼

The skill respects robots.txt and Crawl-Delay directives, enforces a minimum one-second interval between requests to the same domain, and caps crawling at 50 pages for depth 2 and 200 pages for depth 3.

Related Skills

Explore More Marketing & Sales Skills→
jeremybrasherjeremybrasher

sitemap-audit

Audits XML sitemaps for crawl budget waste and indexing errors.

Community
Intermediate
avav25avav25
2

seo-review

Identify public-facing SEO issues and generate a prioritized fixes list.

Community
Intermediate
aashahinaashahin

competitor-profiling

Generates structured competitor profile markdown files from URLs using site scraping and SEO data.

Community
Advanced
MCERQUAMCERQUA
1

screaming-frog

Execute technical SEO audits with Screaming Frog SEO Spider headless CLI.

Community
Advanced