Skills
.Work. You
Rest

spider

Community

Crawl and extract web data with analysis.

Data & Analytics#data extraction#security analysis#web scraping#link extraction#crawling
Authorjohnlindquist
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Web crawling and scraping with analysis. Use for crawling websites, security scanning, and extracting information from web pages.

Core Features & Use Cases

  • Fetch pages with curl and inspect headers
  • Extract links and domain-filtered URLs
  • Quick site scan for headers, scripts, and meta tags
  • AI-powered analysis for page content and security insights
  • Simple extraction of structured data from pages

Quick Start

Use the spider skill to fetch a page, extract its links, and perform a quick meta-tag scan on the target URL.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: spider
Download link: https://github.com/johnlindquist/claude/archive/main.zip#spider

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.