Skills
.Work. You
Rest

crawl-url

Community

Download website content locally.

Content & Communication#documentation#markdown#web scraping#offline access#tavily#content download
AuthorGaryOcean428
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill automates the process of downloading and saving website content, making it accessible for offline use and analysis.

Core Features & Use Cases

  • Website Crawling: Downloads content from any given URL.
  • Markdown Conversion: Saves crawled pages as local markdown files.
  • Offline Access: Enables access to web content without an internet connection.
  • Use Case: Download an entire API documentation website or a knowledge base for easy reference and searching.

Quick Start

Crawl the website at https://docs.anthropic.com and save the content locally.

Dependency Matrix

Required Modules

tavily-pythonpython-dotenv

Components

scripts

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: crawl-url
Download link: https://github.com/GaryOcean428/vex-agent/archive/main.zip#crawl-url

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.