Skills
.Work. You
Rest

tavily-crawl

Official

Explore and ingest entire websites.

Content & Communication#knowledge base#web scraping#web crawling#content extraction#tavily api#documentation ingestion
Authorstoryclaw-official
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill automates the process of crawling entire websites to extract content from multiple pages, saving significant time and effort compared to manual browsing or single-URL extraction.

Core Features & Use Cases

  • Comprehensive Website Crawling: Ingest documentation sites, knowledge bases, or any multi-page resource.
  • Content Extraction: Extracts raw content from discovered pages.
  • Filtering and Focusing: Supports path filtering (select_paths, exclude_paths) and semantic instructions for targeted crawling.
  • Use Case: You need to build a comprehensive knowledge base from a company's internal wiki. Use this Skill to crawl the entire wiki, starting from the homepage, and extract all relevant documentation pages.

Quick Start

Use the tavily-crawl skill to crawl the website at https://docs.example.com, following links up to a depth of 2 and limiting the total pages to 50.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: tavily-crawl
Download link: https://github.com/storyclaw-official/storyclaw-assistant/archive/main.zip#tavily-crawl

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.