Skills
.Work. You
Rest

WebMine

Community

Mine web content and save raw results.

Content & Communication#research#search#web scraping#duckduckgo#content mining#web archive
AuthorDaveSteadman
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill automates the process of fetching and saving web content, whether it's a direct URL or the results of a search query, organizing it into a structured research workspace.

Core Features & Use Cases

  • Direct URL Mining: Save the content of any web page to a specified domain and date.
  • Search and Save: Perform DuckDuckGo searches and save the results, optionally fetching and embedding article content.
  • Deep Mining: Extract individual articles from search results, ideal for in-depth research.
  • Use Case: You need to gather all articles about a specific topic published by a particular news source in a given month. Use mine_search_deep to find and save these articles into your "TechNews" research domain.

Quick Start

Use the WebMine skill to search for "latest AI advancements" and save the results into the "Technology" research domain.

Dependency Matrix

Required Modules

None required

Components

scriptsreferences

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: WebMine
Download link: https://github.com/DaveSteadman/MiniAgentFramework/archive/main.zip#webmine

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.