brightdata-web-mcp
CommunityScrape web, extract data, automate browsers.
Software Engineering#data extraction#web scraping#web automation#bright data#scraping browser#ecommerce data#social media data
Author3kpro
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill provides a robust solution for accessing and extracting data from the web, overcoming common challenges like bot detection, CAPTCHAs, and dynamic content rendering.
Core Features & Use Cases
- Web Scraping: Extract content from any URL as Markdown or HTML.
- Data Extraction: Use AI to extract structured data (JSON) from web pages.
- Web Search: Perform searches across Google, Bing, and Yandex.
- Browser Automation: Control a headless browser for JavaScript-heavy sites, including navigation, clicking, and typing.
- Platform-Specific Tools: Dedicated tools for extracting data from e-commerce sites (Amazon, Walmart), social media (LinkedIn, Instagram), and more.
- Use Case: You need to gather product details, prices, and reviews from multiple e-commerce websites for a market analysis. This Skill can automate fetching this data reliably, even from sites with strong anti-scraping measures.
Quick Start
Use the brightdata-web-mcp skill to scrape the content of 'https://example.com/article' and return it as Markdown.
Dependency Matrix
Required Modules
None requiredComponents
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: brightdata-web-mcp Download link: https://github.com/3kpro/aiarsenal/archive/main.zip#brightdata-web-mcp Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.