scrape-authenticated

Captures paywalled web pages by driving the user's logged-in Chrome via bb-browser.

Updated Apr 23, 2026
One-click install
npx skills add https://github.com/danielrosehill/Claude-Local-Web-Capture-Plugin --skill scrape-authenticated-danielrosehill
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrape-authenticated
Source: https://github.com/danielrosehill/Claude-Local-Web-Capture-Plugin/tree/main/skills/scrape-authenticated
Command: npx skills add https://github.com/danielrosehill/Claude-Local-Web-Capture-Plugin --skill scrape-authenticated-danielrosehill

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires bb-browser.

What problem does it solve? Headless scrapers fail on paywalled or login-gated sites because they lack the user's session cookies and login state. This Skill captures content from those sites by driving the user's real, already-authenticated Chrome browser, so requests carry the user's cookies, login state, and local IP. ## Core Features & Use Cases - Authenticated capture via bb-browser: Drives the user's logged-in Chrome to navigate, render, and extract article text from paywalled pages. - Strict escalation gating: Runs only when headless rungs failed due to auth/paywall, when sites.yaml marks the domain as authenticated, or when the user explicitly requests a logged-in session; otherwise it redirects to the cheaper scrape-article path. - Consistent output schema: Saves markdown with the same frontmatter and directory layout as scrape-article, adding extractor, rung, and authenticated fields. - Use Case: A user needs an article from Haaretz or Calcalist+ that is subscriber-only. After confirming they are logged in to Chrome, this Skill captures the full article text and saves it to the local captures directory. ## Quick Start Capture this subscriber-only article from Haaretz using my logged-in Chrome session and save it as markdown.

Frequently Asked Questions about scrape-authenticated

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape a paywalled article with my logged-in Chrome session?▼

Use bb-browser to drive your real Chrome browser, which already carries your login cookies and session state. Confirm you are signed in to the target site first, then navigate to the URL, wait for the article container to render, and extract the visible text as markdown.

When should I use authenticated browser capture instead of headless scraping?▼

Use authenticated capture only when headless rungs fail due to a paywall or login wall, when the domain is marked as authenticated in sites.yaml, or when you explicitly need a logged-in session. Headless scraping is cheaper and should remain the default for ordinary pages.

What is bb-browser and how does it work for web scraping?▼

bb-browser is a CLI and MCP tool that drives the user's real logged-in Chrome browser. Because requests originate from the actual browser, they carry the user's cookies, login state, and local IP, letting it reach content that blocks headless scrapers.

Does authenticated capture store my cookies or credentials?▼

No. The capture file stores only the article content and metadata frontmatter. Cookies, credentials, and Set-Cookie headers are explicitly excluded from the saved output.

What happens if the site shows a captcha during authenticated capture?▼

The Skill stops and reports the challenge to the user. It does not attempt to solve captchas or defeat bot protections, and it will not silently fall back to another method.