ds-lite-web

Acquires and records public web sources with bounded provenance for research tasks.

2|Updated Jun 18, 2026
One-click install
npx skills add https://github.com/AlexenderSokolov/deepscientist-lite-codex-plugin --skill ds-lite-web-alexendersokolov
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: ds-lite-web
Source: https://github.com/AlexenderSokolov/deepscientist-lite-codex-plugin/tree/main/plugins/deepscientist-lite-web/skills/ds-lite-web
Command: npx skills add https://github.com/AlexenderSokolov/deepscientist-lite-codex-plugin --skill ds-lite-web-alexendersokolov

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Research sessions lose track of where web evidence came from, and uncontrolled crawling risks touching private or unauthorized content. This Skill acquires public web sources under explicit domain, page, byte, and time limits, then records provenance so later sessions can audit exactly what was fetched and how. ## Core Features & Use Cases - Bounded public acquisition: Fetch, search, and render public pages with enforced allowlists, redirect checks, and content-hash provenance records (ds-lite.source-record.v2). - Backend capability discovery: Detect and record available backends (Playwright CLI, Firecrawl, Tapestry, agent-browser) as ds-lite.capability.v1 instead of guessing or auto-installing. - Strict safety policy: Blocks login state, cookies, form submission, and unrestricted crawling; Firecrawl requires both an API key and explicit authorization. - Use Case: While surveying baselines for a paper, capture a set of public project pages and PDFs within a defined domain scope, producing auditable source records for later citation verification. ## Quick Start Ask the agent to use ds-lite-web to fetch public pages from an allowed domain list with page and byte limits, then report the recorded source provenance.

Frequently Asked Questions about ds-lite-web

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I fetch public web pages with provenance records?▼

Use the fetch entrypoint with repeated --allowed-domain options plus page, byte, and timeout limits. Each captured source is written as a ds-lite.source-record.v2 with content hash and relative artifact references for later audit.

Playwright vs Firecrawl for web acquisition in research workflows?▼

Playwright CLI is the reference interactive backend discovered through capability checks, while Firecrawl is an opt-in external service requiring both FIRECRAWL_API_KEY and --authorized-external-provider. Unavailable backends are recorded rather than guessed.

Can I use this to scrape pages behind a login?▼

No. The pack is public-only and forbids login state, cookies, form submission, file uploads, and operating an existing Chrome profile. Requests outside the allowlist or requiring authentication are blocked as policy results.

Why does the web fetch return a blocked result?▼

A blocked result occurs when the domain allowlist is empty, a redirect leaves the allowed scope, the core plugin is missing or incompatible, or an external provider lacks authorization. Run the doctor command against the core plugin first to verify compatibility.

What happens when a source capture fails partway?▼

A failed source record may omit content hash and artifact references but must record the failure layer and reason. Partial captures still require hash and artifact refs, and every redirect is checked against public URI policy.