Smart Browser
CommunityPersistent Chrome sessions for reliable scraping
Software Engineering#web-scraping#browser-automation#js-rendering#agent-browser#markdown-output#agenda-extraction
Authorpynbj1001
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Extracts structured data from dynamic, JavaScript-rendered websites where traditional HTTP scraping fails, eliminating manual inspection and repetitive extraction tasks and enabling reliable capture of agendas and event schedules.
Core Features & Use Cases
- Persistent sessions: Keep Chrome profiles and session state to handle authenticated pages and incremental crawling.
- JS rendering & wait strategies: Wait for network idle, element presence, or custom JS conditions before extraction.
- Structured extraction: Intelligent selector heuristics and in-page JS evaluation to extract title, time, speaker, location, track, and description.
- Debugging & outputs: Save DOM snapshots for analysis, capture screenshots, and export results as Markdown and JSON for downstream use.
- Use Cases: Scraping conference agendas (e.g., MWC), event schedules, and other client-side rendered listings that require stateful browsing.
Quick Start
Fetch the agenda at https://www.mwcbarcelona.com/agenda, wait for JavaScript to render, extract session items, and save the structured output as mwc-agenda.md.
Dependency Matrix
Required Modules
agent-browsernode
Components
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: Smart Browser Download link: https://github.com/pynbj1001/agent-workspace/archive/main.zip#smart-browser Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.