context-scrapers

Official

Web scraping spiders and source management.

Authorstars-end
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill provides a Scrapy-based scraping framework to collect data from Legistar city councils and Municode, with pipelines and verification scripts to ensure data quality and consistency.

Core Features & Use Cases

  • Spiders: Legistar and Municode scrapers to ingest meetings and codes.
  • Pipelines & Settings: Data storage and processing flows.
  • Verification Scripts: Validate raw scrapes and discovery logic.

Quick Start

Use this skill when modifying scrapers, adding new jurisdictions, or debugging ingestion. For example, run scripts/verify_raw_scrapes.py to check the raw_scrapes table and verify_municode_discovery.py to validate Municode discovery.

Dependency Matrix

Required Modules

None required

Components

scripts

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: context-scrapers
Download link: https://github.com/stars-end/affordabot/archive/main.zip#context-scrapers

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository