What problem does it solve? Bulk downloads, scrapes, and API pulls get blocked when a target host rate-limits or bans your IP (HTTP 429, IP ban, geoblock), and client-side fixes like changing the user-agent cannot beat a per-IP quota. This Skill routes requests through a rotating pool of free proxies so the fetch can continue. ## Core Features & Use Cases - Persistent proxy pool management: Discover candidates from public proxy lists, validate reachability against the target host in parallel, and track good/bad proxies with measured latencies across runs. - Self-optimizing rotation: Speed-weighted selection with cool-down rests spreads load across the fastest proxies, while background benchmarking swaps faster fresh proxies in and evicts dead or flaky ones. - Parallel resumable worklists: Run a worklist of items 8-16 workers wide with per-item proxy fallback chains, success detection via output-file globs, and cheap resume of interrupted jobs. - Use Case: Pulling hundreds of YouTube auto-caption transcripts with yt-dlp after the host starts returning 429: build the pool, validate against youtube.com, then run the worklist through rotating proxies until every transcript is downloaded. ## Quick Start Use the net-rotating-proxies skill to download all video IDs in items.txt as YouTube caption files through rotating proxies with 16 parallel workers.
