crawl-fetch-ingest

Crawls VC firm websites and PDFs to extract structured metadata for teams, portfolios, and CEOs.

4|Updated May 4, 2026
One-click install
npx skills add https://github.com/lossless-group/lossless-agent-skills --skill crawl-fetch-ingest
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: crawl-fetch-ingest
Source: https://github.com/lossless-group/lossless-agent-skills/tree/main/crawl-fetch-ingest
Command: npx skills add https://github.com/lossless-group/lossless-agent-skills --skill crawl-fetch-ingest

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pillow, imagemagick, rembg, and includes scripts (resource) components.

What problem does it solve?

VC firms scatter team bios, portfolio companies, and brand assets across multiple sub-pages and PDFs. Manually collecting headshots, LinkedIn URLs, logos, and titles for investment decks and memos is tedious and error-prone. This Skill automates the entire extraction and normalization pipeline.

Core Features & Use Cases

  • Four-Checkpoint Cascade: Systematically extracts VC team members, external advisors, portfolio companies, and portfolio CEOs with human-confirmation gates at each stage.
  • Dual Anchor Types: Supports both firm-anchored walks (one VC → team → portfolio → CEOs) and company-anchored credibility-card walks (operating company → backers → backer teams + portfolios).
  • SVG-First Brand Asset Pipeline: Retrieves logos via a seven-tier cascade (inline SVG → site paths → press kits → Brandfetch → vector repos → Google CSE → raster fallback) with automatic background stripping and validation.
  • Cross-Tool Fallbacks: Chains Jina Reader, Firecrawl, Tavily, OpenGraph.io, and Brandfetch with intelligent escalation and global caching to minimize cost and handle JS-gated sites.

Quick Start

Use the crawl-fetch-ingest skill to fill in the team and portfolio metadata for Sequoia Capital from their website and the attached deck PDF.

Frequently Asked Questions about crawl-fetch-ingest

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract VC team headshots and LinkedIn URLs from websites and PDFs?▼

To extract VC team headshots and LinkedIn URLs, you can crawl firm websites and PDFs using a four-checkpoint cascade that retrieves metadata and normalizes executive bios. It collects headshots and LinkedIn URLs directly from sub-pages and attached documents.

What is the best way to scrape portfolio company logos and strip backgrounds automatically?▼

The best way to scrape portfolio company logos and strip backgrounds is using an SVG-first brand asset pipeline. It retrieves logos via a seven-tier cascade and applies automatic background stripping using rembg to normalize the final output.

How do I automate data ingestion for investment memos when VC sites are JS-gated?▼

To automate data ingestion for investment memos on JS-gated VC sites, you can use cross-tool fallbacks that chain Jina Reader, Firecrawl, Tavily, and OpenGraph.io. This intelligent escalation handles JavaScript rendering and caches responses globally.

Does this web scraping pipeline support company-anchored walks to find external backers?▼

Yes, this web scraping pipeline supports company-anchored walks. It can start from an operating company to find its backers, then crawl the backer teams and portfolios to generate structured credibility-card metadata.

When do I need human confirmation gates during portfolio metadata extraction?▼

You need human confirmation gates during portfolio metadata extraction at each of the four checkpoints in the cascade. The pipeline outputs confidence-flagged schemas for team members, portfolio companies, and CEOs to ensure human review.