skills.rest
timchap
timchapCOMMUNITY
Explore all skills by this author →
GitHub

web-research

Conducts web research using search and browser fallbacks when extraction is blocked.

Updated Jul 10, 2026
Search Tags:#web research#price comparison#shopify#product availability#web scraping fallback#shipping policy#ecommerce audit
One-click install
npx skills add https://github.com/timchap/dot-hermes --skill web-research-timchap
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: web-research
Source: https://github.com/timchap/dot-hermes/tree/main/skills/web-research
Command: npx skills add https://github.com/timchap/dot-hermes --skill web-research-timchap

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Web extraction tools frequently fail on Shopify-based storefronts with ERR_BLOCKED_BY_CLIENT errors, leaving you unable to check product availability, pricing, or shipping policies. This Skill provides a systematic fallback pipeline that routes around those blocks using search queries and browser automation. ## Core Features & Use Cases - Fallback Research Pipeline: When web_extract fails, run parallel site-specific web_search queries, extract policy pages directly, and use browser navigation with snapshots for stock and size data. - E-Commerce Audits: Check product availability, compare pricing, and verify international shipping scope across multiple retailers, with structured per-retailer output tables. - Inventory Change Detection: Identify RESTOCK and NEW badges on collection pages and leverage Google-indexed Shopify JSON-LD snippets that expose full variant stock data. - Use Case: You need to check whether a specific t-shirt is in stock across four heritage clothing retailers and confirm which ones ship to France. The Skill runs parallel searches, extracts shipping policy pages, flags a US-only retailer, and produces a comparison table with prices, sizes, and shipping terms. ## Quick Start Check the availability and French shipping options for Merz b. Schwanen t-shirts across merzbschwanen.com, redcastheritage.com, and witheredfig.com.

Frequently Asked Questions about web-research

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I research products when web_extract is blocked?▼

Run parallel web_search calls with site-specific queries like "site:DOMAIN product pricing" to pull data from search snippets. Then extract policy pages directly with web_extract, since shipping and FAQ pages are rarely blocked, and use browser navigation for product pages needing stock detail.

How to check product availability across multiple retailers?▼

Start with a parallel web_search sweep on each retailer plus the brand name, checking the official brand store first. Extract shipping policy pages, use browser snapshots for size-level stock data, and output structured tables per retailer with price, stock, and shipping columns.

Why does web_extract fail on Shopify stores?▼

Shopify storefronts trigger ERR_BLOCKED_BY_CLIENT because the extraction request headers are blocked by Shopify's shop.app extension before content returns. Confirmed affected domains include merzbschwanen.com, redcastheritage.com, witheredfig.com, and any myshopify.com storefront.

Can web_search show Shopify stock data without a browser?▼

Yes, for merzbschwanen.com specifically. Google indexes the Shopify JSON-LD structured data embedded in collection pages, so search snippets contain the full products array with each variant's SKU, price in cents, size label, and available boolean.

When does web_extract work without fallback?▼

web_extract works on non-Shopify domains, plain-text endpoints like .md, .txt, .json, .csv, and .xml files, raw.githubusercontent.com URLs, documented API endpoints, and most blogs, documentation sites, and news outlets.

How do I verify a retailer ships internationally?▼

Extract the retailer's shipping policy page and check the footer, store locator, and contact pages for shipping scope. Some boutiques like Old House Provisions are US-only with no visible warning banner, so never assume international shipping without explicit confirmation.

Related Skills

Explore More Education & Research Skills→
gnestorgnestor

google-search-console

Query Google Search Console analytics for clicks, impressions, CTR, and position.

Community
Advanced
shahmirerrorshahmirerror

used-car-advisor

Evaluate used-car listings, estimate fair prices, and flag problematic models.

Community
Intermediate
ajayatwal1105-emersonajayatwal1105-emerson

narrative-tracker

Track AI-generated brand narratives across platforms for alignment and drift.

Community
Advanced
Srajangpt1Srajangpt1

compare-prices

Search product listings across online retailers in parallel and generate per-retailer JSON files.

Community
Advanced