wandb-model-sync

Synchronize Pi's wandb provider models.json with live W&B Serverless Inference catalog metadata.

Updated May 18, 2026
One-click install
npx skills add https://github.com/blalor/pi-dot-dev --skill wandb-model-sync-blalor
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: wandb-model-sync
Source: https://github.com/blalor/pi-dot-dev/tree/main/agent/skills/wandb-model-sync
Command: npx skills add https://github.com/blalor/pi-dot-dev --skill wandb-model-sync-blalor

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve? Keeping Pi's wandb provider configuration in models.json aligned with the models actually served by W&B Serverless Inference is manual and error-prone: model IDs change, context windows and modalities are documented separately, and stale entries silently persist. This Skill automates fetching live endpoint IDs and documented catalog metadata, reconciling the configuration, and validating the result. ## Core Features & Use Cases - Live catalog fetch: A Python helper queries the authenticated W&B models endpoint and parses the W&B documentation tables into a snapshot JSON with context windows, modalities, and display names. - Deterministic reconciliation: Rules for adding, removing, and updating models.json entries, with strict guards against inventing metadata or leaking API keys. - Model recommendations: Compares W&B candidates against preferred models on coding specialization, reasoning, modality, and context window, updating SUITABLE_MODELS.md. - Validation workflow: jq-based checks confirm exact endpoint coverage, explicit context windows, and Pi model loading. - Use Case: When W&B adds a new inference model, run the Skill to fetch the catalog, update providers.wandb in models.json with documented context windows, and verify with pi --list-models wandb. ## Quick Start Ask the agent to sync the wandb provider in models.json with the current W&B Serverless Inference catalog and validate the result.

Frequently Asked Questions about wandb-model-sync

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I sync Pi's models.json with W&B Serverless Inference models?▼

Run the fetch_catalog.py helper with your Pi auth.json to snapshot live endpoint IDs and documented metadata, then reconcile providers.wandb in models.json so its model IDs exactly match the endpoint. Validate with jq checks and pi --list-models wandb.

How do I provide the W&B API key for model listing?▼

Set the WANDB_API_KEY environment variable or store the key under wandb.key in Pi's auth.json file. The helper reads the key from these sources and never writes credentials to its output or accepts them as command arguments.

What happens when a W&B endpoint model lacks documented metadata?▼

The snapshot records such models in missingDocumentation with null metadata fields, which blocks automatic reconciliation. You must find authoritative context window and modality documentation or stop and report the discrepancy rather than applying Pi's 128K fallback.

Does the sync modify providers other than wandb in models.json?▼

No. The Skill modifies only providers.wandb and preserves all other providers and unrelated working-tree changes. It checks git status before editing to distinguish pre-existing modifications from its own.

How are W&B model recommendations validated?▼

Recommendations compare candidates on coding specialization, reasoning, modality, context window, and output limits, distinguishing workload fit, interface fit, and proven performance peers. Performance claims require controlled benchmark evidence from named sources using the same benchmark version.