api-experiments
CommunityEfficiently run API-heavy LLM experiments
Authoryulonglin
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Streamlines memory-aware experimentation for API-heavy LLM evaluations by guiding efficient batch and asynchronous patterns.
Core Features & Use Cases
- Batch-centered execution: submit all configurations from a single process, then poll and collect results incrementally.
- Real-time async workflows with controlled concurrency to support interactive iterations.
- Guardrails and anti-pattern avoidance to prevent memory bloat and process explosions in large-scale runs.
- Real-world use cases include large eval campaigns, multi-config sweeps, and reproducible experiment pipelines.
Quick Start
Provide your experiment configurations and run them through a single process that submits all batches, polls for completion, and stores the results incrementally.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: api-experiments Download link: https://github.com/yulonglin/dotfiles/archive/main.zip#api-experiments Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.