Enforce token limits, throttling, and timeouts on LLM API endpoints.
npx skills add https://github.com/thejefflarson/soundcheck --skill model-dos
Please help me install this Agent Skill. Skill: model-dos Source: https://github.com/thejefflarson/soundcheck/tree/main/.claude/skills/model-dos Command: npx skills add https://github.com/thejefflarson/soundcheck --skill model-dos
Protects LLM endpoints from resource exhaustion by enforcing input caps, per-user throttling, and strict timeouts.
Configure your LLM endpoint to enforce max tokens, rate limits, and request timeouts for incoming prompts.
High-intent search queries and answers about installing and using this skill.
Prevent LLM DoS by enforcing input length caps, max token limits, and strict request timeouts to block resource exhaustion before prompts reach the model.
Per-identifier throttling limits API requests from a single user or key, preventing chat handlers and multi-turn workflows from triggering resource exhaustion through rapid abusive calls.
Cap prompt history by bounding conversation length inputs before they reach the model, ensuring inferences remain bounded and timely even when upstream calls misbehave.
Yes, this approach applies to any service exposing an LLM API. It enforces max tokens, input caps, and timeouts across chat handlers and multi-turn workflows.
Endpoints hang because upstream calls lack explicit inference deadlines. Enforcing strict request timeouts guarantees timely responses and prevents resource exhaustion from slow upstreams.
Use prompt capping when exposing LLM APIs to prevent resource exhaustion. It bounds recursive prompts, enforces token limits, and applies per-user throttling to stop abuse.
ZeroGravitySkin-RonTest authenticated API routes with cookie-based JWT authentication.
jeremylongshoreAutomate deployment of Prometheus, Grafana, and Datadog monitoring stacks.
camilooscargbaptistaDesign API gateway architectures with rate limiting, authentication, routing, and circuit breaking.
dreadnodeBypass reverse proxy ACLs and WAF rules via H2C and WebSocket smuggling.
