sage-recovery-patterns

What problem does it solve?

Sage recovery patterns provide a structured approach to adding resilience to LLM integrations by combining circuit breakers, rate limiters, and retry policies to prevent cascading failures and improve reliability.

Core Features & Use Cases

• Circuit Breaker pattern to stop calls when the upstream LLM provider is failing.
• Rate Limiter to cap traffic and avoid throttling or overload.
• Retry Policy with backoff to recover from transient errors.
• Supervisor to manage long-running tasks and restarts.
• Use Case: Integrate with chat workflows to ensure fallbacks when the API is unresponsive.

Quick Start

Example: wrap an llm_client.chat(request) call with a CircuitBreaker configured to trip after 5 failures, a SlidingWindowRateLimiter for 60 requests per minute, and an exponential Backoff RetryPolicy with max_retries = 5.