effect-patterns-streams-sinks

What problem does it solve?

This Skill provides battle-tested sink patterns for streaming data in Effect-TS, enabling reliable batching, persistence, and distribution of stream records with resilience against failures.

Core Features & Use Cases

• Batch Insert Stream Records into Database: batch records to reduce DB round-trips and improve throughput.
• Write Stream Events to an Event Log: append events with metadata for auditability and replay.
• Sink Pattern 3: Write Stream Lines to File: buffered file writes for logs and exports.
• Sink Pattern 4: Send Stream Records to Message Queue: batch and publish with partitioning by key.
• Sink Pattern 5: Fall Back to Alternative Sink on Failure: progressive degradation across cache, DB, and dead-letter targets.
• Sink Pattern 6: Retry Failed Stream Operations: exponential backoff retries with jitter.

Quick Start

Run the streams-sinks sample to execute all six sink patterns against a simulated stream of records and observe batching, publishing, and retry behaviors.