expanso-content-splitting

What problem does it solve?

This Skill automates the process of splitting incoming data batches into individual messages, routing them to different destinations based on their content and validity.

Core Features & Use Cases

• Dynamic Data Splitting: Handles various input formats like JSON arrays, CSV records, or raw arrays, splitting them into individual records.
• Content-Based Routing: Validates each individual item and routes valid items to a processing queue (e.g., Kafka) and invalid items to a dead-letter queue (e.g., file).
• Use Case: Process a large daily batch of customer orders, splitting each order into its own message for individual fulfillment and logging any malformed orders for review.

Quick Start

Run the content splitting pipeline with sample data using the provided shell script.