wap-ingestion

What problem does it solve?

Ingest data from S3 into Bauplan using the Write-Audit-Publish pattern to ensure safe, atomic data loads and easy rollback.

Core Features & Use Cases

• Write-Audit-Publish workflow: Ingest to a temporary branch, audit quality, and publish to main atomically.
• Atomic multi-table operations: Merge branch changes in a single operation to ensure consistency.
• Use Case: Ingest a new parquet dataset from S3, validate rows, then merge into main without partial updates.

Quick Start

Run the wap_template example with your table name and S3 path to create a temporary branch and publish results based on success/failure preferences. After completion, inspect or merge as needed.