Transformation Logic Generator

What problem does it solve?

Building reliable, maintainable, and performant transformation logic for SAP Datasphere can be time-consuming and error-prone; this Skill removes guesswork by providing proven SQLScript and Python patterns, delta handling strategies, and validation steps to reduce runtime failures and data quality issues.

Core Features & Use Cases

• SQLScript patterns: MERGE upserts, watermark-based delta loads, CTEs, window functions, partitioning, and SCD Type 2 templates for Transformation Flows.
• Python operator recipes: pandas-style fusion, chunked processing for large datasets, custom business logic, and memory management for Data Flows.
• Testing & diagnostics: sample execute_query and smart_query checks, schema inspection with get_table_schema, distribution analysis, and structured logging/error handling patterns.
• Use cases: incremental ETL pipelines, SCD Type 2 dimension management, deduplication and pivoting workflows, CDC integration, and performance tuning for million-row workloads.

Quick Start

Ask the skill to generate a MERGE-based SQLScript procedure implementing SCD Type 2 with watermark delta handling and include validation queries and logging.