ssis-to-databricks

Parse SSIS .dtsx packages and convert them to Databricks PySpark, Delta, and Lakeflow pipelines.

4|1|Updated May 22, 2026
One-click install
npx skills add https://github.com/ThomazRossito/ai-data-agents --skill ssis-to-databricks-thomazrossito
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: ssis-to-databricks
Source: https://github.com/ThomazRossito/ai-data-agents/tree/main/plugins/ai-data-agents/skills/ssis-to-databricks
Command: npx skills add https://github.com/ThomazRossito/ai-data-agents --skill ssis-to-databricks-thomazrossito

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires lxml.

What problem does it solve? Migrating SQL Server Integration Services (SSIS) packages to Databricks requires manually reading opaque .dtsx XML files, inventorying Control Flow tasks and Data Flow components, and mapping each one to a modern equivalent — a slow, error-prone process that often loses error outputs, surrogate keys, or reconciliation checks. ## Core Features & Use Cases - Buffer-safe .dtsx parsing: Extracts executables, Data Flow components, connection managers, variables, and precedence constraints via Python/lxml into a JSON index without dumping raw XML into context. - Complexity classification and mapping: Classifies packages as Simple/Medium/Complex/Blocked and maps each task to Databricks equivalents (Workflows/Jobs, Lakeflow DLT, Delta MERGE/SCD, Auto Loader) using the normative kb/ssis-migration knowledge base. - DAB-packaged generation with reconciliation: Produces Bronze/Silver/Gold layers packaged as Declarative Automation Bundles, runs a mandatory sanity self-review checklist, and reconciles source vs. target row counts and numeric sums. - Use Case: Given a directory of 40 legacy .dtsx packages, generate an inventory table, convert each package into idempotent PySpark/Delta pipelines with quarantine handling, and deliver a conversion report flagging Script Tasks and Fuzzy components for manual review. ## Quick Start Ask the agent to parse all .dtsx files in your SSIS project folder and generate the Databricks migration plan with converted pipelines and a reconciliation report.

Frequently Asked Questions about ssis-to-databricks

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I migrate SSIS packages to Databricks?▼

Parse each .dtsx file as XML to inventory Control Flow tasks and Data Flow components, classify complexity, then map components to Databricks equivalents like Delta MERGE for SCD, Auto Loader for file loops, and Lakeflow Jobs or DLT pipelines for orchestration.

How to parse .dtsx files in Python?▼

A .dtsx file is XML with the DTS namespace www.microsoft.com/SqlServer/Dts. Use xml.etree.ElementTree or lxml to iterate Executable, component, ConnectionManager, and Variable elements, writing results to a JSON index rather than loading raw XML into context.

Should I use Databricks Workflows or Delta Live Tables for SSIS migration?▼

Choose one coherent execution model per package: Lakeflow SDP pipelines with @dp.table and APPLY CHANGES for declarative Bronze-to-Gold flows, or fully imperative Lakeflow Jobs with manual MERGE. Never mix @dp declarations inside a notebook orchestrated as a notebook task.

Which SSIS components cannot be migrated to Databricks automatically?▼

Fuzzy Lookup, DQS, SSAS, WMI, and MSMQ tasks have no native Databricks equivalent and must be flagged for manual review. Script Tasks and Script Components in C#/VB should be rewritten rather than translated literally.

How do I validate data after migrating SSIS to Databricks?▼

Reconcile each migrated Data Flow by comparing source vs. target row counts (under 0.1% difference), numeric column sums (±0.01%), date min/max ranges, and primary key uniqueness. Escalate to a data quality process for advanced statistical validation.