What problem does it solve? Moving data from SaaS applications (Salesforce, Workday, ServiceNow, GA4, HubSpot, Confluence) and databases (SQL Server, PostgreSQL, MySQL) into Databricks normally requires custom connector code, credential management, and CDC handling. This Skill guides you through Lakeflow Connect, the managed ingestion path that lands governed Delta tables in Unity Catalog using serverless pipelines. ## Core Features & Use Cases - Connector selection guidance: Decide between Lakeflow Connect, Auto Loader, Lakehouse Federation, Delta Sharing, and Zerobus based on where your data lives and whether you need a copy. - Pipeline authoring patterns: Create ingestion pipelines via databricks pipelines create --json or Declarative Automation Bundles, with correct ingestion_definition structure and UC CONNECTION setup. - Database CDC architecture: Configure the gateway pattern for SQL Server (cloud and on-prem) with change tracking vs CDC trade-offs, staging volumes, and network requirements. - Troubleshooting and monitoring: Query event logs, resolve duplicate-key violations, watermark issues, and OAuth connection problems. - Use Case: You need to sync Salesforce Account and Opportunity objects into Unity Catalog nightly. This Skill walks you through creating the OAuth U2M connection in Catalog Explorer, authoring the ingestion pipeline as a DAB resource, and scheduling it with a Jobs pipeline_task. ## Quick Start Use the databricks-lakeflow-connect skill to create an ingestion pipeline that pulls Salesforce Account and Opportunity tables into my main.salesforce_raw schema.
