skills.rest
dtsong
dtsongCOMMUNITY
Explore all skills by this author →
GitHub

data-integration

Design enterprise data integrations using CDC, webhooks, and iPaaS platforms.

Updated Aug 23, 2026
Search Tags:#API#integration#data sync#CDC#DLT#iPaaS#Reverse ETL
One-click install
npx skills add https://github.com/dtsong/data-engineering-skills --skill data-integration
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: data-integration
Source: https://github.com/dtsong/data-engineering-skills/tree/main/data-integration
Command: npx skills add https://github.com/dtsong/data-engineering-skills --skill data-integration

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill provides expert guidance for designing, implementing, and troubleshooting enterprise data integrations, bridging the gap between disparate systems and ensuring seamless data flow.

Core Features & Use Cases

  • Integration Pattern Selection: Choose the right pattern (REST, CDC, Webhooks, Batch, Reverse ETL) based on latency, volume, and complexity requirements.
  • iPaaS & DLT Guidance: Evaluate and implement solutions using platforms like Workato, MuleSoft, Boomi, or DLT for efficient data movement.
  • System Connectivity: Design integrations for enterprise systems like Salesforce, NetSuite, Stripe, and more, covering authentication, rate limits, and error handling.
  • Use Case: Design a near-real-time integration to sync customer data from Salesforce to NetSuite using CDC patterns, ensuring data consistency across both platforms.

Quick Start

Design an integration to sync Salesforce Accounts to Snowflake in near-real-time, considering CDC and webhook patterns.

Frequently Asked Questions about data-integration

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I choose between CDC, webhooks, and Reverse ETL for data integration?▼

Data integration pattern selection depends on latency, volume, and complexity requirements. Change Data Capture (CDC) suits near-real-time synchronization, webhooks handle event-driven updates, and Reverse ETL pushes processed data back to operational systems.

What is the best way to sync Salesforce data to Snowflake in near-real-time?▼

Syncing Salesforce data to Snowflake in near-real-time is best achieved using CDC and webhook patterns. This ensures data consistency across platforms by capturing database changes immediately and triggering automated workflow updates.

Can I use Workato or MuleSoft to connect enterprise systems like NetSuite and Stripe?▼

Yes, iPaaS platforms like Workato and MuleSoft facilitate enterprise system connectivity for NetSuite and Stripe. They manage system authentication, enforce API rate limiting, and provide robust error handling for seamless data movement.

How do I handle API rate limits and authentication when integrating Stripe and Salesforce?▼

Handling API rate limits and authentication for Stripe and Salesforce integrations requires specific system connectivity patterns. Enterprise integration strategies address these constraints directly to ensure reliable data sync without exceeding API thresholds.

When should I use DLT pipelines instead of an iPaaS platform for data sync?▼

Use DLT pipelines for lightweight data sync instead of an iPaaS platform when you need efficient data movement within data ecosystems. DLT provides a code-first approach, whereas iPaaS solutions like Boomi offer visual workflow automation.

Related Skills

Explore More Software Engineering Skills→
brainbrewlabsbrainbrewlabs
7

claude-code

Configure and troubleshoot Claude Code installations across local, CI/CD, IDE, and enterprise environments.

Official
Advanced
AradotsoAradotso
5

snowflake-dbt-airbnb-analytics

Automate ETL workflows with Snowflake, dbt, and Streamlit.

Official
Advanced
SciMate-AISciMate-AI
1

ensembl-database

Query the Ensembl REST API for gene, sequence, variant, and regulatory data.

Official
Advanced
untitled-data-companyuntitled-data-company
20

dlt-skill

Create and maintain dlt pipelines from APIs, databases, and other sources.

Official
Advanced