adjust-endpoint

What problem does it solve?

This Skill helps refine dlt pipelines for production by addressing common issues encountered during development, such as incorrect data limits, unverified pagination, and inefficient loading configurations.

Core Features & Use Cases

• Production Readiness: Removes development-specific limits (.add_limit()) to ensure full data loads.
• Pagination Verification: Ensures robust handling of paginated APIs by verifying or configuring paginators.
• Incremental Loading Setup: Configures pipelines for efficient incremental data loading.
• Date Range Expansion: Adjusts date filters to capture a complete historical dataset.
• Use Case: You've developed a pipeline that works with .add_limit(1), but now need to load the entire dataset. This skill will help you safely remove the limit by verifying pagination and configuring it correctly.

Quick Start

Use the adjust-endpoint skill to optimize the 'my_pipeline' for production by verifying pagination and setting up incremental loading.