What problem does it solve? Setting up a dlt data pipeline against a generic REST or HTTP API requires knowing the dlthub CLI, RESTAPIConfig structure, auth configuration, and secrets management, which is slow to assemble from scratch. ## Core Features & Use Cases - Pipeline Scaffolding: Runs dlthub pipeline init non-interactively to generate the pipeline script, config, and requirements files. - Single-Endpoint Configuration: Guides editing of the generated pipeline with base_url, auth, endpoint path, data_selector, params, and primary_key, using dev_mode and replace write disposition for fast debugging. - Secrets & Config Setup: Directs non-secret values into .dlt/config.toml and manages credentials through redacted secrets tools without exposing secret values. - Use Case: You want to load data from the Shopify REST API into DuckDB. Provide the init command, pick one endpoint, and get a working minimal pipeline ready for its first debug run. ## Quick Start Ask the assistant to create a dlt REST API pipeline by providing a dlthub pipeline init command such as "dlthub pipeline init rest_api duckdb".
