importing

What problem does it solve?

BeepDM's DataImportManager provides a robust framework for moving data from external sources into target databases, applying transformations, enforcing validations, and handling batch processing. This Skill helps engineers design, configure, and execute import workflows with defaults integration and auditing support, reducing manual effort and data quality issues.

Core Features & Use Cases

• Helper-based architecture with specialized helpers for validation, transformation, batch processing, and progress tracking.
• DefaultsManager integration to apply default values during import.
• Batch processing, field filtering, and field mappings to handle large datasets efficiently.
• Validation and data-compatibility checks prior to import to ensure data integrity.
• Use cases include migrating data from external systems, incremental imports, multi-entity imports, and data migrations with auditing.

Quick Start

Create a basic import configuration from a SourceSystem to a MainDatabase and execute RunImportAsync with an appropriate batch size.