Architecture¶

Technology Stack¶

Framework: dlt (data load tool)
Package Manager: uv
Data Warehouse: Snowflake (production), DuckDB (development)
Secrets Management: Azure Key Vault
Language: Python 3.14+

Pipeline Structure¶

Source/
├── authorization.py         # API authentication
├── <domain>/
│   └── <domain>_sources.py  # Data definitions
└── pipelines/
    └── <domain>_pipeline.py # Execution