Composable canonicals: from tribal data knowledge to versioned artifact
In this article, I'm exploring an AI-native architecture that aims to solve the traditional central data team problem.
7 of 800 posts
In this article, I'm exploring an AI-native architecture that aims to solve the traditional central data team problem.
dlt handles ingestion. dltHub adds the five ecosystem layers you'd otherwise build yourself: AI harness, context catalog, transformation, orchestration, managed infra.
Moving off Airbyte: what the switch to dlt does to your ops load, your bill, and who can build pipelines. Real numbers on cost, reliability, and maintenance.
Schema breaks, OOM deaths, duplicate loads, bus factor of one. What it takes to make hand-rolled pipelines production-grade, and what it costs to run them after.
What does the move do to my bill and my renewal? And how to move?
dltHub ships four Migration Blueprints: Python scripts, dlt, Fivetran, and Airbyte to dltHub. LLM-native tooling turns multi-month, senior-only migration projects into weeks of work at a fraction of the cost.
dltHub launches two Blueprints for agent spend: Agent Cost & Usage to break down what each model, person, and customer costs, and Agent Distillation (with distil labs) to replace expensive agents with cheaper specialist models.