Articles
May 2026
Each integration gets its own role.
StartupTechCo runs a fleet of vendor integrations: two flat-file vendors it pulls from over SFTP, a third that pushes files into an SFTP endpoint...
May 2026
Modular design decision docs.
Alignment lives at the facet level
May 2026
Apache Iceberg internals: snapshots, manifests, and time travel.
A scheduled merge into dim_members overwrote the member_id for a few hundred rows. The job had run the same way every day for months....
May 2026
Testing your data contracts with dbt: schema tests, custom tests, and CI.
In the last post, we built out the model structure: staging, intermediate, marts. This post is about testing it: asserting that what those models...
May 2026
dbt models, refs, and sources — a practical intro.
In the last post, we talked about the ownership problem: StartupTechCo’s transformation layer had grown into logic copied between notebooks and SQL duplicated across...
May 2026
Treating the transformation layer as a product.
The data engineer can tell you the history of how StartupTechCo’s transformation layer got the way it is. She helped build part of it...