PinnedDave Flynndbt best practices in action at Cal-ITP’s data-infra projectCal-ITP uses a standardized PR template and automated report for comprehensive PR review. See their process in-action with example PRs8 min read·Apr 18, 2024----
DouenergyFrom Zero to dbt: Part 2 — Modeling Spotify’s Million Playlist Datasetdbt helps us encapsulate logic within individual models and promotes a more structured and manageable development workflow12 min read·1 day ago----
DouenergyAnalytical SQL Tips Series — Lateral Column AliasSimplify your SQL by reusing expressions with Lateral Column Alias2 min read·4 days ago--1--1
Dave FlynnSpeed up pull request review for SQLMesh data projectsSQLMesh is a powerful ELT platform with features to help you iterate data pipelines with velocity. Do the same for your SQLMesh PR reviews!5 min read·5 days ago----
Dave FlynnAnnouncement: Recce now integrates with SQLMesh bringing enhanced data validation and PR reviewSQLMesh users can take advantage of the enhanced data validation and PR review tools in Recce to catch data issues before merging2 min read·May 7, 2024----
Dave Flynn‘Thoughtful PR Review’ is now a requirement for data jobsPR review is the ‘ Point of no Return’ — The last checkpoint before code is merged and prod data is changed. How do you review yours?5 min read·Apr 30, 2024----
DouenergyAnalytical SQL Tips Series —Qualify ClauseIn SQL, the QUALIFY clause is essential for filtering results from WINDOW functions, serving a similar purpose as the HAVING clause does…2 min read·Apr 19, 2024--2--2
Dave FlynnSo, you think you’ve got dbt test bloat?After a certain threshold, alert fatigue becomes an issue, especially when upstream issues trigger hundreds of downstream alerts5 min read·Apr 18, 2024----
DouenergyFrom Zero to dbt: How to Analyze and Build Data Models from Spotify’s Million Playlist DataPart 1: Analyze the 30GB json dataset with DuckDb and jq, then convert to Parquet to prep for dbt10 min read·Apr 12, 2024--3--3
DouenergyAnalytical SQL Tips Series — Filter ClauseIn SQL there’s often more than one way to skin a cat, er… filter an aggregate. Here’s a SQL tip for those of you using DuckDB or Postgres2 min read·Apr 9, 2024----