Trials and Tribulations of Incremental Models

Vincey Au
Data Analyst, Canva

10 December 2021, 12:55 AM

Reserve your spot to attend Coalesce

By submitting your email you agree to the Terms of Service and Privacy Statement
Register

Categories covered by this talk

About this talk

Incremental models are core to dbt, and are a key solution to how data teams balance the need for computationally efficient and timely data. This talk will discuss some challenges with building incremental models at scale, and how our approach has evolved over time in a high-growth company with over 30 third-party sources of data. On a technical level, this will cover the is_incremental() SQL block logic, as well as custom materializations that make building models simpler and more efficient.

Join the chat in the #coalesce-trials-tribulations-models channel (https://bit.ly/3oncqVB). If you’re not yet a member of dbt Community Slack, sign up at https://www.getdbt.com/community/join-the-community

Proudly supported by

Want to sponsor this event? contact us.