Tech Chat Slowly Changing Dimensions (SCD) Type 2

Channel Avatar
Tech Chat Slowly Changing Dimensions (SCD) Type 2
Tech Chat Slowly Changing Dimensions (SCD) Type 2
We will discuss a popular online analytics processing (OLAP) fundamental – slowly changing dimensions (SCD) – specifically Type-2. As we have discussed in various other Delta Lake tech talks, the reliability brought to data lakes by Delta Lake has brought a resurgence of many of the data warehousing fundamentals such as Change Data Capture in data lakes. Type 2 SCD within data warehousing allows you to keep track of both the history and current data over time. We will discuss how to apply these concepts to your data lake within the context of the market segmentation of a climbing eCommerce site.

Douglas Moore, Solution Architect

I’m passionate about helping customers find value in data analytics and helping the people I work better succeed. 25 year data veteran, ranging from embedded systems to massive cloud based data lakes. My early career interest centered around producing 3D animations of Finite Element Modeled Elastic Waves. Career wise, I came for the data visualizations and stayed for the computation and data. Past roles have included: Solutions Architect, Data Architect, CTO, Engineer. Current Specialties: Big Data Strategy & Architecture, Data Lakes, Streaming, Delta Lake, Spark, and Databricks. Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here.

Take the opportunity to connect and share this video with your friends and family if you find it useful.

Keywords: data warehouse, data warehousing, data lake, delta lake, data lakehouse, SCD, slowly changing dimensions, spark, data architecture, data engineering, database, DB, dbms, OLAP

Read Also

Leave a Reply

Your email address will not be published. Required fields are marked *