SCD Type 3 in SQL and Python Introduction After recently designing a few Slowly Changing Dimensions with a client, I thought it would be good to revisit an earlier post theme and expand on the SCD Types. For more information on this blog series and Slowly Changing Dimensions with Databricks and Delta Lakes check out SCD TypeContinue reading “From Warehouse to Lakehouse Pt.3 – Slowly Changing Dimensions (SCD) with Delta”
Tag Archives: SQL
From Warehouse to Lakehouse Pt.2 – Slowly Changing Dimensions (SCD) with Delta
SCD Type 2 in SQL and Python Introduction For more information on this blog series and Slowly Changing Dimensions with Databricks and Delta Lakes check out SCD Type 1 from part 1 of the ‘From Warehouse to Lakehouse’ series:https://headinthecloud.blog/2021/08/17/from-warehouse-to-lakehouse-slowly-changing-dimensions-scd-with-delta-and-sql/ All code examples are available in SQL and Python (PySpark) from my GitHub repo so youContinue reading “From Warehouse to Lakehouse Pt.2 – Slowly Changing Dimensions (SCD) with Delta”
From Warehouse to Lakehouse Pt.1 – Slowly Changing Dimensions (SCD) with Delta
SCD Type 1 in SQL and Python Introduction With the move to cloud based Data Lake platforms there has often been criticism from the more traditional Data Warehousing community. A Data Lake, offering cheap, almost endlessly scalable storage in the cloud is hugely appealing to a platform administrator however over the number of years thatContinue reading “From Warehouse to Lakehouse Pt.1 – Slowly Changing Dimensions (SCD) with Delta”