From Warehouse to Lakehouse Pt.3 – Slowly Changing Dimensions (SCD) with Delta

SCD Type 3 in SQL and Python Introduction After recently designing a few Slowly Changing Dimensions with a client, I thought it would be good to revisit an earlier post theme and expand on the SCD Types. For more information on this blog series and Slowly Changing Dimensions with Databricks and Delta Lakes check out SCD TypeContinue reading “From Warehouse to Lakehouse Pt.3 – Slowly Changing Dimensions (SCD) with Delta”

Tips for the Databricks Certified Associate Developer for Apache Spark 3.0 – Python – Pt.2

Following on from my previous post I wanted to cover off some more key topics that can really help your understanding of Spark and diving in to the Databricks Certified Associate Developer for Apache Spark 3.0 exam. For more information on general assessment tips, great practice exams to take and other core topics, please seeContinue reading “Tips for the Databricks Certified Associate Developer for Apache Spark 3.0 – Python – Pt.2”

Tips for the Databricks Certified Associate Developer for Apache Spark 3.0 – Python – Pt.1

After recently diving in to (and passing!) the Associate Developer for Apache Spark 3.0 exam certification from Databricks, I thought it would be useful to go over some quick points to remember and some potential ‘gotcha’ topics for anyone considering the challenge. The majority of the exam (72% in fact) features the use of theContinue reading “Tips for the Databricks Certified Associate Developer for Apache Spark 3.0 – Python – Pt.1”