Evolution of Data Architectures
Overview The evolution from data warehouse to data lakes to a Lakehouse architecture Data Warehouse Architecture (1990s) The fast rise of the internet and social media and the availability of…
From Code to Insights: A Developer's Journey
Overview The evolution from data warehouse to data lakes to a Lakehouse architecture Data Warehouse Architecture (1990s) The fast rise of the internet and social media and the availability of…
Data Lake is an open-source project that enables building a data lakehouse on the top of existing cloud storage. It is It is not Open sourced Proprietary Technology Builds upon…
This post lists down a few Spark SQLs that focus on creating and loading delta lake tables, following by a group of handy statements to enrich loaded data and explicitly…
In the realm of data management, the need to efficiently track and manage changes in datasets has led to the development of Change Data Capture (CDC) techniques. CDC involves the…
This post provides insights into Delta Live Tables, distinguishing between Streaming Tables and Materialized Views, highlighting their features, differences, and best practices for Delta Live Pipeline Triggering Modes. What is…