Thursday, June 18, 2026

Build Lakehouse using Iceberg

 Flow Diagram of Data Lakehouse



While Data Lake is excels for Machine Learning , Data warehouse is used for Business Intelligence , Data Lakehouse excels at both.

Data Lakehouse supports :

  •  ACID 
  • Schema Enforcement and Evaluation

Flow Diagram of Data Warehouse




Flow Diagram of Data Lake 



Medallion Architecture

  • Bronze - Raw data receive for replay
  • Silver - Clean data , processed
  • Gold - Features


Kafka for Fan Out Design Pattern 



where one stream is converted to multiple allowing more than one consumer 


at

No comments:

Post a Comment

Subscribe to: Post Comments (Atom)

Build Lakehouse using Iceberg

 Flow Diagram of Data Lakehouse While Data Lake is excels for Machine Learning , Data warehouse is used for Business Intelligence , Data Lak...