Materialized Lake Views in Microsoft Fabric

Introduction

In this article, i want to focus specifically on Materialized Lake Views (MLVs in order to better understand how they work and where they can be applied.

MLVs are still relatively new in Microsoft Fabric and, at first glance, do not fully align with what Microsoft has strongly promoted so far, namely a strict separation of the individual layers. Nevertheless, they represent a very interesting alternative, especially when it comes to reducing complex ETL processes.

In my projects, I generally follow the Medallion architecture, where I use a separate Lakehouse for each of the Bronze, Silver, and Gold layers. Alternatively, the Gold layer can also be implemented as a Fabric Warehouse.

This is exactly where Materialized Lake Views come into play, as they enable a different approach:

Instead of operating multiple Lakehouses for the individual layers, Bronze, Silver, and Gold can be represented via separate schemas within a single Lakehouse. The individual layers are logically separated while being technically created within the same Lakehouse.

Weiterlesen

SAP Mirroring in Microsoft Fabric with SAP Datasphere Step by Step Guide

Introduction

In this article, I walk through the complete process of replicating data from an SAP S/4HANA system into Microsoft Fabric. The goal was to build an end-to-end setup that connects the SAP landscape with modern analytics capabilities in Fabric. To achieve this, I combined several components from both SAP and Microsoft: the SAP Cloud Connector, SAP Datasphere, Azure Data Lake Storage Gen2, and finally the Mirrored SAP Database item inside Microsoft Fabric.

The article is based on the exact steps I carried out in my own environment. Along the way, I encountered a few challenges on the SAP side, especially when configuring the connection through the SAP Cloud Connector. Once this part was working, the remaining setup in Microsoft Fabric was straightforward. In the end, the result is a working replication pipeline that allows SAP data to be used directly in Fabric and prepared for further analytics scenarios.

Weiterlesen
« Ältere Beiträge