Februari 2024 - Mei 2024
For the company ToGaether (Algorythm group), I developed a demo of the brand new Microsoft Fabric.
This demo will be used to show Fabric's capabilities to potential ToGaether customers. Microsoft Fabric is an integrated platform that brings data and analytics together in one environment.
The demo is based on the Adventure Works dataset. We developed a master pipeline consisting of several subpipelines. These subpipelines in turn call our Spark notebooks, which cleanse, enrich and cast the data into delta tables. These delta tables can then be used in Power BI to visualise the data.
Furthermore, we also applied slowly changing dimensions type 1 & 2 to track changes in the data.
The end result is a complete pipeline that reads sales data, transforms it, stores it and processes it into a dashboard.