This post is the second in a series of detailed cases studies discussing the ETL strategies that can be used when a Persistent staging layer is included in your Data Warehouse. It’s intended as a reference for developers using Dimodelo Data Warehouse Studio, our Data Warehouse Automation tool to quickly build a Data Warehouse. It’s most…
Why you Need a Persistent Layer 1. All history, all of the time, instead of some history some of the time Including a persistent layer in your architecture is a paradigm shift in how you see the data warehouse. In the popular Kimball methodology, without the persistent layer, the data warehouse layer was responsible for…
The persistent layer contains as set of persistent tables that record the full history of changes to the data of the table/query that is the source of the Persistent table. The source could a source table/file, a source query, another staging table or a view/materialized view in the transform layer. In a persistent table there…
This post is the first in a series of detailed cases studies discussing the ETL strategies that can be used when a Persistent staging layer is included in your Data Warehouse. It’s intended as a reference for developers using Dimodelo Data Warehouse Studio, our Data Warehouse Automation tool to quickly build a Data Warehouse. It’s…
In this episode, I had the pleasure of speaking with Chris Webb, a well respected independent consultant based in the UK. He specialises in Analysis Services, MDX, Power Pivot, DAX, Power Query and Power BI in general. He is a widely read blogger having authored more than a 1000 posts over the last 10 years. …
At Dimodelo, we have been hard at work, redesigning the Data Warehouse data management architecture that Dimodelo Data Warehouse Studio (our Data Warehouse Automation tool) generates. Working with our clients we have introduced a Persistent Layer into the data warehouse architecture. “What is a Persistent Layer?” I hear you ask. The persistent layer contains as…
In this episode, it is my pleasure to speak with Mark Tabladillo, Lead Data Scientist for Microsoft Services — Data and Artificial Intelligence (Chief Technology Office). He works as part of a global team with Fortune 500 companies, global leading institutions, and high-tech startups toward digital transformation using advanced analytics. Mark is passionate about educating…
Talking Analytics Platform Services with Ashley Furniture’s Data Architect Phil Haddad, and Microsoft’s Principal Program Manager in the Azure SQL Data Warehouse team, Matt Usher. In this podcast we discuss: Refractoring an exising data warehouse Automating data warehouse development in an enterprise environment with 700 applications Migrating to Azure Data Warehouse from PDW/APS The role Microsoft Partners…
How do you gather requirements for a Data Warehouse/Business Intelligence project ? Typically, on a BI project, if you ask a business user, ‘what do you want’ you will get one of 2 responses. I don’t know. I want everything. Which are, effectively, the same thing… As much as it pains IT people to hear…
