Data Warehouse/Business Intelligence Requirements – How To ?

How do you gather requirements for a Data Warehouse/Business Intelligence project ? Typically, on a BI project, if you ask a business user, ‘what do you want’ you will get one of 2 responses. I don’t know. I want everything. Which are, effectively, the same thing… As much as it pains IT people to hear…

|

Improve performance of SSIS using defaultBufferSize

[et_pb_section admin_label=”section”][et_pb_row admin_label=”row”][et_pb_column type=”4_4″][et_pb_text admin_label=”Text” background_layout=”light” text_orientation=”left” text_font_size=”14″ use_border_color=”off” border_color=”#ffffff” border_style=”solid”] Use the defaultBufferSize setting to improve the throughput of SSIS package. Key things you need to know: Each component in an SSIS data flow is assigned a memory buffer. The default is about 10MB. When your source is a wide table (i.e. has many or large…

| |

New managed Incremental Extract Pattern

[et_pb_section admin_label=”section”][et_pb_row admin_label=”row”][et_pb_column type=”4_4″][et_pb_text admin_label=”Text” background_layout=”light” text_orientation=”left” text_font_size=”14″ use_border_color=”off” border_color=”#ffffff” border_style=”solid”] Dimodelo Data Warehouse Studio now allows you to extract only changed data from your source system, reducing load on your source systems and overall ETL duration. I.e. To do change data capture (CDC) at the source. Dimodelo Data Warehouse Studio now includes a managed…

Build a Data Warehouse from Freshbooks (SaaS) data

[et_pb_section admin_label=”section”][et_pb_row admin_label=”row”][et_pb_column type=”4_4″][et_pb_text admin_label=”Text” background_layout=”light” text_orientation=”left” text_font_size=”14″ use_border_color=”off” border_color=”#ffffff” border_style=”solid” custom_margin=”0px|||”] This video demonstrates using Dimodelo Data Warehouse Studio (a data warehouse automation tool) to generate a data warehouse using Freshbooks as a source. Freshbooks is a SaaS provider for timesheets and invoicing. Using ODBC drivers (like those provided by CData) Dimodelo Data Warehouse…

Dimodelo Data Warehouse Studio adds batch monitoring and analysis

The following enhancements have been made in Dimodelo Data Warehouse Studio 2015 2.9: Monitor and Analyse your ETL batches. Dimodelo now writes its ETL batch execution log to an SQL Server database. New PowerBI dashboards have been created to help you monitor and analyse your ETL batches. Support for ODBC Sources. Connect to just about…

Is Data Warehouse Automation good for BI Professionals?

As professionals, anything that makes our job significantly easier, can be conceived as a threat. I must be honest, when Microsoft started on its journey of ‘Self Service BI’, PowerPivot, PowerView etc, I perceived this as a threat, and as a watering down of my skillset. However there is two truths that you can’t get away…

Data Warehouse Automation – the next big thing

Jet Reports have written an interesting article on Data Warehouse Automation. It appears this concept is gaining recognition. TDWI has also recognized the value of Data Warehouse Automation, as one of the emerging trends for 2015 and beyond. I’ve also written an introduction article on the who, what, where, when and why of Data Warehouse Automation….

|

Automate build and deployment of SSAS Cubes using MSBUILD

This post describes how to use MSBUILD to automate the build and deployment of a SSAS Analysis Services Cube. This solution relies on calling Visual Studio (devenv.exe) from within MSBUILD to first build the Cube and then using the SSAS deployment wizard from the command line to deploy the Cube. The first thing to understand…