How to configure and run your ETL batches through the Dimodelo Management Console on your servers, and through Dimodelo Architect. The document also explains the contents of the Batch log database.
Dimodelo Architect is a Data Warehouse Automation tool. Using Dimodelo Architect a developer designs a Data Warehouse, and then generates the necessary SSIS Packages for ETL, and DDL to create/maintain the Data Warehouse and Staging databases.
Dimodelo Architect should be familiar to Microsoft developers because it is built as an addition to Visual Studio, the Microsoft Development Environment.
The first step in developing a Data Warehouse through Dimodelo Architect is to create a new Dimodelo Architect Project. Once the project is created the next step is define one or more Connection Managers for the Source Systems of the Data Warehouse. For each Connection Manager it is necessary to add additional information in a Source System record.
Developers can now start to design the Data Warehouse. A quick start method is to use the Star Schema Wizard to quickly identify Fact tables in the Source Systems, and define Dimensions for those Fact tables. However a developer may choose to just jump straight in, and start designing Staging tables, Dimensions, and Fact tables.
Once a set of Staging tables, Dimension and Facts are defined, the developer can Generate the code. Generation creates both the DDL (T-SQL) to create/maintain the Staging and Data Warehouse databases, it also generates the SSIS packages that implement the ETL. Generated code can then be deployed to a local or remote server.
Dimodelo Architect allows the user to Run an ETL batch, through either the Dimodelo Architect interface, or via Dimodelo Management Console on a server. Using this method, a Developer can iterate through a series of releases very quickly, continually refining the design. A Data Warehouse built through Dimodelo Architect is very flexible. Itâ€™s just a matter of changing the design and re-generating. Once you are more familiar with Dimodelo Architect you will want to start working with more sophisticated functionality. This includes:
- Supporting multiple environments through Dimodelo Architect Project Configuration.
- Defining ETL Batch Workflows.
- Deploying to Servers and Scheduling ETL Batches.
- Advance design techniques including support for: