Data Warehouse

[Wiki] In computing, a data warehouse (DW or DWH), also known as an enterprise data warehouse (EDW), is a system used for reporting and data analysis, and is considered as a core component of business intelligence. DWs are central repositories of integrated data from one or more disparate sources. They store current and historical data and are used for creating analytical reports for knowledge workers throughout the enterprise. Examples of reports could range from annual and quarterly comparisons and trends to detailed daily sales analysis.

The data stored in the warehouse is uploaded from the operational systems (such as marketing or sales). The data may pass through an operational data store for additional operations before it is used in the DW for reporting.

Goals

After completing this course, students will be able to:

  • Describe data warehouse concepts and architecture considerations.
  • Select an appropriate hardware platform for a data warehouse.
  • Design and implement a data warehouse.
  • Implement Data Flow using Talend, Pentaho BA …
  • Implement Control Flow using Talend, Pentaho BA.
  • Implement an ETL solution that supports incremental data extraction using Talend/Pentaho Data Integration.
  • Implement an ETL solution that supports incremental data loading using Talend/Pentaho Data Integration.
  • Implement data cleansing and enforce data integrity.
  • Describe how IBM Cognos solutions can consume data from the data warehouse.

Outline

  • Chapitre 1: Introduction to decision Information systems
  • Chapitre 2: Data warehousing
  • Chapitre 3: Multidimensional analysis
  • Chapitre 4: Introduction to Business analytics (optional training academy for IBM certification)
  • Chapitre 5: Cas study

Prerequisites and related courses

Basics about Relational Data Bases and a certain taste for SQL programming are required for this course.

Having attended the courses on DB Administration and on Web development can be useful and reveal interesting.

Language and material

The classes will be given in French by default. Slides will be in French/ English and available in PDF.

Bibliography

  • « Entrepôts de données, Guide paratique de modélisation dimentionnelle » Ralph Kimballe et Margy Ross, ed Vuibert, 2eme édition 2005.
  • « Le Datawarehouse, Guide de conduite de projets » Ralph Kimballe, Laura Reeves, Margy Ross, ed Eurolles 2005.
  • « Business intelligence avec SQL Server 2008 » Mise en oeuvre d’un projet décisionnel, Auteur : Bertrand Burquier, Editeur : Dunod, Septembre 2009
  • « Pentaho Solutions Business Intelligence and Data Warehousing with Pentaho and MySQL » Roland Bouman Jos van Dongen, Wiley Publishing, Inc, Sep 2009

Tentative Schedule

DATE (DD/MM/YY) TIME CONTENT material
24/02/17 08:00 AM to 12:00 AM Introduction to Decision Support Systems + Introduction to ETL Labs Chapter 1 + Lab1
03/03/17 08:00 AM to 12:00 AM Data warehousing + Exercices series n° 1 + Advanced ETL Labs Chapter 2 + Exercices n°1 + Lab2
10/03/17 08:00 AM to 12:00 AM Design and implement a data warehouse + Exercices series n° 1 + GIMSI  Chapter 2 + Exercices n°1 + Lab2
17/03/17 08:00 AM to 12:00 AM  Multidimensional Analysis + Exercices series n° 3 Chapter 3 +  Exercices n°2 + Lab3 + Dump

Lab 4

24/03/17 08:00 AM to 12:00 AM IBM Cognos Business Analytics (training academy for IBM certification) Introduction +  Cognos BA Fundamentals  1.1
31/03/17 08:00 AM to 12:00 AM IBM Cognos Business Analytics (training academy for IBM certification)  Lab4Cognos BA Fundamentals  1.2
07/04/17 08:00 AM to 12:00 AM Cas study Case study Pentaho BA + Script Dump 

New Project (Download here)

Project requirements:

• Team of 2 students at most;
• The work must be provided as a report and CD containing the data and Oracle and talend scripts before: Sunday, May 22, 2017;
• The date of the individual oral evaluation will be communicated later.

Old Project (Download here)