Advanced Database System - Printerous Data Warehouse

PROJECT DATA WAREHOUSE
T7023 ADVANCED DATABASE SYSTEM

PRINTEROUS DATA WAREHOUSE DESIGN, REPORT, OLAP
& BI DASHBOARD
using MySQL, Pentaho Software:
Pentaho Data Integration (PDI), Pentaho Report Designer (PRD),
Pentaho Schema Workbench (PSW) and Pentaho Business Analytics (BI Server)
and Tableau for BI Dashboard
www.printerous.com
Disusun oleh :
Kelompok 3
CHRISTIAN
ANTONI WIGUNA
RICO ANDROPURNOMO T.
EDO ASSHIDDIQ
WACHYU DANYANTO
Kelas: LTB2-LEC
Binus University
Jakarta
2016
1701533713
1701533480
1701532894
1701533474
1701533915
PT Printerous Global
PRINTEROUS DATA WAREHOUSE DESIGN AND REPORT
www.printerous.com
Table of Contents
1.
Company Background .............................................................................................................. 3

1.
Current Sales Business Unit Schema Diagram at Printerous ............................................... 4
2.
Dimensional Modeling (STAR Schema Design) for Printerous ................................................ 5
3.
ETL Processes in Pentaho Data Integration (Kettle) ................................................................ 6
4.
5.
6.
3.1.
Time Dimension................................................................................................................ 6
3.2.
SKU Dimension ................................................................................................................. 9
3.3.
USER Dimension ............................................................................................................. 12
3.4.
Location Dimension ........................................................................................................ 15
3.5.
Promotion Dimension .................................................................................................... 18
3.6.
Payment Method Dimension ......................................................................................... 21
3.7.
Sales Fact ........................................................................................................................ 24
3.8.
Printerous DWH ETL Load Job ........................................................................................ 27
Sales Report using Pentaho Report Designer ........................................................................ 29

4.1.
Yearly Sales Promotion Report ...................................................................................... 29
4.2.
Monthly Sales Report with Grouping ............................................................................. 31
4.3.
Sales Summary Report with Chart ................................................................................. 37
OLAP (Cube) Analysis ............................................................................................................. 40

5.1.
Cube Creation using Pentaho Schema Workbench ....................................................... 40
5.2.
Pentaho Schema Workbench XML Files (printerous_dwh.xml) .................................... 41
5.3.
OLAP Analysis using Pivot4J at Pentaho Business Analytics BI Server ........................... 44
BI Dashboard ......................................................................................................................... 49
6.1.
Dashboard Creation using Tableau Desktop 9.3 ............................................................ 49
6.2.
Viewing Dashboard ........................................................................................................ 51
6.3.
Publishing Dashboard to Web ........................................................................................ 53
Appendix A. List of Scripts, Schemas, Diagram and Report .......................................................... 54
Group Assignment - Advanced Database System (T7023)

Class: LTB2-LEC, Group# 3
Page 2 of 57
www.printerous.com
1. Company Background
= Print + Monstrous
Digital Online Printing Marketplace
Printerous (Brand dari PT Printerous Global) adalah sebuah platform online yang memproduksi
print dan cetakan dengan kualitas terbaik. Kami menyediakan berbagai produk dan jenis printing,
mulai dari cetak foto-foto personal, cetak karya seni, dan percetakan untuk bisnis, semuanya
berbasis online. Anda tidak perlu membuang waktu untuk pergi ke percetakan dan mengantri
selama berjam-jam, dengan Printerous sekarang semuanya mudah, cepat, dan tak perlu repot.
www.printerous.com
PT Printerous Global Location:

Jln. Kerinci 8 No. 25
Kebayoran Baru, 12120
Jakarta Selatan Indonesia
Phone: 021-29426241
E-mail: support@printerous.com

Page 3 of 57

1. Current Sales Business Unit Schema Diagram at Printerous
www.printerous.com
Page 4 of 57

2. Dimensional Modeling (STAR Schema Design) for Printerous
www.printerous.com
Page 5 of 57
www.printerous.com
3. ETL Processes in Pentaho Data Integration (Kettle)

3.1.
Time Dimension
Load Date/Time Dimension table (printerous_load_date_dim.ktr)

Page 6 of 57
www.printerous.com
Time Dimension Data before loading Date Dimension data Load Transformation
Loading Time Dimension Table

Page 7 of 57
www.printerous.com
Time Dimension Data after loading Date Dimension data Load Transformation

Page 8 of 57
3.2.
www.printerous.com
SKU Dimension
Load Product/SKU Dimension table (printerous_load_sku_dim.ktr)

Page 9 of 57
www.printerous.com
SKU Dimension Data before loading SKU Dimension data Load Transformation
Loading SKU Dimension table

Page 10 of 57
www.printerous.com
SKU Dimension Data after loading SKU Dimension data Load Transformation

Page 11 of 57
3.3.
www.printerous.com
USER Dimension
Load User Dimension table (printerous_load_user_dim.ktr)

Page 12 of 57
www.printerous.com
User Dimension Data before loading User Dimension data Load Transformation
Loading User Dimension table

Page 13 of 57
www.printerous.com
User Dimension Data after loading User Dimension data Load Transformation

Page 14 of 57
3.4.
www.printerous.com
Location Dimension
Load Location Dimension table (printerous_load_addr_dim.ktr)

Page 15 of 57
www.printerous.com
Location Dimension Data before loading Location Dimension data Load Transformation
Loading Location Dimension table

Page 16 of 57
www.printerous.com
Location Dimension Data after loading Location Dimension data Load Transformation

Page 17 of 57
3.5.
www.printerous.com
Promotion Dimension
Load Promotion Dimension table (printerous_load_promotion_dim.ktr)

Page 18 of 57
www.printerous.com
Promotion Dimension Data before loading Promotion Dimension data Load Transformation
Loading Promotion Dimension table

Page 19 of 57
www.printerous.com
Promotion Dimension Data after loading Promotion Dimension data Load Transformation

Page 20 of 57
3.6.
www.printerous.com
Payment Method Dimension
Load Payment Method Dimension table (printerous_load_promotion_dim.ktr)

Page 21 of 57
www.printerous.com
Payment Method Dimension Data before loading Payment Method Dimension data Load
Transformation
Loading Payment Method Dimension table

Page 22 of 57
www.printerous.com
Payment Method Dimension Data after loading Payment Method Dimension data Load
Transformation

Page 23 of 57
3.7.
www.printerous.com
Sales Fact
Load Sales Fact table (printerous_load_promotion_dim.ktr)

Page 24 of 57
www.printerous.com
Sales Fact Data before loading
Loading Sales Fact table

Page 25 of 57
www.printerous.com
Sales Fact Data after loading

Page 26 of 57
3.8.
www.printerous.com
Printerous DWH ETL Load Job

Page 27 of 57

www.printerous.com
Page 28 of 57
www.printerous.com
4. Sales Report using Pentaho Report Designer

4.1.
Yearly Sales Promotion Report

Page 29 of 57

www.printerous.com
Page 30 of 57
4.2.
www.printerous.com
Monthly Sales Report with Grouping

Page 31 of 57

www.printerous.com
Page 32 of 57

www.printerous.com
Page 33 of 57

www.printerous.com
Page 34 of 57

www.printerous.com
Page 35 of 57

www.printerous.com
Page 36 of 57
4.3.
www.printerous.com
Sales Summary Report with Chart

Page 37 of 57

www.printerous.com
Page 38 of 57

www.printerous.com
Page 39 of 57
www.printerous.com
5. OLAP (Cube) Analysis

5.1.
Cube Creation using Pentaho Schema Workbench
Publish CUBE Schema to Pentaho BI Server

Page 40 of 57
5.2.
www.printerous.com
Pentaho Schema Workbench XML Files (printerous_dwh.xml)

printerous_dwh.xml
<Schema name="printerous_dwh" description="Printerous DWH Cube">
<Dimension type="TimeDimension" visible="true"
highCardinality="false" name="Date">
<Hierarchy name="Dates" visible="true" hasAll="true"
primaryKey="Time_ID" primaryKeyTable="time_dim" caption="Sales Date">
<Table name="time_dim">
</Table>
<Level name="Year" visible="true" table="time_dim"
column="y" nameColumn="y" type="String" uniqueMembers="true"
levelType="TimeYears" hideMemberIf="Never" caption="Year"
captionColumn="y">
</Level>
<Level name="Quarter" visible="true" table="time_dim"
column="q" nameColumn="quarter_name" type="Integer"
uniqueMembers="false" levelType="TimeQuarters" hideMemberIf="Never"
caption="Quarter" captionColumn="quarter_name">
</Level>
<Level name="Months" visible="true" table="time_dim"
column="m" nameColumn="month_name" type="Numeric"
uniqueMembers="false" levelType="TimeMonths" hideMemberIf="Never"
caption="Month" captionColumn="month_name">
</Level>
<Level name="Days" visible="true" table="time_dim"
column="d" nameColumn="FullDate" type="String" uniqueMembers="false"
levelType="TimeDays" hideMemberIf="Never" caption="Day"
captionColumn="FullDate">

Page 41 of 57
www.printerous.com
</Level>
</Hierarchy>
</Dimension>
<Dimension type="StandardDimension" visible="true"
highCardinality="false" name="Product">
<Hierarchy name="SKU" visible="true" hasAll="true"
primaryKey="SKU_ID" primaryKeyTable="sku_dim">
<Table name="sku_dim">
</Table>
<Level name="SKU_Type" visible="true" table="sku_dim"
column="SKU_TYPE" type="String" uniqueMembers="false"
levelType="Regular" hideMemberIf="Never">
</Level>
<Level name="SKU_Name" visible="true" table="sku_dim"
column="SKU_NAME" type="String" uniqueMembers="false"
</Level>
</Hierarchy>
</Dimension>
highCardinality="false" name="Promotion">
<Hierarchy name="Promotion" visible="true" hasAll="true"
primaryKey="PROMOTION_ID" primaryKeyTable="promotion_dim">
<Table name="promotion_dim">
</Table>
<Level name="Promotion_Name" visible="true"
table="promotion_dim" column="PROMOTION_NAME" type="String"
uniqueMembers="false" levelType="Regular" hideMemberIf="Never">
</Level>
</Hierarchy>
</Dimension>
highCardinality="false" name="Location">
<Hierarchy name="Address" visible="true" hasAll="true"
primaryKey="LOCATION_ID" primaryKeyTable="location_dim">
<Table name="location_dim">
</Table>
<Level name="Country" visible="true" table="location_dim"
column="COUNTRY" type="String" uniqueMembers="false"
</Level>
<Level name="City" visible="true" table="location_dim"
column="CITY" type="String" uniqueMembers="false" levelType="Regular"
hideMemberIf="Never">
</Level>
</Hierarchy>
</Dimension>
highCardinality="false" name="Customer">
<Hierarchy name="User" visible="true" hasAll="true"
primaryKey="USER_ID" primaryKeyTable="user_dim">
<Table name="user_dim">
</Table>
<Level name="Gender" visible="true" table="user_dim"
column="GENDER" type="String" uniqueMembers="false"

Page 42 of 57
www.printerous.com
</Level>
</Hierarchy>
</Dimension>
highCardinality="false" name="Payment_Method">
<Hierarchy name="Payment_Method" visible="true" hasAll="true"
primaryKey="PAYMENT_ID" primaryKeyTable="payment_method_dim">
<Table name="payment_method_dim">
</Table>
<Level name="Payment_Type" visible="true"
column="PAYMENT_NAME" type="String" uniqueMembers="false"
</Level>
</Hierarchy>
</Dimension>
<Cube name="printerous_dwh_cube" caption="Printerous DWH Cube"
visible="true" description="Printerous DWH Cube" cache="true"
enabled="true">
<Table name="sales_fact">
</Table>
<DimensionUsage source="Date" name="Sales_Date"
caption="Sales Date" visible="true" foreignKey="Time_ID"
highCardinality="false">
</DimensionUsage>
<DimensionUsage source="Product" name="Product"
caption="Product" visible="true" foreignKey="SKU_ID"
</DimensionUsage>
<DimensionUsage source="Promotion" name="Promotion"
caption="Promotion" visible="true" foreignKey="Promotion_ID"
</DimensionUsage>
<DimensionUsage source="Location" name="Customer_Location"
caption="Customer Location" visible="true" foreignKey="Address_ID"
</DimensionUsage>
<DimensionUsage source="Payment_Method" name="Payment_Method"
caption="Payment Method" visible="true" foreignKey="Payment_ID"
</DimensionUsage>
<DimensionUsage source="Customer" name="User" caption="User"
visible="true" foreignKey="User_ID" highCardinality="false">
</DimensionUsage>
<Measure name="Sales_IDR" column="Final_Price_IDR"
datatype="Numeric" aggregator="sum" caption="Sales (IDR)"
visible="true">
</Measure>
<Measure name="Sales_QTY" column="QTY" datatype="Numeric"
aggregator="sum" caption="Sales (QTY)" visible="true">
</Measure>
</Cube>
</Schema>

Page 43 of 57

CUBE_Printerous_DWH_Final.pivot4j
OLAP Analysis using Pivot4J at Pentaho Business Analytics BI Server

5.3.
www.printerous.com
Page 44 of 57

Final OLAP Analysis using Pivot4j
www.printerous.com
Page 45 of 57

Export to XLS
www.printerous.com
Page 46 of 57

Export to PDF
www.printerous.com
Page 47 of 57

www.printerous.com
Page 48 of 57
www.printerous.com
6. BI Dashboard
6.1.
Dashboard Creation using Tableau Desktop 9.3

Develop Yearly Sales Promotion Report Worksheet
Develop Monthly Sales Report Worksheet

Page 49 of 57
www.printerous.com
Develop Sales Summary Report Worksheet
Develop Printerous DASHBOARD

Page 50 of 57
6.2.
www.printerous.com
Viewing Dashboard
View Yearly Sales Promotion Report
View Monthly Sales Report

Page 51 of 57
www.printerous.com
View Sales Summary Report
View Dashboard

Page 52 of 57

Website Public Access (Tableau Public Account):

https://public.tableau.com/profile/wdanyanto#!/vizhome/Printerous_DWH/PrinterousDashboard
Publishing Dashboard to Web

6.3.
www.printerous.com
Page 53 of 57
www.printerous.com
Appendix A. List of Scripts, Schemas, Diagram and Report

Printerous DB Original Diagram (printerous_db)

Page 54 of 57
www.printerous.com
Printerous DWH Star Schema Diagram (printerous_dwh)
No Script/File Name
Description
For ETL Processes Pentaho Data Integration version 6.0.1.0-386
printerous_db_for_loading_v1.6_final.sql
Original
Printerous DB
Schema
Subset of Data
(Sales Business
Unit) v1.5
printerous_dwh_schema_v1.6_final.sql
Printerous DWH
Schema v1.5
truncate_printerous_dwh.sql
printerous_load_date_dim.ktr
printerous_load_sku_dim.ktr
Truncate all
table in
Printerous DWH
schema
PDI
Transformation
Load Date
Dimension
PDI
Transformation
Load SKU
Dimension

File
printerous_db_for_loading_v1.6_final.sql
printerous_dwh_schema_v1.6_final.sql
truncate_printerous_dwh.sql
printerous_load_date_dim.ktr
printerous_load_sku_dim.ktr
Page 55 of 57
printerous_load_user_dim.ktr
printerous_load_addr_dim.ktr
printerous_load_promotion_dim.ktr
printerous_load_payment_method.ktr
10
printerous_load_sales_fact_v1.2.ktr
11
printerous_dwh_ETL_job_v1.2.kjb
12
printerous_dwh_v1.6.mwb
PDI
Transformation
Load User
Dimension
PDI
Transformation
Load Location
Dimension
PDI
Transformation
Load
Promotion
Dimension
PDI
Transformation
Load Payment
Method
Dimension
PDI
Transformation
Load Sales
Fact
PDI Job ETL
Loading
Processes
Printerous DWH
MySQL
Workbench
Model
www.printerous.com
printerous_load_user_dim.ktr
printerous_load_addr_dim.ktr
printerous_load_promotion_dim.ktr
printerous_load_payment_method.ktr
printerous_load_sales_fact_v1.2.ktr
printerous_dwh_ETL_job_v1.2.kjb
printerous_dwh_v1.6.mwb
For Report Pentaho Report Designer version 6.1.0.1-196

PRD Report File
1
01-Yearly_Sales_Promotion_Report_Final.prpt
01-Yearly_Sales_Promotion_Report_Final.prpt
PRD Report File
02-Monthly_Sales_Report_with_grouping_Final.prpt
02-Monthly_Sales_Report_with_grouping_Final.prpt
PRD Report File
03-Sales_Summary_Report_with_Chart_Final.prpt
printerous_dwh_schema_after_loading_v1.5_final.sql
03-Sales_Summary_Report_with_Chart_Final.prpt
Printerous DWH
Schema with
Data
printerous_dwh_schema_after_loading_v1.5_final.sql
For OLAP CUBE Analysis :

Pentaho Schema Workbench version 3.11.1.0-386
Pentaho BI version 6.0.1.0-386
1
printerous_dwh.xml
Printerous CUBE
Pentaho
Schema
Workbench

printerous_dwh.xml
Page 56 of 57
CUBE_Printerous_DWH_Final.pivot4j.zip
printerous_dwh_olap_cube_analysis_FINAL.xls
www.printerous.com
Pivot4j OLAP
Analysis File
CUBE_Printerous_D
WH_Final.pivot4j.zip
Pivot4j export to
XLS
printerous_dwh_olap
_cube_analysis_FINAL.xls
For BI Dashboard (Using Tableau):

Tableau Desktop 9.3
Tableau Public Account
(https://public.tableau.com/profile/wdanyanto#!/vizhome/Printerous_DWH/PrinterousDashboard )
1
Printerous_DWH.twb
Printerous_DWH.twbx
sales_fact+ (printerous_dwh).tde
Tableau
Workbook
(*.twb)
Tableau
Packaged
Workbook
(*.twbx)
Tableau Data
Extract (*.tde)

Printerous_DWH.twb
Printerous_DWH.twbx
sales_fact+ (printerous_dwh).tde
Page 57 of 57

Advanced Database System - Printerous Data Warehouse

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Advanced Database System - Printerous Data Warehouse

Uploaded by

Copyright:

Available Formats

PROJECT DATA WAREHOUSE

T7023 ADVANCED DATABASE SYSTEM

Company Background .............................................................................................................. 3

Current Sales Business Unit Schema Diagram at Printerous ............................................... 4

Dimensional Modeling (STAR Schema Design) for Printerous ................................................ 5

ETL Processes in Pentaho Data Integration (Kettle) ................................................................ 6

SKU Dimension ................................................................................................................. 9

USER Dimension ............................................................................................................. 12

Location Dimension ........................................................................................................ 15

Promotion Dimension .................................................................................................... 18

Payment Method Dimension ......................................................................................... 21

Sales Fact ........................................................................................................................ 24

Printerous DWH ETL Load Job ........................................................................................ 27

Sales Report using Pentaho Report Designer ........................................................................ 29

Yearly Sales Promotion Report ...................................................................................... 29

Monthly Sales Report with Grouping ............................................................................. 31

Sales Summary Report with Chart ................................................................................. 37

OLAP (Cube) Analysis ............................................................................................................. 40

Cube Creation using Pentaho Schema Workbench ....................................................... 40

Pentaho Schema Workbench XML Files (printerous_dwh.xml) .................................... 41

OLAP Analysis using Pivot4J at Pentaho Business Analytics BI Server ........................... 44

Dashboard Creation using Tableau Desktop 9.3 ............................................................ 49

Viewing Dashboard ........................................................................................................ 51

Publishing Dashboard to Web ........................................................................................ 53

Appendix A. List of Scripts, Schemas, Diagram and Report .......................................................... 54

Group Assignment - Advanced Database System (T7023)

PT Printerous Global Location:

Group Assignment - Advanced Database System (T7023)

PRINTEROUS DATA WAREHOUSE DESIGN AND REPORT

Group Assignment - Advanced Database System (T7023)

1. Current Sales Business Unit Schema Diagram at Printerous

PRINTEROUS DATA WAREHOUSE DESIGN AND REPORT

Group Assignment - Advanced Database System (T7023)

2. Dimensional Modeling (STAR Schema Design) for Printerous

3. ETL Processes in Pentaho Data Integration (Kettle)

Load Date/Time Dimension table (printerous_load_date_dim.ktr)

Group Assignment - Advanced Database System (T7023)

Loading Time Dimension Table

Group Assignment - Advanced Database System (T7023)

Group Assignment - Advanced Database System (T7023)

Load Product/SKU Dimension table (printerous_load_sku_dim.ktr)

Group Assignment - Advanced Database System (T7023)

Loading SKU Dimension table

Group Assignment - Advanced Database System (T7023)

Group Assignment - Advanced Database System (T7023)

Load User Dimension table (printerous_load_user_dim.ktr)

Group Assignment - Advanced Database System (T7023)

Loading User Dimension table

Group Assignment - Advanced Database System (T7023)

Group Assignment - Advanced Database System (T7023)

Load Location Dimension table (printerous_load_addr_dim.ktr)

Group Assignment - Advanced Database System (T7023)

Loading Location Dimension table

Group Assignment - Advanced Database System (T7023)

Group Assignment - Advanced Database System (T7023)

Load Promotion Dimension table (printerous_load_promotion_dim.ktr)

Group Assignment - Advanced Database System (T7023)

Loading Promotion Dimension table

Group Assignment - Advanced Database System (T7023)

Group Assignment - Advanced Database System (T7023)

Payment Method Dimension

Load Payment Method Dimension table (printerous_load_promotion_dim.ktr)

Group Assignment - Advanced Database System (T7023)

Loading Payment Method Dimension table