Professional Documents
Culture Documents
Innoveer Solutions
Copyright Notice The Copyright in this work is vested in Innoveer Solutions Inc. and the document is issued in confidence for the express purpose for which it is supplied. It must not be reproduced, in whole or in part, or be used for any other purpose without prior written consent being obtained from Innoveer Solutions Inc., and then only on the condition that this notice be included in any such reproduction. No information as to the contents or subject matter of this document, or any part thereof, arising directly or indirectly there from shall be given orally or in writing or communicated in any manner whatsoever to any third party without the prior written consent of Innoveer Solutions Inc. Copyright Innoveer Solutions Inc. 2010 Revision History
Version 0.1 Author Chenly Paz Status Draft Date 09/23/2010 Revisions Initial document created
Page 2 of 24
Printed 19/08/11
Contents
1 Introduction .................................................................................................................. 4
Document Purpose ......................................................................................... 4 Scope ............................................................................................................. 4 Related Documents ........................................................................................ 4 Abbreviations .................................................................................................. 5 Toolset Used .................................................................................................. 6 Implementation Strategy ................................................................................. 9 Opportunity Star Schema ............................................................................. 10 UOPS Sales Star Schema ............................................................................ 12 MST Analysis Star Schemas ........................................................................ 12 Territory Alignment Star Schemas ................................................................ 13 Course Analysis Star Schemas .................................................................... 14 Overview....................................................................................................... 15 DWH Tables Definitions................................................................................ 16 Informatica Repository Changes................................................................... 19 DAC Repository Setup.................................................................................. 20 Overview....................................................................................................... 21 Real-Time Answers Reporting ...................................................................... 22 Dashboards .................................................................................................. 24 Siebel Embedded Reports ......................................................................... 24 Siebel BI Publisher Report......................................................................... 24
2.1 2.2
3
Star Schemas.............................................................................................................. 10
ETL .............................................................................................................................. 15
5.1 5.2
6
Page 3 of 24
Printed 19/08/11
1 Introduction
1.1 Document Purpose
This document outlines the changes to the current Siebel application configuration as well as standard Oracle BI Applications v7.9.6.1 modification to be implemented for the purpose of the JAR 1 and JAR 2 build for Pearson Education 3Sixty Release 1
1.2 Scope
This technical design document only includes JAR 1 and JAR 2 deliverables. This scope corresponds to what is required to be built and presented in JAR 3. Please refer to the BI JAR Delivery Schedule to gain more clarity on what is included in this JAR. Data-Level permissions and other security or visibility-related requirements will be designed in later JARs and will not be part of this particular design document. In addition, the following have been deemed out of scope for this document due to necessary lag between application design and reporting design: y Reports specific to products analysis only y Product Specialist reporting where there is a requirement to link a product specialist to their corresponding FT discipline y Complex requirements related to Product Kits and component level reporting
Page 4 of 24
Printed 19/08/11
1.4 Abbreviations
# 1 2 3 4 5 6 Abbreviation OBIEE OOTB OLAP ETL DAC BIU / PIU Definition Oracle Business Intelligence Enterprise Edition Out of the Box Online Analytical Processing Extract, Transform and Load Data Warehouse Admin Console Book In Use / Product In Use
Page 5 of 24
Printed 19/08/11
2 Solution Overview
2.1 Toolset Used
The Oracle Business Intelligence Suite Enterprise Edition (OBIEE) is a comprehensive suite of Business Intelligence tools and infrastructure designed to bring greater business visibility and insight to the broadest audiences of users, allowing any user in an organization to have Web-based self-service access to up-to-the moment, relevant, and actionable intelligence. OBIEE comprises of BI server technology and BI presentation tools. The platform consists of several interdependent components, with the Oracle BI Server at its core. Business Intelligence Server The foundation of the Oracle Business Intelligence Suite Enterprise Edition Plus platform is a true BI server that is designed to be highly scalable, optimizing concurrency and parallelism to make the value of BI applications available to the largest possible audience. It provides centralized data access and calculation, essentially creating a large pipe through which anyone can consume any information in any form anywhere in the enterprise. The BI server is central to all of the business processes that consume information, including dashboards, ad hoc queries, intelligent interaction capabilities, enterprise and production reporting, financial reporting, OLAP analysis, data mining, and other Web Service-based applications (J2EE and .NET). All of these applications require rich access to broad sets of data across the enterprise, and they all require a sophisticated calculation and aggregation infrastructure that the platform provides to deliver value. The platform supports a full complement of access, analysis, and information delivery options, all in one fully integrated Web environment. Each of these components serves different audiences in the organization who have different appetites for the same underlying data, but need to access it in different ways. But unlike other BI tools, all components are integrated onto one common architecture, enabling a seamless and intuitive user experience. Intelligence Dashboards Oracle BI Interactive Dashboards provide any knowledge worker with intuitive, interactive access to information that is actionable and dynamically personalized based on the individual's role and identity. In the Oracle BI Intelligence Dashboards environment, the end user is working with live reports, prompts, charts, tables, pivot tables, graphics, and tickers in a pure Web architecture. The user has full capability for drilling, navigating, modifying, and interacting with these results. Oracle BI Intelligence Dashboards can also aggregate content from a wide variety of other sources, including the Internet, shared file servers, and document repositories. Answers Page 6 of 24 Printed 19/08/11
Oracle BI Answers provides true end user ad hoc capabilities in a pure Web architecture. Users interact with a logical view of the informationcompletely hidden from data structure complexity while simultaneously preventing runaway queriesand can easily create charts, pivot tables, reports, and visually appealing dashboards, all of which are fully interactive, drillable and can be saved, shared, modified, formatted, or embedded in the user's personalized Oracle BI Intelligence Dashboards. The results are new levels of business user self-sufficiency in an environment that is fully secure and controlled by IT. Delivers Oracle BI Delivers is a proactive intelligence solution that provides business activity monitoring and alerting that can reach users via multiple channels such as email, dashboards, and mobile devices. Oracle BI Delivers includes a full Web-based selfservice alert creation and subscription portal. This next-generation product can initiate and pass contextual information to other alerts to execute a multistep, multi-person, and multi-application analytical workflow. Furthermore, it can dynamically determine recipients and personalized content to reach the right users at the right time with the right information. Reporting Solution for 3Sixty Analytics Reporting For the purpose of JAR 1 and JAR 2 implementation, the reporting solution will comprise of OBIEE Platform v10.1.3.4.1 with Oracle BI Applications v7.9.6.1 providing all necessary metadata and ETL logic. Oracle BI Applications use Oracle Business Analytics Warehouse - a unified data repository, also referred as Data Warehouse, for all customer-centric data - as a primary data source to support the majority of analytical reporting requirements. OBIEE application will be integrated with Siebel and exposed to end users via additional Screens and Views.
Page 7 of 24
Printed 19/08/11
Users will be granted access to selected OBIEE modules - Dashboard, Answers and Delivers depending on their privileges granted in Siebel application.
Page 8 of 24
Printed 19/08/11
3 Star Schemas
This Technical Design Document provides information on which physical database tables and joins will be used to fulfill the business requirements as set out in the JAR 2 Functional Design Spec Reporting document. Note that the following star schemas are only in reference to the Simplified Star Schemas as the Combined Subject Areas are merely a logical grouping of multiple star schemas. Star Schemas Opportunity Star Schema UOPS Sales Star Schema MST Course + MST Product Schema Territory Account Star Schema Territory Course Star Schema Book In Use Star Schema
Page 10 of 24
Printed 19/08/11
Page 11 of 24
Printed 19/08/11
W_PRODCAT_DH
Page 12 of 24
Page 13 of 24
Printed 19/08/11
Page 14 of 24
Printed 19/08/11
4 ETL
4.1 Overview
4.1.1 Oracle Business Analytics Warehouse
Oracle Business Analytics Warehouse, also referred as Data Warehouse or OLAP (ROLAP), is a unified data repository designed to store all customer-centric from a variety of Oracle products such as Siebel CRM, Oracle E-Business Suite or PeopleSoft in dimensional form following best industry practices. Its a database that contains the data extracted and derived from the online operational database(s) OLTP (e.g. Siebel database), where the data structures have been optimized for advanced, large volume reporting and analytical processing. The strategy of a data warehouse is that the main time-consuming transformations, calculations and data consolidation tasks occur during the loading of the data warehouse, which happens outside of business hours, rather than when the user queries the data via a report/analysis. The other key advantage of having a separate database as a data warehouse is that it has no impact on Siebel CRM application during business hours as a different database is used.
4.1.2 ETL Process
The actual transfer of the data from the online operational database to the data warehouse and the related processing that takes place during this movement is called the ETL process: Extract: Moves the necessary data from the online database to temporary (staging) tables on the data warehouse. No other processing on the online operational database takes place to minimize the impact on its resources. Transform: Processes the data. Cleans, rearranges and derives data. Load: Loads the data into the real Data Warehouse tables used by the Analytics application There are two types of ETL that can take place: Full ETL. This carries out a full transfer of all the related data from the online operational database to the data warehouse. Incremental ETL. This only transfers data that has been updated or inserted in the online operational database since the last ETL. Note that incremental ETLs can follow full ETLs or previously run incremental ETLs but can never be the first ETL run on an empty data warehouse. The time for an incremental ETL is considerably shorter than the time required for a full ETL. For the purpose of the Opportunity Pilot project all ETL execution plans will run in a full refresh mode scheduled to run on a nightly basis, outside business hours.
Page 15 of 24
Printed 19/08/11
Status
OOTB OOTB OOTB OOTB
Business Name
Account to Account Affiliation Helper Table Asset Dimension Asset Mini Dimension Day Dimension
Comments
Helper table for Account to Account affiliations.
Base calendar dimension for the Oracle BI data warehouse. Stores the date related information at the individual calendar day level. Additional fiscal calendar information is loaded from
Page 16 of 24
Printed 19/08/11
Status
OOTB OOTB
Business Name
Employee Dimension Geography Dimension
Comments
fiscal_week.csv or the iscal_month.csv files Allows for more streamlined reporting on STATE, CITY, ZIPCODE AND/OR COUNTRY Common dimension table based on S_LST_OF_VAL
List of Value Dimension Opportunity Dimension Opportunity Mini Dimension Account Dimension Position Dimension
Position Dimension Hierarchy Product Category Dimension Hierarchy Product to Category Dimension Hierarchy
Primary Position dimension table used as a source for other Position tables such as W_POSITION_DH or W_POSITION_H Flattened hierarchy of the Position dimension W_POSITION_D Flattened Hierarchy of Product Categories Flattened hierarchy of Product Categories (W_PROD_CAT_DH) with a link to the Product Dimension (W_PRODUCT_D) Opportunity Sales Stages Custom Helper table for many-tomany Account to Category relationships Custom Helper table for Position to FT relationship (via access groups) Extension to W_PARTY_ORG_D to store MDR information Custom Helper table to resolve the relationship between a Sales Rep to multiple Product Specialists or one Tech Specialist.
NEW
NEW NEW
Page 17 of 24
Printed 19/08/11
Status
OOTB
Business Name
Asset Fact
Comments
Primary Fact Table for Assets and used for Book In Use analysis. Fact table for reporting on Account to Position relationships Primary fact table for Opportunities based on S_REVN base table. Primary fact table for UOPS Sales. UOPS Sales is external sales data from the Pearson ordering system.
WC_ORG_PARTY_F
W_REVN_F
W_UOPS_SALES_F
NEW
4.2.3
Selected OOTB tables have been extended with additional columns to store custom attributes required for reporting purpose. All customizations and new tables have been documented in JAR 1&2 3Sixty BI - ETL mappings spreadsheet and will be applied to Oracle Business Analytics Warehouse using DDLimp utility.
4.2.4 Real-Time Table
For the Product Specialist report, a real-time (OLTP) table will be used to allow for what-if analysis of Specialist to Rep Alignment before the actual Territory Alignment runs in the application. This table will need to be added into the Physical Layer of the RPD and is specified as follows: Table 3 OLTP Real Time Table Table
S_ACCNT_POSTN
Column
OU_EXT_ID
Description
Account or Course ID. This will be joined with the Account ID in Sales Fact for future alignment reporting. Position ID of the Rep assigned to Account or Course Team. This will be joined with the Rep Position in Sales Fact for future alignment reporting. Position ID of new Rep to be added, removed or swapped y Add = Rep in NEW_POSITION_ID is to be
S_ACCNT_POSTN
POSITION_ID
S_ACCNT_POSTN S_ACCNT_POSTN
Page 18 of 24
Printed 19/08/11
OBIEE suite uses Informatica PowerCenter 8.1.1 as the main tool to perform the ETL jobs. Oracle BI Applications come with a set of pre-defined Informatica data flows for the OOTB Siebel application covering the majority of key Entities used within Siebel such as Accounts, Contacts, Products, Opportunities etc. As part of the customization process, OOTB data flows will be copied and altered to include any and/or columns not already transferred by the pre-defined flows.
4.3.2 Informatica Mappings
Informatica Mappings are objects that describe how the data is being processed with a data flow including source and destination table definitions, any necessary data transformations or aggregations etc For the Oracle BI Applications, mappings are grouped in the following two stages: Source Dependent Extract (SDE) Mappings, which are responsible for the Extract part of the ETL process, Source Independent Load (SIL) Mappings, which are responsible for Transform and Load parts of the ETL process.
4.3.3
Informatica Workflow/Sessions
A Workflow is a grouping of Sessions that in turn contain one or more Mappings. A Session is a particular Mapping instance with definitions for the source and destination parameters (e.g. database names, etc.). In case of Oracle BI Applications each Mapping has a dedicated Workflow and Session with matching names.
4.3.4 Customisations of mappings and workflow/sessions
Its a best practice that none of the OOTB Informatica objects are being modified during the implementation. In order to modify the data flow logic all necessary objects need to be first copied into Custom folders before being altered.
All custom and customized Informatica objects have been documented in a Data Mapping spreadsheet - JAR1/JAR 2 3Sixty BI - ETL mappings) used for identifying the individual mappings from the OLTP source tables and columns to the Oracle Business Page 19 of 24 Printed 19/08/11
Technical Design OBIEE Warehouse target tables and columns, along with the extraction, transformation, and loading rules. Note: Data Mapping spreadsheet is only intended to document customizations to OOTB data flows and NOT the entire data flows themselves.
This section will be populated upon build according the OLAP tables that will be used. Please refer to section 4.2 of this document for the list of facts and dimension tables that will be used.
Page 20 of 24
Printed 19/08/11
Page 21 of 24
Printed 19/08/11
Purpose
Helper table to report on the future Account Team intersection. This table is to be used after the planned changes are entered into the Sales Assignment View but before the Territory Realignment process runs).
SQL
SELECT OU_EXT_ID, POSITION_ID, NEW_POSITION_ID, OPERATION, CASE WHEN OPERATION = 'Remove' THEN NULL WHEN OPERATION = 'Swap' THEN NEW_POSITION_ID END AS CALC_FUTURE_POSTN_ID WHERE OPERATION IN ('Remove','Swap') UNION SELECT OU_EXT_ID, POSITION_ID, NEW_POSITION_ID, OPERATION, NEW_POSITION_ID AS CALC_FUTURE_POSTN_ID WHERE OPERATION = 'Add'
Please note, column names may not be exactly as stated above as at the time of writing, the design of the application has not been finalized yet.
Page 22 of 24
Printed 19/08/11
F3A
F4
F5
W_PARTY_ORG_D LEFT OUTER JOIN WC_ORG_PARTY_F W_PARTY_ORG_D LEFT OUTER JOIN W_ASSET_F
F6
Page 24 of 24
Printed 19/08/11