on Oracle Data Integrator: A Deep Dive Hari Cherukupally Oracle
Mark Rittman Rittman Mead
Kevin McGinley Accenture
Copyright 2013, Oracle and/or its affiliates. All rights reserved. 2 The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracles products remains at the sole discretion of Oracle. Safe Harbor Statements Copyright 2013, Oracle and/or its affiliates. All rights reserved. 3 Program Agenda ! Oracle BI Applications Overview ! Oracle BI Applications 11g Overview ! Installation & New Architecture ! Configuration & Data Load Walkthrough ! Future Roadmap ! Q&A
Copyright 2013, Oracle and/or its affiliates. All rights reserved. 4 Introducing the Speakers ! Hari Cherukupally, Oracle Corporation ! Mark Rittman, Rittman Mead ! Kevin McGinley, Accenture Copyright 2013, Oracle and/or its affiliates. All rights reserved. 5 Oracle BI Applications Overview
Copyright 2013, Oracle and/or its affiliates. All rights reserved. 6 Oracle Analytic Applications Product Family Transactional BI
Single Source, single function Part of the Cloud application Real-time analysis Configurable Built on BI Foundation Suite Available for Fusion Applications Planned: Taleo, RightNow, Eloqua BI Applications
Multi-source and cross-functional Independent Deployment Warehouse-based analysis Configurable and customizable Built on BI Foundation Suite Available for on premise Oracle Apps Planned: Connectors to Cloud Apps Copyright 2013, Oracle and/or its affiliates. All rights reserved. 7 Pre-Built Analytic Warehouse 1. Business Analytics Warehouse Over 300 star schemas Designed for analysis and reporting 2. Role-Based Dashboards Best Practice Metrics 3. 4. Over 10,000 metrics Additional pre-defined calculations Based on best practices Pre-mapped integration Fusion, EBS, PSFT, SEBL , JDE, IBM Role-based Security
Over 500 Dashboards and Pages Over 3,000 reports Across Lines of Business Certified Application Integration Oracle BI Apps: Deeper than Dashboards T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com Introducing Oracle BI Applications 11.1.1.7.1 and ODI 11g All-new, 11g release of the BI Applications New content, applications, uptakes OBIEE 11g visuals etc Simplified topology - now uses ODI 11g for the ETL ! Option to continue using Informatica using upcoming release No DAC - uses web-based configuration tools, and ODI, to control and orchestrate the ETL Lower TCO, faster ETL, simpler architecture So how does it all work...? T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com Whats New in Oracle BI Applications 11.1.1.7.1? New Content Enhancements New Data Integration New TCO Tools New Applications & Adapters New OBIEE 11.1.1.7 Oracle Data Integrator Oracle GoldenGate Student Information Analytics Price Analytics for EBS ! GUI Based Configuration ! Functional Setup Tool ! Financials: Fixed Assets, Budgetary Analysis ! HR: Time & Labor, Payroll Analysis ! Projects: Resource Management, GL reconciliation ! CRM: Service Contracts, Price Analytics for EBS ! Procurement & Spend :Sourcing ! Supply Chain: Costing, Inventory Aging & Cycle Counts T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com Migrating and Upgrading to BI Apps 11g BI Apps 11.1.1.7.1 is ODI-only, and for Apps Unlimited customers (i.e. EBS, PSFT, Siebel - not Fusion Apps) Future patch release will support Fusion Apps sources Plan is to also offer BI Apps 11g with Informatica ETL Going forward, ODI releases will come first, INFA will be a port of ODI mappings ! But INFA will be supported for foreseeable future No upgrade to BI Apps 11.1.1.7.1, so ideally for: ! New implementations ! Re-implementations * As of Jan 2013, from Oracle Product Roadmap presentation. Subject to change. T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com Oracle BI Applications 11.1.1.7.1 Product Architecture All server-side BI Apps components now run within WebLogic Server Domain Web-based apps for configuring and controlling the ETL process ODI agent runs within WebLogic domain, uses WLS security etc ODI Console embedded in web apps, used for web-based detailed monitoring of loads ODI Studio available for developer tasks No DAC - functionality now handled by ODI, Configuration Manager and FSM Option to use GoldenGate for trickle-feed loading into staging area, remove issue of load windows T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com Differences in Data Loading Approach OBIA 7.9.6.4 Source Informatica Repository Informatica Server ODI Repository Configuration Manager O D I
A g e n t
Source Target OBIA 11.1.1.7.1 PS1 DAC Repository Execution Plans are created/ stored in DAC DAC tells INFA and Target DB what to do Target D A C
ODI Agent tells DB what to do T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com BI Apps 11.1.1.7.1 and GoldenGate Oracles cross-platform data replication (CDC) solution Can be used in conjunction with BI Apps 11.1.1.7.1 and a new data layer called Source-Dependent Staging ! Replica of source tables, held locally to BI Apps and with GG/ODI journaling Near-zero impact of ongoing data extraction ! No ETL batch load windows required ! Full reload without touching source Consistent CDC approach regardless of source ! Hard deletes in source generate GG events Potentially reduced ETL runtimes ! Transforms and loads all local in BI Apps DW schema ! Near real-time ETL possible ! 24x7 deployments Great enabler for cloud deployments T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com As Detailed in our OTN OBIA 11.1.1.7.1 Cookbook Getting you started article for BI Apps 11.1.1.7.1 on Windows x64 Cookbook style - step-by-step, minimal steps to get a working system Written by Mark Rittman and Kevin McGinley Available on OTN, at http://www.oracle.com/technetwork/articles/bi/ mcginley-bi-apps-1993643.html T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com Installation Steps - Overview 1. Use RCU to create OBIEE repository tables 2. Install OBIEE 11.1.1.7 using Enterprise Install type 3. Run OBIA RCU to create DW schema, BIA schema, ODI repository etc - separate RCU version just for BI Apps 4. Install OBIA 11.1.1.7.1 incl. ODI into OBIEE middleware home 5. Apply OBIA patches using patch utility 6. Use Configuration Utility to extend WLS domain to include OBIA applications 7. Upgrade WLS to 10.3.6 - now, rather than after OBIEE install 8. Run post-install config scripts 9. Configure ODI Studio to use WLS security, Wallet + LPG plugin Uses WLS LDAP for users Configures ODI with required wallet file for credential access Installs Load Plan Generator plug-in for ODI Studio T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com Use of ODI 11g as the Embedded ETL Engine ODI, rather than Informatica, is used as the embedded ETL engine Individual mappings are grouped into scenarios, the equivalent of workflows in Informatica Scenarios are then orchestrated into load plans, the equivalent to execution plans in the DAC ODI uses the target DW (Oracle initially) for the ETL tasks ! Actually ELT, for extract-load-transform ODI agent controls the process - equivalent to the DAC server Configuration metadata is held in the ODI repository, and in repository tables used by CM and FSM T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com New Admin Utilities - Configuration Manager and Functional Setup Manager Functionality of the DAC has been passed to three products ! ODI - for details on mappings, dependencies etc ! Configuration Manager - for system-wide configuration ! Functional Setup Manager - for app-specific configuration Deep integration between the tools Faster deployment and configuration T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com Load Plans - BI Apps 11.1.1.7.1s Equivalent to DAC Execution Plans Load plans were introduced with ODI 11.1.1.5, and are a way of orchestrating sets of compiled ETL steps Steps can be run in parallel or sequence Exceptions can be defined, to execute steps on ETL failure Load plans can be restarted, skipping previously completed steps Can run individual compiled interfaces, or scenarios (equivalent to INFA workflows) So how does ODI generate the particular load plan required for a set of arbitrarily-selected fact groups? T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com The Load Plan Generator Load Plan Generator (LPG) is a JEE library installed into the WebLogic Domain alongside OBIEE, CM etc Automatically generate the optimal load plan for a set of fact groups Called from the Configuration Manager web interface, or by developers as a plug-in to ODI Studio Uses fact > dimension FK relationships, and then links back to staging tables and temp tables, to create the required load plan Establishing an OBIA Instance Copyright 2013 Accenture All rights reserved. 21 Configure Source(s) Configure Target Configure Global Parameters, Languages, Currencies Identify Licensed Business Intelligence Applications Run Domain Load Plans for Desired Licensed Business Intelligence Applications Steps 22 Copyright 2013 Accenture All rights reserved. 23 Copyright 2013 Accenture All rights reserved. 24 Copyright 2013 Accenture All rights reserved. 25 Copyright 2013 Accenture All rights reserved. 26 Copyright 2013 Accenture All rights reserved. 27 Copyright 2013 Accenture All rights reserved. 28 Copyright 2013 Accenture All rights reserved. 29 Copyright 2013 Accenture All rights reserved. 30 Copyright 2013 Accenture All rights reserved. 31 Copyright 2013 Accenture All rights reserved. 32 Copyright 2013 Accenture All rights reserved. 33 Copyright 2013 Accenture All rights reserved. 34 Copyright 2013 Accenture All rights reserved. 35 Copyright 2013 Accenture All rights reserved. 36 Copyright 2013 Accenture All rights reserved. 37 Copyright 2013 Accenture All rights reserved. 38 Copyright 2013 Accenture All rights reserved. 39 Copyright 2013 Accenture All rights reserved. 40 Copyright 2013 Accenture All rights reserved. 41 Copyright 2013 Accenture All rights reserved. 42 Copyright 2013 Accenture All rights reserved. 43 Copyright 2013 Accenture All rights reserved. Copyright 2013 Accenture All rights reserved. 44 Table Name Purpose W_DOMAIN_MEMBER_G Stores domain members and values for each language W_DOMAIN_MEMBER_G_TL Stores translated values for each domain member W_DOMAIN_MEMBER_GS Staging table to incrementally update G & G_TL tables W_DOMAIN_MEMBER_MAP_G Used at ETL run time to resolve source to target domain codes W_DOMAIN_MEMBER_MAP_NUM_G Used at ETL run time to resolve source to target domain codes based on number ranges Domain Tables in the Data Warehouse Schema 45 Copyright 2013 Accenture All rights reserved. Configuring a Specific BI Application Copyright 2013 Accenture All rights reserved. 47 Configure Offerings to be Implemented Create Implementation Project Assign Tasks, Set Due Dates, Etc. Complete Configuration Tasks Steps 48 Copyright 2013 Accenture All rights reserved. 49 Copyright 2013 Accenture All rights reserved. 50 Copyright 2013 Accenture All rights reserved. 51 Copyright 2013 Accenture All rights reserved. 52 Copyright 2013 Accenture All rights reserved. 53 Copyright 2013 Accenture All rights reserved. 54 Copyright 2013 Accenture All rights reserved. 55 Copyright 2013 Accenture All rights reserved. 56 Copyright 2013 Accenture All rights reserved. 57 Copyright 2013 Accenture All rights reserved. Running an ETL Load Copyright 2013 Accenture All rights reserved. 59 Create and Generate Source Extract and Load Load Plan Execute Load Plan Monitor Load Plan and Restart if Necessary Access OBIEE Dashboards!! Steps 60 Copyright 2013 Accenture All rights reserved. 61 Copyright 2013 Accenture All rights reserved. 62 Copyright 2013 Accenture All rights reserved. 63 Copyright 2013 Accenture All rights reserved. 64 Copyright 2013 Accenture All rights reserved. 65 Copyright 2013 Accenture All rights reserved. 66 Copyright 2013 Accenture All rights reserved. 67 Copyright 2013 Accenture All rights reserved. 68 Copyright 2013 Accenture All rights reserved. Copyright 2013, Oracle and/or its affiliates. All rights reserved. 69 BI Applications Roadmap
Copyright 2013, Oracle and/or its affiliates. All rights reserved. 70 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 70 The preceding is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracles products remains at the sole discretion of Oracle. Safe Harbor Statements Copyright 2013, Oracle and/or its affiliates. All rights reserved. 71
Oracle BI Applications Current Releases and Roadmap For Applications Unlimited customers ETL with Informatica New Manufacturing Analytics New Enterprise Asset Management Analytics New SLA support for EBS R12 (patch) For SAP customers ETL with ODI Fin, Proc & Spend, Supply Chain Analytics For Application Unlimited customers ETL with ODI New Student Information Analytics New Golden Gate option New content in all major products
Fusion & AU: release alignment ODI and Informatica : release alignment New content: Talent Management, PLM Analytics integration, EAM enhancements, Student Analytics enhancements, EVM New adapters: Procurement & Spend Analytics for JDE, Manufacturing Analytics for JDE, Supply Chain & Order Management Analytics for PeopleSoft New cloud adapters: Adapters to Fusion CRM, HCM & ERP Cloud Services, Taleo adapter Cost of Ownership Improvements: Data Lineage, ETL Validation, platform support Endeca Extensions BI Applications as Oracle Cloud Service New content/modules: Continue to fill key content gaps based on customer demand New cloud adapters: RightNow adapter, Eloqua adapter Unstructured/big data analytic applications e.g. Customer 360 Continue user experience redesign by leveraging BI Foundation Suite platform developments incl Mobile App Designer Additional cost of ownership improvements BI Apps 7.9.6.4 January 2013 Whats Next 0-12 month planning cycle Future Directions Post 12 month planning cycle BI Apps 7.9.7.2 September 2012 BI Apps 11.1.1.7.1 May 2013 Copyright 2013, Oracle and/or its affiliates. All rights reserved. 72 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 72 Questions Copyright 2013, Oracle and/or its affiliates. All rights reserved. 73 Graphic Section Divider Copyright 2013, Oracle and/or its affiliates. All rights reserved. 74