P.3 PTS ODI11g ODI Architecture PDF

Copyright 2010, Oracle. All rights reserved.
PTS Workshop: ODI 11g
<Insert Picture Here>
Oracle Data Integrator Architecture
Agenda
<Insert Picture Here>
ODI Architecture Overview ODI Components Agents Console Repositories Data Flow Q&A
ODI Architecture
ODI Architecture
Open Web Services for decoupled invocation of any ODI jobs
OpenTools for adding OS functionality to any ETL job
Desktop ODI Studio

Designer Operator Topology Security ODI Console ODI SDK Java EE Application ODI Plug-in
WebLogic 11g / Application Server FMW Console Servlet Container Web Service Container
Runtime WS Java EE Agent Public WS Data Services
JVM
Java EE Application
ODI SDK
SDK APIs for Java generation of any ODI system metadata
Open Web Services for decoupled invocation of any ODI jobs
Data Sources Connection Pool Sources and Targets JVM

Runtime WS Standalone Agent
Repositories
ODI Work Repository Legacy
ODI Master Repository
Files / XML
DBMS
Applications ERP/CRM/PLM/SCM
Metadata is an open relational model with built-in Flex Fields
DW / BI / EPM
ODI Components
Graphical Modules
ODI Designer
Designer Reverse-Engineer Develop Projects Release Scenarios
Operator Operate production Monitor sessions Topology Manager Define the infrastructure of the IS
Security Manager Manage user privileges
Java Most Platforms
DB - Most ISO-92 Repository
SOA / Java EE Run-Time Components

ODI Designer
Any Client App
Consume Data Control EL-T Operations

Monitor sessions View Reports
Operator Operate production Monitor sessions
Java - Any Platform
Access Data
Invoke and manage sessions Submit Jobs
Repository
Any ISO-92 RDBMS Public Web Services Manage sessions Access Data Java EE Agent Handles schedules Orchestrate sessions
Read sessions Write reports
Data Services Access Data and Changed Data
WebLogic Java EE server
Return Code
Execute Jobs
Information System
Standalone Run-Time Components

Monitor sessions View Reports
Operator Operate production Monitor sessions
Java - Any Platform
Submit Jobs
Repository
Any ISO-92 RDBMS Standalone Agent Handles schedules Orchestrate sessions
Read sessions Write reports
Lightweight Distributed Architecture
Java - Any Platform

Return Code
Execute Jobs
Information System
Enterprise Manager and ODI Console

Any Web Browser Control and monitor ODI production Browse metadata lineage
Repository
Any ISO-92 RDBMS Enterprise Manager Fusion Middleware Console Java EE Agent Handles schedules Orchestrate sessions
Submit Executions
ODI Console Web access to the repository
Other components SOA Suite, WLS Servers, Web apps.
WebLogic Java EE server

Execute Jobs
Return Code
Information System
Components: a Global View

ODI Studio Designer
Reverse-Engineer Develop Projects Release Scenarios Define the IS infrastructure Manage user privileges Operate production Monitor sessions
Any Client App Operator Topology Manager Security Manager
Consume Data Control EL-T Operations
Any Web Browser Browse metadata lineage Operate production
Java - Any Platform
Access Data
Invoke and manage sessions
Repository
Any ISO-92 RDBMS Enterprise Manager FMC ODI Console

Web access to the repository
Data Services Access Data and Changed Data Public Web Services Manage sessions Access Data Java EE Agent Handles schedules Orchestrate sessions
Other components
SOA Suite, WLS Servers, Web apps.
Java - Any Platform Information System
Repository Access HTTP Connection Execution Query

Using ODI Studio
ODI Studio
Designer Navigator Operator Navigator Topology Navigator Define the infrastructure of the IS. Operate production. Monitor sessions.
Reverse engineer.
Security Navigator Manage user privileges.
Develop projects.
Release scenarios.
Repository
The Fusion Client Platform (FCP) based UI provides an efficient and
flexible way to manage navigators, panels, and editors.
Designer Navigator
Toolbar
Designer Projects editor
Object tree
Other Designer editors
In ODI Designer, you can create, configure, and execute various ODI objects. Workspace to define ODI objects and design EL-T transformations
Operator Navigator
Toolbar
In Operator Navigator, you can monitor execution of ODI objects.
Workspace to define ODI objects and design EL-T transformations
The monitoring session steps enable you to perform debugging.
Topology Navigator
Toolbar
Technologies tree Workspace to define ODI Topology objects In ODI Topology Manager, you set the architecture of your information system, the technologies, servers, schemas, and repositories.
Security Navigator
Workspace to define objects, profiles, users, and hosts
Object tree
In Security Navigator, you manage objects, profiles, users, and hosts.
Agents
What Is an Agent?
An agent is a run-time component of ODI that orchestrates the integration process. At design time, developers generate scenarios from the business rules that they have designed. The code of these scenarios is then retrieved from the repository by the agent at run-time. This agent then connects to the data servers and orchestrates the code execution on these servers.
ODI Agents
Agents are lightweight Java processes that orchestrate the execution of objects at run time. Agents can: Execute objects on demand, or Execute according to predefined schedules
Two Types of Agents

JEE agent
JEE and Standalone

Any Web App WebLogic 11g (or other JEE)
Servlet Container MBeans Server Registry Any Application Container Web Service Container
Standalone agent
JDeveloper
ODI Studio
Standalone Java
ODI Agent
Designer Security Topology Operator
Any Java App
ODI Agent
Any MBeans App
Any Application
ODI Public Web Service ODI SDK APIs ODI Data Services
ODI SDK APIs ODI Console
ODI MBeans for ODI Agent
RDBMS ODI Repositories
Data Sources Connection Pool
ODI Master Repository
Knowledge Modules ODI Work ODI Work Repository ODI Work Repository Repository
Repository Data Sources Sources Data Sources Repository Data Sources Sources Data Sources Repository Data Sources Sources Data Sources
Target Data Sources Target Data Sources Target Data Sources
Sources and Targets

---
----------ERP PLM CRM
----------Best-of-Breed Applications
-----------
Legacy
Using the Two Types of Agents
Deploying an agent in a JEE Application Server (Oracle WebLogic Server): 1. Define the JEE Agent in the Topology Navigator 2. Create the WLS template for the JEE Agent 3. Deploy this template directly using the WLS Configuration Wizard Using a standalone agent: 1. Launch an Agent 2. Display Scheduling Information 3. Stop the Agent
Example of Standalone Agent

Designer Operator
Reverse engineer Monitor sessions View Reports Develop projects Submit Release Jobs scenarios
Repository Read sessions Standalone Agent Orchestrates sessions Return Code Execute Jobs Write reports
Operate production Monitor sessions
Java - Any Platform
Any ISO-92 RDBMS
Lightweight Distributed Architecture
Java - Any Platform
Information System
Console
ODI Console
Development
Agent
ODI Console
ODI Console
Enterprise Manager Console

Development
Agent
ODI Plug-in for EM Console
Enterprise Manager Console
ODI Repositories
ODI Repositories
There are two types of repositories in ODI: Master repository Work repository Development repository Execution repository Work repositories are always attached to a Master repository.
Master and Work Repositories

Security Topology Versioning Master Repository
Models
Projects Execution Execution Repository (Production)
Execution
Work Repository (Development)
Two type of Repositories: Master and Work Work Repositories are always attached to a Master Repository
Example of a Repository Set-Up

Security Topology Versioning
Create and archive versions of models, projects and scenarios
Master Repository
Import released versions of models, projects and scenarios for testing
Import released and tested versions of scenarios for production
Models Models Execution Projects Execution Work Repository (Test & QA) Execution Repository (Production)
Projects
Execution
Development Test Production Cycle

Repository Set-Up: Separate Networks

Security Topology Versioning
Create and archive versions of models, projects and scenarios (from the GUI) Import released versions of models, projects and scenarios for testing (From the GUI) XML export / Import (manual)
Security Topology
Models Models Projects Execution Work Repository (Test & QA)

XML export / Import (manual)
Projects
Execution
Firewall
Master Repository
Master Repository
Execution Execution Repository (Production)
Development Test Production Cycle

ODI Data Flow
Oracle Data Integrator
Architecture
No Server: only an orchestrator (The Agent) that will send the appropriate SQL statements to the different databases.
Servers and Applications
Execution
CRM
Data Warehouse Legacy
User Interfaces Code Execution Log
Agent Data Flow Conductor
Return Codes
ESB Files / XML
ER P
Developer
Developer Metadata Rules Repositories
Developer
Developers each have the Java GUI on their machine and share a central repository to store the metadata and the transformation processes (no local storage).
Architecture
Execution
CRM
User Interfaces Code Execution Log Codes Return
ER P ESB Files / XML
Developer
Developer
Processes are orchestrated (and possibly scheduled) by an ODI Java agent (no graphical component to allow for the largest possible set of platform support).
Architecture
Execution
CRM
User Interfaces Code Execution Log Codes Return
ER P ESB Files / XML
Developer
Developer
Multiple agents can co-exist in any given environment. Typical locations for the agents are on the target system and/or on the system that hosts the ODI repository.
Overview: 6 steps to Production

4. Generate/Deploy data flows 5. Monitor executions 6. Analyze impact / data lineage
Production
Production Servers and Applications
1. 2. 3.
Retrieve/Enrich metadata Design transformations Orchestrate data flows
Development
Development Servers and Applications
CRM
Data Warehouse
CRM
Data Warehouse
Legacy
Legacy
ERP Files / XML ESB Files / XML
ERP
ESB
ODI Design-Time Environment

Agent Data Flow Conductor Runtime Repository
ODI Runtime Environment

Agent Data Flow Conductor User Interfaces Operator Metadata Navigator
User Interfaces Design-time Design-time Repositories Repositories
Administrators
Designers

P.3 PTS ODI11g ODI Architecture PDF

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

P.3 PTS ODI11g ODI Architecture PDF

Uploaded by

Copyright:

Available Formats

Copyright 2010, Oracle. All rights reserved.

PTS Workshop: ODI 11g

<Insert Picture Here>

Oracle Data Integrator Architecture

Copyright 2010, Oracle. All rights reserved.

Copyright 2010, Oracle. All rights reserved.

OpenTools for adding OS functionality to any ETL job

Desktop ODI Studio

SDK APIs for Java generation of any ODI system metadata

Open Web Services for decoupled invocation of any ODI jobs

Data Sources Connection Pool Sources and Targets JVM

ODI Master Repository

Metadata is an open relational model with built-in Flex Fields

Copyright 2010, Oracle. All rights reserved.

Copyright 2010, Oracle. All rights reserved.

Designer Reverse-Engineer Develop Projects Release Scenarios

Security Manager Manage user privileges

Java Most Platforms

DB - Most ISO-92 Repository

Copyright 2010, Oracle. All rights reserved.

SOA / Java EE Run-Time Components

Designer Reverse-Engineer Develop Projects Release Scenarios

Operator Operate production Monitor sessions

Java - Any Platform

Invoke and manage sessions Submit Jobs

Read sessions Write reports

Data Services Access Data and Changed Data

WebLogic Java EE server

Copyright 2010, Oracle. All rights reserved.

Standalone Run-Time Components

Operator Operate production Monitor sessions

Java - Any Platform

Any ISO-92 RDBMS Standalone Agent Handles schedules Orchestrate sessions

Read sessions Write reports

Lightweight Distributed Architecture

Java - Any Platform

Copyright 2010, Oracle. All rights reserved.

Enterprise Manager and ODI Console

ODI Console Web access to the repository

Other components SOA Suite, WLS Servers, Web apps.

WebLogic Java EE server

Copyright 2010, Oracle. All rights reserved.

Components: a Global View

Any Client App Operator Topology Manager Security Manager

Consume Data Control EL-T Operations

Any Web Browser Browse metadata lineage Operate production

Java - Any Platform

Invoke and manage sessions

Any ISO-92 RDBMS Enterprise Manager FMC ODI Console

Java - Any Platform Information System

Repository Access HTTP Connection Execution Query

Using ODI Studio

Security Navigator Manage user privileges.

The Fusion Client Platform (FCP) based UI provides an efficient and

flexible way to manage navigators, panels, and editors.

Copyright 2010, Oracle. All rights reserved.

Designer Projects editor

Other Designer editors

Copyright 2010, Oracle. All rights reserved.

In Operator Navigator, you can monitor execution of ODI objects.

Workspace to define ODI objects and design EL-T transformations

The monitoring session steps enable you to perform debugging.

Copyright 2010, Oracle. All rights reserved.