Session -I

Oracle Data Integrator

Introduction

Created By : Gourav Atalkar

Reviewed By: Amit Sharma

Contact Point :bispsolutions.wordpress.com

Agenda
What is Oracle Data Integrator?
Why Oracle Data Integrator?
Overview of ODI 11g Architecture
Overview of ODI 11g Components
About Graphical Modules
Types of ODI Agents
Overview of Oracle Data Integrator
Repositories
Why Oracle Data Integrator ?

ELT Architecture provides high performance.

Active integration enables real time data warehousing and
operational data hubs.
Declarative design improves developer productivity.
Knowledge modules provides flexibility and extensibility.

ODI combines three style of data integration: data based, event

based and service based
ODI shortens implementation times with its declarative design
approach.
Conventional Integration process: ETL

Machine Machine

Integration Process

Order
Errors
Source Transform Target

Sales

Correction
files

Machine

Extract Transform Load

ELT
1) Extract: Extracting the data from various sources.
2) Load: Loading the data into the destinations target.
3) Transform: Transforming data according to a set of business
rules.
Conventional ETL Process Next Generation ELT Architecture

Extract
Load
Extract
Load
Transform
Oracle Data Integrator Architecture
Desktop Web Logic 11g/Application Server

JVM ODI Studio FMW Console ODI Plug-in

Java EE Designer
Servlet Container Web Service
Applicatio
n Operator Java EE Run-time Container
ODI WS
Applicatio Data
ODI SDK Public
Topology n Console Servi
ODI SDK Stand Alone WS
ce
Agent
Security
Data Sources Connection Pool

Repositories Sources and Targets

JVM
Run-time WS

Master
Repository Work Stand Alone
Agent
Repository
Legacy Files DBMS
Oracle Data Integrator Components

ODI Studio Components:

Designer Navigator
Operator Navigator
Topology Navigator
Security Navigator

ODI Agent
ODI Console
ODI Repositories
Oracle Data Integrator Studio

Designer Navigator: Operator Navigator: Operator Navigator: Security Navigator:

Reverse Engineering Operate Production Define the Manage user
Develop Projects Monitor sessions infrastructure of the IS. privileges.
Release Scenario

Repository
Designer Navigator
Designer Navigator
Designer Navigator is the GUI for defining metadata and rules for
transformation and data quality. It uses this information to
generate scenarios for production, and designer is where all the
project development take place. Designer navigator is the core
module for developers and metadata administrators.

Designer handles the following:

Models: Description of the data and application structure.

Projects: The developments of various ODI objects.
Operator Navigator

Toolbar

In Operator
navigator you can
monitor execution
of ODI objects

This monitoring
sessions steps
enables you to
perform debugging
Operator Navigator
Operator navigator is used to manage and monitor ODI in
production. It is designed for production operators and
displays the execution logs with error counts, the number of
rows processed, execution statistics, and so on. At design time,
developers use operator navigator for debugging purpose.

Through the Operator navigator, you can manage your

interface execution in the sessions, as well as the scenario in
the production.

The operator navigator stores this information in a work

repository while using the topology define in the master
repository.
Topology Navigator

Toolbar

Technology Workspace to
tree define Topology
objects

In ODI Topology manager

you set the architecture of
your information system,
technologies server
information, schemas and
repositories.
Topology Navigator
Topology Navigator manages the physical and logical
architecture of the infrastructure. Server, schemas, and agents
are registered in the ODI Master Repository-a major ODI
component that contains information about the topology of the
company’s IT resources, security, and ODI resource.

Using the topology navigator, you can define the topology of

your information system to ODI so that it can be accessed by
other ODI modules. Topology navigator enables you to manage
repositories. The topology navigator store this information in a
master repository.
Security Navigator
Workspace to define
objects, profiles,
users and hosts.

In security navigator , you manage

objects, profiles, users and their
privileges and hosts.

Object Tree
Security Navigator

Security Navigator manages users and their privileges in ODI. It

is used to create profiles and provide rights to users to access
ODI objects and features. This navigator is usually used by
security administrators.

It is used to assign user rights for method on generic objects

and to fine tune these rights on the objects instances.
What is an Agent ?
An agent is a run time component of ODI that orchestrates the
integration process.

It is a lightweight java program that retrieves code from the

repository at the run time.

At design time developer generate scenario from the business

rule that they have designed. The code of these scenario is then
retrieved from the from the repository by the agent at run time.

This agent then connects to the data servers and orchestrates

the code execution on these servers.
Oracle data Integrator Agent

Agents are lightweight java

processes that orchestrates the
execution of objects at run time.
Agent can do one of the
following:
-Execute objects on demand
-Execute according to predefined
schedules.
Oracle data Integrator Agent
Two Types of agents: Java EE and standalone
The agents comes in two different types:

The java Enterprise Edition(Java EE; formerly J2EE) agent

can be deployed as a web application and benefit from the
feature of an application server.

The standalone agent runs in a simple java machine and can

be deployed where needed to perform the integration flow.

Both agents are multithreaded java programs that support

load balancing and can be distributed across the information
system.
Using the Two Types of agents
Deploying a Java EE agent in a Java application server
(Oracle WebLogic Server):
1)In ODI, define the Java EE agent in the Topology Navigator.
2)In ODI, create the WLS template for the Java EE Agent.
3)Deploy template directly using WLS configuration Wizard.
Using a stand alone Agent:
1)Launch an agent.
2)Display scheduling information.
3)Stop the agent.
Advantages of Java EE agents over Standalone agents:
1)High Availability
2)Multiple agents, using Coherence.
Example of standalone agent

Designer Navigator: Operator Navigator:

Reverse Engineering Operate Production
Develop Projects Monitor sessions
Release Scenario

Java Any Platform

Repository

RDBMS

Standalone Agent
Java Any Platform

Information System
ODI Console
ODI Console provides web access to Repositories. It enables user
to navigate projects, models, logs and so on. Business user,
developer, Operators, and administrators use their Web browsers
to access ODI Console. The ODI console replaces Metadata
navigator of previous version.
Oracle Data Integrator Repositories

Two Types of repositories are included into the ODI.

-Master Repository
-Work Repository
* Development Repository
* Execution Repository

Work Repositories are always attached to a single Master

repository
Master and Work Repositories

Security
Topology
Versioning

Master Repository

Model
Project Execution
Execution

Work Repository Execution Repository

(Development) (Production)
Master and Work Repositories

Master Repository: It is the data structure containing the

information about the Topology of the company’s IT resources,
security, and version management of projects and data models.
This repository stored on a relational database accessible in
client/server mode from the different ODI modules.

Work Repository: It is the data structure containing the

information about the data model, projects and their use. This
repository stored on a relational database accessible in
client/server mode from the different ODI modules.
Question
 Thank You

Contact Us: http://learnhyperion.wordpress.com

http://bisp.consulting@gmail.com