Accelerating Your SuccessTM

Understanding Oracle GoldenGate

Ron Caffrey ron.caffrey@avnet.com

Oracle Product Specialist
Avnet Technology Solutions
07711-302797
Accelerating Your SuccessTM

AGENDA

 Background & context

 The essence of GoldenGate

 fundamental functionality
 solution models exploiting GoldenGate
 key facts

 Latest enhancements in G/G 11gR2

 Commercial considerations

 Summary of opportunity
Accelerating Your SuccessTM

GoldenGate evolution

 GoldenGate Software established in 1995.

 Chief Technology Officer recruited from Oracle Server Technology labs
 Oracle acquired GoldenGate in Oct 2009.
 As in many of Oracle’s acquisitions, heterogeneity was a key factor
 Under GoldenGate ownership, the main client base was typically large Finance
organisations with (too) many mainframe, Unix and Windows systems,
and considerable pains. Most engagements were consultancy-led and substantial.
 Under Oracle ownership, the product has to stand as a piece of technology for all.
 Major complex migration/upgrade projects around mission-critical components will still
demand considerable know-how and project control.

http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM

Oracle Data Integration Solutions

 Specialized team formed in 2010

 Focus is real time movement, manipulation and management of data
 Products satisfy diverse customer requirements

Heterogeneous real- Heterogeneous

time change data data integration
capture for Oracle Oracle Data services for Data
Continuous GoldenGate Integrator EE Warehousing and
Availability, Disaster SOA, including
Tolerance and real- Data Quality and
time Data Integration Profiling options

http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM

Data Integration : the challenges

 Not to be confused with application integration (SOA, BPEL, AIA etc)

 The dream is “One Version of the Truth”
i.e. each business entity (customer, product etc) is represented only once in an organisation
 The reality…
 Buying a new packaged application usually means another database
 Mergers and acquisitions create more system overlaps
 Consolidation often thwarted by disparate versions – application lifecycle is king
 Data explosion continues (90% of data created in last 2 years : 50x growth by 2020?)
 Meanwhile business continues (i.e. transactions happen)
 Timescales and costs often prevent idealised re-alignment of systems

http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM

Data Integration : the needs

 Duplication (whether permanent or transient) typically cannot be eradicated

 Transaction-driven data changes need to distributed and replayed
 Upgrades/migrations for critical systems demand near zero downtime
 Database-level
 Application-level
 Business Intelligence also generally needs data duplication
 Keeping heavy I/O and cpu loads away from OLTP
 Reflecting need for restructured data to aid analysis
 Increasingly near real-time

http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM

Data Integration : the needs

 Duplication (whether permanent or transient) typically cannot be eradicated

 Transaction-driven data changes need to distributed and replayed
 Upgrades/migrations for critical systems demand near zero downtime
 Database-level
 Application-level
 Business Intelligence also generally needs data duplication
 Keeping heavy I/O and cpu loads away from OLTP
 Reflecting need for restructured data to aid analysis
 Increasingly near real-time

http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM

Data Integration : the needs

 Duplication (whether permanent or transient) typically cannot be eradicated

 Transaction-driven data changes need to distributed and replayed
 Upgrades/migrations for critical systems demand near zero downtime
 Database-level
 Application-level
 Business Intelligence also generally needs data duplication
 Keeping heavy I/O and cpu loads away from OLTP
 Reflecting need for restructured data to aid analysis
 Increasingly near real-time

NB many customers who buy GoldenGate continue to

find new reasons to use it
http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM

AGENDA

 Background & context

 The essence of GoldenGate

 fundamental functionality
 solution models exploiting GoldenGate
 key facts

 Latest enhancements in G/G 11gR2

 Commercial considerations

 Summary of opportunity
Accelerating Your SuccessTM

What is GoldenGate?

 Core product is simple to describe

– it captures transactional data changes and propagates them to other locations,
in a heterogeneous world
 Oracle, Teradata, DB2, SQL Server, MySQL, NonStop etc etc
 Unidirectional or bi-directional
Accelerating Your SuccessTM

Low-Impact, Real-Time Data Integration

& Transactional Replication for many benefits

http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM

Additional comments

 Business Continuity (HA and DR).

This is a solution that can be applied to Oracle DB SE as well EE.
And, since it is possible for replication to be bi-directional, for the first time Oracle now has
a solution for the Active/Active requirement over major distances.
(with Data Guard one side would always be passive and not accept changes.
Advanced Replication was too big a hit on performance).
NB bi-directional implementation does not increase licence costs.

 Offloading reporting workloads to relieve OLTP system : scope of data can be filtered
so reporting system has only relevant tables.

 Oracle has built integration between GoldenGate and Data Integrator to enable a real-time
data warehousing delivery system.
Accelerating Your SuccessTM

Things to understand about GoldenGate

 Every database in the GoldenGate world is AUTONOMOUS

(not a slave clone as with Data Guard etc)
 Your choices in the Configuration Files decide how the databases will interact
and the overall business goals to be achieved
 Transfer is always ASYNCHRONOUS
(but if you provide an external means of mirroring the source database log files,
Goldengate can use them to complete all transactions)
 Conflict resolution mechanisms are supported for multi-master systems
 It captures and distributes canonical forms of data items, so it is prudent to double-check the
documentation to see that relevant application schemas do not have any issues
Accelerating Your SuccessTM

Oracle Streams positioning

 From the GoldenGate Statement of Direction…

Oracle Streams continues to be supported but will not be enhanced to support
any new database features in future releases. This means that Streams will continue to
support exactly what it supports today (11.2) in future releases. It also means that any
new database features, data types, or capabilities will not be supported by Streams.
Customers who want to take advantage of the new data types and features will need to
license Oracle GoldenGate.

 In a soak-test, after stopping transaction arrival, Streams continued for 45 mins.

GoldenGate completed distribution almost immediately.

 Streams is of course bundled with DB EE, but it would be unwise to commence

new projects now.
Accelerating Your SuccessTM

Integration of GoldenGate output

as a source for Data Integrator EE
Oracle BI Tools

Batch feeds for data migration or

integration

Reduce or remove reliance on batch

feeds by using continuous real-time
data capture and delivery

Oracle
Oracle GoldenGate Data Integrator

Capture/migrate from Optional DQ/DP

heterogeneous
sources

http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM

Data conversion / mapping

 GoldenGate provides abilities to re-codify data and make minor adjustments

 For wholesale re-mapping of data structures Data Integrator is the correct tool.
E.g. conversion of Third Normal Form transactional data models into Star Schemas
for Analysis.
Accelerating Your SuccessTM

Oracle Veridata

 Sold independently of GoldenGate

 Effective for comparing schemas regardless of the replication technology used
 Heterogeneous support
 Licensing is in respect of the Veridata environment, not the databases being compared
Accelerating Your SuccessTM

AGENDA

 Background & context

 The essence of GoldenGate

 fundamental functionality
 solution models exploiting GoldenGate
 key facts

 Latest enhancements in G/G 11gR2

 Commercial considerations

 Summary of opportunity
Accelerating Your SuccessTM

GoldenGate 11gR2 Enhancements

 In case of Oracle databases, choice of new Integrated Capture architecture is more tightly-
coupled with the database.
 Greater scalability
 Ability to capture changes from Compressed Data
(all types including the full Exadata HCC ones)
 Better support for global deployments through support for UNICODE and multi-byte
character-sets.
 Enhanced security of transmission with FIPS or Blowfish encryption algorithms
 Simpler, enhanced conflict resolution
 Enhanced feature support for other databases. DB2 for iSeries now added.
 Application adapters output JMS messages or flat-file batches rather than targeting a
database.

http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM

AGENDA

 Background & context

 The essence of GoldenGate

 fundamental functionality
 solution models exploiting GoldenGate
 key facts

 Latest enhancements in G/G 11gR2

 Commercial considerations

 Summary of opportunity
Accelerating Your SuccessTM

GoldenGate commercials

 Be aware that Oracle has created two separate products:-

 “Oracle GoldenGate” (this is for an Oracle source or target)
 “Oracle GoldenGate for Non Oracle Database” (everything else)
(There are also specials for Mainframe and Teradata Replication Services)
 So in a heterogeneous deployment makes sure you sell the correct products
and quantities for each source and target. Oracle doesn’t do refunds!
 Currently there is no distinction in licensing rules or price between the main two.
 Bi-directional replication does not influence the price.
 Do not be fooled by the fact that the Processor and NUP prices appear identical
to those for Database Standard Edition. The GoldenGate variants are priced by the
calculation of cores * multi-core factor for the chip-type, and so core architecture will
influence price.
. http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM

GoldenGate commercials

 GoldenGate products have the same NUP minimum of 25 per Processor as the DB EE
 GoldenGate pricing is not explicitly linked to database pricing, but since it has to be
installed adjacent to the database engine the licensed environment will be identical, as well
as considerations of whether NUPs are permissible.
(Note Oracle GoldenGate for Teradata Replication Services is unique in being deployed
separate from the source, but still the database environment dictates licensing).
 Processors or users are counted as those using the database, not some notional subset or
group of administrators. This applies to all source and target types.
 The new (11gR2) GoldenGate Application Adapters for JMS and FlatFile are licensed only
by Processor, and in respect of the source database(s).

http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM

GoldenGate commercials : Active Data Guard bundled

 The Oracle GoldenGate product includes licence cover for Active Data Guard.
 This is a little strange and needs an explanation.
 Remember that Data Guard (at least the Physical Standby variant) maintains a clone of
the database by pasting changed bytes into correct file addresses. It cannot be used
actively, apart from read-only access through Active Data Guard Option, or temporarily
when converted to a Logical Standby and then subjected to Flashback Database command.
 Conversely with GoldenGate all databases are always autonomous.
 Therefore no DR database could be maintained by Data Guard AND GoldenGate.
 The free licence is simply to avoid a turf war between Oracle’s Server Technology and
Middleware groups.
 The ADG licence cover CAN be beneficial if you had Data Guard and G/G deployed
to separate copies. The source must have ADG licences so this is covered.
http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM

Disaster Recovery for SE v EE : price comparison

 Assuming Production & DR (or Active-Active) have 2 sockets each quad-core Intel chips
 With SE have to check datatype support and cope with physical DDL issues, but still
superior to Hot Standby in most respects
 Still lacking all other EE benefits

Licences List Prices

DB EE 8 £254,712

DB SE 4 £46,920

GoldenGate 8 £93,840

£140,760
Accelerating Your SuccessTM

AGENDA

 Background & context

 The essence of GoldenGate

 fundamental functionality
 solution models exploiting GoldenGate
 key facts

 Latest enhancements in G/G 11gR2

 Commercial considerations

 Summary of opportunity
Accelerating Your SuccessTM

Look for the causes : new business systems, mergers &

acquisitions, geographic separation, real-time BI

http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM

Collateral

http://www.oracle.com/us/products/middleware/dataintegration/overview/index.html

http://www.oracle.com/us/products/middleware/data-integration/resources/index.html

http://www.oracle.com/technetwork/middleware/goldengate/documentation/index.html

http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM

Understanding Oracle GoldenGate

Ron Caffrey ron.caffrey@avnet.com

Oracle Product Specialist
Avnet Technology Services
07711-302797