Thursday Aug 11, 2016

Oracle GoldenGate for Big Data is Cloudera Certified

Oracle GoldenGate is now certified for integration with latest Cloudera Hadoop distribution.

  • Versions used:
    • CDH 5.7
    • Oracle GoldenGate
  • Interfaces Certified - 
    • HDFS
    • Hive
    • Flume
    • Kafka
  • Certified with Kerberos
  • Certified with Apache Sentry 
For more details, you may refer to Cloudera Partner Listing Website

Tuesday Aug 09, 2016

GoldenGate for Big Data

Oracle GoldenGate for Big Data supports integration with Oracle Stream Analytics through Kafka.

For more details, refer to blog

Wednesday Jul 20, 2016

Oracle GoldenGate Application Adapters Released

Oracle GoldenGate Application Adapters for JMS and Flatfile was released on 19/July/2016. 

New Features in this release:

  • DDL propagation for heterogeneous relational databases
  • Metadata in trail for both Extract and Replicat processes
  • Oracle Java standard based Java Package names

You now can download the software from OTN or eDelivery.

Oracle GoldenGate Application Adapters 12c (  Documentation

Oracle GoldenGate Adapter for Confluent Kafka Connect

Oracle GoldenGate Adapter/Handler for Kafka Connect (open-source) is released on 07/Jul/2016.


Kafka Connect is a tool for streaming data between Apache Kafka and other data systems in a scalable and reliable way. Kafka Connect can ingest entire databases or collect metrics from all your application servers into Kafka topics, making the data available for stream processing with low latency. An export connector can deliver data from Kafka topics into secondary indexes like Elasticsearch or into batch systems such as Hadoop for offline analysis. (Source: Confluent Website)

This Kafka Connect handler lets you to integrate using the Kafka Connect API which can be managed using Confluent Platform. The Kafka Connect Handler takes change data capture operations from a source trail file and generates data structs ( as well as the associated schemas ( The data structs are serialized via configured converters then enqueued onto Kafka topics. The topic name used corresponds to the fully qualified source table name as obtained from the GoldenGate trail file. Individual operations consist of inserts, updates, and delete operations executed on the source RDBMS. Insert and update operation data include the after change data. Delete operations include the before change data. A primary key update is a special case for an update where one or more of the primary key(s) is/are changed. The primary key update represents a special case in that without the before image data it is not possible to determine what row is actually changing when only in possession of the after change data. The default behavior of a primary key update is to ABEND in the Kafka Connect formatter. However, the formatter can be configured to simply treat these operations as regular updates or to treat them as deletes and then an insert which is the closest big data modeling to the substance of the transaction.

Difference between official GoldenGate Kafka Handler and Kafka Connect Handler

The Kafka Handler officially released in Oracle GoldenGate for Big Data is slightly different in functionality than the Kafka Connect Handler/Formatter included in this opensource component.

  • The officially released Kafka Handler interfaces with pluggable formatters to output the data to Kafka in XML, JSON, Avro, or delimited text format.
  • The Kafka Connect Handler/Formatter builds up Kafka Connect Schemas and Structs.  It relies on the Kafka Connect framework to perform the serialization using the Kafka Connect converters before delivering the data to topic.

Compatibility Matrix

  • Oracle GoldenGate for Big Data
  • Kafka/Kafka Connect

Download Location

 It is available for download at

 Other Confluent Connectors are listed here

Tuesday Jun 21, 2016

Oracle GoldenGate Studio Release is Available

Oracle GoldenGate Studio (OGGS) is released on June 21st, 2016. You can now download the software from OTN and eDelivery. This is the second release after we launched the OGGS at the start of this calendar year. In this release, we have certified two new heterogeneous databases (MySQL and Microsoft SQL Server) that you can use to design and deploy in high-volume, real-time database replication.

Key Features

  • Design and deploy high-volume, real-time replication across heterogeneous platforms in just a few clicks
  • Best practice solution templates and wizards
  • Automap tables and drag and drop custom maps
  • Deploy the same solution to multiple locations
  • Monitor active deployments with many monitoring points and track deployment history
  • Refresh the metadata in mapping editor

You can refer GoldenGate Studio Data Sheet  for brief information about Studio, new features and benefits. The detailed information can be read from Oracle GoldenGate Studio 12.2 documentation.

Hope to see you guys using new Studio release. Feel free to reach out to me for your queries by posting in this blog or tweeting @nisharsoneji

Oracle Data Integrator (ODI) Now Available

Oracle Data Integrator is now available! Please visit the ODI OTN page for downloads, documentation, related collateral and other useful links.

Take a look here for the latest details of this release – and read on for some highlights:

Hyperion Essbase and Hyperion Planning Knowledge Modules

Hyperion Essbase and Hyperion Planning Knowledge Modules have been made available out of the box with Oracle Data integrator and support the latest version ( of these Hyperion Applications.

Integrated Capture/Delivery support in GoldenGate Knowledge Modules

The GoldenGate Journalization Knowledge Modules (JKMs) for Oracle databases have been updated and now support Integrated Capture and Delivery. This updated functionality can improve performance and provides better scalability and load balancing.

Support for Cubes and Dimensions
Core ETL – ELT enhancements have been made; where ODI now provides support for two types of dimensional objects: Cubes and Dimensions. Users can create and use Cubes and Dimensions objects directly in Mappings to improve developer productivity with out of the box patterns that automate the loading of dimensional objects. This also allows for improved Type 2 Slowly Changing Dimensions and brand new Type 3 Slowly Changing Dimensions support with ODI.

Big Data Configuration Wizard
A brand new Big Data Configuration wizard is now available in the ODI Studio Gallery and provides a single entry point to configure the Topology objects for Hadoop technologies such as Hadoop, Hive, Spark, Pig, Oozie, etc.

Let us know how you are using ODI – and try out this new version to keep up with what’s current!

Tuesday May 24, 2016

Oracle GoldenGate for Big Data update is available now!

Oracle GoldenGate for Big Data update is available

I am pleased to announce the general availability of Oracle GoldenGate for Big Data

What’s new in Oracle GoldenGate for Big Data ?

  • New Formats – Avro OCF and Sequence File
Oracle GoldenGate for Big Data can now write data in Avro Object Container Format (OCF) and HDFS Sequence File format.

  • Automatic Metadata creation and update DDL changes to Hadoop.
Oracle GoldenGate for Big Data can now automatically create target Hive table and provide DDL updates to Hive/HCatalog. Oracle GoldenGate for Big Data can also automatically provide versioned schema files to HDFS directories as well.

  • Data Conversion – Hex Encoding and Character replacements
You will now be able to deliver your CDC data in hex encoding format in addition to base24 format. Oracle GoldenGate for Big Data will be able to find and replace using regular expressions. You can now include primary key in JSON format. Oracle GoldenGate for Big Data can convert time-stamp to ISO8601 format. .

  • Security Improvements – Oracle Wallet Integration and Kafka SSL
Oracle GoldenGate for Big Data can now integrate with Oracle Wallet. Kafka integration now provides integration with Kafka SSL which is available from Kafka 0.9.x.
  • Kafka Multiple Topic support
Oracle GoldenGate for Big Data can now automatically create target topics based on the source tables, if you would like to segregate the data from one table to a topic.
  • · Newer Certifications and many more !!!

Note: The installer is available as an update installer for So please look carefully for the update release file which contains the description with release version.

More information on Oracle GoldenGate

Thursday May 12, 2016

Looking for Cutting-Edge Data Integration & Governance Solutions: Nominate NOW for the 2016 Excellence Awards

It is nomination time!!!

This year's Oracle Cloud Platform Innovation – Excellence Awards will honor customers and partners who are creatively using Oracle products. Think you have something unique and innovative with Oracle Data Integration & Governance products?

We'd love to hear from you! Please submit today in the Data Integration & Governance category. This year’s nomination process is a little bit different in the sense that the forms are fully online.

The deadline for the nomination is Monday, June 20, 2016. Win a free pass to Oracle OpenWorld 2016!

Let’s reminisce a little…

For details on the 2015 Big Data, Business Analytics, and Data Integration Winners:, Caixa Bank, Serta Simmons Bedding, Skanska, Scottish & Southern Energy and Tampa International Airport, check out this blog post.

For details on the 2014 Data Integration Winners: NET Serviços and Griffith University, check out this blog post.

For details on the 2013 Data Integration Winners: Royal Bank of Scotland’s Market and International Banking and The Yalumba Wine Company, check out this blog post.

For details on the 2012 Data Integration Winners: Raymond James Financial and Morrisons Supermarkets, check out this blog post.

We hope to honor you!

Click here to submit your nomination today – scroll to the bottom of the page and select the appropriate category. And just a reminder: the deadline to submit a nomination is 5pm Pacific Time on June 20th, 2016.

Tuesday May 03, 2016

Loading Amazon Redshift with Oracle GoldenGate

Organizations deploy Oracle GoldenGate to replicate data between heterogeneous databases for both on-premise and public cloud environments. Check out some interesting articles about how to load Amazon Redshift with Oracle GoldenGate from Eddie Ho.  This is a two part series where part one provides a high level solution overview. Part two provides the actual details of a sample implementation. Happy reading!

Part 1 of 2

How to load Amazon Redshift by micro batches with Oracle GoldenGate - Part 1/2 (Overview)

Part 2 of 2

How to load Amazon Redshift by micro batches with Oracle GoldenGate - Part 2/2 (Deep Dive/Design Details)

Thursday Apr 21, 2016

Oracle GoldenGate for DB2 for i Release is Available

Oracle GoldenGate for DB2 i was released on 4/15/2016. You now can download the software from OTN and eDelivery.[Read More]

Oracle GoldenGate for DB2 z/OS Release is Available

Oracle GoldenGate for DB2 z/OS was released on 4/15/2016. You now can download the software from OTN and eDelivery. [Read More]

Sunday Apr 17, 2016

Oracle GoldenGate Adapter for ElasticSearch

Oracle GoldenGate can now integrate with ElasticSearch using the GoldenGate Adapter for ElasticSearch. GoldenGate Adapter for ElasticSearch can run on the latest Java based Replicat available with Oracle GoldenGate for Big Data 12.2. It uses high performance native Java driver to ElasticSearch. It can handle automatic DDL replication and supports inserts, updates and deletes into ElasticSearch. 

This project has converted to an open-source project for increased contribution from the Java community. The downloadable bundle contains source code, binary (jar) files, sample configuration files and instructions to use (readme.txt). You can download the bundle from URL


Compatibility Matrix:

  • GoldenGate for Big Data: (All platforms)
  • ElasticSearch Server : 2.0.0 and above
  • ElasticSearch Java Driver: 2.2.1

Thursday Mar 24, 2016

How to connect to GoldenGate Cloud Service 

After you create a GoldenGate Cloud Service (GGCS) instance, you can then connect to the virtual machine to perform the setup. The How to connect to GoldenGate Cloud Service provides the instructions on how you can connect to GGCS instances using SSH in PuTTY on Windows and SSH command from LINUX. You can also connect to GGCS instance via SFTP.

I would also recommend you to refer to the Getting Started with GoldenGate Cloud Service Tutorial for additional information.

To reach Jinyu or send your suggestions/questions, you can follow @jinyu512.

Wednesday Mar 23, 2016

Getting Started with Oracle GoldenGate Cloud Service

GoldenGate Cloud Service (GGCS), is a cloud based real-time data integration and replication service, which provides seamless and data movement from various on-premises relational databases to databases in the cloud with sub-seconds latency while maintaining data consistency and offering fault tolerance and resiliency. This blog provides an overview.[Read More]

Thursday Mar 10, 2016

Oracle GoldenGate Plug-in for Oracle Enterprise Manager 13.1 is released

Oracle GoldenGate Plug-In 13.1.1 for Oracle Enterprise Manager Cloud Control 13.1 is released.

Oracle GoldenGate Plug-In 13.1.1 is certified to work with Enterprise Manager 13.1 and Oracle GoldenGate Core,, and versions.

You may download the software for online or offline upgrade from the following locations

Please refer to the following links for more information:

  • Documentation Oracle GoldenGate for Enterprise Manager

  • Documentation Oracle Enterprise Manager Cloud Control

  • Learn more about Oracle GoldenGate Management Pack

  • Learn more about Oracle Enterprise Manager Cloud Control


Learn the latest trends, use cases, product updates, and customer success examples for Oracle's data integration products-- including Oracle Data Integrator, Oracle GoldenGate and Oracle Enterprise Data Quality


« August 2016