Wednesday Jul 20, 2016

Oracle GoldenGate Application Adapters 12.2.0.1.2 Released

Oracle GoldenGate Application Adapters 12.2.0.1.2 for JMS and Flatfile was released on 19/July/2016. 

New Features in this release:

  • DDL propagation for heterogeneous relational databases
  • Metadata in trail for both Extract and Replicat processes
  • Oracle Java standard based Java Package names

You now can download the software from OTN or eDelivery.

Oracle GoldenGate Application Adapters 12c (12.2.0.1)  Documentation

Oracle GoldenGate Adapter for Confluent Kafka Connect

Oracle GoldenGate Adapter/Handler for Kafka Connect (open-source) is released on 07/Jul/2016.

Summary

Kafka Connect is a tool for streaming data between Apache Kafka and other data systems in a scalable and reliable way. Kafka Connect can ingest entire databases or collect metrics from all your application servers into Kafka topics, making the data available for stream processing with low latency. An export connector can deliver data from Kafka topics into secondary indexes like Elasticsearch or into batch systems such as Hadoop for offline analysis. (Source: Confluent Website)

This Kafka Connect handler lets you to integrate using the Kafka Connect API which can be managed using Confluent Platform. The Kafka Connect Handler takes change data capture operations from a source trail file and generates data structs (org.apache.kafka.connect.data.Struct) as well as the associated schemas (org.apache.kafka.connect.data.Schema). The data structs are serialized via configured converters then enqueued onto Kafka topics. The topic name used corresponds to the fully qualified source table name as obtained from the GoldenGate trail file. Individual operations consist of inserts, updates, and delete operations executed on the source RDBMS. Insert and update operation data include the after change data. Delete operations include the before change data. A primary key update is a special case for an update where one or more of the primary key(s) is/are changed. The primary key update represents a special case in that without the before image data it is not possible to determine what row is actually changing when only in possession of the after change data. The default behavior of a primary key update is to ABEND in the Kafka Connect formatter. However, the formatter can be configured to simply treat these operations as regular updates or to treat them as deletes and then an insert which is the closest big data modeling to the substance of the transaction.

Difference between official GoldenGate Kafka Handler and Kafka Connect Handler

The Kafka Handler officially released in Oracle GoldenGate for Big Data 12.2.0.1.x is slightly different in functionality than the Kafka Connect Handler/Formatter included in this opensource component.

  • The officially released Kafka Handler interfaces with pluggable formatters to output the data to Kafka in XML, JSON, Avro, or delimited text format.
  • The Kafka Connect Handler/Formatter builds up Kafka Connect Schemas and Structs.  It relies on the Kafka Connect framework to perform the serialization using the Kafka Connect converters before delivering the data to topic.


Compatibility Matrix

  • Oracle GoldenGate for Big Data 12.2.0.1.1
  • Confluent.io Kafka/Kafka Connect 0.9.0.1-cp

Download Location

 It is available for download at java.net

Tuesday Jun 21, 2016

Oracle GoldenGate Studio 12.2.1.1.0 Release is Available

Oracle GoldenGate Studio (OGGS) 12.2.1.1.0 is released on June 21st, 2016. You can now download the software from OTN and eDelivery. This is the second release after we launched the OGGS at the start of this calendar year. In this release, we have certified two new heterogeneous databases (MySQL and Microsoft SQL Server) that you can use to design and deploy in high-volume, real-time database replication.

Key Features

  • Design and deploy high-volume, real-time replication across heterogeneous platforms in just a few clicks
  • Best practice solution templates and wizards
  • Automap tables and drag and drop custom maps
  • Deploy the same solution to multiple locations
  • Monitor active deployments with many monitoring points and track deployment history
  • Refresh the metadata in mapping editor

You can refer GoldenGate Studio 12.2.1.1 Data Sheet  for brief information about Studio, new features and benefits. The detailed information can be read from Oracle GoldenGate Studio 12.2 documentation.

Hope to see you guys using new Studio release. Feel free to reach out to me for your queries by posting in this blog or tweeting @nisharsoneji

Oracle Data Integrator (ODI) 12.2.1.1.0 Now Available

Oracle Data Integrator 12.2.1.1.0 is now available! Please visit the ODI OTN page for downloads, documentation, related collateral and other useful links.

Take a look here for the latest details of this release – and read on for some highlights:

Hyperion Essbase and Hyperion Planning Knowledge Modules

Hyperion Essbase and Hyperion Planning Knowledge Modules have been made available out of the box with Oracle Data integrator and support the latest version (11.1.2.4) of these Hyperion Applications.

Integrated Capture/Delivery support in GoldenGate Knowledge Modules

The GoldenGate Journalization Knowledge Modules (JKMs) for Oracle databases have been updated and now support Integrated Capture and Delivery. This updated functionality can improve performance and provides better scalability and load balancing.

Support for Cubes and Dimensions
Core ETL – ELT enhancements have been made; where ODI now provides support for two types of dimensional objects: Cubes and Dimensions. Users can create and use Cubes and Dimensions objects directly in Mappings to improve developer productivity with out of the box patterns that automate the loading of dimensional objects. This also allows for improved Type 2 Slowly Changing Dimensions and brand new Type 3 Slowly Changing Dimensions support with ODI.


Big Data Configuration Wizard
A brand new Big Data Configuration wizard is now available in the ODI Studio Gallery and provides a single entry point to configure the Topology objects for Hadoop technologies such as Hadoop, Hive, Spark, Pig, Oozie, etc.

Let us know how you are using ODI – and try out this new version to keep up with what’s current!

Tuesday May 24, 2016

Oracle GoldenGate for Big Data 12.2.0.1.1 update is available now!

Oracle GoldenGate for Big Data 12.2.0.1.1 update is available

I am pleased to announce the general availability of Oracle GoldenGate for Big Data 12.2.0.1.1.



What’s new in Oracle GoldenGate for Big Data 12.2.0.1.1 ?

  • New Formats – Avro OCF and Sequence File
Oracle GoldenGate for Big Data can now write data in Avro Object Container Format (OCF) and HDFS Sequence File format.

  • Automatic Metadata creation and update DDL changes to Hadoop.
Oracle GoldenGate for Big Data can now automatically create target Hive table and provide DDL updates to Hive/HCatalog. Oracle GoldenGate for Big Data can also automatically provide versioned schema files to HDFS directories as well.

  • Data Conversion – Hex Encoding and Character replacements
You will now be able to deliver your CDC data in hex encoding format in addition to base24 format. Oracle GoldenGate for Big Data will be able to find and replace using regular expressions. You can now include primary key in JSON format. Oracle GoldenGate for Big Data can convert time-stamp to ISO8601 format. .

  • Security Improvements – Oracle Wallet Integration and Kafka SSL
Oracle GoldenGate for Big Data can now integrate with Oracle Wallet. Kafka integration now provides integration with Kafka SSL which is available from Kafka 0.9.x.
  • Kafka Multiple Topic support
Oracle GoldenGate for Big Data can now automatically create target topics based on the source tables, if you would like to segregate the data from one table to a topic.
  • · Newer Certifications and many more !!!

Note: The 12.2.0.1.1 installer is available as an update installer for 12.2.0.1.0. So please look carefully for the update release file which contains the description with 12.2.0.1.1 release version.

More information on Oracle GoldenGate 12.2.0.1.1

Thursday May 12, 2016

Looking for Cutting-Edge Data Integration & Governance Solutions: Nominate NOW for the 2016 Excellence Awards

It is nomination time!!!

This year's Oracle Cloud Platform Innovation – Excellence Awards will honor customers and partners who are creatively using Oracle products. Think you have something unique and innovative with Oracle Data Integration & Governance products?

We'd love to hear from you! Please submit today in the Data Integration & Governance category. This year’s nomination process is a little bit different in the sense that the forms are fully online.

The deadline for the nomination is Monday, June 20, 2016. Win a free pass to Oracle OpenWorld 2016!

Let’s reminisce a little…

For details on the 2015 Big Data, Business Analytics, and Data Integration Winners: amazon.com, Caixa Bank, Serta Simmons Bedding, Skanska, Scottish & Southern Energy and Tampa International Airport, check out this blog post.

For details on the 2014 Data Integration Winners: NET Serviços and Griffith University, check out this blog post.

For details on the 2013 Data Integration Winners: Royal Bank of Scotland’s Market and International Banking and The Yalumba Wine Company, check out this blog post.

For details on the 2012 Data Integration Winners: Raymond James Financial and Morrisons Supermarkets, check out this blog post.

We hope to honor you!

Click here to submit your nomination today – scroll to the bottom of the page and select the appropriate category. And just a reminder: the deadline to submit a nomination is 5pm Pacific Time on June 20th, 2016.


Tuesday May 03, 2016

Loading Amazon Redshift with Oracle GoldenGate

Organizations deploy Oracle GoldenGate to replicate data between heterogeneous databases for both on-premise and public cloud environments. Check out some interesting articles about how to load Amazon Redshift with Oracle GoldenGate from Eddie Ho.  This is a two part series where part one provides a high level solution overview. Part two provides the actual details of a sample implementation. Happy reading!

Part 1 of 2

How to load Amazon Redshift by micro batches with Oracle GoldenGate - Part 1/2 (Overview)

Part 2 of 2

How to load Amazon Redshift by micro batches with Oracle GoldenGate - Part 2/2 (Deep Dive/Design Details)

Thursday Apr 21, 2016

Oracle GoldenGate for DB2 for i 12.2.1.0.2 Release is Available

Oracle GoldenGate for DB2 i 12.2.0.1.2 was released on 4/15/2016. You now can download the software from OTN and eDelivery.[Read More]

Oracle GoldenGate for DB2 z/OS 12.2.1.0.2 Release is Available

Oracle GoldenGate for DB2 z/OS  12.2.0.1.2 was released on 4/15/2016. You now can download the software from OTN and eDelivery. [Read More]

Sunday Apr 17, 2016

Oracle GoldenGate Adapter for ElasticSearch

Oracle GoldenGate can now integrate with ElasticSearch using the GoldenGate Adapter for ElasticSearch. GoldenGate Adapter for ElasticSearch can run on the latest Java based Replicat available with Oracle GoldenGate for Big Data 12.2. It uses high performance native Java driver to ElasticSearch. It can handle automatic DDL replication and supports inserts, updates and deletes into ElasticSearch. 

This project has converted to an open-source project for increased contribution from the Java community. The downloadable bundle contains source code, binary (jar) files, sample configuration files and instructions to use (readme.txt). You can download the bundle from URL https://java.net/projects/oracledi/downloads/directory/GoldenGate/Oracle%20GoldenGate%20Adapter%20for%20ElasticSearch

 

Compatibility Matrix:

  • GoldenGate for Big Data: 12.2.0.1.0 (All platforms)
  • ElasticSearch Server : 2.0.0 and above
  • ElasticSearch Java Driver: 2.2.1

Thursday Mar 24, 2016

How to connect to GoldenGate Cloud Service 

After you create a GoldenGate Cloud Service (GGCS) instance, you can then connect to the virtual machine to perform the setup. The How to connect to GoldenGate Cloud Service provides the instructions on how you can connect to GGCS instances using SSH in PuTTY on Windows and SSH command from LINUX. You can also connect to GGCS instance via SFTP.

I would also recommend you to refer to the Getting Started with GoldenGate Cloud Service Tutorial for additional information.

To reach Jinyu or send your suggestions/questions, you can follow @jinyu512.

Wednesday Mar 23, 2016

Getting Started with Oracle GoldenGate Cloud Service

GoldenGate Cloud Service (GGCS), is a cloud based real-time data integration and replication service, which provides seamless and data movement from various on-premises relational databases to databases in the cloud with sub-seconds latency while maintaining data consistency and offering fault tolerance and resiliency. This blog provides an overview.[Read More]

Thursday Mar 10, 2016

Oracle GoldenGate Plug-in for Oracle Enterprise Manager 13.1 is released

Oracle GoldenGate Plug-In 13.1.1 for Oracle Enterprise Manager Cloud Control 13.1 is released.

Oracle GoldenGate Plug-In 13.1.1 is certified to work with Enterprise Manager 13.1 and Oracle GoldenGate Core 11.2.1.0.20+, 12.1.2.0.1, 12.1.2.1.0 and 12.2.0.1.0(latest) versions.

You may download the software for online or offline upgrade from the following locations

Please refer to the following links for more information:

  • Documentation Oracle GoldenGate for Enterprise Manager 13.1.1.0.0

  • Documentation Oracle Enterprise Manager Cloud Control 13.1.1.0.0

  • Learn more about Oracle GoldenGate Management Pack

  • Learn more about Oracle Enterprise Manager Cloud Control

Friday Feb 19, 2016

Oracle GoldenGate Adapter for MongoDB

Oracle GoldenGate can now integrate with Mongo DB using the GoldenGate Adapter for MongoDB. GoldenGate Adapter for MongoDB can run on the latest Java based Replicat available with Oracle GoldenGate for Big Data 12.2. It uses high performance native Java driver to MongoDB. It can handle automatic DDL replication and supports inserts, updates and deletes into MongoDB.

This project has converted to an open-source project for increased contribution from the Java community. The downloadable bundle contains source code, binary (jar) files, sample configuration files and instructions to use (readme.txt). You can download the bundle from URL https://java.net/projects/oracledi/downloads/directory/GoldenGate/MongoDB%20Adapter

Compatibility Matrix:

  • GoldenGate for Big Data: 12.2.0.1.0 (All platforms)
  • MongoDB Server : 2.4, 2.6, 3.0 3.2
  • MongoDB Java Driver: 3.2.2


Monday Feb 01, 2016

Oracle GoldenGate 12.2 Release

In keeping with our foundation principles, the focus for this release has been Usability, Manageability, Heterogeneity, and Performance.  

What’s New in Oracle GoldenGate 12.2 (Replication Simplification)

GoldenGate Platform Features –for Oracle, SQL Server, Sybase, Teradata, Informix, TimesTen, DB2 LUW, NonStop SQL/MX, PostgreSQL, and MySQL

Automatic Heartbeat Table
Record end-to-end replication lag and view details with a database view. Valid for heterogeneous configurations as well.

Metadata in Trails
No need to generate a definitions file or use SOURCEDEFS/ASSUMETARGETDEFS.

Parameter Insight
Lookup parameter definitions from GGSCI with INFO PARAM, get the list of running parameters for a process with SEND … GETPARAMINFO, and pre-validate parameter files with the new checkprm utility.

One Billion Trail Files
Trail file sequence length has increased to nine digits; a 1000x increase and effectively one billion trail files.

For the Oracle Database

  • DL replication between more than 2 Oracle databases
  • Seamless DML and DDL replication between tables of differing structures
  • Replicat integration with the Oracle Data Pump
  • Filters past table data loaded to target tables from expdp/impdp: DBOPTIONS ENABLE_INSTANTIATION_FILTERING
  • Integrated Capture support for invisible columns
  • Offload fetching to Active Data Guard
  • Oracle Clusterware command and control integration

For SQL Server

  • Remote ALO mode Capture
  • SQL Server Standard Edition Capture and Delivery
  • SQL Server 2014 Compressed Log backups
  • Column level character sets

For Teradata

  • Replicat can process truncates
  • Column level character sets
  • Capture from Teradata is no longer supported from this version onward

For DB2 LUW

  • Column level character sets
  • Temporal Tables

More information on Oracle GoldenGate 12.2

Downloads: http://www.oracle.com/technetwork/middleware/goldengate/downloads/index.html

Documentation: http://docs.oracle.com/goldengate/c1221/gg-winux/index.html

Certification Matrix: http://www.oracle.com/technetwork/middleware/data-integration/goldengate12-2-x-cert-matrix-2769360.xls

About

Learn the latest trends, use cases, product updates, and customer success examples for Oracle's data integration products-- including Oracle Data Integrator, Oracle GoldenGate and Oracle Enterprise Data Quality

Search

Archives
« July 2016
SunMonTueWedThuFriSat
     
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
21
22
23
24
25
26
27
28
29
30
31
      
Today