Tuesday Feb 18, 2014

Recap of Oracle GoldenGate 12c Webcast with Q&A

Simply amazing! That’s how I would summarize last week’s webcast for Oracle GoldenGate 12c.  It was a very interactive event with hundreds of live attendees and hundreds of great questions. In the presentation part my colleagues, Doug Reid and Joe deBuzna, went over the new features of Oracle GoldenGate 12c. They explained Oracle GoldenGate 12c key new features including:

  • Integrated Delivery for Oracle Database,
  • Coordinated Delivery for non-Oracle databases,
  • Support for Oracle Database 12c multitenant architecture,
  • Enhanced high availability via integration with Oracle Data Guard Fast-Start Failover,
  • Expanded heterogeneity, i.e. support for new databases and operating systems,
  • Improved security,
  • Low-downtime database migration solutions for Oracle E-Business Suite,
  • Integration with Oracle Coherence.

We also had a nice long and live Q&A section. In the previous Oracle GoldenGate webcasts, we could not respond to all audience questions in a 10-15 minute timeframe at the end of the presentation. This time we kept the presentation part short and left more than 30 minutes for Q&A. To our surprise, we could not answer even half of the questions we received. 

If you missed this great webcast discussing the new features of Oracle GoldenGate 12c,  and more than 30 minutes of Q&A with GoldenGate Product Management, you can still watch it on demand via the link below.

On Demand Webcast: Introducing Oracle GoldenGate 12c: Extreme Performance Simplified

On this blog post I would like to provide brief answers from our PM team  for some of the questions that we were not able to answer during the live webcast.

1) Does Oracle GoldenGate replicate DDL statements or DML for Oracle Database?

    Oracle GoldenGate replicates DML and DDL operations for Oracle Database and Teradata.

2) Where do we get more info on how to setup integration with Data Guard Fast-Start Failover (FSFO)?

     Please see the following blog posts or documents on My Oracle Support:

Best Practice - Oracle GoldenGate and Oracle Data Guard - Switchover/Fail-over Operations for GoldenGate    [My Oracle Support Article ID   1322547.1] 

Best Practice - Oracle GoldenGate 11gr2 integrated extract and Oracle Data Guard - Switchover/Fail-over Operations  [My Oracle Support Article ID 1436913.1] 

3) Does GoldenGate support SQL Server 2012 extraction? In the past only apply was supported.

Yes, starting with the new 12c release GoldenGate captures from SQL Server 2012 in addition to delivery capabilities.

4) Which RDBMS does GoldenGate 12c support?

GoldenGate supports all major RDBMS. For a full list of supported platforms please see Oracle GoldenGate certification matrix.

5) Could you provide some more details please on Integrated Delivery for dynamic parallel threads at Target side?

Please check out our white papers on Oracle GoldenGate 12c resource kit for more details on the new features, and how Oracle GoldenGate 12c works with Oracle Database. 

6) What is the best way to sync partial data (based on some selection criterion) from a table between databases?

 Please refer to the article: How To Resync A Single Table With Minimum Impact To Other Tables' Replication? [Article ID 966211.1]

7) How can GoldenGate be better than database trigger to push data into custom tables?

Triggers can cause high CPU overhead, in some cases almost double compared to reading from redo or transaction logs. In addition, they are intrusive to the application and cause management overhead as application changes. Oracle GoldenGate's log-based change data capture is not only low-impact in terms of CPU utilization, but also non-intrusive to the application with low maintenance requirements.

8) Are there any customers in the manufacturing industry using GoldenGate and for which application?

We have many references in manufacturing. In fact, SolarWorld USA was our guest speaker in the executive video webcast last November. You can watch the interview here. RIM Blackberry uses Oracle GoldenGate for multi-master replication between its global manufacturing systems. Here is another manufacturing customer story from AkzoNobel.

9) Does GoldenGate 12c support compressed objects for replication? Also does it supports BLOB/CLOB columns?

Yes, GoldenGate 12c and GoldenGate 11gR2 both support compressed objects. GoldenGate has been supporting BLOB/CLOB columns since version 10.

10) Is Oracle Database 11.2.0.4 mandatory to use GoldenGate 12c Integrated Delivery? Not earlier versions?

Yes. To use GoldenGate 12c’s Integrated Delivery, for the target environment Oracle Database 11.2.04 and above is required .

11) We have Oracle Streams implementation for more than 5 years. We would like to migrate to GoldenGate, however older version of GoldenGate were not supporting filtering individual transactions. Is it supported in GoldenGate 12c?

      Yes, it is supported in GoldenGate 12c.


In future blog posts I will continue to provide answers for common questions we received in the webcast. In the meanwhile I highly recommend watching the Introducing Oracle GoldenGate 12c: Extreme Performance Simplified webcast on demand.

Wednesday Feb 05, 2014

Introducing Oracle GoldenGate 12c: Extreme Performance Simplified

Oracle GoldenGate 12c was released last fall with a long list of new features that simplify configuration and increase flexibility, while delivering easy-to-use, advanced solutions with multi-fold performance gain.  We have been discussing these new features in various blog posts including:

· Advanced Replication for The Masses – Oracle GoldenGate 12c for the Oracle Database.

· GoldenGate 12c - What is Coordinated Delivery?

· GoldenGate 12c - Coordinated Delivery Example

· Oracle GoldenGate 12c - Announcing Support for Microsoft and IBM

And you can find new white papers about the 12c release in the Oracle GoldenGate resource kit.

Following the executive video webcast launching Oracle Data Integrator 12c and Oracle GoldenGate 12c in November 2013, we have set up another webcast for Oracle GoldenGate 12c where our product management team discusses the key new features in more depth and takes live questions from the audience.

If you would like to learn more about GoldenGate 12c I invite you to join us on Feb 12th in a webcast with product experts. You can register for this free event via the link below.

Live Webcast: Introducing Oracle GoldenGate 12c: Extreme Performance Simplified

February 12, 2014 -  10am PT/ 1pm ET

If you have missed our executive launch webcast I highly recommend that you watch it on demand via the link below. It talks about the tighter integration between Oracle Data Integrator 12c and Oracle GoldenGate and features customer and partner speakers from SolarWorld, BT, and Rittman Mead Consulting.

On-Demand Video Webcast: Introducing 12c for Oracle Data Integration

Wednesday Oct 30, 2013

Replicating between Cloud and On-Premises using Oracle GoldenGate

Do you have applications running on the cloud that you need to connect with the on premises systems. The most likely answer to this question is an astounding YES!  If so, then you understand the importance of keep the data fresh at all times across the cloud and on-premises environments. This is also one of the key focus areas for the new GoldenGate 12c release which we announced couple of week ago via a press release.

Most enterprises have spent years avoiding the data “silos” that inhibit productivity. For example, an enterprise which has adopted a CRM strategy could be relying on an on-premises based marketing application used for developing and nurturing leads. At the same time it could be using a SaaS based Sales application to create opportunities and quotes. The sales and the marketing teams which use these systems need to be able to access and share the data in a reliable and cohesive way. This example can be extended to other applications areas such as HR, Supply Chain, and Finance and the demands the users place on getting a consistent view of the data.

When it comes to moving data in hybrid environments some of the key requirements include minimal latency, reliability and security:

  • Data must remain fresh. As data ages it becomes less relevant and less valuable—day-old data is often insufficient in today’s competitive landscape.
  • Reliability must be guaranteed despite system or connectivity issues that can occur between the cloud and on-premises instances.
  • Security is a key concern when replicating between cloud and on-premises instances. There are several options to consider when replicating between the cloud and on-premises instances.

Option 1 – Secured network established between the cloud and on-premises

A secured network is established between the cloud and on-premises which enables the applications (including replication software) running on the cloud and on-premises to have seamless connectivity to other applications irrespective of where they are physically located.

Option 2 – Restricted network established between the cloud and on-premises

A restricted network is established between the cloud and on-premises instances which enable certain ports (required by replication) be opened on both the cloud and on the on-premises instances and white lists the IP addresses of the cloud and on-premises instances.

Option 3 – Restricted network access from on-premises and cloud through HTTP proxy

This option can be considered when the ports required by the applications (including replication software) are not open and the cloud instance is not white listed on the on-premises instance. This option of tunneling through HTTP proxy may be only considered when proper security exceptions are obtained.

Oracle GoldenGate

Oracle GoldenGate is used for major Fortune 500 companies and other industry leaders worldwide to support mission-critical systems for data availability and integration. Oracle GoldenGate addresses the requirements for ensuring data consistency between cloud and on-premises instances, thus facilitating the business process to run effectively and reliably.

The architecture diagram below illustrates the scenario where the cloud and the on-premises instance are connected using GoldenGate through a secured network

In the above scenario, Oracle GoldenGate is installed and configured on both the cloud and the on-premises instances. On the cloud instance Oracle GoldenGate is installed and configured on the machine where the database instance can be accessed. Oracle GoldenGate can be configured for unidirectional or bi-directional replication between the cloud and on premises instances.

The specific configuration details of Oracle GoldenGate processes will depend upon the option selected for establishing connectivity between the cloud and on-premises instances. The knowledge article (ID - 1588484.1) titled ' Replicating between Cloud and On-Premises using Oracle GoldenGate' discusses in detail the options for replicating between the cloud and on-premises instances. The article can be found on My Oracle Support.

To learn more about Oracle GoldenGate 12c register for our launch webcast where we will go into these new features in more detail.   You may also want to download our white paper "Oracle GoldenGate 12c Release 1 New Features Overview"

I would love to hear your requirements for replicating between on-premises and cloud instances, as well as your comments about the strategy discussed in the knowledge article to address your needs. Please post your comments in this blog or in the Oracle GoldenGate public forum - https://forums.oracle.com/community/developer/english/business_intelligence/system_management_and_integration/goldengate

Thursday Oct 24, 2013

Oracle GoldenGate 12c - Leading Enterprise Replication

Oracle GoldenGate 12c released  on October 17th and includes several new cutting edge features that firmly establishes GoldenGate's leader position in the data replication space.   In fact, this release more than doubles the performance of data delivery, supports Oracle's new multitenant database feature,  it's more secure, has more options for high availability, and has made great strides to simplify the configuration and deployment of the product.     Read through the press release if you haven't already and do not miss the quote from Cern's Eva Dafonte Perez, regarding Oracle GoldenGate 12c "….performs five times faster compared to previous GoldenGate versions and simplifies the management of a multi-tier environment"

There are a variety of new and improved features in the Oracle GoldenGate 12c.  Here are the highlights:

  • Optimized for Oracle Database 12c -  GoldenGate 12c is custom tailored to the unique capabilities of Oracle database 12c and out of the box GoldenGate 12c supports multitenant (pluggable database (PDB)) and non-consolidated deployments of Oracle Database 12c.   The naming convention used by database 12c is now in three parts (PDB-name, schema-name, and object name).  We have made changes to the GoldenGate capture process to support the new naming convention and streamlined the whole process so a single GoldenGate capture process is being used at the container level rather than at each individual PDB.  By having the capture process at the container level resource usage and the number of processes are reduced. To view a conceptual architecture diagram click here.
  • Integrated Delivery for the Oracle Database - Leveraging a lightweight streaming API built exclusively for Oracle GoldenGate 12c, this process distributes load, auto tunes the degree of parallelism, scales better, and delivers blinding rates of changed data delivery to the Oracle database.  One of the goals for Oracle GoldenGate 12c was to reduce IT costs by simplifying the configuration and reduce the time to manage complex infrastructures.  In previous versions of Oracle GoldenGate, customers would split transaction loads by grouping tables into multiple different delivery processes (click here to view the previous method). Each delivery process executed independently and without any interaction or knowledge of other delivery processes.  This setup was complicated to configure and time consuming as the developer needed in-depth knowledge of the source and target schemas and the transaction profile. With GoldenGate 12c and Integrated Delivery we have made it easier to configure and faster to deploy.  To view a conceptual architecture diagram of integrated delivery click here
  • Coordinated Delivery for Non-Oracle Databases - Coordinated Delivery orchestrates high-speed apply processes and simplifies the configuration of GoldenGate for non-Oracle targets. In Oracle GoldenGate 12c a single delivery process is used with multiple threads (click here) and key events, such as primary key updates, event markers, DDL, etc, are coordinated between the various threads to insure that the transactions are applied in the same sequence as they were captured, all while delivery improved performance. 
  • Replication Between On-Premises and Cloud-Based systems. - The trend for business to utilize both on-premises and cloud-based systems is rising and businesses need to replicate data back and forth.   GoldenGate 12c can be configured in a variety of ways to provide real-time replication when unrestricted or restricted (limited ports or HTTP tunneling) networks are between on-premises and cloud-based systems.   

  • Expanded Heterogeneity - It wouldn't be a GoldenGate release without new and improved platform support.   Release 1 includes support for MySQL 5.6 and Sybase 15.7.   Upcoming in the next release GoldenGate, support will be expanded for MS SQL Server, DB2, and Teradata.
  • Tighter Security - Oracle GoldenGate 12c is integrated with the Oracle wallet to shield usernames and passwords using strong encryption and aliases.   Customers accustomed to using the Oracle Wallet with other Oracle products will instantly be familiar with how to use this great new feature
  • Expanded Oracle Application and Technology Support -   GoldenGate can be used along with Oracle Coherence to enable real-time changed data feeds to the Coherence cache using Toplink and the Oracle GoldenGate JMS adapter.     Plus,  Oracle Advanced Customer Services (ACS) now offers a low downtime E-Business Suite platform and database migrations using GoldenGate as the enabling technology. 

Keep tuned for more blogs on the new features and the upcoming launch webcast where we will go into these new features in more detail.   In the mean time make sure to read through our white paper "Oracle GoldenGate 12c Release 1 New Features Overview"

Monday Oct 14, 2013

Streaming relational transactions to HBase

Following the introductory blog post on the topic – ' Stream your transactions into Big Data Systems', and blog posts on "Streaming Relational Transactions to HDFS and Hive", in this blog post I focus on the architecture for streaming transactions into HBase.

As shown in the diagram below, integrating database with HBase is accomplished by developing a custom handler using Oracle GoldenGate's Java API and HBase APIs.

 The custom handler is deployed as an integral part of the Oracle GoldenGate Pump process.   The Pump process and the custom adapter are configured through the Pump parameter file and custom adapter's properties file. The Pump process executes adapter in its address space. The Pump reads the Trail File created by the Oracle GoldenGate Capture process and passes the transactions to the adapter. Based on the configuration, the adapter writes the transactions to HBase.

A sample implementation of the HBase adapter is provided on My Oracle Support (Knowledge ID - 1586211.1). This is provided to illustrate the capability and to assist in the adoption of the Oracle GoldenGate Java API in developing custom solutions. The sample implementation illustrates the configuration and the code required for replicating database transactions on an example table to a corresponding HBase table. The instructions for configuring Oracle GoldenGate, compiling and running the sample implementation are also provided.

The sample code and configuration may be extended to develop custom solutions, however, please note that Oracle will not provide support for the code and the configuration illustrated in the knowledge base paper.

As always, I would greatly appreciate if you can share your use case about integrating Oracle GoldenGate with your Big Data strategy and your feedback on using the custom handler for integrating relational database with your Big Data systems. Please post your comments in this blog or in the Oracle GoldenGate public forum - https://forums.oracle.com/community/developer/english/business_intelligence/system_management_and_integration/goldengate

Wednesday Oct 09, 2013

Streaming relational transactions to Hive

Following the introductory blog post on the topic – ' Stream your transactions into Big Data Systems', and blog post on 'Streaming relational transactions to HDFS', in this blog post I will discuss the architecture for streaming relational transactions into Hive.

Referring to the architecture diagram below, integrating database with Hive is accomplished by developing a custom handler using Oracle GoldenGate's Java API and Hadoop HDFS APIs.

The custom handler is deployed as an integral part of the Oracle GoldenGate Pump process. The Pump process and the custom adapter are configured through the Pump parameter file and custom adapter's properties file.The Pump process executes adapter in its address space. The Pump reads the Trail File created by the Oracle GoldenGate Capture process and passes the transactions to the adapter. Based on the configuration, the adapter writes the transactions in a desired format, with the appropriate content to a file which is defined by the Hive DDL for the table.

A sample implementation of the Hive adapter is provided on My Oracle Support (Knowledge ID - 1586188.1). This is provided to illustrate the capability and to assist in the adoption of the Oracle GoldenGate Java API in developing custom solutions. The sample implementation illustrates the configuration and the code required for replicating database transactions on an example table to a corresponding Hive table. The instructions for configuring Oracle GoldenGate, compiling and running the sample implementation are also provided.

The sample code and configuration may be extended to develop custom solutions, however, please note that Oracle will not provide support for the code and the configuration illustrated in the knowledge base paper.

It would be great if you could share your use case about leveraging Oracle GoldenGate in your Big Data strategy and your feedback on using the custom handler for integrating relational database with Hive. Please post your comments in this blog or in the Oracle GoldenGate public forum - https://forums.oracle.com/community/developer/english/business_intelligence/system_management_and_integration/goldengate

Thursday Oct 03, 2013

Streaming relational transactions to Hadoop- HDFS

Following the introductory blog post on the topic – ' Stream your transactions into Big Data Systems'  in this blog post I will drill down on the architecture for streaming  relational transactions into HDFS. 

As you can see in the architecture diagram below, you can integrate relational database with HDFS by developing a custom handler using Oracle GoldenGate's Java API and Hadoop HDFS APIs.

 The custom handler is deployed as an integral part of the Oracle GoldenGate Pump process.   The Pump process and the custom adapter are configured through the Pump parameter file and custom adapter's properties file.

The Pump process executes the adapter in its address space. The Pump reads the Trail File created by the Oracle GoldenGate Capture process and passes the transactions to the adapter. Based on the configuration, the adapter writes the transactions in the desired format, with the appropriate content to a desired file on HDFS.

A sample implementation of the HDFS adapter is provided on My Oracle Support (Knowledge ID - 1586210.1). This is provided to illustrate the capability and to assist in the adoption of the Oracle GoldenGate Java API in developing custom solutions. The sample implementation illustrates the configuration and the code required for replicating database transactions on an example table to a file on HDFS. The instructions for configuring Oracle GoldenGate, compiling and running the sample implementation are also provided.

The sample code and configuration may be extended to develop custom solutions, however, please note that Oracle will not provide support for the code and the configuration illustrated in the knowledge base paper.

Please share your use case about how you use Oracle GoldenGate in your Big Data strategy and your feedback on using the custom handler for integrating relational database with your Big Data systems. Please post your comments in this blog or in the Oracle GoldenGate public forum - https://forums.oracle.com/community/developer/english/business_intelligence/system_management_and_integration/goldengate

Wednesday Sep 25, 2013

Oracle GoldenGate AppAdvantage in Action at Land O’Lakes, Smuckers, and Veolia Water

On Tuesday at OpenWorld we had the honor to host a panel with GoldenGate customers: Land O’Lakes, Smuckers, and Veolia Water. Besides giving us yummy nutrition and healthy water, these companies have another aspect in common. They all use GoldenGate to boost their ERP application.

Veoila Water’s Pierre Kerrinckx came from their HQ in France for this panel and spoke to us about the database migration project for their JD Edwards ERP system. Using GoldenGate Veolia was able to migrate from Oracle Database 10gR2 on Aix 5.3 Oracle 10g R2 to Oracle Database Aix 7.1 Oracle 11g R2 and did so with only 2 hours of interruption to JD Edwards end users. Pierre mentioned, the other benefit of GoldenGate was the ability to switch back to the old environment if needed.

Land O’Lakes’ Mark Kohls talked about their use of GoldenGate for their JD Edwards ERP system supporting the Purina business line. Land O’Lakes had to migrate enterprise-wide JDE Xe ERP system to new database and application server platform with minimal downtime to the business. While their goal was to have less than 8 hours of downtime, with GoldenGate they limited downtime to 30 minutes.

Both Veolia and Land O’Lakes used GoldenGate in an Active-Passive fashion, meaning that the new environment was not used simultaneously with the old one, and the users migrated all at once. GoldenGate provides Active-Active migration model too, if the company prefers to do a phased migration and truly zero downtime.

Smuckers's Neal Indermuhle had a different story to share. He talked about operational reporting for their critical Oracle E-Business Suite and how using Oracle GoldenGate helped the company to achieve the near real-time data they need in making critical business decisions. Neil shared that the replication latency averages less than 10 seconds and Oracle GoldenGate Veridata is leveraged to validate synchronization.

I would like to thank Pierre, Mark, and Neal for sharing their best practices, and taking tough questions from the audience. If you would like to learn more about Oracle GoldenGate’s solutions for JD Edwards, E-Business Suite and other key Oracle Applications please check out our new resource center with recorded video presentations and detailed white papers.

Before I get ready for another full day at OpenWorld tomorrow I would like to leave you with the key GoldenGate sessions we have lined up for Wednesday:

Best Practices for Integrating Oracle GoldenGate with Oracle Active Data Guard (CON8500)
Wednesday, September 25, 2013 at 10:15AM-11:15AM PT
Moscone South – 104

Powering Solutions for Oracle Applications with Oracle GoldenGate (CON8897)
Wednesday, September 25, 2013 at 11:45AM-12:45PM PT
Moscone West – 2024

Integrated Apply for Oracle Database: Scalable Replication with Oracle GoldenGate (CON8198)
Wednesday, September 25, 2013 at 5:00PM-6:00PM PT
Moscone North – 131

Friday Sep 20, 2013

Must-Attend Oracle GoldenGate sessions at OpenWorld

 We are very excited for a great event next week. In my last couple of blogs I gave overviews of what is lined up in the Data Integration track. Today I’d like to highlight some of the other key Oracle GoldenGate sessions in case you missed them in our Focus On Data Integration document.

 Obviously the Oracle GoldenGate: New Features and Product Strategy (CON8867) session on Monday at 12:15PM in Moscone West – 2024 is a must-attend session for the GoldenGate community. You will hear the latest features and the roadmap.

If you are currently evaluating high availability solutions then the session “Continuous Availability with Oracle GoldenGate: Best Practices from Comcast” will help you greatly. You’ll get to hear best practices from Comcast on how they implemented four-way and three-way multimaster (active-active) replication architectures using Oracle GoldenGate. You can see how they were able to perform zero downtime system maintenance activities such as patching and upgrades of the operating systems and relational databases supporting critical business operations.

Continuous Availability with Oracle GoldenGate: Best Practices from Comcast (CON8951)

Monday at 12:15PM PT Moscone South – 300

 On Tuesday the session “A Panel of Masterminds: Perspectives from Oracle GoldenGate Customers” will feature a customer panel made up of enterprise architects and other data integration professionals to discuss how they revolutionized their business using Oracle GoldenGate. This interactive session will provide examples of how Oracle GoldenGate supports critical Oracle Applications such as Oracle E-Business Suite and JD Edwards.

A Panel of Masterminds: Perspectives from Oracle GoldenGate Customers (CON8898)

Tuesday at 3:45PM-4:45PM PT Moscone West – 2024

Data integration is not simply replication and in many instances it requires real-time ETL capability. Oracle GoldenGate and Oracle Data Integrator work together for improved data integration agility. In the Hands-On-Lab “Combining Oracle Data Integrator and Oracle GoldenGate”, specifically designed for developers, DBAs, and architects, you will hear best practices for using Oracle GoldenGate and Oracle Data Integrator together to perform real-time ETL. Attendees will experience and hands-on walkthrough on how to configure Oracle GoldenGate from Oracle Data Integrator Studio

 Hand-on-Lab: Combining Oracle Data Integrator and Oracle GoldenGate (HOL10144)

Tuesday at 3:45PM Marriott Marquis – Nob Hill AB

Oracle GoldenGate and Oracle Active Data Guard are two powerful technologies that can be implemented together seamlessly. On Wednesday you can learn how these two technologies can work together in the session “Best Practices for Integrating Oracle GoldenGate with Oracle Active Data Guard”. For Oracle Database customers incorporating data integration with high availability, this session is a can’t miss!

Best Practices for Integrating Oracle GoldenGate with Oracle Active Data Guard (CON8500)

Wednesday 10:15AM PT Moscone South – 104

 For E-Business Suite, Oracle BI, and Oracle Coherence customers a great session awaits you on Wednesday: “Powering Solutions for Oracle Applications with Oracle GoldenGate” will cover E-Business Suite platform migrations and operational reporting, Oracle BI real-time reporting, and Oracle Coherence hot caching. This is a great opportunity to learn how Oracle GoldenGate can extend capabilities with your business applications

Powering Solutions for Oracle Applications with Oracle GoldenGate (CON8897)

Wednesday 11:45AM PT Moscone West – 2024

 On Thursday we will start with the session “Oracle Management Pack for Oracle GoldenGate: Product Update”, which will cover the latest features and enhancements to managing and monitoring GoldenGate.

Oracle Management Pack for Oracle GoldenGate: Product Update (CON9105)

Thursday 11:00AM PT Moscone West – 2012

 In the session “Deploying Oracle GoldenGate with Multitenant Container Databases” you can learn how Oracle GoldenGate can be deployed to capture and replicate changes using Container Databases (CDBs) and Pluggable Databases (PDBs) introduced in the Oracle Database 12c multitenant architecture. Our experts will also provide Oracle GoldenGate configuration recommendations for common and advanced deployment models within the multitenant architecture.

Deploying Oracle GoldenGate with Multitenant Container Databases (CON8499)

Thursday 2:00PM Moscone South – 200

A key use case for GoldenGate is providing zero downtime, and low-risk database upgrades and platform changes. “Cross-Platform Database Upgrades with Oracle GoldenGate” will cover database upgrade scenarios and how you can leverage Oracle GoldenGate and Oracle Data Guard technologies to achieve your upgrade goals. In addition, you will learn how to take advantage of Oracle Advanced Customers Support Services to help you complete your business-critical upgrades while achieving high availability.

Cross-Platform Database Upgrades with Oracle GoldenGate (CON4286)

Thursday 2:00PM Moscone South – 305

As every year GoldenGate team offers a set of strong hands-on-labs. “Deep Dive into Oracle GoldenGate” hands-on-lab’s focus is to provide an overview of the Oracle GoldenGate architecture and then allow attendees to instantiate a secondary database that can be used for disaster recovery or a reporting instance. Hope you can join this session and see firsthand how easy Oracle GoldenGate is to use and how it can be a very valuable technology solution for your organization.

Deep Dive into Oracle GoldenGate (HOL10026)

Thursday 11:00AM Marriott Marquis – Nob Hill AB

Oracle GoldenGate customers looking to take control of their Oracle GoldenGate deployments must attend our Hands-On-Lab session “Deep Dive into Oracle GoldenGate Monitor”. This lab will focus on our complementary product Oracle GoldenGate Monitor, designed to deliver end-to-end visibility into Oracle GoldenGate instances across the enterprise. Attendees will learn about key features including automatic heterogeneous solution discovery, persisted monitoring points, display of replication elements, lag graphs, and creation of alerts.

Deep Dive into Oracle GoldenGate Monitor (HOL10128)

Thursday 12:30 PM - 1:30 PM PT-- Marriott Marquis - Nob Hill AB

I also would like to remind you that you can visit GoldenGate product management in the following demo pods to ask your questions:

Oracle GoldenGate and Oracle Data Integrator – POD 3412

Monitoring Oracle GoldenGate for End-to-End Visibility – POD 3493

Oracle GoldenGate for Oracle Applications – POD 3494

Oracle GoldenGate: Real-Time Transactional Database Replication – POD 3518

Next week you will hear from me and our PM team about what was discussed in these sessions. Stay tuned for more, and enjoy OpenWorld 2013 next week!

 

Thursday Sep 12, 2013

Stream Relational Transactions into Big Data Systems

Are you one of the organizations adopting ‘big data systems’ to manage and analyze a class of data typically referred to as big data? If so, you may know that big data includes data that could be structured, semi-structured or unstructured, each of which originates from a variety of different sources.  Another characterization of big data is described by the data's volume, velocity, and veracity. Due to its promise to help harness the data deluge we are faced with, the adoption of big data solutions is becoming quite pervasive. In this blog post I’d like discuss how to leverage Oracle GoldenGate’s real-time replication for big data systems.

The term 'big data systems' is an umbrella terminology used in general to discuss a wide variety of technologies each of which is used for a specific purpose. Broadly speaking, big data technologies address the needs for batch, transactional, and real-time processing requirements. Using the appropriate big data technology is highly dependent on the use case being addressed.

While gaining business intelligence from transactional data continues to be a dominant factor in the decision making process, businesses have realized that gaining intelligence from other forms of data they have been collecting will enable them achieve a more complete view, address additional business objectives, and lead to better decision making. The following table illustrates some examples of various industry verticals, forms of data, and the objective the business attempts to achieve using the other forms of data.

Industry

Data

Objective

Healthcare

Practitioner’s notes, machine statistics.

Best practices and reduced hospitalization.

Retail

Weblog, click streams.

Micro-segmentation recommendations.

Banking

Weblogs, fraud reports.

Fraud detection, risk analysis.

Utilities

Smart meter reading, call center data.

Real-time and predictive utilization analysis.

Role of transactional data

When using other forms of data for analytics, better contextual intelligence is obtained when the analysis is combined with transactional data. Especially low-latency transactional data brings additional value to dynamically changing operations that day-old data cannot deliver. In organizations, a vast majority of applications' transactional data is captured in relational databases. In order to ensure an efficient supply of transactional data for big data analytics, there are several requirements that the data integration solution should address:

<!--[if !supportLists]-->· <!--[endif]-->Reliable change data capture and delivery mechanism

<!--[if !supportLists]-->· <!--[endif]-->Minimal resource consumption when extracting data from the relational data source

<!--[if !supportLists]-->· <!--[endif]-->Secured data delivery

<!--[if !supportLists]-->· <!--[endif]-->Ability to customize data delivery

<!--[if !supportLists]-->· <!--[endif]-->Support heterogeneous database sources

<!--[if !supportLists]-->· <!--[endif]-->Easy to install, configure and maintain

A solution which can reliably stream database transactions to a desired target enables that the effort is spent on data analysis rather than data acquisition. Also, when the solution is non-intrusive and minimally impacts the source database, it minimizes the need for additional resources and changes on the source database.

Oracle GoldenGate is a time tested and proven product for real-time, heterogeneous relational database replication. Oracle GoldenGate addresses the challenges listed above and is widely used by organizations for mission critical data replication among relational databases. Furthermore, GoldenGate moves transactional data in real-time to support timely operational business intelligence needs.

Oracle GoldenGate Integration Options for Big Data Analytics

There is a variety of integration options available with the Oracle GoldenGate product that facilitates delivering transactions on relational databases into non-relational targets.

Oracle GoldenGate provides pre-built adapters which integrate with Flat Files and Messaging Systems. Please refer to Oracle GoldenGate for Java - Administration Guide and Oracle GoldenGate for Flat Files -Administration Guide for more information.

Oracle GoldenGate also provides Java APIs and a framework for developing custom integrations to Java enabled targets. Using this capability, custom adapters or handlers can be developed to address specific requirements. In this blog post I’d like focus on Oracle GoldenGate Java APIs for developing custom integrations to big data systems.

As we mentioned earlier, 'big data systems' is an umbrella terminology used in general to describe a wide variety of technologies, each of which is used for a specific purpose. Among the various big data systems, Hadoop and its suite of technologies are widely adopted by various organizations for processing big data. The below diagram illustrates a general high level architecture for integrating with Hadoop.

<!--[if !vml]--><!--[endif]--> <!--[if !vml]--><!--[endif]-->

Custom Adapter

<!--[if !vml]--><!--[endif]--> <!--[if !vml]--><!--[endif]--> <!--[if !vml]--><!--[endif]--> <!--[if !vml]--><!--[endif]-->

Pump Parameter file

Adapter Properties file

<!--[if !vml]-->

You can implement custom adapter or handler for the big data system using Oracle GoldenGate's Java API. The custom adapter is deployed as an integral part of the Oracle GoldenGate Pump process. The Pump and the custom adapter are configured through the Pump parameter file and custom adapter's properties file respectively. Depending upon the requirements, the properties for the custom adapter will need to be determined and implemented.

The Pump process will execute the adapter in its address space. The Pump reads the Trail File created by the Oracle GoldenGate Capture process and passes the transactions to the adapter. Based on the configuration, the adapter will write the transactions into Hadoop.

Enabling the co-existence of big data systems with relational systems will benefit organizations to better serve customers and improve decision-making capabilities. Oracle GoldenGate, which has an excellent record of empowering IT on the various aspects of data management requirements, provides the capability to integrate with big data systems. In the upcoming blog posts, we will discuss in depth the implementation and the configuration of integrating Oracle GoldenGate with Hadoop technologies. 

Monday Sep 09, 2013

Boosting Oracle Applications with Oracle GoldenGate: Hear from Masterminds

In recent blogs we have mentioned new data integration solutions and resources for Oracle Applications. Oracle Data Integration products provide incremental value, the AppAdvantage, to Oracle Application users by maximizing performance and availability, and by enabling real-time insight.

Many Oracle Applications customers such as Herbalife and BT, have seen great results from GoldenGate’s solutions. Herbalife used GoldenGate for offloading Oracle E-Business Suite operational reporting to an ODS. As a result the company increased performance significantly while improving the business reports using real-time data. BT used GoldenGate for upgrading its Siebel CRM system to the latest version without impacting operations, with minimized risk, and improved system performance by 5%.

There are many more customers who achieved major performance, availability, and improved insight. This year at Oracle OpenWorld we decided to showcase GoldenGate’s strong offering for Oracle Applications in a customer panel:

A Panel of Masterminds: Perspectives from Oracle GoldenGate Customers

Tuesday, Sep 24, 3:45 PM - 4:45 PM - Moscone West – 2024

In this session industry leaders, Smuckers , Veolia Water, and Land O’Lakes, will talk about their use of GoldenGate for Oracle Applications including E-Business Suite and JD Edwards. The panelists will discuss the best practices and tips for using GoldenGate’s real-time data replication capabilities in offloading reporting to a reporting environment and migrating or upgrading their application environment.

If you attended previous OpenWorld’s customer panels within the Data Integration track, you know there will be great depth in the discussion. For example, last year we had two customer panels for GoldenGate. In one panel St. Jude Medical, Equifax, and Bank of America, presented how they achieved eliminated planned downtime for critical systems using GoldenGate, and in another panel Comcast, Raymond James, and Turk Telekom discussed operational reporting solutions using GoldenGate. 

Both sessions had great audience participation and I expect this year’s panels will be very interactive too.

Another related session on using GoldenGate for Oracle Applications is going to be delivered by the product management team. GoldenGate PM will be joined with PMs from Oracle  BI Applications and Oracle Coherence teams. The team will present latest  updates such as tight integration with Oracle Coherence, and solutions for Oracle BI Applications, E-Business Suite, Siebel CRM, ATG Web Commerce and more.

Powering Solutions for Oracle Applications with Oracle GoldenGate

Wednesday, Sep 25, 11:45 AM - 12:45 PM - Moscone West - 2024

 I hope those of you who will be at OpenWorld will join these sessions. If you will not be at OpenWorld, you can visit our new resource center to download free screencasts and white papers on our solutions for Oracle Applications.

Friday Aug 23, 2013

Ensuring Data Consistency with Oracle GoldenGate Veridata

Today’s 24/7/365, fast-paced world brought the need for high data availability and with that came redundant distributed copies of the data. In our complex IT environment, maintaining data consistency across these distributed systems is not a trivial task unfortunately. Data discrepancy occurs for many reasons, including database configuration differences between source and target, configuration errors during data migration, user errors, gaps in data replication or replication lags. Even when using products that replicate data reliably, such as Oracle GoldenGate, there remain potential causes of data discrepancy.

When data discrepancies occur, businesses can see its impact in the form of incorrect decision-making; failed service-level agreements; and ultimately, operational, financial, and legal risk.

Oracle GoldenGate Veridata helps companies avoid these risks and operate their redundant systems with high confidence knowing that their backup systems, reporting databases, multi-master replication environments have consistency. Oracle GoldenGate Veridata provides an easy-to-use yet powerful solution for identifying out-of-synch data before it negatively impacts the business.

Deployed together with the Oracle GoldenGate real-time data replication  product or separately, Oracle GoldenGate Veridata ensures data consistency is maintained across databases. The software enables periodic checks—as frequently as desired—between heterogeneous source and the target databases without taking either system offline.

Some of the benefits of the product include:

  • Reduced risk exposure. Knowing about data inconsistencies can help address issues before they impact business operations. Oracle GoldenGate Veridata identifies data discrepancies so that corrective measures can be quickly taken.
  • Improve IT Productivity. Oracle GoldenGate Veridata's automated data comparison capabilities reduces the time and resources required for data validation Graphical illustrations and detailed reports clearly convey the key results and specific data disparities so that IT can take immediate corrective action. If there are no inconsistencies, users can document the accuracy of their data for regulatory compliance reporting needs.
  • Continuous operation during validation. With its ability to compare in-flight transactions, Oracle GoldenGate Veridata supports databases that are in use without interrupting business operations. Combining a light footprint and groundbreaking technology, the application imposes minimal impact on technology infrastructure.

If your organization has strict requirements to keep redundant systems consistent, I highly recommend reading more about Oracle GoldenGate Veridata product via our new white paper: Ensuring Data Consistency with Oracle GoldenGate Veridata.

You can also find out best practices on installation and configuration in the Oracle GoldenGate Veridata Handbook on My Oracle Support (Knowledge ID 1583563.1.)

Monday Jul 01, 2013

Oracle GoldenGate 11g Certified Implementation Beta Exam Available

We have great news for Oracle Data Integration partners:  Oracle GoldenGate 11g Certified Implementation Beta Exam is now available. 

The Oracle GoldenGate 11g Certified Implementation Exam Essentials (1Z1-481) exam is designed for individuals who possess a strong foundation and expertise in selling and implementing Oracle Data Integration 11g solutions.

This certification covers topics such as:

  • Oracle GoldenGate 11g Overview
  • Architecture Overview, 
  • Configuring Oracle GoldenGate
  • Parameters, Mapping and Transformation Overview, 
  • Configuration Options, 
  • Managing and Monitoring Oracle GoldenGate 11g. 
This certification helps OPN members differentiate themselves in the marketplace through proven in-depth expertise and helps their partner company qualify for the Oracle Data Integration 11g Specialization Criteria. We recommend up-to-date training and field experience. OPN members earning this certification will be recognized as OPN Certified Specialists.

Request a discounted beta voucher today using the OPN Beta Certified Specialist Exam  Voucher Request Form
You can take the exam now at a near-by Pearson VUE testing center.

Friday Jun 28, 2013

Upgrading Oracle Siebel CRM Application Without Downtime

Oracle’s Siebel Customer Relationship Management (CRM) software helps organizations differentiate their businesses to achieve top- and bottom-line growth. Siebel CRM delivers comprehensive solutions that are tailored to more than 20 different industries. As Siebel CRM implementations have evolved into mission critical, operational business processes that must operate 24/7, companies are finding it increasingly difficult to afford the downtime typically required to perform an in-place upgrade. Without these upgrades, businesses loose out on critical new features and functionality.


With Oracle GoldenGate, customers don’t have to choose between upgrades and outages. Oracle GoldenGate allows Siebel CRM customers to perform upgrades with zero downtime. Now Siebel customers can always take advantages of the latest innovations in customer relationship management without having to worry about potential lost revenue due to downtime.


Oracle GoldenGate provides three different deployment models for Siebel CRM zero downtime upgrades that are designed to meet differing customer requirements. These range from a basic unidirectional model, which is designed to work out-of-the-box, to the most sophisticated active-active model for phased migrations.


If you have mission-critical Siebel CRM implementations I recommend that you watch the screencast below to learn how you can begin taking advantage of all the latest Siebel enhancements without having any downtime.

This screencast is also available on Oracle Media Network and Oracle's YouTube channel. For even more details I recommend reading the whitepaper Upgrading Siebel CRM with Zero Downtime .

Friday Jun 21, 2013

What Comes Next After You Decide on Using Oracle Exadata

As Oracle Exadata continues to expand its footprint for both transaction and analytical processing, moving existing systems to Exadata and feeding it with enterprise data on an ongoing basis have become important discussion topics for Exadata customers. Consolidation and migration is the first step of this powerful journey with Exadata, and I'd like to start there in today's blog post.   

The systems that benefit from Exadata's extreme performance and reliability are typically business-critical systems that carry major risks when it comes to migration. Any downtime or data loss can have significant impact to the business in terms of revenue generation, customer loyalty, and productivity. As Oracle GoldenGate user community knows well, GoldenGate's heteregenous, real-time, and bidirectional replication capabilities enable very strong zero downtime migration and consolidation solutions for major databases and platforms including Oracle, IBM DB2 (zOS, iSeries, and LUW), HP NonStop, SQL Server, Sybase ASE, MySQL, and Teradata.

We discussed GoldenGate's zero downtime migration to Exadata offering and best practices with our customer IQNavigator in a webcast that is now available on demand:

Zero-Downtime Migration to Oracle Exadata Using Oracle GoldenGate: A Customer Case Study

If you have not watched it, I highly recommend listening to the discussion, as it clearly explains there should be no concerns around causing business interruption when moving to Oracle Exadata using GoldenGate.  GoldenGate's failback option to the old environment is a great tool for minimizing risk and many organizations adopt that approach for their business-critical systems.  

In addition to migration to Oracle Exadata, customers use GoldenGate, and Oracle Data Integrator, with Exadata in a variety ways leveraging the natural fit between these technologies:

  • Active-active database synchronization across the globe for data distribution, continuous availability, and zero downtime maintenance purposes.
  • Real-time or near real-time data loading to data warehouse, or consolidated database, on Oracle Exadata from heterogeneous sources. Oracle Data Integrator plays the major role in this use case as it integrates with GoldenGate and loads data warehouse in near real-time after performing transformations within the Exadata machine. This use case will be another blog topic soon as it is a strong best practice for performing ETL/ E-LT for Exadata.
  • Moving change data from an OLTP application running on Exadata in real time, for downstream consumption by other systems including supporting service integration.

As additional resources on best practices for migrating to Exadata I'd like to point you to couple of great white papers: Zero-Downtime Migration to Oracle Exadata Using Oracle GoldenGate and Oracle GoldenGate on Exadata Database Machine.

About

Learn the latest trends, use cases, product updates, and customer success examples for Oracle's data integration products-- including Oracle Data Integrator, Oracle GoldenGate and Oracle Enterprise Data Quality

Search

Archives
« April 2014
SunMonTueWedThuFriSat
  
2
3
5
6
7
8
9
10
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
   
       
Today