Tuesday Mar 25, 2014

Useful Tips on Oracle GoldenGate 12c Installation, Instantiation, and Setup

Written by Nick Wagner, Director of Product Management, Oracle Database High Availability

This is the first of 3 blog posts that I’m writing that will cover some of the questions I get from customers doing a first time implementation of Oracle GoldenGate. I’m not trying to reinvent the wheel, so to speak, so I’m going to reference a number of different My Oracle Support notes that go into more depth about a particular subject or process.

This first post will be about getting the environment set up and installation of Oracle GoldenGate. Also, for simplicity, this will assume a like to like replication environment as well as one-way replication. Future blogs will cover bi-directional replication and environments where the source and target objects have different structures.

Installation

Installation should be done on direct attached storage unless you are installing Oracle GoldenGate in a cluster or for failover, in that case the use of a dedicated NAS or SAN device is fine. Oracle GoldenGate is a quickly evolving product and we have a standard release and patching process. For example, in Oracle GoldenGate 11.2 and 12.1, it’s typically a 3 week patching cycle. So, always use the most recent version of Oracle GoldenGate so you have the most recent stable release. If you are using Oracle GoldenGate 11.2.1, you can just download the most recent release from My Oracle Support. If you are using Oracle GoldenGate 12.1.2, then you should download the installation from OTN or edelivery.oracle.com, and then download and upgrade to the most recent version from My Oracle Support and use Opatch to patch it to the latest release.

Instantiation

There are numerous articles on Oracle GoldenGate instantiation, the two most common are mentioned below.  Essentially, if you can do an Oracle hot backup that’s the easiest way to establish the target database. If that’s not possible, look at Oracle export/import or data pump, and if that can’t be used, you can use GoldenGate's own instantiation. In a situation where you are going to be doing transformation in the Delivery process (Replicat), then GoldenGate's own instantation, while being the slowest, is probably the best choice, as any transformation done in the Delivery can be applied during the initial load as well. It saves you from having to load the data, then transform it.

For like to like, the first is Oracle GoldenGate Best Practices: Instantiation from an Oracle Source Database [Article ID 1276058.1] this document is very comprehensive and covers Oracle to Oracle as well as heterogeneous options. And the other document: Oracle GoldenGate: Initial Load Techniques and References (Doc ID 1311707.1) can be used as well and has a few examples and would be ideal for targets where transformation is going to be used.

Initial Setup

The initial setup of the production database can be quite involved. However, the most important aspect is ensuring that the source database has the correct supplemental logging enabled. In the case where all (or a majority) of the tables are being replicated, it’s easier to configure supplemental logging at the schema level instead of the table level. Using the GGSCI command ADD SCHEMATRANDATA ensures that as the application changes, and new tables are added or keys changed on a table the underlying supplementally logged columns still adhere to those required by Oracle GoldenGate.

If there are tables without primary keys I would recommend that you review this article Supplemental logging – How to Handle Tables Without Primary Keys or Unique Indexes With Oracle GoldenGate [Article ID 1271578.1] that covers the way Oracle GoldenGate handles these types of tables and why it’s important to handle them correctly. If tables without keys aren’t managed properly, you could get anything from poor performance all the way to data corruption. The default way, may not always be the best way of handling these objects. Especially if there is a unique column that just doesn’t have a unique constraint on it.

Another simple way to reduce maintenance on Oracle GoldenGate is wildcarding. For example, if you have  Capture processes (also called Extract) running as a pump and pulling data from a Trail File, and all the data in the Trail File should be sent to the target, then use TABLE *.*; and that will instruct Capture to send all the data that it reads. That way, if a table is added to the Capture reading from the redo logs, you won’t need to make any changes to the Capture running as a pump is necessary. This same concept can even be used in the Delivery, where ASSUMETARGETDEFS is valid. Just use MAP *.*, TARGET *.*; and any table added to the Capture reading from the transaction logs will be sent all the way down to the target.

And that brings the first blog post to a close. I’ll be happy to answer any questions…

Monday Sep 24, 2012

Next-Generation Data Integration on Oracle Exadata

Companies are currently faced with increasing data volumes and retention times while simultaneously batch windows are shrinking. In the ‘Next-Generation Data Integration on Oracle Exadata’ session we will be discussing how Oracle with its innovative Data Integration solution along with Exadata can help companies tackle that challenge.

Oracle Data Integrator and Oracle GoldenGate provide industry-leading performance and scalability for data integration on Oracle Exadata. They are both uniquely designed to take full advantage of the power of the database and to eliminate unnecessary middle-tier components which can often be bottlenecks for data movement and transformation. Combined with the extreme performance provided by Exadata our Data Integration products help companies move towards a more efficient and flexible data integration infrastructure.


If you’re interested in hearing more about how our customers maximize the performance of their Exadata systems while minimizing batch windows, all without adding more hardware resources join us for the following session:

Next-Generation Data Integration on Oracle Exadata 

Thursday October, 4th - 11:15AM - 12:15PM

Moscone West – Room 3005

We also have many other exciting sessions including 'Oracle Data Integrator Product Update and Future Strategy' on October 2nd at 1:15PM in Moscone West Room 3005. In this session we will discuss the ODI roadmap and its integration with engineered systems such as the Oracle Big Data Appliance. It's a session not to be missed!

You can find a list of all the Data Integration sessions happening at Oracle OpenWorld in this document: Focus On Data Integration.

If you will not be able to come to OpenWorld, for more information please check out our data sheet Oracle Data Integration Solutions and the Oracle Exadata Database Machine.

Tuesday Sep 18, 2012

Raymond James at Oracle OpenWorld: Showcasing Real Time Data Integration.

In today’s always-on, always connected world, integrating data in real-time is a necessity for most companies and most industries.

The experts at Raymond James Financials, using Oracle GoldenGate and Oracle Data Integrator, have designed a real-time data integration solution for their operational data store and services that support applications throughout the enterprise . They boast an amazing number of daily executions, while dramatically reducing data latency,  increasing data service performance, and speeding time to market.

OOW: Meet the expertsTo know more on how they have achieved such results, come listen to Ryan Fonnett and Tim Garrod: they will explain how they implemented their solution, and also illustrate their explanations with a live demonstration of their work. A presentation not to be missed!

Real-Time Data Integration
with Oracle Data Integrator
at Raymond James

October 1st 2012 at 4:45pm
Moscone West, room 3005

Friday Sep 14, 2012

Customer Perspectives: Oracle Data Integrator

The Data Integration Product Management team will be hosting a customer panel session dedicated to Oracle Data Integrator at Oracle OpenWorld. I will have the pleasure to present this session with three of our customers: Paychex, Ross Stores and Turkcell.

In this session, you will hear how Paychex, Ross Stores and Turkcell utilize Oracle Data Integrator to meet their IT and business needs. Our customers will be able to share with you how they use ODI in their environments, best practices, lessons learned and benefits of implementing Oracle Data Integrator.

If you're interested in hearing more about how our customers use Oracle Data Integrator then I recommend attending this session:

Customer Perspectives: Oracle Data Integrator

Wednesday October, 3rd, 1:15PM - 2:15PM

Marriott Marquis – Golden Gate C3

The Data Integration track at OpenWorld covers variety of topics and speakers. In addition to product management of Oracle GoldenGate, Oracle Data Integrator, and Enteprise Data Quality presenting product updates and roadmap, we have several customer panels and stand-alone sessions featuring select customers such as St. Jude Medical, Raymond James, Aderas, Turkcell, Paychex, Comcast, Ticketmaster, Bank of America and more. You can see an overview of Data Integration sessions here

If you are not able to attend OpenWorld, please check out our latest resources for Data Integration and Oracle GoldenGate. In the coming weeks you will see more blogs about our products’ new capabilities and what to expect at OpenWorld.

We hope to see you at OpenWorld and stay in touch via our future blogs.


Thursday Oct 13, 2011

Oracle GoldenGate's Advanced Features and Best Practices: A Recap from OpenWorld

I was joined by Shan Nawaz of Verisign last Thursday morning for a great session covering best practices and advanced features of Oracle GoldenGate. Despite the rain; people recovering from the previous nights festivities; and coinciding with a whole bunch of cloud sessions and demos; we had pretty amazing attendance.

Oracle GoldenGate Advanced Features and Best Practices Session

I kicked off by giving an overview of Oracle Data Integration and a quick crash course on Oracle GoldenGate for the few in the audience not familiar with out technology.

After that, I handed over to Shan, who did a terrific job covering some of the best practices for getting optimal performance out of Oracle GoldenGate. He started off with an image that truly summarizes the difference GoldenGate can make to an enterprise:

Shan then moved on to cover a number of philosophies and techniques that he had used successfully to maximize the potential of Verisign’s investment in Oracle GoldenGate, including:

  • Making sure you understand what the data integration requirements are before you start. What is the primary objective of using GoldenGate? What is the maximum throughput you expect, and maximum latency you can accept? If you don’t know these things, you won’t be able to measure success.
  • Learning when you might need to consider parallel data streams to handle maximum load, and what functionality is available to help you achieve that.
  • Determining the impact of I/O on GoldenGate processes and architecting solutions to minimize this.
  • Improving the performance of the GoldenGate Capture, Pump and Delivery processes and optimal tuning of network components.

This was followed by my Advanced Features portion of the session, in which I highlighted some of the less commonly known aspects of Oracle GoldenGate functionality. I covered:

  • The Event Marker Infrastructure – which allows GoldenGate processes to take specific actions whenever they encounter certain database records
  • Flat File Integration – which adds micro-batch file delivery capabilities to GoldenGate
  • Java Integration – which enables GoldenGate to invoke Java APIs based on database events; and provides capture and delivery of data using a JMS message bus

Finally, I gave a preview of some future (next calendar year) functionality that aims to enable Oracle GoldenGate to directly integrate with Oracle Coherence and Oracle TopLink to allow database changes to immediately trigger cache changes. This should help solve a number of use-cases where cached data may become stale if the underlying data changes.

With so much content, we didn’t have much time for Q&A, but still managed to have quite a lively, if brief, Q&A session. Shan had to leave quickly to catch an international flight, but still graciously answered some in-depth questions and swapped contact information with another customer so they could continue the conversation off-line.

It was a pleasure to present with Shan, and I am looking forward to similar sessions at Oracle OpenWorld 2012.

About

Learn the latest trends, use cases, product updates, and customer success examples for Oracle's data integration products-- including Oracle Data Integrator, Oracle GoldenGate and Oracle Enterprise Data Quality

Search

Archives
« April 2014
SunMonTueWedThuFriSat
  
2
3
5
6
7
8
9
10
12
13
14
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
   
       
Today