Wednesday Feb 05, 2014

Introducing Oracle GoldenGate 12c: Extreme Performance Simplified

Oracle GoldenGate 12c was released last fall with a long list of new features that simplify configuration and increase flexibility, while delivering easy-to-use, advanced solutions with multi-fold performance gain.  We have been discussing these new features in various blog posts including:

· Advanced Replication for The Masses – Oracle GoldenGate 12c for the Oracle Database.

· GoldenGate 12c - What is Coordinated Delivery?

· GoldenGate 12c - Coordinated Delivery Example

· Oracle GoldenGate 12c - Announcing Support for Microsoft and IBM

And you can find new white papers about the 12c release in the Oracle GoldenGate resource kit.

Following the executive video webcast launching Oracle Data Integrator 12c and Oracle GoldenGate 12c in November 2013, we have set up another webcast for Oracle GoldenGate 12c where our product management team discusses the key new features in more depth and takes live questions from the audience.

If you would like to learn more about GoldenGate 12c I invite you to join us on Feb 12th in a webcast with product experts. You can register for this free event via the link below.

Live Webcast: Introducing Oracle GoldenGate 12c: Extreme Performance Simplified

February 12, 2014 -  10am PT/ 1pm ET

If you have missed our executive launch webcast I highly recommend that you watch it on demand via the link below. It talks about the tighter integration between Oracle Data Integrator 12c and Oracle GoldenGate and features customer and partner speakers from SolarWorld, BT, and Rittman Mead Consulting.

On-Demand Video Webcast: Introducing 12c for Oracle Data Integration

Monday Aug 26, 2013

ODI - File transformation tool

ODI 11g introduced the complex file technology which supported the ability to define a parser for data files and plug it into ODI. I have created an ODI Open Tool (ODIFileTransformation) which utilizes part of this capability just to do native file to XML file transformation - so just file to file based on the nXSD parser definition. The native input file (such as COBOL or whatever) is parsed based on the nXSD definition and the resultant XML file streamed directly (to disk, a pipe or wherever). Btw...its very easy to extend ODI in a number of ways, adding a tool is an easy way to integrate existing capabilities.

Why? It gives us different opportunities for consuming the parsed data and it is now in a convenient form (XML). As an illustration I processed a 200Mb data file and the resultant XML file was generated in 120 seconds whereas using the complex file technology directly in ODI and staging the same native data file in a database took 9000 seconds. There is no staging with the tool, it simply reads the data, transforms using the nXSD and produces the generated XML. So.... you could write the resultant file on to a disk such as HDFS then process it using Hadoop.

The tool has the following signature and is useful for running from the command line for performing file to file transformation or from within a package. This tool was based on a test tool that was blogged here and I changed to remove the XML DOM nature so that it streams to the result file.

The tool is on the java.net site, to install, you will need the java mail JAR (download here) and the tool itself (download zip containing JAR and source here). The JARs get copied to the ODI userlib directory and then you restart the client and register the open tool. The tool can have more options added including debatching into chunked files. Hopefully some useful bits and pieces here. 

Friday Jun 21, 2013

What Comes Next After You Decide on Using Oracle Exadata

As Oracle Exadata continues to expand its footprint for both transaction and analytical processing, moving existing systems to Exadata and feeding it with enterprise data on an ongoing basis have become important discussion topics for Exadata customers. Consolidation and migration is the first step of this powerful journey with Exadata, and I'd like to start there in today's blog post.   

The systems that benefit from Exadata's extreme performance and reliability are typically business-critical systems that carry major risks when it comes to migration. Any downtime or data loss can have significant impact to the business in terms of revenue generation, customer loyalty, and productivity. As Oracle GoldenGate user community knows well, GoldenGate's heteregenous, real-time, and bidirectional replication capabilities enable very strong zero downtime migration and consolidation solutions for major databases and platforms including Oracle, IBM DB2 (zOS, iSeries, and LUW), HP NonStop, SQL Server, Sybase ASE, MySQL, and Teradata.

We discussed GoldenGate's zero downtime migration to Exadata offering and best practices with our customer IQNavigator in a webcast that is now available on demand:

Zero-Downtime Migration to Oracle Exadata Using Oracle GoldenGate: A Customer Case Study

If you have not watched it, I highly recommend listening to the discussion, as it clearly explains there should be no concerns around causing business interruption when moving to Oracle Exadata using GoldenGate.  GoldenGate's failback option to the old environment is a great tool for minimizing risk and many organizations adopt that approach for their business-critical systems.  

In addition to migration to Oracle Exadata, customers use GoldenGate, and Oracle Data Integrator, with Exadata in a variety ways leveraging the natural fit between these technologies:

  • Active-active database synchronization across the globe for data distribution, continuous availability, and zero downtime maintenance purposes.
  • Real-time or near real-time data loading to data warehouse, or consolidated database, on Oracle Exadata from heterogeneous sources. Oracle Data Integrator plays the major role in this use case as it integrates with GoldenGate and loads data warehouse in near real-time after performing transformations within the Exadata machine. This use case will be another blog topic soon as it is a strong best practice for performing ETL/ E-LT for Exadata.
  • Moving change data from an OLTP application running on Exadata in real time, for downstream consumption by other systems including supporting service integration.

As additional resources on best practices for migrating to Exadata I'd like to point you to couple of great white papers: Zero-Downtime Migration to Oracle Exadata Using Oracle GoldenGate and Oracle GoldenGate on Exadata Database Machine.

Friday Jan 11, 2013

Customer Spotlight:Raymond James

Back in October we announced that Raymond James is a winner of 2012 Fusion Middleware Innovation Awards in the Data Integration category. As I mentioned on this site before, Raymond James used Oracle Data Integrator and Oracle GoldenGate in an integrated solution for its operational data store that supports the application services across the enterprise. By using Oracle's real-time data integration solution from heterogeneous systems into a centralized ODS, the team achieved higher application performance, reduced complexity and cost, and up to 50 percent faster time to market. 

I had a pleasure meeting the team, Ryan Fornett, Tim Garrod, and Michael Wells, from Raymond James at Oracle OpenWorld 2012. In addition to hearing from them during their presentations, we had a chance to record interviews with Tim and Ryan while at OpenWorld. You can find the links to their videos below:

 Yesterday, with their permission we posted a detailed blog on the FMW blog site about their implementation:

Data Integration Customer Spotlight: Raymond James Financial

I highly recommend reading it to see Oracle Data Integration products in action.

Many thanks to Ryan, Tim, and Mike for sharing the details of their innovative solution with us.


Thursday Jan 10, 2013

Maximum Availability with Oracle GoldenGate Webcast: On Demand Link & FAQ

Last month we had a live webcast on a hot topic: Maximum Availability with Oracle GoldenGate. The webcast presentation focused on how Oracle GoldenGate can help achieve maximum availability for Oracle Database and other major databases. This webcast was very useful in answering a frequently asked question around GoldenGate's role for Oracle Database Maximum Availability Architecture (MAA) and when to use Oracle GoldenGate vs Active Data Guard. Product experts, Joe Meeks from Oracle Database High Availability product management team and Nick Wagner from Oracle GoldenGate product management team, addressed this question for us. Joe and Nick presented GoldenGate’s key solutions within MAA, and when to use which product along with Integrated Capture and Automated Conflict Management features of GoldenGate 11gR2. If you missed this event I highly recommend watching it on demand via the following link.

Watch On Demand:Maximum Availability with Oracle GoldenGate.

We also recorded a short podcast on this topic. Oracle GoldenGate 11gR2 for Maximum Availability

In the live webcast we had a very interactive audience who submitted over 100 questions during the event. Joe and Nick answered the most commonly asked questions about GoldenGate’s use cases and technology. Here are a few of the questions that we did not have time to answer during the event, along with the answers from the PM team.

  • Can I use the target database as warehouse for select only. If I were to allow users to this target, are there steps to ensure both source and target databases remain in sync?

 Yes you can use the target for read only or select only operations. Yes, we can do bi-directional active-active replication if you want to allow users to make changes to the target system. We can replicate those back to the source.

  • Can Integrated Capture be run on Oracle Database Standard Edition?

Yes, but all of the features that are only supported by Integrated Capture are only available with Oracle Database Enterprise Edition.

  •  Is it possible to capture database transactions from a source database using GoldenGate and publish them as messages into   a JMS queue?

Yes, GoldenGate can capture from and deliver to JMS queue. Please see our page for Java Adapter for more info. 

  • Can GoldenGate be used in environments where a number of tables do not have primary keys?

Yes. In tables without primary keys, we will use all non-LOB columns in the where clause for updates and deletes and then use ROWNUM = 1.

  • Is there a webinar that shows how to set up Oracle GoldenGate?

 Oracle GoldenGate Youtube channels has many useful videos and labs including “Oracle GoldenGate Fundamentals and How Oracle GoldenGate Works” and “Oracle GoldenGate Deep Dive Hands-on Labs” in 3 part series. You can browse and watch them here. Please check out GoldenGate training sessions with Oracle University as well.

I highly recommend subscribing to GoldenGate’s Youtube channel along with joining the GoldenGate Facebook and Twitter communities to get regular updates on the product.

Thursday Dec 20, 2012

ODI 11g - Loading More Files Faster

This post shows you how to leverage more of your Oracle system, you can load more data and faster using these kind of best practices. The LKM here, lets you leverage the Oracle database's preprocessor to load MORE data faster. The KM also has the capability to leverage a regular expression to identify the file or files so that you can load much much more, it also sorts the files based on size to comply with the most efficient way of loading into Oracle via the external table. The preprocessor can basically do anything, but is commonly used to uncompress data on the fly - so you can eliminate transferring large uncompressed files around or needlessly uncompressing them! There are various creative blog posts around showing you what some customers have done - some even include the transfer in the preprocessing phase.

I posted the LKM on the java.net site here

You can see the LKM configured below, I have used the preprocessor and a regular expression to load all gzipped files in the directory; 

When the code is generated below you can see the PREPROCESSOR directive used, plus you can see that the file names are going to be generated from a Java API call where the regular expression and directory are passed.

My gunzipdb.bat script has the following definition, wrappering the gzip utility (note the use of the -d -c directives);

  • @echo off
  • c:\ext_tab_test\gzip -d -c %1

Check this creative use of the PREPROCESSOR directive here (External table to load compressed data residing on remote locations) which does some creative work in the preprocessing script. This could do pretty much anything you want including transforming from some complex file to project through an external table.

Wednesday Sep 12, 2012

Customers Discuss: Real-World Operational Reporting with Oracle GoldenGate

As businesses leverage business intelligence and analytics for day-to-day decision making, operational reporting solutions become more and more common. While some companies can use their production OLTP system for running operational reports, for many it is too much overhead and performance impact for transaction processing systems. 

Oracle GoldenGate’s real-time data integration capabilities enable companies to create a real-time replica of their OLTP systems, dedicated for operational reporting. This instance can be optimized for the reports needed as well such as containing only the tables needed from the source. Oracle GoldenGate has certified solutions for many Oracle applications such as EBusiness Suite, Peoplesoft, JD Edwards, to offload operational reporting to another reporting server that has real-time data feeding from the production system.

At Oracle OpenWorld we will be hearing from a panel of Oracle GoldenGate customers how they deployed GoldenGate for operational reporting. Comcast, Turk Telekom, and Raymond James will be sharing their experiences and the benefits achieved when implementing GoldenGate’s solution.

If you have performance degradation in your production systems due to reporting or ad-hoc queries, and you will be at OpenWorld, don’t miss this informative session:

Real-World Operational Reporting with Oracle GoldenGate: Customer Panel--

Tuesday Oct 2nd 11:45am Mascone West 3005.

For other data integration sessions at OpenWorld, please check our Focus-On document

If you cannot attend OpenWorld, please check out related white paper “Using Oracle GoldenGate to Achieve Operational Reporting for Oracle Applications to learn more.

Wednesday Aug 29, 2012

Load Plan article in Oracle Magazine

Timely article in Oracle Magazine on ODI Load Plans from Mark Rittman in the current issue, worth having a quick read of the article and play with the sample which is included if you get the time. Thanks to Mark for investing the time and energy providing such useful information to the community.

http://www.oracle.com/technetwork/issue-archive/2012/12-sep/o52bi-1735905.html

Mark goes over the main benefits of the load plan in the article. Interested to hear any creative use cases or comments in general.

Friday Sep 30, 2011

Improving Data Warehouse Performance and Accuracy with Oracle GoldenGate and Oracle Exadata

Data warehouses are becoming a critical system for day-to-day operations, and many users, including customers, rely on the fast and accurate information that data warehousing solutions provide. With the exponential data growth IT systems are experiencing in today’s information age, delivering high performance data warehouses with accurate data is becoming more and more challenging for many lT organizations.

At OpenWorld we will hear about one of biggest data warehousing solutions in the telecommunications industry in Europe. Turkcell, a leading European GSM-based mobile communications operator, implemented Oracle Exadata and Oracle GoldenGate for their enterprise data warehouse to achieve the performance and reliability that their business needs. The data warehouse has several data marts with customer-specific information and provides its 34 million customers with accurate information.The data warehouse is fed from several often changing sources and Oracle GoldenGate is used to capture data changed from each production source and maintain more-up-to-date data for the data warehouse.

At OpenWorld, we will hear from Turkcell how they maximized the performance of their data warehouse and improved data accuracy using Oracle Exadata and GoldenGate.If you will be at OpenWorld next week, you can attend this session:

Data Warehouse Performance and Accuracy at a Telco with Oracle GoldenGate

Tuesday, October 4th 11:45 AM

InterContinental Hotel - Telegraph Hill Room

As a reminder, you can find out about other Data Integration Track sessions here and you can follow our updates and reminders for the Data Integration track via our Facebook and Twitter accounts.

About

Learn the latest trends, use cases, product updates, and customer success examples for Oracle's data integration products-- including Oracle Data Integrator, Oracle GoldenGate and Oracle Enterprise Data Quality

Search

Archives
« April 2014
SunMonTueWedThuFriSat
  
2
3
5
6
7
8
9
10
12
13
14
17
18
19
20
21
23
24
25
26
27
28
29
30
   
       
Today