Monday Oct 27, 2014

Raymond James Financial Leverages Oracle Data Integration

Hot off the press! 

Raymond James Financial shares how it uses Oracle Data Integrator and Oracle GoldenGate in establishing an enterprise information platform that integrates data from multiple heterogeneous sources such as HP NonStop, Microsoft SQL Server, etc and provides a consolidated company view.  This solution provides quicker access to actionable, timely data that helps operational efficiency for its 6,000 financial advisers by enabling repeatable processes in data migration and loading.

Read the press release.

For more information on this solution, this blog may be of interest also.

Friday Oct 10, 2014

Oracle Data Integrator Webcast Archives

Check out the recorded webcasts on Oracle Data Integrator! 

Each month the Product Management Team hosts a themed session for your viewing pleasure.  Recent topics include Oracle Data Integrator (ODI) and Big Data, Oracle Data Integrator (ODI) and Oracle GoldenGate Integration, BigData Lite, the Oracle Warehouse Builder (OWB) Migration Utility, the Management Pack for Oracle Data Integrator (ODI), along with other various topics focused on Oracle Data Integrator (ODI) 12c.

You can find the Oracle Data Integrator (ODI) Webcast Archives here.

Take a look at the individual sessions:

The webcasts are publicized on the ODI OTN Forum if you want to view them live.  You will find the announcement at the top of the page, with the title and details for the upcoming webcast.

Thank you – and happy listening!

Wednesday Oct 08, 2014

A Recap of the Data Integration Track's Final Day in OpenWorld 2014

Last week during OpenWorld, my colleague Madhu provided a summary of the first 3 days of the Data Integration track in his blog post: Data Integration At OOW14 -Recapping days 1,2 and 3Today I would like to mention a few key sessions we presented on Thursday.

We kicked off the last day of OpenWorld with the cloud topic. In the Oracle Data Integration: A Crucial Ingredient for Cloud Integration [CON7926] session Julien Testut from Data Integration product management team presented with Sumit Sarkar from Progress DataDirect. Julien provided an overview of the various data integration solutions for cloud deployments, including integration between databases and applications hosted on cloud,  as well as loading cloud BI infrastructures. Sumit followed Julien with a live demo using Oracle Data Integrator and the Progress DataDirect JDBC drivers for loading and transforming data on Amazon Redshift, and extracting data from Salesforce.com. All of us in the audience were amazed that the demo worked seamlessly using only the OpenWorld wi-fi network.

For Oracle GoldenGate we had 2 key sessions on Thursday:

Achieving Zero Downtime During Oracle Applications Upgrades and System Migrations was in the Fusion Middleware AppAdvantage track and featured Oracle GoldenGate’s zero downtime upgrades and migration solution with customer Symantec and partner Pythian. In this session, Doug Reid presented GoldenGate's 3 different deployment models for zero downtime application upgrades.  In his slides, Doug highlighted GoldenGate’s certified solution for Siebel CRM, and mentioned the support for zero downtime application upgrade for JD Edwards and Billing and Revenue Management (BRM) as well. Following Doug, Symantec’s Rohit Muttepawar, came to stage and talked about their database migration project for their critical licensing database. And Pythian’s  Gleb Otochkin and Luke Davies presented how using Oracle GoldenGate in a 6-node active-active replication environment helped Western Union in achieving application releases with zero downtime, database patches and upgrades with zero downtime, and a real-time reporting database with no impact to online users.

The other key GoldenGate session was Managing and Monitoring Oracle GoldenGate. Joe deBuzna in the GoldenGate product management team provided an overview of the new monitoring and management capabilities included in the Oracle GoldenGate Plug-in for Enterprise Manager, and Oracle GoldenGate Monitor. Both of these products are included in the Oracle Management Pack for Oracle GoldenGate license. With the new 12c release,  they can now control the starting, stopping and configuration of existing Oracle GoldenGate processes, and include many new metrics that strengthen how users can monitor their Oracle GoldenGate deployments. 

The Data Integration track at OpenWorld closed with " Insight into Action: Business Intelligence Applications and Oracle Data Integrator". Jayant Mahto from ODI Development team, and Gurcan Orhan from Wipro Technologies focused  on the Oracle BI Applications latest release that embeds Oracle Data Integrator for data loading and transformations, and provides the option to use Oracle GoldenGate for real-time data feeds into the reporting environment. The session highlighted how the new Oracle BI Apps release provides greater strategic insight quickly, efficiently, and with a low total cost of ownership, as well as the role Oracle Data Integrator as the data integration foundation. Jayant and Gurcan presented how Oracle Data Integrator enables users to increase IT efficiency and reduce costs by increasing data transparency, easing setup and maintenance, and improving real-time reporting.

In case you missed it, I'd like to remind you on the press announcement that went out on September 29th and gives a summary of the key developments in the Fusion Middleware product family and Oracle's data integration offering. As mentioned in the press announcement, we have now a new offering for metadata management. An overview of this product was delivered in the “Oracle Data Integration and Metadata Management for the Seamless Enterprise [CON7923] session We will post a dedicated blog on this topic later in the week. Stay tuned for more on that.

Wednesday Oct 01, 2014

Are you at Oracle OpenWorld?

The week isn’t over just yet!

Oracle Data Integration has nine pods located throughout Moscone South where you can meet the product management and development teams. You will find us in the Fusion Middleware, Database, Application and Big Data areas this year.

For additional details on the Oracle Data Integration Solutions track at OpenWorld, make sure to check us out!  There are still many more sessions to attend before the end of the conference!

Wednesday Sep 17, 2014

Cloud Data Integration Sessions at Oracle OpenWorld

It’s almost time for Oracle OpenWorld and I would like to give you a sneak peek into some of the cloud data integration sessions we are hosting this year.

On Tuesday September 30th we will start with ‘Oracle GoldenGate and the Cloud [CON7774]’. Chai Pydimukkala and Pawan Kumar Kumar will be discussing how Oracle GoldenGate can run in the cloud and be used in the Oracle Cloud.

To learn more about it join us for this session:
Oracle GoldenGate and the Cloud - CON7774
09/30/14 (Tuesday) 12:00 PM - Moscone South - 302

Then on Thursday September 2nd I will have the pleasure to co-present ‘Oracle Data Integration: A Crucial Ingredient for Cloud Integration [CON7926]’ with Sumit Sarkar from Progress DataDirect. In this session we will be explaining how the Oracle Data Integration solutions help businesses integrate with cloud resources such as cloud databases and applications or cloud BI infrastructures. We will cover topics like initializing and synchronizing Oracle DBaaS or performing native E-LT transformations on a cloud data warehousing platform.

We are also very excited to be doing 2 live demonstrations in this session using Oracle Data Integrator and the Progress DataDirect JDBC drivers: extracting data from Salesforce.com as well as integrating and transforming data on Amazon Redshift.

If you are interested in cloud integration make sure you attend this session:
Oracle Data Integration: A Crucial Ingredient for Cloud Integration - CON7926

10/2/14 (Thursday) 9:30 AM - Moscone South - 270

Of course there are also plenty of other Oracle Data Integration sessions you should plan on attending at Oracle OpenWorld this year. For a complete list review our Focus On Data Integration website. See you there!

Monday Sep 15, 2014

You are invited! See the Power of Innovation with Oracle Fusion Middleware

Are you going to be at Oracle OpenWorld? If so, don't miss the opportunity to meet the most innovative Oracle Fusion Middleware projects of 2014. Winners of 2014 Oracle Excellence Awards for Fusion Middleware Innovation will be announced in a special Awards Ceremony on Tuesday September 30th during Oracle OpenWorld.

Oracle Fusion Middleware Innovation Awards honor customers with cutting-edge use of Oracle Fusion Middleware technologies to solve unique business challenges or create business value. Winners are selected based on the uniqueness of their business case, business benefits, level of impact relative to the size of the organization, complexity and magnitude of implementation, and the originality of architecture. Data Integration is among the 9 award categories recognized this year, along with Oracle Exalogic Elastic Cloud, Oracle Cloud Application Foundation, Oracle Service Oriented Architecture, Oracle Business Process Management, Oracle WebCenter, Oracle Identity Management, Oracle Development Tools and Framework, and Big Data and Business Analytics.

If you are planning to attend Oracle OpenWorld in San Francisco or plan to be in the area during Oracle OpenWorld, we hope you can join us, and bring back to your organization real-life examples of Fusion Middleware in action.

   Oracle Excellence Awards Ceremony: Oracle Fusion Middleware: Meet This Year’s Most Impressive Innovators(Session ID: CON7029)

   When: Tuesday September 30, 2014

   Time: Champagne Reception 4:30 pm, Ceremony 5-5:45 pm PT

   Where: Yerba Buena Center for the Arts, YBCA Theater (next to Moscone North) 700 Howard St., San Francisco, CA, 94103


To learn more about last year’s Data Integration winners please read our blog post: 2013 Oracle Excellence Awards for Fusion Middleware Innovation… and the Winners for Data Integration are…

To attend this Award Ceremony, Oracle OpenWorld Badges are required. You can register for this session through the Schedule Builder on the Oracle OpenWorld website. If you are not attending the conference, but will be in the area and would like to join the celebration – please contact us here.

We hope to see you there!

Tuesday Jul 15, 2014

Oracle GoldenGate 12c Capture for SQL Server

In Oracle GoldenGate 12c we have expanded the heterogeneity of the product by adding support for the latest versions of the major databases. 

In Oracle GoldenGate 12.1.2.0.1 for SQL Server, which is available for download on My Oracle Support, we offer support for capturing from and delivering to SQL Server 2012. Oracle GoldenGate 12c also supports SQL Server 2008 and SQL Server 2008 R2 Capture and Delivery.

Two other highly anticipated new features for Oracle GoldenGate 12c for SQL Server, are the ability for Capture to read from SQL Server compressed transaction log backups and the ability to restrict the need for Capture to read from transaction log backups, required when customers use 3rd party transaction log backup utilities.

Some of the key capabilities of Oracle GoldenGate for SQL Server are as follows:

  • Oracle GoldenGate now supports Capture from SQL Server 2012 beginning with GoldenGate 12.1.2.0.1.
  • Oracle GoldenGate for SQL Server can be configured to Capture from tables without Primary Keys.
  • Oracle GoldenGate 12c for SQL Server supports SQL Server native backup compression and includes the optional configuration to never have to read from transaction log backups, which enables any log backup utility to be used.
  • Capture process can work in conjunction with SQL Server Transactional Replication, and Change Data Capture.
  • Oracle GoldenGate for SQL Server can provide real-time data to heterogeneous target databases, and receive real-time data from heterogeneous databases.

A complete list of supported features and details on how to implement those features are available in the Oracle GoldenGate 12c Documentation Library, available at the following address: http://docs.oracle.com/goldengate/1212/gg-winux/index.html

I also recommend reading our white paper Using Oracle GoldenGate 12c with SQL Server”  that provides more details on how GoldenGate supports SQL Server databases.

Tuesday Jul 01, 2014

New Release for Oracle GoldenGate Monitor is here!

 By Tom Chu, Oracle GoldenGate Product Management

Oracle GoldenGate Management Pack provides extensive enterprise-wide monitoring and management of your Oracle GoldenGate solutions The license include:

  • Oracle Enterprise Manager Plug-in. Provides secure viewing, management, and alerting capabilities for Oracle GoldenGate while leveraging Oracle Enterprise Manager framework 

  • Oracle GoldenGate Monitor. A stand-alone product that provides secure viewing, management, and alerting capabilities for Oracle GoldenGate with end-to-end topology solution displays and customizable topology views

  • Oracle GoldenGate Director. A stand-alone product for basic configuration, management, monitoring, and alerting for legacy Oracle GoldenGate deployments

Oracle GoldenGate Monitor version 12.1.3 was released on June 26th, 2014 and delivers the following new features:

  • Control Oracle GoldenGate processes Capture (Extract) and Delivery (Replicat) by:

    • Initiating "start", "stop", and  "kill" commands
    • Configuration management, and ability to edit configuration files
  • Access report and discard files to understand processing and diagnose problems.

  • Integration with Oracle Web Logic Server 12.1.3 to provide secure single sign on (SSO).

  • New metrics including “Seconds Since Last GoldenGate Checkpoint”, and a class of “delta” metrics that track the change between samples for existing “total count” metrics.

  • Support for monitoring Oracle GoldenGate instances running on IBM DB2 for z/OS

For more information, please refer to Oracle Management Pack for Oracle GoldenGate data sheet and to download please visit Oracle GoldenGate Downloads.

Saturday Jun 21, 2014

Oracle Data Integration Continues to Shine on Oracle Exadata

In previous posts I have shared with you how Oracle offers the best data integration for Oracle Exadata. Oracle’s key differentiation in providing solutions that are engineered to work together, applies to the critical add-on technologies such as data integration and replication as well. Our customers’ successes with using Oracle GoldenGate and Oracle Data Integrator is a continuous flow of confirmation that Oracle’s differentiated offering brings real results, simplifies IT, and enables innovation.

Today, I have two brand new customer examples to share with you. 11ST uses Oracle GoldenGate for real-time data integration into the data warehouse, and Abu Dhabi National Oil Company Distribution uses Oracle GoldenGate for achieving high availability for its private cloud environment running on Exadata.

  • 11ST is Korea’s largest online marketplace where customers and sellers can freely trade retail goods, ranging from clothing and food, to electronic equipment. With over 10x turnover growth over the last 4 years, the company faced challenges in delivering high speed transaction processing and good customer experience. So the company decided to implement Oracle Exadata for core database platform to accelerate data-processing speed for online transactions, and for the data warehouse to improve analytical capabilities with a solution that can handle intensive analytical workloads in a scalable fashion.With Exadata, the company increased storage capacity by up to 5x and decreased storage costs, while improving customer satisfaction by accelerating data-processing speed for online transactions.
11ST chose Oracle GoldenGate as the real-time data integration solution for the data warehouse running on Exadata. Their goal is to enable staff access to more timely data throughout the day such as online sales tracking and earnings by period. Oracle GoldenGate supports fast decision-making by completing daily batch loads 4.5x faster—in two hours instead of nine hours.

The key business transformation is seen in their customers’ experience. With the availability of real-time data synchronization between the enterprise data warehouse and marketing systems, the company can act fast to changing customer tastes, such as for women’s clothing and jewelry, to improve its offering and customer service. Using timely data and advanced analytics, the company runs personalized marketing programs, such as cosmetics or shoe promotions, through mobile, private-brand services, which was not possible with the legacy system. You can read more about 11ST story here.

Especially for data warehousing solutions many customers leverage the comprehensive and integrated Oracle Data Integration platform for Exadata. Below is a diagram that shows how customers can achieve an end-to-end solution.

Avea,and Paychex are ywo other good examples of using Oracle Data Integration for Exadata environments for improved analytical capabilities.

  • Abu Dhabi National Oil Company Distribution (ADNOC Distribution) is a United Arab Emirates (UAE) government-owned company that specializes in marketing and distributing petroleum products within the country. The organization decided to implement Oracle Exadata Database Machine to consolidate five Oracle Databases—supporting enterprise resource planning (ERP), online transaction processing (OLTP) applications, and business intelligence (BI) applications—onto a single database platform within a private database cloud.

As this private cloud environment supports the backbone of a business with 250 million financial transactions annually, ADNOC Distribution cannot afford even a minute's downtime. To ensure 24/7 uptime and meet service-level agreements, the company uses Oracle Exadata with Oracle Real Application Clusters and Oracle Automatic Storage Management. Using Oracle GoldenGate ADNOC maximized system availability and improved its ability to integrate Oracle Exadata with nonOracle platforms, such as Microsoft SQL or IBM DB2. You can read more about 11ST story here.

 In a recent webcast we discussed Oracle GoldenGate's offering for consolidation into private cloud. I also recommend watching the webcast: Zero Downtime Consolidation to Oracle Database 12c with Oracle GoldenGate 12c on demand to learn how to use Oracle GoldenGate for maximizing availability in private cloud environments.

Tuesday Jun 03, 2014

How Oracle Data Integration Customers Differentiate Their Business in Competitive Markets

With data being a central force in driving innovation and competing effectively, data integration has become a key IT approach to remove silos and ensure working with consistent and trusted data. Especially with the release of 12c version, Oracle Data Integrator and Oracle GoldenGate offer easy-to-use and high-performance solutions that help companies with their critical data initiatives, including big data analytics, moving to cloud architectures, modernizing and connecting transactional systems and more.

In a recent press release we announced the great momentum and analyst recognition Oracle Data Integration products have achieved in the data integration and replication market. In this press release we described some of the key new features of Oracle Data Integrator 12c and Oracle GoldenGate 12c. In addition, a few from our 4500+ customers explained how Oracle’s data integration platform helped them achieve their business goals. In this blog post I would like to go over what these customers shared about their experience.

Land O’Lakes is one of America’s premier member-owned cooperatives, and offers an extensive line of agricultural supplies, as well as production and business services. Rich Bellefeuille, manager, ETL & data warehouse for Land O’Lakes told us how GoldenGate helped them modernize their critical ERP system without impacting service and how they are moving to new projects with Oracle Data Integrator 12c: “With Oracle GoldenGate 11g, we've been able to migrate our enterprise-wide implementation of Oracle’s JD Edwards EnterpriseOne, ERP system, to a new database and application server platform with minimal downtime to our business. Using Oracle GoldenGate 11g we reduced database migration time from nearly 30 hours to less than 30 minutes. Given our quick success, we are considering expansion of our Oracle GoldenGate 12c footprint. We are also in the midst of deploying a solution leveraging Oracle Data Integrator 12c to manage our pricing data to handle orders more effectively and provide a better relationship with our clients. We feel we are gaining higher productivity and flexibility with Oracle's data integration products."

ICON, a global provider of outsourced development services to the pharmaceutical, biotechnology and medical device industries, highlighted the competitive advantage that a solid data integration foundation brings. Diarmaid O’Reilly, enterprise data warehouse manager, ICON plc said “Oracle Data Integrator enables us to align clinical trials intelligence with the information needs of our sponsors. It helps differentiate ICON’s services in an increasingly competitive drug-development industry."  You can find more info on ICON's implementation here.

A popular use case for Oracle GoldenGate’s real-time data integration is offloading operational reporting from critical transaction processing systems. SolarWorld, one of the world’s largest solar-technology producers and the largest U.S. solar panel manufacturer, implemented Oracle GoldenGate for real-time data integration of manufacturing data for fast analysis. Russ Toyama, U.S. senior database administrator for SolarWorld told us real-time data helps their operations and GoldenGate’s solution supports high performance of their manufacturing systems: “We use Oracle GoldenGate for real-time data integration into our decision support system, which performs real-time analysis for manufacturing operations to continuously improve product quality, yield and efficiency. With reliable and low-impact data movement capabilities, Oracle GoldenGate also helps ensure that our critical manufacturing systems are stable and operate with high performance."  You can watch the full interview with SolarWorld's Russ Toyama here.

Starwood Hotels and Resorts is one of the many customers that found out how well Oracle Data Integration products work with Oracle Exadata. Gordon Light, senior director of information technology for StarWood Hotels, says they had notable performance gain in loading Oracle Exadata reporting environment: “We leverage Oracle GoldenGate to replicate data from our central reservations systems and other OLTP databases – significantly decreasing the overall ETL duration. Moving forward, we plan to use Oracle GoldenGate to help the company achieve near-real-time reporting.”You can listen about Starwood Hotels' implementation here.

Many companies combine the power of Oracle GoldenGate with Oracle Data Integrator to have a single, integrated data integration platform for variety of use cases across the enterprise. Ufone is another good example of that. The leading mobile communications service provider of Pakistan has improved customer service using timely customer data in its data warehouse. Atif Aslam, head of management information systems for Ufone says: “Oracle Data Integrator and Oracle GoldenGate help us integrate information from various systems and provide up-to-date and real-time CRM data updates hourly, rather than daily. The applications have simplified data warehouse operations and allowed business users to make faster and better informed decisions to protect revenue in the fast-moving Pakistani telecommunications market.” You can read more about Ufone's use case here.

In our Oracle Data Integration 12c launch webcast back in November we also heard from BT’s CTO Surren Parthab about their use of GoldenGate for moving to private cloud architecture. Surren also shared his perspectives on Oracle Data Integrator 12c and Oracle GoldenGate 12c releases. You can watch the video here.

These are only a few examples of leading companies that have made data integration and real-time data access a key part of their data governance and IT modernization initiatives. They have seen real improvements in how their businesses operate and differentiate in today’s competitive markets. You can read about other customer examples in our Ebook: The Path to the Future and access resources including white papers, data sheets, podcasts and more via our Oracle Data Integration resource kit.


Friday May 30, 2014

Looking for Cutting-Edge Data Integration: 2014 Excellence Awards

2014 Oracle Excellence Awards Data Integration

It is nomination time!!!

This year's Oracle Fusion Middleware Excellence Awards will honor customers and partners who are creatively using various products across Oracle Fusion Middleware. Think you have something unique and innovative with one or a few of our Oracle Data Integration products?

We would love to hear from you! Please submit today.

The deadline for the nomination is June 20, 2014.

What you win:

  • An Oracle Fusion Middleware Innovation trophy

  • One free pass to Oracle OpenWorld 2014

  • Priority consideration for placement in Profit magazine, Oracle Magazine, or other Oracle publications & press release

  • Oracle Fusion Middleware Innovation logo for inclusion on your own Website and/or press release

Let us reminisce a little…

For details on the 2013 Data Integration Winners:

Royal Bank of Scotland’s Market and International Banking and The Yalumba Wine Company, check out this blog post: 2013 Oracle Excellence Awards for Fusion Middleware Innovation… and the Winners for Data Integration are…

and for details on the 2012 Data Integration Winners:

Raymond James and Morrisons, check out this blog post: And the Winners of Fusion Middleware Innovation Awards in Data Integration are… 

Now to view the 2013 Winners (for all categories).

We hope to honor you!

Here's what you need to do: 

Click here to submit your nomination today.  And just a reminder: the deadline to submit a nomination is 5pm Pacific Time on June 20, 2014.

Wednesday May 21, 2014

Zero Downtime Consolidation to Oracle Database 12c: Webcast Recap

As companies move to private cloud implementations to increase agility and reduce costs, and start their plans with consolidating their databases, a major question arises: how do we move our systems without causing major disruption to the business. At the end, the most important systems that need to move to this new architecture are the ones that cannot tolerate extensive downtime for any reason. In last week’s webcast “Zero Downtime Consolidation to Oracle Database 12c with Oracle GoldenGate 12c” we tackled this specific dilemma that IT organizations face. The webcast is now available on demand via the link above in case you missed it last week.

In the webcast, we started discussing the benefits companies achieve when they consolidate to a private database cloud, critical database capabilities to deliver database as a service, and a quick overview Oracle Database 12c features that enable private database clouds deployments. Nick Wagner, director of product management for Oracle Database High Availability, talked about the new Global Data Services feature in Oracle Database Maximum Availability Architecture (MAA) as well. Global Data Services helps organizations to handle challenges involved with managing multiple database replicas across different sites. The product manages database replicas of Active Data Guard and Oracle GoldenGate products, and offers workload balancing to maximize performance as well as intelligent handling of outages using all available replicas. Nick also discussed the database features available for upgrading, migrating, and consolidating into Oracle Database 12c and when it makes sense to use Oracle GoldenGate for these efforts.

After Nick, Chai Pydimukkala from senior director of product management for GoldenGate discussed some of the key new features of Oracle GoldenGate 12c for Oracle Database and its expanding heterogeneity that supports consolidation from all major databases. Chai continued his presentation with GoldenGate’s solution architecture for zero downtime consolidation and explained how it minimizes risk with failback option as well as via the phased migration option by running old and new environments concurrently.

Chai also gave an example on how Oracle Active Data Guard customers can seamlessly use GoldenGate for a zero downtime migration without affecting their standby system for high ongoing high availability and disaster recoery. After customer examples we had a long Q&A section. For the full presentation and Q&A with the experts you can watch the on-demand version of the webcast via the following link.

Zero Downtime Consolidation to Oracle Database 12c with Oracle GoldenGate 12c

In the rest of this blog post, I provided  answers to some of the questions we could not take in the live event. 

1) Additional difference in features between GoldenGate 11g and 12c?

Please take a look at our previous blog posts below where we discussed many of the new features of GoldenGate 12c.

· Advanced Replication for The Masses – Oracle GoldenGate 12c for the Oracle Database.

· GoldenGate 12c - What is Coordinated Delivery?

· GoldenGate 12c - Coordinated Delivery Example

· Oracle GoldenGate 12c - Announcing Support for Microsoft and IBM

You can also listen to our podcast: Unveiling Oracle GoldenGate 12c

More comprehensive information can be found in the webcast replay  Introducing Oracle GoldenGate 12c: Extreme Performance Simplified or GoldenGate 12c resource kit.

2) Does GoldenGate have a term license that customer can purchase for migration purposes?

We do offer 1 year license that customer can be used for this purposes.

3) Is there a Oracle Tutorial on configuring and testing Zero downtime upgrade using GoldenGate?

Here is a high level outline/tutorial for the migration. It will require some knowledge of how to setup GoldenGate and configuration.

Oracle GoldenGate Best Practice: Oracle Migrations and Upgrades 9i and up

A more broad discussion of this topic can be found in the following white paper. Zero Downtime Database Upgrades using Oracle GoldenGate 12c

4) If the number of updates to the database is very high, does GoldenGate give some kind of compression to transfer the Trail Files and be up to date with the changes?

Oracle GoldenGate does provide support of compress of change data in the Trail File to better the transfer throughput from source to target with the usage of COMPRESS and COMPRESSTHRESHOLD. 

RMTHOST

{host_name | IP_address}

{, MGRPORT port | PORT port}

[, COMPRESS]

[, COMPRESSTHRESHOLD]

[, ENCRYPT algorithm [KEYNAME key_name]]

[, PARAMS collector_parameters]

[, STREAMING | NOSTREAMING]

[, TCPBUFSIZE bytes]

[, TCPFLUSHBYTES bytes]

[, TIMEOUT seconds]

COMPRESS

This option is valid for online or batch Capture processes and any Oracle GoldenGate initial-load method that uses Trails. Compresses outgoing blocks of records to reduce bandwidth requirements. Oracle GoldenGate decompresses the data before writing it to the Trail. COMPRESS typically results in compression ratios of at least 4:1 and sometimes better. However, compressing data can consume CPU resources.

COMPRESSTHRESHOLD

This option is valid for online or batch Capture processes and any Oracle GoldenGate initial-load method that uses trails. Sets the minimum block size for which compression is to occur. Valid values are from 0 and through 28000. The default is 1,000 bytes.

5) Can the Source system utilize 12C GoldenGate for DML/DDL capture and target system utilize GoldenGate 11g?

Yes.  You can replicate from a higher version of GoldenGate to a lower version using FORMAT RELEASE option. 

FORMAT RELEASE <major>.<minor>

In the on demand replay of the webcast you will find more questions answered by our product management experts. So make sure to watch the on demand webcast as well.

Monday May 12, 2014

Check it out – BI Apps 11.1.1.8.1 is now available!

As of May 8, 2014, Oracle Business Intelligence (BI) Applications 11.1.1.8.1 is available on the Oracle Software Delivery Cloud (eDelivery), and on the Oracle BI Applications OTN page. This is the second major release on the 11g code line leveraging the power of Oracle Data Integrator (ODI), and certified with the latest version of Oracle BI Foundation 11.1.1.7. For more details on this release and what’s new – check it out!

Tuesday May 06, 2014

No Way Out, But to Consolidate

IT teams receive pressures on multiple fronts: Business groups demand new application services delivered faster and continuous, high-quality IT service to support highly dynamic and competitive business operations. In the meanwhile IT teams are asked to reduce costs and improve ROI from existing systems in highly complex and siloed environments.

In the midst of this conundrum, the only way out for IT leadership is to consolidate and leverage cloud architecture. Especially consolidation at the database level and implementing a private database-as-a-service (DBaaS) environment is a transformative approach to delivering database functionality to end users in an agile, efficient, and scalable way.  It helps organizations improve resource utilization, and lower both capital and operational expenditures.

Oracle Database 12c is designed to support database consolidation with many new features for deploying shared database environment. The new multitenant architecture, simplified management capabilities, improvements to security and compliance, along with robust and flexible Maximum Availability Architecture, are only a few of the key differentiators.

While this all sounds good and logical for IT teams, when it comes to moving to a private database cloud, they face yet another major challenge: How do we move our critical systems to a new environment without interrupting our operations. In today’s 24/7 world, especially customer-facing systems cannot tolerate hours or days of downtime. For some of them, even few minutes of downtime can bring high costs to the business. As in each major project, risk involved with moving to a new system is a real deterrent factor too.

Oracle GoldenGate 12c offers the core capabilities to enable this major move to a database as a service environment. With its optimized support for Oracle Database 12c multitenant architecture and heterogeneous data replication capabilities, Oracle GoldenGate allows organizations to avoid business disruption while the systems are moving to a consolidated, DBaaS environment. In addition, Oracle GoldenGate offers a failback option to the old environment, or a phased migration option by running old and new systems simultaneously in active-active mode, to minimize risks. Oracle GoldenGate’s heterogeneity includes all major database vendors and operating systems including SQL Server, DB2 (LUW, z/Os, iSeries), Sybase ASE, HP NonStop and more. 

In our webcast Zero Downtime Consolidation to Oracle Database 12c with Oracle GoldenGate 12c on May 13th 10am PT we will present this solution with specific architecture examples and comparison to other database upgrade options.

Zero Downtime Consolidation to Oracle Database 12c with Oracle GoldenGate 12c

May 13th, 10am PT/ 1pm ET

If your organization needs to improve agility, increase innovation, and reduce costs, I invite you to join this webcast to learn how to remove the risk and business interruption barriers to move to an agile and cost-efficient private database cloud.

Friday Apr 25, 2014

Long Running Jobs in Oracle Business Intelligence Applications (OBIA) and Recovery from Failures

Written by Jayant Mahto, Oracle Data Integrator Product Management

In Oracle Business Applications 11.1.1.7.1 (OBIA), the Data Warehouse load is performed using Oracle Data Integrator (ODI). In ODI, using packages and load plans, one can create quite a complex load job that kicks off many scenarios in a coordinated fashion. This complex load job may run for a long time and may fail before completing the entire job successfully and will require restarts to recover from failure and complete successfully.

This blog uses the complex load plan defined in Load Plan for Oracle Business Applications 11.1.1.7.1 (OBIA) to illustrate the method of recovery from failures. Similar methods can be used in the recovery of complex load plans defined independently in Oracle Data Integrator (ODI). Note that this post does not go into the details of troubleshooting a failed load plan and only talks about the different restart parameters that affect the behavior of a restarted job.

The failures can happen due to the following reasons:

  • Access failure – Source/Target DB down, network failure etc.
  • Agent failure.
  • Problem with the Database – As in running out of space or some other DB related issue.
  • Data related failure – Exceptions not caught gracefully, like null in not null column etc.

It is important to find out the reason of failure and address it before attempting to restart the load plan otherwise the same failure may happen again. In order to recover from the failure successfully the recover parameters in the load plan steps need to be selected carefully. These parameters are selected during design time of the load plan by the developers. The goal is to be able to make the restarts robust enough so that the administrator can do restart without knowing the details of the failed steps. This is why it is the developer’s responsibility to select the restart parameters for the load plan steps in such a way which guarantees that the correct set of steps will be re-run during restart to make sure that data integrity is maintained.

In the case of OBIA, the load plans have appropriate restart parameters in the generated load plans for out of the box steps. If you are adding a custom steps then you need to choose similar restart parameters for the custom steps.

Now let us look at a typical load plan and the restart parameters at various steps.

Restart of a serial load plan step:


SDE Dimension Group Step highlighted above is a serial step. Let us say the Load plan failed when running the 3 SDE Dims GEO_DIM step. Since this is a serial step and it has been set to “Restart from Failure”, the load plan on restart would start from 3 SDE Dims GEO_DIM only and not run the 3 SDE Dims USER_DIM again. This parameter is widely used in the OBIA serial steps.

The other restart parameter for a serial steps is “Restart all children”. This will cause all the children steps to be re-run during restart even if only one failed and others succeeded. This parameter could be useful in some case and developers will decide that.

Restart of a parallel load plan step:


The Workforce Dependant Facts Step highlighted above is a parallel step with restart parameter set to “Restart from failed children”. It means all the 5 parallel steps under it would be kicked off in parallel (subject to free sessions being available). Now amongst those 5 steps let us say 2 of them completed (indicated by the green boxes above) and then the load plan failed. When the load plan is restarted all the steps that did not complete/failed, will be started again (in this example being Learning Enrollment Fact, Payroll Facts and Recruitment Facts). This parameter is widely used in the OBIA parallel steps.

The other restart parameter for a parallel step is “Restart all children”. This will cause all the children steps to be re-run during restart even if only one failed and others succeeded. This parameter could be useful in some case and developers will decide that.

Restart of the scenario session:

At the lowest order in any load plan are the scenario steps. While the parent steps (serial or parallel) are used to set the dependencies, the scenario steps are what finally load the tables. A scenario step in turn could have one or more steps (corresponding to number of steps inside the package).

It is important to understand the structure of a session that gets created for the execution of a scenario step to understand the failure points and how the restart takes place.

The following diagram illustrates different components in a session:


The restart parameters for the scenario steps in the load plan are:

  • Restart from a new session – This creates a new session for the failed scenario during restart and executed all the steps again.
  • Restart from a failed task – This uses the old session for the failed scenario during restart and starts from the failed task.
  • Restart from a failed step – This uses the old session for the failed scenario during restart and re-executes all the tasks in the failed step again. This is the most common parameter used by OBIA and is illustrated below.


In the above example, scenario step 2 failed when running. It internally has 3 steps (all under the same session in Operator log but identified with different step numbers 0,1,2 in above case). As per the setting corresponding to OBIA Standard, the Scenario would execute from Failed Step which is from Step number 2 Table_Maint_Proc (and the substep 3 Initialize Variables onwards as shown in diagram).

Note that the successful tasks such as “3 – Procedure – TABLE_MAINT_PROC – Initialize variables” will be executed again during restart since the scenario restart parameter is set to “Restart from failed step” in the Load Plan.

Summary:

OBIA has certain coding standard for setting up restart parameters as discussed above. For serial and parallel steps, the parameters “Restart from failure” and “Restart from failed children” allow the completed steps to be skipped. For scenario steps (which actually kick of the load sessions) the restart parameter of “Restart from failed step” skips the completed steps in the session and reruns all the tasks in the failed step, allowing recovery of an incomplete step.

This standard allows a hands free approach to restart a failed load plan by an administrator who has no knowledge of what the load plan is doing.


About

Learn the latest trends, use cases, product updates, and customer success examples for Oracle's data integration products-- including Oracle Data Integrator, Oracle GoldenGate and Oracle Enterprise Data Quality

Search

Archives
« September 2015
SunMonTueWedThuFriSat
  
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
   
       
Today