Tuesday Apr 15, 2014

Fusion Application Bulk Import Process

Written by Ayush Ganeriwal, Oracle Data Integrator Product Management

In the previous blog post we looked at the Fusion Applications end-to-end bulk data integration use cases. Now let’s take a closer look at the Bulk Import process that transforms and moves data from Interface tables to internal tables. For this use case ODI is bundled along with Fusion Application and get configured transparently by the Fusion Application provisioning process. The entire process is automated and controlled through the Fusion Application User Interface. It also seeds the ODI repository with the Fusion Application specific Models, Interfaces, Procedures and Packages which are then dynamically modified through ODI SDK for any Fusion Application customizations.


Fusion Application Bulk Import Process

The above diagram shows the Bulk import process in Fusion Application where ODI is used for data transformation. Here the Interface tables are the source tables which were populated by other processes before the kicking off the Bulk Import process. The Fusion Application internal tables are the target for these integrations where the data needs to be loaded. These internal tables are directly used for Fusion Application functionalities therefore a number of data validations are applied to load only the good quality data into the internal tables. The data validation errors are monitored and corrected through Fusion Application User Interface. The metadata of Fusion Application tables is not fixed and gets modified as the Application is customized for customer’s requirement. Any change in such source or target tables would require corresponding adjustments in ODI artifacts too and is taken care of by the AppComposer which uses ODI SDK to make such changes in ODI artifacts. If auditing is enabled then any change in the internal table data or the changes in ODI artifacts are recorded in centralized auditing table.

Packaged ODI Artifacts

There are a large number of ODI models, interfaces and packages seeded in the default ODI repository used for Bulk Import. These ODI artifacts are built based upon the base metadata of Fusion Application schema.

Extensibility

As part of the customization, Fusion Application entities are added or modified as per the customer’s requirement. Such customizations result in changes in the underlying Fusion Application’s internal tables and interface tables, and require the ODI artifacts to be updated accordingly. The Fusion Application development team as built the extensibility framework to update ODI artifacts dynamically along with any change in Fusion Application schema. It leverages the ODI-SDK for performing any changes in the ODI repository. The dynamic generation of ODI artifacts is automatically kicked off as part of Patching and Upgrades process. Fusion Application AppComposer User Interface also supports explicitly triggering this process so that administrators can regenerate ODI artifacts whenever they make any customizations.

Validation Error Reporting

The validation errors are populated in intermediate tables and are exposed through BI Publisher so that admin users can correct and recycle these error records.

Auditing

The Fusion Application auditing framework keeps track of the changes performed by each of the users and at what time. There are two levels of auditing captured in Fusion Application audit table for Bulk Import use case. First, metadata changes in ODI artifacts through ODI SDK during customizations. Second, the transactional data changes in the Fusion Application table data as part of ODI interfaces execution. For these purposes the ODI team has exposed some substitution APIs that are used by Fusion Application development team to customize ODI KMs to perform such auditing during the actual data movement.

Provisioning and Upgrade

The provisioning process takes care of install and configuring ODI for the Fusion Application instance.

It takes care of automatically creating ODI repository schemas, configuring topology, setting up ODI agents, setup configurations for ODI –ESS bridge, seeding packaged ODI artifacts, apply modifications to seeded artifacts and create internal users in IDM for external authentication. There is a separate process to apply patches or upgrade the environment to the newer release. Such patching or upgrade processes not only take care of importing newer ODI artifacts but also kick off a CRM extensibility process that modifies ODI artifacts as per the Fusion Application customizations.

External Authentication

There is a dedicated IDM configured with each Fusion Application instance and all Fusion Application components are expected to have their users authenticated through this centralized IDM. For Bulk Import use case ODI is configured with external authentication and there are internal users created in IDM that are used for communication with ODI agent and kicking off ODI jobs.

Enterprise Scheduler Service (ESS) - ODI Bridge

The ODI scenarios are kicked off through ODI-ESS bridges. It is a separate library build for ODI-ESS integration and gets deployed along with Enterprise Scheduler Service (ESS) in Fusion Application environment. It supports both synchronous and asynchronous modes of invocation for ODI jobs. In the asynchronous mode the session status is updated to callbacks to the ESS services. There is a topology editor provided to manage the ESS callback service connectivity exclusively for Fusion Application use cases.

Note: Use of ESS-ODI Bridge is restricted to Fusion Application use case only at the moment.

High Availability

The ODI agent is deployed on Weblogic cluster in the Fusion Application environment to take advantage of ODI high availability capabilities. By default there is only one managed server in the Weblogic cluster created for ODI but as the load increases more managed servers can be added to the cluster to distribute execution of ODI sessions among ODI agent instances in the cluster.

Stay tuned for the last post on this topic coming soon.  This was part two in a series of three posts.  The initial post can be found here.

Friday Apr 11, 2014

Oracle Data Integrator (ODI) Usage in Fusion Applications (FA)

Written by Ayush Ganeriwal, Oracle Data Integrator Product Management

Oracle Data Integrator (ODI) is the bulk data transformation platform for Fusion Applications (FA). ODI is used by Fusion Customer Relationship Management (CRM), Fusion Human Capital Management (HCM), Fusion Supply Chain Management (SCM), Fusion Incentive Compensation (IC) and Fusion Financials family products and many other Fusion Application teams are following suit. Among all these product families CRM is the biggest consumer of ODI leveraging a breadth of ODI features and functionality, out of which some features were developed specifically for Fusion Applications use. Some ODI features they utilize include: ODI SDK, high availability, external authentication, various out of the box and customized Knowledge Modules, ODI-ESS bridge, callbacks to ESS EJBs, auditing, open tools, etc. In this post we will first talk about the different Fusion Application use cases at higher level and then take a closer look at different integration points.

Figure 1 shows data integration need of a typical on-premise Fusion Applications deployment.

  1. Bulk Import: Fusion Applications exposes a set of interface tables as the entry point for data load from any outside source. The bulk import process validates this data and loads it in the internal table which can then be used by the fusion application.
  2. Data Migration: Extracting data from external applications, legacy applications or any other data source and loading it into Fusion Application’s interface table. ODI can be used for such data load.
  3. Preparing Data Files: Converting data into Comma Separated Values (CSV) files that can be imported through Fusion Application’s files import wizard. ODI can be used to extract data into such CSV file.

Figure 1: Data Integration Needs in On-Premise Fusion Application

Figure 2 shows the on-demand or cloud environment requirements, which are slightly different as there is no direct connectivity available to the interface tables.

  1. Bulk Import: Fusion Application exposes a set of interface tables as the entry point for any data load from any outside source. The bulk import process validates this data and then loads it in the internal table which can then be used by the application.
  2. Preparing Data Files: Converting data into CSV files that can be imported through Fusion Application’s files import wizard. ODI can be used for creation on such CSV files.
  3. Uploading data files: The data files are uploaded to the Tenant File repository through either Fusion Application’s File import page or Oracle WebCenter Content Document Transfer Utility. The WebCenter Utility is built using ODI open tool framework allowing orchestrating entire process through ODI package.
  4. Loading Interface Table: Data files to be loaded in the interface tables so that it can be consumed by the Bulk Import process. ODI is used for loading these interface tables.

Figure 2: Data Integration Needs for On-Demand Fusion Application

Stay tuned for more blog posts on this topic coming next week. This was part one in a series of three posts.


Tuesday Apr 01, 2014

Looking for Cutting-Edge Data Integration: 2014 Excellence Awards

It is nomination time!!!

This year's Oracle Fusion Middleware Excellence Awards will honor customers and partners who are creatively using various products across Oracle Fusion Middleware. Think you have something unique and innovative with one or a few of our Oracle Data Integration products?

We would love to hear from you! Please submit today.

The deadline for the nomination is June 20, 2014.

What you win:

  • An Oracle Fusion Middleware Innovation trophy
  • One free pass to Oracle OpenWorld 2014
  • Priority consideration for placement in Profit magazine, Oracle Magazine, or other Oracle publications & press release
  • Oracle Fusion Middleware Innovation logo for inclusion on your own Website and/or press release

Let us reminisce a little…

For details on the 2013 Data Integration Winners:

Royal Bank of Scotland’s Market and International Banking and The Yalumba Wine Company, check out this blog post: 2013 Oracle Excellence Awards for Fusion Middleware Innovation… and the Winners for Data Integration are…

and for details on the 2012 Data Integration Winners:

Raymond James and Morrisons, check out this blog post: And the Winners of Fusion Middleware Innovation Awards in Data Integration are… 

Now to view the 2013 Winners (for all categories).

We hope to honor you!

Here's what you need to do: 

Click here to submit your nomination today.  And just a reminder: the deadline to submit a nomination is 5pm Pacific Time on June 20, 2014.

Thursday May 03, 2012

It's Nomination Time: Fusion Middleware Innovation Awards 2012

Call for Nominations:

Oracle Fusion Middleware Innovation Awards 2012

Are you doing something unique and innovative with Oracle Fusion Middleware? Submit a nomination today for the Oracle Fusion Middleware Innovation Awards. Winners receive a free pass to Oracle OpenWorld 2012 in San Francisco (September 30 - October 4th) and will be honored during a special event at OpenWorld.

Categories include:

  • Oracle Exalogic
  • Cloud Application Foundation
  • SOA and BPM
  • WebCenter
  • Identity Management
  • Data Integration
  • Application Development Framework and Fusion Development
  • Business Analytics (BI, EPM, Exalytics)  

 

Here's what you need to do: 

CLICK HERE, to submit your nomination today. The deadline to submit a nomination is 5pm Pacific on July 17, 2012.

Sunday Feb 26, 2012

Total Economic Impact Report by Forrester: Oracle Data Integrator

See full size image

 

Oracle Data Integrator has proven customer success when it comes to bulk data movement and tranformation.  Forrester Consulting has produced a compelling report that illustrates just how Oracle Data Integrator delivers on its promise of low Total Cost of Ownership, high ROI, stellar performance and reduced project times.  This study is based on interviews with an Oracle Data Integrator customer as well as Forrester's Total Economic Impact methodology.  Don't miss this unique webcast and hear about ODI's results and all about -  "Revolutionizing Economic Impact with Oracle Data Integrator" on February 28, 2012, 10 AM PT/1PM ET.  Learn how ODI can help your organization achieve operational and capital savings for bulk data movement and transformation. Register now http://bit.ly/z0gXRa

Wednesday Oct 05, 2011

Fusion Middleware Innovation Awards at Oracle OpenWorld 2011

By Julianna Button

Tuesday, October 4th, 2011

The Winners of the 2011 Innovation Awards were announced today at Oracle OpenWorld.

The Award recognizes customers for achieving significant business value through innovative uses of Oracle Fusion Middleware.  The program has grown over the past 5 years, and this year we are excited to have received over 230 submissions from customers around the globe, making it very difficult for the panel of internal and external judges to select this year’s most compelling projects.

This year we recognize 30 customers, across 7 product categories representing 11 countries and a diversity of industries around the world, for their innovative use of Oracle Fusion Middleware and their significant results.

This year’s winners are using Oracle Fusion Middleware to drive critical business transformation and IT modernization across their enterprises. Customers have adopted loosely-coupled, service-based architectures to deliver modern, enterprise-class global applications and portals, streamlined business processes and high performance integration platforms.   They are finding new ways to leverage social media and telecommunications to enhance interaction with their customers and are transforming business and financial analysis to deliver faster visibility into performance. Through cloud-based deployments customers are increasing their time to market, and have the infrastructure to support growth of their businesses, as needed.

The impact of these projects has been tremendous - improving performance by up to 15%, reducing budget cycle times by 50% and, increasing time to market by up to 60%. Our winners have seen savings in operational costs by as much as 25% and reduced their total cost of ownership by up to 50%.

 Winners were announced today by Hasan Rizvi, to an audience that included press and analysts, keen to learn about this year’s most impressive Middleware projects.  Congratulations to all our winners!

Application Development Framework

Herbalife International

Etiya Bilgi Teknolojileri

Callista Software Services Pty Ltd

Honorable Mention: KCI

SOA, AIA, BPM

Choice Hotels International

Siram S.p.A

Turk Telecom

Electronic Arts

Honorable Mention: Premium Wine Brands

WebCenter

Agilent

Medtronic

Dutch Prosecutors Office (Openbaar_Ministerie)

Honorable Mention: Schneider National Inc

Application Grid and Exalogic

Banco de Chile

AT&T

Telecom Italia

ANA

Honorable Mention: Haier

BI/EPM

HealthSouth

State of Maryland – Governor’s Office of Crime Control & Prevention

Telenor ASA

The Clorox Company

Honorable Mention: Dunkin Brands

Data Integration

Sabre Holdings

BT

Elsevier

Identity Management

ING North America Insurance

College Board

TTNET A.S.

Honorable Mention: Manpower

Tuesday Oct 04, 2011

The Best Part of Oracle OpenWorld…

What a great start we had yesterday at OpenWorld for our Data Integration track. My colleague Doug was not exaggerating when he said yesterday “Today is going to be a great day!" It was indeed a great day with lots of interest to our sessions, Hands-on-Labs and demos. We also felt great energy in each of our sessions especially in the form of number of attendance and questions. Our team posted a photo album from Day 1 (Monday October 3rd) to our Facebook page. I invite you to check the pictures to get a feeling of that energy we noticed.

Actually the excitement around our DI sessions started with the morning keynote sessions. Thomas Kurian explained ODI’s critical role in loading data from Hadoop to Oracle Database. ODI simplifies data integration from Hadoop with its easy to use interface and MapReduce transformation capabilities. Important note: ODI Product Management will be talking about the new Oracle Data Integrator Application Adapter for Hadoop in more detail in the session:

Oracle Data Integrator Product Update and Strategy on Wednesday 5pm at InterContinental Hotel Telegraph Hill Room.

You should not miss it if you are at OpenWorld and interested in the Big Data topic. Also Hasan Rizvi’s FMW Keynote included a great ODI and GoldenGate customer, Sabre Holdings, on stage talking about the value of using our complete and flexible offering for improving the way customer data is accessed and used at Sabre.

The rest of the day, from my perspective, took place in multiple crowded sessions with great customer presentations, discussions, and product updates.

  •  Turkcell presented about Maximizing Integration Results with Oracle Data Integration in their Enterprise Data Warehouse implementations. The presentation covered both the EDW supporting data mining solution and the DW serving their network operations. Turkcell’s presenters Sanem Seren Sever and Gurcan Orhan shared great performance numbers for using ODI. By moving to ODI and using it on Oracle Exadata they reduced the ETL process from 30 days to 2-3 hours. BTW Gurcan received Oracle Excellence Awards, Technologist of the Year 2011 award. Congratulations Gurcan!
  • Customer panel on zero downtime migrations featured panelist Mark Ramsey from FedEx, Ravi Kulkarni from Dell and Gia Huynh from SiriusXM. I had the honor to moderate this panel. We received so many questions even before Q&A part that we ran over our allotted 1 hour time. The audience had questions around Active-Active configurations for migration purposes and justification for investing in a new technology for migration purposes. Our panelists gave a great overview on the business reasons for minimizing downtime and as well as the technical reasons for the architectures they chose to for the migration solution with GoldenGate.


  • Thomson Reuters’ presentation on Active/Active: Moving from Streams to GoldenGate was another popular session which filled the whole Ballroom C at the InterContinental with folks interested to hear any tips and best practices for migration to GoldenGate. David Baar answered questions very candidly and Volker Kuhr from Oracle Advanced Consulting Services provided a migration path for these critical projects. 

  • GoldenGate’s Product Strategy Update session was the last session of our track yesterday. After a long day I would have expected much lower turnout. Again the whole room was full and the attendees were not shy asking our VP of Product Management many questions, including which specific database platforms are part of the road map. After Alok we heard from Sue Clark from SunGard, who presented their use of Oracle GoldenGate in their Enterprise Data Warehouse. Particularly how it eliminated batch window dependency for their E-Business Suite source systems,and reduced the nightly extract process by 9 hours. Sue added that they achieved 35% internal rate of return from using Oracle GoldenGate for E-Business Suite source systems.

Each and every session left me with a great feeling about being at OpenWorld. It made me realize the best part of the OpenWorld is the interaction with customers and our community. Hearing from our DI customers on how they benefit from our products and hearing our community members ask critical questions to us or toour customers….And of course, exchanging ideas on best practices, and what should go into our product road map, matters a lot.

I am glad we have 3 more days to go to continue with these great interactions with our community. I hope you will  join us too by attending our sessions or following and commenting on our updates on Twitter and Facebook.

Wednesday Sep 21, 2011

Innovation Awards 2011 Preview: See us at OpenWorld

Every year at OpenWorld, Oracle announces the winners to its most prestigious awards in Middleware, the Fusion Middleware Innovation Awards. This year, we’ll be announcing the winners and highlighting a few of their original implementations during this key session in the Middleware stream:

October 4th, 11:45 AM, Oracle Fusion Middleware: Meet This Year's Most Impressive Customer Projects, Moscone West - 3007

In addition, we’ll give a sneak peak of a few winners during the Fusion Middleware General Session with Hasan Rizvi at 11AM, Monday October 3rd, Moscone West, 3014. Checkout the Fusion Middleware Focus On document for more details on both of these activities and more in the Middleware stream.

What kinds of customers win the Fusion Middleware Innovation Awards? Winners are selected based on the uniqueness of their business case, business benefits, level of impact relative to the size of the organization, complexity and magnitude of implementation, and the originality of architecture. The winners are selected by a panel of judges that score each entry across multiple different scoring categories. This year, the following categories included:

  • Application Grid, Oracle Exalogic
  • BI and EPM
  • Data Integration
  • Fusion Development and Application Development Framework
  • Identity Management
  • SOA, AIA, BPM
  • WebCenter

Last year at OpenWorld 2010 we announced over 33 innovative customers that won the award, including companies like Verizon, Avea, Herbalife, OnStar, ING, Credit Suisse, State of NY, SunGard, Northern Trust, Telenor, Crocs, Amgen, and many others.

Did you miss your chance this year to nominate your company? Come join with us in the awards session to get an edge in your next year’s submission and watch for the next opportunity for 2012 on this blog. There’s other awards as part of Oracle’s Excellence awards program or subscribe to our regular Fusion Middleware newsletter to get the latest reminders.

About

Learn the latest trends, use cases, product updates, and customer success examples for Oracle's data integration products-- including Oracle Data Integrator, Oracle GoldenGate and Oracle Enterprise Data Quality

Search

Archives
« April 2014
SunMonTueWedThuFriSat
  
2
3
5
6
7
8
9
10
12
13
14
17
18
19
20
21
22
23
24
25
26
27
28
29
30
   
       
Today