Friday Apr 10, 2015

Customers Tell All: What Sets Oracle Apart in Big Data Integration

Data integration has become a critical component of many technology solutions that businesses pursue to differentiate in their markets. Instead of relying on manual coding in house, more and more businesses choose data integration solutions to support their strategic IT initiatives, from big data analytics to cloud integration.

To explore the differences among the leading data integration solutions and the impact their technologies are having on real-world businesses, Dao Research recently conducted a research study, where they interviewed IBM, Informatica, and Oracle customers. In addition they reviewed publicly available solution information from these three vendors.

The research revealed some key findings that explains Oracle's leadership in the data integration space. For example:

  • Customers who participated in this study cite a range of 30 to 60 % greater development productivity using Oracle Data Integrator vs traditional ETL tools from Informatica and IBM. Dao's research ties Oracle's advantage to product architecture differences such as native push-down processing, the seperation of logical and physical layers, and the ability to extend Oracle Data Integrator using its knowledge modules.
  • The research also showed that Oracle’s data integration cost of ownership is lower because of its unified platform strategy (versus offering multiple platforms and options), its use of source and target databases for processing, higher developer productivity, faster implementation, and it doesn’t require management resources for a middle-tier integration infrastructure.
  • In the area of big data integration, the study highlights Oracle’s advantage with its flexible and native solutions. Unlike competitors’ offerings, developed as separate solutions, Oracle’s solution is aware of the cluster environment of big data systems. Oracle enables big data integration and cloud data integration through the use of a single platform with common tooling and inherent support for big data processing environments.
  • I should add that the latest release of Oracle Data Integrator EE Big Data Options  widens the competitive gap. Oracle is the only vendor that can automatically generate Spark, Hive, and Pig transformations from a single mapping. Oracle Data Integration customers can focus on building the right architecture for driving business value, and do not have to become expert on multiple programming languages.  For example, an integration architect in a large financial services provider told the research company "As an ODI developer, I am a Big Data developer without having to understand the underpinnings of Big Data. That's pretty powerful capability."


You can find the report of Dao's research here:

I invite you to read this research paper to understand why more and more customers trust Oracle for their strategic data integration initiatives after working with or evaluating competitive offerings.


Thursday Mar 26, 2015

Oracle Big Data Lite 4.1.0 is available with more on Oracle GoldenGate and Oracle Data Integrator

Oracle's big data team has announced the newest Oracle Big Data Lite Virtual Machine 4.1.0.  This newest Big Data Lite Virtual Machine contains great improvements from a data integration perspective with inclusion of the recently released Oracle GoldenGate for Big Data.  You will see this in an improved demonstration that highlights inserts, updates, and deletes into Hive using Oracle GoldenGate for Big Data with Oracle Data Integrator performing a merge of the new operations into a consolidated table.

Big Data Lite is a pre-built environment which includes many of the key capabilities for Oracle's big data platform.   The components have been configured to work together in this Virtual Machine, providing a simple way to get started in a big data environment.  The components include Oracle Database, Cloudera Distribution including Apache Hadoop, Oracle Data Integrator, Oracle GoldenGate amongst others. 

Big Data Lite also contains hands-on labs and demonstrations to help you get started using the system.  Tame Big Data with Oracle Data Integration is a hands-on lab that teaches you how to design Hadoop data integration using Oracle Data Integrator and Oracle GoldenGate. 

                Start here to learn more!  Enjoy!

Wednesday Mar 11, 2015

Recap - How to Future Proof Your Big Data Investments - An Oracle webcast with Cloudera

Last week Oracle and Cloudera experts came together to discuss how Big Data is shaping Data Management.

Cloudera's Charles Zedlewski  spoke about  the Enterprise Data Hub, a Hadoop data store that can be used to store vast quantities of unstructured data. This data store, which is secure and governed, stores data in full fidelity, along with enriched and transformed data that can then be drawn upon to make critical business decisions.

Following Cloudera, Jeff Pollock emphasized the importance of Data Integration technologies that can take advantage of Hadoop clusters in their data processing methods. Offloading of data queries into the cluster, real time data ingestion into the data hub and building together an integrated Big Data reservoir were top of mind when designing Oracle's Data Management technologies.

Rounding the webcast up was Dain Hansen, who quizzed the two experts on some of the top mind questions that customers have about big data.

If you missed the webcast do not worry. You can watch it here on demand.

Thursday Jan 22, 2015

OTN Virtual Technology Summit Data Integration Subtrack Features Big Data Integration and Governance

I am sure many of you have heard about the quarterly Oracle Technology Network (OTN) Virtual Technology Summits. It provides a hands-on learning experience on the latest offerings from Oracle by bringing experts from our community and product management team. 

The next OTN Virtual Technology Summit is scheduled to February 11th (9am-12:30pm PT) and will feature Oracle's big data integration and metadata management capabilities with hands-on-lab content.

The Data Integration and Data Warehousing sub-track includes the following sessions and speakers:

Feb 11th 9:30am PT -- HOL: Real-Time Data Replication to Hadoop using GoldenGate 12c Adaptors

Oracle GoldenGate 12c is well known for its highly performant data replication between relational databases. With the GoldenGate Adaptors, the tool can now apply the source transactions to a Big Data target, such as HDFS. In this session, we'll explore the different options for utilizing Oracle GoldenGate 12c to perform real-time data replication from a relational source database into HDFS. The GoldenGate Adaptors will be used to load movie data from the source to HDFS for use by Hive. Next, we'll take the demo a step further and publish the source transactions to a Flume agent, allowing Flume to handle the final load into the targets.

Speaker: Michael Rainey, Oracle ACE, Principal Consultant, Rittman Mead

Feb 11th 10:30am PT -- HOL: Bringing Oracle Big Data SQL to Oracle Data Integration 12c Mappings

Oracle Big Data SQL extends Oracle SQL and Oracle Exadata SmartScan technology to Hadoop, giving developers the ability to execute Oracle SQL transformations against Apache Hive tables and extending the Oracle Database data dictionary to the Hive metastore. In this session we'll look at how Oracle Big Data SQL can be used to create ODI12c mappings against both Oracle Database and Hive tables, to combine customer data held in Oracle tables with incoming purchase activities stored on a Hadoop cluster. We'll look at the new transformation capabilities this gives you over Hadoop data, and how you can use ODI12c's Sqoop integration to copy the combined dataset back into the Hadoop environment.

Speaker: Mark Rittman, Oracle ACE Director, CTO and Co-Founder, Rittman Mead

Feb 11th 11:30am PT-- An Introduction to Oracle Enterprise Metadata Manager
This session takes a deep technical dive into the recently released Oracle Enterprise Metadata Manager. You’ll see the standard features of data lineage, impact analysis and version management applied across a myriad of Oracle and non-Oracle technologies into a consistent metadata whole, including Oracle Database, Oracle Data Integrator, Oracle Business Intelligence and Hadoop. This session will examine the Oracle Enterprise Metadata Manager "bridge" architecture and how it is similar to the ODI knowledge module. You will learn how to harvest individual sources of metadata, such as OBIEE, ODI, the Oracle Database and Hadoop, and you will learn how to create OEMM configurations that contain multiple metadata stores as a single coherent metadata strategy.

Speaker: Stewart Bryson, Oracle ACE Director, Owner and Co-founder, Red Pill Analytics

I invite you to register now to this free event and enjoy this feast for big data integration and governance enthusiasts.

Americas -- February 11th/ 9am to 12:30pm PT- Register Now

Please note the same OTN Virtual Technology Summit content will be presented again to EMEA and APAC. You can register for the via the links below.

EMEA – February 25th / 9am to 12:30pm GMT* - Register Now

APAC – March 4th / 9:30am-1:00pm IST* - Register Now

Join us and let us know how you like the data integration sessions in this quarter's OTN event.

Monday Dec 29, 2014

Oracle Data Enrichment Cloud Service (ODECS) - Coming Soon

What are your plans around Big Data and Cloud?

If your organization has already begun to explore these topics, you might be interested a new offering from Oracle that will dramatically simplify how you use your data in Hadoop and the Cloud:

Oracle Data Enrichment Cloud Service (ODECS)

There is a perception that most of the time spent in Big Data projects is dedicated to harvesting value. The reality is that 90% of the time in Big Data projects is really spent on data preparation. Data may be structured, but more often it will be semi-structured such as weblogs, or fully unstructured such as free form text. The content is vast, inconsistent, and incomplete, often off topic, and from multiple differing formats and sources. In this environment each new dataset takes weeks or months of effort to process, frequently requiring programmers writing custom scripts. Minimizing data preparation time is the key to unlocking the potential of Big Data.

Oracle Data Enrichment Cloud Service (ODECS) addresses this very reality. ODECS is a non-technical, web-based tool that sets out to minimize data preparation time in an effort to quickly unlock the potential of your data. The ODECS tool provides an interactive set of services that automate, streamline, and guide the process of data ingestion, preparation, enrichment, and governance without costly manual intervention.

The technology behind this service is amazing; it intuitively guides the user with a machine learning driven recommendation engine based on semantic data classification and natural language processing algorithms. But the best part is that non-technical staff can use this tool as easily as they use Excel, resulting in a significant cost advantage for data intensive projects by reducing the amount of time and resources required to ingest and prepare new datasets for downstream IT processes.

Curious to find out more? We invite you to view a short demonstration of ODECS below:


Let us know what you think!

Stay tuned as we write more about this offering…

Wednesday Dec 10, 2014

Oracle Enterprise Metadata Management 12.1.3.0.1 is now available!

As a quick refresher, Metadata Management is essential to solve a wide variety of critical business and technical challenges which include how report figures are calculated, understanding the impact of changes to data upstream, providing reports in a business friendly way in the browser and providing reporting capabilities on the entire metadata of an enterprise for analysis and improvement. Oracle Enterprise Metadata Management is built to solve all these pressing needs for customers in a lightweight browser-based interface. Today, we announce the availability of Oracle Enterprise Metadata Management 12.1.3.0.1 as we continue to enhance this offering.

With Oracle Enterprise Metadata Management 12.1.3.0.1, you will find business glossary updates, updates for a better experience to the user interface as well as improved and new metadata harvesting bridges including Oracle SQL Server Data Modeler, Microsoft SQL Server Integration Services, SAP Sybase PowerDesigner, Tableau and more. There are also new dedicated web pages for tracing data lineage and impact! At a more granular level you will also find new customizable action menus per repository object type for more personalization. For a full read on new features, please read here. Additionally, view here for the certification matrix details.

Download Oracle Enterprise Metadata Management 12.1.3.0.1!

Monday Nov 10, 2014

Big Data Governance and Metadata Management - A Recap

On the 30th of November we held a webcast on governing Big Data. It was the second in the series on Big Data (if you missed the first you can register for it here). We discussed the importance of bringing transparency to the Big Data Reservoir architecture and how to improve and enrich data within the reservoir using Oracle's Enterprise Data Quality (OEDQ). Oracle also announced Oracle Enterprise Metadata Management (OEMM), a comprehensive metadata management tool that is built with a business friendly search driven interface. 

Here is a quick recap of some of the questions that came through. 

Do these principles and technology of Metadata Management, Data Governance and Data Quality apply to Big Data as well as traditional Data?

All the technologies are equally applicable to Big Data as well as traditional data warehousing. In fact, Oracle Enterprise Data Quality and Oracle Enterprise Metadata Management are designed to bridge these two worlds.   

 Does Oracle Enterprise Metadata Management work with 3rd party metadata?

 Yes. We recognize that to truly govern data life cycle  Oracle Enterprise Metadata Management should be able to harvest data across multiple technologies and platforms including Oracle and Non Oracle Data bases, Business Analytics, Data Warehouses and ETL engines.

Is Oracle Enterprise Metadata Management compatible with 11g?

Oracle Enterprise Metadata Management is compatible with many 11g products too.

Where can I get more information about Oracle’s Data Integration products?

The best resource for Oracle Data Integration Products are

The Oracle Data Integration Home Page,

The Oracle Data Integration Technology Network,

The Oracle Data Integration Blog

Also connect with us on facebook and twitter (#OEDQ, #OEMM, ORCLGoldenGate, ODI12c)

Monday Oct 27, 2014

Updated Statement of Direction for Oracle Business Intelligence Analytics (OBIA)

Oracle's product strategy around the Oracle Business Intelligence Analytics (OBIA) has been published this October in the latest Statement of Direction.

Interesting points relative to the BI Applications around data integration:

  • Oracle’s strategic development for ELT for BI Applications will focus on the Oracle Data Integrator and related technologies. Since the fielding of the ODI compatible version of BI Applications in the 11g series, customers have realized substantial financial and operational benefits from reduced time to value and improved speed of operations. Oracle continues to evolve and develop ODI, and Oracle’s BI Applications will take advantage of the latest capabilities as they become available.

  • Oracle will continue to support the 7.9.6.x product series according to the Oracle Lifetime Support policy including certifications of databases, operating systems, and enabling 3rd  party technologies.  However, Oracle will no longer develop new content for this series, nor extend the 7.9.6.x support or any series based on an ETL architecture with Informatica.

You can find the related blog entry with additional details from the BI Team here.

Raymond James Financial Leverages Oracle Data Integration

Hot off the press! 

Raymond James Financial shares how it uses Oracle Data Integrator and Oracle GoldenGate in establishing an enterprise information platform that integrates data from multiple heterogeneous sources such as HP NonStop, Microsoft SQL Server, etc and provides a consolidated company view.  This solution provides quicker access to actionable, timely data that helps operational efficiency for its 6,000 financial advisers by enabling repeatable processes in data migration and loading.

Read the press release.

For more information on this solution, this blog may be of interest also.

Thursday Oct 23, 2014

Big Data Governance Webcast

Earlier during the week we announced Oracle Enterprise Metadata Management (OEMM). Join us as we follow up the release with a webcast where we discuss the pressing issue of Data Governance and how it applies to Big Data. Jeff Pollock, Vice President of Product Management, talks about 

  • Applying Governance to Big Data 
  • The role that managing metadata plays in Governance
  • How data quality fits into the whole Governance framework and 
  • The actual product Oracle Enterprise Metadata Management.

Register here and join us for the webcast on the 30th.

Wednesday Oct 08, 2014

Meet the Data Integration Winners of 2014 Oracle Excellence Awards for Fusion Middleware Innovation

Last Tuesday evening we had a special celebration at Oracle OpenWorld. In an Oscars-like ceremony we announced the winners of the 2014 Oracle Excellence Awards for Fusion Middleware Innovation. You can find an overview of the Fusion Middleware Innovation Awards Ceremony and the full list of winners across all 12 categories in the following blog post: And The Winners Are....

In this blog post I would like to introduce you the 2014 Fusion Middleware Innovation Award winners in the Data Integration category: NET Serviços and Griffith University.

NET Serviços is Latin America’s largest multi-service cable company and enjoyed a steep growth in its business. However the existing system architecture was not supporting this business growth, and the new product areas and business models they were expanding to.  Net Serviços team, led by Robin Michael Gray, built a single corporate real-time integration platform in a standards-based private cloud architecture with high level of maturity of standardization and architecture documentation. They implemented the private cloud environment on Oracle Exadata and Oracle Exalogic, and for enterprise-wide real-time integration they are using Oracle Data Integrator (ODI), Oracle GoldenGate and Oracle SOA Suite. This platform enabled:

  • 60% reduction in development time
  • 50% reduction in management costs via native solutions for monitoring and error handling
  • 80% reduction in data quality problems via data validation as part of integration
  • Increased agility in identifying and fixing problems due to very innovative ODI data quality firewall and Oracle GoldenGate "error hospital" 

Griffith University is based in Australia, and is one of the most influential universities in the Asia-Pacific region. Bruce Callow, chief technology officer for Griffith University, and his team saw the opportunity to improve student experience and attract more enrollment by building a modern web and mobile interface. Griffith University deployed Oracle Data IntegratorOracle SOA Suite and Oracle Service Bus with the help of their partner Integral to build a real-time data hub that supports key applications such as Oracle RightNow Service Cloud and allows a new web and mobile interface for students. The solution also reduced the load on the core Oracle PeopleSoft system during peak load windows. With this solution Griffith University:

• Achieved unified view of students by using Oracle Data Integrator, Oracle SOA Suite, and Oracle Service Bus

• Improved visibility on the state of demand for courses and to optimize enrollments and course scheduling in real time to best meet that demand

• Increased student satisfaction in enrollment process from 20% to 86%.

You can learn more about Griffith University's solution here: Griffith University Manages Enrollment Peaks 4x Faster—Boosts Student Satisfaction and Retention Rate

Congratulations to Net Serviços and Griffith University with their partner Integral for winning this year's Oracle Excellence Awards for usion Middleware Innovation in Data Integration category! 

A Recap of the Data Integration Track's Final Day in OpenWorld 2014

Last week during OpenWorld, my colleague Madhu provided a summary of the first 3 days of the Data Integration track in his blog post: Data Integration At OOW14 -Recapping days 1,2 and 3Today I would like to mention a few key sessions we presented on Thursday.

We kicked off the last day of OpenWorld with the cloud topic. In the Oracle Data Integration: A Crucial Ingredient for Cloud Integration [CON7926] session Julien Testut from Data Integration product management team presented with Sumit Sarkar from Progress DataDirect. Julien provided an overview of the various data integration solutions for cloud deployments, including integration between databases and applications hosted on cloud,  as well as loading cloud BI infrastructures. Sumit followed Julien with a live demo using Oracle Data Integrator and the Progress DataDirect JDBC drivers for loading and transforming data on Amazon Redshift, and extracting data from Salesforce.com. All of us in the audience were amazed that the demo worked seamlessly using only the OpenWorld wi-fi network.

For Oracle GoldenGate we had 2 key sessions on Thursday:

Achieving Zero Downtime During Oracle Applications Upgrades and System Migrations was in the Fusion Middleware AppAdvantage track and featured Oracle GoldenGate’s zero downtime upgrades and migration solution with customer Symantec and partner Pythian. In this session, Doug Reid presented GoldenGate's 3 different deployment models for zero downtime application upgrades.  In his slides, Doug highlighted GoldenGate’s certified solution for Siebel CRM, and mentioned the support for zero downtime application upgrade for JD Edwards and Billing and Revenue Management (BRM) as well. Following Doug, Symantec’s Rohit Muttepawar, came to stage and talked about their database migration project for their critical licensing database. And Pythian’s  Gleb Otochkin and Luke Davies presented how using Oracle GoldenGate in a 6-node active-active replication environment helped Western Union in achieving application releases with zero downtime, database patches and upgrades with zero downtime, and a real-time reporting database with no impact to online users.

The other key GoldenGate session was Managing and Monitoring Oracle GoldenGate. Joe deBuzna in the GoldenGate product management team provided an overview of the new monitoring and management capabilities included in the Oracle GoldenGate Plug-in for Enterprise Manager, and Oracle GoldenGate Monitor. Both of these products are included in the Oracle Management Pack for Oracle GoldenGate license. With the new 12c release,  they can now control the starting, stopping and configuration of existing Oracle GoldenGate processes, and include many new metrics that strengthen how users can monitor their Oracle GoldenGate deployments. 

The Data Integration track at OpenWorld closed with " Insight into Action: Business Intelligence Applications and Oracle Data Integrator". Jayant Mahto from ODI Development team, and Gurcan Orhan from Wipro Technologies focused  on the Oracle BI Applications latest release that embeds Oracle Data Integrator for data loading and transformations, and provides the option to use Oracle GoldenGate for real-time data feeds into the reporting environment. The session highlighted how the new Oracle BI Apps release provides greater strategic insight quickly, efficiently, and with a low total cost of ownership, as well as the role Oracle Data Integrator as the data integration foundation. Jayant and Gurcan presented how Oracle Data Integrator enables users to increase IT efficiency and reduce costs by increasing data transparency, easing setup and maintenance, and improving real-time reporting.

In case you missed it, I'd like to remind you on the press announcement that went out on September 29th and gives a summary of the key developments in the Fusion Middleware product family and Oracle's data integration offering. As mentioned in the press announcement, we have now a new offering for metadata management. An overview of this product was delivered in the “Oracle Data Integration and Metadata Management for the Seamless Enterprise [CON7923] session We will post a dedicated blog on this topic later in the week. Stay tuned for more on that.

Wednesday Oct 01, 2014

Data Integration At OOW14 -Recapping days 1,2 and 3

It has been an action packed three days here in San Francisco at the Oracle Open World 2014 event for Data Integration.

Day 1

It all started with the keynote presentations by the executives stressing Oracle's focus around Cloud, Big Data and Mobile developments. Thomas Kurien's session addressed Data Integration's key role in binding the applications, moving data and simplifying access to Big Data.

Jeff Pollock, in his session "Unlocking Big Data Silos in the Cloud" then addressed the various customer best practices and architectural considerations to implement a full or partial cloud based business solution and how Oracle Data Integration products fit in. An interesting real life example was that of the UK Conservatory using Oracle Data Integration in the cloud.

 Product update sessions for the Oracle Data Integrator and Oracle GoldenGate revealed how much of the upcoming releases focus on not  just integrating the products and covering for heterogeneous data source compatibility but also on cloud and Big Data features. Customer testimonials from various well known brands like DirectTV, Canon and LinkedIn further cemented Oracle Data Integration Solution's success.

 Day 2

The highlight of the day was the Fusion Middleware Innovation Awards, awarded to the most innovative use of Oracle technology to solve business needs that can be showcased as best practices to be emulated by customers in the industry. Net Servicos de Communicacao from Brazil and Griffith University from Australia walked away with the awards for the Data Integration category.

Day 2 also saw product updates with Data Quality and how Oracle is now extending its capabilities considerably into the metadata management space to help govern and bring transparency to data within the organization. Enterprise Metadata Management was an area that was of particular interest (a demonstration of which, in the product booth has been always packed with eager visitors).

 Day 3

Oracle Data Integration is one of four pillars key to Oracle's Big Data Strategy stressed Senior Vice president Balaji Yelamanchili. Building on the concept of Data Reservoir, the session "Tapping into the Big Data Reservoir with all Data" explored how it is fully supported by Oracle with Oracle GoldenGate providing real time incremental feed into the reservoir and Oracle Data Integrator doing the data transformations within the reservoir.

The Big Data Lite page offers a great environment that can be downloaded and explored to see all these concepts and technologies in action.

Day 4 is packed with sessions about Cloud Data Integration, Metadata Management, Achieving Zero Downtime migrations and a host of other insightful sessions. Check out the full list here to plan accordingly.


Are you at Oracle OpenWorld?

The week isn’t over just yet!

Oracle Data Integration has nine pods located throughout Moscone South where you can meet the product management and development teams. You will find us in the Fusion Middleware, Database, Application and Big Data areas this year.

For additional details on the Oracle Data Integration Solutions track at OpenWorld, make sure to check us out!  There are still many more sessions to attend before the end of the conference!

Friday Sep 26, 2014

Oracle GoldenGate and Oracle Data Integrator on the Oracle BigDataLite 4.0 Virtual Machine

Oracle's big data team has just announced the Oracle BigDataLite Virtual Machine 4.0, a pre-built environment to get you started on an environment reflecting the core software of Oracle's Big Data Appliance 4.0. BigDataLite is a VirtualBox VM that contains a fully configured Cloudera Hadoop distribution CDH 5.1.2, Oracle DB 12.1.0.2.0 with Big Data SQL, Oracle's Big Data Connectors, Oracle Data Integrator 12.1.3, Oracle GoldenGate, and other software.

The demos for Oracle GoldenGate and Oracle Data Integrator show an end-to-end use case of the fictional Oracle MoviePlex on-line movie streaming company. It shows how to load data into a Data Reservoir in real-time, process and transform the data using the power of Hadoop, and utilize the data on an Oracle data warehouse, either by loading the data with Oracle Loader for Hadoop or by using Hive tables within Oracle SQL queries with Oracle Big Data SQL. 

Please follow the demo instructions to try out all these steps yourself. If you would like to build the ODI mappings from scratch, try our ODI and Big Data Hands-on Lab.  Enjoy! 

About

Learn the latest trends, use cases, product updates, and customer success examples for Oracle's data integration products-- including Oracle Data Integrator, Oracle GoldenGate and Oracle Enterprise Data Quality

Search

Archives
« April 2015
SunMonTueWedThuFriSat
   
1
2
3
4
5
7
11
12
13
14
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
  
       
Today