Monday Oct 12, 2015

Featuring Big Data Sessions at Oracle OpenWorld 2015

Oracle OpenWorld is only a few days away now and Big Data will be front and center again this year! Many of our Oracle Data Integration sessions will speak to your Big Data needs, we hope you will come and meet us to hear how Oracle Data Integration helps everyone by simplifying access to Big Data and introducing real time capabilities to Big Data.

I would recommend attending the following 2 key sessions on Oracle Data Integration with Big Data:

  • Enabling Real-Time Data Integration with Big Data [CON9724]
    In this session Chai Pydimukkala from the Oracle Data Integration Product Management team will discuss GoldenGate's offering for big data environments. With Chai, Janardh Bantupalli from LinkedIn, will present their solution that uses Oracle GoldenGate for Big Data to optimize the data warehousing environment and achieve operational insights with lower costs.
  • Oracle Data Integration Product Family: a Cornerstone for Big Data [CON9609]
    In this session Alex Kotopoulis from the Oracle Data Integration Product Management team and Mark Rittman Chief Technical Officer at Rittman Mead will describe how our Data Integration platform uses a metadata-based approach to hide the complexity of the various big data technologies such as Hive, Pig, and Spark, and delivers a simplified and future-proofed investment in big data technologies.

There are many more Big Data related sessions I’d also recommend to attend:

In addition we will be running several Hands on Labs covering Oracle Big Data Preparation Cloud Service, Oracle Data Integrator and Oracle GoldenGate. Space is limited and they usually fill up quickly so make sure to register!

Please also come to visit us at our various demo pods in Moscone South:

  • Oracle Big Data Preparation Cloud Service: Get Your Big Data Ready to Use
    Workstation ID: SBD-022 / Venue: Moscone South, Upper Right, Big Data Showcase
  • Oracle Big Data Preparation Cloud Service
    Workstation ID: SPI-023 / Venue: Moscone South, Oracle Cloud Platform and Infrastructure Showcase
  • Oracle Data Integrator Enterprise Edition and Big Data Option: High-Performance Data Integration
    Workstation ID: SLM-022 / Venue: Moscone South, Lower Left, Middleware
  • Oracle GoldenGate: Real-Time Data Integration for Heterogeneous and Big Data Environments
    Workstation ID: SLM-035 / Venue: Moscone South, Lower Left, Middleware
  • Tame Big Data with Oracle Data Integration
    Workstation ID: SBD-023 / Venue: Moscone South, Upper Right, Big Data Showcase

We hope you will join a few! Don’t forget to view the Focus on Data Integration – for a full review of Data Integration Sessions during OpenWorld. See you there!

Thursday Oct 08, 2015

Featuring Big Data Preparation Cloud Service and other Cloud Data Integration Sessions at Oracle OpenWorld 2015

Oracle OpenWorld is almost upon us! We are excited to be sharing with you some previews of what will be seen and discussed in just a few weeks in San Francisco!

One of the highlights is Oracle’s new Cloud Based Data Preparation Solution, Oracle Big Data Preparation Cloud Service, also known as BDP.  This new service will revolutionize the process of importing, preparing and publishing your complex business data and getting it ready for use allowing you to spend more time analyzing data rather than preparing data for analysis. Users are guided through the process with intuitive recommendation driven interfaces. The system also provides various ways to automate and operationalize the entire data preparation pipeline via the built in scheduler or via a rich set of RESTful API’s.

During OpenWorld, Oracle’s Luis Rivas, alongside Blue Cloud Innovations’ Vinay Kumar and Pythian’s Alex Gorbachev will discuss and demonstrate how big data promises many game-changing capabilities if tackled efficiently! You will discover how Oracle Big Data Preparation Cloud Service takes “noisy” data from a broad variety of sources in many different formats, both structured and unstructured, and uses sophisticated and unique blend of machine learning and Natural Language Processing based on a vast set of linked open reference data that provide a powerful way to ingest, prepare, enrich, and publish it into useful data streams, ready for further discovery, analysis, and reporting. Don’t miss it:

CON9615 Solving the “Dirty Secret” of Big Data with Oracle Big Data Preparation Cloud Service

Tuesday, Oct 27, 5:15 p.m. | Moscone South—310

Curious to find out more about BDP before the conference? Take a look here and view a short video: Chalk Talk: Oracle Big Data Preparation Cloud Service!

Since we are on the topic of Data Integration and the Cloud – I will also take a quick moment to remind everyone about Oracle Data Integrator’s (ODI) integration relative to the Oracle Storage Cloud Service as well for example. But that’s not all – here is a view into the Data Integration sessions that relate to the Cloud – in chronological order:

CON3506 Into the Cloud and Back with Oracle Data Integrator 12c

Monday, Oct 26, 5:15 p.m. | Moscone West—2022


CON9614 Oracle Data Integration Solutions: the Foundation for Cloud Integration

Wednesday, Oct 28, 11:00 a.m. | Moscone South—274


CON9717 Accelerate Cloud Onboarding Using Oracle GoldenGate Cloud Service

Wednesday, Oct 28, 3:00 p.m. | Moscone West—2022


CON9595 Cloud Data Quality: Lessons Learned from Oracle’s Journey to the Sales Cloud

Thursday, Oct 29, 12:00 p.m. | Moscone West—2022


CON9612 Oracle Enterprise Metadata Management and the Cloud

Thursday, Oct 29, 1:15 p.m. | Marriott Marquis—Salon 4/5/6

We hope you will join a few! Don’t forget to view the Focus on Data Integration – for a full review of Data Integration Sessions during OpenWorld. See you there!

Thursday Jul 02, 2015

Chalk Talk Video: How to Raise Trust and Transparency in Big Data with Oracle Metadata Management

Some fun new videos are available; we call the series ‘Chalk Talk’!

The first in the series that we will share with you around Oracle Data Integration speaks to raising trust and transparency within big data. It is known that crucial big data projects often fail due to a lack in the overall trust of the data. Data is not always transparent, and governing it can become a costly overhead. Oracle Metadata Management assists in the governance and trust across all data with the enterprise, Oracle and 3rd party.

View this video to learn more: Chalk Talk: How to Raise Trust and Transparency in Big Data.

For additional information on Oracle Metadata Management, visit the OEMM homepage.

Wednesday May 13, 2015

Looking for Cutting-Edge Data Integration: 2015 Excellence Awards

It is nomination time!!!

This year's Oracle Fusion Middleware Excellence Awards will honor customers and partners who are creatively using various products across Oracle Fusion Middleware. Think you have something unique and innovative with Oracle Data Integration products?

We'd love to hear from you! Please submit today in the Big Data and Analytics category.

The deadline for the nomination is July 31, 2015. Win a free pass to Oracle OpenWorld 2015!!

Let’s reminisce a little…

For details on the 2014 Data Integration Winners: NET Serviços and Griffith University, check out this blog post.

For details on the 2013 Data Integration Winners: Royal Bank of Scotland’s Market and International Banking and The Yalumba Wine Company, check out this blog post.

For details on the 2012 Data Integration Winners: Raymond James Financial and Morrisons Supermarkets, check out this blog post.

We hope to honor you!

Click here to submit your nomination today. And just a reminder: the deadline to submit a nomination is 5pm Pacific Time on July 31, 2015.

Thursday Jan 22, 2015

OTN Virtual Technology Summit Data Integration Subtrack Features Big Data Integration and Governance

I am sure many of you have heard about the quarterly Oracle Technology Network (OTN) Virtual Technology Summits. It provides a hands-on learning experience on the latest offerings from Oracle by bringing experts from our community and product management team. 

The next OTN Virtual Technology Summit is scheduled to February 11th (9am-12:30pm PT) and will feature Oracle's big data integration and metadata management capabilities with hands-on-lab content.

The Data Integration and Data Warehousing sub-track includes the following sessions and speakers:

Feb 11th 9:30am PT -- HOL: Real-Time Data Replication to Hadoop using GoldenGate 12c Adaptors

Oracle GoldenGate 12c is well known for its highly performant data replication between relational databases. With the GoldenGate Adaptors, the tool can now apply the source transactions to a Big Data target, such as HDFS. In this session, we'll explore the different options for utilizing Oracle GoldenGate 12c to perform real-time data replication from a relational source database into HDFS. The GoldenGate Adaptors will be used to load movie data from the source to HDFS for use by Hive. Next, we'll take the demo a step further and publish the source transactions to a Flume agent, allowing Flume to handle the final load into the targets.

Speaker: Michael Rainey, Oracle ACE, Principal Consultant, Rittman Mead

Feb 11th 10:30am PT -- HOL: Bringing Oracle Big Data SQL to Oracle Data Integration 12c Mappings

Oracle Big Data SQL extends Oracle SQL and Oracle Exadata SmartScan technology to Hadoop, giving developers the ability to execute Oracle SQL transformations against Apache Hive tables and extending the Oracle Database data dictionary to the Hive metastore. In this session we'll look at how Oracle Big Data SQL can be used to create ODI12c mappings against both Oracle Database and Hive tables, to combine customer data held in Oracle tables with incoming purchase activities stored on a Hadoop cluster. We'll look at the new transformation capabilities this gives you over Hadoop data, and how you can use ODI12c's Sqoop integration to copy the combined dataset back into the Hadoop environment.

Speaker: Mark Rittman, Oracle ACE Director, CTO and Co-Founder, Rittman Mead

Feb 11th 11:30am PT-- An Introduction to Oracle Enterprise Metadata Manager
This session takes a deep technical dive into the recently released Oracle Enterprise Metadata Manager. You’ll see the standard features of data lineage, impact analysis and version management applied across a myriad of Oracle and non-Oracle technologies into a consistent metadata whole, including Oracle Database, Oracle Data Integrator, Oracle Business Intelligence and Hadoop. This session will examine the Oracle Enterprise Metadata Manager "bridge" architecture and how it is similar to the ODI knowledge module. You will learn how to harvest individual sources of metadata, such as OBIEE, ODI, the Oracle Database and Hadoop, and you will learn how to create OEMM configurations that contain multiple metadata stores as a single coherent metadata strategy.

Speaker: Stewart Bryson, Oracle ACE Director, Owner and Co-founder, Red Pill Analytics

I invite you to register now to this free event and enjoy this feast for big data integration and governance enthusiasts.

Americas -- February 11th/ 9am to 12:30pm PT- Register Now

Please note the same OTN Virtual Technology Summit content will be presented again to EMEA and APAC. You can register for the via the links below.

EMEA – February 25th / 9am to 12:30pm GMT* - Register Now

APAC – March 4th / 9:30am-1:00pm IST* - Register Now

Join us and let us know how you like the data integration sessions in this quarter's OTN event.

Wednesday Dec 10, 2014

Oracle Enterprise Metadata Management is now available!

As a quick refresher, Metadata Management is essential to solve a wide variety of critical business and technical challenges which include how report figures are calculated, understanding the impact of changes to data upstream, providing reports in a business friendly way in the browser and providing reporting capabilities on the entire metadata of an enterprise for analysis and improvement. Oracle Enterprise Metadata Management is built to solve all these pressing needs for customers in a lightweight browser-based interface. Today, we announce the availability of Oracle Enterprise Metadata Management as we continue to enhance this offering.

With Oracle Enterprise Metadata Management, you will find business glossary updates, updates for a better experience to the user interface as well as improved and new metadata harvesting bridges including Oracle SQL Server Data Modeler, Microsoft SQL Server Integration Services, SAP Sybase PowerDesigner, Tableau and more. There are also new dedicated web pages for tracing data lineage and impact! At a more granular level you will also find new customizable action menus per repository object type for more personalization. For a full read on new features, please read here. Additionally, view here for the certification matrix details.

Download Oracle Enterprise Metadata Management!

Monday Dec 03, 2012

ODI 11g - Scripting a Reverse Engineer

A common question is related to how to script the reverse engineer using the ODI SDK. This follows on from some of my posts on scripting in general and accelerated model and topology setup.

Check out this viewlet here to see how to define a reverse engineering process using ODI's package.

Using the ODI SDK, you can script this up using the OdiPackage and StepOdiCommand classes as follows;

  1.  OdiPackage pkg = new OdiPackage(folder, "Pkg_Rev"+modName);
  2.   StepOdiCommand step1 = new StepOdiCommand(pkg,"step1_cmd_reset");
  3.   step1.setCommandExpression(new Expression("OdiReverseResetTable \"-MODEL="+mod.getModelId()+"\"",null, Expression.SqlGroupType.NONE));
  4.   StepOdiCommand step2 = new StepOdiCommand(pkg,"step2_cmd_reset");
  5.   step2.setCommandExpression(new Expression("OdiReverseGetMetaData \"-MODEL="+mod.getModelId()+"\"",null, Expression.SqlGroupType.NONE));
  6.   StepOdiCommand step3 = new StepOdiCommand(pkg,"step3_cmd_reset");
  7.   step3.setCommandExpression(new Expression("OdiReverseSetMetaData \"-MODEL="+mod.getModelId()+"\"",null, Expression.SqlGroupType.NONE));
  8.   pkg.setFirstStep(step1);
  9.   step1.setNextStepAfterSuccess(step2);
  10.   step2.setNextStepAfterSuccess(step3);

The biggest leap of faith for users is getting to know which SDK classes have to be used to build the objects in the design, using StepOdiCommand isn't necessarily obvious, once you see it in action though it is very simple to use. The above snippet uses an OdiModel variable named mod, its a snippet I added to the accelerated model creation script in the post linked above.


Learn the latest trends, use cases, product updates, and customer success examples for Oracle's data integration products-- including Oracle Data Integrator, Oracle GoldenGate and Oracle Enterprise Data Quality


« November 2015