Tuesday Nov 03, 2015

Oracle Data Integrator 12.2.1 and Big Data

Oracle Data Integrator 12.2.1 brings a number of Big Data features such as Spark and Pig language generation support, executing ODI jobs in the Oozie workflow engine, and all new knowledge modules with improved Hive support. 

We provided a first release of most Big Data features as a patch 12.1.3.0.1 on top of the 12.1.3 release, and have included it now as part of the 12.2.1 release. In addition, we provided further improvements to the initial feature set, such as new Oozie Execution modes. You can now choose between Task and Session execution modes for Oozie workflow generation. The new Session mode allows support for transactions, scripting, and loops in packages and will run a session in a single Oozie action, whereas the Task mode uses a separate Oozie action for each ODI task. ODI will automatically choose the correct mode based on the executed object or the mode can also be manually selected.

ODI provides developer productivity and can future-proof your investment by overcoming the need to manually code Hadoop transformations to a particular language.  You can logically design your mapping and then choose the implementation that best suits your use case. 

Friday Oct 23, 2015

Announcing Oracle Data Integrator (ODI) 12.2.1 – Focus on Big Data and Lifecycle Management Innovations

Oracle Data Integrator 12.2.1 makes its debut today, with new and enhanced functionality in many aspects of its core capabilities. Take a look here for the latest details – and read on for some highlights:

Big Data

Back in April we proudly announced the availability of Oracle Data Integrator for Big Data. The release brought together a series of advanced Big Data updates and features that Oracle Data Integration is rolling out for customers to help take their Hadoop projects to the next level with support for Apache Spark, Apache Pig, and orchestration using Oozie. Today, we continue to enhance this functionality by allowing users to choose between Task and Session execution modes for Oozie workflow generation.


Lifecycle Management

We all realize that the process for managing system software through its lifecycle from the initial development to the implementation is important! In Oracle Data Integrator 12.2.1 release management capabilities are introduced to provide a distinction between those development and deployment environments and artifacts.


ODI Exchange

Ever wanted a more community feel for ODI objects – including Global Knowledge Modules? That is now possible through the ODI Exchange which allows browsing, download, and install of global ODI objects made available by Oracle, or other ODI users through Official of Third-Party Update Centers.


Better Oracle Connectivity

Oracle Data Integrator’s repertoire of Knowledge Modules is continually improved. This release features a Knowledge Module to perform Partition Exchange Loading is available to allow users to swap partitions as needed. For more on that very subject view the A-Team Blog post: Using Oracle Partition Exchange with Oracle Data Integrator (ODI). Improvements have also been made to the Loading Knowledge Modules using External Tables, and the Data Pump Knowledge Modules.

More Data Integration Pillar Integration – Enterprise Data Quality (EDQ)

This release adds a new Oracle Enterprise Data Quality (EDQ) technology – meaning that it is directly available in Topology and allows the creation of data servers, physical schemas, and logical schemas for EDQ. This helps to tightly couple the various tools when in use together in any project. In addition, the OdiEnterpriseDataQuality tool was improved to support EDQ data servers through Contexts and Logical Schemas.

There are many other operational enhancements that have been made, for the entire list of improved functionality, please click here for a detailed list of what is new in Oracle Data Integrator (ODI) 12.2.1 – many are not listed here! Try it out and tell us what you think!

Monday Oct 12, 2015

Featuring Big Data Sessions at Oracle OpenWorld 2015

Oracle OpenWorld is only a few days away now and Big Data will be front and center again this year! Many of our Oracle Data Integration sessions will speak to your Big Data needs, we hope you will come and meet us to hear how Oracle Data Integration helps everyone by simplifying access to Big Data and introducing real time capabilities to Big Data.

I would recommend attending the following 2 key sessions on Oracle Data Integration with Big Data:

  • Enabling Real-Time Data Integration with Big Data [CON9724]
    In this session Chai Pydimukkala from the Oracle Data Integration Product Management team will discuss GoldenGate's offering for big data environments. With Chai, Janardh Bantupalli from LinkedIn, will present their solution that uses Oracle GoldenGate for Big Data to optimize the data warehousing environment and achieve operational insights with lower costs.
  • Oracle Data Integration Product Family: a Cornerstone for Big Data [CON9609]
    In this session Alex Kotopoulis from the Oracle Data Integration Product Management team and Mark Rittman Chief Technical Officer at Rittman Mead will describe how our Data Integration platform uses a metadata-based approach to hide the complexity of the various big data technologies such as Hive, Pig, and Spark, and delivers a simplified and future-proofed investment in big data technologies.

There are many more Big Data related sessions I’d also recommend to attend:

In addition we will be running several Hands on Labs covering Oracle Big Data Preparation Cloud Service, Oracle Data Integrator and Oracle GoldenGate. Space is limited and they usually fill up quickly so make sure to register!

Please also come to visit us at our various demo pods in Moscone South:

  • Oracle Big Data Preparation Cloud Service: Get Your Big Data Ready to Use
    Workstation ID: SBD-022 / Venue: Moscone South, Upper Right, Big Data Showcase
  • Oracle Big Data Preparation Cloud Service
    Workstation ID: SPI-023 / Venue: Moscone South, Oracle Cloud Platform and Infrastructure Showcase
  • Oracle Data Integrator Enterprise Edition and Big Data Option: High-Performance Data Integration
    Workstation ID: SLM-022 / Venue: Moscone South, Lower Left, Middleware
  • Oracle GoldenGate: Real-Time Data Integration for Heterogeneous and Big Data Environments
    Workstation ID: SLM-035 / Venue: Moscone South, Lower Left, Middleware
  • Tame Big Data with Oracle Data Integration
    Workstation ID: SBD-023 / Venue: Moscone South, Upper Right, Big Data Showcase

We hope you will join a few! Don’t forget to view the Focus on Data Integration – for a full review of Data Integration Sessions during OpenWorld. See you there!

Thursday Oct 08, 2015

Featuring Big Data Preparation Cloud Service and other Cloud Data Integration Sessions at Oracle OpenWorld 2015

Oracle OpenWorld is almost upon us! We are excited to be sharing with you some previews of what will be seen and discussed in just a few weeks in San Francisco!

One of the highlights is Oracle’s new Cloud Based Data Preparation Solution, Oracle Big Data Preparation Cloud Service, also known as BDP.  This new service will revolutionize the process of importing, preparing and publishing your complex business data and getting it ready for use allowing you to spend more time analyzing data rather than preparing data for analysis. Users are guided through the process with intuitive recommendation driven interfaces. The system also provides various ways to automate and operationalize the entire data preparation pipeline via the built in scheduler or via a rich set of RESTful API’s.

During OpenWorld, Oracle’s Luis Rivas, alongside Blue Cloud Innovations’ Vinay Kumar and Pythian’s Alex Gorbachev will discuss and demonstrate how big data promises many game-changing capabilities if tackled efficiently! You will discover how Oracle Big Data Preparation Cloud Service takes “noisy” data from a broad variety of sources in many different formats, both structured and unstructured, and uses sophisticated and unique blend of machine learning and Natural Language Processing based on a vast set of linked open reference data that provide a powerful way to ingest, prepare, enrich, and publish it into useful data streams, ready for further discovery, analysis, and reporting. Don’t miss it:

CON9615 Solving the “Dirty Secret” of Big Data with Oracle Big Data Preparation Cloud Service

Tuesday, Oct 27, 5:15 p.m. | Moscone South—310

Curious to find out more about BDP before the conference? Take a look here and view a short video: Chalk Talk: Oracle Big Data Preparation Cloud Service!

Since we are on the topic of Data Integration and the Cloud – I will also take a quick moment to remind everyone about Oracle Data Integrator’s (ODI) integration relative to the Oracle Storage Cloud Service as well for example. But that’s not all – here is a view into the Data Integration sessions that relate to the Cloud – in chronological order:

CON3506 Into the Cloud and Back with Oracle Data Integrator 12c

Monday, Oct 26, 5:15 p.m. | Moscone West—2022

*****

CON9614 Oracle Data Integration Solutions: the Foundation for Cloud Integration

Wednesday, Oct 28, 11:00 a.m. | Moscone South—274

*****

CON9717 Accelerate Cloud Onboarding Using Oracle GoldenGate Cloud Service

Wednesday, Oct 28, 3:00 p.m. | Moscone West—2022

*****

CON9595 Cloud Data Quality: Lessons Learned from Oracle’s Journey to the Sales Cloud

Thursday, Oct 29, 12:00 p.m. | Moscone West—2022

*****

CON9612 Oracle Enterprise Metadata Management and the Cloud

Thursday, Oct 29, 1:15 p.m. | Marriott Marquis—Salon 4/5/6


We hope you will join a few! Don’t forget to view the Focus on Data Integration – for a full review of Data Integration Sessions during OpenWorld. See you there!

Wednesday Oct 07, 2015

More on Leveraging Oracle Data Integrator (ODI) for Cloud Applications

Take a look at this week’s A-Team Blog post: Need to Integrate your Cloud Applications with On-Premise Systems… What about ODI? This blog is tightly coupled to the recent blog post: A Universal Cloud Applications Adapter for ODI.

First you learned about the simplicity of leveraging Oracle Data Integrator (ODI) with all emerging technologies in the world of cloud computing. Now read about which Cloud JDBC drivers will allow you to expand your data integration initiatives to include PaaS and SaaS connectivity.

For more A-Team reads on ODI, browse through the A-Team Chronicles.

Tuesday Oct 06, 2015

Catch Up on Oracle GoldenGate at Oracle OpenWorld

This year Oracle OpenWorld brings many opportunities for Oracle GoldenGate users to learn the latest features and best practices. If you will be at OpenWorld later this month, I recommend you check out the following key Oracle GoldenGate sessions:

On Monday October 26th, Chai Pydimukkala from the GoldenGate product management team will present Oracle GoldenGate Product Update and Strategy (CON9720) session and share the new features of Oracle GoldenGate and its strategic direction. Along with Chai, Eric Schneider and Andrew Yee from our customer TicketMaster will present their GoldenGate deployment and best practices

On Tuesday Oct 27th, in the Enabling Real-Time Data Integration with Big Data (CON9724) Chai will discuss GoldenGate's offering for big data environments. With Chai,  Janardh Bantupalli from LinkedIn, will present their solution that uses Oracle GoldenGate for Big Data to optimize the data warehousing environment and achieve operational insights with lower costs.

On Wednesday October 28th you can get a preview to the anticipated Oracle GoldenGate Cloud Service by attending Accelerate Cloud On-Boarding using GoldenGate Cloud Service (CON9717). You will also learn about using GoldenGate in public, private, and hybrid cloud deployment and hear from Michael Pape, CTO Database Operations for Intuit, talk about their GoldenGate best practices.  

Other key GoldenGate sessions to attend:

You can find the full list of Oracle GoldenGate and Oracle Data Integration sessions in our Focus On Document, and use the Schedule Builder to build your personal schedule for OpenWorld. While at OpenWorld, follow us via @OracleDI and @ORACLEBigData and using the hashtags #ODI12c,#OGG12c, #OEMM, #OEDQ and #OBDPCS to join the conversation.

Sunday Oct 04, 2015

Oracle Open World 2015 with Oracle Data Integration Solutions.

This year’s Oracle Open World, OOW15 is right around the corner. Less than 4 weeks away and counting. We at Oracle Data Integration Solutions are extremely excited to meet you and showcase our solutions to you. Oracle Open World provides the opportunity for our Data Integration customers to explore cutting edge technologies around our Data Integration solutions, latest releases and to catch sneak previews of upcoming products.

Important Tips to make the most of this year’s Open World.

       1. Focus on Data Integration : If you have been to Open Worlds before you will realize that planning your open world is crucial to making the most of the experience. Between trying to catch exciting sessions, meeting with Product Experts, signing up for Hands on Labs and catching up with product teams, fellow customers and partners it is easy to miss a lot without a schedule. So make sure you build your own using our Focus On Document (this lists all Data Integration related happenings at OOW15) and then use the Schedule Builder to build your itinerary.

2. Catch Jeff Pollock’s General Session: Oracle Data Integration Solutions—Platform Overview and Roadmap [CON9737] – Before heading to deep dive sessions focusing on Data integration products at OOW15, make sure you catch this session by Jeff Pollock, Vice President of Product Management for Data Integration. This session sets the overview and roadmap vision for all products within the Data Integration Family. So if you are interested in Oracle GoldenGate, Oracle Data Integrator, Oracle Enterprise Metadata Management, Oracle Enterprise Data Quality or Oracle Big Data Preparation Cloud Service (a brand new offering!), Jeff will help orient how they all fit together to manage your data through the entire lifecycle through these products.

        3. Ongoing Coverage for Attendees and those who cannot make it to San Francisco: We understand that not all of us can make it to the event physically. That is not to say that you cannot be equally up-to-date on what is happening. Leading up to the event, and throughout OOW15, we shall have blogs and write-ups focusing on each product and have recap blogs to ensure you miss nothing. For more real time updates, follow us on twitter at @OracleDI and @ORACLEBigData using the hashtags #ODI12c,#OGG12c, #OEMM, #OEDQ and #OBDPCS to join the conversation.

       4. Fusion Middleware Innovation Awards: Oracle Fusion Middleware: Meet This Year’s Most Impressive Innovators [CON10374] - Come see how your peers are innovating and winning with Oracle Middleware. The Oracle Excellence Awards for Oracle Fusion Middleware Innovation honors organizations from around the globe. If you have ever wanted to combine technology innovation with red carpets, this is the event.

       5. And finally, have a good time.

For more information on Oracle Data Integration, visit us our home page and keep your eyes out here for more followup blog posts in the coming days.

Wednesday Sep 30, 2015

Defining and Implementing a Realistic Data Governance Strategy – Webcast Recap

If you missed the Data Governance webcast on the 24th of September, do not worry. You can catch the replay right here.


The webcast featured Jeff Pollock, Director of Product Management for Oracle Data Integration and Governance solutions, and Sunil Soares, Founder and Managing Partner of Information Asset LLC. The focus was on Data Governance and Data quality as a practice and how to implement them using Oracle Enterprise Metadata Management and Oracle Enterprise Data Quality.

Critical Data Elements are a key concept in identifying which information to govern and how to measure success for any governance program. The traditional perception of using governance as a defensive tool to prevent risk is shifting onto a more pro active one of growing top line growth.

Here were some questions that came in during the session which we want to share to the wider governance community. And if you need any more questions answered while watching the replay we encourage you to reach out to us here.

How does OEMM support ingestion of external metadata?

Do you provide support for Informatica metadata ingestion out of the box?

OEMM harvests (ingests) external metadata using harvesting bridges which come with the product. There are bridges to all popular Databases, Data Modeling, Data integration and BI platforms. You can see the complete list in our certification matrix. For the platforms that are not covered in our extensive bridge list, we also provide a way to harvest metadata by defining them in excel.

Yes, Informatica is supported out of the box.

For more info check out the data sheet.

Does OEMM support column level lineage for Informatica?

Yes, OEMM supports full lineage, column level, all transformations and SQL override parsing for lineage and other scenarios.

For a deeper dive into this subject here is a White Paper on Data Governance that was authored by the two speakers.

Wednesday Aug 05, 2015

Chalk Talk Video: Oracle Big Data Preparation Cloud Service

We continue our Oracle Data Integration chalk talk video series, with an overview of Oracle Big Data Preparation Cloud Service (BDP). BDP allows users to unlock the potential of their data with a non-technical, web-based tool that minimizes data preparation time. BDP provides an interactive set of services that automate, streamline, and guide the process of data ingestion, preparation, enrichment, and governance without costly manual intervention.

View this video to learn more: Chalk Talk: Oracle Big Data Preparation Cloud Service

For additional information – visit the Oracle Big Data Preparation Cloud Service page.


Tuesday Aug 04, 2015

Simplicity in Leveraging Oracle Data Integrator for Cloud Applications

Check out last week’s A-Team Blog post… A Universal Cloud Applications Adapter for ODI

Learn about the simplicity of leveraging Oracle Data Integrator (ODI) with all emerging technologies in the world of cloud computing!

For more A-Team reads on ODI, browse through the A-Team Chronicles.

Wednesday Jul 08, 2015

ODI KMs for Business Intelligence Cloud Service

In this article we will learn how to leverage Oracle Data Integrator’s extensible Knowledge Modules (KM) framework to create knowledge modules to load data into the Oracle Business Intelligence Cloud Service (BICS). The following instructions are targeted for BICS instances using Schema Cloud Service, if your BICS instance uses Database as a Service then you can directly load data into DBaaS tables as described in the blog post ODI 12c and DBaaS in the Oracle Public Cloud. More details on implementing Knowledge Modules can be found in Knowledge Module Developer Guide.

BICS exposes REST APIs that allows programmatically creating, managing, and loading schemas, tables, and data into Oracle BI Cloud Service. We will invoke these REST APIs using the Jersey client libraries providing wrapper implementation for invoking RESTful web services. The sample implementation of it is available on Java.net : RKM and IKM for Oracle BI Cloud Service
[Read More]

Tuesday Jul 07, 2015

Chalk Talk Video: Kick-Start Big Data Integration with Oracle

Next in the series for Oracle Data Integration chalk talk videos, we speak to Oracle Data Integrator (ODI) for big data. ODI allows you to become a big data developer without learning to code Java and Map Reduce! ODI generates the code and optimizes it with support for Hive, Spark, Oozie, and Pig.

View this video to learn more: Chalk Talk: Kick-Start Big Data Integration with Oracle.

For additional information on Oracle Data Integrator, visit the ODI homepage and the ODI for Big Data page. This blog can be very handy also: Announcing Oracle Data Integrator for Big Data.

Thursday Jul 02, 2015

Chalk Talk Video: How to Raise Trust and Transparency in Big Data with Oracle Metadata Management

Some fun new videos are available; we call the series ‘Chalk Talk’!

The first in the series that we will share with you around Oracle Data Integration speaks to raising trust and transparency within big data. It is known that crucial big data projects often fail due to a lack in the overall trust of the data. Data is not always transparent, and governing it can become a costly overhead. Oracle Metadata Management assists in the governance and trust across all data with the enterprise, Oracle and 3rd party.

View this video to learn more: Chalk Talk: How to Raise Trust and Transparency in Big Data.

For additional information on Oracle Metadata Management, visit the OEMM homepage.

Wednesday Jul 01, 2015

ODI - Integration with Oracle Storage Cloud Service

Oracle Data Integrator’s open tool framework can be leveraged to quickly get access to the Oracle Storage Cloud Service, which is gradually becoming an essential part for integrating on premise data to many cloud services. The reference implementation of an open tool for Oracle Storage Cloud is now available on the Data Integration project on Java.net: ODI OpenTool for Oracle Storage Cloud which can be used and modified as per your integration needs. [Read More]

Friday Jun 19, 2015

Oracle GoldenGate Certified on Teradata Unity

Oracle GoldenGate 12.1.2.1.1  is now certified with Unity 14.11.  With the certification, customers can use Oracle GoldenGate to deliver data to Teradata Unity which can then automate the distribution of data to multiple Teradata databases.  This joined effort from Oracle GoldenGate and Teradata extends the Oracle GoldenGate and Teradata ecosystem for real-time data integration. 

About

Learn the latest trends, use cases, product updates, and customer success examples for Oracle's data integration products-- including Oracle Data Integrator, Oracle GoldenGate and Oracle Enterprise Data Quality

Search