Tuesday Feb 02, 2016

A-Team Article: Integrating Oracle Data Integrator (ODI) On-Premise with Cloud Services

Benjamin Perez-Goytia of the Data Integration Solutions A-Team provides a very matter of fact summary regarding Cloud Integration with Oracle Data Integrator (ODI). For all the details: Integrating Oracle Data Integrator (ODI) On-Premise with Cloud Services.

The blog post details how to integrate Oracle Data Integrator (ODI) on-premise with cloud services.  Cloud computing is a service or utility in high demand and enterprises find themselves with a mix of on-premise data sources and cloud services.  Ben describes how Oracle Data Integrator (ODI) on-premise can enable the integration of both on-promise data sources and cloud services.

Happy reading! For more A-Team reads on ODI, browse through the A-Team Chronicles.

Monday Jan 25, 2016

Oracle Metadata Management (OMM) 12.2.1 is now available!

Metadata Management is essential to solving a wide variety of critical business and technical challenges which include how report figures are calculated, understanding the impact of changes to data upstream, providing reports in a business friendly way in the browser and providing reporting capabilities on the entire metadata of an enterprise for analysis and improvement. Oracle Metadata Management is built to solve all these pressing needs for customers in a lightweight browser-based interface.

With Oracle Metadata Management 12.2.1, you will find many new features and enhancements. To list just a few:

Oracle Metadata Management is now based upon 100% Java delivery and installation allowing support for Windows as well as variation Linux/Unix deployments. This provides all UI features and any bridges which are executable in a Java and Linux/Unix based environment, specifically 100% java based bridges including JDBC database bridges (Oracle, Teradata, DB2, SQL Server, etc.), big data bridges (Hadoop Hive, HCatalog), and other popular bridges such as CA ERwin xml, Informatica PowerCenter xml, Tableau BI, etc.

Oracle Metadata Management configuration architecture visualization is now based upon an HTML 5 based implementation which includes better scalability, performance and overall layout quality, and supports iPad and other tablets.

Oracle Metadata Management provides two primary user interfaces for access, analysis, management and administration. The Metadata Manager UI provides a more technical interface for those who are managers of the metadata or administrators of the repository. The Metadata Explorer UI is designed for optimized search, analysis and reporting, as well as more control over the context (configuration version) presented to given users.

Oracle Metadata Management is now offering detailed DI data flow lineage analysis on demand only (in real time), instead of pre-calculating. This enhancement means that harvesting times are reduced by about 80%!

Oracle Metadata Management has a great number of new or enhanced bridges covering RDBMS, Big Data, Data Modeling, Data Integration, and Business Intelligence.

More details on the bridges and all the New Features for this release can be found here.

You can download Oracle Metadata Management 12.2. 1 here!

Friday Dec 18, 2015

Oracle Management Pack for Oracle Data Integrator for Enterprise Manager 13.1 is out! Make the most of the value of your Oracle Data Integrator investments!

We’ve mentioned before that to help you make the most of Oracle Data Integrator, and to deliver a superior ownership experience in an effort to minimize systems management costs, Oracle’s Management Pack for Oracle Data Integrator is a great addition! As a quick refresher: this product leverages Oracle Enterprise Manager Cloud Control's advanced management capabilities to provide an integrated and top-down solution for your Oracle Data Integrator environments. Management Pack for Oracle Data Integrator supports both 11g (11.1.1.7.0 and higher) and 12c versions of Oracle Data Integrator (12.1.2, 12.1.3 and 12.2.1).

Management Pack for Oracle Data Integrator provides a consolidated view of your entire Oracle Data Integrator infrastructure. This enables users to monitor and manage all their components centrally from Oracle Enterprise Manager Cloud Control.


In review, important capabilities include:

Performance Monitoring and Management

Management Pack for Oracle Data Integrator streamlines the monitoring of the health, performance, and availability of each and all components of an Oracle Data Integrator environment – this includes Master and Work Repositories, Standalone and JEE agents, as well as source and target Data Servers.

Configuration Management

To ensure that the configurations of all critical Oracle Data Integrator components in production environments are consistent with staging or test environments, Management Pack for Oracle Data Integrator provides Configuration Snapshots to save working configurations into the Management Repository or into an external XML file. These snapshots can then be compared with the active configuration in staging or test environments, or against any historical snapshot. Configuration Comparison is the next logical step which thus allows you to ensure the consistency of configurations in your application environment. Going one step further, Configuration History keeps track of all configuration changes, which can help in diagnosing performance problems that may be related to configuration changes along the way.

Service Level Management

Management Pack for Oracle Data Integrator allows for a proactive method to monitor Oracle Data Integrator environments at all levels. Many out of the box metrics are automatically collected for each Oracle Data Integrator component (repositories, agents, sources, targets…) which then provides users the ability to set up alerts based on critical or warning thresholds. Notifications can be provided to users in various ways through emails or Simple Network Management Protocol (SNMP) options.

Historical Analysis and Reporting

While real-time metrics certainly come in handy, there is also something to be said for historical collection of data! Management Pack for Oracle Data Integrator stores collected metrics and configurations data in a central repository –allowing users to thus analyze the metrics in various incremental views that include; last 24 hours, last 7 days, last 31 days. In addition, customizable service and system dashboard functionality allows users to create reports on various services and systems for service level availability, usage, performance, and business indicators – all in an effort to facilitate strategic trend analysis and reporting.

In a nutshell, Oracle Management Pack for Oracle Data Integrator benefits include: reducing the costs associated with monitoring the overall Oracle Data Integrator infrastructure and providing visibility into complex Oracle Data Integrator deployments across the enterprise, minimizing troubleshooting and performance tuning efforts as well as improving the overall ability to efficiently monitor Service Level Agreement compliance using powerful alerting capabilities. (For additional detail and to review another blog on the subject, click here.)

Oracle Management Pack for Oracle Data Integrator is licensed separately. From an installation perspective it is packaged in the Fusion Middleware plug-ins for Enterprise Manager (version 12.1.0.4 and higher) and comes with the base Enterprise Manager 12c or 13c download. There is no separate installation file to download. More information can also be found here.

Try it out! Getting Started with Oracle Fusion Middleware Management Plug-in

Monday Dec 14, 2015

Oracle Data Integrator Webcast Recap: Special Topic - Cloud Application Adapter

If you missed our Oracle Data Integrator Webcast two weeks ago about the simplicity of leveraging Oracle Data Integrator (ODI) with Cloud technologies – take a look here: Oracle Data Integrator Special Topic:  Salesforce.com & Universal Cloud.


With the explosion of the number of Cloud Applications today, the topic is top of mind for many organizations. ODI coupled with Progress DataDirect’s JDBC drivers can be the perfect fit – find out by viewing the webcast! Thanks again to our guest speakers: Sumit Sarkar, Chief Data Evangelist at Progress Software and Christophe Dupupet, Director – A-Team, Cloud Solutions Architects at Oracle.

For additional posts about ODI and the Cloud, browse the A-Team Chronicles – one of the posts you will find: A Universal Cloud Applications Adapter for ODI.

For other ODI webcasts, please view the Oracle Data Integrator Demo Webcast Archives. Our next one will cover ODI’s 12.2.1 New Features and is scheduled for January 14, 2016 at 1pm ET/10am PT. Join us!

Friday Oct 23, 2015

Announcing Oracle Data Integrator (ODI) 12.2.1 – Focus on Big Data and Lifecycle Management Innovations

Oracle Data Integrator 12.2.1 makes its debut today, with new and enhanced functionality in many aspects of its core capabilities. Take a look here for the latest details – and read on for some highlights:

Big Data

Back in April we proudly announced the availability of Oracle Data Integrator for Big Data. The release brought together a series of advanced Big Data updates and features that Oracle Data Integration is rolling out for customers to help take their Hadoop projects to the next level with support for Apache Spark, Apache Pig, and orchestration using Oozie. Today, we continue to enhance this functionality by allowing users to choose between Task and Session execution modes for Oozie workflow generation.


Lifecycle Management

We all realize that the process for managing system software through its lifecycle from the initial development to the implementation is important! In Oracle Data Integrator 12.2.1 release management capabilities are introduced to provide a distinction between those development and deployment environments and artifacts.


ODI Exchange

Ever wanted a more community feel for ODI objects – including Global Knowledge Modules? That is now possible through the ODI Exchange which allows browsing, download, and install of global ODI objects made available by Oracle, or other ODI users through Official of Third-Party Update Centers.


Better Oracle Connectivity

Oracle Data Integrator’s repertoire of Knowledge Modules is continually improved. This release features a Knowledge Module to perform Partition Exchange Loading is available to allow users to swap partitions as needed. For more on that very subject view the A-Team Blog post: Using Oracle Partition Exchange with Oracle Data Integrator (ODI). Improvements have also been made to the Loading Knowledge Modules using External Tables, and the Data Pump Knowledge Modules.

More Data Integration Pillar Integration – Enterprise Data Quality (EDQ)

This release adds a new Oracle Enterprise Data Quality (EDQ) technology – meaning that it is directly available in Topology and allows the creation of data servers, physical schemas, and logical schemas for EDQ. This helps to tightly couple the various tools when in use together in any project. In addition, the OdiEnterpriseDataQuality tool was improved to support EDQ data servers through Contexts and Logical Schemas.

There are many other operational enhancements that have been made, for the entire list of improved functionality, please click here for a detailed list of what is new in Oracle Data Integrator (ODI) 12.2.1 – many are not listed here! Try it out and tell us what you think!

Monday Oct 12, 2015

Featuring Big Data Sessions at Oracle OpenWorld 2015

Oracle OpenWorld is only a few days away now and Big Data will be front and center again this year! Many of our Oracle Data Integration sessions will speak to your Big Data needs, we hope you will come and meet us to hear how Oracle Data Integration helps everyone by simplifying access to Big Data and introducing real time capabilities to Big Data.

I would recommend attending the following 2 key sessions on Oracle Data Integration with Big Data:

  • Enabling Real-Time Data Integration with Big Data [CON9724]
    In this session Chai Pydimukkala from the Oracle Data Integration Product Management team will discuss GoldenGate's offering for big data environments. With Chai, Janardh Bantupalli from LinkedIn, will present their solution that uses Oracle GoldenGate for Big Data to optimize the data warehousing environment and achieve operational insights with lower costs.
  • Oracle Data Integration Product Family: a Cornerstone for Big Data [CON9609]
    In this session Alex Kotopoulis from the Oracle Data Integration Product Management team and Mark Rittman Chief Technical Officer at Rittman Mead will describe how our Data Integration platform uses a metadata-based approach to hide the complexity of the various big data technologies such as Hive, Pig, and Spark, and delivers a simplified and future-proofed investment in big data technologies.

There are many more Big Data related sessions I’d also recommend to attend:

In addition we will be running several Hands on Labs covering Oracle Big Data Preparation Cloud Service, Oracle Data Integrator and Oracle GoldenGate. Space is limited and they usually fill up quickly so make sure to register!

Please also come to visit us at our various demo pods in Moscone South:

  • Oracle Big Data Preparation Cloud Service: Get Your Big Data Ready to Use
    Workstation ID: SBD-022 / Venue: Moscone South, Upper Right, Big Data Showcase
  • Oracle Big Data Preparation Cloud Service
    Workstation ID: SPI-023 / Venue: Moscone South, Oracle Cloud Platform and Infrastructure Showcase
  • Oracle Data Integrator Enterprise Edition and Big Data Option: High-Performance Data Integration
    Workstation ID: SLM-022 / Venue: Moscone South, Lower Left, Middleware
  • Oracle GoldenGate: Real-Time Data Integration for Heterogeneous and Big Data Environments
    Workstation ID: SLM-035 / Venue: Moscone South, Lower Left, Middleware
  • Tame Big Data with Oracle Data Integration
    Workstation ID: SBD-023 / Venue: Moscone South, Upper Right, Big Data Showcase

We hope you will join a few! Don’t forget to view the Focus on Data Integration – for a full review of Data Integration Sessions during OpenWorld. See you there!

Thursday Oct 08, 2015

Featuring Big Data Preparation Cloud Service and other Cloud Data Integration Sessions at Oracle OpenWorld 2015

Oracle OpenWorld is almost upon us! We are excited to be sharing with you some previews of what will be seen and discussed in just a few weeks in San Francisco!

One of the highlights is Oracle’s new Cloud Based Data Preparation Solution, Oracle Big Data Preparation Cloud Service, also known as BDP.  This new service will revolutionize the process of importing, preparing and publishing your complex business data and getting it ready for use allowing you to spend more time analyzing data rather than preparing data for analysis. Users are guided through the process with intuitive recommendation driven interfaces. The system also provides various ways to automate and operationalize the entire data preparation pipeline via the built in scheduler or via a rich set of RESTful API’s.

During OpenWorld, Oracle’s Luis Rivas, alongside Blue Cloud Innovations’ Vinay Kumar and Pythian’s Alex Gorbachev will discuss and demonstrate how big data promises many game-changing capabilities if tackled efficiently! You will discover how Oracle Big Data Preparation Cloud Service takes “noisy” data from a broad variety of sources in many different formats, both structured and unstructured, and uses sophisticated and unique blend of machine learning and Natural Language Processing based on a vast set of linked open reference data that provide a powerful way to ingest, prepare, enrich, and publish it into useful data streams, ready for further discovery, analysis, and reporting. Don’t miss it:

CON9615 Solving the “Dirty Secret” of Big Data with Oracle Big Data Preparation Cloud Service

Tuesday, Oct 27, 5:15 p.m. | Moscone South—310

Curious to find out more about BDP before the conference? Take a look here and view a short video: Chalk Talk: Oracle Big Data Preparation Cloud Service!

Since we are on the topic of Data Integration and the Cloud – I will also take a quick moment to remind everyone about Oracle Data Integrator’s (ODI) integration relative to the Oracle Storage Cloud Service as well for example. But that’s not all – here is a view into the Data Integration sessions that relate to the Cloud – in chronological order:

CON3506 Into the Cloud and Back with Oracle Data Integrator 12c

Monday, Oct 26, 5:15 p.m. | Moscone West—2022

*****

CON9614 Oracle Data Integration Solutions: the Foundation for Cloud Integration

Wednesday, Oct 28, 11:00 a.m. | Moscone South—274

*****

CON9717 Accelerate Cloud Onboarding Using Oracle GoldenGate Cloud Service

Wednesday, Oct 28, 3:00 p.m. | Moscone West—2022

*****

CON9595 Cloud Data Quality: Lessons Learned from Oracle’s Journey to the Sales Cloud

Thursday, Oct 29, 12:00 p.m. | Moscone West—2022

*****

CON9612 Oracle Enterprise Metadata Management and the Cloud

Thursday, Oct 29, 1:15 p.m. | Marriott Marquis—Salon 4/5/6


We hope you will join a few! Don’t forget to view the Focus on Data Integration – for a full review of Data Integration Sessions during OpenWorld. See you there!

Wednesday Oct 07, 2015

More on Leveraging Oracle Data Integrator (ODI) for Cloud Applications

Take a look at this week’s A-Team Blog post: Need to Integrate your Cloud Applications with On-Premise Systems… What about ODI? This blog is tightly coupled to the recent blog post: A Universal Cloud Applications Adapter for ODI.

First you learned about the simplicity of leveraging Oracle Data Integrator (ODI) with all emerging technologies in the world of cloud computing. Now read about which Cloud JDBC drivers will allow you to expand your data integration initiatives to include PaaS and SaaS connectivity.

For more A-Team reads on ODI, browse through the A-Team Chronicles.

Tuesday Aug 04, 2015

Simplicity in Leveraging Oracle Data Integrator for Cloud Applications

Check out last week’s A-Team Blog post… A Universal Cloud Applications Adapter for ODI

Learn about the simplicity of leveraging Oracle Data Integrator (ODI) with all emerging technologies in the world of cloud computing!

For more A-Team reads on ODI, browse through the A-Team Chronicles.

Tuesday Jul 07, 2015

Chalk Talk Video: Kick-Start Big Data Integration with Oracle

Next in the series for Oracle Data Integration chalk talk videos, we speak to Oracle Data Integrator (ODI) for big data. ODI allows you to become a big data developer without learning to code Java and Map Reduce! ODI generates the code and optimizes it with support for Hive, Spark, Oozie, and Pig.

View this video to learn more: Chalk Talk: Kick-Start Big Data Integration with Oracle.

For additional information on Oracle Data Integrator, visit the ODI homepage and the ODI for Big Data page. This blog can be very handy also: Announcing Oracle Data Integrator for Big Data.

Thursday Jul 02, 2015

Chalk Talk Video: How to Raise Trust and Transparency in Big Data with Oracle Metadata Management

Some fun new videos are available; we call the series ‘Chalk Talk’!

The first in the series that we will share with you around Oracle Data Integration speaks to raising trust and transparency within big data. It is known that crucial big data projects often fail due to a lack in the overall trust of the data. Data is not always transparent, and governing it can become a costly overhead. Oracle Metadata Management assists in the governance and trust across all data with the enterprise, Oracle and 3rd party.