Tuesday Jun 21, 2016

Oracle Data Integrator (ODI) 12.2.1.1.0 Now Available

Oracle Data Integrator 12.2.1.1.0 is now available! Please visit the ODI OTN page for downloads, documentation, related collateral and other useful links.

Take a look here for the latest details of this release – and read on for some highlights:

Hyperion Essbase and Hyperion Planning Knowledge Modules

Hyperion Essbase and Hyperion Planning Knowledge Modules have been made available out of the box with Oracle Data integrator and support the latest version (11.1.2.4) of these Hyperion Applications.

Integrated Capture/Delivery support in GoldenGate Knowledge Modules

The GoldenGate Journalization Knowledge Modules (JKMs) for Oracle databases have been updated and now support Integrated Capture and Delivery. This updated functionality can improve performance and provides better scalability and load balancing.

Support for Cubes and Dimensions
Core ETL – ELT enhancements have been made; where ODI now provides support for two types of dimensional objects: Cubes and Dimensions. Users can create and use Cubes and Dimensions objects directly in Mappings to improve developer productivity with out of the box patterns that automate the loading of dimensional objects. This also allows for improved Type 2 Slowly Changing Dimensions and brand new Type 3 Slowly Changing Dimensions support with ODI.


Big Data Configuration Wizard
A brand new Big Data Configuration wizard is now available in the ODI Studio Gallery and provides a single entry point to configure the Topology objects for Hadoop technologies such as Hadoop, Hive, Spark, Pig, Oozie, etc.

Let us know how you are using ODI – and try out this new version to keep up with what’s current!

Friday May 20, 2016

Using Oracle Data Integrator (ODI) for Loading to Oracle Cloud’s Human Capital Management (HCM)

The A-Team is on a roll…

To load data into Oracle Cloud’s Human Capital Management (HCM) with Oracle Data Integrator (ODI) – check out the following blog:

Oracle Data Integrator (ODI) for HCM-Cloud: a Knowledge Module to Generate HCM Import Files

HCM is unique in that it uses a dedicated file format that contains both metadata and data. As far as the data is concerned, the complete hierarchy of parent and children records must be respected for the file content to be valid. This article explores a new Integration Knowledge Module (KM). This KM allows us to leverage ODI to prepare the data and generate the import file. Then, traditional Web Services connections can be leveraged to load into HCM.

Monday May 16, 2016

More About Using and Connecting ODI to the Cloud!

More about ODI and the Cloud from the A-Team. Thanks Christophe!

This article covers connecting Oracle Data Integrator (ODI) to the Cloud – with details about web services and security policies. This has all been made simple with ODI 12.2.1 – just follow the simple configuration steps and off you go.

Connecting Oracle Data Integrator (ODI) to the Cloud: Web Services and Security Policies

Happy reading!

Thursday May 12, 2016

Looking for Cutting-Edge Data Integration & Governance Solutions: Nominate NOW for the 2016 Excellence Awards

It is nomination time!!!

This year's Oracle Cloud Platform Innovation – Excellence Awards will honor customers and partners who are creatively using Oracle products. Think you have something unique and innovative with Oracle Data Integration & Governance products?

We'd love to hear from you! Please submit today in the Data Integration & Governance category. This year’s nomination process is a little bit different in the sense that the forms are fully online.

The deadline for the nomination is Monday, June 20, 2016. Win a free pass to Oracle OpenWorld 2016!

Let’s reminisce a little…

For details on the 2015 Big Data, Business Analytics, and Data Integration Winners: amazon.com, Caixa Bank, Serta Simmons Bedding, Skanska, Scottish & Southern Energy and Tampa International Airport, check out this blog post.

For details on the 2014 Data Integration Winners: NET Serviços and Griffith University, check out this blog post.

For details on the 2013 Data Integration Winners: Royal Bank of Scotland’s Market and International Banking and The Yalumba Wine Company, check out this blog post.

For details on the 2012 Data Integration Winners: Raymond James Financial and Morrisons Supermarkets, check out this blog post.

We hope to honor you!

Click here to submit your nomination today – scroll to the bottom of the page and select the appropriate category. And just a reminder: the deadline to submit a nomination is 5pm Pacific Time on June 20th, 2016.


Tuesday Apr 05, 2016

How to load data from Excel using ODI 12.2.1 and Progress DataDirect SequeLink

Author: Octavio Oliveira

Background

There is often a need to read data from Excel spreadsheets and integrate it with different target technologies in Data Integration projects. The challenge is that MS Excel only supports ODBC connectivity whereas Oracle Data Integrator (ODI) and many other tools only support JDBC connectivity natively. This is where the Sun JDBC-ODBC Bridge packaged with Sun Java Development Kit (JDK) proved very useful to make the bridge between ODBC and JDBCS. However, starting with JDK 1.8 (required for ODI 12.2.1) the Sun JDBC-ODBC Bridge has been deprecated.

Luckily there are many third-party JDBC-ODBC bridges out there that can be used with ODI. In this blog post we will be using a solution provided by Progress DataDirect named SequeLink (https://www.progress.com/connectors/sequelink).

[Read More]

Monday Mar 28, 2016

Leveraging Oracle Data Integrator (ODI) with the Amazon Elastic MapReduce (EMR) Cloud Service

Another interesting article from our A-Team – read on!

Benjamin Perez-Goytia recently published Using Oracle Data Integrator (ODI) with Amazon Elastic MapReduce (EMR). He provides details on how to use Oracle Data Integrator (ODI) with the Amazon Elastic MapReduce (EMR) cloud service.  Amazon EMR is a big data cloud service and a member of the Amazon Web Services (AWS) cloud computing services, offered by Amazon.com.

Thanks Benjamin!

Thursday Feb 18, 2016

Topology Configurations for Web Services in Oracle Data Integrator (ODI) 12.2.1

There are a couple of enhancements added in outbound Web Services invocation support in Oracle Data Integrator (ODI) 12.2.1. You can now configure the Web Service end point URLs in the Topology definition instead of hard coding it in the ODI Tools parameters. Logical Schema of such topology configuration can be then used directly in the OdiInvokeWebService tool parameters. Now ODI also allows you to invoke a WebService that is protected by OWSM policies and register those OWSM policies as part of Physical Schema definition.

To register the Web Services definition a new technology, “SOAP Web Service”, is added in the Topology where you create the Data Server for the Web Service and register its WSDL URL.

The Services, Ports, user credentials, OWSM policies for the endpoint service from the WSDL are configured as the Physical Schemas.

You can then create a Logical schema for it and bind it with Physical Schema through Context mapping. Such logical schema and context can be specified in the OdiInvokeWebService tool instead of hard coding Web Service URL and other parameters.

To learn more about the Topology Configurations for Web Services, there is an Oracle by Example tutorial available providing step by step instructions on using the feature: http://www.oracle.com/webfolder/technetwork/tutorials/obe/fmw/odi/odi_12c/odi12c_newfeatures/ascii_files.html#section3s1

Additionally the new features introduced in Oracle Data Integrator 12.2.1 are also documented in our New Features white paper.

Tuesday Feb 16, 2016

More Tips on Oracle Data Integrator (ODI) for the Cloud from the A-Team

Check out this week’s post from Cecile Franchini of the A-Team, the title says it all: Tips for ODI in the Cloud: ODI On-Premise with DBCS.

If you are considering connecting to the Cloud and using Oracle DBCS – Oracle Database Cloud Service – ODI on-premise can help get the job done.

Friday Feb 12, 2016

Complex File Wizard is now available in ODI Studio 12.2.1

In the new Oracle Data Integrator 12.2.1 release the Native Format Builder wizard which is used by the Complex File technology is available directly within ODI Studio. Previously users had to use JDeveloper with the SOA Extensions to access it. The Native Format Builder wizard is used to parse a complex file structure and build a Native Schema (nXSD) description out of it, Oracle Data Integrator then uses this nXSD to reverse-engineer, read and write information from complex files.

You can find more information about the Native Format Builder and the Complex File technology in our documentation: http://docs.oracle.com/middleware/1221/odi/develop-connectivity-km/complex_files.htm#ODIKM1397

In addition you can find an Oracle By Example tutorial which will walk you through how to use this feature: https://apexapps.oracle.com/pls/apex/f?p=44785:24:103532390093139:::24:P24_CONTENT_ID,P24_PROD_SECTION_GRP_ID,P24_PREV_PAGE:12572,,24

Finally all the new features introduced in Oracle Data Integrator 12.2.1 are documented in our New Features white paper.


Tuesday Feb 02, 2016

A-Team Article: Integrating Oracle Data Integrator (ODI) On-Premise with Cloud Services

Benjamin Perez-Goytia of the Data Integration Solutions A-Team provides a very matter of fact summary regarding Cloud Integration with Oracle Data Integrator (ODI). For all the details: Integrating Oracle Data Integrator (ODI) On-Premise with Cloud Services.

The blog post details how to integrate Oracle Data Integrator (ODI) on-premise with cloud services.  Cloud computing is a service or utility in high demand and enterprises find themselves with a mix of on-premise data sources and cloud services.  Ben describes how Oracle Data Integrator (ODI) on-premise can enable the integration of both on-promise data sources and cloud services.

Happy reading! For more A-Team reads on ODI, browse through the A-Team Chronicles.

Friday Dec 18, 2015

Oracle Management Pack for Oracle Data Integrator for Enterprise Manager 13.1 is out! Make the most of the value of your Oracle Data Integrator investments!

We’ve mentioned before that to help you make the most of Oracle Data Integrator, and to deliver a superior ownership experience in an effort to minimize systems management costs, Oracle’s Management Pack for Oracle Data Integrator is a great addition! As a quick refresher: this product leverages Oracle Enterprise Manager Cloud Control's advanced management capabilities to provide an integrated and top-down solution for your Oracle Data Integrator environments. Management Pack for Oracle Data Integrator supports both 11g (11.1.1.7.0 and higher) and 12c versions of Oracle Data Integrator (12.1.2, 12.1.3 and 12.2.1).

Management Pack for Oracle Data Integrator provides a consolidated view of your entire Oracle Data Integrator infrastructure. This enables users to monitor and manage all their components centrally from Oracle Enterprise Manager Cloud Control.


In review, important capabilities include:

Performance Monitoring and Management

Management Pack for Oracle Data Integrator streamlines the monitoring of the health, performance, and availability of each and all components of an Oracle Data Integrator environment – this includes Master and Work Repositories, Standalone and JEE agents, as well as source and target Data Servers.

Configuration Management

To ensure that the configurations of all critical Oracle Data Integrator components in production environments are consistent with staging or test environments, Management Pack for Oracle Data Integrator provides Configuration Snapshots to save working configurations into the Management Repository or into an external XML file. These snapshots can then be compared with the active configuration in staging or test environments, or against any historical snapshot. Configuration Comparison is the next logical step which thus allows you to ensure the consistency of configurations in your application environment. Going one step further, Configuration History keeps track of all configuration changes, which can help in diagnosing performance problems that may be related to configuration changes along the way.

Service Level Management

Management Pack for Oracle Data Integrator allows for a proactive method to monitor Oracle Data Integrator environments at all levels. Many out of the box metrics are automatically collected for each Oracle Data Integrator component (repositories, agents, sources, targets…) which then provides users the ability to set up alerts based on critical or warning thresholds. Notifications can be provided to users in various ways through emails or Simple Network Management Protocol (SNMP) options.

Historical Analysis and Reporting

While real-time metrics certainly come in handy, there is also something to be said for historical collection of data! Management Pack for Oracle Data Integrator stores collected metrics and configurations data in a central repository –allowing users to thus analyze the metrics in various incremental views that include; last 24 hours, last 7 days, last 31 days. In addition, customizable service and system dashboard functionality allows users to create reports on various services and systems for service level availability, usage, performance, and business indicators – all in an effort to facilitate strategic trend analysis and reporting.

In a nutshell, Oracle Management Pack for Oracle Data Integrator benefits include: reducing the costs associated with monitoring the overall Oracle Data Integrator infrastructure and providing visibility into complex Oracle Data Integrator deployments across the enterprise, minimizing troubleshooting and performance tuning efforts as well as improving the overall ability to efficiently monitor Service Level Agreement compliance using powerful alerting capabilities. (For additional detail and to review another blog on the subject, click here.)

Oracle Management Pack for Oracle Data Integrator is licensed separately. From an installation perspective it is packaged in the Fusion Middleware plug-ins for Enterprise Manager (version 12.1.0.4 and higher) and comes with the base Enterprise Manager 12c or 13c download. There is no separate installation file to download. More information can also be found here.

Try it out! Getting Started with Oracle Fusion Middleware Management Plug-in

Monday Dec 14, 2015

Oracle Data Integrator Webcast Recap: Special Topic - Cloud Application Adapter

If you missed our Oracle Data Integrator Webcast two weeks ago about the simplicity of leveraging Oracle Data Integrator (ODI) with Cloud technologies – take a look here: Oracle Data Integrator Special Topic:  Salesforce.com & Universal Cloud.


With the explosion of the number of Cloud Applications today, the topic is top of mind for many organizations. ODI coupled with Progress DataDirect’s JDBC drivers can be the perfect fit – find out by viewing the webcast! Thanks again to our guest speakers: Sumit Sarkar, Chief Data Evangelist at Progress Software and Christophe Dupupet, Director – A-Team, Cloud Solutions Architects at Oracle.

For additional posts about ODI and the Cloud, browse the A-Team Chronicles – one of the posts you will find: A Universal Cloud Applications Adapter for ODI.

For other ODI webcasts, please view the Oracle Data Integrator Demo Webcast Archives. Our next one will cover ODI’s 12.2.1 New Features and is scheduled for January 14, 2016 at 1pm ET/10am PT. Join us!

Friday Dec 11, 2015

Oracle Data Integrator 12.2.1 - Release Management with Deployment Archives

In earlier articles on ODI Lifecycle Management features we covered Managing Versions in Apache Subversion and Parallel Development using Subversion Branches. Now let’s explore the Release Management aspects addressed in ODI 12.2.1.

Deployment Archive

The release management use cases are addressed in ODI 12.2.1 through the newly introduced object called Deployment Archive. It is an archive file containing a set of ODI objects along an XML file containing archive details. It is the vehicle to promote objects from a development environment to the testing or production environment as depicted in below diagram. In a typical release process a Deployment Archive is first deployed in testing environment where the validations can be performed and after testing is done it is applied to a production environment.


Deployment Archive Types

There are four types of Deployment Archives

  1. Initial Deployment Archive – It is used to initialize a fresh ODI repository. It is created with all the objects in your development project.
  2. Patch Deployment Archive – As the name suggest it is used to apply patch containing a bug fix or enhancement to an ODI repository that is already initialized with Initial Deployment Archive. It usually contains only the object having the bug fix or enhancement and all its dependencies.
  3. Rollback Deployment Archive – A Rollback Archive facilitates restoring a pre-patch state of deployment environment. It is created when a Patch Deployment Archive is applied to an ODI Repository and contains the artifacts from the repository that are being updated by the patch.
  4. Execution Deployment Archive – It holds only the runtime executable objects and gets created along with Initial or Patch Deployment Archive. It is used to promote artifacts to ODI execution repository, which holds only executable objects.

Creating Deployment Archive

All Deployment archive related operations can be invoked from the ODI Studio menu. There are three options available for creating a Deployment Archive, which differs in the way the objects to be included in the Archive are selected.


 Each of these options allows you to
  • Select the type of Deployment Archive to create (if applicable)
  • Provide Archive Name
  • Specify the file location where the archive is created
  • Specify an Export key which is used to encrypt sensitive data in the exported object XML
  • Provide an option to exclude physical topology containing connectivity details.

Create from a VCS Label (Tag)

The objects from a Subversion Tag are included in the Deployment Archive.