Friday Aug 12, 2016

Using Oracle Data Integrator (ODI) 12.2.1 with Microsoft Excel Data

There is often a need to read data from Excel spreadsheets, especially when talking about data integration.

The OpenLink JDBC-to-ODBC Bridge driver can help. It restores connectivity between modern JDBC-consuming applications and ODBC-accessible data sources across multiple operating systems.

Read here for how to connect to Excel using the OpenLink JDBC-ODBC driver. You’ll find simplicity and step by step instructions.

Thursday Aug 11, 2016

Oracle GoldenGate for Big Data is Cloudera Certified

Oracle GoldenGate is now certified for integration with latest Cloudera Hadoop distribution.

  • Versions used:
    • CDH 5.7
    • Oracle GoldenGate 12.2.0.1.1
  • Interfaces Certified - 
    • HDFS
    • Hive
    • Flume
    • Kafka
  • Certified with Kerberos
  • Certified with Apache Sentry 
For more details, you may refer to Cloudera Partner Listing Website

Upgrading to Oracle Data Integrator (ODI) 12c

The team often fields questions about the upgrade process between versions – and here we have a case study from a customer who has recently gone through that process. Do you like to fly safely?

Eurocontrol is the European organization for the safety of air navigation and consists of 41 member states. It manages the air traffic network, route charging, and working with other organizations to build a Single European Sky. It aims to run safer, more efficient, and more environmentally friendly operations in a growing market. Annual air traffic currently stands at approximately 10 million flights per year.

Eurocontrol underwent the upgrade from ODI 11g to ODI 12c led by partner Rittman Mead, and found that the entire upgrade process and operation could be planned, the risks could be foreseen and mitigated.

With datasets storing critical air traffic demand data and data pertaining to usage of airspaces, the upgrade had to be repeatable, executed with minimal downtime, and completed without any impact on the existing systems.

For the full case study, click here.

The upgrade was quick, smooth, and a complete success!

Wednesday Jul 20, 2016

Oracle GoldenGate Application Adapters 12.2.0.1.2 Released

Oracle GoldenGate Application Adapters 12.2.0.1.2 for JMS and Flatfile was released on 19/July/2016. 

New Features in this release:

  • DDL propagation for heterogeneous relational databases
  • Metadata in trail for both Extract and Replicat processes
  • Oracle Java standard based Java Package names

You now can download the software from OTN or eDelivery.

Oracle GoldenGate Application Adapters 12c (12.2.0.1)  Documentation

Oracle GoldenGate Adapter for Confluent Kafka Connect

Oracle GoldenGate Adapter/Handler for Kafka Connect (open-source) is released on 07/Jul/2016.

Summary

Kafka Connect is a tool for streaming data between Apache Kafka and other data systems in a scalable and reliable way. Kafka Connect can ingest entire databases or collect metrics from all your application servers into Kafka topics, making the data available for stream processing with low latency. An export connector can deliver data from Kafka topics into secondary indexes like Elasticsearch or into batch systems such as Hadoop for offline analysis. (Source: Confluent Website)

This Kafka Connect handler lets you to integrate using the Kafka Connect API which can be managed using Confluent Platform. The Kafka Connect Handler takes change data capture operations from a source trail file and generates data structs (org.apache.kafka.connect.data.Struct) as well as the associated schemas (org.apache.kafka.connect.data.Schema). The data structs are serialized via configured converters then enqueued onto Kafka topics. The topic name used corresponds to the fully qualified source table name as obtained from the GoldenGate trail file. Individual operations consist of inserts, updates, and delete operations executed on the source RDBMS. Insert and update operation data include the after change data. Delete operations include the before change data. A primary key update is a special case for an update where one or more of the primary key(s) is/are changed. The primary key update represents a special case in that without the before image data it is not possible to determine what row is actually changing when only in possession of the after change data. The default behavior of a primary key update is to ABEND in the Kafka Connect formatter. However, the formatter can be configured to simply treat these operations as regular updates or to treat them as deletes and then an insert which is the closest big data modeling to the substance of the transaction.

Difference between official GoldenGate Kafka Handler and Kafka Connect Handler

The Kafka Handler officially released in Oracle GoldenGate for Big Data 12.2.0.1.x is slightly different in functionality than the Kafka Connect Handler/Formatter included in this opensource component.

  • The officially released Kafka Handler interfaces with pluggable formatters to output the data to Kafka in XML, JSON, Avro, or delimited text format.
  • The Kafka Connect Handler/Formatter builds up Kafka Connect Schemas and Structs.  It relies on the Kafka Connect framework to perform the serialization using the Kafka Connect converters before delivering the data to topic.


Compatibility Matrix

  • Oracle GoldenGate for Big Data 12.2.0.1.1
  • Confluent.io Kafka/Kafka Connect 0.9.0.1-cp

Download Location

 It is available for download at java.net

 Other Confluent Connectors are listed here

Tuesday Jun 21, 2016

Oracle GoldenGate Studio 12.2.1.1.0 Release is Available

Oracle GoldenGate Studio (OGGS) 12.2.1.1.0 is released on June 21st, 2016. You can now download the software from OTN and eDelivery. This is the second release after we launched the OGGS at the start of this calendar year. In this release, we have certified two new heterogeneous databases (MySQL and Microsoft SQL Server) that you can use to design and deploy in high-volume, real-time database replication.

Key Features

  • Design and deploy high-volume, real-time replication across heterogeneous platforms in just a few clicks
  • Best practice solution templates and wizards
  • Automap tables and drag and drop custom maps
  • Deploy the same solution to multiple locations
  • Monitor active deployments with many monitoring points and track deployment history
  • Refresh the metadata in mapping editor

You can refer GoldenGate Studio 12.2.1.1 Data Sheet  for brief information about Studio, new features and benefits. The detailed information can be read from Oracle GoldenGate Studio 12.2 documentation.

Hope to see you guys using new Studio release. Feel free to reach out to me for your queries by posting in this blog or tweeting @nisharsoneji

Oracle Data Integrator (ODI) 12.2.1.1.0 Now Available

Oracle Data Integrator 12.2.1.1.0 is now available! Please visit the ODI OTN page for downloads, documentation, related collateral and other useful links.

Take a look here for the latest details of this release – and read on for some highlights:

Hyperion Essbase and Hyperion Planning Knowledge Modules

Hyperion Essbase and Hyperion Planning Knowledge Modules have been made available out of the box with Oracle Data integrator and support the latest version (11.1.2.4) of these Hyperion Applications.

Integrated Capture/Delivery support in GoldenGate Knowledge Modules

The GoldenGate Journalization Knowledge Modules (JKMs) for Oracle databases have been updated and now support Integrated Capture and Delivery. This updated functionality can improve performance and provides better scalability and load balancing.

Support for Cubes and Dimensions
Core ETL – ELT enhancements have been made; where ODI now provides support for two types of dimensional objects: Cubes and Dimensions. Users can create and use Cubes and Dimensions objects directly in Mappings to improve developer productivity with out of the box patterns that automate the loading of dimensional objects. This also allows for improved Type 2 Slowly Changing Dimensions and brand new Type 3 Slowly Changing Dimensions support with ODI.


Big Data Configuration Wizard
A brand new Big Data Configuration wizard is now available in the ODI Studio Gallery and provides a single entry point to configure the Topology objects for Hadoop technologies such as Hadoop, Hive, Spark, Pig, Oozie, etc.

Let us know how you are using ODI – and try out this new version to keep up with what’s current!

Tuesday May 24, 2016

Oracle GoldenGate for Big Data 12.2.0.1.1 update is available now!

Oracle GoldenGate for Big Data 12.2.0.1.1 update is available

I am pleased to announce the general availability of Oracle GoldenGate for Big Data 12.2.0.1.1.



What’s new in Oracle GoldenGate for Big Data 12.2.0.1.1 ?

  • New Formats – Avro OCF and Sequence File
Oracle GoldenGate for Big Data can now write data in Avro Object Container Format (OCF) and HDFS Sequence File format.

  • Automatic Metadata creation and update DDL changes to Hadoop.
Oracle GoldenGate for Big Data can now automatically create target Hive table and provide DDL updates to Hive/HCatalog. Oracle GoldenGate for Big Data can also automatically provide versioned schema files to HDFS directories as well.

  • Data Conversion – Hex Encoding and Character replacements
You will now be able to deliver your CDC data in hex encoding format in addition to base24 format. Oracle GoldenGate for Big Data will be able to find and replace using regular expressions. You can now include primary key in JSON format. Oracle GoldenGate for Big Data can convert time-stamp to ISO8601 format. .

  • Security Improvements – Oracle Wallet Integration and Kafka SSL
Oracle GoldenGate for Big Data can now integrate with Oracle Wallet. Kafka integration now provides integration with Kafka SSL which is available from Kafka 0.9.x.
  • Kafka Multiple Topic support
Oracle GoldenGate for Big Data can now automatically create target topics based on the source tables, if you would like to segregate the data from one table to a topic.
  • · Newer Certifications and many more !!!

Note: The 12.2.0.1.1 installer is available as an update installer for 12.2.0.1.0. So please look carefully for the update release file which contains the description with 12.2.0.1.1 release version.

More information on Oracle GoldenGate 12.2.0.1.1

Friday May 20, 2016

Using Oracle Data Integrator (ODI) for Loading to Oracle Cloud’s Human Capital Management (HCM)

The A-Team is on a roll…

To load data into Oracle Cloud’s Human Capital Management (HCM) with Oracle Data Integrator (ODI) – check out the following blog:

Oracle Data Integrator (ODI) for HCM-Cloud: a Knowledge Module to Generate HCM Import Files

HCM is unique in that it uses a dedicated file format that contains both metadata and data. As far as the data is concerned, the complete hierarchy of parent and children records must be respected for the file content to be valid. This article explores a new Integration Knowledge Module (KM). This KM allows us to leverage ODI to prepare the data and generate the import file. Then, traditional Web Services connections can be leveraged to load into HCM.

Monday May 16, 2016

More About Using and Connecting ODI to the Cloud!

More about ODI and the Cloud from the A-Team. Thanks Christophe!

This article covers connecting Oracle Data Integrator (ODI) to the Cloud – with details about web services and security policies. This has all been made simple with ODI 12.2.1 – just follow the simple configuration steps and off you go.

Connecting Oracle Data Integrator (ODI) to the Cloud: Web Services and Security Policies

Happy reading!

Thursday Apr 21, 2016

Oracle GoldenGate for DB2 for i 12.2.1.0.2 Release is Available

Oracle GoldenGate for DB2 i 12.2.0.1.2 was released on 4/15/2016. You now can download the software from OTN and eDelivery.[Read More]

Oracle GoldenGate for DB2 z/OS 12.2.1.0.2 Release is Available

Oracle GoldenGate for DB2 z/OS  12.2.0.1.2 was released on 4/15/2016. You now can download the software from OTN and eDelivery. [Read More]

Wednesday Mar 23, 2016

Getting Started with Oracle GoldenGate Cloud Service

GoldenGate Cloud Service (GGCS), is a cloud based real-time data integration and replication service, which provides seamless and data movement from various on-premises relational databases to databases in the cloud with sub-seconds latency while maintaining data consistency and offering fault tolerance and resiliency. This blog provides an overview.[Read More]

Tuesday Feb 16, 2016

More Tips on Oracle Data Integrator (ODI) for the Cloud from the A-Team

Check out this week’s post from Cecile Franchini of the A-Team, the title says it all: Tips for ODI in the Cloud: ODI On-Premise with DBCS.

If you are considering connecting to the Cloud and using Oracle DBCS – Oracle Database Cloud Service – ODI on-premise can help get the job done.

Tuesday Feb 02, 2016

A-Team Article: Integrating Oracle Data Integrator (ODI) On-Premise with Cloud Services

Benjamin Perez-Goytia of the Data Integration Solutions A-Team provides a very matter of fact summary regarding Cloud Integration with Oracle Data Integrator (ODI). For all the details: Integrating Oracle Data Integrator (ODI) On-Premise with Cloud Services.

The blog post details how to integrate Oracle Data Integrator (ODI) on-premise with cloud services.  Cloud computing is a service or utility in high demand and enterprises find themselves with a mix of on-premise data sources and cloud services.  Ben describes how Oracle Data Integrator (ODI) on-premise can enable the integration of both on-promise data sources and cloud services.

Happy reading! For more A-Team reads on ODI, browse through the A-Team Chronicles.

About

Learn the latest trends, use cases, product updates, and customer success examples for Oracle's data integration products-- including Oracle Data Integrator, Oracle GoldenGate and Oracle Enterprise Data Quality

Search

Archives
« August 2016
SunMonTueWedThuFriSat
 
1
2
3
4
5
6
7
8
10
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
   
       
Today