X

Welcome to All Things Data Integration: Announcements, Insights, Best Practices, Tips & Tricks, and Trend Related...

Hybrid Data Integration in Three Simple Steps using Oracle Data Integration Platform Cloud (DIPC)

Thomas Vengal
Director, Product Management

Background

We are currently living in a real-time world and data movement is expected to happen real-time across the various enterprise systems. Enterprises are having serious challenges in data integration between on-premises systems and cloud systems. Integration is never an easy problem to solve considering the complexity in handling the knowledge in various complex applications and also managing various data risks for the organization across these hybrid systems. Oracle Data Integration Platform Cloud  (DIPC) has simplified the complexity of data integration with a simplified concept of using an on-premises agent to integrate to any type of data sources or targets.

An on-premises DIPC Agent can be broadly used in the following two data integration scenarios:

a. On-Premises to Cloud Data Integration and Vice versa

In this integration, a DIPC agent is installed in the On-premises data center which communicates to DIPC Host on the Oracle cloud. In this scenario, the data gets transferred from DIPC Agent to the DIPC Host and then to the Oracle Database Cloud Service. 

b. On-Premises to On-Premises Data Integration

In this integration, a DIPC agent is installed in the On-premises data center which communicates to DIPC Host on the Oracle cloud only for manageability aspects. In this scenario, the data gets transferred from Source Oracle database to Target Oracle database through the DIPC Agent. No customer data will be transferred out of on-premises to Oracle Cloud.

3 Simple Steps for Hybrid Data Integration 

In this section, you will learn how to a) Download and Install, b) Configure and c) Run a DIPC agent on your on-premises system to integrate across On-Premises or Hybrid systems.

Step 1: Download and Install DIPC Agent

i. Log on to Data Integration Platform Cloud.

ii. From the left navigation pane, click Agents.

iii. From the Download Installer menu, select the available agent package based on the operating system.

iv. In the Download Agent Installer window, click OK.


v. Once the agent is downloaded, you would need to unzip into directory where you are expecting the agent to run.



Note: This location will be called as  ${AGENT_UNZIP_LOC} in the further section

vi. This completes your DIPC Agent download and installation step.

Step 2 : Configuring On-Premises Agent

i. You can find the agent configuration script in the following directory
Command> cd [Agent_unzip_dir]/dicloud
You will  find scripts dicloudConfigureAgent.bat (on Windows ) and dicloudConfigureAgent.sh (on Unix)

ii. You may configure the agent in two ways :
a) Basic AuthType  : For Configuring in Basic AuthType, run the following 
Command> ./dicloudConfigureAgent.sh [agent_name] -dipchost=[dipc.example.host.com] -dipcport=[port_no] -user=[diuser] -password=[dipassword] -authType=BASIC

eg: 
dicloudConfigureAgent.bat dipcagent001  -recreate -dipchost=135.169.165.107 -dipcport=9073 -user=weblogic -password=password123 -authType=BASIC



b) OAuth Type: For Configuring in OAuth Type, run the following
Command> ./dicloudConfigureAgent.sh [agentInstanceDirectory] -recreate -debug -dipchost=[dipc.example.host.com] -dipcport=[port] -user=[diuser] -password=[dipassword] -authType=[BASIC/OAUTH2] -idcsServerUrl=[idcs_server url] -agentIdcsScope=[agent_IDCS_Client_Scope] -agentClientId=[Agent_IDCS_clientID] -agentClientSecret=[Agent_IDCS_clientSecret]

Eg: ./dicloudConfigureAgent.sh -dipchost=dipcsfungerc4-dipcsv2meteri01.uscom-central-1.c9dev1.oc9qadev.com -dipcport=443 -idcsServerUrl=https://idcs-b8bdf957678a4d91b80801964c406828.identity.c9dev1.oc9qadev.com -agentIdcsScope=https://235C1F73C5B54068A7C02A202D6B2B42.uscom-central-1.c9dev1.oc9qadev.com:443external  -user=firstname.lastname@ORACLE.COM -password=Password123# -agentClientId=fb035f53b22a450982ec22551cccfdd6 -agentClientSecret=62eda7dc-1991-47ca-8205-fde062c62ab8 

Note a: You would need to get the OAuth tokens from Oracle Identity Cloud Service (IDCS) prior to configuring DIPC Agent in OAuth mode. Refer to blog  https://blogs.oracle.com/dataintegration/how-to-get-idcs-oauth-details for step-by-step details.

Note b: If you need to configure Remote agent with Autonomous DIPC, then you would need to create a Trusted Application using the Oracle IDCS Admin Console and assign "OCMS App" in allowed Scope.

iii. This completes DIPC agent configuration 

Step 3 : Starting the Agent

i. Go to the DIPC agent instance directory

Command> cd [AGENT_UNZIP_LOC]/dicloud/agent/[agent_name]/bin/

ii. To Start DIPC Agent: 
Command> ./startAgentInstance.sh 

iii. If you need to Stop DIPC Agent for any maintenance, you can run the following
Command> ./stopAgentInstance.sh

Note: If you are using Autonomous DIPC, the you would need to import the certificate from browser into cacerts present in DIPC Agent's JAVA_HOME directory and then run keytool import command.
For eg: $JAVA_HOME/bin/keytool -import -alias ocptest -keystore  /u01/JDK/jdk1.8.0_171/jre/lib/security/cacerts -file /scratch/ocp_test.crt

Reference and Additional Information

  • DIPC certification matrix to know the supported versions of Operating Systems and Source/Target Applications.
  • DIPC Documentation Homepage
  • Setting up DIPC Agents to understand what each configuration parameter means or to understand how to manually edit the configuration file to change port number or heartbeat interval

Be the first to comment

Comments ( 0 )
Please enter your name.Please provide a valid email address.Please enter a comment.CAPTCHA challenge response provided was incorrect. Please try again.Captcha
Oracle

Integrated Cloud Applications & Platform Services