Data Integration Platform Cloud (DIPC) 18.4.3 is now available!
Do you know what DIPC is? If not, check out this short 2 minute video!
Data Integration Platform Cloud (DIPC) is a re-imagination of how various best of breed data integration solutions can come together and work seamlessly, finding synergies in their features and elevating smaller piecemeal tasks and projects into a solution based approach.
For example, DIPC introduces the concept of “elevated tasks” and “atomic tasks”. The latter, atomic tasks, are equivalent to point tasks that are used to accomplish smaller data requirements and logic, while the former, elevated tasks, consists of end goal oriented (e.g. building a data lake, or prepping data) groupings that bring together often encountered technological requirements into simple and logical task groupings.
Let’s explore some of the new features for DIPC 18.4.3:
A major enhancement we made in this release is the added support for Autonomous Data Warehouse (ADW), Oracle’s easy-to-use, fully autonomous database that delivers fast query performance. You can now create a connection to ADW and harvest metadata that can be used in our elevated tasks.
In a recent blog article we explored the Data Lake Builder task. This task helps with data lake automation, enabling an intuitive instantiation and copy of data into a data lake, in an effort to help reduce some of the existing data engineer/ data scientist friction. You can quickly create a comprehensive, end-to-end repeatable data pipeline to your data lake. The Add Data to Data Lake task now supports Autonomous Data Warehouse as a target and you can also ingest from Amazon S3. Additionally, task execution is supported through the remote agent.
The Replicate Data task includes advanced Kafka support with Avro and Sub types. The user experience has been enhanced to support many varied replication patterns in the future. You also have the option to encrypt data within the task.
The ODI Execution task adds support for Autonomous Data Warehouse (ADW) and Oracle Object Storage empowering users to bulk load into ADW and run ETL/ELT workloads to transform their data.
You’ll also find that DIPC scheduling is offered, allowing you to create scheduling policies to run jobs. Additionally, heterogeneous support has been expanded, with GoldenGate for SQL Server now available through the DIPC agent.
Learn more by checking out this documentation page for bits on how to create and runs tasks.