The recently launched Data Integration Platform Cloud (DIPC) provides capabilities for various data integration requirements covering data transformation, integration, replication and governance. DIPC introduces the concept of Elevated Tasks to hide the complexity of underlying data integration processes used for achieving an end-to-end use case. Synchronize Data is the first such elevated task that allows you to synchronize a source schema with a target schema with no effort. Synchronize Data allows you to keep data in your target database schema in sync with a production database so that the target database can be used for real time Business Intelligence and reporting without affecting production system performance.
Let us quickly understand the challenges in implementing such a data synchronization solution. The entire process can be achieved in two steps. First perform initial load of the existing source data to target and then configure a replication process to replicate all the ongoing transactions to the target. Let’s understand the steps required if you were implementing it using Oracle Data Integrator (ODI) and Oracle GoldenGate (OGG).
You notice that there are a number of intricate steps involved here that must be performed in the right order, across different products and requires a handshake between ODI and OGG. To implement all of this, you would require deep understanding of both ODI and OGG and it may take several days if not weeks to achieve the process end to end. Additionally, monitoring the progress of each of the steps and getting consolidated statistics will be another challenge.
With the new Synchronized Data task in DIPC, this entire operation is now done with few clicks without worrying about the complexity of the underlying steps. All you need to do is create a Synchronize Data task, which entails having to specify the source and target schema, and run it. DIPC takes care of creating the appropriate ODI scenarios, retrieving SCN in ODI, passing SCN from ODI to OGG, and initializing and running relevant OGG processes – OGG extract, OGG pump, OGG replicat. DIPC also provides central monitoring capability so that you can view the ongoing progress of each of the steps and their statistics.
Let us go through the steps for synchronizing data to see how easily you can do it in DIPC.
As shown above, DIPC has drastically simplified the data synchronization use case between two databases. Now, anybody can implement such an end-to-end scenario without needing the deep expertise previously required or the juggle of multiple underlying products.
Stay tuned for upcoming blogs on other exciting features introduced in DIPC. Meanwhile, check the product blogs to get more information: Data Integration Platform Cloud and Getting a Data Integration Platform Cloud (DIPC) Trial Instance.