Use case: Near real-time data replication from databases (on-premise/Cloud) to OCI object storage using GoldenGate & GoldenGate Streaming Analytics.

Components Required:

  • GoldenGate 19.x or above. Marketplace Image or OCI GoldenGate Service.
  • Source Database can be any of the GoldenGate Supported databases.
  • Golden Gate Stream Analytics Marketplace.
  • OCI object Storage Bucket.

Architecture:

Provision Oracle GoldenGate for Oracle from OCI market place.

Assumption: GoldenGate Extract has to configured on the source Database and needs to be in a running state.

Here in the above example EXEDB  has been configured to capture the data from source Oracle Database.

Sample Extract parameter file.
extract EXEDB
useridalias EBS_207 domain OracleGoldenGate
exttrail /u02/trails/lt
sourcecatalog “ebsdb”
Table AP.*;

Provision Oracle GoldenGate Stream Analytics from OCI market place

After provision of OSA image from OCI marketplace, log in to GUI using osadmin

STEP 1:  Create a local kafka connection.
Catalog —> Create New item —> Connection —> Create Connection

Kafka Connection Detail -> Zookeepers has to be set as : localhost

Test Connection : Successful

STEP 2:  Create GoldenGate connection.
Catalog —> Create New item —> Connection —> Create Connection

Service Manager Host : IP Address of GG Marketplace Image
Service Manager Port : 443
GG username : oggadmin
GG Password : –Password of oggadmin —-

STEP 3:  Create Bucket in OCI Object Storage.

STEP 4:  Create connection to OCI Object Storage from OSA
Catalog —> Create New item —> Connection —> Create Connection

Punch in all the details related OCID & Tenancy information & click on Test Connection. This should show as Successful

STEP 4:  Create GG Change Data
Catalog —> Create New item —> GG Change Data

Click on Start GG Change Data.
This will create a Distribution Server Path automatically from Golden Gate Marketplace to OSA.

 

STEP 6:  Create Stream
Catalog —> Create New item —> Stream —> Stream

STEP 7:  Create Pipeline
Catalog —> Create New item —> Pipeline —> Pipeline

STEP 8 : Publish the pipeline and create the target mapping to OCI object Store.

Data in the object storage will be created with the specified format. Here is an example of Parquet.

 

More information about OSA documentation.