X

The latest cloud infrastructure announcements, technical solutions, and enterprise cloud insights.

Load and transform data from Oracle Fusion Cloud Applications to build a data lake or data warehouse

Sandrine Riley
Senior Principle Product Manager

We’re excited to announce a new release of Oracle Cloud Infrastructure Data Integration. This release adds connectivity to Oracle Fusion Applications.

Cloud native, serverless integration

OCI Data Integration is a recently launched, cloud native, fully managed, serverless extract, transform, and load (ETL) solution. Organizations building data lakes for Data Science on OCI. Departments building data lakes, data marts, and data warehouses using Autonomous Databases can gain great business value by using a solution that can help simplify, automate, and accelerate the consolidation of data for use.

Data Integration is graphical, providing a no-code designer, interactive data preparation, profiling options, and schema evolution protection, all powered by Spark ETL or ELT push-down runs. If you’re not familiar with this new service and want to more, check out the blog, What is Oracle Cloud Infrastructure Data Integration?

Data Integration is available in all OCI commercial regions.

New features

Today, we’re learning about extracting data from Oracle Fusion Applications through Oracle Business Intelligence Cloud Connector (BICC) in OCI Data Integration.

Oracle Fusion Applications is a suite of 100% open, standards-based business applications that provide a new standard for the way businesses innovate, work, and adopt the technology. Delivered as a complete suite of modular, service-enabled enterprise applications, Oracle Fusion Applications works with Oracle’s Applications Unlimited portfolio to evolve the business to a new level of performance.

OCI Data Integration uses the Oracle Business Intelligence Cloud Connector (BICC) to enable connections to Oracle Fusion Applications as data sources. You use an Oracle Fusion Applications data asset as a source to extract data from Oracle Fusion Applications, such as an ERP or HCM cloud. Data Integration loads the extracted data into a predefined external storage location that’s configured in BICC. In this blog, we load the data from Fusion Applications to Object Storage in Parquet format and Autonomous Data Warehouse.

Prerequisites

Figure 1 - Configuring External Storage

  • Click the OCI Object Storage Connection tab and create a connection by clicking the + symbol.

Figure 2 - Object Storage as External Storage

  • Provide the Object Storage the details from document Storage Type: OCI Object Storage Connection and export the public key into OCI.

  • These prerequisites for configuring external storage are a one-time activity. Based on the business requirements, you can add an OCI Object Storage connection.

Implementing Fusion Applications integration with Data Integration

In this example, we join the geographical information coming from Fusion Applications with Bank Customer data present in JSON format. The joined data is then split into multiple customer locations. Data for customers from India (IN) gets loaded in Object Storage in Parquet format and data for customers from the US location gets loaded in Autonomous Data Warehouse.

Configuring data assets

After the prerequisites are complete, you can create data assets and select Fusion Application as data asset type.

Figure 3 - Create Data Asset for Fusion Applications

Using data assets in Data Flow and data loader tasks for Fusion Applications

You can use data assets in the data flow or data loader task. Create the data flow and select and drag the source operator in the canvas. Use the Fusion Applications data asset. In the following example, full extracts have been configured.

A screenshot of an example data flow.

Figure 4 - Configuring Data Asset in Data Flow for Fusion Applications

When the data flow is complete, save it, create an integration task, publish it to an application, and run the corresponding task.

Figure 5 - Transformations and Complete Data Flow

You can browse the Runs tab within the application to monitor the progress of the run.

Figure 6 - Task Run Successfully Executed

You can also configure incremental extracts in the data flow or data loader task for the data assets related to Fusion Applications.

Figure 7 - Data Asset Incremental Load Configuration for Fusion Applications

For the multiple incremental loads, you can define the parameter for the last extract date and pass the date value during run-time.

Figure 8 - Parameterize the Incremental Loads

Conclusion

This concludes our overview of implementing Fusion Applications integration with OCI Data Integration. You have seen how easy it is to load and transform data from Fusion Applications into Object Storage in Parquet format and in Autonomous Data Warehouse using OCI Data Integration. With the help of Object Storage, you can store the Fusion Applications data in data lakes and with Autonomous Data Warehouse, you can perform analytics and derive the business insights.

Organizations are embarking on their next-generation analytics journey with data lakes, autonomous databases, and advanced analytics with artificial intelligence and machine learning in the cloud. For this journey to succeed, they need to quickly and easily ingest, prepare, transform, and load their data into Oracle Cloud Infrastructure. OCI Data Integration’s journey is just beginning! Try it out today!

For more information, review the Oracle Cloud Infrastructure Data Integration documentation, associated tutorials, and the Oracle Cloud Infrastructure Data Integration blogs.

Be the first to comment

Comments ( 0 )
Please enter your name.Please provide a valid email address.Please enter a comment.CAPTCHA challenge response provided was incorrect. Please try again.Captcha