Announcement: bring Data Catalog objects into Autonomous Database Data Studio

May 9, 2023 | 4 minute read
Alexey Filanovskiy
Product Manager
Text Size 100%:

Today, I'm pleased to announce that Oracle Autonomous Database Data Studio supports seamless integration with OCI Data Catalog. Leverage the metadata in OCI Data Catalog for integration with any data asset maintained in OCI Data Catalog without any coding.

What is OCI Data Catalog?

OCI Data Catalog is a Cloud Service that maintains a complete view of all available data for discovery and governance in Oracle Cloud. I will not go into the details of the OCI Data Catalog but only highlight a few points – an excellent blog out there discusses its capabilities in great detail.

Just to re-cap the key advantages of why you should be using a data catalog, here are my top three ones:

•    Have a central place to store metadata for multiple objects in Oracle Cloud.
•    Automatically harvest metadata of data assets. 
•    Enrich technical metadata with business context information.

It's also worth pointing out that with a central data catalog, you can reuse its information in multiple processing engines beyond Autonomous Database.

Some of you might say that Autonomous Database had integration with OCI Data Catalog before. That is true and has been available for a while without proper web-based support. That's the brand-new component we just added. 

In this blog, I assume you have a Data Catalog and have harvested some objects already. If not, you can get quickly up-to-speed with this Live Lab, which helps with step-by-step guidance on how to do so.

The screenshot below gives you an idea of how it will look like.

DCAT Objects

How to bring Data Catalog entities into Autonomous Database for analysis?

Oracle Data Studio now has intuitive web-based support to integrate your Data Catalog with your Autonomous Database as part of the "Data Loading" workflow, the place to load or access data that resides outside your Autonomous Database:

Data Loading

You start with the registration of your catalog:

register catalog

It's a relatively simple process. You only need to provide or select the credentials to access your data catalog and the region. Data Studio automatically discovers available catalogs and suggests picking one:

pick a catalog

After establishing the connection to the data catalog, you see all your Object Store harvested and managed in the data catalog. Pick and choose the data assets you are interested in Data Studio will do the rest:

choose assets
The next step is no different than using manually created Object Store locations. Choose to load data or to link objects in your Cloud Store with drag-and-drop:

Link Data

drug and drop

The data loading process with Data Studio is well explained in this blog post, so I will not overcommunicate here.

Summary

In this blog post, you may learn that there are reasons why users may want to hire OCI Data Catalog. If this is the case, the next step is to bring this metadata into ADW. Although integration was there for a while, it required coding.
 
The new Data Studio functionality, explained in this blog post, allows performing such integration without any line of code.

Alexey Filanovskiy

Product Manager

My role involves overseeing the product management of Data Lake features for the Oracle Autonomous Database.


Previous Post

How to easily access and gain insights from your Stripe data on Oracle Autonomous Database

Nilay Panchal | 4 min read

Next Post


Oracle Database API for MongoDB - Best Practices

Hermann Baer | 5 min read
Everything you need to know about data warehousing with the world's leading cloud solution provider