Today, I'm pleased to announce that Oracle Autonomous Database Data Studio supports seamless integration with OCI Data Catalog. Leverage the metadata in OCI Data Catalog for integration with any data asset maintained in OCI Data Catalog without any coding.
OCI Data Catalog is a Cloud Service that maintains a complete view of all available data for discovery and governance in Oracle Cloud. I will not go into the details of the OCI Data Catalog but only highlight a few points – an excellent blog out there discusses its capabilities in great detail.
Just to re-cap the key advantages of why you should be using a data catalog, here are my top three ones:
• Have a central place to store metadata for multiple objects in Oracle Cloud.
• Automatically harvest metadata of data assets.
• Enrich technical metadata with business context information.
It's also worth pointing out that with a central data catalog, you can reuse its information in multiple processing engines beyond Autonomous Database.
Some of you might say that Autonomous Database had integration with OCI Data Catalog before. That is true and has been available for a while without proper web-based support. That's the brand-new component we just added.
In this blog, I assume you have a Data Catalog and have harvested some objects already. If not, you can get quickly up-to-speed with this Live Lab, which helps with step-by-step guidance on how to do so.
The screenshot below gives you an idea of how it will look like.
Oracle Data Studio now has intuitive web-based support to integrate your Data Catalog with your Autonomous Database as part of the "Data Loading" workflow, the place to load or access data that resides outside your Autonomous Database:
You start with the registration of your catalog:
It's a relatively simple process. You only need to provide or select the credentials to access your data catalog and the region. Data Studio automatically discovers available catalogs and suggests picking one:
After establishing the connection to the data catalog, you see all your Object Store harvested and managed in the data catalog. Pick and choose the data assets you are interested in Data Studio will do the rest:
The next step is no different than using manually created Object Store locations. Choose to load data or to link objects in your Cloud Store with drag-and-drop:
The data loading process with Data Studio is well explained in this blog post, so I will not overcommunicate here.
In this blog post, you may learn that there are reasons why users may want to hire OCI Data Catalog. If this is the case, the next step is to bring this metadata into ADW. Although integration was there for a while, it required coding.
The new Data Studio functionality, explained in this blog post, allows performing such integration without any line of code.
My role involves overseeing the product management of Data Lake features for the Oracle Autonomous Database.