Do you want to analyze your data in the Oracle NoSQL database and come up with patterns? Do you want to increase the performance of your queries by understanding the bottlenecks? Do you want to identify the trends in your data? Read on to understand how you can easily analyze your data in Oracle NoSQL Database using Oracle Analytics in no time.

Modern application developers have many choices when deciding when and how to persist a piece of data. In recent years, NoSQL databases have become increasingly popular and are now seen as one of the necessary tools every application developer must have at their disposal. Many of the recent applications have been designed to personalize the user experience to the individual, ingest huge volumes of machine-generated data, deliver blazingly fast, crisp user interface experiences, and deliver these experiences to large populations of concurrent users. In addition, these applications must always be operational, with zero downtime, and with zero tolerance for failure. The approach taken by Oracle NoSQL Database is to offer extreme availability and exceptionally predictable, single-digit millisecond response times to queries at scale.

analytics_integrator

 

 

 

 

 

 

 

 

 

 

 

 

 

There is a real-time need to analyze the data stored in the Oracle NoSQL database. Take for example an airline application. Many airlines provide real-time baggage tracking for their customers. The customer is always interested in getting close to a real-time feed of where their bag is at as it moves along its journey. This airline application handles volumes of data and should have the following features:

  • Predictable low latency
  • Scalable to your user base
  • Highly available

Some common data analyses that would be useful in this airline application are :

  • Where exactly is a passenger’s baggage now? How long will it take to arrive?
  • How many passengers’ baggage goes through more than 2 hops?
  • What are the top three sources and destinations that are in demand within all routes?
  • What percentage of baggage arrive on time?

This is where an analytic tool like Oracle Analytics Cloud comes into the picture. Oracle Analytics Cloud empowers business users, data engineers, and data scientists to access and process relevant data, evaluate predictions, and make quick, accurate decisions.

Would it not be cool to have the data stored in Oracle NoSQL Database Service (NDCS) available in Oracle Analytics for analysis? Welcome to Oracle NoSQL Database Analytics Integrator.

Oracle NoSQL Database Analytics Integrator copies data stored in a NoSQL Database Cloud Service table to a table created in the Oracle Autonomous Data Warehouse Cloud Service. After storing data in Oracle Autonomous Data Warehouse, you may want to analyze that data using an analytic tool like Oracle Analytics Cloud or Oracle Analytics Server.

Simple steps to get started with Oracle NoSQL Database Utility for Analytics:

Using the Oracle NoSQL Database Utility for Analytics:

Installation : You can download the Oracle NoSQL Database Analytics Integrator from Oracle Technology Network. You can install it in the desired compute environment; which can be an Oracle Cloud Compute Instance. For example, suppose you download the zip file for version 1.0.0 to the ~/Downloads directory of your local environment, then you would do the following:

scp ~/Downloads/nosqlanalytics-1.0.0.zip opc@<public-ip-address>:/home/opc

ssh opc@<public-ip-address>

unzip nosqlanalytics-1.0.0.zip

This installs the utility under the home directory for the user named opc on the compute instance; that is, /home/opc/nosqlanalytics-1.0.0.

Note: You can also install on your own local environment, outside of the Oracle Cloud.

Configuration:

  • Before you can execute the Oracle NoSQL Database Analytics Integrator, you must first create a configuration file. This configuration file will be used when invoking the utility.
  • The configuration is divided into three sections – nosqlstore, objectstore, and database – whose entries are used to specify how the utility interacts with each respective cloud service: the Oracle NoSQL Database, Oracle ObjectStorage, and Oracle Autonomous Data Warehouse.
  • The configuration file has the entries in JSON format as shown below.

        Example: You execute the utility from an Oracle Cloud Compute Instance and you wish to authenticate using an Instance Principal.  So the parameter useInstancePrincipal is set to true.      

{

    “nosqlstore”: {

        “type” : “nosqldb_cloud”,

        “endpoint” : “us-ashburn-1”,

        “useInstancePrincipal” : true,

        “compartment” : <ocid.of.compartment.containing.nosql.tables>,

        “table” : <tableName1,tableName2,tableName3>,

        “readUnitsPercent” : “90,90,90”,

        “requestTimeoutMs” : “5000”

    },

    “objectstore” : {

        “type” : “object_storage_oci”,

        “endpoint” : “us-ashburn-1”,

        “useInstancePrincipal” : true,

        “compartment” : <ocid.of.compartment.containing.bucket>,

        “bucket” : <bucket-name-objectstorage>,

        “compression” : “snappy”

    },

    “database”: {

        “type” : “database_cloud”,

        “endpoint” : “us-ashburn-1”,

        “credentials” : “/home/opc/.oci/config”,

        “credentialsProfile” : <profile-for-adw-auth>,

        “databaseName” : <database-name>,

        “databaseUser” : “ADMIN”,

        “databaseWallet” : <path-where-wallet-unzipped>

    }

Execution: The Oracle NoSQL Database Analytics Integrator can be run by simply typing a command on the command line.

java -Djava.util.logging.config.file=./src/main/resources/logging/java-util-logging.properties

-Dlog4j.configurationFile=file:./src/main/resources/logging/log4j-analytics.properties

-jar ./lib/nosqlanalytics-1.0.0.jar -config ~/.oci/<config-file-name>.json

Verify data in ADW: After executing the Oracle NoSQL Database Analytics Integrator, connect to your ADW database and query the data.

Analyze your data using Oracle Analytics: You can connect Oracle Analytics to the ADW database and verify that Oracle Analytics can access and analyze the data in the newly created table. Oracle Analytics Desktop is a tool for quick exploration of sample data from multiple sources or for analysis and investigation of your own local datasets. You can invoke the graphical user interface to create a connection to the database in Autonomous Data Warehouse and access the database in Autonomous Data Warehouse. Your data is now ready to be analyzed using all of the facilities provided by Oracle Analytics.

Using this utility you can have your data in Oracle NoSQL Database Service be ready for analysis using Oracle analytics in no time.