X

Oracle Management Cloud Blog covers the latest releases, customer stories, how-to guides and more.

Recent Posts

Oracle Management Cloud Release 1.50 Is Now Available!

Release Highlights We are pleased to announce the availability of Oracle Management Cloud Release 1.50!  As always, OMC updates will be applied automatically to your environment, with no action required on your part.   The following are key updates in this release: IT Analytics: Expanded support for Exadata Cloud Service and Cloud @ Customer environments Exadata Analytics now offers a unified view of your inventory, capacity and performance data for all Exadata systems, on-premises Exadata as well as ExaCS and ExaCC. You can now analyze your Exadata storage systems and perform in-depth resource analysis, capacity planning and forecasting for your ExaCS and ExaCC systems. Figure 1: ITA Exadata Analytics Unified View of Various Exadata Systems For more details, see What's New in Oracle IT Analytics.   Log Analytics: Enhancements to machine learning and visualizations New features in Log Analytics include enhancements to defining Lookups, ability to link visualizations sections in dashboards and creating multiple analyze charts in link.  Link Table and Analyze charts can now display problem priorities. Figure 2: Analyze Chart Showing Problem Priorities For more details, see What's New in Oracle Log Analytics.   Infrastructure Monitoring: Metric and metric management enhancements New SQL Server Performance metrics are now available as well as enhanced management of custom metrics from the OMC user interface. For more details, see What’s New in Oracle Infrastructure Monitoring.   Data Explorer and Dashboards: Enhanced widgets There are new visualization and time-based display enhancements in the Card, Line and Area widgets, which are usable in any dashboard. For more details, see What's New in Data Explorer and Dashboards.   Enjoy the new features in OMC 1.50!   Additional Resources: Explore Oracle Cloud Management Solutions Oracle Management Cloud Technical Resources Take Action! New to Oracle Management Cloud? Take advantage of our 30-day free offer to get started. Attend an Oracle University course or get your Oracle Management Cloud Certificate.

Release Highlights We are pleased to announce the availability of Oracle Management Cloud Release 1.50!  As always, OMC updates will be applied automatically to your environment, with no action...

Security Insights for your web apps with OMC Log Analytics

1. Introduction Oracle Cloud Infrastructure (OCI) Web Application Firewall (WAF) is an Oracle Cloud Service that protects your web applications against threats. Logs are available within the WAF Service. In this blog, we’re going to leverage those logs in order to build a comprehensive dashboard with Oracle Management Cloud (OMC) and get insights on what’s happening in the Web Application from a security perspective. The final result of this blog will be the dashboard shown below, including tabs for Activity Overview, Top 10 OWASP Threats, and detected events from several sources.  An exported version of this dashboard will be available at the end of this blog for you to import into your own OMC environment.   In this article, we will see how to forward WAF Logs to an OCI Object Storage Bucket, configure an OCI Event Service to trigger an OCI Serverless Function, utilize REST APIs to generate OAuth tokens to upload the logs into OMC Log Analytics, and finally import the above mentioned dashboard.. As a prerequisite, you should be familiar with OMC, IDCS, OCI and rest APIs. You will need an Oracle cloud account already provisioned with a specific compartment. If you don't already have an account, you can sign up for Oracle Cloud's Free Tier. Let’s proceed with my component called omcwaf_compartment, a WAF policy configured in that compartment, an OMC tenant, an OCI Object Storage created in the compartment and an IDCS account. You will need to make sure that you have admin access to all the accounts. Before starting, let’s prepare all the needed details from OCI, OMC, IDCS, WAF policy and OCI Object Storage.  You may find it useful to put the collected details along with their step number into a text editor for easy reference in later steps. All the needed resources to complete this integration are available for download. 2. COLLECT INFORMATION 2.1 From OCI 2.1.1. Go to Administration > Tenancy details and copy the tenancy OCID  2.1.2.  In Administration > Tenancy, pick the Region Name. Go to Administration > Region Management save the corresponding Region Identifier 2.1.3. In Administration > Identity > Users, create a new user for the integration between the WAF Log and the OCI Bucket. Add the API Public Key and copy the Fingerprint.  2.1.4. Copy the OCID 2.1.5. Click on Customer Secret Keys, and generate a new secret key. Save the secret key in a safe place 2.1.6. Copy the Access Key 2.1.7. In Administration > Identity > Groups, create a new group and add the user previously created on this group. Copy the group OCID 2.1.8. Copy the group name.   2.2 From OMC 2.2.1. Go to Administration > Agents, click on the navigation button on the right then select Download Agents.  Select  Gateway as the Agent Type, then copy TENANT_NAME from the bottom of the page 2.2.2. Copy the OMC URL from the browser URL bar ending with oraclecloud.com  2.3. From IDCS From OCI, Go to Identity > Federation , click on OracleIdentityCloudService. Copy the IDCS Console URL.  If you are not federating IDCS identity for OCI, you can obtain your IDCS Console URL when you log out of OMC.  It should have the format of https://idcs-<guid>.identity.oraclecloud.com 2.4. From IDCS 2.4.1. Go to Security > WAF Policies the click on the policy already created. Copy the Policy OCID. 2.4.2. Copy the CNAME Target  2.4.3. Copy the domain name of the target application  2.5. From Object Storage 2.5.1. Go to Object Storage and click on the Bucket you already created.  Copy the OCID 2.5.2. Copy the Bucket name 2.5.3. Copy the namespace 2.5.4. Click on the compartment and copy the compartment OCID 2.5.5. Copy the compartment name   3. FORWARD WAF LOG TO OCI BUCKET In order to forward WAF Logs to your OCI Bucket your created previously, you should create an SR with Oracle Support.  3.1. Set IAM Policy The user created in step 2.1.3 must have write permission on the bucket.  To do so, we need to grant privileges on the group that contain this user. 3.1.1. Go to Administration > Identity > Policy and create the below policy statement:  allow group <group_name_step_2.1.8> to manage object-family in compartment <compartment_name_step_2.5.5> 3.1.2. Copy the policy OCID 3.2. Raise a SR with Oracle Support Once the policy is set, raise an SR on your Oracle WAF Portal support and provide the following information: •    Domain name of the application (step 2.4.3), and additional domain name if applicable.  •    Access Key (step 2.1.6)  •    Secret Key (step 2.1.5) •    WAF Policy OCID (step 2.4.1) •    Bucket Name (step 2.5.2) •    Bucket OCID (step 2.5.1) •    Namespace (step 2.5.3) •    Tenancy OCID (step 2.1.1) •    Compartment OCID (step 2.5.4) •    Policy OCID (step: 3.1.2) •    Region identifier (step 2.1.2) •    Bucket Region. •    Upload Prefix: "%{+YYYY}/%{+MM}/%{+dd}/%{[log_type]}" The implementation should take a few days before seeing the logs on your OCI Bucket. Once completed, you should see logs arriving from WAF to your OCI Bucket: 4. SET UP OAUTH FOR OMC Here, we are going to create a client application, that uses a token to connect into OMC. This saves you from providing your username and password to authenticate the function. By granting the OMC Admin role to the client application, the application will be able to upload logs to OMC LA. 4.1. Obtain OMC Access Token Connect to IDCS and search to OMCEXTERNAL_<your_OMC_tenant> application and click on it. Click on generate access token, a generate Token popup should open. Select Customized Scope and Invoke IDCS APIs Download the token. This token will be used in the next steps.   4.2. Create an application for OAuth 4.2.1. Create a JSON file named newClientApp.json with the following content. The name, displayName field can be customized, but note that the name must end with _APPID Replace <OMC_URL> by the one in step 2.2.2. {   "name": "APPOMC_SERVICEAPI_APPID",   "displayName": "APPOMC_SERVICEAPI",   "description": "Test client for serviceapi",   "isAliasApp": false,   "active": true,   "isOAuthClient": true,   "clientType": "confidential",   "allowedGrants": [     "client_credentials"   ],   "allowedScopes": [     {       "fqs": "https://<OMC_URL>/serviceapi/"     }   ],   "isOAuthResource": true,   "accessTokenExpiry": 86400,   "audience": "https://<OMC_URL>",   "scopes": [     {       "value": "/serviceapi/"     }   ],   "basedOnTemplate": {     "value": "OPCAppTemplateId"   },   "serviceTypeVersion": "1.0",   "serviceTypeURN": "OMCEXTERNAL",   "schemas": [     "urn:ietf:params:scim:schemas:oracle:idcs:App"   ] } 4.2.2. Run the following command to create the application: Curl -X POST https://<IDCS_DOMAIN>/admin/v1/Apps -H ‘Content-Type: application/json’ -H “Authorization: Bearer <OAuth_Access_Token>” -d “@newClientApp.json” <OAuth Access Token> is the format token value below you saved in the file of the Step 4.1: {"app_access_token":"<OAuth Access Token>”} Replace <IDCS DOMAIN> by the domain got on the step: 2.3. Domain should be like: https://idcs-xxxxxxxxxxxxxxxxxxx.identity.oraclecloud.com From the response, save the <client secret>, the <id> and the <name>, we will use them later. 4.3. Grant OMC Admin Role to Client App On IDCS, click on Application, then your OMCEXTERNAL_<your_OMC_instance> instance Click on Application Roles and assign the Application previously created to OMC Administrator 5. SET UP FUNCTION ENVIRONMENT 5.1. Prerequisites Group and user we are going to use can be the same as the one created in step 2.1.3 5.1.1. Create a VCN and a subnet on your compartment. The VCN must egress via either NAT Gateway, Internet Gateway of Service 5.1.2. Create a policy in the root compartment with the following statements: Allow service FAAS to use virtual-network-family in tenancy Allow service FaaS to read repos in tenancy 5.1.3. As the user created in step 2.1.3 is not a tenancy administrator, so add the following statement: Allow group <group-name> to manage repos in tenancy Allow group <group-name> to read metrics in tenancy Allow group <group-name> to read objectstorage-namespaces in tenancy Allow group <group-name> to use virtual-network-family in tenancy Allow group <group-name> to manage functions-family in tenancy Allow group <group-name> to use cloud-shell in tenancy Replace the <group-name> by the one on step 2.1.8 Note: If necessary, you can restrict these policy statements by compartment 5.2. Create a function 5.2.1. On OCI Console, go to Developer Services and click on Functions 5.2.2. Select your compartment, then click on “Create Application”, let’s name it load-waf-logs-app. Select the VCN and the subnet previously created on the prerequisite part then click on save. 5.2.3. Once the Application is created, click on it and follow the Getting Started steps on the left side of the page using the Cloud Shell Setup: 1.    Launch Cloud Shell 2.    Set up fn CLI on Cloud Shell  3.    Update the context with the function’s compartment 4.    Update the context with the location of the Registry you want to use.  5.    Already generated in obtain OAuth OMC token 6.    Log to the registry. Note: use the user created previously, and the OAuth token.  7.    Verify your setup Stop the Getting Started steps here, and continue with the following instruction: 5.2.4. Create a loadlogs python function by entering:  fn init --runtime python loadlogs        A directory called loadlogs is created with 3 files: func.py, func.yaml, requirements.txt  5.2.5. Edit the file requirements.txt to contain these three lines: fdk requests oci 5.2.6. Edit the file func.py and replace it with the ODU python code available on the resources. 5.2.7. Deploy the function by running: fn -v deploy --app load-waf-logs-app 5.3. Create function parameters Click on the application load-waf-logs-app, click on Configuration on the left menu then add the following parameters: •    apiuser: is the application name chosen in the step 4.2 ending in _APPID •    apipwd: is the Application client secret saved at the end of the step 4.2  •    idcsurl: is the IDCS domain URL used at the end of the step 4.2  •    input_bucket: is the bucket name from the step 2.5.2 •    logSourceName: must by WAF_LOGS since it’s the logSourceName used on the exported resources of this blog •    omcurl: is the OMC URL from the browser URL bar in step 2.2.2 •    uploadName: use it to help isolate initial test uploads within Log Analytics but leave the parameter with an empty value or remove it when going to production Note: idcsurl and omcurl values should NOT include a trailing "/"   5.4. Create a Dynamic group for the Function In order to use other OCI Services, the function must be part of a dynamic group. To do so, from OCI console, go to Identity > Dynamic Group and create a new dynamic group fn_oci for example. On the matching rules, add the following statement by using the correct compartment OCID from step 2.5.4: ALL {resource.type = 'fnfunc', resource.compartment.id = 'ocid1.compartment.oc1..aaaaaxxxxx'} 6. SET UP EVENT RULE 6.1.  Bucket Storage configuration 6.1.1. Go to your Object Storage bucket where WAF Logs are stored, and enable Emit Object Events options: 6.2. Create IAM Policy The dynamic group previously created need to manage objects within your tenancy  To do so, go to identity > Policies and add the following statement: allow dynamic-group <name_choosen_in_step_5.4> to manage objects in tenancy Note: If necessary, you can restrict these policy statements by compartment. 6.3. Create an event rule From your OCI console menu, go to Application Integration then Events Service. Created a new rule as following: Event Matching: Event types Service Name: Object Storage Event Type: Object – Create Attributes: bucketName: bucket name from the step 2.5.2   Actions: -    Function application need to be called.    7. CONFIGURE OMC  7.1. Import Log Parsers   Download the Log Parsers export from the resources. Each Parser is a .zip file which contains the content.xml From OMC menu, go to Log Analytics then click on Administration home.  Click on the gear icon on the top right corner then click on import configuration content. Select your parsers. 7.2. Import Log sources  Download the Log Source export from the resources. and select the .zip file which contains the content.xml  From OMC menu, go to Log Analytics then click on Administration home.  Click on the gear icon on the top right corner then click on import configuration content. Select the .zip file. 7.3. Import dashboard Download the Dashboard json export from the resources. Launch the following curl command to import the dashboard into your OMC instance: curl -X PUT https://xxxx.omc.ocp.oraclecloud.com//serviceapi/dashboards.service/import -H 'cache-control: no-cache' -H 'Content-type: application/json' -u 'omc_username' --data @/path/to/exported/dashboard.json -o /tmp/import_output Use your OMC credentials. 8. RESOURCES Python function Log Source Parser 1  Parser 2 WAF Dashboard   9. FINAL RESULT The configuration is now completed. New log files arriving on the Object Storage Bucket will be uploaded to OMC under WAF_LOGS log source and start populating   OCI WAF dashboard as below:  A Global Overview summarizing the global access requests Map, by Country, by URL, by Application by Code Error, by Code Error by Time. it gives also insight on Security Rules triggered, by IP Address and by Time.    A second tab giving more insights on the OWASP Top 10 threats:  A third tab with details on all Threat Intelligence Feeds detection Another tab giving all details about detections based on Access Rules   Finally, a tab with details on all threats detected and blocked by the Javascript Challenge feature I hope you found this blog helpful. Here are a couple of next steps to help you get started:  If you don't have an Oracle Cloud Infrastructure account, try our Free Tier. To try the dashboard, download the json export from the resources.

1. Introduction Oracle Cloud Infrastructure (OCI) Web Application Firewall (WAF) is an Oracle Cloud Service that protects your web applications against threats. Logs are available within the...

Running Your Organization on Oracle E-Business Suite? What You Need to Know

(This blog post was written by our guest author Luca Martelli, our Sr. Director of Security and Systems Management in the EMEA region.) Having your applications and critical systems available continuously to remote employees, partners and customers is a fundamental requirement in today's business climate. Preventing a slowdown of these services is not an option and any change in the IT environment could have business critical consequences. If a problem does occur, being able to troubleshoot quickly is vital for any organization running their business and operations on Oracle E-Business Suite. Whether it’s core processes such as; Customer Relationship Management, ERP, Supply Chain Management, Financial, or Human Capital. Any possible disruption, or even a slowdown in performance can lead to a poor user experience or even worse—a lack of productivity for thousands of employees around the world. To properly maintain and debug a multifaceted application like Oracle E-Business Suite, requires a variety of telemetry and specialized knowledge. Luckily with Oracle Management Cloud, we have packaged up all of the necessary components for monitoring and managing Oracle E-Business Suite for customers. Delivering Better Visibility into Oracle E-Business Suite for IT Staff Oracle Management Cloud is a cloud-based system management solution that includes Log Management, Application Performance Monitoring, Infrastructure Monitoring, Capacity Planner and IT Analytics services. The solution offers customers integrated monitoring that takes advantage of machine learning capabilities to provide better insight and an end-to-end user experience.  The solution ingests a vast array of log and system data and analyzes it to predict potential performance issues. Oracle Management Cloud helps you prevent problems before they impact your users and the business. Proactively optimize Oracle E-Business Suite resources, enhance performance and minimize downtime with Oracle Management Cloud Oracle Management Cloud key solution capabilities include: Automatic one-click discovery of the entire Oracle E-Business Suite environment including: Application Tier, Database Tier, Concurrent Manager Service, Workflow Engine and Forms System Instant insight with pre-configured reports and dashboards: Fleet View, Infrastructure Health, Concurrent Processing, Forms System, Workflow Health, End User Experience Machine Learning against Oracle E-Business Suite telemetry: Out-of-box collection of enriched log messages with error classification. Anomaly detection, base-lining, clustering, and forecasting End-user monitoring for HTML and Forms UI: Real user experience (response times, errors) by individual sessions. Synthetic transactions for proactive testing   Additional Use Cases for Oracle Management Cloud: It supports a big variety of Clouds (AWS, Azure, Oracle Cloud), and on-premise hardware appliances, network devices, operative systems, virtualization layers, application servers, databases, applications offering out-of-the-box dashboard, alerts, anomaly detection rules and resources-demand forecasting, with the support of dedicated machine learning algorithms. It’s recognized as “the most open of all the vendors” with on-premises and multi-cloud support, and having a very attractive pricing model. Achieving Operational Insights with Zero-Effort   Additional Resources: We have a wide selection of resources that you can take advantage of to help you better understand the value Oracle Management Cloud brings to Oracle E-Business Suite customers. Here are a few I thought you would be of interested in: Demo: Oracle Management Cloud for Oracle E-Business Suite: (6 minutes) This short demo by Carlos Estero will show you how Oracle Management Cloud comes with pre-built dashboards to monitor your entire E-Business Suite stack, from end-user experience all the way to the SQL analytics and the infrastructure monitoring. Let the machine working in OMC do the work for you. Customer Success Story: Pioneer Natural Resources: (1 Minute) Performance Optimization of Enterprise ERP Applications 25% reduction in troubleshooting time 100% reduction in end user complaints in 2months and half 50% decrease in application server related incidents Webcast: Automate Management of Oracle E-Business Suite with Oracle Management Cloud (40 minutes) Learn how OMC can help you optimize operations for your EBS environment Blog: Oracle Management Cloud for Oracle E-Business Suite   Check out the documentation and how to guides: https://docs.oracle.com/en/cloud/paas/management-cloud/ebsms/oracle-management-cloud-oracle-e-business-suite.html   And of finally, I am available one-on-one conversations anytime. You can contact me via LinkedIn @ Luca Martelli https://www.linkedin.com/in/lucamartelli/      

(This blog post was written by our guest author Luca Martelli, our Sr. Director of Security and Systems Management in the EMEA region.) Having your applications and critical systems available...

Oracle Management Cloud to Monitor Oracle Integration

Uday Vallamsetty, Oracle Management Cloud Simone Geib, Oracle Integration Tyler Mast, Oracle Sales     In this blog post, we will talk about an Oracle Management Cloud (OMC) based solution that helps customers monitor applications and track transactions across on-premises, SaaS and public cloud. Customers who use Oracle Integration to connect their SaaS applications with applications on-premises and public cloud can now use the OMC-OIC integration to monitor end-end transactions across SaaS, on-premises and public-clouds. In such complex application environments, it becomes prohibitive to track and monitor applications and transactions in a single pane of glass. Like all good solutions, this one was also borne out of requests from customers who own both the services (OMC, OIC) and wanted us to build tighter integration to simplify their deployment and monitoring challenges. Oracle Management Cloud Hybrid cloud deployments are a reality today; almost all of our customers use some SaaS applications connected to applications either on-premises or in a public cloud or both. Oracle Management Cloud (OMC) is an integrated suite of IT operations monitoring and management services. This is a lightweight cloud-based service where customers can monitor their entire IT landscape without any infrastructure or maintenance costs. The umbrella of services offered under Oracle Management Cloud are:   Application Performance Monitoring: Provides deep insight into applications, from an end-user as well as from the backend server Log Analytics: Aggregate and index all the log data across the application and infrastructure. Deep Oracle knowledge is used to annotate the logs to allow rapid troubleshooting IT Analytics: Allows users to analyze the performance and utilization of their IT landscape, everything from SQL Analysis to Host resource consumption   Infrastructure Monitoring: Real time monitoring of your applications by collecting metrics and provide machine-learning based smart alerting     All of the services are built on a unified data platform, allowing them to leverage information across the services and simplify monitoring and root cause controls for the end user. The services are built on next generation machine learning technology, which absorbs all of the monitoring telemetry and converts it into actionable alerts and insights. This simplification of monitoring and remediation is at the heart of Oracle Management Cloud. Oracle Management Cloud for Oracle Integration Environments Oracle Cloud Infrastructure (OCI) provides a large range of services for our enterprise customers. One of the key services that is gaining a lot of traction is the “Oracle Integration”. This service helps our customers accelerate their Digital Transformation projects by providing simple, clean solutions to connect their applications across on-premises, public-cloud and SaaS based offerings. The Oracle Advantage Pre-integrated with applications: Oracle offers the only integrations built by Oracle’s app development experts. With our extensive library of best-in-class, third-party application adapters, you no longer need to waste time and resources on custom-developed integrations. Prebuilt integration flows: Take the guesswork out of integration. Oracle’s machine jumpstarts your integrations connecting customer experience (CX), human capital management (HCM), and ERP applications. Unified process, integration, application development, and API management: Reduce project delivery times with a common, visual design experience across process automation, application integration, application development, and API management. OMC-OIC Integration In order to simplify the deployment of the OMC solution for OIC customers, we created a purpose-built integration in OIC that will collect all of the metric and log data from ALL the OIC instances managed by a customer and push the data to Oracle Management Cloud.   Between the teams that produce the two services, we made sure that the APIs being used on either end are lightweight and can be sustained even in a large-scale environment. This solution is currently deployed at several of our customers in production. Oracle Management Cloud natively understands the OIC Taxonomy, so the telemetry can be mapped to existing entities available out of the box. Telemetry Extraction In complex hybrid environments, telemetry needs to be extracted from several sources in order to create a coherent picture of how transactions are flowing and where time is being spent for each individual transaction. In order to facilitate this complex orchestration, the OMC-OIC integrations provides several hooks for customers to attach to their on-premises or SaaS applications. OMC Agents: OMC provides agents that can be deployed in on-premises or public cloud instances. These agents can natively connect to and extract telemetry for a large range of applications and infrastructure. Along with telemetry the agents will also extract log data from the instances OIC APIs: OIC provides native APIs that can be used to extract rich telemetry about status of all the integrations and connections present in an OIC instance. The OMC_OIC Integration will discovery all of the instances using these APIs and then start monitoring them at pre-configured intervals. Depending on the number of integrations/connections, the telemetry extracted is shipped to the OMC Service OIC Audit Logging: OMC_OIC Integration will automatically extract all operational changes in the environment. Users can use the Audit dashboards to verify what changes were done by specific users, which users have stopped/started specific integrations etc. The Integration can be downloaded from the Oracle Management Cloud Customer Connect forum. and deployed into your Oracle Integration environment. We are working towards making this integration available as part of the OCI Marketplace Machine Learning Powered Analytics     In order to get value out of the box with OMC for Oracle Integration monitoring, there are a few included dashboards that will organize data coming in from the solution and provide a high-level overview of your Integration instances. For example, the dashboard above shows an inventory of Integrations, Connections, etc. and what state they’re all in if you click into the different links. The scope of data shown can be customized using the OIC Service Groups widget to create different logical groups of Integration instances. In the case that you might want to view only non-prod instances, a non-prod group can be created that includes Dev, Test, and other instances being monitored by OMC.     Like other entities that are supported by OMC, like a Linux host, the Infrastructure Monitoring service provides metric overview pages for Oracle Integration instances and machine learning is used to identify anomalous changes in different metrics.     This is a sample Dashboard set that takes advantage of many of the metrics made available by the Integration solution. Many of the same data points used in Oracle Integration’s out of the box monitoring dashboard are able to be replicated in OMC to aggregate data from all of your different OIC instances together and pair it with other parts of the IT estate (e.g. the applications used on-prem, databases being used to house transaction data). Being able correlate performance of both the endpoint systems and the Integrations connecting them is one of the main benefits and the main request from OMC and Oracle Integration customers.     One of the highlights of importing Oracle Integration monitoring data into OMC is the ability to track performance over a long period of time and across different Oracle Integration instances. Being able to view the difference in duration for an execution of the same integration across different environments can greatly simplify troubleshooting potential issues. This also applies to potential integration errors. Instead of having to go to Oracle Integration and looking for the error, each individual error message is pulled in so that they can be in the same place as endpoint logs. Alerts can be created for both performance issues and errors so that steps can be taken to remediate issues before they affect customer-facing systems.     Finally, the primary security benefit from the solution is the ability to view audit activity from all users in each environment and alert on suspicious or unwanted activity. For integrations that are critical to your business, knowing when those integrations are deactivated (whether intentionally or not) is a high priority issue. Using the audit logs, alerts can be configured to tell when users deactivate/delete specific integrations and reduce the amount of time it would normally take to discover the issue. If there is a requirement to monitor any privileged admin account in Integration instances, all activity from those accounts can be called out as well. Conclusion In this blog post, we demonstrated a solution for monitoring application deployed in a hybrid cloud environment. Customers using Oracle Integration can leverage this solution to monitor transactions that cross on-premises, public cloud and SaaS platforms. Customers can audit changes to their environment through audit monitoring. Operations teams can leverage log-analytics capabilities to reduce their mean time to recovery in case of failures. This solution is easy to deploy through a native integration and will be available in the OCI marketplace in short order.  

Uday Vallamsetty, Oracle Management Cloud Simone Geib, Oracle Integration Tyler Mast, Oracle Sales     In this blog post, we will talk about an Oracle Management Cloud (OMC) based solution that helps...

Oracle Log Analytics: Introduction to Link - Part 1

Oracle Management Cloud (OMC) Log Analytics (LA) helps you analyze log data at scale. LA has several features that allow you to slice and dice the data, and find insights using machine learning. In this article, I want to explain one of those features, called Link. What is Link? Link is a powerful analytical feature in LA. Link allows you to stitch together millions of related log events in real time. Stitching events together allows for deeper analysis to find answers to complex questions, like the ones below: "What are the events in a flow and how long do they take ?" (Transaction or Flow Analysis) "Which events happened before an outage ?" (Time Series Sequencing) "Among the millions of E-business Suite (EBS) Jobs that I have run, which are the anomalous Jobs ?" (Job System Analysis) "Among thousands of hosts, which ones should I pay attention to because of a high number of error events ?" (Outlier Detection) Example: Understanding Application Usage and Customer Uploads Let us use a real world example to demonstrate Link. Let us say we have a web-based application hosted using an Apache Tomcat server. The Tomcat server is setup on a set of Cloud VMs. The application serves multiple pages. We are concerned about understanding the usage of the application. We do not know which parts of the application are used the most, which parts cause high data volumes, or what time of day the access spikes. We do not have access to the underlying network data, and we don't capture metrics into a database or print to a log file. We don't know where to start, but we know which questions we want answered: Which part of my application is being accessed the most ? Is my application allowing data uploads ? If so, which part of the application does that, and what is the typical size of uploads ? To answer these questions, we want to look at the data transfer patterns of various application resources (known as Uniform Resource Identifiers, or URIs). Apache Tomcat Access Logs captures each request to the web server. The log files contain the URI, Client IP, Duration and the Bytes transferred, among other information. Oracle Log Analytics provides an out-of-the-box Log Source to capture these details - so as a Log Analytics user, you do not need to know how to read the information contained in these files. Log Analytics also has some sample logs available so you can practice using the techniques.  We will start by enabling the sample log data, and then we will run some analysis against that data. Enabling Sample Data Available with Log Analytics Log Analytics ships with sample logs. These logs can be used to demonstrate analytics use cases. You need to enable Sample Data for your tenant before you can use it. Enable Sample Data using the Log Admin->Sample Data Menu     Figure 1. Use the Log Admin menu to enable Sample logs included with your tenancy Once enabled, you can see the list of sample Saved Searches. Select the LASample:Logs by Source Name Saved Search.                   Figure 2. Select a Saved Search to view the available Log Sources You can now see the Log Explorer UI, showing the available Log Sources. Notice the demomode | in the Query area. This indicates you are working with the demo logs.   Select Apache Tomcat Access Logs to view the records       Figure 3. View Available Log Sources and Select Apache Tomcat Access Logs Now that we have the Apache Tomcat Access Logs selected, let us go about answering our questions using the Link functionality. Default Link UI Select Link under Analysis to switch to the Link view. Remember that what Link is doing is stitching together all related log entries (there may be millions of entries) by criteria that you choose. Link by default links by the Log Source field (a grouping based on type of the logs).  For this analysis, we instead want to link by something that can identify the access patterns - which in this case is the URI field. Figure 4. Choose Link Analysis from the Visualization Panel Linking by URI The Fields panel on the left shows the available fields. Use the Add to Link By option for the URI field. Then remove the existing Log Source field from Link By, since we only want to link by a single field now. Figure 5. Choose the URI field for Linking Link Table View In its simplest form, Link is similar to a group by. So linking by URI shows you a table of distinct URIs in the logs for the selected time. Figure 6. Link Table Description Link also enriches the table with the below automatically derived fields for each row: Auto Populated Field Description  Start Time  Timestamp for the first log record  End Time  Timestamp for the last log record  Group Duration  Difference between Start Time and End Time. Hidden by default  Count  Number of log records The timestamps use the same time zone as the browser used to view the Log Analytics UI (that is your browser, as an LA user) Link analyzed over 6,800 Apache Tomcat Access Logs in less than a second, and extracted the unique URIs. In addition, we can see the following information: There are 114 unique URIs in the system for the selected duration There are more number of accesses to /swstoreweb/service/cart than any other URI. This URI had 1083 hits, compared to 493 for the orderservice below. We now have answer to one of our questions: Which part of my application is accessed the most ? Assuming URIs map to different parts of the application, the cart service is the most accessed part of our application. We can also see which are the top areas being accessed, as Link shows the top URIs by count. All it took was linking by the URI field. Let us now try to answer our second question: Is any data being uploaded to the system ? For this, we will start by building a property against each URI. Building Properties for the Group Link creates one row for each unique value of the input field, referred to as a Group. The group is a unique combination of the Link By fields. Since we have only the URI field in Link By, number of groups in the table is same as the number of unique URIs. You would typically want to build properties for a group so that you can compare between groups. To answer our question on uploaded data, we will pick the field that records the upload information for each request, and compute an average property. Creating Average Uploaded Bytes Property Content Size In is a field that records the number of bytes uploaded for each request. By using the average stats function, we can get an idea of how many bytes are uploaded for each URI. Choose the Add to Display Fields for the Content Size In field. Since this is a numeric field, the avg() function is automatically selected. Figure 7. Compute Average for the Content Size In field You can choose from several statistical functions, such as Average, Count and Distinct Count. A function is applied to a field to produce a new field. These fields are called derived fields or properties, and can be used for further analysis. Some functions require a numeric field as input. The functions not applicable to this field are greyed out. We now have a new column in the table. The value for each URI is the average computed from the log records shown under the Count column. Figure 8. Link Table with a column for Average of Content Size In field For improved readability, it is useful to rename the column. Edit the query such that it reads like this: demomode | 'Log Source' = 'Apache Tomcat Access Logs' | link URI | stats avg('Content Size In') as 'Average Uploaded Bytes' The column now shows Average Uploaded Bytes as the name for the computed property. We are very close to getting an answer to our second question. A cursory look at the table shows: Not all URIs upload data, as the Average Uploaded Bytes column has no value for several URIs. The average size is varying. We can see values as low as 11 and as high as 5,497. How do we further analyze the Average Uploaded Bytes, without having to manually look at each value ? Analyzing Average Uploaded Bytes There are 114 URIs in the table. The Average Uploaded Bytes property has no value for some URIs, and has varying values for others. Analyze is a clustering (machine learning) feature of Link. Analyze takes one or more fields, uses various machine learning algorithms to cluster the values by recognizing patterns, and in the process also finds anomalies. Use the Analyze UI to create a chart of clustered results for the Average Uploaded Bytes field. Figure 9. Input Configuration for Analyzing the Fields Analyze needs at least one field for analysis. All the other inputs, including the Chart Title are optional. You can keep the Y-axis empty for now. You should now see the Analyze Chart for Average Uploaded Bytes. Figure 10. Analyze Chart for Average Uploaded Bytes The values of the Average Uploaded Bytes are clustered and shown in the chart. Looking at the chart, we can identify several patterns: The size of the bubble represents the number of rows in the table. Only seven URIs have a value for Average Uploaded Bytes. The largest bubble has 71% of these URIs, and it shows those URIs received anywhere from 11 bytes to 347 bytes The other two bubbles share two important characteristics: They are farther from the largest bubble, which indicates their Upload size is much higher than the common behavior for other URIs They have an anomalous value above what is normal for most other URIs. The majority of the URIs received only up to 347 bytes, but a few, such as these have upload values over 3K - almost 10x as large. You can drill down to the anomalies to filter the table. Figure 11. Drill down to Anomalies in the Analyze Chart The table now shows the two URIs that were receiving large amount of uploaded data. You can click on the Count values to drill down into those log records for further investigation into why these URIs are receiving so much more data than rest of the URIs receive. This information is important to understand our second question: Is my application allowing data uploads ? If so, which part of the application does that, and what is the typical size of uploads ? We now know our application does allow uploading of data, but only through seven URIs. We also know 11 to 347 bytes is the normal upload size for majority of those URIs. Finally, we identified the two specific areas that receive extremely large amount of uploads compared to the rest. If we are concerned about these large uploads, we can use Log Analytics to further investigate the users or client hosts that generate this traffic. Summary Link allowed us to instantly analyze the URIs, compute the average upload size and very quickly identify the anomalous URIs by upload size. We were able to find out that most URIs upload only a small amount of data, and the anomalous URIs uploaded several times more. We could then drill down and locate the specific log records. We did not need to know anything about the way the logs were structured, or how to read the data in the logs. Log Analytics took care of all of that for us. We simply clicked a few buttons to ask and answer our questions. The power of Link goes well beyond these examples. For instance, we have not yet asked if the high upload happened on a specific day, or from a specific Client IP. We can do so quickly - simply by linking by multiple fields, and analyzing by multiple fields. Check the next article in this series to find out more!

Oracle Management Cloud (OMC) Log Analytics (LA) helps you analyze log data at scale. LA has several features that allow you to slice and dice the data, and find insights using machine learning. In...

Oracle Management Cloud Release 1.49 Now Available!

Release Highlights We are pleased to announce the availability of Oracle Management Cloud Release 1.49!  As with all OMC updates, this update will be applied automatically to your environments. The following are key updates in this release: IT Analytics In the new version, OMC automatically collects SQL Text/Plan Data.  This enables you to see details on problematic SQL statements immediately in context, reducing diagnostics time and allowing you to focus your tuning efforts. For more details, see New Features in Oracle IT Analytics. Log Analytics The ability to change the title of the bubble chart improves the readability of the chart in Link visualization and you can change the title of the bubble chart. You can now use additional fields to control the size of the bubbles in the chart. The string fields can now be used to control the color of the bubbles of a chart. Use first( ), last( ), lead( ), lag( ), nthval( ) and rownum functions of eventstats command for sequential processing of the link table data.  You can now use a predefined query for EBS Concurrent Requests to perform analysis of logs. The addfields command is now enhanced to work with generated fields. For more details, see New Features in Oracle Log Analytics. Data Explorer and Dashboards The character limit in the Text/HTML widget in Dashboards is now 10,000 characters. For more details, see New Features in Data Explorer and Dashboards. Oracle Management Cloud for Oracle E-Business Suite Applications You can now generate an alert when your program exceeds a specific running time limit. Slow Running and Long Pending Requests metrics are now collected every 5 minutes. You can now use a predefined query for EBS Concurrent Requests to perform analysis of logs For more details, see New Features in Oracle Management Cloud for Oracle E-Business Suite Applications. Additional Resources: Explore Oracle Cloud Management Solutions Oracle Management Cloud Technical Resources Interested in seeing what other customers are doing with Management Cloud?  Here are some examples: JNE Resolves Logistical Challenges with Oracle Management Cloud Autostrade Maximises Performance with Oracle Management Cloud and Oracle Enterprise Manager Take Action! New to Oracle Management Cloud? Take advantage of our 30-day free offer to get started. Attend an Oracle University course or get your Oracle Management Cloud Certificate.

Release Highlights We are pleased to announce the availability of Oracle Management Cloud Release 1.49!  As with all OMC updates, this update will be applied automatically to your environments. The...

How to Ingest Oracle Cloud Infrastructure Audit Logs into Oracle Management Cloud

In my previous post, I mentioned that it is now possible to ingest and analyse logs from Oracle Cloud Infrastructure (OCI) Virtual Cloud Infrastructure (VCN) Flow Logs, OCI Audit Logs and other OCI logs stored in buckets, with the focus on Flow log ingestion. For this post, we will focus on Audit logs.  What are the Audit Logs? Audit logs record events to all supported public application programming interface (API) endpoints.  This gives insight and helps to understand what's happening in tenancies. By default, the Audit service is turned on for every tenant at no extra charge - this behaviour cannot be turned off.   The Tenant Administrator has full access to all audit logs in all Compartments. To allow other USERS to view Audit logs, you must set a POLICY using IAM. The Audit logs record information in JSON format, some of the fields included are: ·      ID of the Caller ·      Target Resource ·      Time the activity occurred ·      Request and Response parameters ·      Type of Action and Request Why use OMC to Analyse Audit Logs? Audit logs can be viewed in OCI from the OCI console by going to Governance menu then Audit. A search facility is provided to help drill down to the particular event, action or time that may be of interested, however, this can be a daunting task when there are many users and compartments in tenancies. Oracle Management Cloud Log Analytics (LA) Service can help view and analyse the audit logs. There are out-of-the-box parsers, which help analyse the fields in the logs. Below are some examples and ideas (there are many more!) of how OMC can help analyse audit logs: ·      Administrators can view User Activities. ·      Review usage and changes in Tenancies. ·      Troubleshoot problems by viewing Activities. ·      Figure out who created the Activity and from where. ·      Understand when the Event or Activity happened and the resulting Status. Below is a screenshot of an OMC Dashboard I have created: Ingesting Audit Logs into Oracle Management Cloud As mentioned earlier, Audit logs are turned on for every tenant automatically. These logs need to be exported into Object Storage Buckets for OMC to ingest. To do the export, a Service Request ticket will need to be submitted via My Oracle Support. The information required for the ticket is: Ticket name: Export Audit Logs - <your_company_name> Tenancy OCID Regions    The ticket will normally take 3-4 business days to complete - this is a one-time operation. Once completed, create a Credentials store in OMC for OCI Authentication as shown in the previous post. The next step is registering the Object Storage Audit logs buckets to Log Analytics. To register the buckets, create a JSON configuration file to include details of the buckets that need to be polled,  and then use REST API to register the configuration file. Below is an example of my JSON configuration file (bucket_AUDIT.json). { "logType":"AUDIT", "bucketsInfo":[ { "credential":"MKS-vnclogs", "namespace":"oraxxxxx", "region":"eu-frankfurt-1", "pollSince":"BEGINNING", "buckets":[ { "name":"oci-logs._audit.ocid1.compartment.oc1..aaxxxxxxxxxxxxxxx" } ] } ] } Note two important differences compared to the Flow logs. logType buckets name The bucket name is the name of the bucket for the compartment that Audit logs will be ingested from. A list of all the Audit buckets can be gathered from the OCI Console or OCI CLI. From the OCI Console: Menu > Object Storage (Ensure to choose the root compartment) From OCI CLI:   Where compartment-id is the name of the compartment for the audit logs that are of interest.  Here is an example of another JSON configuration file containing a few compartments. { "logType":"AUDIT", "bucketsInfo":[ { "credential":"MKS-vnclogs", "namespace":"oraxxxxx", "region":"eu-frankfurt-1", "pollSince":"BEGINNING", "buckets":[ {"name":"oci-logs._audit.ocid1.compartment.oc1..aaaaxxxxxxxxxxxxx"}, {"name":"oci-logs._audit.ocid1.compartment.oc1..abbbxxxxxxxxxxxxx"}, {"name":"oci-logs._audit.ocid1.compartment.oc1..acccxxxxxxxxxxxxx"} ] } ] } REST API is then used to register the configuration file -  bucket_AUDIT.json.     # curl -X POST -u <username> -H "X-USER-IDENTITY-DOMAIN-<tenant_name>" https://<tenant_url>/serviceapi/logan.uploads/registerOSSConfig -H 'Content-Type:application/json' -d "@bucket_AUDIT.json "     To confirm the buckets have been registered with OMC:  # curl -X GET -u <username> https://<tenant_url>/serviceapi/logan.uploads/getOSSConfig?logType=AUDIT    Registering compartment Audit logs is a one-off process. After registration, logs will continue to be incrementally ingested. To stop ingestion the buckets will need to be unregistered   Unregistering Bucket Collections To unregister an Object Storage Bucket the following can be used: # curl -X DELETE -u <username> https://<tenant_url>/serviceapi/logan.uploads/unregisterOSSConfig -H 'Content-Type:application/json' -d "@Unregister.json" Unregister.json, should contain bucketIds.  For Example: { "bucketIds" : ["<bucket_IDs>"] } Summary Hopefully, this post, as well as my previous post, has shown how easy it is to ingest Audit and Flow logs into Oracle Management Cloud Log Analytics Service to give you the ability to analyse and understand what’s happening in your OCI environments with minimum efforts. Additional Resources: Get Started with Oracle Management Cloud Tutorial: Learn to Set Up and Use Oracle Management Cloud Blog: How to Ingest Oracle Cloud Insfrastructure VCN Flow Logs into Oracle Management Cloud Videos: Watch Oracle Enterprise & Cloud Manageability Solutions videos Twitter: Oracle Manageability

In my previous post, I mentioned that it is now possible to ingest and analyse logs from Oracle Cloud Infrastructure (OCI) Virtual Cloud Infrastructure (VCN) Flow Logs, OCI Audit Logs and other OCI...

How To Ingest OCI VCN Flow Logs into OMC

In the February 2020 Oracle Management Cloud (OMC) release, we announced it is possible to ingest and analyse logs from Oracle Cloud Infrastructure (OCI) Virtual Cloud Infrastructure (VCN) Flow Logs, OCI Audit Logs and other OCI logs stored in buckets. In this blog post, I’ll show how to set up OMC to poll for VCN Flow Logs, explore why the logs are useful and look at some meaningful insights we can get from OMC Logs Analytics (LA) services. What’s interesting about VCN Flow Logs? Flow logs capture information related to traffic in your VCN. The logs can inform on which traffic has been allowed (Accept) or denied (Reject), where the traffic originated from (srcaddr) and it's port (srcport), the destination (dstaddr) and it's port (dstport), the time this happened (start_time), when it ended (end_time), the communication method (protocol), how many packets (packets) and the communication size (bytes).  In its raw form a typical log record would look like this: version srcaddr dstaddr srcport dstport protocol packets bytes start_time end_time action status 2 x.x.x.x x.x.x.x 50448 443 6 15 10672 1555431265 1583455265 ACCEPT OK The logs can be viewed in OCI Logging Service (Menu > Logging > Log Search) which has a search capability.  However, once the logs are ingested into OMC, there are many interesting ways in which we can use Log Analytics to analyse the data. For example: Troubleshooting connections made from your private to public or on-premise to OCI networks, checking whether packets are being accepted or rejected. This may highlight areas in which your Security Lists need tightening up. Help you understand the flow of traffic to and from your VCN's, like which ports/protocols are being used most often. Insights into traffic growth. Traffic to/from Countries/Cities. IP to IP communication. Spikes in packets/traffic. Sudden propagation of new IP’s. Below is a screenshot of an OMC Dashboard I have built based on just VCN Flow logs.   Let’s look at how we can ingest the logs to get these insights. Assumptions I will assume the following actions have already been completed: 1. Creating an OCI tenancy, a compartment, a VCN, an Instance, a user in IAM with RSA key pair (in PEM format) loaded for the API calls (OCI Documentation link). A simple setup could look like this: 2. Flow logs are enabled. 3. Administration level access to an OMC tenancy. Gathering Information For OMC to ingest VCN Flow logs, we need to establish a secure connection between OMC and OCI Object Stores and then point Log Analytics (LA) Service to the Flow log buckets. To do this we need to gather information from both OMC and OCI.  The information we gather here will be needed later. The required information can be gathered in a few ways like using the OCI Console and/or OCI Command Line Interface (CLI) and/or Cloud Shell.  I’m using a combination in this post. Tenancy Namespace: OCI Console: Menu > Administration > Tenancy Information. Copy Object Storage Namespace value. OCI CLI:   Tenancy OCID OCI Console: Menu > Administration > Tenancy Information. Copy OCID. OCI CLI:   User OCID – OCID of the user calling the API. OCI Console: On the top right corner of the console click on the Profile, then click on the profile name. The User Information page shows the OCID   Fingerprint – Fingerprint for the User calling the API. OCI Console: On the top right corner of the console click on the Profile, then click on the profile name. The fingerprint is under API Keys on the User Information Page. OCI CLI:   Private Key – The Private and Public RSA key pair are part of the pre-requirements.  The location of the Private key will be unique in your environment. Region – The region in which Flow Logs are created. In my case, it's “eu-frankfurt-1”. OCI Console: Menu > Administration > Region Management OCI CLI:   Compartment-id – The compartment in which the Flow logs are generated.  OCI Console: Menu > Identity > Compartment.  Click on your Compartment Name and record the compartment OCID. OCI CLI:   Buckets – The Object Storage Bucket name that contains the Flow logs. OCI Console: Menu > Object Storage.  Copy the Name OCI CLI:   OMC Tenant Name – OMC Console: Menu > Administration > Agent > Download Agents. select Agent Type. The tenant_name will be shown at the bottom of the page.  OMC URL OMC Console: Menu > Administration > Agent > Download Agents. select Agent Type. The OMC_URL will be shown at the bottom of the page.  Creating Credentials for OCI Authentication To capture the Flow logs we need to establish a secure connection between OMC and the OCI Object Storage. The credentials can be created from the OMC Console or REST API. I’ll show the console way. From the Menu > Administration > Security > Credential Store.  Click on New Credential. A new dialogue window will appear: We have already gathered most of the information required from the previous steps.  It’s important to set the Credential type to Oracle.OCI.Auth. This is an example from my environment. Note: I did not use a pass_phrase Ingesting Flow Logs into Log Analytics We now need to register the Flow log buckets to Log Analytics. Once registered the Log Analytics service will poll for new logs. To register the buckets, we need to create a JSON configuration file to include details of the buckets we wish to poll and use REST API to register the configuration file.  We should already have most of the information we need to create the JSON configuration file. My JSON configuration file (bucket_config2.json) looks like this. { "logType":"FLOW", "bucketsInfo":[ { "credential":"MKS-vnclogs", "namespace":"oraxxxxx", "region":"eu-frankfurt-1", "pollSince":"BEGINNING", "buckets":[ { "name":"oci-logs._flowlogs.ocid1.compartment.oc1..aaxxxxxxxxxxxxxxx" } ] } ] } Where: “logType” - depends on the logs that you are ingesting.  The options are FLOW, AUDIT or OCI_LOGS_GENERIC. “credential” - is taken from the name of the credential store created earlier in OMC. “pollSince” - Indicates when the logs should start to be polled.  There are three options: BEGINNING – collects logs form the first time they were stored in the buckets. 2020-03-10T01:00:00.000Z – the absolute time when the buckets logs should start from. CURRENT_TIME – logs are collected from the time the buckets are registered in LA. REST API is then used to register the bucket_config2.json. # curl -X POST  -u <username> -H "X-USER-IDENTITY-DOMAIN-<tenant_name>" https://<tenant_url>/serviceapi/logan.uploads/registerOSSConfig -H 'Content-Type:application/json' -d "@bucket_config2.json" Where: “username” -  is the name used to logon to OMC.  You will be prompted for the password. To confirm the buckets have been registered with OMC, we can run: # curl -X GET  -u <username>  https://<tenant_url>/serviceapi/logan.uploads/getOSSConfig?logType=FLOW The output would be similar to: [ { "bucketId" : "9f2xxxxxxxxxxxxxxxxxxx", "ociCredential" : "MKS-vnclogs", "ociNamespace" : "orasxxxxxxx", "ociRegion" : "eu-frankfurt-1", "ociBucket" : "oci-logs._flowlogs.ocid1.compartment.oc1..aaxxxxxxxxxxxxxxxx", "logType" : "FLOW", "createdOn" : "2020-03-06T18:01:41.701Z", "pollSince" : "1970-01-01T00:00:00.000Z", "logSourceName" : "OCI VCN Flow Logs" }] Summary As you have seen it is very simple to ingest VCN Flow logs into the OMC's Log Analytics service to get real insights into VCN's. I have shown just a few use cases, however, there are many more especially when combined with other logs sources like Audit logs, and expanding into other OMC services like Infrastructure Monitoring (IM) and Application Performance Monitoring (APM).

In the February 2020 Oracle Management Cloud (OMC) release, we announced it is possible to ingest and analyse logs from Oracle Cloud Infrastructure (OCI) Virtual Cloud Infrastructure (VCN) Flow Logs, O...

Cyber Resilience at Oracle OpenWorld 2019

I hear from IT leaders they are prioritizing data protection as a top focus area to scale up, even as they are doing more to protect their data. It’s with good reason, as breaches can cost up to $4M on average. Additionally, downtime, unrelated to security, causes revenue losses as much as $500K per hour. Protecting data requires a comprehensive approach, including preventative security and operational measures to protect from internal and external threats, as well as keeping your data resilient, or available for business activities from both planned downtime and unplanned mishaps leading to business disruption. At #OOW2019, #OracleEM and Oracle #MgmtCloud sessions will highlight what you can do for Cyber Resilience. Do you only have time for one session? General Session | Future of Oracle Enterprise Manager and Management Cloud: Strategy and Roadmap (GEN5111) Tuesday, September 17, 11:45am, Moscone South - Room 207/208   Come hear Wim Coekaerts (@WimOracle), Senior Vice President of Product Development,, present on how Oracle continues to make major investments in manageability designed to lower the cost and risk of providing high-performance applications and adopting the latest Oracle technology. In this strategic session Oracle's enterprise and cloud manageability leadership discuss Oracle's current offerings and future plans to provide manageability across hybrid estates that leverage the best of on-premises and cloud technology.   There are numerous sessions providing deep dives on cyber resilience. Here are a few examples: Managing at Hyperscale: Oracle Enterprise Manager as the Nerve Center of Oracle Best Practices for Monitoring Your Hybrid On-Premise and Cloud Environments Best Practices for Hardening Security with Oracle Enterprise Manager 13c Smart, Secure, and Lean Database Monitoring with Oracle Enterprise Manager Maximizing Reliability and Scalability Tips for Oracle Enterprise Manager 13c Automate STIG, CIS, and Custom Oracle Database Security Standards Hands-On Lab: Stay Protected, Patch Often with Oracle Enterprise Manager Fleet Maintenance   Lastly, don’t forget to scan through our entire program guide for other interesting news, technical content, best practices, hands-on labs, demos and more. Program Guide | Enterprise and Cloud Manageability The Enterprise and Cloud Manageability Program Guide is a comprehensive listing of all our sessions, demos, and hands-on labs. It's a live link that will update if there any changes, so please bookmark this URL.   If you are attending the event, be sure to drop me a line and stop by The Exchange in Moscone South for a chat. If you are not attending the event, not to worry. Follow this blog and you will see content available online.  

I hear from IT leaders they are prioritizing data protection as a top focus area to scale up, even as they are doing more to protect their data. It’s with good reason, as breaches can cost up to $4M...

Oracle Enterprise and Cloud Manageability Support for Multi-Cloud Environments

As customers roll out multi-cloud application environments, they will need to monitor and manage those applications across those multiple clouds.  Oracle customers who use Oracle Enterprise Manager (EM) and/or Oracle Management Cloud (OMC) can take advantage of the appropriate capabilities offered by these solutions to work across their entire estate, regardless of which deployment model they leverage. For today's blog post, we'll use an example of an application which uses the Autonomous Database on Oracle Cloud, but which also has application components hosted in Amazon Web Services and/or Microsoft Azure.  If you are looking for an overview of what EM and OMC do, we recommend reviewing this other recent blog post. Managing Oracle Databases Deployed in Oracle Cloud As we've discussed in earlier blog posts, Oracle provides comprehensive management of Oracle Databases in Oracle Cloud.  Oracle Enterprise Manager can be used to seamlessly manage Oracle Databases in Oracle Cloud, whether they are customer-managed or Autonomous Databases.  Customers can use Oracle Enterprise Manager remote agents to manage these databases from their existing, on-premises EM, or an EM that is hosted in Oracle Cloud Infrastructure.  Oracle Management Cloud can also be used to manage Oracle Autonomous and customer-managed Databases in Oracle Cloud via REST APIs.  Figure 1.  Autonomous Database Monitoring. Now let's turn our attention to what happens when this database is serving application components hosted in other clouds.   Monitoring Amazon Web Services One popular deployment location for application components is Amazon Web Services, or AWS for short.  Oracle's Manageability Solutions have a variety of support for Amazon Web Services.  For starters, customers can start monitoring resources in Amazon Web Services or Microsoft Azure by adding a Cloud Discovery profile as shown below. Figure 2.  Cloud Discovery Profiles for Amazon Web Services (AWS). As depicted in the following figure, Oracle Management Cloud discovery UI allows you to select the region and services you want to monitor. Alternatively, you can use Oracle Management Cloud’s command line utility or REST API to add a cloud discovery profile.  Note that Oracle Management Cloud executes AWS functions to monitor AWS Entities. AWS users must have the permissions as documented here for discovery and monitoring of AWS services Figure 3.  Filtering Cloud Discovery Profiles for certain regions or services. After you add the Cloud service profile, Oracle Management Cloud will discover all services in AWS for the Services and Regions you have selected, and will start to monitor your resources as shown below.  As part of the discovery process,Oracle Management Cloud also imports all tags that you defined in your cloud service provider and you can use the same tags to perform filtering or to create a dynamic group. Figure 4.  Automatic discovery of new entities for selected AWS Cloud services and regions.  Supported entities include the following (see example screenshots and links to documentation): AWS EC2 Instance You can install Oracle Management Cloud agents on your compute node for deep monitoring of the host and underlying applications and databases. In the following figure, we see a VM running in AWS EC2. Figure 5.  Monitoring an Amazon Web Services Elastic Compute (EC2) instance.  Additionally, you can leverage Oracle Management Cloud’s unique machine learning capabilities such as log clustering to link and diagnose issues faster. The following figure shows how Oracle Management Cloud’s log clustering capabilities allow you to find a “needle in the haystack” by reducing a large number of log entries down to a few patterns. Figure 6.  Using Log Analytics to analyze system/host/OS logs from an Amazon Web Services Elastic Compute (EC2) instance.  Oracle Management Cloud supports monitoring a wide variety of other AWS Cloud Services.  For information about many of the additional services monitored by OMC, follow these links. AWS Cloud Service Resource Amazon Web Services (S3) AWS ELB Application Instance AWS SQS AWS SNS AWS Elastic Block Store (EBS) AWS Lambda Function AWS Redshift Cluster AWS ELB Instance AWS DynamoDB   Monitoring Microsoft Azure Environments Oracle Management Cloud supports monitoring a variety of Microsoft Azure offerings via Azure’s REST APIs.  Customers simply create a Cloud Discovery Profile for Microsoft Azure and they can get started monitoring! Figure 7.  Azure Cloud Discovery Profile in Oracle Management Cloud. Supported entities include the following (see example screenshots and links to documentation): Microsoft Azure VM Instance (Compute) and Microsoft Azure VM Scale Set Figure 8.  Azure VM Scale Set Monitoring in Oracle Management Cloud. Microsoft Azure Logic Application Service Figure 9.  Azure Logic Application Monitoring in Oracle Management Cloud. Microsoft Azure API Application Service Figure 10.  Azure API Application Monitoring in Oracle Management Cloud. Microsoft Azure Event Hub Namespace Figure 11.  Azure Event Hub Namespace Monitoring in Oracle Management Cloud. Microsoft Azure Functions Application Figure 12.  Azure Functions Application Monitoring in Oracle Management Cloud. Microsoft Azure Mobile Application   Figure 13.  Azure Mobile Application Monitoring in Oracle Management Cloud. Microsoft Azure Web Application Figure 14.  Azure Web Application Monitoring in Oracle Management Cloud. Oracle Management Cloud supports monitoring of additional Azure Cloud Services beyond what are pictured above.  For information about some of the additional services monitored by OMC, follow these links. Microsoft Azure Application Service Plan Microsoft Azure Application Gateway   Managing Oracle Application Environments that are Deployed in AWS or Azure Oracle Management Cloud can monitor Oracle packaged applications, such as Oracle E-Business Suite, PeopleSoft and Siebel via OMC agents, which could be deployed into AWS or Microsoft Azure hosts.  Oracle Enterprise Manager offers a variety of Application Management Packs for Oracle Applications as well as an EM app in Oracle Cloud Infrastructure that can be used to manage the portions of those applications and databases deployed on-premises and in Oracle Cloud Infrastructure. Figure 15.  Oracle E-Business Suite Application Monitoring in Oracle Management Cloud.   Managing Oracle Databases Deployed in AWS or Azure, Managing Microsoft SQL Server and Connecting to Microsoft Systems Center Operations Manager (SCOM) Oracle Enterprise Manager is best-known for its deep and active management of Oracle Database.  If the Oracle Database targets are deployed in AWS or Azure, customers can install an agent in the AWS or Azure host to fully monitor and manage their Oracle Database targets.  Customers who use Amazon Relational Database Service (RDS) for Oracle can also monitor any AWS RDS Instance using Oracle Management Cloud.   As shown in the screenshot below, Oracle Management Cloud provides all key performance metrics for a given RDS instance. Customers can use Oracle Management Cloud’s machine learning capabilities to find anomalies such as a high CPU usage and Write IOPS. From the screen shot below you can see that these two items seem to be correlated. Figure 16.  Anomaly detection through event correlation for Amazon RDS services in Oracle Management Cloud.  For monitoring Microsoft environments, customers of Oracle Enterprise Manager can use the System Monitoring Plug-In for Non-Oracle Databases to monitor Microsoft SQL Server, while OMC also supports monitoring of Microsoft SQL Server and a variety of Microsoft stack components such as IIS, .NET, SCOM, Hyper-V, and Active Directory.  Figure 17.  Monitoring Microsoft SQL Server with Oracle Enterprise Manager.   Figure 18.  Deploying Management Agents for .NET applications. Figure 19.  Monitoring Microsoft SQL Server. Customers who use Microsoft Systems Center Operations Manager (SCOM) can leverage the Oracle Enterprise Manager Management Connector for SCOM to forward Enterprise Manager events to SCOM. Figure 20.  Configuring the Oracle Enterprise Manager Management Connector to Microsoft SCOM. And customers can also use Oracle Management Cloud to monitor a variety of entities that may be monitored by a local SCOM, including Windows Hosts, SQL Server DB, Exchange Server, Hyper-V (via Virtual Platform and Virtual Server), Active Directory and Internet Information Server (IIS) as well as using OMC Notification Channels to send event and alert information into SCOM. Figure 21.  Configuring Notification Channels in Oracle Management Cloud. Summary As customers roll out multi-cloud application environments, they will need to monitor and manage those applications across those multiple clouds.  Oracle customers who use Oracle Enterprise Manager and/or Oracle Management Cloud can take advantage of the appropriate capabilities offered by these solutions to work across their entire estate, regardless of which deployment model they leverage.  Want to learn more?  See the latest on Oracle Enterprise Manager and Oracle Management Cloud. Additional Resources: Watch Live and On-Demand Webcasts featuring Oracle Management Cloud and Oracle Enterprise Manager.  

As customers roll out multi-cloud application environments, they will need to monitor and manage those applications across those multiple clouds.  Oracle customers who use Oracle Enterprise Manager...

Manage Dynamic Oracle Cloud Infrastructure using Terraform

Contributing Author: Akanksha Sheoran Kaler, Consulting Product Manager, Oracle Oracle Management Cloud is a suite of management services that eliminate the human effort associated with traditional solutions for monitoring, managing and securing applications and infrastructure. Oracle Management Cloud leverages machine learning and big data techniques against the full breadth of the operational data set to help customers drive innovation while removing cost and risk from operational processes. Oracle Management Cloud is a heterogeneous, hybrid Cloud solution that receives and analyzes data from any, or combination of sources, whether on-premises, or in Oracle Cloud Infrastructure, or other 3rd party Cloud platforms such as, Amazon Web Services (AWS) or Microsoft Azure or Google Cloud Platform. To get started with Oracle Management Cloud, you don’t need any additional setup, you just need to deploy agents on your instances or host. Oracle Cloud Infrastructure combines the elasticity and utility of public cloud with the granular control, security, and predictability of on-premises infrastructure to deliver high-performance, highly available, and cost-effective infrastructure services. If you need to quickly create a secure multi-tenant, multi-tier network on Oracle Cloud Infrastructure and apply best practices repeatedly, you need to script it using a tool called Terraform. Terraform is a powerful tool that you can use to efficiently build, change, and version your infrastructure. Instead of setting up a cloud environment from scratch every time you need one, you can use Terraform to quickly provision the infrastructure. Using this approach saves you time by creating a basic structure that you can tune for your business requirements. It gives you agility and fine-grained control over all your infrastructure resources. You can create configuration files to describe your resources in a human-readable format. In this blog, I will cover how you can script the agent install using Terraform and spinoff cloud agents along with the dynamic Oracle Cloud Infrastructure instance creation and/or deletion. Oracle Management Cloud Agent As the administrator of an Oracle Management Cloud, you can deploy agents on any infrastructure and it will then collect log and metric data from entities that you want to monitor and upload the data to Oracle Management Cloud. To learn more about getting started with Oracle Management Cloud, take a look at the documentation and resources available to you. Cloud Agent Support for Terraform Before you begin you need to keep a few things in mind for deploying your Cloud Agents. Plan: Install and deploy agent Uninstall: De-install agent Manage: Check existence of agent on the instance Automate Deploying Cloud Agents on Oracle Cloud Infrastructure using Terraform Terraform provisions specific, reproducible environments, such as test environments, or an environment as part of a larger deployment where you need to create several cloud instances. Since Terraform scripts are code, you can use the scripts as a method of source control and enhance them to deploy cloud agents while creating cloud instances. Any change including addition or deletion in the topology is codified in the Terraform scripts, which will allow you to deploy and remove cloud agents along with the cloud instances created using these scripts. This will allow Oracle Cloud Infrastructure instances to be immediately monitored by Oracle Management Cloud. Instructions for Deploying Cloud Agents with Terraform Scripts Enhancing the Terraform scripts to deploy cloud agents along with cloud instance creation is a 3 steps process and one-time activity. Step 1: Create a setup.sh file that will create install user and agent base directory. Step 2: Open the MAIN.TF and punch in the variables for the cloud agent install. There are 4 variables required for the cloud agent install: TENANT_NAME - Name of the tenant where Oracle Management Cloud is running. AGENT_REGISTRATION_KEY - Key to validate the identity of the tenant and the authenticity of the installation. Oracle Management Cloud_URL - The absolute URL including the protocol that is required to connect to Oracle Management Cloud for uploading data for the specific TENANT_NAME. AGENT_REP_URL- This is the absolute location of latest cloud agent binaries. To learn more about these mandatory variables, please refer to the following documentation. Step 3: Create a omc_entity.json to discover the Oracle Cloud Infrastructure instance in Oracle Management Cloud. Step 4: Execute the command $ terraform apply. This will kick start the Oracle Cloud Infrastructure instance creation and then deploying the agent. Oracle Cloud Infrastructure instances appears on the Oracle Management Cloud console. Instructions for Deleting Cloud Agents with Terraform Scripts Enhancing the Terraform scripts to delete cloud agents along with deletion of cloud instance is a 3 steps process and one-time activity: Step 1: Open the Main.tf and inject a delete module as below that will invoke the cloud agent delete. If the Oracle Cloud Infrastructure instances are deleted due to any anomaly deletion by Terraform then the cloud agents will also be deleted, and the Oracle Management Cloud UI will no longer show the instances as monitored. Alerting the Terraform Plan and Cloud Agent Lifecyle There could be times when you need to alter the Terraform plan based on the infrastructure expansion or reduction. The modified Terraform script with cloud agent (install and delete) will work along with Terraform plan alteration. Let’s look at an example. A senior DBA created a plan for 10 instances with database entities on each. Another user deletes four instances. Terraform will detect this drift and recreate instances with the cloud agent deployed on it. Conclusion Monitoring your Cloud infrastructure is an important part of keeping your IT infrastructure running smoothly. To monitor your infrastructure, you must install and discover agents on each component. This process can be time-consuming and prone to errors. Terraform is a tool that allows you to programmatically manage, version, and persist your IT infrastructure as "infrastructure as code". Its primary purpose is to create defined hardware resources in code and to run that code to create or provision the hardware. During this process, it can also add software to the hardware being operated upon. If you want to bootstrap multiple Oracle Cloud Infrastructure compute instances with Oracle Management Cloud, you can use the customizable Terraform modules that deploys Oracle Cloud Infrastructure compute instances along with required infrastructure resources, installs Oracle Management Cloud Agents for each deployment, and adds the instances to Oracle Management Cloud for immediate monitoring. Additional Resources: Watch Live and On-Demand Webcasts featuring Oracle Management Cloud and Oracle Enterprise Manager.

Contributing Author: Akanksha Sheoran Kaler, Consulting Product Manager, Oracle Oracle Management Cloud is a suite of management services that eliminate the human effort associated with traditional...

Simplify Management of Your Hybrid Cloud and Multi-Cloud IT Estate

Contributing Author: Debu Panda, Senior Director, Product Management, Oracle We are seeing a rapid adoption of public cloud by organizations worldwide in the last couple of years. Several organizations have adopted multiple public cloud vendors such as Amazon Web Services (AWS) and Oracle Cloud Infrastructure (OCI). Although organizations are moving to the cloud, they have many of their mission critical applications still running on-premises or in a private cloud environment. While organizations embark on their journey to the cloud, they still face several challenges managing a diverse multi-cloud or hybrid IT environment. When I talk to customers about their challenges, what I’ve found is a wide range of issues that are occurring across different regions and industries. You can group these challenges into several key problem areas that include: Lack of unified visibility due to disparate management tools, Availability and performance issues take time to diagnose, Growing application and/or VM sprawl, Difficulty in managing and optimizing IT resource usage, On-going compliance drift of critical applications and systems, Ability to secure hybrid cloud. In this blog, I will discuss how you can use Oracle Management Cloud to address these areas, so you can get a unified view in to the health and performance of your application and infrastructure in a multi-cloud and/or hybrid cloud environment. I will cover how the machine learning capabilities in Oracle Management Cloud improves the time-to-value, reduces your cost of ownership and improves your mean-time-to-repair. Let’s start off by looking at the key use cases that apply to the development and IT operations (DevOps) model many organizations are employing today. Key Use Cases for DevOps The primary goal for DevOps / ITOps organization is to ensure that they meet their service level agreements and to help improve the coordination, efficiency and speed of deploying new services. While at the same time, DevOps needs to help with the task of reducing the overall cost of IT operations. To meet these objectives, as DevOps/ITOps personnel, you need a management solution that fulfills all these requirements and one that provides you with: Complete visibility of application and infrastructure resources deployed on-premises and public cloud, Ability to monitor end-users, application, database and infrastructure’s performance, Rapid diagnostics capabilities to detect application performance degradation and system errors, Automate remediation of application failures, IT resource capacity planning based on demand, you want flexibility to automatically spin up or down resources when needed, Cost control, this goes without saying, your management solution should help you lower your operational expenses. Managing Multiple Clouds with Oracle Management Cloud The following graphics shows key capabilities of Oracle Management Cloud that DevOps/ITops personnel can leverage to manage hybrid cloud environments. The power of Oracle Management Cloud is in its ability to help you see a holistic view of your entire IT estate, whether it’s on-premises or in the cloud or in multiple clouds. The solution provides a unified view in to system availability and application performance across all tiers of your cloud and on-premises resources—all from a single management console. Let’s take a deeper look in to how Oracle Management Cloud provides this proactive monitoring. Centralized Visibility of Multi-Cloud Environment Oracle Management Cloud allows you to collect all types of telemetry for your cloud or on-premises applications that includes server metrics such as CPU, I/O utilization for your compute nodes and underlying entities such as databases, logs for your compute and application infrastructure, end-user metrics for your web-based or mobile applications, deep-dive application performance metrics, etc. The solution allows you to bring metrics in from other monitoring systems such as Oracle Enterprise Manager, Microsoft SCOM, VMWare vCenter, and public clouds such as Oracle Cloud Infrastructure, AWS, Microsoft Azure to name a few. You can also bring your business and operational metrics into Oracle Management Cloud by using our REST API. Oracle Management Cloud’s machine learning and data explorer tools can also be used to gain insight into your application performance based on your metrics and log data. The following figure shows types of data collected and stored in Oracle Management Cloud’s unified big data platform. Unified Monitoring for All Your Resources Oracle Management Cloud provides a unified monitoring console for all your compute resources (public cloud vs on-premises), PaaS services, on-premises applications, databases infrastructure, application servers, and networking devices. To see the complete list of entity types supported by Oracle Management Cloud click here. As you can see from the figure below, we monitor the availability and performance of all entities which are distributed across on-premises, Oracle Cloud and Amazon Web Services. This view centralizes entities running in on-premises or in public cloud infrastructure. Oracle Management Cloud reduces your cost of operations by leveraging machine learning and helps you to proactively monitor problems in your application and infrastructure before the business is impacted. It can also automatically remediate many infrastructure problems by using run-book automation. We will discuss this in more detail later in the article. Oracle Management Cloud provides innovative ways to identify hot spots within your application and infrastructure by arranging your resource entities in a topology viewer. Notably the entity map visualization helps you manage at scale and provides a novel way to identify problematic entities by highlighting them, so you can quickly troubleshoot issues and preform root-cause analyses by different dimensions such as, location, entity type, cost center, resource tier, etc. The Power of Machine Learning: Finding the Needle in the Haystack Using system and log data, we can apply machine learning to search, analyze and correlate millions of log files to help identity any potential security problems or performance anomalies that might occur. Oracle Management Cloud’s machine learning algorithms does that heavy lifting for you.  You don’t have to spend costly labor-intensive hours searching for that “needle in the haystack,” the solution takes care of finding, analyzing and reporting issues for you. Oracle Management Cloud ingests your system and log data into the solution so that we can apply machine learning to it. When you apply machine learning to the data you can start to see that it’s highly patterned. If you look at the logs—most of the times, it’s a lot of the same patterns which means we can derive insights into what the data is telling you. Watch the video below to see how Betacom, a European solution provider, is using Oracle Management Cloud with their clients to help resolve issues faster. Unified Dashboard for Your Cloud Infrastructure Recently, I was working with a large retail company whose workload is distributed between Amazon Web Services, Oracle Cloud Infrastructure and their on-premises data center. They wanted to centralize their visibility to all their compute infrastructure. What was interesting in this case, was that I helped them build a custom dashboard within Oracle Management Cloud, similar to the screen shot below, that used different types of data (metrics, logs, etc.). All the data and log files were collected from their cloud and on-premises infrastructure and brought under one management console and view in Oracle Management Cloud. Let me describe the dashboard a little bit more. The dashboard illustrated above brings together some key metrics. For example, the customers wanted compute resources such as host availability, status, and open alerts in their IaaS Infrastructure on the dashboard. The dashboard was being used by senior management to help identify issues by specific cloud service providers. Besides alerting based on static thresholds, Oracle Management Cloud leverages machine learning algorithms to detect anomaly and can send early warning alerts to you. This helps you be proactive at catching problems early before things get outof hand and cause significant damage. We will learn how to create alert rules later in the article. The dashboard also included compute host distribution by cloud service provider and compute hosts by CPU vs Memory consumption. By having one consolidated view of their multi-cloud estate, it helped the customer make critical business decision about their IT. Another important discovered was that it helped them to optimize the resources they had and lower costs by switching off any VMs that were not being used. The cloud VMs are generally accessed through keys which are highly secure. In an ideal environment, there shouldn’t be any failed login attempts. But if there are, Oracle Management Cloud can automatically report these attempts to you, which is an indication of a potential hacking. Bringing Your Data into Oracle Management Cloud Oracle Management Cloud supports native monitoring of your system resources and cloud native applications by using agents. The following architecture diagram shows different components and agents that can be optionally deployed to collect telemetry and log data. These agents can be used to run remediation jobs that help you to streamline your IT operations. For more information on these components, review the Oracle Management Cloud documentation. Oracle Management Cloud provides a unified platform by allowing you to ingest operational metrics and logs from a variety of different sources. These sources include (but not limited to): Cloud agents running on compute hosts monitoring the host and underlying applications, databases, container management solutions such as Kubernetes, Docker Swarm, Application Performance Monitoring agents running on your application servers and containers that brings end-user and application metrics, Native collection from public clouds using their APIs such as Oracle Cloud, AWS CloudWatch and Microsoft Azure, Monitoring solutions such as Oracle Enterprise Manager, Microsoft SCOM, VMWare venter, Custom collection of metrics and logs using REST API. Let’s dive deeper in to how Oracle Management Cloud provides native monitoring of third-party cloud providers by looking Amazon Web Services as an example. Adding Monitoring of Amazon Web Services Resources You can start monitoring resources in Amazon Web Service (AWS) or Microsoft Azure by adding a Cloud Discovery profile as below. Oracle Management Cloud executes AWS functions to monitor AWS Entities. AWS users must have the permissions as documented here for discovery and monitoring of AWS services.  As depicted in the following figure, Oracle Management Cloud discovery UI allows you to select the region and services you want to monitor. Alternatively, you can use Oracle Management Cloud’s command line utility or REST API to add a cloud discovery profile. As you see above, you can filter the entities that you want to monitor by either your regions or services. You have to provide your credentials and access key. Note, that you must update these credentials if they change in future. Proactive Monitoring of Cloud Services After you add the Cloud service profile, Oracle Management Cloud will discover all services in AWS and will start to monitor your resources as shown below in the screen shot. Oracle Management Cloud will automatically discover any new entities that have been added. Oracle Management Cloud also imports all tags that you defined in your cloud service provider and you can use the same tag to perform filtering or to create a dynamic group. You can use the entity card in-context to get more information about a specific entity. The entity card will show some key performance metrics for the entity, its membership information and any tags associated with it. It also helps you navigate to view relevant information such as, monitoring metrics or log data that you need to diagnose issues. Let’s use the entity card to navigate to the home page for RDS instance. As you can see, Oracle Management Cloud provides all key performance metrics for this RDS instance. You can Oracle Management Cloud’s machine learning capabilities to find anomalies such as a high CPU usage and Write IOPS. From the screen shot below you can see that these two items seem to be correlated. Creating an Alert Rule Oracle Management Cloud enables you to create availability alerts automatically. For other metrics, you can create alert rule based on either static threshold or anomaly alert based on automatic baselining. In the figure below, you can see here that I set an anomaly alert for the AWS RDS Instance. If there are any issues, then Oracle Management Cloud will send an alert once the condition has been met. This is a great way to become more proactive at preventing mission-critical services from being disrupted. Notification Channels Oracle Management Cloud allows you to either send a notification via email or push notification to the Oracle Management Cloud Mobile App. It also provides integration with third-party ticketing system such as, ServiceNow and PagerDuty.   Auto Remediation Oracle Management Cloud now offers Oracle Orchestration Service which lets you automate scheduling and tracking of workflows and jobs where you can execute scripts on hosts or invoke web services. It’s ideal for those looking to schedule recurring maintenance tasks across their on-premises and cloud infrastructure as well as developers looking to integrate a scheduler into their applications development processes. We give you the ability to orchestrate and schedule workflows that can executed at any given time whether you want to run a configuration check or if you want to do spin-up or shut-down of a certain service or resource. You can tie this orchestration into your standard alerts to auto control your application. You can even take care of the common problems with its auto remediation capabilities. The following figure shows an auto-remediation job that starts a new instance. Getting Enhanced Visibility to Compute Node in IaaS You can install Oracle Management Cloud agents on your compute node for deep monitoring of the host and underlying applications and databases. In the following figure, we see a VM running in AWS EC2. Oracle Management Cloud allows you to view all logs for your compute node and associated entities to provide real-time insight and rapidly isolate of infrastructure issues. Additionally, you can leverage Oracle Management Cloud’s unique machine learning capabilities such as log clustering to link and diagnose issues faster. The following figure shows how Oracle Management Cloud’s log clustering capabilities allow you to find “needle in the haystack” by reducing large number of log entries down to a simply few patterns. Conclusion IT organizations are challenged in gaining unified visibility in to the health and performance of applications deployed in hybrid cloud environments. In this article, I talked about how Oracle Management Cloud provides unified visibility in your hybrid cloud infrastructure so that you can quickly understand what’s going on and troubleshoot issues faster. I covered how Oracle Management Cloud enables you monitor your workload running a multi-cloud scenario that included AWS. About the Author: Debu Panda has authored numerous books, articles on cloud, enterprise Java and databases. He is the lead author of the EJB 3 in Action (Manning Publications) and Middleware Management (Packt). Additional Resources: Watch the full Oracle Management Cloud keynote and customer panel from Oracle OpenWorld. Watch it Now! Try Oracle Management Cloud! Get the EasyStart Kit Today. Learn & Experience Oracle Management Cloud.  

Contributing Author: Debu Panda, Senior Director, Product Management, Oracle We are seeing a rapid adoption of public cloud by organizations worldwide in the last couple of years. Several organizations...

Return on Your Investment: Why You Should Care About Hybrid Cloud Management

Contributing Author: Moe Fardoost, Senior Director, Product Marketing, Oracle Over the last few years, we have asked our readers how many different tools they used to manage their databases and applications. The responses ranged from a dozen to hundreds! Now-a-days IT professionals must also monitor their cloud environments which could potentially call for even more tools. Some people take pride in learning new tools and finding new ways to manage their IT assets. That’s great if these tools don’t get in the way of taking care of business. Industry experts and Oracle’s own surveys indicate that complexity increases as you add more point tools to your toolset. Therefore, it’s important to have a realistic expectation. To address this, Pique Solutions, an independent research firm interviewed several Oracle Management Cloud customers to determine how they were using the platform, the investment involved and, most importantly, the business value and cost-savings benefits they realized after using it over time. The study found that customers using Oracle Management Cloud were able to: Achieve up to a 4X ROI—390% over three years, Eliminate or avoid costs of nearly $428K from legacy systems management platforms or multi-vendor solutions, Save more than $1M over three years in productivity and efficiency gains from faster troubleshooting, issue resolution, capacity planning, and improved application delivery, Scale and growth enablement savings of $334K from IT capacity optimization, Increase developer productivity and improve availability service levels. Download and read the full study to learn more.

Contributing Author: Moe Fardoost, Senior Director, Product Marketing, Oracle Over the last few years, we have asked our readers how many different tools they used to manage their databases...

Blog Series: Building Interactive Dashboards in Oracle Management Cloud - Part 1

Guest Author: Pratul Mathur, Senior Product Manager, Oracle Management Cloud In this 3 part blog series, I will show you how to build and connect several interactive dashboards together in Oracle Management Cloud, which will enable you to drill-down to view and manage the health of your applications and infrastructure. I’ll show you how to set up and link your own custom dashboards with easy to follow steps. The blog topics in this series will cover: Part 1: Drill-Down from Dashboard Widgets using Entity Links Part 2: Using Out-of-the-Box Data Explorer Widgets with Drill-Down Capabilities Part 3: Drill-Down from Dashboard Widgets using Widget Title Linking Part 1 – Drill-Down from Dashboard Widgets Using Entity Links Oracle Management Cloud allows users to build highly interactive custom dashboards with ability to in-context drill-down and/or link it to another dashboard or Oracle Management Cloud page, such as, the Application Performance Monitoring page, or the Database Performance Analytics page.   To diagnose performance and infrastructure issues faster, Oracle Management Cloud offers several different types of drill-down capabilities including: Widgets that enable you to drill-down and view the underlying log data with a single click, Metric widgets that allow you to perform ad-hoc diagnostics, Entity Link APIs to quickly point to a destination dashboard for a given Entity, Out-of-the-box Status and Alert widgets for a quick view in to the Entity Summary and Alerts pages, Widget Title Link to let users to go from custom dashboards to specific Oracle Management Cloud pages and dashboards. In this article, I will introduce you to Entity Links and show how to easily customize and link dashboards together using the Entity Links API. Introduction to Entity Links If you have built a dashboard for your Entity Type, such as, an application or an Oracle Database, you’re more than likely interested in monitoring its health and performance at a glance. With Oracle Management Cloud, we provide you with a convenient way to navigate to specific Entity Type dashboard using Entity Links. In Oracle Management Cloud, you can create a link for all entities that belong to a specific Entity Type, shown in a Data Explorer widget, to another dashboard by using the Entity Link capability. The same link also appears in the entity card “View In” option with the name of the dashboard. When you click on the Entity Link, you navigate to the linked dashboard within the context of the specific entity, which you have selected or clicked, in the global entity selector. (Note: In Oracle Management Cloud Release 19.1.1, you can only link to the entities shown in a table or data grid visualizations.) Some of the Entity Type such as, Oracle E-Business Suite group, Oracle Exadata, or an APM application, are linked to a relevant out-of-the-box dashboard or Oracle Management Cloud pages by default. You can customize or change these links to point to other dashboards if needed. Entity Links in a Table Entity Link in the Entity Card Steps for Creating and Customizing Entity Links You can create an Entity Link for an Entity Type or customize Entity Links for an Entity Type using Oracle Management Cloud’s service API. By using APIs, you can also fetch the details of all Entity Links or delete an Entity Link that you have created. Once you create the link, all the entities that belong to that Entity Type will show up as links in the table and data grid visualizations. If you click on them, it will take you to the corresponding linked dashboard. As I mentioned earlier, the same link will also appear in the entity card “View In” option with the name of the dashboard.   Please note, that if an out-of-the-box default Entity Link is set for an Entity Type, such as an Oracle E-Business Suite application, Oracle Exadata, or an APM application, and you create an Entity Link for the same Entity Type, then your created link will override the default link. Let’s look at how to create these links in more detail. Consider the use-case where you have a dashboard for an application fleet, which lists all your application’s critical metrics. If you want to drill-down to see a more detailed view for a specific application within your fleet, follow the steps I’ve outlined below. Step 1: Obtain the ID of Your Destination Application Dashboard In this initial set up step, navigate to your desired application dashboard within Oracle Management Cloud. You’ll need to open the destination dashboard first to obtain the “dashboardID” parameter from the browser URL. The “dashboardID” is the unique identifier for that specific dashboard. See screenshot below. Step 2: Invoking the Entity Link Service API In the second step, you will need to use Oracle Management Cloud’s service API to link the APM application Entity Type to your destination Application Dashboard. Use this URL to invoke Oracle Management Cloud’s service API: https://<Oracle-Management-Cloud_INSTANCE_URL>/serviceapi/preferences/entitylinks If, for example, your Oracle Management Cloud homepage URL is: https://myOracle-Management-Cloud-url.oraclecloud.com/emsaasui/emcpdfui/welcome.html then the service API URL will be: https://myOracle-Management-Cloud-url.oraclecloud.com/serviceapi/preferences/entitylinks Use POST method on the URL mentioned above to create a new Entity Link or to edit existing Entity Link. You can use any REST client like Postman to invoke the service API. Here are a few sample screenshots to illustrate the setup within the Postman REST client. Use Basic Auth with username as ‘<Tenant Name>.<Username>’ and the password. Below is the payload of the API, which is a JSON with the Entity Type and the destination application dashboard ID that you want to link. Note, the payload is a JSON array, which means, you can create multiple Entity Links using just one call with one JSON object per Entity Link. Use the following header and invoke the service API. You should see a 204 response code for successful API invocation. Step 3: Verify You Successfully Created the Link In this last step, you can verify whether you created the Entity Link correctly by using Oracle Management Cloud’s UI and/or service API. In our example, go to the application fleet dashboard and verify the linking of the individual application is right. Alternatively, you can invoke the following service API to fetch all the Entity Links: GET https://myOracle-Management-Cloud-url.oraclecloud.com/serviceapi/preferences/entitylinks The same authorization and headers are needed to access the API. In the response, you should see an entry for the APM application Entity Type with the URL of the linked dashboard. Deleting an Entity Link You can delete the Entity Link that you created earlier by using the following steps to invoke the delete service API. DELETE method with the URL: https://myOracle-Management-Cloud-url.oraclecloud.com/serviceapi/preferences/entitylinks/<entity_type> The same authorization and headers are needed, and you should see a 204 response code for successful API invocation. Note, that you can delete only the user created and /or customized Entity Links. You cannot delete the out-of-the-box or default ones. If a default link is present for an Entity Type and you delete the user created/customized link for that entity type, then it will default back to the out-of-the-box or default link. Conclusion Oracle Management Cloud allows users to build interactive dashboards for monitoring the health of your applications and IT estate. In this article, I illustrated how to leverage Oracle Management Cloud’s Entity Link API to drill-down and link to your destination dashboards. You saw in the example, how this is a handy way for you to quickly navigate to any application that might be having issues. In the Part 2 of the blog series, I will discuss how to use Oracle Management Cloud’s out-of-the-box widgets to drill-down and see critical Alerts and Entity Summary pages from your own custom dashboard. Guest Author: Pratul Mathur, Senior Product Manager, Oracle Management Cloud Up Next: Read the 3 Part Blog Series: Building Interactive Dashboards in Oracle Management Cloud Part 1: Drill-Down from Dashboard Widgets using Entity Links Part 2: Using Out-of-the-Box Data Explorer Widgets with Drill-Down Capabilities Part 3: Drill-Down from Dashboard Widgets using Widget Title Linking  

Guest Author: Pratul Mathur, Senior Product Manager, Oracle Management Cloud In this 3 part blog series, I will show you how to build and connect several interactive dashboards together in...

Blog Series: Building Interactive Dashboards in Oracle Management Cloud - Part 2

Guest Author: Pratul Mathur, Senior Product Manager, Oracle Management Cloud In this 3 part blog series, I will show you how to build and connect several interactive dashboards together in Oracle Management Cloud, which will enable you to drill-down to view and manage the health of your applications and infrastructure. I’ll show you how to set up and link your own custom dashboards with easy to follow steps. The blog topics in this series will cover: Part 1: Drill-Down from Dashboard Widgets using Entity Links Part 2: Using Out-of-the-Box Data Explorer Widgets with Drill-Down Capabilities Part 3: Drill-Down from Dashboard Widgets using Widget Title Linking Part 2 – Using Out-of-the-Box Data Explorer Widgets with Drill-Down Capabilities In part 1 of the series, I talked about how to use the Entity Link API within Oracle Management Cloud to connect dashboards together. In this article, I will show you how to use the out-of-the-box widgets with drill-down capabilities. What is an Out-of-the-Box Widget? Oracle Management Cloud provides several generic purpose-build widgets for looking at metrics, logs and security data. The solution allows you to surface this information from within your dashboards. It is a great way to get a high-level view of what’s really going on within your applications and infrastructure. Oracle Management Cloud gives you the flexibility to copy widgets and customize them based on your needs. Oracle Management Cloud’s Data Explorer provides two out-of-the-box widgets with drill-down capabilities in to the Infrastructure Monitoring and Alerts pages. Using these widgets, you can diagnose infrastructure performance issues much faster—you don’t have to spend time looking for where the issue is occurring, the widget will help guide you. The following are two widgets for Infrastructure Monitoring. 1. “Entity Status” Widget This widget shows the distribution of the entities by their status and has capabilities to fetch more details about these entities with a particular status by navigating to the Monitoring page. For example, if you have this widget in a dashboard and you saw that three of your entities are down for the OrderApp application, you can click on the red “Down” section of the circle graph to navigate to the Monitoring page to find out which entities are having trouble. 2. "Open Alerts by Severity" Widget This widget shows the count of open alerts categorized by their severity and has the capability to fetch more details on the alert severity by navigating to the Alerts page. When you click on a bar in this widget, it will take you to the Alerts page and show you the corresponding alert severity and entity information, including, its time context. Using this widget enables you to quickly and visually sort through your most severe alerts to find out which ones need immediate attention. Using Widgets in a Dashboard You can add the widgets above, along with many others in Oracle Management Cloud. To customize your dashboards follow these steps: First, enter the dashboard Edit mode by clicking on the ‘Edit’ button. Edit mode will show the ‘Add Widget’ panel. Search for the widget name and click on the widget to add it to the dashboard. The links in the widgets are activated when a user selects a composite entity such as an Application or Group in the global entity. You can navigate to the Infrastructure Monitoring page with the appropriate context and filters. You can navigate to the alerts page with the appropriate context and filters. Conclusion In this article, I outlined how to use Oracle Management Cloud’s out-of-the-box widgets to drill-down in to the Alerts and Entity Summary pages. This is an effortless and easy way to navigate within Oracle Management Cloud and allows you to quickly triage potential issues that could disrupt application performance.  In the next article, I will show you how to use the widget “Title Linking” so you can create your own custom links to and from different dashboards or to different Oracle Management Cloud pages. Guest Author: Pratul Mathur, Senior Product Manager, Oracle Management Cloud Up Next: Read the 3 Part Blog Series: Building Interactive Dashboards in Oracle Management Cloud Part 1: Drill-Down from Dashboard Widgets using Entity Links Part 2: Using Out-of-the-Box Data Explorer Widgets with Drill-Down Capabilities Part 3: Drill-Down from Dashboard Widgets using Widget Title Linking  

Guest Author: Pratul Mathur, Senior Product Manager, Oracle Management Cloud In this 3 part blog series, I will show you how to build and connect several interactive dashboards together in...

Blog Series: Building Interactive Dashboards in Oracle Management Cloud - Part 3

Guest Author: Pratul Mathur, Senior Product Manager, Oracle Management Cloud In this 3 part blog series, I will show you how to build and connect several interactive dashboards together in Oracle Management Cloud, which will enable you to drill-down to view and manage the health of your applications and infrastructure. I’ll show you how to set up and link your own custom dashboards with easy to follow steps. The blog topics in this series will cover: Part 1: Drill-Down from Dashboard Widgets using Entity Links Part 2: Using Out-of-the-Box Data Explorer Widgets with Drill-Down Capabilities Part 3: Drill-Down from Dashboard Widgets using Widget Title Linking Part 3 – Drill Down from Dashboard Widgets using Widget Title Linking In the last two articles, I discussed how to use Oracle Management Cloud’s Entity Link API and its out-of-the-box widgets to create interactive dashboards. In this article, I will show you how to link different dashboards together or how to link to Oracle Management Cloud pages using Widget Title Linking. What is Widget Title Linking? You can convert the title of any dashboard widget into a link that lets you navigate to not only other custom or out-of-the-box dashboards, but also to other Oracle Management Cloud pages, such as the Application Performance Monitoring page, or the Database Resource Analytics page. This widget Title Linking feature becomes very powerful when you want to drill-down in to other dashboards or pages while trying to troubleshoot performance or infrastructure issues. For example, if you create a widget that provides information about Oracle Database resource consumption and add it to your dashboard, you can link this widget to Oracle Management Cloud IT Analytics’ Database Resource Analytics page, which highlights specific details about database resource consumption. Creating Dashboard Widget Title Links To create a custom dashboard for managing your Oracle Database fleet, you can add a custom widget to your dashboard that shows all the CPU and memory utilization across your entire database estate. You can graphically represent database CPU and memory on a customizable scatter chart as shown in the screenshot below. Dashboard showing CPU and Memory Utilization Scatter Chart. As you look at your database CPU and memory, you notice that consumption is rather high. You may want to drill-down into these databases to analyze further and see if there are any anomalies. To make navigation faster and more seamless, you can create a “Title Link” within the widget to connect to the Database Resource Analytics page. To create this link, first enter the dashboard Edit mode by clicking on the ‘Edit’ button. Next, click on the options menu (three vertical dots) on top right of the widget and click ‘Link Title’. You will now see a popup menu to create the link with options to select the dashboard or Oracle Management Cloud page. The list of dashboards or pages will narrow as you type in the search box. You can select the desired dashboard and/or page from the drop-down list and click on ’Save’ button in the dialog. Next, click on the ‘Done Editing’ button on the dashboard. This will save the widget title linking. You can see that the color of the widget title has changed to blue, which now shows the linkage between your database dashboard and Database Resource Analytics page. In the example above, you created a widget that links a dashboard to a page. If you’re interested in creating a link to a custom or out-of-the-box dashboard, the process is the exactly the same. Removing Widget Title Links If you want to remove or edit the widget title link that you just created, enter the dashboard Edit mode again by clicking the ‘Edit’ button. Open ‘Link Title’ dialog box by clicking on the options menu (three vertical dots) on top right of the widget and click ‘Link Title’. Next, click on the cross icon to remove the link to the dashboard and then click on the ‘Save’ button. If you want to edit the link, select the new dashboard or page and then click on the ‘Save’ button. Click on the ‘Done Editing’ button on the dashboard.   Conclusion In this article, I discussed how to create a Widget Title Link between your custom dashboard and an Oracle Management Cloud page. This linkage feature allows you to drill into potential issues that might appear in your dashboard and is a great way to help you navigate ‘in-context’ between pages to resolve the problem. Guest Author: Pratul Mathur, Senior Product Manager, Oracle Management Cloud   Blog Series: Building Interactive Dashboards in Oracle Management Cloud: Read the 3 Part Blog Series: Building Interactive Dashboards in Oracle Management Cloud Part 1: Drill-Down from Dashboard Widgets using Entity Links Part 2: Using Out-of-the-Box Data Explorer Widgets with Drill-Down Capabilities Part 3: Drill-Down from Dashboard Widgets using Widget Title Linking

Guest Author: Pratul Mathur, Senior Product Manager, Oracle Management Cloud In this 3 part blog series, I will show you how to build and connect several interactive dashboards together in...

Oracle Management Cloud for Oracle Identity and Access Management

Identity and Access Management (IAM) has become more visible as a business requirement across all industries and affects organizations of all sizes. In the current environment a security breach has the potential to impact a business’ bottom line - damaging its reputation, customer loyalty and profitability. Furthermore, compliance, governance and privacy regulations have put an unprecedented executive level focus on the need for strong security controls. This becomes a challenging task in a constantly changing environment where granting appropriate and timely access to information is critical. IAM systems are indispensable to the security, governance, and risk mitigation of organizations. Whether for authentication, user lifecycle management, or access certification, Identity is at the core of making business processes function. Some of the key issues customers face include: Maintaining high performance Identity Systems Full visibility of complete IAM systems in context Ability for proactive Monitoring Lack of specificity of information for performance troubleshooting Lack of data and insight into access request transnational latency and throughput Oracle Management Cloud is a comprehensive suite of next-generation integrated monitoring, management, security and analytics services. Built on a Unified Data platform, Oracle Management Cloud integrates a comprehensive set of capabilities that spans, Application Performance Monitoring, Infrastructure Monitoring, IT Analytics, Log Analytics, Security Monitoring and Analytics, Configuration and Compliance, and Orchestration services. With this integrated solution, businesses can leverage Oracle Management Cloud's Machine Learning algorithms to provide a more intelligent and efficient management experience with its advanced clustering, anomaly detection, correlation and forecasting capabilities. Operational data is automatically analyzed and correlated across all of Oracle Management Cloud services, and the resulting insights are made instantly available through intuitive dashboards to give operational teams a true picture of what's happening within their IT estates. Real-time diagnostics, IT resource capacity planning, operational forecasting, and business analytics are all built into the product. Oracle Management Cloud's services leverage an unified platform when it comes to collecting and analyzing all the various system files and logs. For example, log data can be used to provide context for performance metrics and troubleshooting. The deep understanding that results from Machine Learning enables customers to make intelligent decisions and execute those decisions with full-featured automation. Customers can thus maintain visibility across rapidly changing, cutting-edge, cloud-native or cross-cloud integration, prevent outages across the entire application portfolio, collect and analyze business and IT data on the entire stack, from end-user devices and browsers, through application, middleware, and database services, and all the way down to hardware, hosts, virtual machines, containers, and clouds. Oracle Management Cloud provides the following features specifically in support of Identity and Access Management (IAM): Automated purpose-built collection, analytics and remediation of IAM system components, underlying infrastructure and diagnostic logs Pre-built intuitive dashboards optimized for IAM Applications Unified operational data includes application metrics, application and server logs and configuration information Oracle Management Cloud is a heterogeneous, Hybrid Cloud solution so it can receive and analyze data from any, or combination of sources: whether on-premises, or in Oracle Cloud Infrastructure, or other 3rd party Cloud platforms such as, Amazon AWS or Microsoft Azure or Google Cloud Platform. We also provide the ability to manage hybrid environments including Oracle's Cloud@Customer. Additionally, the solution supports non-Oracle entities out-of-the-box as well, such as Microsoft Windows, SQLServer, IIS, SAP, several NoSQL databases, etc. The full list is here. We offer services to all of the IAM components including: Oracle Access Manager Oracle Identity Manager Oracle Identity Governance Oracle Directory Server (Enterprise Edition) Oracle Unified Directory [Note, this is based on the latest IAM offering, other components, available in previous releases are also supported and have been merged into these offerings] Creating Identity and Access Management specific Dashboards is one of the out-of-the-box highlight for this solution. Several are available, making it easy to get started quickly. Lets start with the Executive Overview Dashboard. This Dashboard is for executive management to show the overall health of the system. You can easily get answers to common but critical questions such as, are my IAM services up or down, how are some of the key performance indicators (KPIs) looking for the environment? The KPIs included items such as the number of users created, updated and deleted in OIM organized by department, number of authentications and authorizations including failures and so on. Right below is an interesting metric, the volume of logs processed. You can clearly see that Oracle Management Cloud processed about half a billion log records in total, generated from just one week of activity. That's not a great issue in itself. If you setup a large infrastructure and invest lot of money in hardware and software you can do that too. The power of Oracle Management Cloud comes in analyzing that volume of data and leveraging the power of not just Oracle Cloud to scale up but also use the power of Machine Learning to find patterns in that data. As you can see Oracle Management Cloud identified roughly 500 or so distinct issues within the environment. All of these are clickable so that if the executives choose to do so, they can click through to get to that next level of detail. The idea here is that the executive or C-Level team gets the right level of details that they care about in a single place and if any of them are interested, they can drill down further. OAM Owner Dashboard The OAM owner here gets a more detailed breakdown of the authentications and authorizations happening in the system along with the different errors. The executive team wanted to know when authentications and authorizations are taking longer than 5 seconds. So the Access owner asked to be notified when authentications are taking more than 3 seconds and authorizations are taking more than ½ second. They want to be notified before their boss gets an alert. The OAM owner wants to see a further breakdown of authentication and authorization failures by users, or by policies that caused those failures. Note here that Oracle Management Cloud is not only processing the logs, but that it understands the system that is generating those logs and so can provide valuable insight into how OAM is working instead of just being any other log aggregator. This is the power of Oracle Management Cloud, understanding and providing insights into the solutions you are monitoring OIM Owner Dashboard Just like the OAM dashboard, the OIM one gives that next level of detail that an OIM owner would want to know. For example, if you wanted to know, where are my errors happening, when are provisioning exceptions occurring and so on. ODSEE Analytics Dashboard The ODSEE Analytics dashboard shows important information like the IP addresses the clients are coming from, top users, top unindexed searches, that will cause huge performance hit on any LDAP, top filters used for searches, what search bases are used in LDAP queries to understand if the search operations are being optimal or if they are just searching the entire directory tree unnecessarily. Other Dashboards are also available, eg ODSEE Health Dashboard, SOA Infrastructure Dashboard, OIM Scheduled Jobs, OIM Admin Role (Application Access, Access Policies, etc) but for brevity of this blog, I didnt include them here. Key Takeaways Oracle Management Cloud provides readily available, easy to understand dashboards that help pinpoint issues quickly. It allows you to easily troubleshooting Identity Applications across the entire estate. There are several advantages to this uniquely broad view of the entire IT estate, particularly when Machine Learning techniques are applied on top of such a vast amount of unified data. Oracle Management Cloud enables you to: Maximize Performance of Identity and Access Management Applications Minimize operational effort to identify, diagnose and remediate performance issues across hybrid clouds Plan accurately for future resource capacity needs to prevent shortfalls or unplanned outages Provide real-time diagnostics, operational forecasting and business analytics In a subsequent blog, I will show how Oracle Management Cloud can tackle interesting IAM-related use cases, such as: Rapidly troubleshooting outages (root-cause analysis) Setting up proactive alerts (before something bad happens) Anomaly alerts (find the needle in the hay stack) Resource utilization and capacity planning (Forecasting) SOA Infrastructure monitoring (deep visibility) The application domain is broad and Oracle Management Cloud can help manage all aspects of Identity and Access Management applications. Whether it's on-premises, or in Oracle Cloud (eg with IDCS), or in someone else's Cloud, if you are considering a lift-and-shift scenario, you will need to track all of the critical metrics. With Oracle Management Cloud this task can be done for you automatically. It is a terrific service for all of these mentioned use cases. See Also: PRO5815 (Oracle OpenWorld Presentation): Managing Identity Applications and Securing Databases with Oracle Management Cloud  Try Oracle Management Cloud for free:  Get the EasyStart Kit Today

Identity and Access Management (IAM) has become more visible as a business requirement across all industries and affects organizations of all sizes. In the current environment a security breach has...

Oracle Management Cloud @ Oracle OpenWorld 2018—Round Up

Now that Oracle OpenWorld is behind us, I wanted to take a few moments to share some of the Oracle Management Cloud highlights and news that happened during the conference. This was one of our best Oracle OpenWorld's to date. We had a ton of Oracle Management Cloud sessions, demos, hands-on-labs and partner events with several customers telling their story of how they benefited from the solution. Not to mention that a few of them won Oracle Excellence Awards. So a big congratulations goes out to the winners: Cox Automotive SK Hynix Anthem Optima Gaming Congratulations to the #OOW18 Excellence Awards winners and special shout out to Oracle Management Cloud winners: Cox Automotive, Anthem, Kingold, and Optima Gaming! #MgmtCloud https://t.co/yUayTeHt38 — OracleMgmtCloud (@OracleMgmtCloud) October 25, 2018 It was a busy night at the #OOW18 #Oracle Excellence Awards.#MgmtCloud pic.twitter.com/xOTJLXMB4F — OracleMgmtCloud (@OracleMgmtCloud) October 23, 2018 Congratulations to all our #MgmtCloud #OOW18 #Oracle Excellence Award winners. pic.twitter.com/T391KwB0NP — OracleMgmtCloud (@OracleMgmtCloud) October 23, 2018 During mid-week at Oracle OpenWorld, we had our Oracle Management Cloud product keynote, Modern Management and Security in Action, (watch the full keynote here) featuring Prakash Ramamurthy, Senior Vice President along with Dan Koloski, Vice President, from the Security and Systems Management team. In the keynote, Prakash talked about how organizations need to maintain control and operational integrity of fast-moving hybrid cloud environments. He talked about the challenges customers are facing when it comes to managing applications. And why it's important that IT knows about everything that happens within their environment. So you can avoid any surprise outages that can negatively impact end-users or customers or even worse, revenue. The session featured a customer panel of those who were using Oracle Management Cloud to gain visibility into their Cloud estates and as a result were able to transform their business. The customers featured included, Anthem, Cox Automotive, Kingold, Optima Gaming and LOLC. Follow us to learn what early adopters are doing to modernize their management and security practices #oow18 #MgmtCloud live tweeting starts at 3:30 PM https://t.co/oEiL62rNPX pic.twitter.com/elt0k6sT6Z — OracleMgmtCloud (@OracleMgmtCloud) October 24, 2018 Anthem, a US-based health benefits provider, uses Oracle Management Cloud to drill down from application tier to the database SQL tier in order to troubleshoot issues and tune applications faster. By doing this, Anthem is able to spend less time on manual effort and gain visibility into Oracle Exadata's performance.    Modern management and security in action with @Oracle customers #OOW18 pic.twitter.com/95hw7myc4S — Troy Kitch (@tkitch) October 24, 2018 Cox Automotive, a global auto auctions and wholesale services group, which includes popular online sites such as Autotrader.com and Kelley Blue Book, uses Oracle Management Cloud’s machine learning to get predictive insights into its business as it moves to the public Cloud. Kingold Group, a Chinese based multi-industry conglomerate, uses Oracle Management Cloud to help manage and monitor its hybrid cloud environment. As the company underwent a digital transformation, it was able to uncover over 500 previously unknown issues using Oracle Management Cloud’s machine learning and IT analytics capabilities. Optima Gaming, an e-gaming provider, saw a 90% productivity savings from its support team. Using Oracle Management Cloud's machine learning, Optima Gaming can now predict potential issues in its applications, helping the business to dramatically reduce the number of escalations being done by the first-line support team. Faced with a complicated IT environment, LOLC Group, a financial services firm, was dealing with multiple banking systems across it's business groups. The company found that monitoring such a diverse and heterogeneous IT estate was very complex. The organization turned to Oracle Management Cloud and was quickly able to improve software code quality by moving monitoring telemetry upstream for developers. As a result application page load times were dramatically reduced by 96%. It certainly was a busy and exciting OpenWorld week for the Oracle Management Cloud team, we want to thank everyone who came out to support us and hope you learned a lot. We look forward to seeing you at the next Oracle OpenWorld in your region. Watch the full Oracle Management Cloud keynote and customer panel from Oracle OpenWorld 2018 Watch it Now!

Now that Oracle OpenWorld is behind us, I wanted to take a few moments to share some of the Oracle Management Cloud highlights and news that happened during the conference. This was one of our best...

Oracle Management Cloud for Oracle E-Business Suite

Guest Author: Uday Vallamsetty, Architect, Strategic Customer Programs, Oracle Management Cloud    We recently announced the general availability of our fully integrated monitoring solution for Oracle E-Business Suite. In this blog, we will talk about some of the key features of the solution. Please review Oracle Management Cloud Solution For Oracle E-Business Suite for more details and a full list of use-cases. Automatic Discovery of Oracle E-Business Suite Applications Oracle Management Cloud provides a simple, single click discovery of the entire application including the following components: WebLogic Domain/Servers, Database System/Instances; Application and DB Hosts Concurrent Manager Service, Forms application service, and the Workflow service In addition to the application components, Oracle Management Cloud can also monitor a wide range of infrastructure like: load balancers, switches, firewalls, and storage arrays. The full list of supported entities is available online. This broad coverage provides a single pane of glass view of the entire landscape, from technology stack to the hosts to the network and storage.   Simplified End User Experience Monitoring Oracle Management Cloud Application Performance Monitoring Cloud Service (APM) works by leveraging a Java agent that is deployed into the JVM. This agent collects key performance metrics from every user accessing the application, including all the JVMs in the managed servers. Users can optionally enable injection of browser agents, to capture real end-user response time breakdown: Browser, Network, Middleware and Database. Oracle Management Cloud can help operational users proactively monitor interactive user experience and take corrective steps before there is any application degradation or business impact. Please review further documentation on how Oracle Management Cloud APM can help developers isolate and root cause performance issues in the application. Machine Learning Powered KPI Monitoring Oracle Management Cloud Infrastructure Monitoring Cloud Service will collect a set of Key Performance and Availability Metrics from various components in the Oracle E-Business Suite. These metrics were identified in conjunction with the Oracle E-Business Suite support team. A sampling of metrics are as follows: Long Running/Active Jobs Maximum/Average Runtime of Jobs Pending forms sessions per user Using advanced machine learning, Oracle Management Cloud will baseline all the metrics collected. Alerts can be enabled when any of the metric values strays outside of the baseline band. These alerts can be pushed to various Notification Channels. Integrated Dashboards Oracle Management Cloud provides three out of the box dashboards for each Oracle E-Business Suite application environment discovered. Overall E-Business Suite Health: Status of all the technology components, DB Tier and Middle Tier errors, Transaction Failures, and Job Failures. Concurrent Manager Service: Long Running/Pending Jobs,  Active Jobs in the System, Active Users,  Failed Jobs Forms Activity: Forms Sessions,  Forms Server Resource Usage                   Oracle E-Business Suite Health Dashboard Oracle E-Business Suite Concurrent Processing Dashboard Topology Aware Log Analysis We made significant investment into Oracle Management Cloud's Log Analytics capabilities of our Oracle E-Business Suite solution. Oracle E-Business Suite produces a large amount of detailed log data which is very amenable to be machine processed. Oracle Management Cloud can parse and index almost all of the logs found in a typical E-Business Suite environment. Using machine learning, users can quickly identify patterns, to discover problem signatures and eliminate noise. Oracle E-Business Suite Aware Log Enrichment Oracle Management Cloud will also enrich the Oracle E-Business Suite log data with additional information while storing in Oracle Management Cloud database. Oracle Management Cloud will absorb the semantic information codified in the logs and tag with “Labels”. Labels allow users to identify common problems, like Connection Errors, Storage Errors, ORA errors and all of the systems suffering from these problems. Because of the tight integration between different services, precise logs can be accessed from other services and alerts. For example: Application Performance to Log Analytics Integration User complains of failures on the web application Using the APM service, the administrator can drill down to the particular user session that experienced high number of failures With a single click, the administrator can drill into the relevant logs for that particular session, for that time period and view the WebLogic, Database, Host, Network logs in a single view Alert is raised that Concurrent Requests are running slow Slow jobs can be correlated to the nodes on which they are running to check CPU, memory resources Log enrichment will categorize jobs with broad failure signatures. These can be viewed to see problems in the related systems. Maximize Database Performance The database plays a central role in the performance and execution throughout of any Oracle E-Business Suite environment. Using Oracle Management Cloud IT Analytics Cloud Service, database administrators can get insights into SQL  performance degradation, databases with varying workload performance, database inefficiency, and Top SQL statements. Out of box widgets are available to view degrading SQLs, SQL execution across different databases etc. For further details, please review maximizing Oracle Database performance. Conclusion Oracle Management Cloud provides a comprehensive, light weight, cloud-based monitoring solution for Oracle E-Business Suite. Oracle Management Cloud can monitor applications deployed on-premises or in the cloud. We have several customers using Oracle Management Cloud to de-risk their cloud migration primarily because of this flexibility. Oracle Management Cloud leverages the power of machine learning to categorize telemetry data into simple, actionable insights that produce smart alerts as required. For further details of all the use-cases addressed by Oracle Management Cloud, please review the Oracle Management Cloud for E-Business Suite documentation.     Solution Brief: Oracle Management Cloud for Oracle E-Business Suite     Try Oracle Management Cloud! Get the EasyStart Kit Today

Guest Author: Uday Vallamsetty, Architect, Strategic Customer Programs, Oracle Management Cloud    We recently announced the general availability of our fully integrated monitoring solution for Oracle...

Oracle Management Cloud @ Oracle OpenWorld 2018

body { background-color: #FFFFFF; } .wrapper, #header { background-color: #FFFFFF; } a:link { color: #3333ff; } a:visited { color: #3333ff; } a:hover { color: #3333ff; } a:active { } .style3 {font-size: 14px} Systems Management and Security @ Oracle OpenWorld 2018 Join us for our customer panel keynote and receive a free gift*!  Product Keynote & Conference Sessions Product Keynote: Modern Management and Security in Action (PKN6465) Wednesday, 3:30pm, Yerba Buena Center for the Arts (YBCA) Theater Security and management must be as adaptive as your business in order for your organization to survive in today’s environment. Oracle’s security and management services enable organizations to maintain control and operational integrity of fast-moving, heterogeneous hybrid cloud environments. In this session hear from customers about how they are transforming their security and management practices with step-function improvements in efficiency, visibility, and control. Oracle executives discuss concrete steps you can take today to eliminate human effort from data collection, analysis, and remediation in a variety of cloud, hybrid, and on-premises scenarios, and also give you a glimpse into the future of these cutting-edge offerings. (Back to the top) Podcast: Best of Oracle Management Cloud @ OOW2018 (25:09) At this year's Oracle OpenWorld, we put together a huge showcase for Oracle Management Cloud's security and management solutions. There's tons of new and exciting content across a wide range of product keynotes, sessions, demos, and hands-on labs. Here is a summary of all the Oracle Management Cloud security and management activities happening this year. Enjoy! Highlights: Product Keynote Conference Sessions Demos - Exchange South Code One Session Hands-on Labs Focus On Docs (Back to the top) Conference Sessions: To see the entire schedule of Oracle Management Cloud security and management sessions click here (Back to the top) Demos - Exchange South: Exhibit Hours: Monday, Oct 22 – 9:00 AM - 5:45 PM Tuesday, Oct 23 – 10:30 AM - 5:45 PM Wednesday, Oct 24 – 10:30 AM - 4:45 PM To see the entire list of Oracle Management Cloud security and management demos click here (Back to the top) Code One Sessions: To see the entire list of Oracle Management Cloud security and management sessions at Code One click here (Back to the top) Hands-on Labs: To see the entire list of Oracle Management Cloud security and management hands-on labs click here (Back to the top) Focus On Docs The Oracle Management Cloud Focus On Document is a comprehensive listing of all our sessions, demos, and hands-on labs. It's a live link that will update automatically if there any changes. Focus On Document - Systems Management Focus On Document - Security (Back to the top)

Systems Management and Security @ Oracle OpenWorld 2018 Join us for our customer panel keynote and receive a free gift*!  Product Keynote & Conference Sessions Product Keynote: Modern Management and...

Every DBA Needs to Understand the Impacts of Oracle Autonomous Database

                                         For DBAs, chances are your responsibilities look like the list shown above for Daniel and Mia. Daniel is focused on the system itself, and Mia is responsible for the business applications. In fact, there are many different types of DBAs. In addition to System DBAs and Application DBAs, there are DBAs who say they are database architects or data modelers. Some say they are a generalist whilst others say they are specialist DBAs such as a performance tuning expert or data warehouse administrator. Regardless of the classification, DBAs are responsible for many repetitive tasks that can take much of their time. Some of these tasks are listed in figure 1.  Although these tasks may only provide incremental value to the business, nonetheless, these tasks can't be ignored. And that’s why the Autonomous Database is a gamechanger for DBAs. Figure 1: Typical System DBA Responsibilities   How DBA Duties Have Changed   Many of you recognized the value of automating these tasks, and painstakingly set up and managed your own routines. Oracle also recognized this pain point, going back to the releases of Oracle Database 9i and 10g, Oracle introduced the self-managing database with its ingenious performance data warehouse (AWR) and the Automatic Database Diagnostics Monitor (ADDM). Subsequently, Oracle Enterprise Manager introduced the diagnostics and tuning packs to deliver full automation for diagnostics and performance tuning. The solution was revolutionary for its day! Still, there were challenges, like the restricted amount of data stored for diagnostics purposes, and the labor-intensive effort to set up or update environments to be monitored. At least apps didn’t change frequently in those days, so the pain was somewhat manageable. Today brings new opportunities, and new challenges. The pace of change has accelerated with mobile and web applications released and updated weekly or even daily. The manual efforts for threshold setting and the volume of telemetry and metrics and logs data has skyrocketed. The good news is, the Autonomous Database from Oracle revolutionizes how databases are being managed, essentially automating up to 95% of the system DBA responsibilities.     How Oracle’s Autonomous Database Makes the DBA Job Easier   The Autonomous Database runs in the Oracle Cloud. The Oracle Cloud Infrastructure is based on the Oracle Exadata platform which can deliver unmatched performance and high availability to ensure 99.995 uptime access for your workloads. The Oracle Cloud also delivers higher flexibility than commodity clouds with instant elasticity where compute and storage resources can be scaled independently while the application is running, with no downtime. There is no manual sizing of database workloads. With Oracle Cloud, there is no limit on how much diagnostics and audit data can be stored for your database workloads. You can collect and analyze as much diagnostics data as you want to solve a problem and get answers without any impact to your database performance. The autonomous database uses AI and adaptive machine learning to automatically self-patch, self-tune, detect and resolve anomalies, and optimizes indexes much more quickly and efficiently than manual hands-on processing. Figure 2: Autonomous Database Automates up to 95% of manual tasks   Focus Areas for Successful DBAs   Whether or not you are a System DBA, this technology can have a major impact on your productivity and your career. For example, by adopting the Autonomous Database, system DBAs can now expand their responsibilities to cover more high value areas or specialize in areas with higher business value including: Spend more time on data model enhancements Focus more on the database architecture Spend more time with developers and line of business Focus on any other task that can benefit from a proactive approach e.g. plan capacity, eliminate systemic issues You can see there are compelling reasons for a system DBA to consider the Autonomous Database. What about other DBA roles? Arguably, the application DBA has the most complex responsibilities. Let's now look at the application DBA requirements.    Figure 3: Many Application DBA responsibilities require cross-domain expertise When applications run on the Autonomous Database, they automatically benefit from better performance, higher availability and resilience as well as better security. This enables DBAs to effectively direct resources when unknown issues arise, requiring rapid troubleshooting. This typically involves the assembly of large war rooms where architects, administrators and developers from across the IT landscape show up with their data to troubleshoot the issue. But in practice, people are there to disprove that the problem is in their respective areas. Oracle now provides Oracle Management Cloud to provide DBAs with complete visibility into their application environments to help avoid war room finger pointing and other challenges associated with multi-tier troubleshooting. Check out this great blogpost by Tim Mooney where he explains the benefits Oracle Management Cloud.    How to Use Autonomous Database with Oracle Management Cloud   By working together, the Autonomous Database and Oracle Management Cloud can help provide complete visibility and automation for the entire application environment.  Figure 4: Automation of repetitive tasks by Autonomous Database and Oracle Management Cloud Move your databases to Autonomous Database to automate the manual tasks associated with database infrastructure and processes. Add Oracle Management Cloud to automate tasks such as user experience monitoring, multi-tier performance troubleshooting, security monitoring for hybrid cloud, and configuration and compliance monitoring. Taking a step-by-step approach will get you started quickly with immediate benefits. Start with the Autonomous Database and deploy Oracle Management Cloud for multi-tier troubleshooting using log analytics.    Figure 5: A simple, high value use case You can be underway in minutes. Check out our step-by-step EasyStart toolkit that makes it easy to start using logs across your enterprise to troubleshoot issues spanning application, database and infrastructure.   

                                         For DBAs, chances are your responsibilities look like the list shown above for Daniel and Mia. Daniel is focused on the system itself, and Mia is responsible...

Mindfulness for Robots – Tools They Need to Handle the Stresses of Managing IT

I am constantly hearing visions of how robots and artificial intelligence will make life easier, including for IT folks, but few people are explaining how! How does an intelligent bot avoid getting bogged down with “sensory overload” when faced with massive volumes of machine data that it needs to analyze for anomaly detection or outage prevention? What if it makes incorrect deductions or ignores crucial data, causing more disruptions? We humans have found many ways to manage the chaotic world we live in. One technique that’s getting a lot of attention lately is Mindfulness. Can we integrate Mindfulness concepts to help program or guide our robotic helpers? It’s an interesting idea, if a weird one at that, but I think the question has some merit.     To manage anything, I hope you agree, one must have a thorough understanding of the environment being managed. Mindfulness teaches us to be aware of our surroundings and immerse ourselves in the present time. Can an A.I. bot or tool be taught to be mindful? Can it be taught to pay attention to what’s important and ignore the noise and the distractions hampering progress? The idea isn’t far-fetched! Consider how we as individuals achieve self-awareness or mindfulness and how similar it is to managing the world of computer networks. The cyberworld, just like the real world, contains a tremendous number of stimuli. As humans, we face massive volumes of sensory data causing us to react and respond to our surroundings. Similarly, in a computer network applications and infrastructure generate large volumes of sensory, metric, and log data. This isn’t a new phenomenon. Logging is as old as computer science itself. Right from the start, developers had the foresight to design systems with sensors even though they fully understood the application functionality and design. They also understood that computer performance must mimic what humans perceive as high performance and that requires continuous measurement and tracking. Today’s typical ERP system at an enterprise organization can generate 5 GB or more of log data per day across application, process, and infrastructure logs. Organizations typically maintain 3-5 instances of an ERP system. Similar volumes of time-series user experience data may also be generated by application performance and security monitoring tools. Typical types of log and metric data available in any computing environment. That’s a lot of white-noise data for an autonomous bot to sift through to find the nuggets of insights we are looking for, to perceive the IT world like us humans perceive our world, even enhanced to match the experiences of administrators and users. Unfortunately, even though IT systems generate a lot of machine data, they don’t have the equivalent of a central processing unit to derive meaning from it and that’s a big problem for our digital helpers who need training to understand the data.       Mindfulness for robots could be conceived of as a set of tools helping autonomous bots to become aware of their surroundings to derive actionable insights and improve the experience of human operators without the human traits of getting confused, misled or discouraged. So why now? Consider the following: Up until a few years ago, application and infrastructure changes were infrequent. Operations teams had authority over production environments and limited the frequency and timing of changes. Network perimeter was well-defined. Operations and security professionals limited access to enterprise assets so performance and security considerations were relatively straightforward. Administrators knew their environments well due to their static nature. Users didn’t have a lot of sway about experience and expectation, this was the realm of the CIO and the operations team.    Mainstream cloud and new app/dev technologies bring significant, changes for IT operations. Application developers are demanding a bigger say about IT and CEOs are listening. Chatbots, blockchain, containers, functions, microservices in addition to many other cloud technologies are driving rapid innovation. QA and operations teams are no longer setting the pace, instead they are reacting to it. Network perimeter is constantly shifting due to the use of personal devices and the new ways applications are being deployed. Rapid App/Dev also means administrators no longer know every detail about their applications; which renders most traditional monitoring practices ineffective. User experience requirements are increasingly set by customers and lines of business leaders not IT operations or the office of the CIO.   Mindful Robots A real-world example comes from a company whose product is a physical robot who interacts with people at sporting events and conferences. Read what this company is doing to make its robots highly intelligent as well as highly manageable.   These changes are coming to every IT organization. The good news is, with your IT expertise, you are uniquely positioned to benefit from A.I. and autonomous management for your IT.   Let’s look at some basic best practices: Identify and collect all logs, monitoring data, and configuration data about everything in IT. Create a Big Data lake where all your data is stored and keep the data for as long as possible. Find/write machine learning algorithms that can train your monitoring tools to respond to anomalies or resource issues as you would. Bring together a core set of monitoring and management tools that operate on the entire data set for your entire hybrid/heterogeneous IT. And finally, enable automatic resolution. Key tooling needed for any A.I. based security and management solution Trying to build this from scratch will take a lot of effort and most IT organizations simply don’t have the time or the resources to develop their own custom A.I. platform for IT monitoring. There are cloud-based management platforms available in the market that can do this for you.   Autonomous Management to the Rescue What does the ideal solution look like? One that requires no on-premises resources, ideally completely deployed on the cloud. Requires no data science or coding for training the machine learning engine. Has integrations for your core monitoring, security and management tooling. Is capable of automatic preventative and corrective actions. If you are interested to learn more, join me for a discussion on the topic of autonomous management for IT operations on August 22th. Joining me are two industry luminaries, Erik Benner (@erik_benner), VP of Enterprise Transformation at Mythics and Dan Koloski (@dankoloski), VP of Product Management for Security and Management at Oracle. The discussions will include: Why is there a drive towards cloud-based intelligent monitoring? Why is an integrated platform necessary for enabling A.I. for IT operations? What are the common use cases? What is the best way to get started? I hope you will join us. Click to Register: https://go.oracle.com/LP=71477

I am constantly hearing visions of how robots and artificial intelligence will make life easier, including for IT folks, but few people are explaining how! How does an intelligent bot avoid getting...

Customize and Visualize Your Data with Oracle Management Cloud

Guest Author:  Phil Brown, Director of Cloud Strategy at Data Intensity Oracle Management Cloud (OMC) has a lot of great features out the box and the time to value is pretty quick; that’s one of the key points; log parsers, entity types are already to go, all you need to do is install the agents. However you can use customization and build upon the platform to get even more value from the data uploaded. This blog is going to cover: Creating Custom Log Parser Labelling Log Data Word Cloud Visualizations Creating Custom Log Parsers When you create a log parser you can burn a lot of time writing a regular expression to carve out a log entry into meaningful chunks. With OMC's guided log parser you can simply use example log file contents and match elements of the log to pre-defined regular expression elements through drag and drop. Select the element of the log file and choose from the field name the element; it couldn’t be easier. Also once you have added the element it will then check the sample log file content against that parser element to show you if there are any issues in the parser test. Selecting Log Element Testing the Log Element Once you’ve gone though all the log elements you will end up with a newly defined parser. We have a new log parser created pretty quickly but now we want to Label the data.  This is a great feature and allows you to translate an item in a log message to a Label. A label can be a way to translate a syntactical error to something more human readable or group errors under common labels. For example, in Oracle Databases ORA-07445 and ORA-00600 are both ‘critical’ errors so when you’re searching through log labels it’s easy to search for ‘Critical’ errors rather than ORA-07445, ORA-00600 etc etc.    Here is a walked through example: Create a label on the message field Where the message starts with ORA-SEV1 create a label from the select list The selection list are pre-defined labels, you can also create your own. Labels also can optionally denote ‘problems’ which again is another way to group and highlight issues.    For my sample log file above, I’ve created 4 different custom labels each which each have defined as ‘problems’. Problems can be one of three levels high (red), orange (medium) yellow (low).  Now we have labelled the data let’s take a look at how these can be used to drill into log data and quickly find issues.  Now in the Log Explorer when we want to view data we can filter on problems; so this allows us to quickly view key problems in a log file and NOT be looking for individual error codes. Finally, let’s have a look at Word Cloud; this allows you to visualize on Labels; this becomes more interesting when you’re looking at a broad range of log files, i.e. getting the tool to highlight the problem for you. In this screen shot we are grouping on ‘labels’ across a whole host of log sources (52,184 individual log records). If you click into these labels you can view the key log data. But even better than that you can further add in additional dimensions into this by dragging and dropping into the ‘color’ field as well.  Here we add in Entity Type: Here we add in Problem instead:   The key thing here is to remember that out the box OMC can provide some great insight into your data; BUT if you spend just a little bit of time on labeling and thinking about what you would like to get out your data you can really accelerate the value of OMC. To learn more about Oracle Management Cloud and its capabilities: IDC: Cloud-Based Analytics and Machine Learning Accelerate Hybrid IT Management Blog: Log Analytics for DBAs in just 3 steps or zero to solved in 60 minutes Test drive Oracle Management Cloud Log Analytics for Oracle Database About the Author: Phil Brown is the Director of Cloud Strategy at Data Intensity. He works with clients helping them move enterprise workloads to Cloud based SaaS, PaaS and IaaS solutions. You can follow Phil on Twitter: @pbedba

Guest Author:  Phil Brown, Director of Cloud Strategy at Data Intensity Oracle Management Cloud (OMC) has a lot of great features out the box and the time to value is pretty quick; that’s one of the...

The DBA's New Best Friend for Oracle Exadata Environments

Oracle Exadata is a high-performance system for hosting the Oracle Database and delivers the highest levels of database performance. It’s a favorite with DBAs for delivering high performance due to the many unique features such as the ability to provide database-aware storage and accelerated database processing. It’s important to know that Oracle Exadata isn’t just available for on-premises. Oracle provides a rich set of deployment models for Oracle Exadata, enabling flexible ways to harness the power of Oracle Exadata to fit any customer environment. Here are the three main models: Oracle Exadata deployed on-premises Oracle Exadata Cloud Service at Oracle Cloud Oracle Exadata Cloud Service at Customer As DBAs explore their options and expand Oracle Exadata’s footprint across these diverse deployment choices, Oracle has them covered with Oracle Management Cloud, a unique monitoring, management and analytics solution delivered on Oracle Cloud with comprehensive capabilities for Oracle Exadata. It not only provides the best visibility across the above-mentioned environments, it also enables complete visibility for the entire IT environment spanning Oracle Cloud, 3rd party clouds, and on-premises technologies. Figure 1. Oracle Exadata Resource Usage and Projection in Oracle Management Cloud Here are some of the main benefits:   Maximize database resource utilization across the entire IT environment Accelerate cloud adoption with guidance and workflows for deciding which workloads to move to the cloud, how much cloud resources to procure, and how to automate the operational aspects Become proactive by leveraging out-of-the-box machine learning that’s trained to provide insights into Oracle Exadata environments and integrated tooling for comprehensive management including monitoring, rapid troubleshooting, capacity planning, security monitoring, configuration management, and compliance tracking. To learn more about Oracle Management Cloud and its capabilities for managing Oracle Exadata: Read our new technical white paper Watch the on-demand webcast   

Oracle Exadata is a high-performance system for hosting the Oracle Database and delivers the highest levels of database performance. It’s a favorite with DBAs for delivering high performance due to...

How to Resist the Temptation to Outsmart ML

Machine Learning (ML) is all around us. According to a new Constellation Research Survey, 70% of organizations are using it in some form. The rise of Machine Learning is supposed to transform the nature of work and collaboration between humans and machines. In other words, leave the mundane to the machines and focus your time on solving business problems. Sounds logical. But in practice, it's temptingly counter-intuitive. Perhaps because it's hard to get over what we have practiced for decades. I mean, we know which metrics to track and even the precise thresholds to set alarms for. Right? Well, as it turns out in making such decisive calls, we may have contributed to massive numbers of false alerts. A 2018 report by DevOps.com states that one in five IT organizations receive over 1000 operations alerts each month. This proves the hard, cold fact that relying on your intuition or previous experience may not be the best way to deal with IT Operations and security issues.   Closer to home, think about a lift-and-shift scenario. Organizations are actively involved in moving their applications and databases to the cloud. Their primary motivation is to get out of the data center management business but as they do so, performance monitoring and security are primary concerns: will my performance in the cloud be as expected? how does it compare to my data center performance? how do I do capacity planning with resources in the cloud? how do I secure my application against increasing threats? As I have written previously, ML helps with each one: anomaly detection for performance and security, clustering to understand outliers, top (N) SQL anomalies for performance variability, forecasting based on observed dynamic consumption patterns, understanding configuration drift, user behavior analysis and finally auto-remediation workflow actions are among many others. ML simplifies what is inherently very difficult to do manually. The same general principle applies broadly to much of systems and security monitoring. So, and rightfully, argues an Oracle Management Cloud Specialized Partner, Erik Benner of Mythics. In a recently published Forbes OracleVoice article, Erik forcefully argues for curbing such instinct and letting ML do its job without interference. Erik busts some common Systems management myths, arguing that Machine Learning can be very helpful in unexpected ways. Read the article for more on Erik's recommendations. Erik will be elaborating on this during a Webinar on Oracle Management Cloud on July 31st.  Want to get a quick hands-on experience with Oracle Management Cloud? Use our free EasyStart Kit and get started in under and hour!

Machine Learning (ML) is all around us. According to a new Constellation Research Survey, 70% of organizations are using it in some form. The rise of Machine Learning is supposed to transform the...

RTM Announcement for Oracle Enterprise Manager Cloud Control 13c Release 3 (13.3.0.0)

We are pleased to announce the release of Oracle Enterprise Manager Cloud Control 13c Release 3 (13.3.0.0). Oracle Enterprise Manager is Oracle's integrated enterprise information technology (IT) management product line, which provides the industry's only complete, integrated, and business-driven enterprise cloud management solution. Oracle Enterprise Manager creates business value for IT by leveraging the built-in management capabilities of the Oracle stack for traditional and cloud environments, enabling customers to achieve unprecedented efficiency gains while dramatically improving service levels. Oracle Enterprise Manager 13.3 introduces many new features for database, cloud and middleware management, such as: Support for monitoring and management of Oracle Database 18c Onboarding non-cloud DB/PDB to DBaaS Cloud Relocation of service instances across cloud pools PDB upgrade using Fleet Maintenance Modernization of UI stack for key database performance diagnostics capabilities like ASH Analytics and Real-time SQL Monitoring Support for Oracle Identity Management 12.2.x Management Support for Cloning of SOA or OSB-based Domains Versioned 12.2.1.3 and later JVMD enhancements to support large scale deployments & ALL request monitoring Uptake of JDK 7u171 and WLS April 2018 CPU for enhanced security For the full list of features and descriptions, see the New Features In Oracle Enterprise Manager Cloud Control 13c. Following platforms are supported in 13.3 release: LINUX.X64 SOLARIS.SPARC64 SOLARIS.X64 AIX.PPC64 WINDOWS.X64 HPUX.IA64 LINUX32 (Agent only) LINUX.ZSERIES64 (Agent Only) Release is available for download today on OTN. Oracle Enterprise Manager Documentation is available here

We are pleased to announce the release of Oracle Enterprise Manager Cloud Control 13c Release 3 (13.3.0.0). Oracle Enterprise Manager is Oracle's integrated enterprise information technology (IT)...

Oracle Management Cloud: Autonomous By Design

OMC? ... wait I thought the 'O' in it was for Autonomous :-) Oracle Management Cloud (OMC) is recognized by Ovum as a leader for Systems Management and Security and it represents a culmination of Oracle's Autonomous Cloud vision. I posit that OMC is Autonomous by Design and in this blog I'm going to explain why this is the case. The term Autonomous generally conjures image of self-driving cars, robots or unmanned vehicles that do difficult tasks without human intervention or those that significantly augment human capabilities. In other words, the power to make own decisions, being self-governing and being better by being independent. OMC grew out of a similar desire. Network Operating Centers (NOCs) and IT Ops organizations have been inundated with ever increasing data from application metrics, server (whether host or VM or container driven) metrics, real and synthetic user data, diagnostic logs, transaction traces, configuration and compliance reports, tickets, alerts, network events and other data streams. Over time data-centers have expanded their footprint by hosting dozens of VMs in place of a single host and the application of DevOps principles has driven development into enormous diversity. Meanwhile, heterogeneous application stacks multiplied due to a much greater application deployment cadence and Containers and Cloud have driven heterogeneity to a new level of complexity. This has caused data streams to multiply enormously. There are almost as many monitoring and management tools to make sense of this data, but each is typically "specialized" to its own tier. Network outages have become common because managing such a wealth of data through established practices and narrow tools became increasingly unwieldy and impractical. Now, add cyber-security issues to this mix. These are delivered not by lonesome hackers wanting to prove their hacking prowess, but rather by well-funded organizations keen and willing to sustain long engagements, to try and crack open cyber defenses through a wide range of cyber-hacking tools available in the underground black market (the so-called "dark web"). You now have a situation that is far more complex. Add to this above list of data streams, security related streams like global threat feeds or Identity driven traces or security events and the data muddle gets even harder to tackle. OMC was Oracle's vision for tackling this deluge, in a way in which smarter, machine-operated methods would be used to pick out the crucial needle of anomalies from a haystack of repetitive and boring, easy to miss events. OMC had to build-in some incredible smarts into this solution. We set upon this task by doing two things that provided the solution with the autonomy it needed: building a unified data platform so that all the input streams could be meaningfully mapped and then applying popular machine learning techniques and auto-remediation to the data. Machine learning with careful supervision vitally allows powerful, non-interventional decision making. Popular techniques employed are: Anomaly detection that flags unusual resource usage, identifies configuration drift, etc Clustering which filters out signals from noise and aggregates topology-based data Correlation which resolves dependencies and groups alerts on related symptoms Forecasting which prevents outages before they can happen and helps in capacity and resource planning While Machine Learning is at the basis of autonomy, there are two broad categories for minimizing management labor: Eliminating effort associated with maintaining legacy management tools: this includes managing the unified data platform, upgrading and patching it, elastically growing according to expanding needs, updating with security patches, encrypting data in transit, etc Eliminating effort associated with using legacy management tools: this includes zero-effort techniques to set baselines and thresholds, automatic topology discovery and correlations, Machine learning techniques that have been extensively taught to follow patterns, behaviors and heuristics, various telemetry contexts so that anomaly detection, clustering, correlation and forecasting can be done without extensive data science knowledge on the part of the user. Additionally, automatic orchestration and remediation can be used for preventive and corrective actions. Oracle Management Cloud was built for today's complex environments: heterogeneous stacks (not just Oracle software or hardware), hybrid cloud environments, mix of on-premises and cloud solutions, going beyond firewalls to track users through their Identity and associated Entities. By building a unified data platform, OMC delivers services that are fully integrated between performance monitoring, infrastructure and IT analytics, Log analytics, compliance and configuration, orchestration/remediation and security monitoring and analytics. Whenever I present OMC to customers, they are often astonished to see that we have chosen to integrate traditional Systems Management with Security, but in its original architecture, this is the most logical conclusion. Security and Systems Management are really two different faces of the same coin. Log Analytics is the basis for Security Monitoring and Analytics as well as Systems Management because logs contain both application diagnostic as well as security information; the logs are parsed similarly, but the various fields are enriched differently. Configuration drift is both a Systems issue and a Security issue. User Behavior is at the basis of Performance optimizations and DevOps on the Systems side, and UEBA (User and Entity behavior analysis) is the basis for Security analysis. Topology is central to Systems trouble-shooting, and also key to understanding the Security Kill Chain. Anomaly detection means outliers and trends on the Systems side and they are fundamental to Security. Historical samples inform forecasting, clustering and anomaly detection on the Systems side and Kill Chains on the Security side. SQL deep-dives are important for Performance trouble-shooting and also to detect Security anomalies. Remediation is common to both. There are so many similarities between them that can unite them; indeed even at the top level, Data Center outages and Cyber-security threats are not seen as distinct events either.  Thus, the OMC architecture of having a unified data platform and then running well-trained Machine Learning algorithms on it and applying auto-remediation is a great mechanism for tackling both types of problems equally well. In retrospect, it feels like OMC's decision to build such a platform is such a brilliant move. But in many ways, it is the logical culmination of thinking that tomorrow's problems need to be solved by machines that work autonomously, that learn as they go, and combat the twin scourges of outages and cyber-security threats by being aggressively based on a smart learning platform combined with automated remediation. This is what makes OMC Autonomous by design. Related Reading: Give Yourself an Edge: Use Machine Learning for Managing IT Operations Read more about Oracle Cloud's Autonomous capabilities

OMC? ... wait I thought the 'O' in it was for Autonomous :-) Oracle Management Cloud (OMC) is recognized by Ovum as a leader for Systems Management and Security and it represents a culmination of Oracle...

What Would You Do With Autonomous Machine Learning For IT Management?

Machine learning is showing up everywhere. The near-ubiquitous help from ‘Siri’ or ‘Alexa’ or ‘hey Google’ allows us to make queries with our voice for example.  Machine learning is driving innovation in every industry, including healthcare, where machine learning helped identify 52%1 of breast cancer diagnoses up to a year ahead of being actually diagnosed. And automotive forecasts predict fully autonomous vehicles on the road in 2022. This begs so many questions, from how will we spend our newly available time to how will we own vehicles of the future. What's on your IT management machine learning wish list? Do any of these make your priorities? Monitor my apps without all the false positives Most IT managers are familiar with alert fatigue. How many of you have created email filters to remove alerts from your inbox? It’s a laudable goal for machine learning since it’s designed to learn from examining metric (time series) data to establish a dynamic normalized baseline. Alerts are raised based on anomalies with this baseline, rather than through static thresholds.   Troubleshoot ten times faster Unplanned downtime causes havoc for virtually every company.  No matter how much you prepare, problems will occur, and the challenges continue to worsen with the growing number of dynamic, more complex environments with applications running across multi-cloud and on-premises environments. Problem-solving can require hours of your best people in war rooms, each with their own tools, trying to identify anomalies, and correlate issues.  On the other hand, topology-aware log exploration makes it easy to troubleshoot problems. You can utilize machine learning techniques like cluster to find the outliers or trends. You can use the link feature to understand latency issues across various components or steps or tiers in a given transaction. Using link along with cluster, for example, will find the outliers among all steps or components that together result in unusually long latencies and often point at steps or components which cause the slowdown or problem. Maximize utilization and capacity of my resources, both cloud, and on-premises This is an age-old challenge, often requiring valuable team members to go from system to system, manually looking for utilization information. Typically this means only seeing a slice of time and taking many hours to get an analysis together.  Many in IT are taking advantage of the ability to scale up with the cloud, which fixes half of the problem, and would appreciate saving costs by scaling down when it's not needed.  Machine learning is a perfect tool to take massive amounts of usage data to predict utilization trends, identify largest users of resources, or fastest growing applications and it can be done in real-time with zero data collection effort, then scale up or down, automatically as needed to save IT resource expense, whether on-prem or in the cloud. Analyze all my data not just some of it This is a common problem of the previous generation IT tools.  It’s expensive and or difficult to store and query larger amounts of data, especially when you’re keeping it on-premise, and have to purchase, and install the storage and compute systems yourself. The challenge is even more difficult with the proliferation and growth of data being generated.  So much compute and storage capacity is needed it ‘s been prohibitive in the past.  You get a short window of time or pieces of application or infrastructure data and piece information together manually.  These problems are well suited for big data and machine learning-based solutions where the more data, the better, and massive scaling up and scaling down in the cloud makes it all possible. Give me complete visibility without needing many tools When applications were relatively stable and monolithic, it was common to have one set of tools to monitor and manage your applications, another for the mid-tier, and more for your database, networks, and storage.  With the advent of the cloud, you can just about double it for each cloud vendor. And then there is the rapid pace of change with mobile and online applications and new faster delivery models like containers and serverless change the game. The silo-specific tools of the past just don’t provide the visibility you want, into an application stack or across the DevOps spectrum.  You want something that can dynamically and even autonomously adjust as your applications and environments change, something built using machine learning.   Photo credit: Quora and Deep Networks What if you could design a machine learning based system for your IT responsibilities? After delivering IT operations management tooling for decades, and listening to 10s of 1,000s of users and executives, Oracle designed a new system to do just that.  Based on the demands of IT professionals, some of the design tenets include:   Simplify set-up and management of the tool itself.   Make it fast and easy to use, and agile to adapt. Integrate all the data, across on-prem assets, and any cloud and any application. Build it on a big data platform that scales, and leverage machine learning. Deliver insights to IT, without having to be a data scientist or requiring the ability to code machine learning algorithms.   A new chapter in Automation: Autonomous Management Oracle Management Cloud with embedded automation capabilities, enables IT operations to reduce risks, and increase DevOps agility.  An integral part of Oracle’s adaptive, intelligent security and systems management portfolio, Oracle Management Cloud provides customers with a complete and integrated solution for managing and securing hybrid IT environments. Customers and partners around the world are already accelerating performance with Oracle Management Cloud, including Accenture, Amis, Astute Business Solutions, Betacom, Bias, Compasso, Fors, Future Robots, Infosys, Kapstone, Mythics, OneGlobe, Promata, Tech Democracy. Image: Oracle Management Cloud is a Unified SaaS Platform Oracle Management Cloud leverages a unified data platform to ingest the full breadth of operational data shown on the left, both structured metrics and unstructured log data, and from global threat feeds and access identity to user experience metrics, both real users and synthetic including transaction latency, browser and user device to server side data from web app, and database transaction metrics, down to platform metrics and logs, from containers, virtual machines and OSes to compute and storage data.  Once unified into a single dataset in the cloud, a high-powered big data platform can crank out more complete insights from machine learning algorithms.  Unlike other options where only part of the dataset is available, the unified dataset enables more complete insights with less human intervention required.  There are other advantages to having the entire dataset. Oracle Management Cloud data can now be viewed from any number of points of view, for example for monitoring apps from top-level key applications in real time. You can also view the performance of each component of the full IT stack or you can view across the estate of infrastructure or databases for example, from a point in time, to multiple months for capacity planning or cloud utilization.  Arguably, the most valuable capability is using all the data, along with security feeds to monitor in real time and also over time to look for threat vectors systematically and rapidly.  Finally, with these rapid insights, you also have the option of using automation to trigger prevention steps before issues impact customers or apply corrective actions automatically.  So, for example, with all this data unified together, you can analyze security vulnerabilities in real-time, check compliance and even automate enforcement of compliance rules automatically based on your needs. It’s a SaaS product, which means you use it with no maintenance required.  You are up and running nearly instantly, and It’s designed for IT operations and DevOps, with pre-built ML capabilities that answer IT questions.  You don’t have to develop your inner-data scientist to use it.  Comprehensive, Intelligent Management Platform One aspect of a unified solution is the opportunity to design for IT workflows.  Like monitoring apps or databases or infrastructure, then when you see an issue, troubleshoot it.  With out-of-the-box machine learning algorithms designed specifically for IT, you get the benefit of the system highlighting normal dynamically, and finding a statistically significant change in user performance metrics, and then, within context of the issue identified, OMC can present the relevant log records filtered specifically to the issue and area you've been monitoring with no delay, no human intervention, no switching to another system.  That's the power of unified systems management. Even though IT organizations have been investing in automation for several decades, benefits haven’t kept up with the proliferation of the tools that claim to bring yet new levels of automation. One major challenge is too many tools. Now they are delivered in the cloud too. The issue really is the complexity that results when you have to make decisions based on different tools that weren’t designed to work together. Oracle Management Cloud provides a unified solution that not only brings your data together, it also provides solutions across the entire spectrum of IT operations management as depicted in the diagram. Furthermore, these tools work across heterogeneous environments and hybrid cloud so you can get end-to-end visibility and comprehensive insights about your IT environment as well as automate response actions. Zero-Effort Operational Insights At its core, Oracle Management Cloud is built to answer IT questions, and support IT workflows.  Yes, it's built on a big data platform and it applies machine learning to the entire data set. As a user of the system, you don’t need to worry about data collection, aggregation, normalization and the associated big data analytics as well as the machine learning algorithms. The system continuously examines the environment and constantly refines thresholds. You will not need to define thresholds for your alerts. They are automatically set for you. You will be presented with IT ready dashboards to answer your most common questions. to accomplish this, Oracle Management Cloud is prebuilt to employ key machine learning techniques out of the box: Anomaly detection; flags unusual resource usage and non-standard application behavior Clustering; groups alerts or data on related symptoms Correlation; discovers dependencies, allowing stack trace views Forecasting; Forecasts outages before they happen; enables easier capacity and resource planning Automated Preventative and Corrective Actions There are siloed orchestration solutions available, but with insights in-hand, a complete solution builds in capabilities to orchestrate responses and remediation. What if your system identified an application that would reach maximum utilization in the next day? With an automated response, you can spin up additional resources.  What if the system detected a security risk? The system can be set to automatically turn off permissions to specific users for example without requiring a separate orchestration tool.   What are others saying? The results customers are seeing cover the gamut from saving costs to reducing downtime to making what previously seemed impossible, just work.  For example, a company is using the platform for managing their robots that interact with humans.  Photo credit: FutureRobot Attendees at this year’s Winter Olympics have some fun with FutureRobot’s FURo-D. “To ensure a seamless interaction, we must collect and analyze massive amounts of human-robot interaction data in order to train our robots to respond appropriately, refining with social AI,” said Youngki Hwang, chief technology officer, FutureRobot. “We use Oracle Management Cloud to collect that data as well, noting factors such as the number of people approaching a robot and interacting with it, users’ emotional data based on facial recognition technology, the conversations people have based on voice recognition technology, and statistics on the content people access.”  Future Robots is also using Oracle Management Cloud to collect operating data on each of its robots, such as location, sensors, CPU and memory use, battery level, and network status - alerting the company to any problems. “Compasso is managing the infrastructure supporting over a dozen e-commerce environments with Oracle Management Cloud,” said Ernie Molinaro, Divisional President, US, UK, and Canada, Compasso.  “Leveraging its autonomous management capabilities, including unified data collection, machine learning analytics, and forecasting, Oracle Management Cloud has given Compasso a 50 percent increase in productivity and has enabled us to automatically identify and resolve anomalies that point to potential areas of concern.” “We are supporting our customers in their transformation to DevOps and faster time-to-market,” said Lucas Jellema, Chief Technology Officer of Amis,.  “Oracle Management Cloud’s autonomous management capabilities help us avoid costly outages and proactively resolve issues so that we can maximize developer resources while achieving better performance.” For more customer testimonials and videos, visit our customer references site. Are You Ready To Try It? If an autonomous management cloud sounds like something you’ve been wishing for in your IT environment, it is easy (and free) to give it a try.  The Easystart kit is designed to give you a hands-on first-hand experience within minutes. You can start with a simple use case for troubleshooting your database environments and then expand to many more use cases. Oracle Management Cloud is available for trial at oracle.com/easystart 1 Forbes 9.30.16 What Are The Top Use Cases For Machine Learning and AI p.p1 {margin: 0.0px 0.0px 0.0px 0.0px; font: 11.0px 'Lucida Grande'; color: #000000}

Machine learning is showing up everywhere. The near-ubiquitous help from ‘Siri’ or ‘Alexa’ or ‘hey Google’ allows us to make queries with our voice for example.  Machine learning is driving innovation...

Security Automation Is Critical

​Forrester made a case in a September 2017 report ("Overcoming SecOps Hurdles Decreases Risk While Improving DevOps Efficiency") that 30% companies cite lack of automation for integrations and configurations as a top challenge. The just released Oracle and KPMG Threat report also asserts that 84% of companies are committed to increased levels of security automation, but only 35% actively invest in such solutions (others are still in technical evaluation and planning stages). The mindset is changing from where IT and cybersecurity professionals were resistant to automating, to where it is now being viewed as a fundamental technology to efficiently respond to events and alerts. Automation promises operational efficiencies and to close up security gaps. Combined with Machine Learning, security automation can improve the agility of cybersecurity teams so they are not lagging behind their DevOps colleagues. Clearly, there are some significant hurdles to overcome in order to achieve this. Dan Koloski has a recent opinion piece in Dark Reading that advocates for automation to be an essential part of the IT toolkit. Dan explores four possible barriers to its adoption: Lack of confidence in decision making which is attributable to an upstream analytics problem Not everything lends to automation. In particular, platform choices often hamper this freedom, but this really is a platform conversation opportunity where security experts should now be making recommendations that are mutually profitable to both SecOps as well as Development Afraid of losing control. This cultural problem needs baby steps for confidence building and the suggestion is to start by automating forensics and lightweight remediation Security vs DevOps. This is a classic problem now that automation is more readily accepted by developers than by Ops. So its best to partner up and combine the practices to build a smarter DevSecOps process Dan concludes by observing that these problems are not inherently of automation and so represent a multi-pronged opportunity to fix and improve overall efficiencies. Indeed, today's overwhelmed cybersecurity professionals must rely on smart ML-driven analytics and combine them with automation to have a chance to go toe-to-toe with increasingly sophisticated hackers. Otherwise, this is a battle where we will quickly fall behind and lose. Related Reading: Better Security Analytics? Clean up the data first Give Yourself an Edge: Use Machine Learning for Managing IT Operations Automatic. Secure. Integrated.       

​Forrester made a case in a September 2017 report ("Overcoming SecOps Hurdles Decreases Risk While Improving DevOps Efficiency") that 30% companies cite lack of automation for integrations and...

IDC Report: Strategic Priorities for IT Operations Analytics

Contributing Authors: Stephanie Hlavin, Oracle & Moe Fardoost, Oracle As a global analyst firm, IDC speaks to businesses of all types and sizes and the IT staff that work within them. In a recent report, Tim Grieser, Research Vice President at IDC, wrote about his research on the role of cloud-based analytics and machine learning for hybrid IT management. On May 16, hear more from Grieser about what’s driving organizational strategies for IT operations and some of the emerging tools available to help. Pre-register for the webcast, Accelerate Hybrid IT Management with Cloud-Based Analytics and Machine Learning. In a recent survey of 200 organizations, IDC asked IT leaders at each to identify what their top strategic priorities for IT operations analytics were now through 2020. Answers ranged from, ‘improving development productivity,’ to ‘establishing a more proactive infrastructure life-cycle management and workload migration.’ But the top-three, most-pressing priorities for IT Ops were: Improve security and compliance Improve IT infrastructure capacity planning/utilization Increase quality of digital engagement with customers and partners Do these three priorities resonate? You may have felt this pressure at work already, but the IDC survey report puts research behind it: to respond to competitive pressures, the impact of disruptive technologies, and constantly increasing user expectations for speed of delivery, IT Ops teams are going to need a new breed of automated system management solutions. But why? Grieser states multiple reasons for increasing adoption of cloud-based management solutions, but one of the most compelling he discovered is tied to dissatisfaction with the outdated approach business tends to take when addressing IT Ops. Traditional IT management tools are fragmented and IT-silo based. This leaves IT Ops with the difficult task of piecing together information to detect and analyze the impact of anomalous events, service quality and end-user experience issues. And that brings us to the other elephant in the room: the substantial and ongoing human effort required to manage the entire collection of toolsets. The report describes the advantages of a Software-as-a-Service based approach to address siloed tools and as an effective way to free IT staff from the necessity of managing the management platform itself. IDC’s Grieser and Oracle’s Moe Fardoost, Senior Director of Product Marketing, Oracle Cloud Business Group, will host an hour-long, live webcast, May 16, where they will share more details about the report. You will also learn how Oracle Management Cloud incorporates big data analytics and machine learning technologies with integrated automation to help customers manage IT environments now and in the future (to 2020 and beyond). Register for the Accelerate Hybrid IT Management with Cloud-Based Analytics and Machine Learning webcast.

Contributing Authors: Stephanie Hlavin, Oracle & Moe Fardoost, Oracle As a global analyst firm, IDC speaks to businesses of all types and sizes and the IT staff that work within them. In a...

A Simple Guide to Oracle Management Cloud At Collaborate

Collaborate18 at Mandalay Bay Las Vegas | April 22-26 • 1000 sessions • 200 exhibitors Oracle Management Cloud will be well represented at Collaborate18 with Workshops, Demos, Sessions and Social Time.  Attend sessions, use the hands on lab, or ask your questions to Oracle Management Cloud experts at the exhibitor hall. 5 OMC partners exhibiting 6 OMC sessions OMC Workshop 1 OMC Demo Kiosk Plan your OMC schedule: 4/22 Sunday 9:30 am – 4 pm Oracle Cloud Journey Hands-On Lab – Erik Benner Ace Director, Mythics  4/23 Monday 4:15 pm – 5:15 pm Lecture Advance from DBA to Cloud Administrator  South Pacific Ballroom I Erik Benner, Ace Director Mythics, Tim Mooney Oracle 5:15 pm - 8:00 pm - Welcome Reception in the Exhibition Hall • Meet with OMC experts, ask your questions. 4/24 Tuesday 11:00am -noon Lecture & Demo Getting Started with Oracle Management Cloud  Debu Panda, Oracle 5:15pm - 8:00 pm - Exhibitor Showcase Happy Hour • Meet with OMC experts, ask your questions. 4/25 Wednesday  8:30 – 9:30 am Lecture Security Monitoring and Analytics for Hybrid Cloud Environments Jasmine G Joe Diemer, Oracle 11 am – Noon Lecture & Demo Learn 10 New Things: Using Oracle Enterprise Manager with Oracle Management Cloud Jasmine E Debu Panda, Oracle 4/26 Thursday  8:30 AM–9:30 AM Lecture Performance Excellence for Your Databases and Applications  Lagoon J Scott Mcneil, Oracle Exhibition Hall Hours • Mon 4/23 - 5:15pm - 8:00 pm - Welcome Reception in the Exhibition Hall Tues 4/24 - 9:30 am - 4:15 pm - Exhibit Hall Open Tues 4/24 - 5:15 pm - 7:00 pm - Exhibitor Showcase Happy Hour Wed 4/25 - 10:15 am - 4:15 pm - Exhibit Hall Open   Key Partners Exhibiting at Collaborate18 Application Software Technology(AST) LLC Apps Associates Centroid Systems Inc. Deloitte Global Services Keste  

Collaborate18 at Mandalay Bay Las Vegas | April 22-26 • 1000 sessions • 200 exhibitors Oracle Management Cloud will be well represented at Collaborate18 with Workshops, Demos, Sessions and Social Time....

Log Analytics for DBAs in Just 3 Steps or Zero To Solved in 60 Minutes

You get the call, a customer is complaining about a non-responsive application.  Is it the database, or the application? Or something else?  And your journey begins. You check the usual, CPU utilization is okay, so is memory utilization.  It's not long before you're headed to the Database Event Logs to see if it's a problem with the database.   Wouldn't it be nice if there was an easy way to automatically see the application topology? And better yet, the topology and hot spots show up automatically too.   Enter Oracle Management Cloud Log Analytics OMC is cloud-based, built on a big data platform with machine learning built in.  It ingests your log files and Enterprise Manager data, and with machine learning automation, helps provide answers to your top questions.   Where is the problem? What caused it? You can quickly identify where anomalies have occurred, then double click to investigate out what happened, when.  Log Analytics designed to include enhanced features for Oracle DBAs, only Oracle could provide. For example, you see where the problem is and can double click those red nodes showing problems to get more detail about what is causing the abnormal behavior.  That's what you can do with OMC log analytics.   By applying machine learning to the log data, you can cluster together what's normal and what's not with a couple clicks as shown in the image below.  Thank you Maaz Anjum for the images, and blog post.   EasyStart Kit And now there is an EasyStart Kit designed to provide you with step-by-step guidance and scripts and sample data to get you up in running in 60 seconds, err minutes.  And the Kit is free, and you can use free $300 cloud credits for a trial.  Do you want to get started with your own data? There's guidance for that too.  There are many features in Oracle Management Cloud worth investigating, and as I discussed with Mughees Minhas, the fastest way to success is to pick your use case, define your objectives and focus on that specific use case before expanding to additional use cases.

You get the call, a customer is complaining about a non-responsive application.  Is it the database, or the application? Or something else?  And your journey begins. You check the usual, CPU...

Let me tell you a heartwarming customer engagement story

This is a guest post by our UK Oracle Management Cloud specialist Lee Bonfield. You can follow Lee on Twitter at @lee_oraclecloud As a specialist who helps customers modernize their Systems Management , it’s really motivating when a customer goes live and see them getting immediate value. Together we can help grow their overall business. Willis Towers Watson My engagement with Willis Towers Watson is right up there in terms of best engagements though as it culminated in a UK Customer Excellence Award and a donation by Oracle, on the customer’s behalf to Macmillan Cancer Support – a cause that’s close to my heart. More on that later. They were spending a lot of time fire-fighting service requests, on the phone to vendor support call-centers and holding war-rooms, so we started by looking at the customer’s application performance. The insights they got from the deployment of machine learning powered Oracle Application Performance Monitoring (APM) and Log Analytics helped them reduce the amount of effort spent on those reactive activities and meant they had more time to spend on more pro-active stuff. As a result, service requests reduced and stress on the team calmed. The team generally felt more in control and when a Sev1 did appear, they had the tools to find the needle in the haystack – and there were several, pretty large haystacks! Next, they also deployed Oracle Infrastructure Monitoring (IM), so as well as understanding how the Application tier was performing, WTW could also ‘join the dots’ with the underlying Infrastructure and build a bird’s-eye-view of the application typology.  If APM told them the app was under-performing, IM could tell them (in-context) where to look. Further, Log Analytics could also then tell them WHY there was a problem by applying machine learning in correlating and analyzing the associated log files – again in full context of the entire application and the timeframe of the issue. Having a toolset that was integrated by its very nature, made trouble-shooting a breeze. Oracle and WTW are now going to the next level and deploying Oracle IT Analytics. This is the part of Oracle Management Cloud that capacity plans for the future, making the customer even more proactive when it comes to solving those application and infrastructure issues.  Customer Excellence Award Modernizing WTW’s IT Operations with a single, holistic systems management platform, led them to winning the "Simplify IT" award of the aforementioned UK Oracle Customer Excellence Award on March 22nd. They were handed a cheque for £10.000 for the Macmillan Cancer Support organization on their behalf.  A truly motivating, heartwarming and inspirational night, hearing from several customers on how Oracle technology is helping them and from their associated charities on the work they do in the community. If you would like to get involved in helping Macmillan, make sure to visit their site and get involved.They fill a much needed gap in supporting families and patients through a difficult time. Lee

This is a guest post by our UK Oracle Management Cloud specialist Lee Bonfield. You can follow Lee on Twitter at @lee_oraclecloud As a specialist who helps customers modernize their Systems Management...

Oracle Management Cloud a Leader in Multicloud and Hybrid Cloud Management

In a  recent blogpost, my colleague Scott McNeil wrote about how hard it is for organizations in today’s fast paced market to maintain and manage the complexity and volatility  of their hybrid application and IT infrastructure. IT modernization is all about being flexible to meet the present and future demands of your business, so choosing a Multicloud and/or Hybrid Cloud Management solution is a critical success factor but no easy task. This challenge is well understood by industry experts. A great example is the latest work by OVUM, a market-leading research and consulting business. Their new Decision Matrix: “Selecting a Multicloud and Hybrid Cloud Management Solution 2018-2019” provides solid guidance.   The Ovum Decision Matrix (ODM) provides a side-by-side comparison and evaluation of management solutions and vendors, supported by rigorous analysis: 10 dimensions of technology assessment 6 dimensions in execution assessment 4 dimensions on market impact Oracle Management Cloud Some of the highlights, as they relate to Oracle Management Cloud, in the report: Oracle recorded strong scores in the execution and market impact dimensions, where it was above the dimension average. However, it was in the technology dimension where it was above average in all categories Oracle was the most open of all the vendors, supporting more than 10 different virtualization technologies Oracle's strength comes from being able to monitor at different levels, from the base infrastructure to the abstracted container Oracle scored above average in 17 out of 20 categories evaluated, two were category leading If you have been following our monthly releases  of Oracle Management Cloud, you know by now that we are introducing innovations in SaaS-based management at a phenomenal pace. It is no wonder that Oracle Management Cloud was selected by Ovum as a leader in this space. I would recommend the Ovum Decision Matrix if: You are an existing Oracle customer with investments in database and applications technologies in your own data centers as well as Oracle’s Cloud Platform and Infrastructure. You are new to Oracle and have a heterogeneous IT environment composed of Open Source and proprietary technologies. Your IT assets run on multiple cloud providers such as Amazon AWS and Microsoft Azure and you are still looking for that single pane of glass for your security and management objectives. Click here to download this complimentary full Ovum Decision Matrix and learn why Ovum named Oracle a leader in the space. For more information about Oracle Management Cloud and your FREE trial, please visit us at oracle.com/managementcloud.

In a  recent blogpost, my colleague Scott McNeilwrote about how hard it is for organizations in today’s fast paced market to maintain and manage the complexity and volatility  of their hybrid...

What DBAs Ought to Know About Modern Database Management

63% of companies surveyed say their number of applications is growing.  66% say managing those applications and databases has a negative impact on competitiveness.  If you are a DBA facing these challenges and striving to be a DBA superstar, you'll learn valuable lessons from my recent interview with Mughees Minhas, Oracle VP, Product Management, Database Management We talked about the DBA's changing role especially around the tools they use, including Enterprise Manager, and Oracle Management Cloud (OMC), Oracle's new cloud-based management solution.  Mughees has an interesting background, not only having worked on many of what now makes up the Autonomous Database, he is responsible for the group who develops Enterprise Manager, and is also responsible for facets of Oracle's new Oracle Management Cloud.  The theme of my questions to Mughees are around DBAs, and in particular, what is the future of management tools for DBAs. In his current role, he is helping to shape that future with new technologies within Enterprise Manager and complementing those tools with modern functions best delivered on a cloud platform.  Listen in, and let me know your comments. Figure 1: Cloud-based log analytics simplifies database troubleshooting.   Listen to the Podcast  Join the conversation: What are your most challenging database management problems?  

63% of companies surveyed say their number of applications is growing.  66% say managing those applications and databases has a negative impact on competitiveness.  If you are a DBA facing these...

Give Yourself an Edge: Use Machine Learning for Managing IT Operations

In today’s fast pace market, every business is looking for ways to improve efficiencies to gain an edge. Whether it’s using technology to try and streamline operations or using it to drive innovation. One of the major problems for your typical IT organization is that they’re being asked to deliver more and more services and applications at a faster pace while at the same time experiencing a rapid growth in their application portfolios. As a result, IT organizations are seeing more emergencies and fire drills with the onset of more web and mobile enabled applications. Trying to maintain and manage the complexity and veracity of these applications is taxing on IT. Here’s an interesting figure from a recent multi-user group survey; over 85% of customer-facing issues are reported first by users, and 32% of calls/emails about slow application performance are from senior management. So how do we address these challenges? Do you add more monitoring tools or IT resources to the equation? According to IDC, close to 92% of enterprise IT organizations currently have one or more monitoring tools in use, but yet 55% of those in the report recognize that they need new solutions designed for the scale and complexity of the digital business, hybrid cloud and big data. So as the need for new cloud-era monitoring solutions grows to keep up with the pace of change—it’s the traditional methods that lack the capabilities to merge and integrate all the segregated log files and operational data that are coming in from the next-gen applications. Why is this important? Well, logs and operational data hold the key to unlocking true insight into what’s really happening within your applications and system environments. One way is to bring the data silos together under one platform so you can analyze and dissect what’s really happening.  This helps to eliminate any gaps you might have, and gives you a complete picture of what’s going on inside your applications environments. Once you have a solid foundation of unified data, you can then apply machine learning to uncover potential anomalies and issues that would be normally hard to detect using traditional methods. Oracle's Vice President, Product Management & Business Development Dan Koloski is being interviewed during Oracle Code on why machine learning in systems management and security is great for developers. Machine learning gives you the edge you need to find and detect problems automatically. It’s a very natural fit for systems management and security because you can apply some intelligence to separate out the real issues from all the noise. Machine learning can help identify important patterns in your data and by clustering them, it can help you focus on the most urgent issues. You gain a faster time to resolution for troubleshooting problems that impact users and customers.  And with today’s data growth exploding, you need tools that automate and remediate these issues quickly. One advantage to doing all of this in the cloud, is that you can significantly reduce implementation time and deployment delays from months to weeks to even days. According to industry analysts cloud-based systems management is among the fastest growing IT Operations and Analytics markets. Watch this video to learn how one customer is using machine learning to monitor hundreds of thousands of transactions per second. Highlights from Oracle OpenWorld on managing applications using machine learning to improve performance by detecting anomalies automatically in real-time. Bottom-line: use technology such as machine learning to boost application and infrastructure performance and cut down time-to-resolution of issues so you can advance your business edge.

In today’s fast pace market, every business is looking for ways to improve efficiencies to gain an edge. Whether it’s using technology to try and streamline operations or using it to drive innovation....