Wednesday Jul 31, 2013

IOUG SIG Webcast on August 7th : SQL Monitoring and ASH Analytics

The Oracle Enterprise Manager Special Interest Group (SIG) growing body of IOUG members who manage or are interested in all aspects of Enterprise Manager. This IOUG SIG is managed by volunteers and supported by Oracle EM product managers and developers. The purpose of the SIG is to bring relevant information and education through webcasts, discussions and networking to users interested in learning more about the product, and to share user experiences.

On August 7th at 10 AM pacific time, Oracle Enterprise Manager SIG is hosting a webcast on SQL monitoring and ASH analytics. In this webcast, Edward Whalen, Chief Technologist, Performance Tuning Corporation will provide a tutorial on how to take advantage of two of the powerful performance monitoring and debugging tools; SQL Monitoring and ASH Analytics.

After attending the session, the attendee should have a better understanding of:

1. Oracle Enterprise Manager Cloud Control 12c and how to take advantage of some of the key performance monitoring features.

2. The usage and basic properties of SQL Monitoring; how to invoke it and how to use it to identify long running SQL statements.

3. What ASH Analytics is, what is ASH data and how to use ASH Analytics for determining which sessions, modules or SQL statements are consuming system resources.


Stay Connected:

Twitter |  Face book |  You Tube |  Linked in |  Newsletter

Monday Oct 29, 2012

OS Analytics - Deep Dive Into Your OS

Oracle Enterprise Manager Ops Center provides a feature called "OS Analytics". This feature allows you to get a better understanding of how the Operating System is being utilized. You can research the historical usage as well as real time data. This post will show how you can benefit from OS Analytics and how it works behind the scenes.

The recording of our call to discuss this blog is available here:

https://oracleconferencing.webex.com/oracleconferencing/ldr.php?AT=pb&SP=MC&rID=71517797&rKey=4ec9d4a3508564b3

Download the presentation here

See also:

Blog about Alert Monitoring and Problem Notification

Blog about Using Operational Profiles to Install Packages and other content


Here is quick summary of what you can do with OS Analytics in Ops Center:

  • View historical charts and real time value of CPU, memory, network and disk utilization
  • Find the top CPU and Memory processes in real time or at a certain historical day
  • Determine proper monitoring thresholds based on historical data
  • View Solaris services status details
  • Drill down into a process details
  • View the busiest zones if applicable

Where to start

To start with OS Analytics, choose the OS asset in the tree and click the Analytics tab.

You can see the CPU utilization, Memory utilization and Network utilization, along with the current real time top 5 processes in each category (click the image to see a larger version):


 In the above screen, you can click each of the top 5 processes to see a more detailed view of that process. Here is an example of one of the processes:


One of the cool things is that you can see the process tree for this process along with some port binding and open file descriptors.


On Solaris machines with zones, you get an extra level of tabs, allowing you to get more information on the different zones:


This is a good way to see the busiest zones. For example, one zone may not take a lot of CPU but it can consume a lot of memory, or perhaps network bandwidth. To see the detailed Analytics for each of the zones, simply click each of the zones in the tree and go to its Analytics tab.


Next, click the "Processes" tab to see real time information of all the processes on the machine:


An interesting column is the "Target" column. If you configured Ops Center to work with Enterprise Manager Cloud Control, then the two products will talk to each other and Ops Center will display the correlated target from Cloud Control in this table. If you are only using Ops Center - this column will remain empty.


Next, if you view a Solaris machine, you will have a "Services" tab:

By default, all services will be displayed, but you can choose to display only certain states, for example, those in maintenance or the degraded ones. You can highlight a service and choose to view the details, where you can see the Dependencies, Dependents and also the location of the service log file (not shown in the picture as you need to scroll down to see the log file).


The "Threshold" tab is particularly helpful - you can view historical trends of different monitored values and based on the graph - determine what the monitoring values should be:

You can ask Ops Center to suggest monitoring levels based on the historical values or you can set your own. The different colors in the graph represent the current set levels: Red for critical, Yellow for warning and Blue for Information, allowing you to quickly see how they're positioned against real data.

It's important to note that when looking at longer periods, Ops Center smooths out the data and uses averages. So when looking at values such as CPU Usage, try shorter time frames which are more detailed, such as one hour or one day.


Applying new monitoring values

When first applying new values to monitored attributes - a popup will come up asking if it's OK to get you out of the current Monitoring Policy. This is OK if you want to either have custom monitoring for a specific machine, or if you want to use this current machine as a "Gold image" and extract a Monitoring Policy from it. You can later apply the new Monitoring Policy to other machines and also set it as a default Monitoring Profile.

Once you're done with applying the different monitoring values, you can review and change them in the "Monitoring" tab. You can also click the "Extract a Monitoring Policy" in the actions pane on the right to save all the new values to a new Monitoring Policy, which can then be found under "Plan Management" -> "Monitoring Policies".


Visiting the past

Under the "History" tab you can "go back in time". This is very helpful when you know that a machine was busy a few hours ago (perhaps in the middle of the night?), but you were not around to take a look at it in real time. Here's a view into yesterday's data on one of the machines:


You can see an interesting CPU spike happening at around 3:30 am along with some memory use. In the bottom table you can see the top 5 CPU and Memory consumers at the requested time. Very quickly you can see that this spike is related to the Solaris 11 IPS repository synchronization process using the "pkgrecv" command.

The "time machine" doesn't stop here - you can also view historical data to determine which of the zones was the busiest at a given time:


Under the hood

The data collected is stored on each of the agents under /var/opt/sun/xvm/analytics/historical/

  • An "os.zip" file exists for the main OS. Inside you will find many small text files, named after the Epoch time stamp in which they were taken
  • If you have any zones, there will be a file called "guests.zip" containing the same small files for all the zones, as well as a folder with the name of the zone along with "os.zip" in it
  • If this is the Enterprise Controller or the Proxy Controller, you will have folders called "proxy" and "sat" in which you will find the "os.zip" for that controller

The actual script collecting the data can be viewed for debugging purposes as well:

  • On Linux, the location is: /opt/sun/xvmoc/private/os_analytics/collect
  • On Solaris, the location is /opt/SUNWxvmoc/private/os_analytics/collect

If you would like to redirect all the standard error into a file for debugging, touch the following file and the output will go into it:

# touch /tmp/.collect.stderr  

The temporary data is collected under /var/opt/sun/xvm/analytics/.collectdb until it is zipped.

If you would like to review the properties for the Analytics, you can view those per each agent in /opt/sun/n1gc/lib/XVM.properties. Find the section "Analytics configurable properties for OS and VSC" to view the Analytics specific values.

I hope you find this helpful! Please post questions in the comments below.

Eran Steiner


Stay Connected:
Twitter |
Facebook | YouTube | Linkedin | Newsletter

About

Latest information and perspectives on Oracle Enterprise Manager.

Related Blogs




Search

Archives
« April 2014
SunMonTueWedThuFriSat
  
3
5
6
7
9
10
11
12
13
14
15
17
18
19
20
21
22
23
24
25
26
27
28
29
30
   
       
Today