By mike on Oct 12, 2011
Today I was asked how to monitor the bandwidth of the Exadata Infiniband switch DCS 36p? There are two ways, the simplest method is to use the Fabric Monitor (ILOM Web Interface), and the other way is just to use SNMP requests:
- Fabric Monitor
Connect to the Oracle ILOM web interface of the switch, select Switch/Fabric Monitoring Tools, and launch the SUN DCS 36p Monitor. You can then select the IB Performance Tab to monitor the receive (RX), the transmit (TX), and the overall bandwidth per port.
Refer to Using the Fabric Monitor/IB Performance Tab
You can run snmpget/snmpwalk requests against the switch to get detailed counters for received/transmitted data as well as packet counters for each port:
ibPmaPortXmitData - Display the number of data octets, divided by 4, transmitted on all virtual lanes from the port.
ibPmaPortRcvData - Display the number of data octets, divided by 4, received on all virtual lanes at the port.
ibPmaPortXmitPkts - Display the number of packets transmitted on all virtual lanes from the port.
ibPmaPortRcvPkts - Display the number of packets received from all virtual lanes on the port.
The SUN-DCS-MIB MIB file is part of the DSC 36p firmware patch 11891229 that you can find and download in MOS Patches & Updates:
11891229 SUN DCS 36P INFINIBAND SWITCH VERSION 1.3.3 (Patch)
$ unzip p11891229_133_Generic.zip
$ gunzip SUN_DCS_36p_1.3.3.tar.gz
$ tar xvf SUN_DCS_36p_1.3.3.tar
Refer to PMA Extended Port Counters Table OIDs & SUN-DCS-MIB MIB OID Command Syntax
For complete information, please visit the Sun Datacenter InfiniBand Switch 36 Topic Set