HP StorageWorks Scalable File Share - Manual (Page 165)

Verifying the system 6–35
6.1.8.4 Examining the Voltaire InfiniBand interconnect HCA adapter and interconnect link
This section describes how to identify and isolate problems on the Voltaire InfiniBand interconnect. The
procedures described in this section apply only to the portion of the interconnect that connects the server in
the HP SFS system to the switch infrastructure of the InfiniBand interconnect. Specifically, diagnosing
problems with links within or between switches is not covered in this manual. It is assumed that switch
monitoring and use of the VoltaireVision® graphical diagnostic tool (from Voltaire, Inc.) is performed by and
on the client system to which the HP SFS system is connected.
Read this section in conjunction with the diagnostics manual of the client system (if one is provided). For
example, for an HP XC system, the diagnostics are described in the HP XC System Software Administration
Guide.
To verify that the Voltaire InfiniBand interconnect is working correctly, perform the following procedures:
1. Test for the presence of the Voltaire InfiniBand interconnect adapter (see Section 6.1.8.4.1).
2. Test the performance of the Voltaire InfiniBand interconnect (see Section 6.1.8.4.2).
6.1.8.4.1 Testing for presence of Voltaire HCA adapter
When a logical link is present (that is, the Voltaire InfiniBand interconnect is running correctly), the two LEDs
on the Voltaire Host Channel Adapter (HCA) are lit (one orange, one green) for the port connected to the
InfiniBand switch.
You can test for the presence of a Voltaire InfiniBand interconnect HCA adapter by logging in to the server
to be tested and entering the following command on the server:
# vstat
If the adapter is present and active, the output starts as follows:
1 HCA found
.
.
.
If the output does not start as shown above, see Section 9.25 for information on troubleshooting the Voltaire
InfiniBand interconnect. Section 9.25.3 contains a complete sample of output from the
vstat
command.
6.1.8.4.2 Testing Voltaire InfiniBand interconnect performance
You can test the performance of a Voltaire InfiniBand interconnect by running the
perf_main
command.
The command works as a server/client application between two nodes, and allows you to check the raw
bandwidth between any two nodes. (In this section, the term node is used to refer to any system that is
connected to the interconnect: a node can be a server in the HP SFS system, or a client node.)
To test the performance of a Voltaire InfiniBand interconnect using the
perf_main
command, perform the
following steps:
1. On one of the nodes that you are using in the test, enter the following command:
# perf_main --send -m bw -r write -n 1000 -s 262144
The output should be as follows:
********************************************
********* perf_main version 9.6 *********
********* CPU is: 3600.00 Mcps *********
********************************************
The first test node then waits for the second test node to start.