Document Type | Technical Information
Category | Monitoring/Inspection
Applicable Product Versions | 7FS02, 7FS02PS
Document Number | ZMOTI001
Overview
This explains how to check InfiniBand communication between servers in Zetadata 7.
Method
Perform the ibv_rc_pingpong command to check.
Note
In the case of a 2TAC-3SSVR configuration, the following relationships must be able to ping each other.
(Ping transmission and response must occur from all nodes connected via InfiniBand for normal operation)
- DB1 <-> DB2
- DB1 <-> SSVR1, SSVR2, SSVR3
- DB2 <-> SSVR1, SSVR2, SSVR3
- SSVR1, SSVR2, SSVR3 <-> SSVR1, SSVR2, SSVR3
[Example]
By default, ibv_rc_pingpong sends pings using the first DEVICE (mlx5_0). ex) To check communication between Node A and Node B: * Node A: ibv_rc_pingpong -d active device name on Node A * Node B: ibv_rc_pingpong -d active device name on Node B Node A's IP Node A: DB1 (ACTIVE DEVICE: mlx5_2, IP: 10.10.10.100) Node B: SSVR1 (ACTIVE DEVICE: mlx5_0, IP: 10.10.10.101) 1. On DB1, run "ibv_rc_pingpong -d mlx5_2" to prepare to receive communication. 2. On SSVR1, run "ibv_rc_pingpong -d mlx5_0 10.10.10.100" to send a ping to DB1's 10.10.10.100.