NOTE: If the failed node is already offline, it is not necessary to shutdown the node because it is already not part of the cluster. Skip to step 12.
To replace a controller node:
1. Connect the maintenance PC to the SP using the serial connection and start an spmaint session.
2. In the 3PAR Service Processor Menu, select option 7 Interactive CLI for an InServ, then select the desired system.
3. Issue the shownode command to verify the node’s state.
cli% shownode
Control Data Cache Node -Name- -State- Master InCluster --LED-- Mem(MB) Mem(MB) Available(%) 0 1400510-0 OK Yes Yes GreenBlnk 16384 32768 100 1 1400510-1 DEGRADED No Yes AmberBlnk 16384 32768 100
4. Issue the servicenode start <nodeID> command to service the node. The node LEDs will appear blue.
5. Type exit to end the CLI session and return to the 3PAR Service Processor Menu.
Replacing a Controller Node 35
6. Before disconnecting the cables from the front of the controller node, note the locations ot the cables, or note or label them. The drive-side Fibre Channel cables are marked to simplify this task.
7. Select option 4 InServ Product Maintenance.
8. Select option 6 Halt an InServ cluster/node, then select the desired system.
9. Select the desired node and confirm all prompts to halt the node.
10. Allow 2-3 minutes for the node to halt, then verify that the node status LED is flashing green and the node service LED is blue indicating that the node has been halted.
11. Set the node power switch to the OFF position to turn off power on the node.
12. Wearing a wrist-grounding strap, remove the node:
a. Pull the insertion/removal levers out to release the node.
Figure 19 Opening the Insertion/Removal Levers on a Controller Node
b. Pull the controller node insertion/removal lever out to disengage the node from the chassis midplane.
c. Slide the node part way out of the chassis and hold the node by the bottom and top to remove and carry (Figure 20 (page 37)) and place it on an ESD-safe work surface.
Figure 20 Removing the Controller Node from the Chassis
Replacing a Controller Node 37
13. Remove the replacement controller node from its protective packaging and place it onto an ESD-safe work surface next to the failed node.
14. Because the replacement node will not contain any node-disk (SSD), PCI adapters or memory, the following must be performed:
a. One at a time, remove the node-disk and PCI adapters from the failed node and install them in the same slots in the replacement node. See“Replacing a Node Disk” (page 40) and“Replacing a PCI Adapter” (page 44).
NOTE: It may be necessary to remove some blank PCI slot covers from the replacement node to install PCI adapters. Install these slot covers in the failed node for return to HP.
b. Remove the top cover from both nodes and move the four control cache DIMMs and the eight data cache DIMMs to the replacement node, see“Replacing a Cache DIMM”
(page 47). Reinstall the top covers on both nodes.
15. Properly install the blank disk into the failed node. Refer to“Replacing a Node Disk” (page 40) for more information. If the disk in the failed node is questionable, replace the node disk and perform node rescue on the blank disk in the replacement node to install necessary software.
When the node disk is being replaced, you must perform node rescue. See“Performing Node Rescue” (page 93).
16. Properly secure the parts and cover on the failed controller node then place it into the protective packaging for return to HP.
WARNING! Make sure the node power switch is set to the OFF position before inserting the node into the node chassis.
17. Replace the node:
a. Orient the node properly and align the bottom of the node with the grooves in its slot and slide the node into the node chassis.
Figure 21 Replacing the Node
b. Push the insertion levers in quickly until the node is seated securely.
Figure 22 Pushing the Node Insertion Levers
WARNING! Do not connect the cables to the node at this time.
18. Set the node power switch to the ON position to turn on power on the node.
Replacing a Controller Node 39
NOTE: Once power is applied to the node, it begins to boot. This process can take approximately 5-10 minutes. When complete, the node becomes part of the cluster.
19. Verify that the node LED is blinking green indicating that the node has joined the cluster.
20. In the 3PAR Service Processor Menu, select option 7 Interactive CLI for an InServ, then select the desired system.
21. Issue the shownode command to verify the node has joined the cluster.
cli% shownode
Control Data Cache Node --Name--- -State-- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 0 1400510-0 OK Yes Yes GreenBlnk 16384 32768 100 1 1400510-1 OK No Yes AmberBlnk 16384 32768 100
22. Reboot the replaced node one more time to synchronize software and hardware values by issuing the shutdownnode reboot <node_ID> command.
23. After the node reboots a second time, monitor the node status LED and verify again that all nodes have joined the cluster by issuing the shownode command.
24. Reconnect the customer’s Ethernet cable, if applicable, and all other cables to the node once the node has rebooted.
CAUTION: Do not reconnect host cables without verifying the controller node is functioning properly.
25. Issue the checkhealth -svc -detail command to verify the system is healthy.
26. In the SP window, issue the exit command and select X to exit from the 3PAR Service Processor Menu and to log out of the session.
27. Disconnect the serial cable from the maintenance PC and replace the cable behind the SP.
28. Close and lock the rear door.