SGI Rackable C2108-TY10 System User s Guide

(1)

SGI

®

_{Rackable™ C2108-TY10 System}

User’s Guide

(2)

LIMITED RIGHTS LEGEND

The software described in this document is “commercial computer software” provided with restricted rights (except as to included open/free source) as specified in the FAR 52.227-19 and/or the DFAR 227.7202, or successive sections. Use beyond license provisions is a violation of worldwide intellectual property laws, treaties and conventions. This document is provided with limited rights as defined in 52.227-14.

The electronic (software) version of this document was developed at private expense; if acquired under an agreement with the USA government or any contractor thereto, it is acquired as “commercial computer software” subject to the provisions of its applicable license agreement, as specified in (a) 48 CFR 12.212 of the FAR; or, if acquired for Department of Defense units, (b) 48 CFR 227-7202 of the DoD FAR Supplement; or sections succeeding thereto. Contractor/manufacturer is SGI, 1140 E. Arques Avenue, Sunnyvale, CA 94085.

TRADEMARKS AND ATTRIBUTIONS

Altix, SGI, and the SGI logo are registered trademarks and SGI ProPack is a trademark of SGI in the United States and/or other countries worldwide. Fusion-MPT, Integrated RAID, MegaRAID, and LSI Logic are trademarks or registered trademarks of LSI Logic Corporation.InfiniBand is a registered trademark of the InfiniBand Trade Association. Intel, Itanium, and Xeon are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. Internet Explorer and MS-DOS are registered trademarks of Microsoft Corporation. Java and Java Virtual Machine are trademarks or registered trademarks of Sun Microsystems, Inc. Linux is a registered trademark of Linus Torvalds, used with permission by SGI. Novell and Novell Netware are registered trademarks of Novell Inc. PCIe and PCI-X are registered trademarks of PCI SIG. Phoenix and PhoenixBIOS are registered trademarks of Phoenix Technologies Ltd. Red Hat and all Red Hat-based trademarks are trademarks or registered trademarks of Red Hat, Inc. in the United States and other countries. SUSE LINUX and the SUSE logo are registered trademarks of Novell, Inc. UNIX is a registered trademark in the United States and other countries, licensed exclusively through X/Open Company, Ltd.

All other trademarks mentioned herein are the property of their respective owners. Adaptec, HostRAID, and the Adaptec logo are registered trademarks of Adaptec Inc.

(3)

Record of Revision

Version Description

001 September 2010

(4)

(5)

Figures

Figure 1-1 SGI Rackable C2108-TY10 Server . . . . 1

Figure 1-2 Intel 5520/ICH10R Chipset System Block Diagram. . . . 6

Figure 2-1 Separating and Installing the Rack Rails . . . . 11

Figure 2-2 Installing the Server in a Rack . . . . 13

Figure 2-3 Accessing the Inside of the System . . . . 15

Figure 3-1 System Reset Button . . . . 19

Figure 3-2 System Power On Button . . . . 20

Figure 3-3 Power Fail LED . . . . 20

Figure 3-4 Overheat/Fan Fail LED . . . . 21

Figure 3-5 LAN1 Network Activity NIC1 LED . . . . 21

Figure 3-6 LAN2 Network Activity NIC2 LED . . . . 21

Figure 3-7 Hard Drive Activity LED . . . . 22

Figure 3-8 Power On LED . . . . 22

Figure 4-1 Installing the Onboard Battery . . . . 24

Figure 5-1 Control Panel Header Pins . . . . 29

Figure 5-2 I/O Ports Locations . . . . 29

Figure 5-3 Node Board Features . . . . 31

Figure 5-4 DIMM Installation . . . . 33

Figure 5-5 Installing DIMM Modules . . . . 34

Figure 5-6 Removing a DIMM Module . . . . 35

Figure 5-7 Memory DIMM Locations . . . . 36

Figure 5-8 Memory Block Diagram . . . . 37

Figure 5-9 SGI Rackable C2108-TY10 Disk Drive Locations . . . . 45

Figure 5-10 Base PCI card configuration . . . . 47

Figure 6-1 Front and Rear Chassis Views . . . . 50

(14)

Figure 7-1 System Overview Main BIOS Setup Screen . . . . 61

Figure 7-2 Advanced Settings Screen . . . . 63

Figure 7-3 Security Settings Screen . . . . 88

Figure 7-4 Boot Settings Screen . . . . 90

(15)

Tables

Table 5-1 Jumper Descripton . . . . 32

Table 5-2 Recommended Memory DIMM Configurations . . . . 40

Table 5-3 Non-Optimal Memory DIMM Configurations . . . . 43

(16)

(17)

About This Guide

This guide provides an overview of the installation, architecture, general operation, and

descriptions of the major components in the SGI®_Rackable®_{C2108-TY10 server. It also provides}

basic troubleshooting and maintenance information, BIOS information, and important safety and regulatory specifications.

Audience

This guide is written for owners, installers, system administrators, and users of SGI Rackable C2108-TY10 computer systems. It is written with the assumption that the reader has a good working knowledge of computers and computer systems.

Chapter Descriptions

The following topics are covered in this guide: • Chapter 1, “Introduction”

Provides an overview SGI Rackable C2108-TY10 server components. • Chapter 2, “Server Installation”

Provides a quick setup checklist to get the SGI Rackable C2108-TY10 operational. • Chapter 3, “System Interface”

Describes several LEDs on the control panel as well as others on the SATA drive carriers that keep you constantly informed of the overall status of the system as well as the activity and health of specific components.

• Chapter 4, “System Safety” Provides system safety information.

(18)

• Chapter 7, “BIOS”

Describes the AMI BIOS Setup Utility for the SGI Rackable C2108-TY10 severboard. • Appendix A, “BIOS Error Codes,”

Provides BIOS error code information. • Appendix B, “System Specifications,”

(19)

:

Related Publications

The following SGI and LSI documents are relevant to the SGI Rackable C2108-TY10 server: • MegaRAID SAS Software User’s Guide, publication number, publication number

860-0488-00x

• MegaRAID 1078-based SAS RAID Controllers User’s Guide, publication number 860-0489-00x

• LSI Integrated SAS for RAID User’s Guide, publication number 860-0476-00x • SGI ProPack 6 for Linux Start Here, publication number 007-5482-00x • SGI InfiniteStorage series documentation

• Man pages (online)

You can obtain SGI documentation (as well as the pertinent LSI books), release notes, or man pages in the following ways:

• Refer to the SGI Technical Publications Library at http://docs.sgi.com. Various formats are available. This library contains the most recent and most comprehensive set of online books, release notes, man pages, and other information.

• You can also view man pages by typing man <title> on a command line.

SGI systems include a set of Linux®_{man pages, formatted in the standard UNIX}®_{“man page”}

style. Important system configuration files and commands are documented on man pages. These are found online on the internal system disk (or DVD-CD) and are displayed using the man command. For example, to display the man page for the xscsidisktest command, type the following on a command line:

man xscsidisktest

For additional information about displaying man pages using the man command, see man(1). In addition, the apropos command locates man pages based on keywords. For example, to display a list of man pages that describe disks, type the following on a command line:

apropos disk

(20)

Product Support

SGI provides a comprehensive product support and maintenance program for its products. SGI also offers services to implement and integrate Linux applications in your environment. • Refer to http://www.sgi.com/support/

• If you are in North America, contact the Technical Assistance Center at +1 800 800 4SGI or contact your authorized service provider.

• If you are outside North America, contact the SGI subsidiary or authorized distributor in your country.

Convention Meaning

Command This fixed-space font denotes literal items such as commands, files, routines, path names, signals, messages, and programming language structures.

variable The italic typeface denotes variable entries and words or concepts being defined. Italic typeface is also used for book titles.

user input This bold fixed-space font denotes literal items that the user enters in interactive sessions. Output is shown in nonbold, fixed-space font. [ ] Brackets enclose optional portions of a command or directive line. ... Ellipses indicate that a preceding element can be repeated.

man page(x) Man page section identifiers appear in parentheses after man page names.

GUI element This font denotes the names of graphical user interface (GUI) elements such as windows, screens, dialog boxes, menus, toolbars, icons, buttons, boxes, fields, and lists.

(21)

:

Reader Comments

If you have comments about the technical accuracy, content, or organization of this document, contact SGI. Be sure to include the title and document number of the manual with your comments. (Online, the document number is located in the front matter of the manual. In printed manuals, the document number is located at the bottom of each page.)

You can contact SGI in any of the following ways:

• Send e-mail to the following address: [email protected]

• Contact your customer service representative and ask that an incident be filed in the SGI incident tracking system.

• Send mail to the following address: SGI

Technical Publications 46600 Landing Parkway Fremont, CA 94538

(22)

(23)

Chapter 1

1. Introduction

Important: SGI Rackable systems may sometimes require driver versions that are not included

in the original operating system release. SGI provides these required drivers on the SGI Rackable Driver CD, which ships with all SGI Rackable systems, and on systems that are pre-installed in the factory. For more information, check with your sales or service representative.

The SGI Rackable C2108-TY10 server is a 2U rackmount server (see Figure 1-1). It has two main subsystems: the 2U server chassis and the dual processor serverboard.

Figure 1-1 SGI Rackable C2108-TY10 Server

In addition to the serverboard and chassis, various hardware components have been included with the SGI Rackable C2108-TY10, as listed below:

(24)

• Two passive heatsinks • One air shroud

• SATA and SAS Accessories – One SAS/SATA backplane – One 2-ft. SATA cable – Two 35-cm SATA cables – Two 40-cm SGPIO cables – Two 48-cm SATA cables – One 70-cm SATA cable – Eight drive carriers • One rackmount kit

(25)

Server Board Features

At the heart of the SGI Rackable C2108-TY10 system is a dual processor serverboard based on the Intel 5520 + ICH10R chipset and designed to provide maximum performance. Below are the main features of the serverboard.

Processors

The serverboard supports single or dual Intel® Xeon® 5500 processors. The Intel® Xeon® 5200 and 5400 processors are not supported.

Memory

The serverboard has eighteen DIMM slots that can support up to 144 GB of DDR3 1333/1066/800 registered ECC SDRAM (see “Installing Memory” on page 32).

Serial ATA

A Serial ATA controller is integrated into the ICH10R (South Bridge) portion of the chipset to provide a six-port 3 Gb/s SATA subsystem, which is RAID 0, 1, 10 and 5 supported. The SATA drives are hot-swappable units.

Note: The SATA drives are hot-swappable units if your operating systems has RAID support.

PCI Expansion Slots

The dual processor serverboard has two low-profile PCI Express 2.0 x8 slots, one low-profile PCI Express x4 slot (in a x8 slot), three low-profile 64-bit 133/100 MHz PCI-X slots and one UIO slot (see “PCI Card Slotting” on page 46)

UIO

(26)

Note: The SGI Rackable C2108-TY10 does not come with a UIO card pre-installed.

When the RAID option is ordered, this slot is filled with the RAID card.

Onboard Controllers/Ports

One onboard ATA/100 connector, which supports IDE hard drives or ATAPI devices. The color-coded I/O ports include one COM port (an additional COM header is located on the serverboard), a VGA (monitor) port, two USB 2.0 ports (two additional USB headers and one Type A port are included on the serverboard), PS/2 mouse and keyboard ports and two gigabit Ethernet ports.

ATI Graphics Controller

The dual processsor serverboard features an integrated ATI video controller based on the ES1000 32 MB graphics chip. The ES1000 was designed specifically for servers, featuring low power consumption, high reliability and superior longevity.

Other Features

Other onboard features that promote system health include onboard voltage monitors, a chassis intrusion header, auto-switching voltage regulators, chassis and CPU overheat sensors, virus protection and BIOS rescue.

Server Chassis Features

The following is a general outline of the main features of the SGI Rackable C2108-TY10 server chassis.

System Power

The SGI Rackable C2108-TY10 server chassis features a redundant 720W power supply composed of two separate power modules. This power redundancy feature allows you to replace a failed power supply without shutting down the system.

(27)

Server Chassis Features

Serial ATA Subsystem

The SGI Rackable C2108-TY10 server chassis supports up to six 3 Gb/s Serial ATA drives. The SATA drives are hot-swappable units and are connected to a backplane that provides power and control.

Note: The operating system you have installed must support RAID to enable the hot-swap

capability of the SATA drives.

Front Control Panel

The control panel on the SGI Rackable C2108-TY10 provides you with system monitoring and control. LEDs that indicate system power, HDD activity, network activity, system overheat and power supply failure. A main power button and a system reset button are also included. In addition, two USB ports and one serial port have been incorporated into the control panel to provide front side USB and COM port access.

Motherboard

The SGI Rackable C2108-TY10 server chassis is an ATX form factor chassis designed to be used in a 2U rackmount configuration. The motherboard provides one UIO slot, seven low-profile expansion slots, one COM port, a VGA port, two USB 2.0 ports, PS/2 mouse and keyboard ports and two Gigabit Ethernet ports.

Cooling System

The SGI Rackable C2108-TY10 server chassis has an innovative cooling design that includes three 8-cm hot-plug system cooling fans located in the middle section of the chassis. An air shroud channels the airflow from the system fans to efficiently cool the processor area of the system. The power supply module also includes a cooling fan.

(28)

Figure 1-2 Intel 5520/ICH10R Chipset System Block Diagram CSI #1 DDR3 DIMM #1 #1 #2 DDR3 DIMM #2 #2 #3 DDR3 DIMM #3 #3 DDR3 DIMM #1 #1 #1 DDR3 DIMM #2 #2 #2 DDR3 DIMM #3 #3 #3 C C C A A A B B B D D D E E E F F F Intel 5520 Port1 Port0 PCI-Ex16 Slot #4 Ports Ports 3,4 5,6 7,8 PCI-E x8 Slot #0 SEPC J11 PCI-E x8 Slot #6 9,10 PXH PCI-x Slot #3 Chnl A PCI-x Slot #1 Chnl B #2 ICH10R Ports 1,2 82575 RJ45RJ45 ESI PE 4-1 PCI-E x8 Slot #5 x4 PE 5 x1 JMB368 IDE VGA VGA ES1000 DDR2 PCI SATA #6 SATA SIO 83627 LPC Floppy SPI SST25 VF016 CLINK CLINK DMI SIMLP PCI-x Slot CPU2 Ports Ports SATA #5 SATA #4 SATA #3 SATA #2 SATA #1 CPU1

(29)

Chapter 2

2. Server Installation

This chapter provides a quick setup checklist to get the SGI Rackable C2108-TY10 operational.

Unpack the System

Inspect the shipping container that the SGI Rackable C2108-TY10 was shipped in and note if it was damaged in any way. If the server shows damage, file a damage claim with the carrier who delivered it.

Decide on a suitable location for the rack that supports the weight, power requirements, and environmental requirements of the SGI Rackable C2108-TY10 server. It should be situated in a clean, dust-free environment that is well ventilated. Avoid areas where heat, electrical noise, and electromagnetic fields are generated. Place the server rack near a grounded power outlet. Refer to “Warnings and Precautions” on page 8.

Prepare for Setup

The shipping container should include two sets of rail assemblies, two rail mounting brackets and the mounting screws that you will use to install the system into a rack.

Read this section in its entirety before you begin the installation procedure.

Choose a Setup Location

Leave enough clearance in front of the rack to enable you to open the front door completely (~25 inches) and approximately 30 inches of clearance in the back of the rack to allow for sufficient airflow and ease in servicing.

(30)

Warnings and Precautions

Rack Precautions

Warning:

The SGI Rackable C2108-TY10 server weighs 57 lbs (26 kg). Always use proper

lifting techniques when your move the server. Always get the assistance of another qualified person when you install the sever in a location above your shoulders. Failure to do so may result in serious personal injury or damage to the equipment.

Warning:

Extend the leveling jacks on the bottom of the rack to the floor with the full

weight of the rack resting on them. Failure to do so can result in serious injury or death.

Warning:

Attach stabilizers to the rack in single rack installations. Failure to do so can

result in serious injury or death.

Warning:

Couple racks together in multiple rack installations. Failure to do so can result

in serious injury or death.

Warning:

Be sure the rack is stable before extending a component from the rack. Failure

to do so can result in serious injury or death.

Warning:

Extend only one component at a time. Extending two or more components

simultaneously may cause the rack to tip over and result in serious injury or death.

!

(31)

Rack Mounting Considerations

Server Precautions

• Review the electrical and general safety precautions.

• Determine the placement of each component in the rack before you install the rails. • Install the heaviest server components in the bottom of the rack first, and then work up. • Use a regulating uninterruptible power supply (UPS) to protect the server from power surges

and voltage spikes and to keep your system operating in case of a power failure. • Allow the hot-pluggable SAS/SATA drives and power supply modules to cool before

touching them.

• Always keep the rack’s front door and all panels and components on the servers closed when not servicing to maintain proper cooling.

Rack Mounting Considerations

Ambient Operating Temperature

If installed in a closed or multi-unit rack assembly, the ambient operating temperature of the rack environment may be greater than the ambient temperature of the room. Therefore, consideration should be given to installing the equipment in an environment compatible with the manufacturer’s maximum rated ambient temperature (35º C or 95º F).

Reduced Airflow

Equipment should be mounted into a rack so that the amount of airflow required for safe operation is not compromised.

Mechanical Loading

Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanical loading.

(32)

Circuit Overloading

Consideration should be given to the connection of the equipment to the power supply circuitry and the effect that any possible overloading of circuits might have on overcurrent protection and power supply wiring. Appropriate consideration of equipment nameplate ratings should be used when addressing this concern.

Reliable Ground

A reliable ground must be maintained at all times. To ensure this, the rack itself should be grounded. Particular attention should be given to power supply connections other than the direct connections to the branch circuit (for example, the use of power strips, and so on).

Install the System into a Rack

This section provides information on installing the SGI Rackable C2108-TY10 into a rack. If the system has already been mounted into a rack, refer to “Check the Node Board Setup” on page 14. There are a variety of rack units on the market, which may mean the assembly procedure will differ slightly. You should also refer to the installation instructions that came with the rack unit you are using.

Note: This rail will fit a rack between 26" and 33.5" deep.

Separate the Sections of the Rack Rails

The chassis package includes two rail assemblies in the rack mounting kit. Each assembly consists of two sections: an inner fixed chassis rail that secures directly to the server chassis and an outer fixed rack rail that secures directly to the rack itself.

To separte the inner and outer rails, perform the following steps:

1. Locate the rail assembly in the chassis packaging as shown in Figure 2-1. 2. Extend the rail assembly by pulling it outward.

(33)

Install the System into a Rack

4. Separate the inner rail from the outer rail assembly.

Figure 2-1 Separating and Installing the Rack Rails

1

2

3

4

Rail Assembly

Extending the Rails

Quick-Release Tab

Separating the Inner Rail Extension

5

6

(34)

Outer Rack Rails

Outer rails attach to the rack and hold the chassis in place. The outer rails for the chassis extend between 30 inches and 33 inches.

Install the Outer Rails to the Rack

5. Secure the back end of the outer rail to the rack, using the screws provided (see Figure 2-1). 6. Press the button where the two outer rails are joined to retract the smaller outer rail.

7. Hang the hooks of the rails onto the rack holes and if desired, use screws to secure the front of the outer rail onto the rack.

8. Repeat steps 1-3 for the remaining outer rail.

Install the Inner Rail Extension

The SGI Rackable C2108-TY10 chassis includes a set of inner rails in two sections: inner rails and inner rail extensions. The inner rails are pre-attached to the chassis, and do not interfere with normal use of the chassis if you decide not to use a server rack The inner rail extension is attached to the inner rail to mount the chassis in the rack.

Install the Inner Rails

Perform the following steps to install the inner rails:

1. Place the inner rail extensions on the side of the chassis aligning the hooks of the chassis with the rail extension holes. Make sure the extension faces "outward" just like the pre-attached inner rail.

2. Slide the extension toward the front of the chassis.

3. Secure the chassis with 2 screws as illustrated. Repeat steps for the other inner rail extension.

(35)

Install the System into a Rack

Install the Server in a Rack

Warning:

The SGI Rackable C2108-TY10 server weighs 57 lbs (26 kg) Always use proper

lifting techniques when your move the server. Always get the assistance of another qualified person when you install the sever in a location above your shoulders. Failure to do so may result in serious personal injury or damage to the equipment.

You should now have rails attached to both the server chassis and the rack unit. The next step is to install the server into the rack (refer to Figure 2-2).

1. Extend the outer rails as shown in Figure 2-2.

2. Align the inner rails of the chassis with the outer rails on the rack.

3. Slide the inner rails into the outer rails, keeping the pressure even on both sides. When the chassis has been pushed completely into the rack, it should click into the locked position. 4. Optional screws may be used to secure the to hold the front of the chassis to the rack.

Figure 2-2 Installing the Server in a Rack

!

(36)

Check the Node Board Setup

Use the following sections to open the top cover and check that each node board is properly installed and all the connections have been made.

Access the Inside of the Chassis

1. Grasp the two handles on either side and pull the unit straight out until it locks (you will hear a “click”).

2. Depress the two buttons on the top of the chassis to release the top cover as shown in Figure 2-3.

3. Lift the top cover from the chassis.

Note: To remove the system from the rack completely, depress the locking tabs on the chassis

rails (push the right-side tab down and the left-side tab up) to continue to pull the system out past the locked position.

(37)

Check the Node Board Setup

(38)

Check the CPUs (processors)

You may have one or two processors installed into the serverboard. Each processor needs its own heatsink.

Check the System Memory

Your server system is shipped with system memory installed. Make sure all DIMMs are fully seated in their slots. For details on adding system memory, refer to Chapter 3.

Install Expansion PCI Cards

You can install six expansion PCI cards in the system. Refer to Chapter 3 for details on installing PCI expansion cards.

Check all Cable Connections and Airflow

Make sure all power and data cables are properly connected and not blocking the chassis airflow. Refer to Chapter 3 for details on cable connections.

Check the Drive Bay Setup

Next, you should check to make sure the system disk drives and disk drive backplane have been properly installed and all connections have been made.

Check the System Disk Drives

All drives are accessable from the front of the server. For servicing the DVD-ROM, you will need to remove the top chassis cover. The hard drives can be installed and removed from the front of the chassis without removing the top chassis cover. Depending upon your system configuration, your system may have one or more drives installed. For detailed information about how to install disk drives, see “Hard Disk Drives (SGI Rackable C2108-TY10 Chassis)” on page 45.

If you have more than 4TB of storage, you must create multiple volumes to fully utilize your RAID disks.

(39)

Check the Node Board Setup

Refer to the MegaRAID SAS Software User's Guide, SGI publication number 860-0488-00x and the MegaRAID 1078-based SAS RAID Controllers User's Guide, SGI publication number 860-0489-00x for more information about configuring your system disks.

A slim DVD-ROM may be preinstalled in your server. Refer to Chapter 6 if you need to install a DVD-ROM disk drive to the system.

Depending upon your system's configuration, your system may have one or more drives already installed. If you need to install hard drives, please refer to Chapter 6.

Check the Airflow

Airflow is provided by three hot-swappable 8-cm chassis cooling fans. The system component layout was carefully designed to direct sufficient cooling airflow to the components that generate the most heat.

Note: Make sure that all power and data cables have been routed in such a way that they do not

block the airflow generated by the fans.

Supply Power to the System

If necessary, install the system in a rack (refer to “Install the System into a Rack” on page 10), and connect the power cord from the power supply module into a power strip or power distribution unit (PDU). SGI also recommends that you use an uninterruptible power supply (UPS) source.

(40)

(41)

Chapter 3

3. System Interface

Overview

There are several LEDs on the control panel as well as others on the SATA drive carriers to keep you constantly informed of the overall status of the system as well as the activity and health of specific components. There are also two buttons on the chassis control panel.

Control Panel Buttons

There are two buttons located on the front of the chassis: a reset button and a power on/off button. Use the reset button to reboot the system as shown in Figure 3-1.

Figure 3-1 System Reset Button

Figure 3-2 shows the the main power button, which is used to apply or turn off the main system power. Turning off system power with this button removes the main power but keeps standby

(42)

Figure 3-2 System Power On Button

Control Panel LEDs

The control panel located on the front of the chassis has several LEDs. These LEDs provide you with critical information related to different parts of the system. This section explains what each LED indicates when illuminated and any corrective action you may need to take.

Power Fail

The power fail LED ndicates a power supply module has failed as shown in Figure 3-3. The second power supply module will take the load and keep the system running but the failed module will need to be replaced. Refer to Chapter 6 for details on replacing the power supply. This LED should be off when the system is operating normally.

Figure 3-3 Power Fail LED

Overheat/Fan Fail

When the red overheat/fan LED flashes (shown in Figure 3-4), it indicates a fan failure. When on continuously it indicates an overheat condition, which may be caused by cables obstructing the airflow in the system or the ambient room temperature being too warm. Check the routing of

(43)

Control Panel LEDs

the cables and make sure all fans are present and operating normally. You should also check to make sure that the chassis covers are installed. This LED will remain flashing or on as long as the indicated condition exists.

Figure 3-4 Overheat/Fan Fail LED

NIC1

When flashing, the NIC1 LED indicates network activity on the LAN1 port (see Figure 3-5).

Figure 3-5 LAN1 Network Activity NIC1 LED

NIC2

When flashing, the NIC2 LED indicates network activity on the LAN2 port (see Figure 3-6).

Figure 3-6 LAN2 Network Activity NIC2 LED

HDD

1

(44)

Figure 3-7 Hard Drive Activity LED

Power

The power LED indicates power is being supplied to the system's power supply units is shown in Figure 3-8. This LED should normally be illuminated when the system is operating.

Figure 3-8 Power On LED

SATA Drive Carrier LEDs

Each SATA drive carrier has two LEDs, as follows:

• Green: When illuminated, the green LED on the SATA drive carrier indicates drive activity. A connection to the SATA backplane enables this LED to blink on and off when that particular drive is being accessed. Please refer to Chapter 6 for instructions on replacing failed drives.

• Red: The red LED indicates a SATA drive failure. If one of the drives fails, you should be notified by your system management software. Please refer to Chapter 6 for instructions on replacing failed drives.

(45)

Chapter 4

4. System Safety

This chapter describes basic safety precautions.

Electrical Safety Precautions

Basic electrical safety precautions should be followed to protect yourself from harm and the SGI Rackable C2108-TY10 system from damage, as follows:

• Be aware of the locations of the power on/off switch on the chassis as well as the room's emergency power-off switch, disconnection switch or electrical outlet. If an electrical accident occurs, you can then quickly remove power from the system.

• Do not work alone when working with high voltage components.

• Power should always be disconnected from the system when removing or installing main system components, such as the serverboard, memory modules and SATA drives. When disconnecting power, you should first power down the operating system first and then unplug the power cords. The unit has more than one power supply cord. Disconnect two power supply cords before servicing to avoid electrical shock.

• When working around exposed electrical circuits, another person who is familiar with the power-off controls should be nearby to switch off the power if necessary.

• Use only one hand when working with powered-on electrical equipment. This is to avoid making a complete circuit, which will cause electrical shock. Use extreme caution when using metal tools, which can easily damage any electrical components or circuit boards they come into contact with. • Do not use mats designed to decrease static electrical discharge as protection from electrical shock. Instead, use rubber mats that have been specifically designed as electrical insulators.

(46)

• Serverboard Battery

Caution: There is a danger of explosion if the onboard battery is installed upside down,

which will reverse its polarites (see Figure 4-1). This battery must be replaced only with the same or an equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions.

• DVD-ROM Laser

Caution: This server may have come equipped with a DVD-ROM drive. To prevent direct

exposure to the laser beam and hazardous radiation exposure, do not open the enclosure or use the unit in any unconventional way.

• Mainboard replaceable soldered-in fuses: Self-resetting PTC (Positive Temperature Coefficient) fuses on the mainboard must be replaced by trained service technicians only. The new fuse must be the same or equivalent as the one replaced. Contact technical support for details and support.

Figure 4-1 Installing the Onboard Battery

General Safety Precautions

Follow these rules to ensure general safety:

• Keep the area around the SGI Rackable C2108-TY10 system clean and free of clutter. • The SGI Rackable C2108-TY10 system weighs approximately 57 lbs (25.9 kg.) when fully

loaded. When lifting the system, two people at either end should lift slowly with their feet spread out to distribute the weight. Always keep your back straight and lift with your legs.

!

Lithium battery

(47)

ESD Precautions

• Place the chassis top cover and any system components that have been removed away from the system or on a table so that they won't accidentally be stepped on.

• While working on the system, do not wear loose clothing such as neckties and unbuttoned shirt sleeves, which can come into contact with electrical circuits or be pulled into a cooling fan.

• Remove any jewelry or metal objects from your body, which are excellent metal conductors that can create short circuits and harm you if they come into contact with printed circuit boards or areas where power is present.

• After accessing the inside of the system, close the system back up and secure it to the rack unit with the retention screws after ensuring that all connections have been made.

ESD Precautions

Caution: Electrostatic discharge (ESD) is generated by two objects with different electrical

charges coming into contact with each other. An electrical discharge is created to neutralize this difference, which can damage electronic com ponents and printed circuit boards.

The following measures are generally sufficient to neutralize this difference before contact is made to protect your equipment from ESD:

• Use a grounded wrist strap designed to prevent static discharge.

• Keep all components and printed circuit boards (PCBs) in their antistatic bags until ready for use.

• Touch a grounded metal object before removing the board from the antistatic bag. • Do not let components or PCBs come into contact with your clothing, which may retain a

charge even if you are wearing a wrist strap.

• Handle a board by its edges only; do not touch its components, peripheral chips, memory modules or contacts.

• When handling chips or modules, avoid touching their pins.

• Put the serverboard and peripherals back into their antistatic bags when not in use.

(48)

(49)

Chapter 5

5. Advanced Severboard Setup

This chapter includes procedures to install a node board into the SGI Rackable C2108-TY10 chassis, connect the data and power cables, and install expansion cards.

A layout and quick reference chart is included in this chapter for your reference. See “Serverboard Quick Reference” on page 32.

Note: Some software products are protected with software license keys derived from the

Media Access Control (MAC) Ethernet address. When you replace a node board, the MAC Ethernet address changes. If you are using such a product, you must request a new license key after replacing the node board. Contact your local customer support office

http://www.sgi.com/support/supportcenters.html

Caution: Install the chassis cover after you have completed accessing the components inside the

server to maintain proper airflow and cooling for the system.

Handling the Node Board

Caution: Electrostatic discharge (ESD) can damage electrostatic-sensitive devices inside the SGI

Rackable C2108-TY10 server. Use the ESD precautions described below when you handle printed circuit boards or other components in the system. The following measures are generally sufficient to protect your equipment from electric static discharge.

!

(50)

ESD Precautions

• Use a grounded wrist strap designed to prevent electrostatic discharge.

• Touch a grounded metal object before removing any board from its antistatic bag. • Handle each printed circuit board (PCB) by the edges; do not touch the components,

peripheral chips, memory modules, or gold contacts on the PCB. • When handling chips or modules, avoid touching the pins.

• Place the node board, expansion PCI cards, or other boards and components into antistatic bags when not in use.

• Make sure your computer chassis provides a conductive path between the power supply, the case, the mounting fasteners, and the node board to chassis ground.

Unpacking

Caution: The node board is shipped in antistatic packaging to avoid electrostatic discharge

damage. Be sure to use ESD precautions when you unpack replacement components for the SGI Rackable C2108-TY10 server. Failure to do so can result in damage to the equipment.

Connecting the Control Panel

JF1 contains header pins for various front control panel connectors. See Figure 5-1 for the pin locations of the various front control panel buttons and LED indicators.

All JF1 wires have been bundled into a single cable to simplify this connection. Make sure the red wire plugs into pin 1 as marked on the board. The other end connects to the Control Panel PCB board, located just behind the system status LEDs on the chassis.

(51)

I/O Ports

Figure 5-1 Control Panel Header Pins

I/O Ports

The I/O ports are color coded in conformance with the PC 99 specification. See Figure 5-2 below for the colors and locations of the various I/O ports.

NMI x (Key) Vcc Vcc Vcc Vcc Vcc Vcc Reset (Button) Power (Button) Ground x (Key) Power On LED HDD LED NIC1 LED NIC2 LED OH/Fan Fail LED Power Fail LED Ground Ground

2 1 20 19

(52)

Serverboard Details

The 2U SGI Rackable C2108-TY10 chassis has one node board. It can be configured with 1 or 2 processor sockets. When configuring two processors, the following rules apply:

• Both processor sockets must have identical revisions, core voltage, and bus/core speed. • The stepping between the two processors on a node board must be identical.

• If only one processor is installed, the single processor socket must be installed in the socket labeled CPU1 (See Figure 5-3). The other socket remains empty.

(53)

Serverboard Details

Figure 5-3 Node Board Features

J8 J7 JPG1 JPL1 JP4 J21 JF1 JPW4 JPW3 JPW1 SP1 JIDE1 Fan1 Fan3 Fan4 Fan8 JWF1 JBT1 J14 J4 LE1 JOH1 JP6 JK1 JWOR1 JL1 J12 J13 JPP0 JPP1 J16 JD1 JCOM2 JLAN1 JLAN2 J15 COM1 JUSB1 JKM1 J11 J1 J2 J10 J5 J6 J1 12 J1 11 J1 13 J1 14 J1 15 J1 16 J1 18 J1 17 J100 CPU2 Fan OH LED CPU1 Floppy IDE JP3 USB7 USB6 USB4 SEPC Slot6 PCI-E2 X8 Slot5 PCI-E X4 Slot4 PCI-E2 X8 Slot3 PCI-X 100/133MHZ Slot2 PCI-X 100/133MHZ Slot1 PCI-X 133MHZ LAN2 VGA KB/MS Clear CMOS WOL IPMB USB2/3 I-SA TA0 PWR I2C Fan7 CPU1 Fan XDP CPU2 USB0/1 T-SGPIO2 T-SGPIO1 LAN1 Slot0 PCI-U COM2 Fan6 JG1 J1 10 P2 DIMM3A P2 DIMM3B P2 DIMM3C P2 DIMM2A P2 DIMM2B P2 DIMM2C P2 DIMM1A P2 DIMM1B P2 DIMM1C SIMLP Battery VGA CTRL J3 JAR FP CTRL Fan2 P1 DIMM1C P1 DIMM1B P1 DIMM1A P1 DIMM2C P1 DIMM2B P1 DIMM2A P1 DIMM3C P1 DIMM3B P1 DIMM3A J101 J102 J103 J104 J105 J106 J107 J108 JCOM1 Fan5 I-SA TA1 I-SA TA2 I-SA TA3 I-SA TA4 I-SA TA5 X8DTN+ BIOS LAN CTRL S I/O Intel IOH-D36 Intel ICH9R PXH IPMI SPI SPKR JUSB2 JUSB3

(54)

Serverboard Quick Reference

Installing Memory

Caution: Exercise extreme care when installing or removing DIMM modules to prevent any

possible damage.

SGI Rackable C2108-TY10 serverboard supports up to 144 GB of DDR3 1333/1066/800 registered ECC SDRAM in 18 DIMM slots. Three-way interleaved memory is supported. For optimal memory performance, install DIMMs three at a time. Use memory modules of the same type and speed. See the following table for memory installation.

Install DIMMs

Perform the following steps to install memory modules, as follows:

1. Insert the DIMM module vertically and press down into its slot until it snaps into place. Pay attention to the alignnment notch at the bottom of the module to avoid installing incorrectly (see Figure 5-4 and Figure 5-5). Insert the desired number of DIMMs into the memory slots, beginning with DIMM #1A and DIMM #2A, then DIMM #3A and DIMM #4A, etc. (see

Table 5-1 Jumper Descripton

Jumper Description Default Setting

JBT1 CMOS Clear See Section 5-10

J12 SMB to PCI-Exp. Slots Pins 2-3 (Disabled)

J13 SMB to PCI-X Slots Pins 2-3 (Disabled)

J21 Watch Dog Enable/Disable Pins 1-2 (Reset)

JP3 IDE Enable/Disable Pins 1-2 (Enabled)

JPG1 VGA Enable/Disable Pins 1-2 (Enable)

JPL1 LAN1/2 Enable/Disable Pins 1-2 (Enabled)

(55)

Installing Memory

Table 5-2). Always spread DIMMs across all three banks for each CPU (see Figure 5-3). Gently press down on the DIMM module until it snaps into place in the slot. Repeat for all modules.

2. To remove a DIMM module, use your thumbs to gently push the release tabs near both ends of the module (see Figure 5-4). This should release it from the slot (see Figure 5-6).

Figure 5-4 DIMM Installation

Front view

Top view of DDR3 slot Notch Release tab Notch Release tab 1 2

(56)

(57)

Installing Memory

Figure 5-6 Removing a DIMM Module

Memory Configuration

When configured with two processors, the SGI Rackable C2108-TY10 can be configured with a maximum of eighteen memory DIMMs.

Unlike previous processors, the Nehalem-EP processor has the memory controller embedded within the processor socket. There are nine memory DIMMs that are controlled by each processor. If the node board is configured with only one processor the total number of memory DIMMs supported with be reduced from 18 to 9.

(58)

Figure 5-7 Memory DIMM Locations

Memory DIMM Layout

The SGI Rackable C2108-TY10 Nehalem-EP memory controller has three channels with three memory DIMM slots on each channel.

J1 12 J1 11 J1 13 J1 14 J1 15 J1 16 J1 18 J1 17 J1 10 P2 DIMM-3A P2 DIMM-3B P2 DIMM-3C P2 DIMM-2A P2 DIMM-2B P2 DIMM-2C P2 DIMM-1A P2 DIMM-1B P2 DIMM-1C P1 DIMM1C P1 DIMM1B P1 DIMM1A P1 DIMM2C P1 DIMM2B P1 DIMM2A P1 DIMM3C P1 DIMM3B P1 DIMM3A J101 J102 J103 J104 J105 J106 J107 J108 CPU1 CPU2 J100

Front of Chassis

Rear of Chassis

(59)

Installing Memory

Figure 5-8 Memory Block Diagram

Memory DIMM Rules

Use the following rules when installing memory DIMMs:

The minimum memory allowed on SGI Rackable C2108-TY10 cluster nodes is defined by whether or not the compute nodes are diskless:

• Diskless compute nodes: 8GB per node memory minimum • Diskful compute nodes: 4GB per node memory minimum Memory DIMM Rules

• Populate the DIMMs in the furthest slot from the processor for channel 1, first. Then channels 2 - 3.

• A minimum of one DIMM per processor must always be present - one for each processor. • Mixing DIMM Sizes - When mixing DIMMs on a channel that has a mixed number of ranks,

D D R 3 D D R 3 D D R 3 D D R 3 D D R 3 D D R 3 D D R 3 D D R 3 D D R 3 Nehalem-EP Memory Channel 1 Memory Channel 2 Memory Channel 3 S lot C S lot B S lot A

(60)

of ranks. If this option is used, populate the higher ranking DIMMs furthest from the processor (slot A).

• For maximum memory performance the DIMMs within a node must be identical in: – Speed (1066 or 1333 Mtransfer/sec)

– Number of ranks (1 or 2)

Note: The speed of the memory controller will reduce to the lowest speed DIMM on the channel.

• When configuring the memory for maximum performance, it is critical that the memory DIMM capacity is balanced across all memory channels.

Note: The key words are “memory capacity”.

Note: The maximum speed of the memory controller changes based on the number of DIMMs

placed on the channel:

• Three DIMMs on the channel the maximum speed supported is 800 MT/s • Two DIMMs on the channel the maximum speed supported is 1066 MT/s • One DIMM on the channel the maximum speed supported is 1333 MT/s

Note: Reason for the decrease in memory performance - as more DIMMs are added to a channel

the noise on the channel increases and the voltage levels decrease due to signal loading. As a result we have to lower the frequency that we run the channel as more DIMMs are added.

See Table 5-2 for the recommended DIMM configurations that will achieve the maximum memory performance.

(61)

Installing Memory

Mixing Processors and DIMM Speeds

The Nehalem-EP processor is rated for the maximum DIMM speed that it will support. Configuring memory DIMMs that have a DIMM speed that is greater than the processors capability to support will result in the memory DIMM running at the maximum speed of the processor - not the maximum speed of the DIMM. See the following table:

Three conditions must be met to have a memory speed of 1333 MT/s: • The processor must be capable of supporting 1333 MT/2 • The DIMM must be capable of running at 1333 MT/s • Only one DIMM is placed on each channel.

Placing three DIMMs on the channel will cause the DIMMs to run at 800 MT/s.

Processor Memory DIMM Actual Memory DIMM Speed 1066 MT/s capable CPUs: LSX-CPU-L5520 LSX-CPU-E5520 LSX-CPU-E5530 LSX-CPU-E5540 LSX-MEM-2G-1066 LSX-MEM-4G-1066 LSX-MEM-8G-1066 1066 MT/s (Based on 1 or 2 DIMMs per channel) 1066 MT/s capable CPUs: LSX-CPU-L5520 LSX-CPU-E5520 LSX-CPU-E5530 LSX-CPU-E5540 LSX-MEM-2G-1333 LSX-MEM-4G-1333 LSX-MEM-8G-1333 1066 MT/s (Based on 1 or 2 DIMMs per channel) 1333 MT/s capable CPUs: LSX-CPU-L5550 LSX-CPU-E5560 LSX-CPU-E5570 LSX-MEM-2G-1066 LSX-MEM-4G-1066 LSX-MEM-8G-1066 1066 MT/s (Based on 1 or 2 DIMMs per channel) 1333 MT/s capable CPUs: LSX-CPU-L5550 LSX-CPU-E5560 LSX-CPU-E5570 LSX-MEM-2G-1333 LSX-MEM-4G-1333 LSX-MEM-8G-1333 1333 MT/s (Based on 1 DIMM per

(62)

Table 5-2 Recommended Memory DIMM Configurations Processor 1 Processor 2 Memory/ Core Total Node Memory Size Maximum Mem Speed (MT/s) Channel 1 Channel 2 Channel 3 Channel 1 Channel 2 Channel 3

1A: 2GB 2A: 2GB 3A: 2GB 1A: 2GB 2A: 2GB 3A: 2GB

1.5 GB/core 12 GB 1333

1B: none 2B: none 3B: none 1B: none 2B: none 3B: none 1C: none 2C: none 3C: none 1C: none 2C: none 3C: none

3 GB/core 24 GB 1066

1B: 2GB 2B: 2GB 3B: 2GB 1B: 2GB 2B: 2GB 3B: 2GB 1C: none 2C: none 3C: none 1C: none 2C: none 3C: none

4.5 GB/core 36 GB 800

1B: 2GB 2B: 2GB 3B: 2GB 1B: 2GB 2B: 2GB 3B: 2GB 1C: 2GB 2C: 2GB 3C: 2GB 1C: 2GB 2C: 2GB 3C: 2GB

9 GB/core 72 GB 800

12 GB/core 96 GB 1066

(63)

Installing Memory

18 GB/core 144 GB 800

Table 5-2 Recommended Memory DIMM Configurations (continued)

Processor 1 Processor 2 Memory/ Core Total Node Memory Size Maximum Mem Speed (MT/s) Channel 1 Channel 2 Channel 3 Channel 1 Channel 2 Channel 3

(64)

The chart above shows the memory DIMM configurations for the optimum memory performance.

Note: The minimum compute blade memory size is 4GB. The minimum compute memory size

is 8GB if the compute blade is in s system running Scali Manage software. 1A: 8GB 2A: 8GB 3A: 8GB 1A: 8GB 2A: 8GB 3A: 8GB

15 GB/core 120 GB 800

Table 5-2 Recommended Memory DIMM Configurations (continued)

(65)

Installing Memory

Table 5-3 Non-Optimal Memory DIMM Configurations

1A: 2GB 2A: none 3A: none 1A: 2GB 2A: none 3A: none

0.5 GB/core 4 GB 1333

1A: 2GB 2A: 2GB 3A: none 1A: 2GB 2A: 2GB 3A: none

1 GB/core 8 GB 1333

1B: 2GB 2B: none 3B: none 1B: 2GB 2B: none 3B: none 1C: none 2C: none 3C: none 1C: none 2C: none 3C: none

2.5 GB/core 20 GB 1066

1B: 2GB 2B: 2GB 3B: none 1B: 2GB 2B: 2GB 3B: none 1C: none 2C: none 3C: none 1C: none 2C: none 3C: none

3.5 GB/core 28 GB 800

1B: 2GB 2B: 2GB 3B: 2GB 1B: 2GB 2B: 2GB 3B: 2GB 1C: 2GB 2C: none 3C: none 1C: 2GB 2C: none 3C: none

4 GB/core 32 GB 800

1B: 2GB 2B: 2GB 3B: 2GB 1B: 2GB 2B: 2GB 3B: 2GB 1C: 2GB 2C: 2GB 3C: none 1C: 2GB 2C: 2GB 3C: none

1 GB/core 8 GB 1333

(66)

7 GB/core 56 GB 800

8 GB/core 64 GB 800

1B: 4GB 2B: 4GB 3B: 4GB 1B: 4GB 2B: 4GB 3B: 4GB 1C: 4GB 2C: 4GB 3C: none 1C: 4GB 2C: 4GB 3C: none

10 GB/core 80 GB 1066

14 GB/core 112 GB 800

Table 5-3 Non-Optimal Memory DIMM Configurations (continued)

SGI Rackable C2108-TY10 System User s Guide

SGI

Rackable™ C2108-TY10 System

User’s Guide

Record of Revision

Contents

Figures

Tables

About This Guide

Audience

Chapter Descriptions

Related Publications

Product Support

Reader Comments

1.

Introduction

Server Board Features

Processors

Memory

Serial ATA

PCI Expansion Slots

UIO

Onboard Controllers/Ports

ATI Graphics Controller

Other Features

Server Chassis Features

System Power

Serial ATA Subsystem

Front Control Panel

Motherboard

Cooling System

2.

Server Installation

Unpack the System

Prepare for Setup

Choose a Setup Location

Warnings and Precautions

Rack Precautions

Warning:

Warning:

Warning:

Warning:

Warning:

Warning:

!

!

!

!

!

!

Server Precautions

Rack Mounting Considerations

Ambient Operating Temperature

Reduced Airflow

Mechanical Loading

Circuit Overloading

Reliable Ground

Install the System into a Rack

Separate the Sections of the Rack Rails

Outer Rack Rails

Install the Inner Rail Extension

Install the Server in a Rack

Warning:

!

Check the Node Board Setup

Access the Inside of the Chassis

Check the CPUs (processors)

Check the System Memory

Install Expansion PCI Cards

Check all Cable Connections and Airflow

Check the Drive Bay Setup

3.

System Interface

Overview

Control Panel Buttons

Control Panel LEDs

Power Fail

Overheat/Fan Fail

NIC1

NIC2

_{Rackable™ C2108-TY10 System}