Smarter Cluster Supercomputing from the Supercomputer Experts
Maximize Your Productivity with Flexible,
High-Performance Cray
®CS400™ Cluster
Supercomputers
In science and business, as soon as one question is answered another is waiting. And with so much depending on fast, accurate answers to complex problems, you need reliable high performance computing (HPC) tools matched to your specific tasks.
Understanding that time is critical and all HPC problems are not
created equal, we developed the Cray® CS400™ cluster
super-computer series. These systems are industry standards-based, highly customizable, easy to manage, and purposefully designed to handle the broadest range of medium- to large-scale simulations and data-intensive workloads.
All CS400 components have been carefully selected, optimized and integrated to create a powerful, reliable high-performance compute environment capable of scaling to over 11,000 compute nodes and 40 peak petaflops.
Flexible node configurations featuring the latest processor and interconnect technologies mean you can get to the solution faster by tailoring a system to your specific HPC applications’ needs. Innovations in packaging, power, cooling and density translate to superior energy efficiency and compelling price/performance. Expertly engineered system management software instantly boosts your productivity by simplifying system administration and mainte-nance, even for very large systems.
Cray has long been a leader in delivering tightly integrated super-computer systems for large-scale deployments. With the CS400 system, you get that same Cray expertise and productivity in a flex-ible, standards-based and easy-to-manage cluster supercomputer.
CS400-AC™ Cluster Supercomputer:
Air-Cooled and Designed for Your Workload
The CS400-AC™ system is our air-cooled cluster supercomputer. Designed to offer the widest possible choice of configurations, it is a modular, highly scalable platform based on the latest x86 pro-cessing, coprocessing and accelerator technologies from Intel and NVIDIA. Industry standards-based server nodes and components have been optimized for HPC workloads and paired with a compre-hensive HPC software stack, creating a unified system that excels at capacity- and data-intensive workloads.
Regardless of your application requirements, the Cray XC series scales across the performance spectrum — from smaller configurations up to the world’s largest and highest-performing supercomputers.
CS400-AC Hardware Configuration Options
● Cray GreenBlade or rackmount servers ● Two- or four-socket x86 Intel Xeon processors ● Intel Xeon Phi coprocessors or NVIDIA Tesla GPU
accelerators
● Large memory per node
● Multiple interconnect options: 3D torus/fat tree, single/ dual rail, QDR/FDR InfiniBand
● Local hard drives in each server
● Choice of network-attached file systems and parallel file systems
● Server management options
Choice of Flexible, Scalable Configurations
Flexibility is at the heart of the Cray CS400-AC system design. At the system level, the CS400-AC cluster is built using blades or rackmount servers.
The Cray® GreenBlade™ platform is comprised of server blades aggregated into chassis. The platform is designed to provide
mix-and-match building blocks for easy, flexible configuration at the node, chassis and whole-system level. Among its advantages, the GreenBlade platform offers extremely high density (up to 80 blades per 42U rack), excellent memory capacity (up to 512 GB per blade node), a choice of coprocessors and accelerators, local storage and a built-in management module in each chassis for industry-leading reliability.
Cray rackmount servers offer maximum configurability in an industry-standard package optimized for HPC by Cray. Rackmount servers can be configured with large memories, up to eight disk drives or coprocessors as required for your specific need.
Both GreenBlade and rackmount platforms feature the latest Intel® Xeon® processors with available support for Intel® Xeon Phi™
copro-cessors and NVIDIA® Tesla® GPU accelerators.
The CS400-AC system also offers multiple interconnect topology options, local storage and network-attached file system options. It has the ability to integrate with Lustre®-based global parallel storage systems including Cray® Cluster Connect™, Cray Tiered Adaptive
Storage (TAS) and Cray® Sonexion® scale-out storage.
With these blade and rackmount platforms, a Cray CS400-AC system can be tailored to multiple purposes — from an all-purpose mas-sively parallel HPC cluster, to one suited for shared memory parallel tasks, to a cluster optimized for hybrid compute and data-intensive workloads.
At the node functionality level, the cluster has two types of server nodes: compute and service. Compute nodes run parallel MPI and/or Open MP tasks with maximum efficiency. Service nodes provide I/O connectivity and can also function as login nodes.
The configuration options available for GreenBlade and rackmount servers are described on their respective datasheets.
With industry-standard components throughout, each configuration can be replicated over and over to create a reliable and powerful large-scale system. Additionally, you have the option of fitting a CS400-AC system with liquid-cooled rack rear door heat exchangers and chillers for more energy and cost savings.
Easy, Comprehensive Manageability
A flexible system is only as good as your ability to use it. The Cray CS400-AC cluster supercomputer offers two key productivity-boost-ing tools — a customizable HPC cluster software stack and the Cray Advanced Cluster Engine (ACE™) system management software.
Cray HPC Cluster Software Stack
HPC Programming Tools Development & Performance Tools Cray PE on CS
Intel Parallel Studio XE Cluster Edition
PGI Cluster Development
Kit® GNU Toolchain NVIDIA ®CUDA®
Application Libraries Cray
®LibSci™,
LibSci_ACC Intel®MPI IBM Platform MPI MVAPICH2 OpenMPI
Debuggers Rogue Wave TotalView® Allinea DDT, MAP Intel®IDB PGI PGDBG® GNU GDB
Schedulers, File Systems and Management Resource Management /
Job Scheduling SLURM
Adaptive Computing
Moab®, Maui, Torque ProfessionalAltair PBS IBM Platform™ LSF® Grid Engine
File Systems Lustre® NFS GPFS Panasas PanFS® Local
(ext3, ext4, XFS)
Cluster
Management Cray®Advanced Cluster Engine (ACE™) Management Software Operating
Systems and Drivers
Drivers &
Network Mgmt. Accelerator Software Stack & Drivers OFED Operating
Systems Linux®(Red Hat, CentOS)
®
The HPC cluster software stack con-sists of a range of software tools com-patible with most open source and commercial compilers, debuggers, schedulers and libraries. Also avail-able as part of the software stack is the Cray Programming Environment, which includes the Cray Compiling Environment, Cray Scientific and Math Libraries, and Performance Measurement and Analysis Tools.
Cray
®Advanced Cluster Engine (ACE
™)
Hierarchical, Scalable Framework for Management, Monitoring and File Access
Hierarchical management infrastructure Divides the cluster into multiple logical partitions, each with unique personality Revision system with rollback Remote management and remote power control
GUI and CLI to view/change/control, monitor health; plug-in capability Automatic server/network discovery Scalable, fast, diskless booting High availability, redundancy, failover
Cluster event data available in real-time without affecting job performance Node, IB network status BIOS, HCA information Disk, memory, PCIe errors Temperatures, fan speeds Load averages Memory and swap usage Sub-rack and node power I/O status
RootFS – high-speed, cached access to root file system allowing for scalable booting
High-speed network access to external storage
ACE-managed, high-availability NFS storage
MANAGEMENT MONITORING FILE ACCESS
The Advanced Cluster Engine (ACE) management software simplifies cluster management for large scale-out environments with extremely scalable network, server, cluster and storage man-agement capabilities. Command line (CLI) and graphical user inter-face (GUI) options provide flexi-bility for the cluster administrator. An easy-to-use ACE GUI con-nects directly to the ACE daemon on the management server and can be executed on a remote system. With ACE, a large system is almost as easy to understand and manage as a workstation.
● Simplifies compute, network and storage management ● Supports multiple network topologies and diskless
configurations with optional local storage ● Provides network failover with high scalability
● Integrates easily with standards-based HPC software stack components
● Manages heterogeneous nodes with different software stacks ● Monitors node and network health, power and component
temperatures
Built-in Energy Efficiencies and Reliability Features Lower Your TCO
Energy efficiency features built into the CS400-AC system, combined with our long-standing expertise in meeting the reliability demands of very large, high-usage deployments, means you get more work done for less.
The CS400-AC options for additional energy and cost savings include high-efficiency load balancing power supplies, liquid-cooled rack rear door heat exchangers and chillers and a 480V power distribution unit with a choice of 208V or 277V three-phase power supplies. It means you can use industry-standard 208V and 230V power as well as 277V (single-phase of a 480V three-phase input) and reduce power loss caused by step-down transformers and resistive losses as the power is delivered from the wall directly to the rack.
Reliability is built into the system design, starting with our careful selection of boards and components. Then multiple levels of redun-dancy and fault tolerance ensure the system meets your uptime needs. The CS400-AC cluster has redundant power, cooling, manage-ment servers and networks — all with failover capabilities.
Intel
®Xeon
®Processor E5-2600 Product Family
The Intel Xeon processor is at the heart of the agile, efficient datacenter. Built on Intel’s industry-leading microar-chitecture based on the 22nm 3D Tri-Gate transistor technology, the Intel Xeon processor supports high-speed DDR4 memory technology with increased bandwidth, larger density and lower voltage over previous generations. The Intel support for PCI Express (PCIe) 3.0 ports improves I/O bandwidth, offering extra capacity and flexibility for storage and networking connections. The processor delivers energy efficiency and performance that adapts to the most complex and demanding workloads.
Intel
®Xeon Phi™ Coprocessor for Parallel Workloads
The Intel Xeon Phi coprocessor x100 series is based on Intel Many Integrated Core (Intel MIC) architecture and works synergistically with the Intel Xeon processor to increase developer productivity via common programming models and tools. It enables dramatic performance gains for demanding applications delivering over 1 teraflop peak double-precision performance. Additionally, it offers many-core compared to multicore with wider vector processing units for greater floating point performance/watt. The Intel Xeon Phi coprocessor is highly parallel and programmable and based on open standards with support for data thread and process parallelism with full support from Intel Cluster Studio XE while delivering outstanding aggregate performance and higher memory bandwidth.
NVIDIA
®Tesla
®K40 GPU Computing Accelerator
GPU-accelerated computing offers unprecedented application performance by offloading the compute-intensive portions of the application to the GPU. The NVIDIA Tesla K40 GPU accelerator features 2,880 cores and the industry’s highest single- and double-precision peak floating point performance — 4.29 teraflops and 1.43 tera-flops, respectively. Equipped with 12 gigabytes of GPU accelerator memory, the NVIDIA Tesla K40 processes datasets twice as large as prior-generation GPUs, making it well suited for big data analytics and large-scale scientific computations. It outperforms CPUs by up to 10 times and delivers additional performance with its GPUBoost feature, converting power headroom into user-controlled performance boost.
© 2014 Cray Inc. All rights reserved. Specifications are subject to change without notice. Cray is a registered trademark of Cray Inc. All other trademarks mentioned herein are the properties of their respective owners. 20150419EMS
Cray Inc. 901 Fifth Avenue, Suite 1000 Seattle, WA 98164 Tel: 206.701.2000 Fax: 206.701.2500 www.cray.com
Cray CS400-AC Specifications
Architecture Air cooled, up to 80 nodes per rack cabinet Processor, Coprocessor and
Accelerators
Support for up to 12-core, 64-bit, Intel® Xeon® processor E5-2600 v3
Optional support for Intel® Xeon Phi™ coprocessors and NVIDIA® Tesla® GPU computing accelerators
Memory Up to 512 GB DDR4 RAM in GreenBlade systems and up to 1,536 GB in rackmount servers Interconnect
and Networks
Available FDR InfiniBand with Connect-IB® or QDR True Scale Host Channel Adapters
Options for single- or dual-rail fat tree or 3D torus 1 GbE and 10 GbE Ethernet for management
Redundant networks (InfiniBand, GbE and 10GbE) with failover
System Administration
Advanced Cluster Engine (ACE™)
● Complete remote management capability ● GUI and command line system administration ● System software version rollback capability
● Redundant management servers with automatic failover
● Automatic discovery and status reporting of interconnect, server and storage hardware
● Cluster partitioning into multiple logical clusters, each capable of hosting a unique software stack ● Remote server control (power on/off, cycle) and remote server initialization (reset, reboot, shutdown) ● Scalable fast diskless booting for large node systems and root file systems for diskless nodes ● Multiple global storage configurations
Reliable, Available,
Serviceable (RAS) Redundant power, cooling and management servers with failover capabilitiesAll critical components easily accessible Resource Management and
Job Scheduling
Options for SLURM, Altair PBS Professional, IBM Platform™ LSF, Adaptive Computing Torque, Maui and Moab, and Grid Engine
File System Cray® Cluster Connect™, Cray® Sonexion®, NFS, Local FS (Ext3, Ext4 XFS), Lustre®, GPFS and Panasas® PanFS® available as global file systems
Disk Storage Full line of FC-attached disk arrays with support for FC, SATA disk drives and SSDs Operating System Red Hat, SUSE or CentOS available on compute nodes
ACE Management Servers delivered with Red Hat Linux®
Performance Monitoring Tools Open source packages such as HPCC, Perfctr, IOR, PAPI/IPM, netperf
Compilers, Libraries and Tools
Options for Open MPI, MVAPICH2, Intel MPI and IBM Platform MPI libraries
Cray Programming Environment on Cluster Systems (Cray PE on CS), PGI, Intel Cluster Toolkit, NVIDIA® CUDA®,
CUDA C/C++
OpenCL, DirectCompute Toolkits, GNU, DDT, TotalView, OFED programming tools and many others Power Power supplies deliver up to 38 kW per cabinet, with actual consumption based upon configuration
Optional 480V power distribution with a choice of 208V or 277V three-phase power supplies Cooling Features
Air cooled
Airflow: up to 3,000 cfm in densest configuration; Intake: front; Exhaust: back Optional passive or active chilled cooling rear door heat exchangers
Cabinet Dimensions (HxWxD) 42U/19”: 78.39” (1,991 mm) x 23.62” (600 mm) x 47.24” (1,200 mm) standard rack cabinet Cabinet Weight 42U/19”: up to 1,856.3 lbs.; 232 lbs./sq. ft. per cabinet
