Grid Computing and Sun

William Lo

Technical Consultant

Grid Computing and Sun

Agenda

• Customer challenges

• Grid Computing overview

• Sun and Grid Computing

• Grid success stories

Customer Challenges

• Time-to-market pressures

• Multiple concurrent projects with different

schedules & milestones

• Growing datasets… larger, more complex designs

• Insufficient in-house IT expertise

• Not enough throughput—more and faster

compute resources required

Industry Pressures

The need for more compute power:

• Life Sciences: Genetic sequencing, database queries

• Automotive: Crash tests, stress tests, Aerodynamics

• Electronic Design: Simulations, verifications, regression tests

• Digital Content Creation: Frame rendering

• Oil and Gas: Visualization, data analysis

• Software Development: Code builds

The Productivity Challenge

Improving Resource Access

Problem:

Not using Scientists/Engineering efficiently

Solution:

A Grid makes it easy for the engineers to submit jobs. They run more tests— product design cycle improves.

Benefits:

Increase productivity which leads to shorter time to market, higher

Grid Computing

A New Computing Utility Model

Problem-solving through resource pooling in virtual systems:

Virtualization of…

Transparent scalability of…

Access that is...

Resources into a dynamic, single compute resource from federated assets

CPU cycles, storage

Dependable, consistent, pervasive, inexpensive

Stages of Sun Grid Computing

Cluster Grid

Departmental Computing

• Simplest Grid deployment

• Maximum utilization of departmental resources

• Resources allocated based on priorities

Campus Grid

Enterprise Computing

• Resources shared within the enterprise • Policies ensure computing on demand • Gives multiple groups seamless access

to enterprise resources

Global Grid

Internet Computing

• Resources shared over the Internet • Global view of distributed datasets • Growth path for enterprise Campus Grids

Grid Computing Model

Cluster Grids

Usage

• Simplest Grid deployment • Single team:

Project Department • Single site firewall

Benefit

• Optimal alignment of resources, tasks, and budgets

Industry Examples

• Automotive—More simulations for safer cars

• Entertainment—Faster image-frame rendering

• Life Sciences—Pattern matching against huge datasets

• EDA—Increased design iterations create more powerful devices

Grid Computing Model

Campus Grids

Usage

• Multiple teams in organization share one or more Cluster Grids • Single site to

enterprise-wide

Benefit

• Maximum ROI and utility Industry Examples• Manufacturing—Collaborative engineering projects

• Oil and Gas—Mining-distributed databases

• Finance—More Monte Carlo simulations for uncovering new business

Grid Computing Model

Global Grids

N1

Usage

• Linked Cluster and Campus Grid Models across many organizations

• Typically used for research

Benefit

• Creates large virtual system • Facilitates collaboration

between organizations

Industry Examples

• Medicine—Provides expert teams access to medical instruments and distributed computing resources

• Academia—Facilitates collaboration between geographically dispersed groups

• Research—Enables compute-intensive projects beyond the firewall

Grid Computing Adoption Trends

Campus Grids • Multiple teams • Single organization Global Grids • Multiple teams • Multiple organizations Cluster Grids • Single team • Single organization

How it Works

Grid Hardware and Software Components

• Resource management

services above OS layer to

integrate systems

• Hardware/OS systems are

unchanged

• Minimal management

software/tool costs

• Connecting people,

departments,organizations,

communities

Key Software Technologies for the Grid

Cluster Grid:

Sun Grid Engine Campus Grid:Sun Grid Engine, Enterprise Edition

Global Grid:

Cluster Grid Solution

Sun™ Grid Engine

• Maximize resources for

single projects, teams,

departments

• Prioritize jobs

• Manage jobs from start to

finish

• Free download for Solaris

and Linux Operating

Sun Grid Engine 5.3

Essential Feature and Benefits

Feature

• Ongoing,

resource balancing

Benefits

• Easy access to computer

resources

• High utilization

(almost 100%)

• Increases project

Sun Grid Engine Free Downloads

First Year

Fast becoming the most-used Distributed Resource

Manager (DRM) tool

• 3016 unique sites

• 118,000 CPUs worldwide run Sun Grid Engine • 1 new CPU every 5 minutes

• Over 90 countries

• 60% never used Grid software before

• 92% rated Sun Grid Engine as Good, Very Good, or Excellent

When to Select Sun Grid Engine 5.3

• A small company with one product

• A single project within a larger organization

• One team with its own financing for a specific

Campus Grid Solution:

Sun™ Grid Engine, Enterprise Edition

• Consolidates departmental

(Cluster) Grids across the

enterprise

• Owners negotiate accumulated

usage assignments over time

(weeks, months, quarters)

• Policies enforced automatically

• Exceptions for specific needs/

Sun Grid Engine, Enterprise Edition 5.3

Essential Feature and Benefits

Feature

(additional to Sun Grid Engine 5.3)

• Policies module based on

accumulated usage over

time

Benefits

(additional to Sun Grid Engine 5.3)

• Align business needs to

compute resources usage

• Sharing between projects

• Fosters collaboration

Options to Set Up a Grid

Full solution

• Outsource required services to build and maintain a Grid

Grid enabling services

• Outsource creation of a Grid with goal of becoming

self-sufficient

Reference implementation

Customer Stories

➢

Synopsys

➢

University of Durham

More Customer Stories of Grid Computing at

Sun:

http://www.sun.com/grid

Synopsys

Company Overview

• Leader in complex integrated circuit design software and expert professional services

Challenges

• Needed to reduce the time & expense of regression testing

• Lack of compute usage data made it difficult to plan for future growth and spending

Solution

Results

“We’ve dramatically increased the speed and depth of testing, received quicker results and significantly increased the utilization of our computing resources.”

University of Durham—UK

Company Overview

• The Virgo Consortium—a global collaboration of cosmology researchers

Challenges

• How to run simulations of huge datasets

Solution

• Create a total throughput machine • Solaris 8, Veritas, Sun Grid Engine,

HPC ClusterTools™, Forte tools

• Sun Fire™ 6800 servers/Sun Blade™ 1000 workstations

Results: The Cosmology Machine

University of Durham—UK

“I’m very happy with the decisions we made. Cosmology is one of the highest profile, most exciting and

competitive fields of science. Four hundred fifty-six billion arithmetic operations per second sounds like a lot, but our performance demands are growing roughly in accordance with Moore’s Law. That means Sun’s scalability is crucial to us in maintaining our lead. The unique functionality that Sun architected will help us completely change the profile of cosmological

research. Sun is a great company to be working with.”

Grid Information From Sun

On the Web

Grid Computing at Sun:

sun.com/grid

• Success stories

• Web-based training and testing

• Grid Certification course information

• Grid Engine Open Source Project

Grid Computing

Product and Support Partners

• Access Computing Limited • Amdahl IT Services Avaki • Blackstone Computing • Cantiga

• Cards Engineering GmbH & CO. • Clarity Technology • Distributor Systems International Limited • EsEda Limited • Esteem Systems Plc • GNS • Semcon Trollhattan • UdiTiS SA • Areo Communications • Canon • CTC • ECS Singapore • Exson Technology • Greenbell Systems • Hitachi

• Ingram Micro Asia • Itt Frontier

• Pericomp Systech • Toshiba

• Trigem Computer • Yugi Systems

Americas

Asia Pacific

Europe/Middle East

• Amdahl IT Services

• Applied Computer Solutions • Avaki

• Avcom Technologies • Blackstone Computing • Cantiga

• CGI, Inc.

• Eakins Open Systems • Grid Queuing

• Noemix • Raytheon

Services to Set Up a Grid

Professional Services

• Consulting/integration of full solution

• Configuration support

• Ongoing tuning of compute environment

Enterprise Services

Getting Started

• Find a suitable pilot project

• Download Sun Grid Engine

• Take the Web-based training course

• Install on designated workstations and servers

• Learn how to configure for your environment,

applications, and workload

• Roll out on a wider scale

Conclusion

•Sun Grid Computing delivers competitive

advantage

•Sun has the products, services and partners to

help you succeed.

William Lo

Computational Demand

Pushing the Envelope

The Net Effect:

• More bandwidth • More systems/devices • More powerful computing technologies

To Meet:

• Time-to-market pressure • Growing datasets • Heightened budget/ROI focus

Key Software Technologies for the Grid

• Solaris Firewall • Sun Enterprise Authentication Mechanism™ • Trusted Solaris • iPlanet Certificate Management System • Sun ONE Portal

Server/Technical Compute Portal • Sun ONE Directory

Server

• Sun ONE Messaging Server • Forte™ Developer • HPC ClusterTools™/ Prism • Sun Management Center Developer Environment • Sun Management Center • Solaris™ Management Console • Sun HighGround Storage Resource Manager

• Solaris Web Start Flash

• Solaris Live Upgrade • Solaris Resource Manager • Distributed Resource Management for Cluster Grids • Distributed Resource Management for Campus Grids • Distributed Resource Management for Global Grids

Security for Grids

Solutions for demanding enterprise and government requirements Services-on-demand for Grids

Powerful tools for intranet and extranet access and collaboration

Application

Development Tools

Build and deploy performance-tuned Grid-ready applications

Systems Management

Application and systems management for IT professionals

Grid Infrastructure

Foundation software provides users access to the full power of connective resources

Cognigen

Company Overview

• Uses NONMEM to model drug variability within a patient and across a population

Challenges

• Manual processes not scaling at the company grows • Time wasted looking for resources

• Not enough throughput

Solution

Results

“Dropped it (Sun Grid Engine) in the Grid and got it working the way I wanted within 6–8 hours.”

—Darrin Perusich, Cognigen

“Each one of our scientists has one extra hour every day to work on other things.”

—Duncan Ross, Director of IT

“We experienced a ten-to-one reduction in hardware costs and almost doubled the CPU power.”

—Duncan Ross, Director of IT

“We can process twelve times the amount of NONMEM jobs, allowing us to do more complex and thorough analyses.”

Caprion Pharmaceuticals

Company Overview

• Applies proteomics to accelerate diagnosis and treatment • Internal drug discovery programs

Challenges

• Protein analysis demands required a new approach

• Difficulty predicting the exact problems that will arise over time • Insufficient in-house IT expertise to architect the right solution

Solution

• Sun Cluster Grid: Sun Blade 100 workstations, Sun Fire 6800, 4800, 3800, and 280R servers, Sun Ray, Sun StorEdge

Results

“We’re experts in biology, not computers.”

—Paul Kearny, Director of Bioinformatics

“We were extremely fortunate that the company with the highest performance technology today is the same company that has the ability, willingness, and scalability to help us feel comfortable about tomorrow—Sun Microsystems.”

Customer Stories

Cognigen

Synopsys

University of Durham