SARA Computing & Networking Services
Paul Wielinga
Business unit manager
High Performance Networking
Agenda
14.00 uur Opening Paul Wielinga 14:00 – 14:15 Inleiding Paul Wielinga 14:15 – 15:00 High Performance Networking
- Research and Innovation Mark Meijerink - Operations Sadi Koçak 15.00 – 15.30 TSM (Storage back-up
Implementatie bij SARA) Jurriaan Saathof 15:30 – 16:00 Pauze en info SARA Ans Sullot
16:00 – 16:30 Supercomputing Walter de Jong OptIPuter Tijs de Kler 16:30 – 17:00 Rondleiding computervloer Walter de Jong/
Mark Meijerink Rondleiding Cave Tijs de Kler Tiled Panel Display (TPD)
17.00 – 17.30 Rondleiding Cave Tijs de Kler Tiled Panel Display (TPD)
Rondleiding computervloer Walter de Jong/ Mark Meijerink 17.30 uur Afsluiting met informele borrel
About SARA
SARA is an independent not-for-profit company
delivering a full service package in the areas of
high-performance computing & networking, visualization and
virtual reality, data storage, grid services and hosting
SARA employs ~100 fte’s
First supercomputer in The Netherlands at SARA in 1984
(Control Data CYBER 205)
The mission of SARA is two-fold:
Providing high-performance computing,
-networking and -visualization not-for-profit services
to geographically dispersed education and research
communities across The Netherlands sharing data,
information and computation resources (National
e-Science Support & Grid Service Center)
Offering commercial ICT services based on the
expertise built in the high-end activities
Commercial Services will (slowly) be moved to new
BV: VANCIS BV from April 2008
VANCIS and SARA: One single Holding
SARA mission
SARA organization
SARA is divided into three business units:
High Performance Computing and Visualization
facilitating large-scale simulations mass-storage
grid services
visualization and data-analysis
High Performance Networking
management of SURFnet6 and NetherLight design and management of regional networks network research ICT services managed hosting on-demand services co-location ASP services
Co-location and hosting
ASP and database services
On-demand services
Network design and operations
AMS-IX (Amsterdam Internet Exchange)
SURFnet6
Regional education and medical networks
VNU (large content publisher)
Royal Library (KB)
KPN, BT, Google, etc
Commercial ICT services
SARA Amsterdam
National e-Science Support & Grid Service Center
Enhance Dutch Science by:
State-of-the-art integrated infrastructure, facilities and services (high-performance computing, -networking, data storage,
visualization, grid services)
Customer Support
Participation in National and International e-Science and Grid project’s
Development and implementation of new and advanced technologies
From research phase to deployment of innovative production facilities and services
Connection to and integration into international e-Infrastructures, collaboration
Supernode @SARA: Computing,
Networking,
Internet, Visualization and Storage
resources
CAVE National supercomputer
Storage
Tiled-panel displays
IBM Power5+ National Compute cluster
Netherlight
SURFnet6
Providing state-of-the-art infrastructure (1)
Dutch National Supercomputer (capability computing)
Huygens I
14 Tflop/s Power5+ system
Mei 2007 – 2e kwartaal 2008Huygens II (replaces Huygens I spring 2008)
60 Tflop/s Power6 system
2e kwartaal 2008 – eind 2011Dutch National Compute Cluster (capacity computing)
690 Dell PowerEdge 1850 nodes
dual Intel Xeon 3.4 GHz CPUs (em64t)
Topspin low-latency high bandwidth Infiniband network
Peak performance: 8,5 Tflop/s
Providing state-of-the-art infrastructure (2)
CAVE (upgraded)
Operational since 1997, started with first SGI Onyx2 RealityMonster
SGI Onyx4 Ultimate Vision system
24 CPUs, 10 graphics pipes, 4 compositors FakeSpace CAVE
walls 4 x 3 meters, screen resolution 1400 x 1050 8 DLP projectors, Beacon Technology for stereo
Tiled panel display
15 high resolution LCD screens (21” 1600x1200) Total screen resolution 8000 x 3600 pixels
OptIPuter project
Render cluster
29 dual Intel Xeon nodes (HP) 29 high-end graphics cards
Providing state-of-the-art infrastructure (3)
Storage on-demand
Advanced services on-demand EMC disk array (50 TB)
SAN and NAS storage, FC and SATA
Tape libraries
STK Powderhorn 9310, 9840C, 9940B drives STK SL8500, 9940B drives
Long-distance SAN (30km), off-site backup Current data transfer to/from tape av. 5TB/day Capacity ~8 PB (end 2006)
Doubling of stored data every year
Large storage of scientific data, simulation and experimentation (e.g. Tier-1 CERN)
Remote back-up on-demand service
SARA Amsterdam
National e-Science Support & Grid Service Center
Servicing the grid:
Grid Resource Center
Tflops computing (capability, capacity) Pbytes data storage
Lambda networking
High resolution visualization
Central Grid services Grid Support
enabling applications enabling (local) resources helpdesk
courses, training
Implementing new grid services and technologies
Participating in national and international innovation and infrastructure projects
National context
NL-Grid, BIG-Grid www.nwo.nl/ncf www.nikhef.nl www.nbic.nl
Virtual Lab e-Science www.vl-e.nl SURFnet6 network www.surfnet.nl www.gigaport.nl BioRange www.nbic.nl LOFAR www.lofar.nl Stichting Nationale Computer
Faciliteiten www.nwo.nl/ncf
International context
Data storage and processing EGEE grid www.eu-egee.org Supercomputing DEISA grid www.deisa.org Lambda networking GLIF, Netherlight www.glif.is
Visualization & networking OptIPuter www.optiputer.net
Thank you for your
attention
National e-Science Data Center
Central data storage and archiving facility at SARA for scientific data in The
Netherlands
LOFAR
LHC Tier – 1
KNMI
National
services
VL-e
BioRange
etc.
Providing state-of-the-art infrastructure (3)
SURFnet6:
Managed dark fiber infrastructure
Congestion-free end-to-end transparent IP transport
1 Gbit/s, 10 Gbit/s and beyond Lambda services to eventually all connected organizations
One of the most advanced research networks in the world
Management of the network by SARA & Telindus
Providing state-of-the-art infrastructure (4)
Netherlight: “Bring us
your Lambda’s”
Test facility for light path provisioning for
high-bandwidth Internet traffic Optical Internet exchange for NREN’s in Amsterdam
NetherLight as GLIF European focal point
GLIF: Global Lambda Integrated Facility
Visualization courtesy of Bob Patterson, NCSA
National e-Science and Grid project’s
NL-Grid/
National production grid infrastructure SARA: provision of all central grid services NCF
Virtual Laboratory for E-science
Creation of e-Science environment SARA: Proof-of-Concept environment Bsik
Data-intensive sciences (LHC, LOFAR)
Grid infrastructure for data analysis and archiving SARA: design and deployment of grid infrastructure NIKHEF, ASTRON
BioAssist/BioRange
process bio-information from data to knowledge
SARA: service provision, appl. development support, PoC NBIC, NGI, Bsik
AlmereGrid
Desktop broadband grid
Data-intensive Sciences
High Energy Physics
DataGrid ( EU FP5 funded), EGEE (EU FP6 funded)
Data storage for
Tier-1 center
(NIKHEF/SARA): order of 2-10 PBytes/yearLCG data service challenge with SARA Storage Element (SE)
understand what it takes to operate a real grid service, run
for days/weeks at a time
get essential grid services ramped up to target levels of reliability, availability, scalability, end-to-end performance
use of NL-light Amsterdam-Geneva Lambda connection
LOFAR
LOw Frequency ARray
World’s largest radio telescope
Project coordination by ASTRON (NL) Data production, order of 10 Tbytes/day
Role SARA: data archiving and -distribution and grid enabling Data challenge similar to HEP!
International e-Science and Grid project’s
DEISA
Distributed European Infrastructure for Supercomputing Applications
SARA: Dutch supernode, security EU FP6 funding
EGEE
Enabling Grids for E-SciencE
SARA: Regional Operations Center Northern Europe, LHC Tier-1 EU FP6 funding
HPC-EUROPA
integrated provision of advanced computational services
SARA: enabling researchers to carry out collaborative research visits
EU FP6 funding
OptIPuter
infrastructure that will tightly couple computational resources over parallel optical networks using IP communication
SARA: development, persistent visualization node NSF funding