SWITCH Cloud Services

(1)

SWITCH Cloud Services

Future and current Activities of Platforms and Services

SATW Workshop A2, Rüschlikon, 30. Januar 2014

Andreas Dudler

[email protected]

(2)

• Cloud : challenges and needs (SWITCH community) • One example : SWITCHdrive

• Recent Cloud activities of SWITCH

• CUS P-2 “Information scientifique, accès, traitement, sauvegarde”

• Ongoing and future Cloud activities

Agenda

2

(3)

• Cloud topic is a (new) challenge for IT service departments!

• Traditional IT service models are questioned • Consumerization of IT

• Higher requirements of users for IT services

• Building up know-how is required for all aspect of the topic • Integration of clouds in own architecture

• Legal aspects (data protection, data privacy, data location) • Cloud services open outsourcing potential

Challenges for Swiss universities

3

Ausgangslage bei den Universitäten und Hochschulen

Das Thema Cloud ist eine Herausforderung für Informatikdienste der Hochschulen

Rechtliche Aspekte Consumerization der IT

Höhere Ansprüche der Nutzer an IT-Dienstleistungen Cloud Dienste bieten Outsourcing-Potential

Traditionelle Dienstleistungen werden in Frage gestellt Know-How Aufbau ist nötig für alle Aspekte des Themas

(4)

• IT services and researchers want to use clouds

– Scaling, capex -> opex, ease of use, concentrate on own added value

• Data location based in Switzerland

• High performance access to Cloud services • Financing models tailored to academic world

• Legal advice and security for the use of Cloud services and these contracts

• “keep control”

• Specific use cases have been gathered within the CUS P-2 project “Information scientifique: accès, traitement et sauvegarde”.

Needs in the SWITCH community

4

(5)

Input form FID

•“AAI-enabled Dropbox” Evaluation

•December 2012: 1st _{Workshop: institution’s}

expectations and user needs

•April – June 2013: test phase with end users •August 2013: decision -> build

Output

•SWITCHdrive service: starting April 2014

One example : SWITCHdrive

5

Wichtiges Element in der Evaluation: Beteiligung der Community (IT Services und Benutzer)

Wir haben auch Filesender getestet

(6)

• SATW – Swiss Academy of Technical Sciences – Participated in creating Cloud Computing white paper

– “Cloud Computing in Bildung und Forschung” workshop in Jan 2014 • GN3+ : new activity on Support to Clouds

• Helix Nebula project: following their activities, SWITCH is connectivity provider

• Swiss Academic Compute Cloud (SwissACC)

• Own hands-on project: Building Cloud Competence (BCC) • Swiss OpenStack User Group

• CUS P-2 Cloud Strategy

Recent Cloud activities of SWITCH:

Relevant Communities

6

Bisherige Aktivitäten von SWITCH im Bereich Cloud :

(7)

GN3+: Current stage of GÉANT collaboration for pan-European R&E networking – 41 partners (38 NRENs)

– Service Activity 7 (new in GN3+) on Cloud Computing

– Focused on general strategy, brokerage, and (network) integration – Growing interest among community in operating own services

Helix Nebula: “Big Science” users CERN, ESA, EMBL and (not so big) commercial Cloud providers (CloudSigma, Interoute etc.) look at brokerage and unifying interfaces

– SWITCH facilitates this work by extending its existing interconnection with CloudSigma to the European-wide research community

European Projects: GN3+/HelixNebula

7

(8)

• CUS P-2 bridge project May 2013 – April 2014 • Led by University of Zurich, GC3

• Co-lead by SWITCH

• 14 partners from Swiss academic institutions Goal

• Collaborative project to support large scale data-analysis • Support researchers in solving scientific problems on IT

infrastructure

Swiss Academic Compute Cloud

8

"Consolidate infrastructure and user support effort to enable a Swiss-wide platform for large-scale data analysis" Swiss Academic Compute Cloud (SwissACC) is an short project, serving as a funding bridge between the AAA/SWITCH program and the Information scientifique, accès, traitement et sauvegarde program of CRUS. The project provides a range of services and know-how from over 10 AAA/SWITCH projects. The 14 SwissACC partners work on two main objectives: sustaining and preserving the research communities of the former AAA/SWITCH grid projects, and increasing user and usage numbers. The project focuses on consolidating the services and simplifying the procedures that have been created to support Swiss communities. Its main goal is to free researchers from complex computational aspects of their research so they can focus on their core work.

(9)

• BCC = “Building Cloud Competence” • 10 COTS servers (Superµ/Quanta)

– Dual 10GE each, consumer SATA disks • Ceph distributed storage system • OpenStack/KVM virtualization

The BCC Experience: Building It

9

(10)

• Various researchers running VMs

– CAIDA/Georgia Tech/TAMU work studying network traffic

• Analyzed 200 GB of aggregated Netflow data over a few months

– USI performance tests

• Virtualized 10GE can outperform “bare-metal” GigE

– Digital Humanities (Medievalist)

• Currently rent server in Germany, would like moving to Swiss service

– A4Mesh

• Data: analysis, storage and publication

– ETH-SEG

• Scientific experiments

• “Dogfooding” internal users @SWITCH, e.g. Security

• Cloud Shared Storage aka Academic DropBox tests – 500 users testing for six weeks

The BCC Experience: Users

10

(11)

• OpenStack is used in many industries over the world • Vibrant community with many commercial sponsors • Use in academic community

– CERN

– ICCLab ZHAW – University of Zurich

• Use by large public Cloud service providers

– HP

– Rackspace – …

OpenStack: Gaining Traction

11

(12)

Action Items suggested by partial strategy (paraphrased): •Call for national compute/storage cloud services

(resources)

•Call for cooperative integration projects to lay groundwork •Call for national e-Science team

•Call for cooperative adoption projects on specific “e-Science” use cases

•Fund participation in other relevant national and international projects

CUS P-2 Cloud Strategy

12

Leading role of SWITCH together with SWING. in substrategies for Identity management, Cloud,

e-learning, participation in “working environment”, “national organization”.

(13)

Action Items suggested by partial strategy (paraphrased):

•Call for national compute/storage cloud services (resources)

•Call for cooperative integration projects to lay groundwork

•Call for national e-Science team

•Fund participation in other relevant national and international projects.

•Training modules for the use of cloud resources.

CUS P-2 Cloud Strategy, Whitepaper

13

(14)

Action Items suggested by partial strategy (paraphrased):

•Call for national compute/storage cloud services (resources)

•Call for cooperative integration projects to lay groundwork

•Call for national e-Science team

•Fund participation in other relevant national and international projects.

•Training modules for the use of cloud resources.

CUS P-2 Cloud Strategy, Whitepaper, SWITCH Focus

14

(15)

• Swiss edu-ID

• Long-term electronic ID for the Swiss education system • Based on Authentication and Authorization Infrastructure

(SWITCHaai) of the Swiss Universities

• SWITCH starts a project to build up the Swiss edu-ID

CUS P-2 Strategy, Identity Management

15

370’000 AAI Accounts 50 IdPs

770 SPs

Langlebige elektronische Identität für das Bildungssystem

Basis: Authentisierungs- und Autorisierungs Infrastruktur (SWITCHaai) der Schweizerischen Hochschulen

(16)

• Clear needs of the community – Input in the Innovation process

– Clear statements of requirements by university management – Data security and data protection

• Cloud as a field of action in SWITCH’s strategy (2011) • Positioning of SWITCH

– Governance and financing model for the academic community – Close integration into the academic network (SDN)

– Identity management: AAI and Swiss edu-ID (Integration with University IT architecture)

– Swiss data location, full control by users – Security expertise

Motivation for Cloud activities

16

Deklarierte Bedürfnisse der Community Eingabe in Innovationsprozess

Klare Forderungen aus den Management Meetings Datensicherheit und Datenschutz

Cloud als Thema in der Strategie von SWITCH Positionierung einer SWITCH-clud

Governance und Finanzierungsmodell

Enge Integration in das akademische Netzwerk Identitätsmanagement: AAI und Swiss edu-ID

Schweizer Standort, vollständige Kontrolle durch die Nutzer

(17)

• Building up Know-how in Cloud in all aspects – Technical Know-How

– Experience gathered in pilot installations with selected customers – Swiss Academic Compute Cloud: Cloud usage by researchers – Study of legal aspects

• Initiated “SWITCH Cloud” project 2014

Ongoing and further Cloud activities

17

Aufbau von Know-How im Thema Cloud Aufbau von technischem Know-How

Pilot-Installation mit ausgewählten Kunden

Swiss Academic Compute Cloud: Cloud Nutzung durch Forscher Klärung von rechtlichen Aspekten

Projekt “SWITCH Cloud”

Aufbau von Infrastruktur und Dienstleistungen: Academic Dropbox

Virtuelle Maschinen, Massen-Speicher als self-Service Dienstleistung Wissenschaftliche Software für akademische Benutzung

(18)

Goal of the project

Create services for the community

Build up scalable and cost-effective infrastructure Key figures

•Budget: 600’000 CHF •60 man-months

•Infrastructure in 2 locations – Lausanne and Zurich

The SWITCH Cloud Project 2014

18

Zürich

Lausanne

(19)

The SWITCH Cloud 2014

19 Cloud Infrastructure Software as a Service Academic Dropbox “Filesender functionality” Academic Software Infrastructure as a Service Virtual Machines Storage as a Service Identity Reporting Monitoring 19

(20)

Project Milestones 2014

20

April Juli September Oktober

Januar Februar

CUS P-2

(21)

• Project proposals for CUS P-2 project – Swiss edu-ID

– Cloud

• Building up the Cloud services with academic community (Advisory Committee)

• SERI (SBFI) 2017-2020 proposal by SWITCH

Next steps

21