Grid vs. Cloud Computing and Why This Should Concern the Optical Networking Community

(1)

1

Grid vs. Cloud Computing and Why This Should Concern

the Optical Networking Community

OFC/NFOEC 2009

« Virtualizing and Scheduling Network resource for

Emerging IT services: the CARRIOCAS approach »

Pascale Vicat-Blanc Primet (INRIA) Dominique Verchère (Alcatel-Lucent Bell Labs)

March 23rd₂₀₀₉

Optical Fiber Communication Conference and Exposition & the National Fiber Optic Engineers Conference

CAlcul Réparti sur Réseau Internet Optique à CApacité Surmultipliée*

* Distributed/Grid Computing services delivered by Internet Optical Networks with Ultra-high transmission Capacities

(2)

2

Cliquez pour modifier le style du titre

Contents

1. CARRIOCAS Challenges and Project presentation

2. Efficient Network architecture combining capacity and flexibility 3. Scheduling, Reconfiguration & Virtualization (SRV) service

4. CARRIOCAS Pilot Network and Experimentations 5. Conclusion

(3)

3

Cliquez pour modifier le style du titre

CARRIOCAS Challenges



To research, design and implement a ultra-high bit rate

network reconfigurable according to grid applications

connectivity requirements



Transmission capacity 40Gbit/s per wavelength*



Enhanced

application-network interactions

with

SRV



Guarantied

network service deliveries

in

function

of

Application QoS requirements

.



To develop new

Services

&

Usages



collaborative engineering on virtual prototypes



Computing Intensive Simulation Applications



interactive visualization



To specify new business models of services

integrating IT access and connectivity

The 40Gb/s transponder prototypes have been successfully deployed on Bruyères-le-ChâtelSaclay and SaclayClamart links, performance are at nominal level.

(4)

4

Cliquez pour modifier le style du titre

Academia

SME’s

Industrials

CARRIOCAS Partnership

Financial partners: Application Computing Networking Optics

(5)

5

Relative Cost comparisons over 2007 - 2012

0 0.5 1 1.5 2 2.5 3 3.5 4 4.5 5 5.5 6 2007 2008 2009 2010 2011 2012 Year

Router over Photonic X-Connect Carrier Ethernet Switch over Photonic X-Connect Router over SDH X-Connect Carrier Ethernet Switch over SDH X-Connect

Router over WDM Carrier Ethernet Switch over WDM

- 0.00 - 5.00 - 10.00 - 15.00 - 20.00 - 25.00 - 30.00 - 35.00 - 40.00 Tbps Traffic Evolution



Network Traffic flow characterizations «Data Grid» generated by large

organizations (companies and institutions) users (clients) and datacenters (IT resource providers)

CARRIOCAS Service optimized Optical Network

dimensioning and sizing

(°) (*)



Carrier Grade Ethernet Switch over SDH X-Connect(°)



TSS over ROADM: CARRIOCAS based architecture (*)

 Layer 2 (Carrier Grade Ethernet) and Layer 1 (WDM) reconfiguration capabilities

(6)

6

UNI Edge Nodes

Provider Edge Node (G)MPLS controlled Network

UNI Provider Node (P) P P P PE PE Picture Walls (Visualization Resources) Scientific Instruments/Sensors (Acquisition Resources) Usage SLA Se rv ic e S to re fr on t CPU Resources Storage Resources Specific Software (AppsResources)

Service Integrator & Presentation

Provider SLA

Network Service Management (S.R.V.)

Bio-informatics Scientists High Energy Physic

engineers ! ! ! ! IT infrastructures ! ! ! !

Telecom Infrastructure Operator Grid Service

Provider

Provider Edge Node (PE) Car Designers – Manufacturers Datacenter Operators Customers (Enterprises) CE

Customer Edge node (CE) CE

P P

Towards Virtualized Infrastructures and

«Extended Service Providers»

(7)

7

CARRIOCAS services suited for Grid

Applications



V1 : Connectivity services

 Requirements: to guarantee Quality of Experiences for grid application users

 Adaptive connections configurations with QoS guarantee (bandwidth, latency,

availability …) negotiated according to Grid Application workflow needs

 Technology enabler: GMPLS, PCE, Timed based Network management



V2 : Full Virtualized services



Requirements: To integrate grid resources management for executing the Grid Application workflows



Selection, reservation and interconnection of Computational, Storage and Visualization Centers which may come from 3rd_{party resource}

infrastructure providers (e.g. datacenters, HPC-centers)



Co-selection and cross-optimization of network and grid (application) resources



Technology enablers: WSRF, and network protocols + VXDL & VXcore (INRIA),

(8)

8



One Data flows can be mapped on one EVC allocated on dedicated WDM

Binding of VISUPIPE flows (jobs) and

Carrier Grade Networks services (resources)

Automatic Switched Optical Network Transport Service Switch

(Ingress ROADM) OCh [PSC,WDM] TE-link TSS Add/Drop Ports OCh TSS Add/Drop Ports

Transport Service Switch

PSC

(Egress ROADM)

PSC TE Link ⇔ WDM FA-LSP

Automatic end-to-end Ethernet Virtual Circuit provisioning

[WDM,WDM] TE-link [WDM,WDM] TE-link [WDM, PSC] TE-link PSC WDM LSP Dynamic mapping (CE-VLAN) Mapping (CE-VLAN) 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D Data Source

Cluster File System

Data transformation: Volumetric transfer function,

Surface construction

Filtering Rendering Display

Raw data Transformed

data

Filtered data Frame

buffer

 24 Mpixels x 32 bits x 30 images/s x 2 for stereo = 46,08 Gb/s  Low latency requirements for interactivity

(9)

9

Cliquez pour modifier le style du titre

Consultation Network

Res. Scheduler Timed _TED

Requests / Reponses Cds Management : Read / Write Scheduled PCE Planning tools TED Synchronization/ Alimentation NMS Resource inventory NE NE NE NE NE A B _C D E IGP-TE NE NE NE NE NE A B C 2 3

Service Provider ’s Carrier Network

Ain/out=20Gbps Bin/out=4 0Gbps Cin/out =20Gbps NE A B C Bin/out=40Gbps

Ain/out=20Gbps Cin/out=20Gbps Business view Service view Network view Element view NE NE NE A B C

Ain/out =20Gbps Bin/out =40Gbps Cin/out=2 0Gbps NE NE NE NE NE A B C

Ain/out=20Gbps Bin/out=4 0Gbps Cin/out =2 0Gbps Connection inventory NetConf. Transport Networks

Commercial Filters (policies)

Consultation Network

Res. Scheduler Timed _TED

Requests / Reponses Cds Management : Read / Write Scheduled PCE Planning tools TED Synchronization/ Alimentation NMS Resource inventory NE NE NE NE NE A B _C D E IGP-TE NE NE NE NE NE A B C 2 3

Ain/out=20Gbps Bin/out=4 0Gbps Cin/out =20Gbps NE A B C Bin/out=40Gbps

Ain/out=20Gbps Cin/out=20Gbps Business view Service view Network view Element view NE NE NE A B C

Ain/out =20Gbps Bin/out =40Gbps Cin/out=2 0Gbps NE NE NE NE NE A B C

Ain/out=20Gbps Bin/out=4 0Gbps Cin/out =2 0Gbps Connection inventory NetConf. Transport Networks

Commercial Filters (policies)

9

SRV position in Telecom Network

Scheduled Management Components of Network Resources

Network Management Function Layer

Connectivity Services (v1) Virtualized Services (v2) Scheduling, Reconfiguration & Virtualisation

S.R.V. Service Negotiation

Service Negotiation

Shared Information / Data Model

Service Selection Composition

Resource abstraction / Virtualization

Policies Policies Service Publication / Notification Service Publication / Notification Patterns (WSLA) Patterns

(WSLA) ContractsContracts

Scheduling

Scheduling Processes_Processes

S.R.V. Service Negotiation

Service Negotiation

Shared Information / Data Model

Service Selection Composition

Resource abstraction / Virtualization

Policies Policies Service Publication / Notification Service Publication / Notification Patterns (WSLA) Patterns

(WSLA) ContractsContracts

Scheduling

Scheduling Processes_Processes

(10)

10

Cliquez pour modifier le style du titre

CARRIOCAS Demonstration platform

CARRIOCAS pilot network demonstrates advanced network service functions and proving their concepts through an emulation platform

Feasibility of automated network management and control with dynamic

delivery of Telecom network services to end users: e.g. company customers.

The first steps are focused on Connectivity services managed through a well

defined Service Management System (SRV) described.

Each connectivity service is designed with specific attributes including:

 Service Access points (UNI), throughput (x Gbps), end-to-end latency (y ms), time interval [T₁,T₂]

GMPLS based control protocols, Timed based PCE, Network Resource Scheduler with Carrier Switches and Wavelength Cross-connects as connection services are based on Ethernet Virtual Circuit over Wavelength connections:

 Provisioned: through NMS with automated network Operations through MTOSI 2.0 (triggered by SRV)

(11)

11

Cliquez pour modifier le style du titre

Service Activation Interface : SRV-NRS



Connection Service Component Activation: EVC Services

 SRV  NRS (phase 1): Timed EVPLINE, EVPLAN, E-TREE provisioning

 TE management  Connection Provisioned Monitoring NRS  SRV-DB

 Background and periodic process (from Network States)



Downward information: SRV  NRS



Connectivity topology is an Ethernet Service graph

 Access points: location,

 Bandwidth (pipes)

 Latency on the links



Commands for new connectivity services

 Feasibility  Reservation  Provision  Activation



Upward information: NRS  SRV



Connection status:  Reserved / Available  Provisioned / Unprovisioned

 Activated (i.e. used) / De-activated



Shared Info/Data Model based on MTOSI 2.0 / TMF

(12)

12

Cliquez pour modifier le style du titre

Connection Services Connectivity

Services



Ethernet  MPLS-TP over WDM Network architecture referencing :

 Reconfigurable-OADM based WDM transmission: 1626LM (with 40 Gbps)  Carrier Grade Ethernet based Transport Networks: 1850TSS

 Network Configurations based on Management: 1350-OMS service functions



Large Scale Distributed Applications (Grid Applications):

 Computing and Storage Service on Demand (Ter@tec): LUSTRE CFS Application  Instruments: Industrial (Remote Visualization): EDF Picture Walls

References on Experimentation plans

1626LM Network Network Controller Controller Network Controller Network Controller Network Network Controller Controller Network Network Controller Controller Univ. Orsay (PoP 2) EDF Clamart (PoP 1) CEA-Saclay (PoP 3) CEA Ter@tec (PoP 4) Grid Application Client / Server Application Client Visual. Server

Network Management Systems Network Management Systems (1353NM (1353NM –– 1354BM-Ethernet) 1354BM-Ethernet) HPC + Storage Servers Application Client Storage Server High-Capacity transmission λ: nx10 Gb/s 10Gb/s Interfaces (Ethernet frame aggregation over λ)

1626LM Ethernet Switch (Customer Equipment) 1850 TSS-320 (Provider Edge) Transmissions : λ: 4x10 Gb/s  40 Gb/s Negotiation protocol Negotiation protocol

(e.g. WS-agreement based)

Advertisement protocol

Advertisement protocol

(e.g. WS-notification based)

North Bound Interface

South Bound Interface South Bound Interface

Scheduling Reconfiguration & Virtualization (SRV) service Scheduling Reconfiguration & Virtualization (SRV) service Scheduling Reconfiguration & Virtualization (SRV) service Scheduling Reconfiguration & Virtualization (SRV) service Ethernet Switch

(Customer Equipment) _{A1850 TSS-320 (PE)}

1626LM 1626LM PE CE CE PE link 1 link 3 link 2 link 4 Requests Requests Delivery Delivery

(13)

13

Cliquez pour modifier le style du titre

CARRIOCAS Network Pilot and

test bed configuration

4x10 GEth. Access

Deployment phase 1 (10Gb/s): June 2007 Deployment phase 2 (40Gb/s): June 2008

Lambda 1 à 10G omnibus Lambda 2 à 10G Lambda 3 à 10G Lambda 4 à 10G Lambda 5 à 40G Légende Saclay Bruyères Le Châtel Orsay Clamart Trib 40G prototypes fournis gracieusement par Alcatel dans SP1 durant la vie du projet 4 x 10GEth.

Transport Service Switch

Carrier Grade Ethernet with T-MPLS capabilities

Nx10 Gbps Transmission Local monitoring Network Management 1850 TSS 1626 LM

Ter@tec

storage _storage Super-computers Picture wall Issy les Moulineaux 1354BM 1353NM 4 x 10GEth. 4 x 10GEth. 4 x 10GEth. Local monitoring 40 Gbps Transmission

(14)

14

Towards Network Centric Cloud Computing



Respond to strong demands by Organizations on accessing

High-Performance IT services remotely through WAN with strict QoS:

 Grid  Cloud Computing towards Utility Computing



Service optimized Transport Networks & Data Grid Facilities will be

built on different requirements to offer e-science services

 Depending if Public or Private owned infrastructures

 Needs to coordinate our efforts for standardizations



SRV v1 software, developed by INRIA, automates:

• Support for different network services offered by multilayer networks (Lx-VPN) • Mapping of applications/users requirements over connectivity services

• Fine grain Dynamic Bandwith Requests scheduling

• Connection service Reconfiguration  Optimization  X-optimization



Standardization efforts at ETSI (Grid TC) led by BT and

Alcatel-Lucent with contributions from BT, FT, Telefónica, Nokia-Siemens,

(15)

15

Cliquez pour modifier le style du titre

Special thanks to PHOSPHORUS and G-Lambda projects for their stimulating and valuable interactions



Questions ?

Many Thanks to

CARRIOCAS-SP2 Colleagues for their contributions

French Ministry of Industry, Essonnes, Haut-de-Seines and Paris General Council

for their supports on CARRIOCAS project http://www.carriocas.org

(16)

16

Cliquez pour modifier le style du titre

CARRIOCAS Network Environment



Emulated Platform is based on CARRIOCAS network pilot architecture*



Two Routing Areas (1 per switching layer): (i) CGEthernet (ii)

Wavelength



5 PoP emulated, each PoP is

 Carrier Switch (Ethernet-switching capable) + PXC (Lambda-switching capable)



10 Node controllers (5+5): RSVP-TE + OSPF-TE



2 Path Computing Engines (1 per layer): PCEP, OSPF-TE



1 NMS: performs resource inventory at L2 and L1



Dynamic Ethernet LSP establishments



5 EVPLINE services



1 EVPLAN service (4 locations)



Static Wavelength LSP characterized by



Capacity: 3x10Gbps, 1x30Gbps, 1x40Gbps



Latency: 1ms ≤ t ≤ 10 ms UNI λ / GMPLS LSR1 Wavelength connection 1 OADM node CORE LSR2 Routing Area 1 Routing Area 0 Wavelength X-Connect

Intermediate edge node Ingress node _{Egress node}

Ethernet LS_{P 2}

Virtual Topology

Carrier Grade Ethernet Network services

Ethernet LSP 1

Wavelength connection 2

(17)

17

Cliquez pour modifier le style du titre



5 point-to-point Ethernet LSP (E_LSP): E_LSP(ERO,BW(Gbps),delay(ms))

 E_LSP_1 ({AB},5,1); E_LSP_2 ({ABC},10,5); E_LSP_3 ({A↔C},40,1); E_LSP_4 ({AC

D},20,10); E_LSP_5 ({A↔B↔E},15,5);



1 point-to-multipoint Ethernet LSP:

 E_LSP_ 6({tree_1},10,10);

MTOSI Commands (over HTTP/SOAP - AXIS)

NRS Agent

Network

Management System

6Network configuration implementation (1/2)

SRV SRV-DB S-PCE Service Scheduling TE-Link DB S-PCE TE-Link_DB PCC XML NetConf RPCs PCEP Commands (RPCs) RSVP-TE + OSPF-TE LSRs Layer 2 Switch Capable (51)

RSVP-TE + OSPF-TE LSRs Lambda Switch Capable (150)

TE-link TE-link PMSER algorithm LSR_A LSR_D LSR_E LSR_B LSR_C LSR_1 LSR_3 LSR_2 LSR_4 LSR_5 C B D E A tree_1

(18)

18

Network configuration implementation (2/2)



5 wavelength LSPs (L_LSP): L_LSP(ERO, BW(Gbps)

 L_LSP_1 ({1 ↔ 4},10); L_LSP_2 ({1 ↔(4)↔ 3},30); L_LSP_3 ({1↔(5)↔ 2},40); L_LSP_4 ({2

↔ 3},10); L_LSP_5 ({1 ↔ 5},15);



Scenarios – Connectivity services managed by SRV

 T₀=1 (January 1st_{) , T}

1=55 (February 24th), duration=nb of slots (1 time_slot = ½ day),

e.g. duration = 60 (30 days)

5 ms 10 ms 1 ms 5 ms 100ms 5 ms e2e delay (ms) 15 / 10 30 / 10 5 / 1 20 / 10 10 / 5 38.4 / 30 Gbps Max. Throughput/ Guaranteed BW. 99.99% 99.9 % 99.999% 99.999% 99.999% 99.999% Service

availability Application_id(information)

T₁/duration End-points Tele-Call-Conf 30 / 16 C{A,E,D} Data Storage 35 / 12 D  C Video-Streaming 38 / 6 E  D Ultra-high perf. Visu 24/20 A _↔ D Back-up Storage 26/60 AB Ultra-high perf. Visu Coll. 23/10 A ↔ B T₁-ε T₂= T₁ + duration T₂+ε T₀