Manjra Cloud Computing: Opportunities and Challenges for HPC Applications

(1)

Cloud Computing:

Opportunities and Challenges

(2)

Prediction:

Buyya’s “Cloud is the Computer” 100% real in 2020!

Dr. Rajkumar Buyya

Gri

d Computing and

D

istributed

S

ystems (GRIDS) Lab

Dept. of Computer Science and Software Engineering

The University of Melbourne, Australia

www.gridbus.org

/megha

www.buyya.com

www.manjrasoft.com

Gridbus Sponsors

Manjrasoft

Dr Rajkumar Buyya

Ch ie f Exe c u tiv e O ffic e r

Manjrasoft Pty Ltd Room 5.31, ICT Building, 111, Barry Street, Carlton,

Melbourne, VIC 3053, Australia P: +61-3-8344 1344 | F : +61-3-9348 1184 E: [email protected]

http://www.manjrasoft.com

(3)

Issues with HPC



So far, HPC is too much patronaged by Govt.

and dominated by scientific apps:



This has changed recently with Clusters



Setting up HPC environment is harder and

requires too much of expertise.



Often people with “PhD” qualification needs to

be hired develop parallel applications.



Programming in MPI is harder.



Need more advances in “Application Development

(4)

4

Issues with HPC



HPC environment is often setup to meet “peak”

needs.



HPC systems are often “underutilised”



Few applications dominate the system.



Clouds can help here:



Blessing for those who have a great idea for

applications (and don’t have huge budget).



“Lease” more resources only when you need.



But “Clouds” need to have SDK supporting HPC

(5)

Too popular: too many are

“In Search” of Cloud Computing

Legend:

Cluster computing

,

Grid computing

,

(6)

6 Aneka: .NET-based Cloud Computing



SDK containing APIs for

multiple programming

models and tools



Runtime Environment for

managing application

execution management



Suitable for



Development of Enterprise

Cloud Applications



Cloud enabling legacy

applications



Portability for Customer Apps:



Enterprise ↔ Public Clouds



.NET/Win ↔ Mono/Linux

Private Cloud

LAN network

Amazon

Microsoft

Google

IBM

Data Center

Hardware Profile Services

Container

Pe rs is te n ce Task Model Thread

Model Map Reduce Model ModelsOther

.NET @ Windows Mono @ Linux

S ec u rit y Programming Models Software Development Kit

Management Studio

Application

Foundation Services Membership

Services ReservationServices ServicesLicense

APIs _ExplorerDesign

Management Kit

Administration Portal SLA-Negotiation

Web Services Web ServicesManagement

Storage

Services AccountingServices Fabric Services

Dynamic Resource Provisioning Services

Infrastructure

Physical Machines/Virtual Machines

Private Cloud

LAN network

Private Cloud

LAN network

Amazon

Microsoft

Google

IBM

Data Center

Amazon

Microsoft

Google

IBM

Data Center

Hardware Profile Services

Container

Pe rs is te n ce Task Model Thread

Model Map Reduce Model ModelsOther

.NET @ Windows Mono @ Linux

S ec u rit y Programming Models Software Development Kit

Management Studio

Application

Foundation Services Membership

Services ReservationServices ServicesLicense

APIs _ExplorerDesign

Management Kit

Administration Portal SLA-Negotiation

Web Services Web ServicesManagement

Storage

Services AccountingServices Fabric Services

Dynamic Resource Provisioning Services

Infrastructure

(7)

Clouds pose Challenge



Some HPC Apps (e.g., MPI-based) often use

“space” shared allocation:



Nodes need to be allocated/reserved often for entire

execution duration.



Cloud providers will “charge” once you lease nodes

irrespective of their usage.



“Block” charging of Clouds (hourly basis like in

Amazon) is NOT good for HPC applications.

(8)

8

What do we do?



Can we force Cloud providers to change

“charging” policy?



Can we bypass “VMs”… to gain best

performance.



We/HPC definitely need to align with

“mainstream” computing industry:



Make “HPC” Apps accessible/beneficial for all.



Offer “HPC” Apps as services so that they can be

(9)

When will Cloud spending become

50% of IT spending or reach to a

several trillion $ business/year?

120?

15%

600?

(10)

10 Manjrasoft: Roadmap & ambition

-What can we do to achieve it and

how can you all help ?

2006 | 2007 | 2008 | 2009 | 2010 | 2011 | 2012 | 2013 | 2014 | 2015 | 2016 | 2017 | 2018 | 2019 | 2020

Aneka

idea

Aneka

Patent

Aneka

Beta Aneka

1.0,

Amazon

Aneka

Federation

Open

Cloud

Market

De-facto

PaaS

Aneka:

De-facto

PaaS

On all

Clouds

50% Cloud Apps

On

Manjrasoft

70% Cloud Apps

On

Manjrasoft

50 % of IT

spending is

on Cloud

(trillions?)

CNN.com:

“Manjrasoft

Acquires

Microsoft”

(11)

Become part of the Revolution:

Join hands with Manjrasoft and use its

(12)

12

Thanks for your attention!



Are there any



Questions?



Comments/ Suggestions

We Welcome Cooperation in R&D and Business!

http:/

www.gridbus.org |

www.Manjrasoft.com

[email protected] | [email protected]

(13)

References



Blueprint Paper!



R. Buyya, C. S. Yeo, S. Venugopal, J. Broberg, I. Brandic, “Cloud Computing

and Emerging IT Platforms: Vision, Hype, and Reality for Delivering

Computing as the 5

th

_{Utility”, Future Generation Computer Systems (FGCS)}

Journal, 2009.



Aneka Documents:



http://www.manjrasoft.com/



The Grid Economy Paper:



R. Buyya, D. Abramson, S. Venugopal, “The Grid Economy”, Proceedings of

the IEEE, No. 3, Volume 93, IEEE Press, 2005.



MetaCDN Paper:



James Broberg, Rajkumar Buyya, and Zahir Tari, MetaCDN: Harnessing

'Storage Clouds' for High Performance Content Delivery, Journal of Network

and Computer Applications, ISSN: 1084-8045, Elsevier, Amsterdam, The

Netherlands, 2009.



CloudSim Keynote Paper:

(14)