High Performance Computing Cloud Computing. Dr. Rami YARED

High Performance Computing

Cloud Computing

Outline

High Performance Computing

Parallel Computing

Cloud Computing

Definitions

Advantages and drawbacks

Outline

High Performance Computing

Parallel Computing

Cloud Computing

Definitions

Advantages and drawbacks

Cloud Computing

New paradigm

“Clouds will transform the information Technology (IT) industry… profoundly change the way people work and companies operate”  Provides massively scalable computing resources from anywhere.  Simplifies services delivery.

 Enables rapid innovation of new business models.

• Ease of Use

• Scalability

• Reliability

• Cost

• Deploy infrastructure with a mouse or API

– No cabling

– Middle of the night

– Do it yourself remotely from anywhere anytime

Scalability

Control your infrastructure with your app

Based on enterprise grade hardware Design for failures:

Automatically spin up replacements Use multiple clouds

Reliability

Cost

“Turn off the lights” = turn off servers you aren’t using

Ex: Turn off development and test environments

Pay for only what you use No need to buy in advance Zero Capital Outlay

Cloud computing

• Understanding how others view “Cloud

Computing”

“A pool of abstracted, highly scalable, and managed

compute infrastructure capable of hosting end-customer applications and billed by consumption”

• Different than SaaS (Software as a Service)

– Prescript & Abstract Infrastructure – Fully Virtualized

– Dynamic Infrastructure Software – Pay by Consumption

– Free of Long-Term Contracts

– Application and OS Independent

– Free of Software or Hardware Installation

“Cloud computing has all the earmarks of being a potential innovation that all infrastructure and operations

professionals should pay close attention.”

Other Definitions

“Cloud computing is an emerging approach to shared

infrastructure in which large pools of systems are linked together to provide IT services.”

– IBM press release on “Blue Cloud”

“…a hosted infrastructure model that delivers abstracted IT resources over the Internet”

– Thomas Weisel Partners LLC from “Into the Clouds: Leveraging Data Centers and the Road to Cloud Computing”

“Cloud computing describes a systems architecture. This particular architecture assumes nothing about the

physical location, internal composition or ownership of its component parts.”

• SaaS

– Software as a Service – Storage as a Service

• PaaS – Platform as a Service

• IaaS – Infrastructure as a Service

Cloud Computing definition

Cloud Computing -“Enabling Technology” to

move from Traditional Hosting to Cloud

Hosting

The Cloud’s “Snowball Effect”

• Maturation of Virtualization Technology

• Virtualization enables Compute Clouds

• Compute Clouds create demand for Storage

Clouds

• Storage + Compute Clouds create Cloud

Infrastructure

• Cloud Infrastructure enables Cloud Platforms &

Cloud Computing

• Build upon a foundation

• Building blocks: Infrastructure, Platforms, Applications

Cloud Computing is…

… virtualized compute power and storage delivered via platform infrastructures of abstracted hardware and software accessed over the Internet.

Cloud computing

• Develop

in the cloud

Cloud computing

• Deploy

in the cloud

– One click application provisioning – Deployment optimization

Cloud computing

• Deliver

services from the cloud

Cloud computing

• Overflow

to another cloud

– Hybrid cloud for dynamic Infrastructure – Leverage extra capacity from public clouds

• SaaS resides here

• Most common Cloud / Many providers of

different services

• Examples: SalesForce, Gmail, Yahoo! Mail

• Advantages: Free, Easy, Consumer Adoption

• Disadvantages: Limited functionality, no

control or access to underlying technology

• “Containers”

• “Closed” environments

• Examples: Google App Engine, Joyent or

Force.com (SalesForce Dev Platform)

• Advantages: Good for developers, more control

than “Application” Clouds, tightly configured

• Disadvantages: Restricted to what is available

• Static  Dynamic = Quick & Easy Scalability

• Cost Prohibitive  Cost Effective = Cost Efficiencies based on usage, no contracts, no upfront costs

• Predictable  Unpredictable = Innovations • Stagnant  Growth = Evolution

Traditional Hosting  Cloud Hosting = FUTURE!

Traditional Hosting

vs

Cloud Hosting

Reference: Paul Lancaster, Business Development Manager, GoGrid

Cloud “Infrastructure”

• Provide “Compute” and “Storage” clouds • Virtualization layers (hardware/software) • Examples: Amazon EC2, Amazon S3

• Advantages: Full control of environments and infrastructure

Cloud Computing

vs

Grid computing

• Cloud computing is a style of computing in

which dynamically scalable and often

virtualized resources are provided as a service

over the Internet. Users need not have

Comparisons

Cloud computing can be confused with:

1) grid computing: "a form of distributed computing

whereby a super and virtual computer is composed of a cluster of networked, loosely-coupled computers, acting in concert to perform very large tasks".

2) utility computing: the "packaging of computing resources, such as computation and storage, as a metered service

Cloud computing characteristics

• Cloud computing customers do not generally own the physical

infrastructure serving as host to the software platform in question. Instead, they avoid capital expenses by renting usage from a third-party provider.

• They consume resources as a service and pay only for resources that they use. Many cloud-computing offerings employ the utility

computing model, which is analogous to how traditional utility services (such as electricity) are consumed, while others bill on a subscription basis.

• Computing power among multiple tenants can improve utilization rates, as servers are not unnecessarily left idle (which can reduce costs significantly while increasing the speed of application

History of Cloud Computing

telephony. Up to the 1990s, data circuits

(including those that carried Internet traffic) were hard-wired between destinations. Subsequently, long-haul telephone companies began offering

Virtual Private Network (VPN) service for data communications.

Telephone companies were able to offer VPN based services with the same guaranteed

History of Cloud Computing

• As a result of this arrangement, it was

impossible to determine in advance

precisely paths traffic would be routed

over. The term "telecom cloud" was

used to describe this type of

Disadvantage of cloud Computing

• Since cloud computing does not allow users to physically possess the storage of their data (the exception being the possibility that data can be backed up to a user-owned storage device, such as a USB flash drive or hard disk) it does leave responsibility of data storage and control in the hands of the provider.

• Cloud computing has been criticized for limiting the freedom of users and making them dependent on the cloud computing

provider, and some critics have alleged that is only possible to use applications or services that the provider is willing to offer. Thus,

The London Times compares cloud computing to centralized

systems of the 1950s and 60s, by which users connected through "dumb" terminals to mainframe computers. Typically, users had no freedom to install new applications and needed approval from

administrators to achieve certain tasks. Overall, it limited both

Disadvantage of cloud Computing

• Similarly, Richard Stallman, founder of the

Outline

High Performance Computing

Parallel Computing

Cloud Computing

Definitions

Advantages and drawbacks

Cloud Computing

• With cloud computing, companies can scale up to massive capacities in an instant without having to invest in new infrastructure, train new personnel, or license new software.

• Cloud computing is of particular benefit to small and medium-sized businesses who wish to completely outsource their data-center infrastructure, or large

companies who wish to get peak load capacity without incurring the higher cost of building larger data centers internally. In both instances, service consumers use

Cloud Computing

• The service consumer no longer has to be at a PC, use an application from the PC, or purchase a

specific version that's configured for smart

phones, PDAs, and other devices. The consumer does not own the infrastructure, software, or

platform in the cloud.

• He has lower upfront costs, capital expenses, and operating expenses. He does not mind about how servers and networks are maintained in the

cloud.

• The consumer can access multiple servers

Grid computing

Cloud computing evolves from grid computing and provides on-demand resource provisioning. Grid computing may or may not be in the cloud depending on what type of users are using it. If the users are systems administrators and integrators, they care how things are maintained in the cloud. They upgrade, install, and

virtualize servers and applications. If the users are consumers, they do not mind how things are run in the system.

Grid computing requires the use of software that can divide and farm out pieces of a program as one large system image to several thousand computers. One concern about grid is that if one piece of the software on a node fails, other pieces of the software on other nodes may fail. This is alleviated if that component has a failover component on another node, but problems can still arise if components rely on other pieces of software to accomplish one or more grid computing tasks. Large system images and associated hardware to operate and maintain them can

Grid

vs

Cloud: Similarities and

differences

• Cloud computing and grid computing are

scalable. Scalability is accomplished through load balancing of application instances running

separately on a variety of operating systems and connected through Web services.

• CPU and network bandwidth is allocated and de-allocated on demand. The system's storage

Grid

vs

Cloud Similarities and

differences

• Both computing types involve multitasking, meaning that many customers can perform different tasks, accessing a single or multiple

application instances. Sharing resources among a large pool of users assists in reducing infrastructure costs and peak load capacity.

• Cloud and grid computing provide service-level agreements (SLAs) for guaranteed uptime

availability of, say, 99 percent.

• If the service slides below the level of the

Grid

vs

Cloud Computing

• The Amazon S3 provides a Web services interface for the storage and retrieval of data in the cloud. Setting a maximum limits the number of objects one can store in S3. It can store an object as small as 1 byte and as large as 5 GB or even several

Grid

vs

Cloud Computing

• While the storage computing in the grid is well suited for data-intensive storage, it is not

economically suited for storing objects as small as 1 byte. In a data grid, the amounts of distributed data must be large for maximum benefit.

• A computational grid focuses on computationally intensive operations. Amazon Web Services in

Summary

High Performance Computing

Parallel Computing

Cloud Computing

Definitions

Advantages and drawbacks