CS6703 GRID AND CLOUD COMPUTING CS6703 GRID AND CLOUD COMPUTING
UNIT I UNIT I INTRODUCTION
INTRODUCTION
Evolution of Distributed computing: Scalable computing over the Internet – Technologies for Evolution of Distributed computing: Scalable computing over the Internet – Technologies for networ
network k based systems – based systems – clustclusters of ers of cooperacooperative computers - tive computers - rid computinrid computing g InfraInfrastrustructures – ctures – cloud computing - service
cloud computing - service oriented architecture – Introduction to oriented architecture – Introduction to rid !rchitrid !rchitecture and standardsecture and standards –Elements of rid – "verview of rid !
–Elements of rid – "verview of rid !rchitecture#rchitecture# 1.
1.1 1 EvEvololututioion n of of DiDiststii!u!ut"t"# # $o$o%&%&ututinin'( '( S$S$)l)l)!)!l" l" $o$o%&%&ututinin' ' ovov" " t*t*" " InInt"t"nn"t "t ++ T"$*nolo'i"s fo n"t,o- !)s"# sst"%s + Clust"s of $oo&")tiv" $o%&ut"s
T"$*nolo'i"s fo n"t,o- !)s"# sst"%s + Clust"s of $oo&")tiv" $o%&ut"s
$ertainly one can go back a long way to trace the history of distributed computing# Types $ertainly one can go back a long way to trace the history of distributed computing# Types of distributed computing e%isted in the &'()s#
of distributed computing e%isted in the &'()s#
*any people were interested in connecting computers together for high performance *any people were interested in connecting computers together for high performance computing in the &'+)s and in particular forming multicomputer or multiprocessor systems# computing in the &'+)s and in particular forming multicomputer or multiprocessor systems# ,rom connecting processors and computers together locally that began in earnest in the &'()s ,rom connecting processors and computers together locally that began in earnest in the &'()s and &'+)s distributed computing now e%tends to connecting computers that are geographically and &'+)s distributed computing now e%tends to connecting computers that are geographically distant#
distant#
The distributed computing technologies that underpin rid computing were developed The distributed computing technologies that underpin rid computing were developed concurrently and rely upon each other#
concurrently and rely upon each other#
There are three concurrent interrelated paths# They are: There are three concurrent interrelated paths# They are:
./etworks ./etworks .$omputing platforms .$omputing platforms .Software techni0ues .Software techni0ues N"t,o-s(
N"t,o-s( rid computing relies on high performance computer networks# The history of such rid computing relies on high performance computer networks# The history of such networks began in the &'()s with the development of packet switched networks# The most networks began in the &'()s with the development of packet switched networks# The most impor
important tant and and groundground-break-breaking ing geogrageographicalphically ly distdistributributed ed packetpacket-swi-switched tched netwonetwork rk was was thethe DoD-funded !12/ET network with a design speed of 3) 4bits5sec#
DoD-funded !12/ET network with a design speed of 3) 4bits5sec#
!12/ET became operational with four nodes 67niversity of $alifornia at 8os !ngeles !12/ET became operational with four nodes 67niversity of $alifornia at 8os !ngeles Stanford 1esearch Institute 7niversity of $alifornia at Santa 9arbara and 7niversity of 7tah in Stanford 1esearch Institute 7niversity of $alifornia at Santa 9arbara and 7niversity of 7tah in &'(
&'('# '# T$T$2 2 6T6Traransmnsmisissiosion n $ont$ontrol rol 2ro2rotoctocol ol was was conconceiceived ved in in &'+; &'+; and and becbecame ame T$2T$25I5I22 6Transmission $ontrol 2rotocol5Internet 2rotocol in &'+<# T$25I2 became universally adopted# 6Transmission $ontrol 2rotocol5Internet 2rotocol in &'+<# T$25I2 became universally adopted# T$2 provided a protocol for reliable communication while I2 provided for network routing# T$2 provided a protocol for reliable communication while I2 provided for network routing# Important concepts including I2 addresses to identify hosts on the Internet and ports that identify Important concepts including I2 addresses to identify hosts on the Internet and ports that identify end points 6processes for communication purposes# The Ethernet was also developed in the end points 6processes for communication purposes# The Ethernet was also developed in the early &'+)s and became the principal way of interconnecting computers on local networks#
early &'+)s and became the principal way of interconnecting computers on local networks#
It initially enabled multiple computers to share a single Ethernet cable and handled It initially enabled multiple computers to share a single Ethernet cable and handled communication collisions with a retry protocol although nowadays this collision detection is communication collisions with a retry protocol although nowadays this collision detection is usu
usuallally y not not neeneeded ded as as sepseparaarate te EthEthernernet et cablcables es are are useused d for for eaceach h comcomputputerer witwith h EthEthernernetet switches to make connections# Each Ethernet interface has a uni0ue physical address to identify switches to make connections# Each Ethernet interface has a uni0ue physical address to identify it for communication purpose which is mapped to
it for communication purpose which is mapped to the host I2 address#the host I2 address#
The Internet began to be formed in early &'<)s using the T$25I2 protocol# During the The Internet began to be formed in early &'<)s using the T$25I2 protocol# During the &'<)s the Internet grew at a phenomenal rate# /etworks continued to improve and became more &'<)s the Internet grew at a phenomenal rate# /etworks continued to improve and became more pervasive througho
pervasive throughout ut the world# the world# In In the the &'')s &'')s the Internet the Internet developed developed into the into the =o=orld-=irld-=ide de =e=eb#b# The browser and the >T*8 markup language was introduced# The global network enables The browser and the >T*8 markup language was introduced# The global network enables computers to be interconnected virtually anywhere in the world#
computers to be interconnected virtually anywhere in the world# Co%
Co%&ut&utin' in' Pl)Pl)tfotfo%s(%s( $omputing systems began as single processor systems# It was soon$omputing systems began as single processor systems# It was soon recogni?ed that increased speed could potentially be obtained by having more than one processor recogni?ed that increased speed could potentially be obtained by having more than one processor
inside a single computer system and the term parallel computer was coined to describe such inside a single computer system and the term parallel computer was coined to describe such systems#
systems#
2arallel computers were limited to applications that re0uired computers with the highest 2arallel computers were limited to applications that re0uired computers with the highest computational speed# It was also recogni?ed that one could connect a collection of individual computational speed# It was also recogni?ed that one could connect a collection of individual computer systems together 0uite easily to form a multicomputer system for higher performance# computer systems together 0uite easily to form a multicomputer system for higher performance# There were many pro@ects in the &'+)s and &'<)s with this goal especially with the advent of There were many pro@ects in the &'+)s and &'<)s with this goal especially with the advent of low cost microprocessors#
low cost microprocessors#
In the &'')s it was recogni?ed that commodity computers 62$s provided the ideal In the &'')s it was recogni?ed that commodity computers 62$s provided the ideal cost-effective solution for constructing multicomputer and the term cluster computing emerged# In effective solution for constructing multicomputer and the term cluster computing emerged# In cluster computing a group of computers are connected through a network switch as illustrated in cluster computing a group of computers are connected through a network switch as illustrated in the figure below# Speciali?ed high-speed interconnections were developed for cluster computing# the figure below# Speciali?ed high-speed interconnections were developed for cluster computing# >owever many chose to use commodity Ethernet as a cost-effective solution although >owever many chose to use commodity Ethernet as a cost-effective solution although Ethernet was not developed for cluster computing applications and incurs a higher latency# The Ethernet was not developed for cluster computing applications and incurs a higher latency# The term 9eowulf cluster was coined to describe a cluster using off-the-shelf computers and other term 9eowulf cluster was coined to describe a cluster using off-the-shelf computers and other commodity components and software named after the 9eowulf pro@ect at the /!S!#
commodity components and software named after the 9eowulf pro@ect at the /!S!#
T&i$)l $lust" $o%&utin' $onfi'u)tion T&i$)l $lust" $o%&utin' $onfi'u)tion
oodard Space ,light $enter started in &''A 6Sterling B))B# The original 9eowulf pro@ect used oodard Space ,light $enter started in &''A 6Sterling B))B# The original 9eowulf pro@ect used In
Intel tel ;<;<( ( prprococesessosorsrs ththe e frfree ee 8i8inu% nu% opeoperaratiting ng sysyststem em anand d dudual al &) &) *b*bitits5s5sesec c EtEtherhernenett connections#
connections#
!s clusters were being constructed work was done on how to program them# The !s clusters were being constructed work was done on how to program them# The dominant programming paradigm for cluster computing was and still is message passing in dominant programming paradigm for cluster computing was and still is message passing in whi
which ch infinformormatiation on is is paspassed sed betbetweeween n proprocescesses runnises running ng on on the computthe computers in ers in the the forform m of of messages# These messages are specified by the programmer using message-passing routines#
messages# These messages are specified by the programmer using message-passing routines# The
The mosmost t notnotable able lilibrarbrary y of of mesmessagsage-pae-passssing ing rouroutintines es was was 2C* 2C* 62a62aralrallel lel CiCirturtualal *achine 6Sunderam &'') which was started in the late &'<)s and became the de facto *achine 6Sunderam &'') which was started in the late &'<)s and became the de facto standard in the early-mid &'')# 2C* included
Subse0uently a standard definition for message passing libraries called *2I 6*essage Subse0uently a standard definition for message passing libraries called *2I 6*essage 2assing Interface was established 6Snir et al# &''< which laid down what the routines do and 2assing Interface was established 6Snir et al# &''< which laid down what the routines do and how they are invoked but not the implementation# Several implementations were developed# how they are invoked but not the implementation# Several implementations were developed# 9oth 2C* and *2I routines could be called from $5$ or ,ortran programs for message 9oth 2C* and *2I routines could be called from $5$ or ,ortran programs for message passing and related activities#
passing and related activities#
Several pro@ects began in the &'<)s and &'')s to take advantage of networked computers Several pro@ects began in the &'<)s and &'')s to take advantage of networked computers in laboratories for high performance computing# ! very important pro@ect in relation to rid in laboratories for high performance computing# ! very important pro@ect in relation to rid computing is called $ondor which started in the mid-&'<)s with the goal to harness unusedF computing is called $ondor which started in the mid-&'<)s with the goal to harness unusedF cycles of networked computers for high performance co
cycles of networked computers for high performance co mputing#mputing#
In the $ondor pro@ect a collection of computers could be given over to remote access In the $ondor pro@ect a collection of computers could be given over to remote access automatically when they were not being used locally# The collection of computers 6called a automatically when they were not being used locally# The collection of computers 6called a $ondor pool then
$ondor pool then formed a high-performance formed a high-performance multicomputer#multicomputer# *ul
*ultiptiple le useusers rs coulcould d use use sucsuch h phyphysicsicallally y disdistrtribuibuted ted compcomputeuter r syssystemtems# s# SomSome e veryvery imp
importortant ant ideideas as werwere e empemployloyed ed in in $ond$ondor or incincludiluding ng matmatchinching g the the @ob @ob witwith h the the avaiavailablablele res
resourources ces autautomatomaticaically using lly using a a desdescricriptiption on of of the @ob the @ob and and a a desdescricriptiption on of of the the avaavailailableble resources# ! @ob workflow could be described in which the output of one @ob could automatically resources# ! @ob workflow could be described in which the output of one @ob could automatically be
be fed fed into into another another @ob# @ob# $ondor $ondor has has become become mature mature and and is is widely widely used used as as a a @ob @ob scheduler scheduler for for clusters in addition to
clusters in addition to its original purpose of using its original purpose of using laboratory computers collectively#laboratory computers collectively# In
In $o$ondndoror ththe e didiststriribubuteted d cocompmpututerers s neneed ed ononly ly be be nenetwtwororkeked d anand d cocoululd d bebe geographically distributed# $ondor can be used
geographically distributed# $ondor can be used to share campus-wide computing resources#to share campus-wide computing resources# Soft,)"
Soft,)" T"T"$*ni/u"s($*ni/u"s( !part from the development of distributed computing platforms software !part from the development of distributed computing platforms software techni0ues were being developed to harness truly distributed systems#
techni0ues were being developed to harness truly distributed systems#
The remote procedure call 612$ was conceived in the mid-&'<)s as a way of invoking a The remote procedure call 612$ was conceived in the mid-&'<)s as a way of invoking a procedure
procedure on on a a remote remote computer computer as as an an e%tension e%tension of of e%ecuting e%ecuting procedures procedures locally# The locally# The remoteremote procedure
procedure call call was was subse0uently subse0uently developed developed into into ob@ect-oriented ob@ect-oriented versions versions in in the the &'')s &'')s one one waswas $"19! 6$o
$"19! 6$ommon 1e0uest 9roker !rchitmmon 1e0uest 9roker !rchitectureecture and and anotheanother r was the was the Gava *ethod Gava *ethod InvocaInvocationtion 61*I#
61*I#
The remote procedure call introduced the important concept of a service registry to locate The remote procedure call introduced the important concept of a service registry to locate rem
remote ote serservicvices# es# SerServicvice e regregististrieries s in in relrelatiation on to to disdiscovcoveriering ng serservicvices es in in a a ririd d comcomputputinging environment includes the mechanism of discovering their method
environment includes the mechanism of discovering their method of invocation#of invocation#
During the early development of the =orld-=ide =eb the >T*8 was conceived to During the early development of the =orld-=ide =eb the >T*8 was conceived to provide a way of
provide a way of displaying =edisplaying =eb pages and b pages and connecting to other pages connecting to other pages through now very familiar through now very familiar hyperte%t links# Soon a =eb page became more than simply displaying information it became hyperte%t links# Soon a =eb page became more than simply displaying information it became an interacti
an interactive ve tool whereby informtool whereby information could be ation could be entereentered d and processed at and processed at eitheeither the r the client sideclient side or the server side# The programming language GavaScript was introduced in &''3 mostly for or the server side# The programming language GavaScript was introduced in &''3 mostly for causing actions to take place specified in code at the client whereas other technologies were causing actions to take place specified in code at the client whereas other technologies were being developed for causing actions to take place at the server such as !S2
being developed for causing actions to take place at the server such as !S2 first released in &''(#first released in &''(# In B)))s a very significant concept for distributed Internet-based computing called a In B)))s a very significant concept for distributed Internet-based computing called a =e
=eb service was introduced# b service was introduced# =e=eb services have b services have their roots in remote procedure their roots in remote procedure calls and providecalls and provide remote actions but are invoked through standard protocols and Internet addressing# They also use remote actions but are invoked through standard protocols and Internet addressing# They also use H*8 6eHtensible *arkup 8anguage which was also introduced in B)))#
H*8 6eHtensible *arkup 8anguage which was also introduced in B)))#
The =eb service interface is defined in a language-neutral manner by the H*8 language The =eb service interface is defined in a language-neutral manner by the H*8 language =SD8# =eb services were adopted into rid computing soon after their introduction as a =SD8# =eb services were adopted into rid computing soon after their introduction as a fle%ible interoperable way of implementing the rid infrastructure and were potentially useful fle%ible interoperable way of implementing the rid infrastructure and were potentially useful for rid applications#
G
Gii# # CCoo%%&u&uttinin''(( ThThe e fifirsrst t lalargrge-se-scacale le rrid id cocompmpututining g demdemonsonstrtratatioion n ththat at ininvolvolvevedd geographically distributed computers and the start of rid computing proper was the Information geographically distributed computers and the start of rid computing proper was the Information =ide-!rea
=ide-!rea ear 6I-=ear 6I-=!! demonstration at demonstration at the the Supercomputing &''Supercomputing &''3 $onference 3 $onference 6S$J'3#6S$J'3#
Seventeen supercomputer sites were involved including five D"E supercomputer centers Seventeen supercomputer sites were involved including five D"E supercomputer centers four /S, supercomputer centers three /!S! supercomputer sites and other large computing four /S, supercomputer centers three /!S! supercomputer sites and other large computing sites# Ten e%isting !T* networks were interconnected with the assistance of several ma@or sites# Ten e%isting !T* networks were interconnected with the assistance of several ma@or network service providers#
network service providers# "ve
"ver r () () appappliclicatiations ons demdemonsonstratrated ted in in areareas as incincludluding ing astastronronomy omy and and astastroprophyshysicsics atmos
atmospheripheric c sciencscience e biochembiochemistryistry molecumolecular lar biolobiology gy and and strustructural biologyctural biology biolobiological gical andand med
medicaical l imimaginaging g chemchemisistrytry disdistritributbuted ed comcomputputinging earearth th scisciencence e edueducatication on engiengineerneeringing ge
geomometetriric c momodeldelining g mamateteririal al scscieiencnce e mamaththememataticics s mimicrcrophophysysicics s and and mamacrcrophophysysicicss ne
neururososcicienencece peperfrformormancance e anaanalylysisis s plplasasma ma phyphysisicscs tetele le opopereratatioionsns5t5telelepepreresesencence andand visuali?ation 6De,anti &''(# "ne focus was on virtual reality environments# Cirtual reality visuali?ation 6De,anti &''(# "ne focus was on virtual reality environments# Cirtual reality components included an immersive AD environment# Separate papers in the &''( special issue of components included an immersive AD environment# Separate papers in the &''( special issue of International Gournal of Supercomputer !pplications described nine
International Gournal of Supercomputer !pplications described nine of the I-=ay applications#of the I-=ay applications# I-=
I-=ay ay was was perperhaps haps the the larlargesgest t colcolleclectiotion n of of netnetworworked ked comcomputputing ing resresourources ces eveever r assembled for such a significant demonstration purpose at that time# It e%plored many of the assembled for such a significant demonstration purpose at that time# It e%plored many of the asp
aspectects s now now regregardarded ed as as centcentral ral to to ririd d comcomputputinging sucsuch h as as secsecuriurityty @ob @ob subsubmismissiosion n andand di
diststriributbuted ed reresosoururce ce scscheheduldulining# g# It It camcame e fafacece-t-to-o-faface ce wiwith th ththe e ppololititicical al anand d tetechchninicacall constraintsF that made it infeasible to provide single scheduler 6De,anti &''(# Each site had its constraintsF that made it infeasible to provide single scheduler 6De,anti &''(# Each site had its own @ob scheduler which had to be married together# The I-=ay pro@ect also marked the start of own @ob scheduler which had to be married together# The I-=ay pro@ect also marked the start of the lobus pro@ect 6lobus2ro@ect which developed de facto software for rid computing# The the lobus pro@ect 6lobus2ro@ect which developed de facto software for rid computing# The lobus 2ro@ect is led by Ian ,oster a co-developer of the I-=ay demonstration and a founder of lobus 2ro@ect is led by Ian ,oster a co-developer of the I-=ay demonstration and a founder of the rid computing concept# The lobus 2ro@ect developed a toolkit of middleware software the rid computing concept# The lobus 2ro@ect developed a toolkit of middleware software components for rid computing infrastructure including for basic @ob submission security and components for rid computing infrastructure including for basic @ob submission security and resource management#
resource management#
lobus has evolved through several implementation versions to the present time as lobus has evolved through several implementation versions to the present time as standards have evolved although the basic structural components have remained essentially the standards have evolved although the basic structural components have remained essentially the same 6security data management e%ecution management information services and run time same 6security data management e%ecution management information services and run time environment# =e
environment# =e will describe lobus in will describe lobus in a little more detail later#a little more detail later# !lthough the lobus software has been widely
!lthough the lobus software has been widely adopted and is the basis of adopted and is the basis of the coursework the coursework described in this book there are other software infrastructure pro@ects# The 8egion pro@ect also described in this book there are other software infrastructure pro@ects# The 8egion pro@ect also envis
envisioned a ioned a distdistributributed ed rid computinrid computing g enviroenvironment# 8egion was nment# 8egion was conceiconceived ved in &''A in &''A althoalthoughugh work on the 8egion software did not begin in &''( 68egion =orld=ide Cirtual $omputer# work on the 8egion software did not begin in &''( 68egion =orld=ide Cirtual $omputer# 8egion used an ob@ect-based approach to rid computing# 7sers could create ob@ects in distant 8egion used an ob@ect-based approach to rid computing# 7sers could create ob@ects in distant locations#
locations#
The first public release of 8egion was at the Supercomputing '+ conference in /ovember The first public release of 8egion was at the Supercomputing '+ conference in /ovember &''+# The work led to the rid computing company and software called !vaki in &'''# The &''+# The work led to the rid computing company and software called !vaki in &'''# The company was subse0uently taken over by Sybase Inc#
company was subse0uently taken over by Sybase Inc#
In the same period a European rid computing pro@ect called 7/I$"1E 67/iform In the same period a European rid computing pro@ect called 7/I$"1E 67/iform Int
Interferface ace to to $"m$"mputputing ing 1Es1Esourourcesces begbegan an iniinitiatially lly funfunded ded by by the the ererman man *in*inististry ry for for Education and 1esearch 69*9, and continued with other European funding#
Education and 1esearch 69*9, and continued with other European funding# 7/
7/I$I$"1"1E E is is ththe e basbasis is of of seseververal al of of ththe e EuEuroropepean an efeffofortrts s in in rrid id cocompmpututining g anandd elsewhere including in Gapan# It has many similarities to lobus for e%ample in its security elsewhere including in Gapan# It has many similarities to lobus for e%ample in its security model and a service based "S! standard but is a more complete solution than lobus and model and a service based "S! standard but is a more complete solution than lobus and
includes a graphical interface# !n e%ample pro@ect using 7/I$"1E is E71"1ID a rid includes a graphical interface# !n e%ample pro@ect using 7/I$"1E is E71"1ID a rid computing testbed developed in the period of B)))-B));#
computing testbed developed in the period of B)))-B));# !
! E71E71"1"1ID ID applapplicaicatition on propro@ec@ect t is is "pe"pen*on*ol1l1ID ID "pe"pen n $om$omputputing ing 1I1ID D for for *olecular Science and Engineering developed during the period of B))B-B))3 to speed up *olecular Science and Engineering developed during the period of B))B-B))3 to speed up automati?e and standardi?e the drug-design using rid technologyF 6"pen*ol1ID#
automati?e and standardi?e the drug-design using rid technologyF 6"pen*ol1ID#
The term e-Science was coined by Gohn Taylor the Director eneral of the 7nited The term e-Science was coined by Gohn Taylor the Director eneral of the 7nited 4ingdomJs "ffice of Science and Technology in &''' to describe conducting scientific research 4ingdomJs "ffice of Science and Technology in &''' to describe conducting scientific research using distrib
using distributed uted networnetworks ks and and resourresources ces of of a a rid computing infrastrid computing infrastructurructure# !nother moree# !nother more re
recencent t EuEuroropeapean n teterm rm is is e-e-InInfrfrasastrtructucturure e whwhicich h rerefefers rs to to crcreateatining g a a rridid-l-likike e rereseseararchch infrastructure#
infrastructure#
=ith the development of rid computing tools such as lobus and 7/I$"1E a growing =ith the development of rid computing tools such as lobus and 7/I$"1E a growing num
numbeber r of of rrid id prpro@o@ecects ts bebegan gan to to dedevevelolop p apapplplicicatatioionsns# # "r"rigigininalallyly ththesese e fofocuscused ed onon computational applications# They can be categori?ed as:
computational applications# They can be categori?ed as: .$omputationally intensive
.$omputationally intensive .Data intensive
.Data intensive
.E%perimental collaborative pro@ects .E%perimental collaborative pro@ects The
The comcomputputatiationalonally ly intintensensive ive catcategoregory y is is tratraditditionional al highigh h perperforformanmance ce comcomputputinging addressing large problems# Sometimes it is not necessarily one big problem but a problem that addressing large problems# Sometimes it is not necessarily one big problem but a problem that has to be solved repeatedly with different parameters 6parameter sweep problems to get to the has to be solved repeatedly with different parameters 6parameter sweep problems to get to the solution# The data intensive category includes computational problems but with the emphasis on solution# The data intensive category includes computational problems but with the emphasis on large amounts of data to store and process# E%perimental collaborative pro@ects often re0uire large amounts of data to store and process# E%perimental collaborative pro@ects often re0uire collecting data from e%perimental apparatus and very
collecting data from e%perimental apparatus and very large amounts of data to study#large amounts of data to study#
The potential of rid computing was soon recogni?ed by the business community for The potential of rid computing was soon recogni?ed by the business community for so-calle
called d e-9use-9usiness applicatiness applications to ions to improimprove ve busibusiness models ness models and and practipractices sharing ces sharing corporcorporateate com
computputing ing resresourources ces and and datdatabasabases es and and commcommercercialiali?ai?atiotion n of of the the techtechnolnology ogy for for busbusineinessss applications#
applications#
,or 9usiness applications the driving motive was reduction of costs whereas for ,or 9usiness applications the driving motive was reduction of costs whereas for e-Science applications the driving motive was obtaining research results# That is not to say cost Science applications the driving motive was obtaining research results# That is not to say cost was not a factor in e-Science rid computing#
was not a factor in e-Science rid computing#
8arge-scale research has very high costs and rid computing offers distributed efforts 8arge-scale research has very high costs and rid computing offers distributed efforts and cost sharing of resources# There are pro@ects that are concerned with accounting such as and cost sharing of resources# There are pro@ects that are concerned with accounting such as rid9us mentioned earlier#
rid9us mentioned earlier#
The figure below shows the time lines for computing platforms underlying software The figure below shows the time lines for computing platforms underlying software tec
technihni0ue0ues s and and netnetworworks ks disdiscuscussedsed# # SomSome e see see ririd d comcomputputing ing as as an an e%te%tensension ion of of cluclustester r computing and it is true in the development of high performance computing rid computing has computing and it is true in the development of high performance computing rid computing has followed on from cluster computing in connecting computers together to form a multicomputer followed on from cluster computing in connecting computers together to form a multicomputer platform but rid computing offers m
platform but rid computing offers much more#uch more#
The term cluster computing is limited to using computers that are interconnected locally The term cluster computing is limited to using computers that are interconnected locally to form a computing resource# 2rogramming is done mostly using e%plicit message passing# rid to form a computing resource# 2rogramming is done mostly using e%plicit message passing# rid comput
computing ing involinvolves ves geogrageographicallphically y distdistributributed ed sitesites s and and invokes some invokes some diffdifferent techni0ues#erent techni0ues# The
There re is is cercertaitainly nly a a finfine e liline ne in in the the contcontinuinuum um of of intintercerconneonnectected d comcomputeputers rs frfrom om loclocallyally interconnected computers in a small room through interconnected systems in a large computer interconnected computers in a small room through interconnected systems in a large computer roo
room m thethen n in in mulmultitiple ple roorooms ms and and in in difdifferferent ent depdepartartmenments ts witwithin hin a a comcompanypany thrthrougough h toto computers interconnected on the Internet in one area in one country and across the world#
The early hype of rid computing and marketing ploys in the late &'')s and early B)))s The early hype of rid computing and marketing ploys in the late &'')s and early B)))s caused some to call configurations rid computing when they were @ust large computational caused some to call configurations rid computing when they were @ust large computational clusters or they were laboratory computers whose idle c
clusters or they were laboratory computers whose idle c ycles are being used#ycles are being used# "ne classification that embodies the collaborative feature of rid computing is: "ne classification that embodies the collaborative feature of rid computing is:
.Enterprise rids – rids formed within an organi?ation for collaboration# .Enterprise rids – rids formed within an organi?ation for collaboration#
.2artner rids – rids set up between collaborative organi?ations or institutions# .2artner rids – rids set up between collaborative organi?ations or institutions# Enterprise rid still might cross administrative domains of
Enterprise rid still might cross administrative domains of departments and re0uires departmentsdepartments and re0uires departments to share their resources# Some of the ke
to share their resources# Some of the key features that are indicative of rid computing are:y features that are indicative of rid computing are: .Shared multi-owner computing resources#
.Shared multi-owner computing resources#
.7sed rid computing software such as lobus with security and cross-management .7sed rid computing software such as lobus with security and cross-management mechanisms in place#
mechanisms in place#
rid computing software such as lobus provides the tools for individuals and teams to use rid computing software such as lobus provides the tools for individuals and teams to use geographically distributed computers owned by others collectively#
geographically distributed computers owned by others collectively#
" $on$"&ts in t*" *isto of Gi# $o%&utin'. " $on$"&ts in t*" *isto of Gi# $o%&utin'. ,oste
,osterJs $heck rJs $heck 8ist:8ist: IaIan n ,o,ostster er is is crcrededitited ed fofor r ththe e dedevevelolopmpment ent of of rrid id cocompmpututining g anandd sometimes called the father of rid computing# >e proposed a simple checklist of aspects that sometimes called the father of rid computing# >e proposed a simple checklist of aspects that are common to most true rids 6,oster B))B:
are common to most true rids 6,oster B))B: ./o centrali?ed control
./o centrali?ed control .Standard open protocols .Standard open protocols
./on-trivial 0uality of service 6KoS ./on-trivial 0uality of service 6KoS Gi# Co%&utin
Gi# Co%&utin' v"s" ' v"s" Clust" Co%&Clust" Co%&utin'(utin'( It is important not to think of rid computingIt is important not to think of rid computing simply as a large cluster because the potential and challenges are different# $ourses on rid simply as a large cluster because the potential and challenges are different# $ourses on rid
comput
computing and ing and on cluster computing are on cluster computing are 0uite diffe0uite different# In rent# In clustcluster computing one er computing one learnlearns s aboutabout message-passing programming using tools such as *2I# !lso shared memory programming is message-passing programming using tools such as *2I# !lso shared memory programming is considered using threads and
considered using threads and "pen*2 "pen*2 given that most computers in given that most computers in a cluster today are a cluster today are now alsonow also multicore shared memory systems# In cluster computing network security is not a big issue that multicore shared memory systems# In cluster computing network security is not a big issue that usually concerns the
usually concerns the user directly#user directly#
7sually an ssh connection to the front-end code of cluster is sufficient# The internal 7sually an ssh connection to the front-end code of cluster is sufficient# The internal compute nodes are reached from there# $lusters are usually 8inu% clusters and in those often an compute nodes are reached from there# $lusters are usually 8inu% clusters and in those often an /,S 6/etwork ,ile
/,S 6/etwork ,ile System shared file System shared file system installed across system installed across the compute the compute resources# !ccountsresources# !ccounts need to be present on all systems in the cluster and it may be that /IS 6/etwork Information need to be present on all systems in the cluster and it may be that /IS 6/etwork Information System is used to provide consistent configuration information on all systems but not necessary System is used to provide consistent configuration information on all systems but not necessary so#
so#
/IS
/IS can can increase increase the the local local network network traffic traffic and and slow slow the the start start of of applications# applications# In In ridrid computing one looks at how to manage and use the geographically distributed sites 6distributed computing one looks at how to manage and use the geographically distributed sites 6distributed resources# 7sers need accounts on all resources but generally a shared file system is not present# resources# 7sers need accounts on all resources but generally a shared file system is not present# Each site is typically a high performance cluster# 9eing a distributed environment one looks at Each site is typically a high performance cluster# 9eing a distributed environment one looks at distributing computing techni0ues such as =eb services and Internet protocols and network distributing computing techni0ues such as =eb services and Internet protocols and network security as well as how to actually take
security as well as how to actually take advantage of the distributed resource#advantage of the distributed resource#
Security is very important because the pro@ect may use confidential information and the Security is very important because the pro@ect may use confidential information and the distributed nature of the environment opens up a
distributed nature of the environment opens up a much higher probability of a security breach#much higher probability of a security breach# There are things in common with both rid computing and cluster computing# 9oth There are things in common with both rid computing and cluster computing# 9oth involve using multiple compute resources collectively# 9oth re0uire @ob schedulers to place @obs involve using multiple compute resources collectively# 9oth re0uire @ob schedulers to place @obs onto the best platform# In cluster computing a single @ob scheduler will allocate @obs onto the onto the best platform# In cluster computing a single @ob scheduler will allocate @obs onto the local compute resources# In rid computing a rid computing scheduler has to manage the local compute resources# In rid computing a rid computing scheduler has to manage the geographically disturbed resources owned by others and typically interacts with local cluster @ob geographically disturbed resources owned by others and typically interacts with local cluster @ob schedulers found on local clusters#
schedulers found on local clusters#
Gi# Co%&utin' v"sus Clou# Co%&utin'(
Gi# Co%&utin' v"sus Clou# Co%&utin'( $ommerciali?ation of rid computing is driven by$ommerciali?ation of rid computing is driven by a business model that will make profits# The first widely publici?ed attempt was on-demand and a business model that will make profits# The first widely publici?ed attempt was on-demand and utility computing in the early B)))s which attempted to sell computer time on a rid platform utility computing in the early B)))s which attempted to sell computer time on a rid platform con
constrstructucted ed usiusing ng ririd d tectechnolhnologiogies es sucsuch h as as lolobusbus# # *or*ore e recrecententlyly clocloud ud comcomputputing ing is is aa business
business model model in in which which services services are are provided provided on on servers servers that that can can be be accessed accessed through through thethe Internet#
Internet#
The common thread between rid computing and cloud computing is the use of the The common thread between rid computing and cloud computing is the use of the Internet to access the resources# $loud computing is driven by the widespread access that the Internet to access the resources# $loud computing is driven by the widespread access that the Internet and Internet technologies provide#
Internet and Internet technologies provide#
>owever cloud computing is 0uite distinct from the original purpose of rid computing# >owever cloud computing is 0uite distinct from the original purpose of rid computing# =he
=hereas reas ririd d comcomputputing ing focfocuseuses s on on colcollabolaboratrative ive and and disdistrtribuibuted ted shashared red resresourourcesces clocloudud com
computputing ing concconcententratrates es upoupon n plaplacing cing resresourources ces for for paypaying ing useusers rs to to accaccess ess and and shashare# re# TheThe technology for cloud computing emphasi?es the use of services 6software as a service SaaS and technology for cloud computing emphasi?es the use of services 6software as a service SaaS and possibly the use of virtuali?ation #
possibly the use of virtuali?ation #
! number of companies entered the cloud computing space in the mid-late B)))s# I9* ! number of companies entered the cloud computing space in the mid-late B)))s# I9* was an early promoter of on-demand rid computing in the early B)))s and moved into cloud was an early promoter of on-demand rid computing in the early B)))s and moved into cloud computing in a significant way opening a cloud computing center in Ireland in *arch B))< computing in a significant way opening a cloud computing center in Ireland in *arch B))< 6Dublin and subse0uently in the /etherlands 6!msterdam $hina 69ei@ing and South !frica 6Dublin and subse0uently in the /etherlands 6!msterdam $hina 69ei@ing and South !frica 6Gohannesburg in Gune B))<#
Clou# $o%&utin' usin' vitu)li"# "sou$"s. Clou# $o%&utin' usin' vitu)li"# "sou$"s.
"ther ma@or cloud computing players include !ma?on and oogle who utili?e their "ther ma@or cloud computing players include !ma?on and oogle who utili?e their massive number of servers# !ma?on has the !ma?on Elastic $ompute $loud 6!ma?on EB massive number of servers# !ma?on has the !ma?on Elastic $ompute $loud 6!ma?on EB pro@ect for users to buy time and resources through =
pro@ect for users to buy time and resources through =eb services and virtuali?atieb services and virtuali?ation#on# The cloud
The cloud computcomputing business model is ing business model is one step one step furtfurther than her than hostihosting ng compancompanies simplyies simply renting servers they provide at their location which became popular in the early-mid B)))s with renting servers they provide at their location which became popular in the early-mid B)))s with many start-up companies and continues to
many start-up companies and continues to date#date# 1.2 Gi# $o%&utin' Inf)stu$tu"s
1.2 Gi# $o%&utin' Inf)stu$tu"s
rid $omputing is based on the concept of information and electricity sharing which rid $omputing is based on the concept of information and electricity sharing which allowing us to access to another type
allowing us to access to another type of heterogeneous and geographically of heterogeneous and geographically separated resources#separated resources# rid gives the sharing of:
rid gives the sharing of: &# Storage elements
&# Storage elements
B# $omputational resources B# $omputational resources A# E0uipment A# E0uipment ;# Specific applications ;# Specific applications 3# "ther 3# "ther
Thus rid is based on: Thus rid is based on: . Internet protocols# . Internet protocols#
. Ideas of parallel and distributed computing# . Ideas of parallel and distributed computing#
A Gi# is ) sst"% t*)t A Gi# is ) sst"% t*)t & $oordinates resources that may not sub@ect to a
& $oordinates resources that may not sub@ect to a centrali?ed control#centrali?ed control# B 7sing standard open general-purpose protocols and
B 7sing standard open general-purpose protocols and interfaces#interfaces# A To deliver nontrivial 0ualities of
A To deliver nontrivial 0ualities of services#services#
,le%ible secure coordinated resource sharing among
,le%ible secure coordinated resource sharing among individuals and institutions#individuals and institutions#
Enable communities 6virtual organi?ations to share geographically distributed resources in order Enable communities 6virtual organi?ations to share geographically distributed resources in order to achieve a common goal#
to achieve a common goal#
In applications which canJt be solved by resources of an only institution or the results can In applications which canJt be solved by resources of an only institution or the results can be achieved faster and5or cheaper#
be achieved faster and5or cheaper# 1.3 Clou# $o%&utin'
1.3 Clou# $o%&utin' $loud $omputin
$loud $omputing g is used is used to manipulatito manipulating accessing and ng accessing and conficonfiguringuring g the hardware andthe hardware and software resources remotely# It gives online data storage infrastructure and
Clou# Co%&utin' Clou# Co%&utin'
$loud computing supports platform independency as the software is not re0uired to be installed $loud computing supports platform independency as the software is not re0uired to be installed locally on the 2$# >ence the $loud $omputing is making our business applications mobile and locally on the 2$# >ence the $loud $omputing is making our business applications mobile and collaborative#
collaborative#
C*))$t"isti$s of Clou# Co%&utin' C*))$t"isti$s of Clou# Co%&utin' There are four key characteristics of cloud
On D"%)n# S"lf S"vi$" On D"%)n# S"lf S"vi$"
$loud $omputing allows the users to use web services and resources on demand# "ne can logon $loud $omputing allows the users to use web services and resources on demand# "ne can logon to a website at any time and
to a website at any time and use them#use them# 4o)# N"t,o- A$$"ss
4o)# N"t,o- A$$"ss
Since cloud computing is completely web based it can be accessed from anywhere and at any Since cloud computing is completely web based it can be accessed from anywhere and at any time#
time#
R"sou$" Poolin' R"sou$" Poolin'
$loud computing allows multiple tenants to share a pool of resources# "ne can share single $loud computing allows multiple tenants to share a pool of resources# "ne can share single physical instance of hardware database and basic infrastructure#
physical instance of hardware database and basic infrastructure# R)&i# El)sti$it
R)&i# El)sti$it
It is very easy to scale the resources vertically or hori?ontally at any time# Scaling of resources It is very easy to scale the resources vertically or hori?ontally at any time# Scaling of resources means the ability of resources to deal with increasing
means the ability of resources to deal with increasing or decreasing demand#or decreasing demand#
The resources being used by customers at any given point of time are automatically monitored# The resources being used by customers at any given point of time are automatically monitored# M")su"# S"vi$"
M")su"# S"vi$"
In this service cloud provider controls and monitors all the aspects of cloud service# 1esource In this service cloud provider controls and monitors all the aspects of cloud service# 1esource optimi?ation billing capacity planning etc# depend on it#
optimi?ation billing capacity planning etc# depend on it# 4"n"fits
4"n"fits
&# "ne can access a
&# "ne can access applications as utilities over the Internet#pplications as utilities over the Internet#
B# "ne can manipulate and configure the applications online at any time# B# "ne can manipulate and configure the applications online at any time# A# It does not re0uire to install a
A# It does not re0uire to install a software to access or manipulate cloud application#software to access or manipulate cloud application#
;# $loud $omputing offers online development and deployment tools programming runtime ;# $loud $omputing offers online development and deployment tools programming runtime environment through 2aaS model#
3# $loud resources are available over the network in a manner that provide platform independent 3# $loud resources are available over the network in a manner that provide platform independent access to any type of clients#
access to any type of clients# (#
(# $l$lououd d $o$ompmpututining g ofoffefers rs on-on-demdemand and seselflf-s-serervivicece# # ThThe e reresosoururceces s cacan n be be usused ed wiwiththoutout interaction with cloud service
interaction with cloud service provider#provider# Dis)#v)nt)'"s of $lou# $o%&utin' Dis)#v)nt)'"s of $lou# $o%&utin'
. 1e0uires a high-speed internet connection . 1e0uires a high-speed internet connection . Security and confiability of data
. Security and confiability of data . /ot
. /ot solved yet the solved yet the e%ecutie%ecution of on of >2$ apps in >2$ apps in cloud computicloud computing ng InterInteroperaboperability betweeility between n cloudcloud based systems
based systems
1.5 S"vi$" oi"nt"# )$*it"$tu" 1.5 S"vi$" oi"nt"# )$*it"$tu" Ser
Servicvice-"e-"rierientented d !r!rchichitectecturture e helhelps ps to to use use applapplicaicatiotions ns as as a a serservicvice e for for othother er appappliclicatiationsons regardless the type of vendor product or technology# Therefore it is possible to e%change the regardless the type of vendor product or technology# Therefore it is possible to e%change the dat
data a betbetweeween n applapplicaicatiotions ns of of difdifferferent ent venvendordors s witwithout hout addadditiitional onal proprogragrammimming ng or or makimakingng changes to services#
changes to services#
The cloud computing service oriented
Distributed computing such as rid computing relies on causing actions to occur on remote Distributed computing such as rid computing relies on causing actions to occur on remote computers# Taking advantage of remote computers was recogni?ed many years ago well before computers# Taking advantage of remote computers was recogni?ed many years ago well before rid computing# "ne of the underlying concepts is the client-server model as shown in the rid computing# "ne of the underlying concepts is the client-server model as shown in the figure below# The client in this conte%t is a software component on one computer that makes an figure below# The client in this conte%t is a software component on one computer that makes an access to the server for a particular operation#
access to the server for a particular operation#
Cli"nt+s"v" %o#"l Cli"nt+s"v" %o#"l
The server responds accordingly# The re0uest and response are transmitted through the network The server responds accordingly# The re0uest and response are transmitted through the network from the client to the server#
from the client to the server# !n early
!n early form of form of clientclient-serv-server arrangemener arrangement t was the was the remotremote e procedprocedure call ure call 612$ introd612$ introduced inuced in the &'<)s# This mechanism allows a local program to e%ecute a procedure on a remote computer the &'<)s# This mechanism allows a local program to e%ecute a procedure on a remote computer and get back results from that procedure# It is now the basis of certain network facilities such as and get back results from that procedure# It is now the basis of certain network facilities such as mounti
mounting remote files in ng remote files in a a sharshared file ed file systsystem# ,or em# ,or the remote proceduthe remote procedure call re call to work the to work the clientclient needs to:
needs to:
.Identify the location of the re0uired procedure# .Identify the location of the re0uired procedure# .4now how to communicate with the
.4now how to communicate with the procedure to get it to provide the procedure to get it to provide the actions re0uired#actions re0uired#
The remote procedure call introduced the concept of a service registry to provide a means of The remote procedure call introduced the concept of a service registry to provide a means of locating the service 6procedure# 7sing a service registry is now part of what is called a locating the service 6procedure# 7sing a service registry is now part of what is called a service-oriented architecture 6S"! as illustrated in the figure below# The se0uence of events is as oriented architecture 6S"! as illustrated in the figure below# The se0uence of events is as follows:
follows:
.,irst the server 6service provider pub
.,irst the server 6service provider publishes its services in a lishes its services in a service registry#service registry# .Then the client 6service re0uestor can ask
.Then the client 6service re0uestor binds with service provider to invoke a service# .Then the client 6service re0uestor binds with service provider to invoke a service#
S"vi$"+oi"nt"# )$*it"$tu". S"vi$"+oi"nt"# )$*it"$tu".
8ater forms of remote procedure calls in &'')s introduced distributed ob@ects most notably 8ater forms of remote procedure calls in &'')s introduced distributed ob@ects most notably $"19! 6$ommon 1e0uest 9roker !rchitecture and Gava 1*I 61emote *ethod
$"19! 6$ommon 1e0uest 9roker !rchitecture and Gava 1*I 61emote *ethod Invocation#Invocation# ! fundamental disadvantage of remote procedure calls so far described is the need for the calling ! fundamental disadvantage of remote procedure calls so far described is the need for the calling programs to
programs to know implementation-dependent know implementation-dependent details of the details of the remote procedural remote procedural call# ! proceduralcall# ! procedural call has a list of parameters with specific meanings and types and the return value6s have call has a list of parameters with specific meanings and types and the return value6s have specific meaning and type#
specific meaning and type#
!ll these details need to be known by the calling program each remote procedure provided by !ll these details need to be known by the calling program each remote procedure provided by dif
differferent ent proprogragrammemmers rs coucould ld havhave e difdifferferent ent and and incincompompatiatible ble arrarrangeangementments# s# ThiThis s led led toto improvements including the introduction of interface definition 6or description languages 6ID8s improvements including the introduction of interface definition 6or description languages 6ID8s that enabled the interface to be described in a language-independent manner and would allow that enabled the interface to be described in a language-independent manner and would allow clients and servers to interact in different languages 6e#g# between $ and Gava# >owever even clients and servers to interact in different languages 6e#g# between $ and Gava# >owever even with ID8s these systems were not always completely platform5language independent#
with ID8s these systems were not always completely platform5language independent# Some aspects for a better system include:
Some aspects for a better system include:
.7niversally agreed-upon standardi?ed interfaces# .7niversally agreed-upon standardi?ed interfaces#
.Inter-operability between different systems and languages# .Inter-operability between different systems and languages#
.,le%ibility to enable different programming models and message patterns# .,le%ibility to enable different programming models and message patterns#
.!greed network protocols 6Internet standards# .!greed network protocols 6Internet standards# =e
=eb services with an b services with an H*8 interface definition language offer the solution#H*8 interface definition language offer the solution# 1. Into#u$tion to Gi# A$*it"$tu" )n# st)n#)#s
1. Into#u$tion to Gi# A$*it"$tu" )n# st)n#)#s
4)si$ &ill)s 4)si$ &ill)s
•
•
• 1esource management1esource management
•
• SecuritySecurity
•
• Information servicesInformation services
N""# of s"$uit N""# of s"$uit
•
• /o centrali?ed control /o centrali?ed control
•
• Distributed resourcesDistributed resources
•
• Different resource providersDifferent resource providers
•
• Each resource provider uses different security policiesEach resource provider uses different security policies
R"sou$" M)n)'"%"nt R"sou$" M)n)'"%"nt
The huge number and the heterogeneous potential of rid $omputing resources causes the The huge number and the heterogeneous potential of rid $omputing resources causes the resource management challenge to be
resource management challenge to be a ma@or effort topic in rid $omputing environments#a ma@or effort topic in rid $omputing environments# These resource management eventualities are include resource discovery resource inventories These resource management eventualities are include resource discovery resource inventories fault isolation resource provisioning resource monitoring a variety of autonomic capabilities fault isolation resource provisioning resource monitoring a variety of autonomic capabilities and service-level management activities#
and service-level management activities#
The most interesting aspect of the resource management area is the selection of the correct The most interesting aspect of the resource management area is the selection of the correct resource from the grid resource pool based on the service-level re0uirements then to efficiently resource from the grid resource pool based on the service-level re0uirements then to efficiently provision them to facilitate user needs#
provision them to facilitate user needs# Info%)tion S"vi$"s
Info%)tion S"vi$"s Inf
Informormatiation on serservicvices es are are funfundamdamententallally y conconcentcentratrated ed on on proprovidividing ng valvaluabuable le infinformormatiationon respective to the rid $omputing infrastructure resources#
respective to the rid $omputing infrastructure resources#
These services leverage and entirely depend on the providers of information such as resource These services leverage and entirely depend on the providers of information such as resource availability capacity utili?ation @ust to name a few# This information is valuable and mandatory availability capacity utili?ation @ust to name a few# This information is valuable and mandatory fee
feedbacdback k resrespecpectivtive e to to the the reresousourcerces s manmanageragers# s# TheThese se infinformormatiation on serservicvices es enaenable ble serservicvicee providers to most efficiently allocate resources for the variety of very specific tasks related to the providers to most efficiently allocate resources for the variety of very specific tasks related to the
rid $omputing infrastructure solution# rid $omputing infrastructure solution# D)t) M)n)'"%"nt
Data forms the single most important asset in a rid $omputing system# This data may be input Data forms the single most important asset in a rid $omputing system# This data may be input into the resource the results from the resource on the
into the resource the results from the resource on the e%ecution of a specific task#e%ecution of a specific task#
If the infrastructure is not designed properly the data movement in a geographically distributed If the infrastructure is not designed properly the data movement in a geographically distributed system can 0uickly cause scalability problems#
system can 0uickly cause scalability problems#
It is well understood that the data must be near to the computation where it is used# This data It is well understood that the data must be near to the computation where it is used# This data movement in any rid $omputing environment re0uires absolutely secure data transfers both to movement in any rid $omputing environment re0uires absolutely secure data transfers both to and from the respective resources#
and from the respective resources#
The current advances surrounding data management are tightly focusing on virtuali?ed data The current advances surrounding data management are tightly focusing on virtuali?ed data storage mechanisms such as storage area networks 6S!/ network file systems dedicated storage mechanisms such as storage area networks 6S!/ network file systems dedicated storage servers virtual databases#
storage servers virtual databases#
These virtuali?ation mechanisms in data storage solutions and common access mechanisms 6e#g# These virtuali?ation mechanisms in data storage solutions and common access mechanisms 6e#g# relational SK8s =eb services etc# help developers and providers to design data management relational SK8s =eb services etc# help developers and providers to design data management concepts into the rid $omputing infrastructure with much more fle%ibility than traditional concepts into the rid $omputing infrastructure with much more fle%ibility than traditional approaches#
approaches#
St)n#)#s fo GRID "nvion%"nt St)n#)#s fo GRID "nvion%"nt
• • "S!"S! • • "SI"SI • • "S!-D!I"S!-D!I • • rid,T2rid,T2 •
• =S1, and etc#=S1, and etc#
OGSA OGSA
The lobal rid ,orum has published the "pen rid Service !rchitecture 6"S!# To address The lobal rid ,orum has published the "pen rid Service !rchitecture 6"S!# To address the re0uirements of grid computing in an open and standard way re0uires a framework for the re0uirements of grid computing in an open and standard way re0uires a framework for distributed systems that support integration virtuali?ation and management# Such a framework distributed systems that support integration virtuali?ation and management# Such a framework re0uires a core set of interfaces e%pected beh
re0uires a core set of interfaces e%pected behaviors resource models bindings#aviors resource models bindings#
"S! defines re0uirements for these core capabilities and thus provides a general reference "S! defines re0uirements for these core capabilities and thus provides a general reference architecture for grid computing environments# It identifies the components and functions that are architecture for grid computing environments# It identifies the components and functions that are useful if not re0uired for a grid environment#
OGSI OGSI
!s grid computing has evolved it has become clear that a service-oriented architecture could !s grid computing has evolved it has become clear that a service-oriented architecture could provide many benefits in the implementation of a grid infrastructure#
provide many benefits in the implementation of a grid infrastructure#
The lobal rid ,orum e%tended the concepts defined in "S! to define specific interfaces to The lobal rid ,orum e%tended the concepts defined in "S! to define specific interfaces to various services that would implement the functions defined by "S!# *ore specifically the various services that would implement the functions defined by "S!# *ore specifically the "pen rid Services Interface 6"SI defines mechanisms for creating managing e%changing "pen rid Services Interface 6"SI defines mechanisms for creating managing e%changing information among rid services#
information among rid services# ! rid service is a =e
! rid service is a =eb service that b service that conforms to a set conforms to a set of interfaces and behavof interfaces and behaviors that define howiors that define how a client interacts with a rid service#
a client interacts with a rid service#
These interfaces and behaviors along with other "SI mechanisms associated with rid service These interfaces and behaviors along with other "SI mechanisms associated with rid service creation and discovery provide the basis for a robust grid environment# "SI provides the =eb creation and discovery provide the basis for a robust grid environment# "SI provides the =eb Service Definition 8anguage 6=SD8 definitions for these key interface
Service Definition 8anguage 6=SD8 definitions for these key interface OGSA+DAI
OGSA+DAI
The "S!-D!I 6data access and integration pro@ect is concerned with constructing middleware The "S!-D!I 6data access and integration pro@ect is concerned with constructing middleware to assist with access and integration of data from separate data
to assist with access and integration of data from separate data sources via the grid#sources via the grid#
The pro@ect was conceived by the 74 Database Task ,orce and is working closely with the The pro@ect was conceived by the 74 Database Task ,orce and is working closely with the lobal rid ,orum D!IS-= and the lobus team#
lobal rid ,orum D!IS-= and the lobus team# Gi#TP
Gi#TP ri
rid,Td,T2 2 is is a a secsecure ure and and relreliabiable le datdata a tratransfnsfer er proprotoctocol ol proprovidviding ing highigh h perperforformanmance ce andand optimi?ed for wide-area networks that have high
optimi?ed for wide-area networks that have high bandwidth#bandwidth#
!s one might guess from its name it is based upon the Internet ,T2 protocol and includes !s one might guess from its name it is based upon the Internet ,T2 protocol and includes e%
e%tetensnsioions ns ththat at mamake ke it it a a desdesirirabable le totool ol in in a a grgrid id enenviviroronmenmentnt# # ThThe e rridid,T,T2 2 prprototococolol specification is a proposed
specification is a proposed recommendation document in recommendation document in the lobal rid ,orum the lobal rid ,orum 6,D-1-26,D-1-2#)B)##)B)# rid,T2 uses basic rid security on both control 6command and data channels#
rid,T2 uses basic rid security on both control 6command and data channels#
,eatures include multiple data channels for parallel transfers partial file transfers third-party ,eatures include multiple data channels for parallel transfers partial file transfers third-party transfers more# =S1, =eb Services 1esource ,ramework 6=S1,# 9asically =S1, defines a transfers more# =S1, =eb Services 1esource ,ramework 6=S1,# 9asically =S1, defines a