Bio
•
Gregor von Laszewski is conducting state-of-the-art work in Cloud
computing and GreenIT at
Indiana University
as part of the Future
Grid project. During a 2 year leave of absence from Argonne
National Laboratory he was an associate Professor at Rochester
Institute of Technology (RIT). He worked between 1996 and 2007
for
Argonne National Laboratory
and as a fellow at University of
Chicago.
•
He is involved in Grid computing since the term was coined.
Current research interests are in the areas of GreenIT, Grid & Cloud
computing, and GPGPUs. He is best known for his efforts in making
Grids usable and initiating the Java Commodity Grid Kit which
provides a basis for many Grid related projects including the Globus
toolkit (h
ttp://www.cogkits.org).
His Web page is located at
h
ttp://cyberaide.org
•
Re
cently worked on FutureGrid, ht
tp://futuregird.org
Cyberaide Creative:
On-Demand Cyberinfrastructure
Provision in Clouds
Casey Rathbone, Lizhe Wang,
Gregor von Laszewski
, Fugang Wang
Outline
•
Background and related work
•
Problem definition
•
System design
•
Prototype performance results
•
Current progress
•
FutureGrid
Why are we dong it?
03/02/2020 Gregor von Laszewski, [email protected] 4
Grid/Cloud Computing
•
Effective computing paradigm for distributed
high performance computing applications
•
A number of production Grid infrastructures,
projects, applications:
–
TeraGrid, EGEE, WLCG, FutureGrid, D-Grid …
•
Disadvantages of current production Grids:
–
Overloaded Grid middleware
–
Complicated access interfaces and policies
–
Limited QoS support
–
No personalized computing environment
Grid/Cloud Computing
Features:
–
On demand service provision
–
Utility computing model: pay-as-you-go
–
Customized computing environment provision
–
Automatic and autonomous service management
–
User centric interfaces with broad network access
–
Scalable services with resource pooling
……
Cyberaide
•
An open source project
–
Originally created at Argonne Nat. Lab.
–
Now Indiana University
•
Some students from RIT
•
PI: Dr. von Laszewski
•
A middleware for Cyberinfrastructure
–
Including Grids and Clouds
•
Cyberaide virtual appliance
•
Cyberaide shell
Cyberaide
shell, mediator and server
Motivation: Cyberaide Creative
•
Todays heterogeneous network architectures
require teams of IT specialists to effectively
deploy services. Decreasing accessibility to
computing resources.
•
Cyberaide Creative addresses this issue by
Research Topic
•
Increasing accessibility to computing resources
with on-demand deployment on virtualized
hardware resources.
•
Effectively abstracting the end-user from
configuring specifications for each system
Use Case
•
End-user configures a virtual appliance image
with the web interface
•
Cyberaide Creative builds and stores the
virtual appliance
•
End-user then has the capability to deploy
instances of the virtual appliance onto Cloud
resources
Cyberaide Gridshell Deployment
Demonstrates that there is performance sacrifice for virtual
deployments.
Virtual Machine Linpack
Performance Result
On demand access
Cyberinfrastructures
•
Now users can on-demand build desired cyberinfrastructures,
for example production Grid environments.
•
Then how to access them?
•
Interfaces of Production Grids are strictly defined:
•
Resource information
•
Security
•
Job submission and management
•
Access resources of production Grid
•
from ad-hoc clients
•
without special client software & Grid expertise
Cyberaide Virtual Appliance:
overview
•
Cyberaide Virtual Appliance
–
Put cyberadie shell, mediator and server into a virtual
machine,
–
On demand deploy cyberaide virtual appliance to access
production Grid
–
User can access production Grid via cyberaide virtual
appliance
•
Advantages
–
Cyberaide virtual appliance can be dynamically deployed
with policy customization, like user account, access URI, ..
–
Multiple users can share a cyberaide virtual appliance,
then build a VO
–
A cyberaide virtual appliance can be managed easily, for
example, start, shutdown, migration, duplication, ..
Cyberaide virtual appliance:
Solutions
Vmware Studio vs. JeOS VMBuilder
JeOS VMBuilder is selected
Criteria
Vmware Studio
JeOS VMBuilder
User interface
Very good
Less comfortable
Support OS
Ubuntu, SUSE, RedHat,
CentOS
Ubuntu JeOS only
Support hypervisor
Vmware
Vmware, Xen and KVM
Auto support on
hypervisor
Yes
no
Ease of use
Some technical
Cyberaide virtual appliance:
Implementation
•
Four configuration files for Boot and Login:
–
A basic configuration file that allows to define some basic
parameters such as: platform type (i386), amount of memory of
the virtual appliance, packages that should be directly installed,
etc.
–
A hard-disk configuration file that defines the size of each
available (virtual) hard-disk and the number and size of all the
partitions that will be created on these hard-disks.
–
Boot.sh: Shell script that will be executed during the first boot
of the new appliance.
–
Login.sh: Shell script that will be executed after the first logon in
the new appliance.
•
One script is for adapting the VMbuilder configuration files
•
One script is for transferring the appliance to the target
host and starting it on the specified hypervisor.
Test result
Web portal on TeraGrid
Test result:
performance evaluation on TeraGrid
Metrics
value
Building time (basic OS packages)
10 minutes
Building time (full system image)
20 minutes
Deployment time
15 minutes
Total time
40 ~ 60 minutes
Virtual machine image size (basic OS package) 400 MB
Our work on Cloud computing
•
Cyberaide virtual appliance (CloudComp’09)
•
Cyberaide creative (GridCAT’09)
•
Cyberaide onServe (submitted)
•
On-demand ESD (accepted as a book chapter)
•
e-Molst (accepted by CCPE)
FutureGrid
•
The goal of FutureGrid is to support the research that
will invent the future of distributed, grid, and cloud
computing.
•
FutureGrid will build a robustly managed simulation
environment or testbed to support the development
and early use in science of new technologies at all
levels of the software stack: from networking to
middleware to scientific applications.
•
The environment will mimic TeraGrid and/or general
parallel and distributed systems
FutureGrid Partners
03/02/2020 Gregor von Laszewski, [email protected] 26
Indiana University Purdue University
University of Florida University of Virginia
University of Chicago/Argonne National Labs
University of Texas at Austin/Texas Advanced Computing Center
San Diego Supercomputer Center at University of California San Diego
