CLOUD COMPUTING SECURITY
HP Labs G-Cloud
A Secure Cloud Infrastructure
Frederic Gittler
©2009 HP Confidential 22
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Covering…
– A few words about HP Labs
– An outline of Cloud Computing
•
Business drivers, Goals, etc.
– Cloud Security
-
Stakeholders and their issues
-
Routes of attack
-
Properties required
– Secure services
-
Control over security properties
– Infrastructure design
-
Virtual machines, networks and storage
-
Sensors and monitoring
©2009 HP Confidential 33
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
HP LABS AROUND THE WORLD
–
Global talent, local innovation
EMEA
• 10 university collaborations in EMEA
• 4 EU FP7 consortia, UK Tech Strategy
Board awards
• UK CASE PhD support
APJ
• 7 university collaborations in
the Asia-Pacific Region
• A*STAR and EDB support,
Singapore
PALO ALTO
HAIFA
BRISTOL
BEIJING
BANGALORE
SINGAPORE
ST. PETERSBURG
AMERICAS
• 46 university collaborations in the Americas
• Guadalajara Advanced Prototyping Center $1M
• 29 projects with HP Brazil R&D
• DARPA, DOE, US Army, MPO external funding
• NSF Post-Docs support $1M
©2009 HP Confidential 44
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
HP LABS RESEARCH AREAS
–
Innovation at every touchpoint of information
Information
Analytics
Mobile &
Immersive
Experience
Printing
& Content
Delivery
Service &
Solutions
Networking &
Communications
Intelligent
Infrastructure
Cloud &
Security
Sustainability
©2009 HP Confidential 55
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
A long history
1998
2001
2003
2004
2005
2009
2010
2011
2012
OpenCall
2000
Cells
Proposal
The Painter
SE3D
1999
2000
2002
2006
2007
2008
Service
Sensors
G-Cloud
Demo
Williams
F1
Sanger
DreamWorks
Cells v1
SmartFrog
1997
1996
Data
Sharing
©2009 HP Confidential 66
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Cloud Services
IT delivered as a logical service, available on demand,
charged by usage
Logical Service:
details of delivery hidden
On Demand:
scales up and down immediately and seamlessly
Charged by Usage:
metering and billing of services, pay for what you
use
©2009 HP Confidential 77
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Cloud computing Concepts
–
Multi-tenancy
•
Shared service infrastructure, running simultaneous collocated workloads, for
multiple customers
•
Dynamic sharing for flexibility and utilisation efficiency
–
Cloud-scale infrastructure
•
Commodity scale-out hardware
•
Targeting extreme economies of scale
–
Ubiquitous access
•
Using portable client devices
•
Any where, any time
©2009 HP Confidential 88
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Cloud Computing benefits
–
Cost management
•
Benefit from economies of scale
•
Avoids cost of over-provisioning
•
Reduction in up-front capital investment, switch to expense more in line with business
needs
–
Risk reduction
•
Someone else worries about running the data-centre, protecting your data, and
providing disaster recovery
•
Reduces risk of under-provisioning
–
Flexibility
•
Add/remove services on demand
•
Scale up and down as needed – rapidly
–
Ubiquity
©2009 HP Confidential 99
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Barriers to adoption
–
Security, Regulatory, Data locality concerns
–
Concerns about lock-in, lack of multi-vendor options
–
Challenge of migrating from in-house (or outsourced) apps
–
Trust in the service vendors
•
Service levels
•
Stability
•
Geographic presence
©2009 HP Confidential 10
10
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
The Cloud
©2009 HP Confidential 11
11
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Roles in the Cloud
community
public
private
©2009 HP Confidential 12
12
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Infrastructure
Provider
Roles in the Cloud
install and
administer
community
private
public
private
©2009 HP Confidential 13
13
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Roles in the Cloud
Infrastructure
Provider
App Store
Service
Developer
community
private
public
private
©2009 HP Confidential 14
14
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Roles in the Cloud
Service
Provider
Infrastructure
Provider
App Store
Service
Developer
community
private
public
private
©2009 HP Confidential 15
15
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Roles in the Cloud
Service
Provider
Infrastructure
Provider
App Store
procure
Service
Developer
community
private
public
private
©2009 HP Confidential 16
16
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Roles in the Cloud
Service
Provider
Infrastructure
Provider
App Store
procure
Service
Developer
community
private
public
private
©2009 HP Confidential 17
17
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Roles in the Cloud
Service
Provider
Infrastructure
Provider
App Store
administer
Service
Developer
community
private
public
private
©2009 HP Confidential 18
18
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Roles in the Cloud
service
Service
Provider
Infrastructure
Provider
App Store
Service
Developer
community
private
public
private
composed
©2009 HP Confidential 19
19
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
community
private
public
private
Roles in the Cloud
Service
Provider
Infrastructure
Provider
App Store
Service
Developer
multi-tenanted
©2009 HP Confidential 20
20
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Roles in the Cloud
service
Service
Provider
Service
Users
Infrastructure
Provider
App Store
Service
Developer
community
private
public
private
©2009 HP Confidential 21
21
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Roles in the Cloud
service
Service
Provider
Service
Users
Infrastructure
Provider
App Store
Service
Developer
community
private
public
private
Cyber-Criminal
Social Attack
Engineered Attack
©2009 HP Confidential 22
22
©2009 HP Confidential 23
23
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
a Cell is a container for a
service - including all its
virtualized infrastructure
©2009 HP Confidential 24
24
©2009 HP Confidential 25
25
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
©2009 HP Confidential 26
26
©2009 HP Confidential 27
27
©2009 HP Confidential 28
28
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
routing and firewall rules
external internet
©2009 HP Confidential 29
29
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
©2009 HP Confidential 30
30
©2009 HP Confidential 31
31
©2009 HP Confidential 32
32
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
©2009 HP Confidential 33
33
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Model-Based
– Describe “desired” end-point
•
Can freely update the description of the end-point
– Allow the system to create it
•
Asynchronous convergence for scale and performance
– Errors and status reported relative to model
©2009 HP Confidential 34
34
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Model-Based: Why
– Declarative
•
Enables analysis and tool support
•
Cross-model properties and policies
•
Basis for compliance and transparent management
•
Enables different principals to sign different parts of the model, independent of right of model
submission, and mapping into enterprise IT roles
•
Enables IT best practice
– Inherently idempotent
•
Hugely simplifies interaction model, improves security
– Enables back-end asynchrony and parallelism for scale and performance
– Template descriptions of services
•
Simplifies service packaging
•
Ease of integration with a Cloud Marketplace
– Easy to map transactional interfaces to model-based; hard to do the other way
around and maintain the advantages
©2009 HP Confidential 35
35
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Infrastructure Models
vnet
VM
VVol
VVol
vnet
VM
VM
VVol
VVol
VVol
cell
Topology managed by
grants
Communication managed by
rules
©2009 HP Confidential 36
36
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Future Modelling
– Currently we provide explicit description of topology and some security
properties
– However, this is but the start….
•
Support for loose models and constraints
−
Models that are configured according to user or business-level concepts
•
Order-dependencies
−
Declarative description of state transitions and dependencies on the state
•
Specification of QoS policies
−
linked through sensor framework, constraints and dependencies, to create auto-flexing models
•
Specification of service high-availability policies
−
Automatically mapped into placement and recovery decisions
−
Federation properties
•
Specification of additional security policies
−
Guiding placement and other aspects such as providing “security probes”
−
Semantic controls over data sharing
©2009 HP Confidential 37
37
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Infrastructure Virtualization
– To build the isolation, we need virtualized environments
– Virtualization introduces security issues
•
But there are ways around it, for example placement algorithms can keep sensitive
workloads apart from each other
– Virtualization enables new security and isolation techniques
•
sitting “below” the virtual machine allows a range of control points, sensors and
mitigations that are impossible in a physical world
– Indeed virtualization can be seen as the KEY to producing secure
multi-tenanted systems
©2009 HP Confidential 38
38
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Infrastructure Integrity
– We must protect the cloud at all costs
– Threats come from
•
Services run upon it
•
Direct attacks from outside
•
Internal administrators
– We must understand these threats, and the paths that they may use to undermine the
cloud
– We must provide a number of engineering solutions to deal with the threats
•
Minimize attack surface, defence in depth
•
Provide a framework for countermeasures
•
Sensors to detect attacks, both attempts and successes
•
Mitigations to remove attempted and successful attacks
•
Diagnosing attacks by turning sensor data into diagnoses
©2009 HP Confidential 39
39
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Threats
identification
detection
prevention
mitigation
©2009 HP Confidential 40
40
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Service
©2009 HP Confidential 41
41
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Service
server and storage nodes
supporting
services
©2009 HP Confidential 42
42
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Service
server and storage nodes
supporting
services
utility controllers
VMs
(trusted
virtualization)
VNets
(diverter,
rules)
VVols
(CoWs,
©2009 HP Confidential 43
43
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Service
server and storage nodes
supporting
services
utility controllers
VMs
(KVM)
VNets
(diverter,
rules)
VVols
(CoWs,
caching)
©2009 HP Confidential 44
44
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Virtual Networking
–
Goals
•
Support full layer-3
unicast, multicast and broadcast packets
•
Create the illusion of subnets and routing
•
Provide all the inter-VM and subnet routing policies
•
Strong and secure separation
VM VM
©2009 HP Confidential 45
45
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Virtual Storage
Origin image
COW volume B
COW volume A
CopyA
CopyB
Storage area network
LVM+
CopyA
LVM+
CopyB
RO
RW
RW
VM VM©2009 HP Confidential 46
46
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Virtualization Security: Threat
– The main requirement is that the core virtualization technology is secure
– What happens if a VM successfully breaks out of its container and takes over the host?
Hypervisor
Dom 0
Physical host
©2009 HP Confidential 47
47
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Virtualization Security: Prevention
– Use trusted virtualization technologies to minimize risk of attack and reduce impact
– Subdivide the Hypervisor and DOM0 into smaller, simpler, more secure parts and limiting the impact
of success
Hypervisor
Physical host
©2009 HP Confidential 48
48
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Virtualization Security: Host Compromise
– Provide host peer-peer detection of dom0 “misbehaviour”
Hypervisor
Dom 0
Physical host
Dom U
?
?
©2009 HP Confidential 49
49
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Sensors
Aim to detect:
– Illegal Actions
•
System components detecting or initiating abnormal activity with other system components: this is either a bug or a
successful attack and needs immediate attention
•
Attempts of user VMs to communicate with disallowed targets
– Abnormal behaviour
•
Sudden changes in profiles of IO or CPU usage
•
Requests for VMs or other resources beyond reasonable or specified limits
•
Excessive churn in topology
•
Sudden widening of network rules
©2009 HP Confidential 50
50
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Sensors: System
Dom 0 Dom 0 Dom 0 Dom 0 Dom 0 Dom 0 Dom 0 Dom 0 Dom 0
System
VM
System components
can verify requests for
“reasonableness”
System components
inter-communicate in
limited ways
System VMSystem VMSystem VMs©2009 HP Confidential 51
51
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Enforcing and Sensing: IO
Hypervisor
Dom U
Storage IO
Network IO
Enforcement Points and I/O Sensors, e.g.
•dropped or illegal packets
•writes to protected areas
©2009 HP Confidential 52
52
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Service Integrity
– A virused or malicious service is not strictly a threat to the integrity of the whole
cloud, however...
– We must prevent (where possible) attacks on another services by providing
robust isolation and detection of attack attempts
– We must detect when an attack succeeds by
•
monitoring from outside of the service
•
spotting abnormalities in behaviour
•
forensic examination of service VMs
– We must be able to mitigate when an attack is detected
•
Shutting down, restarting or freezing VMs or services
©2009 HP Confidential 53
53
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Service Sensors
– We want to allow service writers to be able to create sensors that
monitor their own services
•
run outside of the service, looking in, and undetectable to it
•
service owners have a better view of the service semantics
•
can be offered by 3
rd
party monitoring specialists (NSA for USG)
•
that do not have any privileged access to core system capability
– Virtualization gives control over what one compartment can do or see
with another compartment.
– We can use the fact that one virtual machine can (given permission)
•
look into the memory space of another.
•
Interpose itself into an IO path of another.
©2009 HP Confidential 54
54
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Sensor VMs
Hypervisor
Dom 0
Sensor
Service
inspection of
VM memory
•
Invisible to the service VM
•
Viruses and root-kits cannot
hide by altering OS or
disabling virus checkers
•
Enabled by an API in the
hypervisor
•
Needs care to ensure that it
doesn’t become another
vector for attack!
©2009 HP Confidential 55
55
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Sensor VMs
– Deployable by the service provider, infrastructure provider or
trusted 3
rd
party
Hypervisor
Dom 0
Sensor
Service
inspection of
VM IO
©2009 HP Confidential 56
56
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.
Sensor VM properties
– We can look for evidence of the use
of different “virus components”
– We do not look only for specific
attacks
– We gain evidence to suggest the
existence of malware.
– It’s hard to detect the presence of the
sensors.
– It’s impossible to hide the code or IO
from the sensors
– We can see if the OS tables have been
manipulated
– We can see into disc and network buffers
– We can sit in the IO path and carry out
©2009 HP Confidential 57
57
© Copyright 2010-2012 Hewlett-Packard Development Company, L.P.