Seanodes presents
Storage Virtualization
from clusters to grid
Agenda
•
Seanodes Presentation
•
Overview of storage virtualization in clusters
•
Seanodes cluster virtualization, Shared Internal Storage with Exanodes
•
Seanodes grid virtualization, ViSaGe virtualizer
Agenda
•
Seanodes Presentation
•
Overview of storage virtualization in clusters
•
Seanodes cluster virtualization, Shared Internal Storage with Exanodes
•
Seanodes grid virtualization, ViSaGe virtualizer
Company Information
•
Founded in 2002
•
Mission :
To provide storage software solutions for commoditized infrastructure
•
Result of several years of research conducted in a major French research center: IRIT
•
1st prize in the 2003 National Competition for Creation of Innovative Technological
Partners
Agenda
•
Seanodes Presentation
•
Overview of storage virtualization in clusters
•
Seanodes cluster virtualization, Shared Internal Storage with Exanodes
•
Seanodes grid virtualization, ViSaGe virtualizer
No virtualization: Direct Attached Storage
•
Clusters heterogeneity
– Hardware, CPUs, OS, interconnect, storage device (SATA, SCSI, SAS, SSD … – Storage clients: File systems, data
bases
– Applications
•
Properties and limitation of DAS
– Management doesn’t scale – Local storage
– Scalability is local to storage node – Load balancing between nodes is
difficult
– Failure management is difficult
SAN / NAS virtualization
NAS FC SAN IP•
NAS/SAN benefits
– Shared storage – Easier to manage – Connect to I/O nodes•
NAS/SAN drawbacks
– Incompatibility between systems
– Hardware costs for High performance systems
SAN / NAS virtualization appliance
•
Appliance benefits
– Mask heterogeneity
– Manage dynamicity of storage
– Provide clients (FS, dB …) unified data access
– Load balancing
•
Appliance drawbacks
– Additional Hardware
– Costs of hardware to manage scalability performance and fault tolerance
NAS
FC
SAN
IP
Commodity hardware virtualization: Shared Internal
Storage
•
SIS innovation
– Software only solution
– Transparent to clients (file systems and database)
– Mask storage resources heterogeneity and dynamicity
– Provide fault tolerance capability – Fully symmetric architecture
Agenda
•
Seanodes Presentation
•
Overview of storage virtualization in clusters
•
Seanodes cluster virtualization, Shared Internal Storage with Exanodes
•
Seanodes grid virtualization, ViSaGe virtualizer
Exanodes features and functionalities
•
Exanodes: a clustered block device
virtualization solution for Linux clusters
– Exanodes uses unused local nodes storage devices in Linux clusters and turns them into a fault tolerant and high performing clustered storage system
– Exanodes provides a symmetric storage solution with unmatched I/Os parallelism : computing nodes are also storage nodes – Exanodes is compatible with Linux file
systems (ext3, xfs, GFS …) and is non intrusive
– Cost effective solution relying on existing devices in clusters
Exanodes : features & functionalities
•
High performance shared storage on commodity hardware
– Using storage devices in parallel provide I/Os treatments speed up
– Use of high performance interconnect (Gigabit Ethernet, Infiniband) as data path grows storage bandwidth and reduce latency
•
Fault tolerant shared storage system with RAIN: Redundant Array of Inexpensive Nodes
– Tolerate nodes or disks failures
– Storage clients (file systems, data Bases) always see a coherent and available logical volume even if nodes or disks fail
•
Mask blocks heterogeneity and dynamicity to file systems and raw device applications
– Manage heterogeneous storage devices (SATA,SCSI, SAS …)
Exanodes : file system integration
•
Features Benefits
– Ease of installation
– Ease file system management – Multiple File system support
• Local : EXT 3 • Clustered : GFS
•
Exanodes with GFS
– Exanodes provides to GFS a clustered block device , managing storage device heterogeneity and failures
– GFS manages data coherency on an Exanodes block device – Increased performance and scalability due to SIS
Agenda
•
Seanodes Presentation
•
Overview of storage virtualization in clusters
•
Seanodes cluster virtualization, Shared Internal Storage with Exanodes
Grid Virtualization : increased complexity
Cluster Grid geographic distribution heterogeneity latency capacity dynamicityNO YES multiple sites + +++ several clusters - +++ WAN >> LAN + +++ cumulated capacity + +++ cumulated failures
WAN
S IS SA N N/S SIS S A N SIS DAS NAS SAN N/S gateway gateway gateway gatewayStorage services in Grid middleware : VISAGE
Applications Specialized services Grid servicesMiddleware
Globus toolkit
ViSaGe: storage components other grid services
resources data authorization confidentiality ... genomic biomedical // computing ...
admin & monitor
visagefs
ViSaGe Virtualizer : Role
ViSaGe: storage components
admin & monitor visagefs virtualizer
•
Heterogeneity is managed
– unified access•
Geographic location and latency
management
– migration
– replication
– several consistency protocols
• Read One Write All (large R/W ratio)
• Majority (small R/W ratio)• Weak consistency
•
Large capacity and dynamicity
– automatic administration
