• No results found

High Performance Computing Specialists. ZFS Storage as a Solution for Big Data and Flexibility

N/A
N/A
Info
Download
Protected

Academic year: 2021

Share "High Performance Computing Specialists. ZFS Storage as a Solution for Big Data and Flexibility"

Copied!
37
0
0

Loading.... (view fulltext now)

Download now ( 37 Page )

Full text

(1)
(2)

Introducing VA Technologies

•UK Based System Integrator

•Specialising in High Performance ZFS Storage •Partner of E4 Computing Engineering

(3)

VA HPC Powered by E4

•New HPC Solutions

•ARKA ARM and Quadro + Tegra 3 Blades •Joint New Solutions

(4)

But First. ZFS 

•6 Great Reasons to Love ZFS •Architecture

•Data Integrity •Redundancy

•Transactional Copy on Write (COW) •Snapshots

(5)

Architecture

•6 Great Reasons to Love ZFS •Architecture

•Data Integrity •Redundancy

•Transactional Copy on Write (COW) •Snapshots

(6)
(7)

Architecture ‐ ZFS Layer View

e.g. pNFS

raw swapdumpiSCSI ?? ZFS NFS CIFS ??

?? ZFS POSIX Layer (ZPL)

ZFS Volume Emulator (Zvol)

Transactional Object Layer Pooled Storage Layer

Block Device Driver

(8)

Data Integrity

•5 Great Reasons to Love ZFS •Architecture

•Data Integrity •Redundancy

•Transactional Copy on Write (COW) •Snapshots

(9)

Data Integrity – Designers Quote

“The job of any file system boils down to this: when asked to read a block, it should return the same data that was previously written to that block. If it can't do that -- because the disk is offline or the data has been damaged or tampered with -- it should detect this and return an error.”

(10)
(11)
(12)
(13)

Redundancy

•6 Great Reasons to Love ZFS •Architecture

•Data Integrity •Redundancy

•Transactional Copy on Write (COW) •Snapshots

(14)

Redundancy – Mirrored Disks in 2 vdevs

Logical vdevs

Physical or leaf vdevs

(15)

Redundancy – RAIDz2 in 3 vdevs

Physical or leaf vdevs

(16)

Redundancy – Dynamic Striping

Total write size = 2816 kBytes

RAID-0 Column size = 128 kBytes, stripe width = 384 kBytes

ZFS Dynamic Stripe recordsize = 128 kBytes 384 kBytes

(17)

Transactional Copy on Write (COW)

•6 Great Reasons to Love ZFS •Architecture

•Data Integrity •Redundancy

•Transactional Copy on Write (COW) •Snapshots

(18)

Transactional Copy on Write (COW)

(19)
(20)

Snapshots

•6 Great Reasons to Love ZFS •Architecture

•Data Integrity •Redundancy

•Transactional Copy on Write (COW) •Snapshots

(21)
(22)

Hybrid Storage Pools Mixing SSD with HDD

•6 Great Reasons to Love ZFS •Architecture

•Data Integrity •Redundancy

•Transactional Copy on Write (COW) •Snapshots

(23)

Hybrid Storage Pools Mixing SSD with HDD

•New •Old

(24)

Hybrid Storage Pools Mixing SSD with HDD

HDD HDD

HDD Read optimized

device (SSD) Adaptive Replacement Cache (ARC)

Main PoolMain Pool Level 2 ARC (L2ARC)

Write optimized device (SSD)

(25)

Hybrid Storage Pools – ARC 

Frequent Cache

MFU

LFU

Evict the oldest multiple accessed entry Recent

Cache LRU

MRU

Evict the oldest single-use entry

Hit Miss

(26)
(27)
(28)

ZFS Limitations

Parallel Access? Distributed File System?

(29)
(30)

Hadoop on ZFS

•Rebuild Times

•Utilize SSD’s with HDD •Better Administration

(31)

Linux and Lustre on ZFS

(32)

Linux and Lustre on ZFS

55PB – Now Active to Sequoia Users Lustre + ZFS Fully Configured

(33)
(34)

Lustre on ZFS – Write Performance

8 16 24 32 40 48 56 64 72 80 88 96 104 0 200 400 600 800 1000 1200 1400 1600

Single shared file IOR (10G block, 1M transfers)

M

B

/s

Sequoia Workload

• 768 OSS Nodes

• 2048 Tasks per OSS

• 1,572,864 Compute Cores

LDISKFS

• Increased tasks per OSS degrades performance ZFS - Constant performance

• Increase I/O size for RAIDZ2

LDISKFS+RAI D6

(35)

Lustre on ZFS – Read Performance

LDISKFS

● mballocallowslargerI/O ZFS

● 128Kmaximumblocksize ● IOPs limited for ZFS+RAID6

Perfect Opportunity for Read Caching

(36)

Lustre on ZFS – Coming Soon

New Hardware 

Optimised for Lustre on ZFS Low Power Consumption OSS & OST Customisable for your Lustre deployment

(37)

Thanks Very Much!

Ryan Tyler VA Technologies

References

Download now ( PDF - 37 Page - 2.29 MB )

Related documents

CyberLink. PowerDirector 8. User s Guide

Note: if you want to burn your current movie production to a disc right away, go directly to the Create Disc module. In the Create Disc module you can create a disc menu, produce

Retributing forest carbon vs. stimulating fuelwood demand insights from the French forest sector model

The aim of this paper was to explore the effects on the French forest sector of three policies to mitigate climate change: a fuelwood consumption subsidy (substitution), a payment

What Nelson Mandela Taught the World About Leadership

de Klerk, South Africa’s last leader under the apartheid regime, Mandela found a negotiation partner who shared his vision of a peaceful transition and showed the courage to

Field implementation and trial of coordinated control of wind farms.

Wind tunnel experiments and simulations based on data obtained from ECN (Energy Research Centre of the Netherlands) test wind farm in [16]–[21] confirm that if properly

Software Architecture Document (SAD) for the Next ESA SAR Toolbox (NEST)

[3] NEST’s primary goals are to read in ESA and third part SAR data products, provide tools for calibration, orthorectification, co-registration, interferometry,

Teaching Public Administration Abroad through the Fulbright Specialist Program

After providing an overview of the Fulbright Specialist Program and the collaborative teaching approach we used for the preparation and delivery of instructional materials,

Pregnancy: Privileges and Protection in the Spanish Golden Age

This is the recurring motto of the unedited treatise Diez privilegios para mujeres preñadas 4 (Ten Privileges for Pregnant Women), written in 1606 by the Spanish physician

Mini-Review. IUDs and Adolescents An Under-Utilized Opportunity for Pregnancy Prevention

27 In a UK study of nulliparous women (in which 80% of the insertions were copper IUDs), 63% had unscheduled bleeding at 3 months; in 40% unscheduled bleeding persisted at 1 year..