Amanda: Open Source Backup

(1)

Amanda: Open Source Backup

On the Ground Experiences On the Ground Experiences On the Ground Experiences On the Ground Experiences

Zmanda: Open Source Backup www.zmanda.com Twitter: @chanderkant 1111

(2)

Agenda Agenda Agenda Agenda

• A/ZmandaA/ZmandaA/ZmandaA/Zmanda

• Amanda EnterpriseAmanda EnterpriseAmanda EnterpriseAmanda Enterprise

• Challenges of a Backup AdministratorChallenges of a Backup AdministratorChallenges of a Backup AdministratorChallenges of a Backup Administrator • Customer ExperiencesCustomer ExperiencesCustomer ExperiencesCustomer Experiences

(3)

Protected by Zmanda Protected by Zmanda Protected by Zmanda Protected by Zmanda

Subscribers of Enterprise Editions Subscribers of Enterprise Editions Subscribers of Enterprise Editions Subscribers of Enterprise Editions

Web and Media Web and Media Web and Media Web and Media

Research & Education Research & Education Research & Education Research & Education Government

Government Government Government

Research & Education Research & Education Research & Education Research & Education

Telecom & Service Providers Telecom & Service Providers Telecom & Service Providers Telecom & Service Providers

Manufacturing & Services Manufacturing & Services Manufacturing & Services Manufacturing & Services

(4)

Amanda Amanda Amanda Amanda

• Amanda: The most popular open source backup Amanda: The most popular open source backup Amanda: The most popular open source backup Amanda: The most popular open source backup software

software software software

— Revered open source project (99th _{percentile on}

SourceForge) since 1991

— Protects more than 500,000 systems around the world — Protects Linux, Solaris, Windows, OS X, ...Protects Linux, Solaris, Windows, OS X, ...Protects Linux, Solaris, Windows, OS X, ...Protects Linux, Solaris, Windows, OS X, ...

Downloads

(5)

Amanda Enterprise Amanda Enterprise Amanda Enterprise Amanda Enterprise

Built for today’s data centers Built for today’s data centers Built for today’s data centers Built for today’s data centers

(6)

Travails of a Backup Administrator Travails of a Backup Administrator Travails of a Backup Administrator Travails of a Backup Administrator • Life of an Insurance Agent?

— No friends in fair weather

• Finish backup in desired backup window • Recovery needs anytime from anywhere

• Backup motley of environments to motley of media

— OS’es, Distros, Databases, Apps — Tapes, Disks, Cloud

• Compliance

(7)

Homegrown Backup Scripts Homegrown Backup Scripts Homegrown Backup Scripts Homegrown Backup Scripts

• Many system administrators start with home grown backup scripts

— No initial budget for backup software and backup server — Initially problem seems relatively easy for a Perl hacker

• Backup scripts don’t scale

— Changing needs of the organization

— New platforms and applications — New administrators

• Amanda uses similar formats as typical home-grown scripts

— Tar for Linux/UNIX — Zip for Windows

(8)

Zen Innovations: Manual scripts to Amanda Zen Innovations: Manual scripts to Amanda Zen Innovations: Manual scripts to Amanda Zen Innovations: Manual scripts to Amanda

“Our initial manual processes, scripts and cron jobs quickly started to get complicated as we grew our

infrastructure. We needed to do backups regularly and be in a position to recover quickly without too much

manual intervention. Our initial approach was neither scalable nor suitable to work efficiently.”

(9)

3Jane: We Backup Everything! 3Jane: We Backup Everything! 3Jane: We Backup Everything! 3Jane: We Backup Everything!

We backup:

— All of our custom written source code

— Database schemas

— Dynamically generated website content

— Corporate e-mail data

— Other proprietary information

Data is spread on all flavors of Fedora Linux as well as Windows 2003 and Windows 2008 Servers

And oh, we also want to backup to Amazon S3 for Disaster Recovery.

(10)

Backup to Cloud Backup to Cloud Backup to Cloud Backup to Cloud • BenefitsBenefitsBenefitsBenefits

— No capital expenses. Pay as you go.

— Significantly reduces infrastructure management tasks

— Faster recovery from offsite backups

— Geographic accessibility

— Get risk profile of a much larger vendor, e.g. Amazon, Sun, etc.

(11)

Backup Scheduling Backup Scheduling Backup Scheduling Backup Scheduling

• Every tighter backup windows

• Difficult to predict which data set will change when

— Traditional backup methods require extensive planning and on-going maintenance

— One of our customers had a backup plan which was 50 pages long

(12)

Data Size Server 1 Server 2 Server 3 Server 4 50GB 60GB 70GB

You plan for this…

Backup window will be different for each backup run and there will be spikes in resource utilization during full backups

Backup Scheduling: Traditional Approach Backup Scheduling: Traditional ApproachBackup Scheduling: Traditional Approach Backup Scheduling: Traditional Approach

10GB

0GB

Server 5

Server 6

Server 7

Sunday Monday Tuesday Wednesday Thursday Friday Saturday 20GB

30GB 40GB

…but you mostly use THIS

(13)

Backup Scheduling: Amanda Enterprise Backup Scheduling: Amanda Enterprise Backup Scheduling: Amanda Enterprise Backup Scheduling: Amanda Enterprise

Data Size Server 1 Server 2 Server 3 Server 4 50GB 60GB 70GB

Backup window and resource utilization are consistent for each backup run

10GB

0GB

Server 5

Server 6

Server 7

Sunday Monday Tuesday Wednesday Thursday Friday Saturday 20GB

30GB 40GB

(14)

Recovery needed now! Recovery needed now! Recovery needed now! Recovery needed now!

• Recovery is always harder than imagined • When did you test your recovery?

— Recovery from archives from three years ago?

• Space requirement during recovery

• Space requirement during recovery • Permissions issues

(15)

Anytime. Anywhere. Anytime. Anywhere. Anytime. Anywhere. Anytime. Anywhere.

Built for the Modern Workforce

(16)

Reporting Reporting Reporting Reporting • Several Views — Success/Failure report

— Data sizing and trend report — Media report

— Performance report

• Export for other formats, pie-charts etc.

(17)

Advantage of Open Advantage of Open Advantage of Open Advantage of Open

• Open Formats

— Proprietary format for backup archives comes with huge cost and pain

• Backup on one platform and recover on another

“I’m able to recover the system using basic Linux tar and gzip

“I’m able to recover the system using basic Linux tar and gzip commands even without Amanda. When it comes to recovering data, you don’t want a lot of dependencies.”

- Ray Zhu, Senior IT Manager, • Open discussions!

— forums.zmanda.com — wiki.zmanda.com

(18)

Perspectives of Zmanda Customers Perspectives of Zmanda Customers Perspectives of Zmanda Customers Perspectives of Zmanda Customers

“The administration via Zmanda Management Console, which handled all the set up and interaction with our tape stacker, helped to make our entire backup process very simple and it cut down on a lot of work for our systems engineer”

Sergio Laberer, Managing Director, Zen Innovations “The cost-effective nature of Amanda Enterprise has allowed us to implement a single common solution for enterprise wide backup, while other solutions would have be price-prohibitive for our company in the current market climate”

Steve Jackson, Systems Architect, Haas Cabinet

“Every morning, I have peace of mind after looking at the Zmanda backup logs.” Ray Zhu, Senior IT Manager, Vyatta

“The data is critically important to the company, and it needs to be protected from equipment failure and other risks,Zmanda’s engineers went out of their way to develop a solution that worked for us.”