b k
sys.backup
Centralized Open Source backup
solution for CARNet members solution for CARNet members
Branko Radojević, M.Sc.
Deputy Director
June 2011.
Just a few introductory words
Just
a
few
introductory
words
…
40 years around 10100 years around University computing center Croatian NREN
University level services National-level services + some national services Universities + Schools
GRID NO GRID
Inspired
Inspired
• Some of the basic concepts and ideas were pickedSome of the basic concepts and ideas were picked up from our recent major involvement in TF-STORAGE
h
k
CARNet – Who we are & what we do?
CARNet
– Who
we
are
&
what
we
do?
• Public Institution funded from National Budget • NREN – National Research and Education Network • 95 full time + 50 part-time employees
• Over 19 years ISP for Educational Institutions in Croatia
(schools, universities, research institutes, ministry, agencies, public hospitals etc ) 3000 locations in Croatia
public hospitals, etc.) – 3000 locations in Croatia
• Over 100 different services for educational community in Croatia
(Authorization services, LMS, CMS for schools, Videoconferencing, VoIP, virtual f f
servers for faculties, e-learning academy, Cisco Networking Academy, etc.)
It all started in 1992
It
all
started
in
1992…
1992
First link to Internet No WEB
No WEB Few e-mails
Small amount of not so important data Lack of knowledge about the Internet in our Institutions
then in 1994/1995
…
then in 1994/1995
…
1992 1994
First link to Internet No WEB
CARNet decided to push Institutions to No WEB
Few e-mails
Small amount of not
became virtually present
CARNet starts to buy so important data
Lack of knowledge about the Internet in
and support UNIX servers located on Institutions premises
and finally around 1997
..
and
finally
around
1997
…
1992 1994 1997
First link to Internet No WEB CARNet decided to push Institutions to Amount and importance of data No WEB Few e-mails
Small amount of not
became virtually present
CARNet starts to buy
stored on server
becomes respectable. CARNet starts to buy so important data
Lack of knowledge about the Internet in
and support UNIX servers located on Institutions premises
and support UNIX servers with tape backup drives
our Institutions CARNet starts to
develop its own Linux distro based on Debian
CARNet server from around 1997
CARNet servers today
CARNet
servers
today
•
Standard Intel x86 platform
Standard Intel x86 platform
( HP ML 370 and Fujitsu-Siemens TX300)
•
Included LTO2 drive with the server
•
Included LTO2 drive with the server
•
Running CARNets version of Debian Linux
or
The Problem
The Problem
• Servers came with Tape Drives but w/o tapesServers came with Tape Drives but w/o tapes
• Tape drives can make up to 50% of server’s purchase price
price
• In majority of cases were never or rarely used • If used, often tapes were kept at same physical
location with servers
• Unwillingness to (manually) change tapes on daily basis by the local administrators y
The Solution
The Solution
• One to fix’em all
• Centralized backup system for members over its
existing connection to CARNet network existing connection to CARNet network
• Easy to setup – single step for user to request and establish the service
establish the service
• Secure – data encrypted on client’s side and visible
l b th
The Solution (cont’d)
The Solution (cont d)
• Redundant – all data are stored on CARNet’s enterprise type
storage system in two steps and on two different devices (storage + tape library) – geographical redundancy
Ch f i ti i f t t d
• Cheap – use of existing infrastructure, resources and open
Hardware & Software
Hardware
&
Software
•
Hardware – multi tiered enterprise level backup
Hardware multi tiered enterprise level backup
system. Tape library and Storage array kept on
same physical locations – can change
same physical locations
can change
•
Software – sys.backup as a service is based on
B
l
t f O
S
t
i
d
Bacula, a set of Open Source, enterprise ready,
computer programs.
sys backup user perspective
sys.backup
‐
user
perspective
• To request the service:To request the service: apt-get install bacula-cnapt get install bacula cn
• Within 24 hrs email is received with confirmation
that full backup is successfully completed i e service that full backup is successfully completed i.e. service was successfully established
S t th h CARN t h l f b
• Support through CARNet sys.help for member sysadmins
• Use existing sysadmin web portal for how-to’s on selective recovery as well as recommended bare-metal recovery
sys backup – our perspective
sys.backup – our perspective
• Ticket is being opened by email from user afterTicket is being opened by email from user after bacula-cn install
• Ticket contains all necessary info to add new • Ticket contains all necessary info to add new
user/client to bacula director/server (currently manually updated)y p )
• Full backup for new client is scheduled in late night hours
hours
• Following day and if all goes well user is notified and ticket is closed
Current limitations and issues
Current
limitations
and
issues
• only foronly for fullfull MI’sMI s
• bacula-cn runs only on cn-debian GNU/Linux distro • not available for Windows (for now)
• “only” 100GB per usery p
• can overwhelm the network for longer periods of time if run over slower link – a challenge for NOC time if run over slower link a challenge for NOC department
