1
Micky Hogue, CRM Sandia National Laboratories
Albuquerque, New Mexico [email protected]
Disaster Recovery Planning
Disaster Recovery Planning
Presented by
4
If that happened to your
If that happened to your
business...
business...
Would your business be
able to survive???
5
Agenda
Agenda
z
Business Disaster Recovery Planning
zAnalyzing your company & it’s needs
zRegulations, Recovery, & Risks
zTesting the plan
z
Mutual Aid & Pre-disaster Agreements
6
Business Disaster
Business Disaster
Recovery Planning
Recovery Planning
Disasters happen...
Disasters happen...
If your company is here today,
If your company is here today,
and gone tomorrow...
and gone tomorrow...
Will it matter?
Will it matter?
7
Focus on the Organization’s
Focus on the Organization’s
most Critical Functions
most Critical Functions
These Need to be
These Need to be
Recovered First.
Recovered First.
8Definitions
Definitions
zDisaster Planning--determines risks & potential
impacts
zDisaster Prevention--steps to prevent or lessen
impacts
zContingency Planning--develop records
program, recovery strategies, and procedures, coordinated written plans, make assignments, list resources, do training and testing.
Definitions...
Definitions...
(continued)(continued)zDisaster Response & Recovery--Implementing your
Plan, dedicate resources to priority “critical function areas” - retrieve/restore all vital records for these areas.
zBusiness Resumption--retrieve/restore all vital
records & information for the rest of the company’s work areas -- finally return to normal business.
10
Levels of Disasters
Levels of Disasters
z
Individual – loss of file, diskette, hard drive
zLoss of office – fire, water
z
Local (loss of building) – fire, earthquake,
bomb, biological hazard
z
Region Wide – flood, storm, earthquake, fire,
bio/chemical hazards
z
Nationwide – terrorism, massive computer
failure, bio/chemical hazards,war
11
An Information Disaster is...
An Information Disaster is...
a sudden event that results in the loss
of records essential to an
organization’s continued operation.
zDestruction--fire, water, earthquake, etc.zStolen--industrial espionage, theft for profit or
sabotage
zInaccessible--toxic contaminates, earthquake
12
Is Your Company Unique?
Is Your Company Unique?
zSole provider of your services/function?
zHow fast must you resume
services--immediately? 24 hrs? 48 hrs? 1 wk?...
zWho is harmed if you cannot function?
zAre special skills/knowledge required?
zWill your employees be available?
z
Are special records or equipment required?
zIf so, will they be available in time?
13
What are Your Company’s
What are Your Company’s
Post
Post
-
-
Disaster Needs?
Disaster Needs?
z
Your building is gone -- Where will you go?
zTransportation? Housing? Food?
zWill employees leave home & family?
z
Alternate work site established & contracted?
zEquipment, supplies, telecom -- in place?
zCurrent Vital Records Plan & backups?
zDo you have a plan now? Does staff know of
it, and what they are supposed to do?
14
Will the Disaster Change Your
Will the Disaster Change Your
Responsibilities, Functions, or Direction in
Responsibilities, Functions, or Direction in
Any Way?
Any Way?
z
What will be new or different during the
response and recovery?
z
Do business as usual? Or address
specific response & recovery services?
zDo you have procedures for these
response & recovery function?
zHave your employees been trained &
rehearsed?
Why Should I Develop a
Why Should I Develop a
Company Disaster Recovery Plan?
Company Disaster Recovery Plan?
z
How can I justify? What are the Benefits?
»Meet regulatory requirements »Ensures continuation of services »Increase employee confidence & morale »Insure job security
»Identifies the vital parts of the agency & helps to focus and streamline procedures & strategies »Minimizes liability and lawsuits
16
Regulations & Statutes for
Regulations & Statutes for
Recovery Planning
Recovery Planning
zContingency Planning Regulations
zLiability Laws
z
Life/Safety Guidelines
zRisk Reduction Statutes
zSecurity Acts
z
Vital Records Statutes
17
Risks
Risks
z
Impact if records are lost? To company,
customers, or public?
z
Which type of disasters can happen most
often?
z
How quickly must you resume business?
zHow tough is your competition?
z
How soon will you lose market share?
18
Risks
Risks
(continued)(continued)z
Will customer sue you if they suffer
losses?
z
What if the disaster involves your
off-site storage or archives?
z
What are legal, IRS, and other
implications?
19
Where to Begin?
Where to Begin?
z
Get management agreement for a plan,
and the extent of the plan
z
Set up a Contingency Planning Group
zSelect a disaster recovery team
zGet every department working on a
disaster plan and vital records plan
20
Four Phases of Disaster
Four Phases of Disaster
Recovery
Recovery
--
--
S, S, R, and R
S, S, R, and R
z
S = Survival
»Immediate response to threats to life safety, equipment, buildings, or area.
z
S = Stabilize
»Take sensible steps to regain control of situation
z
R = Recover
»Take necessary steps to recover critical & essential functions & facilities
z
R = Resume
»Transition from recovery to normal business
Business Disaster Recovery
Business Disaster Recovery
Plan Strategies
Plan Strategies
z
All work units develop disaster recovery plans
& test them at least twice each year
z
Recovery Priority Level is based on the
impact to customer, regulatory requirements,
and financial stability:
»1. CRITICAL -- recovery within 48 hours
»2. ESSENTIAL -- recovery within 1 week
»3. SUPPORT -- assist recovery of other units
22
Business Disaster Recovery
Business Disaster Recovery
Plan Strategies
Plan Strategies
(continued)(continued)z
Standard Disaster Plan Format:
»corporate policy, response & recovery strategies, plan assumptions
»explains changes during a recovery period »ensures all essential information & decisions are
included in the plan
»information is in a logical sequence
»information is easily referenced during a disaster
23
Business Disaster Recovery
Business Disaster Recovery
Plan Strategies
Plan Strategies
(continued)(continued)z
Standard Disaster Plan Format:
»planning process efficient for managers »allows DRP to easily read & critique every plan »allows DRP to compare strategies of business
units
»allows another manager to implement a plan other than their own
24
Basic Steps in Developing a
Basic Steps in Developing a
Disaster Recovery Plan
Disaster Recovery Plan
(cont...)(cont...)zInform all function areas of the priority status and
your recovery plans for them
zDevelop a Standard Disaster Recovery Plan to be
completed, & updated annually by all business units.
zCopies of the plan to be kept in the managers’
offices and homes
zPlan to include standard emergency response
25
Basic Steps in Developing a
Basic Steps in Developing a
Disaster Recovery Plan
Disaster Recovery Plan
z
Do a Risk Analysis (building/regional)
zDo Business Impact Analysis (types of
disasters on business functions)
zDo Human Impact Analysis
z
Ensure Adequate Business Interruption
Insurance
z
Ensure frequent off-site backups of all vital
records, data, software, etc.
26
Basic Steps in Developing a
Basic Steps in Developing a
Disaster Recovery Plan
Disaster Recovery Plan
(cont...)(cont...)z
Develop Hotsite/Warmsite/Coldsite
Plan--implement and do tests
z
Plan Communication after a Disaster
»Where will key managers meet?
»What should staff do when they hear of disaster? »How to keep everyone up-to-date & informed?
z
Determine what your critical functions are,
and if any are independent of location
Basic Steps in Developing a
Basic Steps in Developing a
Disaster Recovery
Disaster Recovery
Plan
Plan
(cont...)(cont...)zCritical functions that must resume operations in
less than 1 week must develop, equip, install telecommunications and mainframe connectivity, supply, and test an alternative worksite
zDetermine what order “Critical” functions should be
recovered
zDetermine how to best use staff & resources of your
28
Basic Steps in Developing a
Basic Steps in Developing a
Disaster Recovery Plan
Disaster Recovery Plan
(cont...)(cont...)zDo a 1-page summary of key information for every
“Critical” function’s dept’s. plan--these summaries must be immediately available to the corporation’s “Recovery Management Team”
zPrepare a Work Unit Location Analysis for every
multi-store building--which units, # of people, criticality status, square footage, equipment needed, etc
.
29
Basic Steps in Developing a
Basic Steps in Developing a
Disaster Recovery Plan
Disaster Recovery Plan
(cont...)(cont...)z
Develop a multi-room Emergency Operations
Center (EOC)
»Develop rolls/responsibilities and basic procedures
»Have key managers/staff practice activating and using it
z
Interview major restoration companies
»Consider pre-signed service agreements for emergency evaluation and priority service
30
Basic Steps in Developing a
Basic Steps in Developing a
Disaster Recovery Plan
Disaster Recovery Plan
(cont...)(cont...)zBeyond your fire warden program, develop an
Emergency Response and Life Safety Program based on a severe regional emergency or disaster.
zFocus on your ability to survive up to 1 week without
any outside assistance--fire, injuries, deaths, search & rescue, water, food, sanitation, communications, & evacuations
31
The Only Certain Thing
The Only Certain Thing
About an Untested Plan...
About an Untested Plan...
Is That the Plan Won’t Work.
32
Types of Tests
Types of Tests
z
Notification Tests
zTable Top Tests
zWalk Through Tests
z
Operational Tests of Emergency
Voice Communications
z
Operational Tests of Hotsite
Types of Tests
Types of Tests
(continued)(continued)z
Triage Tests
zMini - Simulations
zMajor - Simulations
z
Coordinated Partnership Response
Test of a Major Disaster Simulation
34
Pre
Pre
-
-
Disaster Agreements, Service
Disaster Agreements, Service
Contracts, & Mutual Aid
Contracts, & Mutual Aid
z
What should you do?
z
What can you do?
35
Pre
Pre
-
-
Disaster Agreements, Service
Disaster Agreements, Service
Contracts, and Mutual Aid
Contracts, and Mutual Aid
Can You Recover All By Yourself?
Generally speaking, if your business or
agency is going to have a realistic
chance of recovering in time, you are
going to need the help of others. And in
order for them to recover, they may need
your help.
36
Mutual Aid & Pre
Mutual Aid & Pre
-
-
Disaster Agreements
Disaster Agreements
“Helping Each Other” Philosophy
“Helping Each Other” Philosophy ----Volunteering to AssistVolunteering to Assist z
Mutual Aid and Pre-Disaster Agreements:
»Are voluntary
»Do not bind or obligate the signers; they will only assist if possible
»Define the general types of assistance that may be required
»Identify the chain of command for activating the agreement
37
Service Contracts
Service Contracts
--
--
How to Ensure
How to Ensure
Essential Services Will Continue
Essential Services Will Continue
z
Service Contracts:
»Are legal and binding contracts
»Stipulate how, when, and where specific services are to resume
»Are negotiated and signed by the vendors owners or high-level managers
»Identify the chain of command for activating the agreement
»Define 24-hour communications procedures
38
Public & Private
Public & Private
Partnerships
Partnerships
z
Mutual Aid and Pre-Disaster Agreements:
»Are voluntary
»Do not bind or obligate the signers; they will only assist if possible
»Define the general types of assistance that may be required
»Identify the chain of command for activating the agreement
»Define 24-hour communications procedures
There are no Permanent
There are no Permanent
Answers....
Answers....
Only Evolving Solutions
Only Evolving Solutions
40