Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Hurricane Sandy Disaster Recovery Infographic


Published on

Hurricane Sandy Disaster Recovery Infographic. Chronicle of two recoveries.

Published in: Data & Analytics
  • Be the first to comment

  • Be the first to like this

Hurricane Sandy Disaster Recovery Infographic

  1. 1. $163,000 According to a recent survey conducted by Aberdeen Group, the top 2 pressures leading to BCDR initiatives are: 44% Cost of Downtime 72% Risk of Business Interruption According to the same survey, the average cost per hour of downtime was over: A prominent East Coast university with a complex hybrid environment implements SunGard’s Managed Recovery Program (MRP) for comprehensive life cycle management of IT disaster recovery. During the first 5 months of onboarding, SunGard observes the university’s annual IT application testing and gathers information about its complex environment the university would send 40 people to their colocation facility to exercise its recovery plans losing an entire IT sprint cycle in the process. A world class medical center located in New York City evaluated its IT landscape and began a two-year transformation. The initial strategy was designed to help refresh their technology, set priorities and determine the strategy. While the hospital has its own on-site datacenter, it also hosts production applications in SunGard’s Carlstadt, New Jersey facility. data is a high priority for this healthcare customer- and while they use cloud technology internally, they decided not to go that route for backing up mission-critical data. ME DICAL CEN TER N ew York City EAST COAST UNIVE RSITY Enterprise Resiliency & Application Recovery Real Life Chronicle of Two IT Departments During Hurricane Sandy Superstorm Sandy, a hurricane combined with a powerful nor'easter, struck the East Coast in late October 2012. It was the deadliest and most destructive hurricane of 2012, as well as the second-costliest hurricane in U.S. history. This is the story of how productivity and preparedness paid-off for a prominent healthcare provider and East Coast university, who were able to weather the storm and maintain IT availability in spite of the odds.
  2. 2. NOAA predicts 2012 Atlantic hurricane season: “A less active season compared to recent years” - NOAA Administrator Jane Lubchenco, Ph.D. TROPICALDEPRESSION EIGHTEEN forms south of Kingston, Jamaica. Hurricane Sandy takes aim at Eastern seaboard of U.S. and has shut down businesses from North Carolina to Maine and cut off power to 8 million homes in 10 states. Senior vice president, vice dean and CIO of the healthcare provider is getting reports about the approaching storm and puts his IT team on high alert. MAY 2012 OCTOBER 22, 2012 Scheduled to review its newly prepared IT recovery runbooks with the university on November 1, SunGard is prepared to deliver them when Sandy hits. OCTOBER 26, 2012 knocked out emergency generators, the medical center is forced to shut down and evacuate and declares a disaster. OCTOBER 29, 2012 Across town, due to rising water levels, the university is also forced to shut down its generators and is unable to run its mission-critcal applications. SunGard deploys 1/3 of its staff 342 customers put SunGard on alert “Very scary sight. New York's gone black.” OCTOBER 2012 Twitter Feed
  3. 3. Mandatory evacuations are underway. The healthcare provider engages full disaster recovery plan to restore email, critical applications, and telecom. Key IT personnel are able to operate from SunGard’s Carlstadt, NJ facility. OCTOBER 30, 2012 The university puts SunGard on alert and within hours declares a disaster. SunGard advises the university to have their tapes delivered to its Carlstadt, NJ recovery facility. mission-critical applications that need recovering- one of them a data warehouse which they have never been able to successfully self-recover in any previous tests. Built on high ground, SunGard’s Carlstadt, NJ datacenter is serving as an impromptu triage, command, and evacuation center by local government for the town of Moonachie, NJ. Referred to as “a beacon of light on a very dark night”- 100+ emergency responders and local residents 117DISASTERS DECLARED Sandy is causing severe flooding in many states along the mid-Altantic coast. National Guard troops are deployed. Bridges and subways close. evacuation shelters open around New York City. 76 Nearly the same number of declarations the company had following 9/11 sungard-data-center-takes-in-flood-evacuees/ TAPES
  4. 4. 9 of SunGard’s workgroup facilities are in use housing 1,500 customer employees. 5 Mobile Recovery Units are deployed including 2 that will eventually be sent to the medical facility to help run telecom and hospital infrastructure. University tapes are delivered to SunGard’s facility. Drawing upon previous months of information gathering and knowledge, the SunGard team works through the night to stand up the various platforms and operating systems needed to perform the recovery. Hurricane Sandy affects some 1.5 million businesses located across 19 counties in the tri-state region. These businesses employ 9.3 million individuals. All told, these businesses represent nearly 1,000 different industries. OCTOBER 31, 2012 medical facility is completed – service is gradually restored. Healthcare provider recovery plan is in full execution. NOVEMBER 1, 2012 The university's IT team arrives at Carlstadt facility with a skeleton crew of 8 people. Shocked to learn that their AIX, Windows, Linux, and backup environments are all up and running, the teams are ready to begin the data recovery process. Transportation Authority says that the destruction is the worst disaster in the 108-year history of New York City. NOVEMBER 2012 1,500 AIX Windows Linux 100% TAPES
  5. 5. - University VP for Information Technology and Chief IT Officer - Medical Center Vice President of Infrastructure and Engineering “The most important thing is to understand the business requirement—what are the critical systems. Then have a clear policy of data retention and make sure everyone understands what that policy is.” “SunGard didn’t just wait around for [us] to show up before beginning the recovery process.” http://searchdisasterrecovery. sourcing-disaster-recovery-services- vs-in-house-disaster-recovery Following the storm, as displaced customer employees stream in, SunGard’s Recovery teams build 15 additional workgroup recovery 750 more seats. The hospitals switch board and telephony are back online, public website is fully restored and functional, and critical application access restored for 600 users. NOVEMBER 2, 2012 By evening, all university systems are back together and the database team begins the restore. IT fully restored at medical facility critical office complex. NOVEMBER 4, 2012 By midnight, the university database is restored. The Red Cross mobilizes 1,700 disaster workers from all over the country and activates 167 response vehicles. An IDC study states, enterprises that performed IT recovery in-house lost an average of $4 million per disaster incident across a variety of business functions while enterprises that partnered with a managed recovery service provider lost an average of $1.1 million per incident.
  6. 6. Medical Center East Coast University In looking back over the recovery efforts following Sandy, Medical Center senior vice president, vice dean and CIO stresses the importance of team work. “In a crisis, people work together. We learned we can do things faster than we thought we could.” “Hurricane Sandy brought many gaps in our DR program to light, and we were fortunate to have SunGard as our recovery partner. Without them, we would not have been able to recover.” To learn more about SunGard Availability Services, a leading provider of disaster recovery, cloud and managed hosting solutions services, visit us on the web at To see how the SunGard Managed Recovery Program can help provide the level of assurance and resiliency to help your complex IT operations remain available when the unexpected happens, view this short demo. Pages/disaster-recovery-program-still-on-the-todos-list.aspx SunGard maintains 100% uptime through crisis. None of its facilities in the affected areas or its managed customer environments ever went down. 43% of businesses that close after a natural disaster never reopen, and an additional 29% permanently close within two years. Several months later, total economic impact of Hurricane Sandy estimated at $65M. news/ten-reasons-disaster-recovery-plans- fail-10023118-1.html AFTERMATH “Champions do not become champions when they win the event, but in the hours, weeks, months and years they spend preparing for it.” - Alan Armstrong - University VP for Information Technology and Chief IT Officer