DTS was formed by consolidating two successful data centers to address evolving service demands, but the existing models are insufficient for today's changing landscape in California. Recent outages in other states due to hardware and software failures highlight the risks of inadequate disaster recovery plans and infrastructure. DTS hosts 243 websites without full redundancy or disaster recovery capabilities. The expiring lease for one DTS facility and the co-location of both centers in the same flood plain present an opportunity to transform DTS' operations and infrastructure to better meet current and future needs.

1. DTS was formed from the consolidation of HHSDC and TDC, two successful
data centers that met the challenges and demands that evolved for 30+ years.
Consolidation has been moving forward and based on taking the best of these
two models. But those models were not created to address the changing
landscape of California service delivery demands that we are experiencing
today.
We have an opportunity that we may never have again to transform the DTS in
a way that will not only meet the needs of today but set the stage for DTS to
become the corner stone of meeting California’s future demands.

2. Two statewide computer crashes in one month…
Hardware failure causes 24 hour outage
Fire Alarm triggered halon gas dump..
-Dust into computer
-Froze fiber optic channels

3. FAA computer failure
Affected Air Travel in Colorado and 8 neighboring states
2 failures in 6 months
“puts the safety of the flying public at risk”

4. 17,000 International Travelers Stranded
7 hour extension to the outage due to mis-diagnosis of the problem
vendor contracted response time (4 hrs)
Diagnosis took 3 hours
No contingency plans

5. Millions lose email capability
Inadequate testing of software upgrade in their Canadian NOC
No backup/DR

6. VIRGINIA
12+ hour outage
Hardware failure on 1 of 2 state mainframes
Large agencies impacted most (legacy apps) DMV, Social Services, TAX (FTB), VDOT
(CalTrans) and Employment Commission (EDD)
Working on upgrading infrastructure, building a new data center and a backup data center

7. The RED numbers reflect what DTS is set up to provide and was architected to
provide……we do much better, but……….
It gets dramatically more expensive the closer to 100% you are looking to
guarantee
Enough clients were achieving 99.9%, that we changed our definition of “Best-
in-class” availability to 99.95%
It is not unusual to spend three to four times more for a 99.95% level than
99.7%

8. The web has set new expectations for service to be available anytime/anywhere
At last count we have 243 web sites hosted at DTS….none have full operational recovery
(component redundancy) let alone disaster recovery
Department’s are emphasizing more cost effective solutions and DTS must remain competitive
in all their service offerings. Customers compare our service offering pricing to the Google’s of
the world, but it’s the old fruit salad issue – no two services are likely to be completely
comparable
We are seeing an increase in enterprise solutions that serve multiple customers all with varying
processing requirements posing challenges to maintenance and break/fix activities (email,
service desk, 21st
century, SOA)
Customers are asking us for new tiers of services (storage), and are putting COEMS storage
environments on our floor for their offsite storage requirements

9. Open systems grew up one application at a time and used dedicated hardware/software
environments due to maturity of the environment at the time as well as our inability to charge for
shared environments – that is all changed, virtual solutions are mainstream and the industry has
responded with solutions to the billing problems
DR has been the responsibility of each application to provide/procure…..we have offered an
outsourced arrangement to provide 72 hour disaster recovery to those customers that can afford
the price
Customers basically were expecting that the two data centers could back each other up – NOT
or that we had plans to recover ourselves in entirety – NOT
All 243 web sites are basically one-deep…..keep costs down and bet on the come…..and then
scream when it goes down (we can be down 36 hours a month and still meet published Service
levels – not acceptable, but also not funded)
Need to move from dedicated or stand alone environments to shared environments….industry

10. Open systems grew up one application at a time and used dedicated hardware/software
environments due to maturity of the environment at the time as well as our inability to charge for
shared environments – that is all changed, virtual solutions are mainstream and the industry has
responded with solutions to the billing problems
DR has been the responsibility of each application to provide/procure…..we have offered an
outsourced arrangement to provide 72 hour disaster recovery to those customers that can afford
the price
Customers basically were expecting that the two data centers could back each other up – NOT
or that we had plans to recover ourselves in entirety – NOT
All 243 web sites are basically one-deep…..keep costs down and bet on the come…..and then
scream when it goes down (we can be down 36 hours a month and still meet published Service
levels – not acceptable, but also not funded)
Need to move from dedicated or stand alone environments to shared environments….industry

11. We have no choice to change, the only question how much do we change and
what will that agreed upon change level provide. Two items are providing that
needed opportunity for change. The first being:
Cannery/South Annex lease expiring in 2011, owner wants us out
- Must relocate to a new location
- Affords the opportunity to restructure or change the current
relations/operations between the two data centers
Our two sites are in the same flood plain….a disaster waiting to happen
- Only 17 customers have some of their applications covered for DR
- We estimate it may take up to 6 months to restore all applications under our
current environment