1. WHIT E PA P E R
Data Management Wish List:
IT Is Open to
Big Changes
A
rmies may march on their stomachs, but businesses march on
their data. If a company’s operational, market or competitive data is old,
inaccurate or simply hard to access and analyze, the consequences can be
dire. On the positive side, companies able to rapidly collect and leverage meaningful
data can significantly improve their battlefield prospects.
Data management, access and analysis haven’t always received the same amount of
consideration, or respect, as the corporate applications that generate and consume the
data. In recent years, however, IT leaders have focused much more attention on their
organizations’ data management platforms and capabilities. The reasons for this shift
are twofold:
1. An expanding collection of systems—from corporate IT systems and cloud services
to smartphones and social media networks—is generating massive amounts of
potentially valuable raw data.
2. The speed of doing business has accelerated, putting much more pressure
on companies to find data almost instantaneously and to mine that data for valuable
intelligence almost as quickly.
Beyond these fundamental business realities, other market and technology trends are
putting new pressures on existing data management infrastructures. Everything has
direct ramifications in the data management world, and some of those ramifications
aren’t pretty.
2. 2 WHIT E PA P E R Data Management Wish List: IT Is Open to Big Changes
To get a better picture of the current data manage- The 200 survey respondents represented a variety
ment landscape and its likely evolution, IDG of industry and government/nonprofit sectors as
Research Services surveyed 100 senior-level and well as a range of organization sizes. More than half
100 midlevel IT managers in June 2012 regarding had 10 terabytes or more under management, and
their data management and analysis objectives, nearly one-quarter had 100 terabytes or more.
challenges and plans. The two groups of managers
largely shared the same perspectives about the
topics covered, although some interesting differ- TCO and Access to Real-Time Data
ences did emerge. Among the survey’s key findings: and Analysis Are Top IT Objectives
The total cost of ownership (TCO) remains a
To get a sense of where the IT managers want to
top evaluation criterion for data management
take their data management environments, IDG
systems, and budget constraints are a major
Research Services analyzed top objectives, which,
challenge.
of course, also often reflected areas of existing
Improved access to real-time data and analysis need or shortcomings in the current data manage-
also tops the list of data management objectives. ment infrastructure. Given the still struggling world
economy—as well as organizations’ perpetual focus
Nearly half of the survey respondents expect
on the bottom line—it wasn’t surprising to find
to evaluate new data management approaches
respondents identifying “managing costs and effi-
within the next two years, and more than one-
ciencies” as their top data management objective for
quarter are considering moving to an entirely
the coming two years.
new database platform.
There is a strong preference for an integrated Not far behind was the need for better access to
software platform for meeting data manage- and analysis of real-time data, which was cited by 46
ment needs. percent of the respondents. This need encompasses
both operational data stored in relational database
records as well as data aggregated in columnar
databases for more-efficient trend-spotting and
FIGURE 1. TOP DATA MANAGEMENT OBJECTIVES other real-time analysis. The real-time-data require-
ment actually ranked as the top objective for the
coming 12 months but was eclipsed by the cost-
Top Data Management Senior Mid-level All
and-efficiencies need when respondents looked
Objectives — Next 12 Months IT IT Respondents
out 24 months.
Managing costs and efficiencies In today’s always-connected, always-on world,
across a complex infrastructure
56% 55% 56%
customers, employees, supply chain partners and
others have come to expect immediate access to
Enabling better access and the information they seek and have little patience
analysis of real-time data (both
46% 46% 46% if an organization’s systems can’t deliver. Likewise,
operational and aggregate data) companies can’t afford to analyze their data for
meaningful sales trends, cash flow status, inven-
Improved ability to support the
tory trends or marketplace shifts with a backward-
remote/mobile workforce
44% 38% 41% looking batch mode approach. Even waiting until
off-hours to mine operational data for such valuable
insights can sometimes cause companies to miss
Enabling better customer
38% 37% 38% fleeting opportunities or be unable to counter fast-
responsiveness
emerging threats.
Increased alignment and “There should be as little latency as possible between
integration with internal
26% 34% 30%
a the occurrence of a transaction and a company’s
business partners
being able to mine information from that event,” says
Irfan Khan, senior vice president and chief technology
Improving the ability to react officer at Sybase, the data management firm that is
quickly to changes in the market
30% 27% 29%
now an SAP company. “As important, if you don’t
and identify opportunity
have a real-time-data platform, you won’t even be
able to build the next generation of applications.”
SOURCE: COMPUTERWORLD; BASE: 200 (100 Senior IT and 100 Mid-level IT)
3. 3 WHIT E PA P E R Data Management Wish List: IT Is Open to Big Changes
The strong demand for access to and analysis of in the cloud. Companies often focus initially on the
real-time data is sometimes overshadowed by importance of securing mobile and cloud-based data
narrower but high-profile needs such as those but soon come to realize that their systems must
resulting from the trend toward big data. However, also be able to keep mobile and centrally stored data
although big data management and analysis are closely synchronized and—once again—available
critical needs for some, mostly large companies, it in real time. Organizations can’t afford to have their
was cited as a top objective by only one-fifth of the sales force or their field technicians working with
respondents, compared to the nearly half who want data that is old or inaccurate.
real-time-data capabilities.
Clearly, the mobile data capabilities that compa-
Other primary objectives—supporting remote/ nies desire will also help them realize their goal of
mobile workers and enabling better customer providing better customer responsiveness. Real-time
responsiveness—represent, respectively, a need access to customer data is important for employees
to deal with a new operational reality and a long- working in central call centers, of course, but is also
standing business objective. The rapid proliferation needed by workers in the field if they are to deliver
of smartphones, tablets and other mobile devices better customer service. More globally, companies
means that companies must both collect and need systems that give employees not only imme-
manage data generated by these devices as well as diate access to customer accounts but, ideally, also
give access to data residing in corporate stores or access to analytic systems that help companies
anticipate customer needs.
The senior-level and midlevel respondents were in
FIGURE 2. TOP DATA MANAGEMENT CHALLENGES AND LIMITATIONS close agreement on most of the top objectives. One
exception was in the mobile workforce category,
support for which more senior managers than
Senior Mid-level All
IT IT Respondents midlevel managers cited as a top need. This disparity
may reflect the upper-level managers’ greater
awareness of the strategic value of supporting
Cost and budget constraints 55% 53% 54% mobile workers.
Increasing data volumes 39% 50% 45% On the flip side, more midlevel managers than senior
IT managers cited increased alignment and integra-
tion with internal business partners as a top objec-
Integrating and managing 32% 33%
33% tive. Senior IT certainly understands the need for
siloed data and applications
such alignment, but it is probably a higher-priority
item for the midlevel managers who must deliver it.
Inadequate staffing
for database management 25% 32% 29%
and maintenance
Budget Constraints and
Scalability 26% 31% 29%
Data Volumes Lead Data
Management Concerns
Data redundancy 25% 31% 28% Although there was generally a high degree of align-
ment between the senior and midlevel IT managers
regarding the top data management objectives, there
Too many tools/interfaces 28% 27% 28%
was more divergence when it came to identifying top
challenges. The two groups did closely agree on their
Data quality 30% 22% 26% top challenge: cost and budget constraints, cited by
approximately half in each group.
Complex to use or administer 26% 26% 26%
Beyond that agreement, opinions were in and out
of alignment on various other issues. For example,
Slow querying/reporting speed 18% 31% 25%
senior and midlevel IT respondents listed increasing
data volumes as their second-most-important chal-
Difficult to maintain 24% 22% 23% lenge, but 50 percent of the midlevel managers
cited this issue and only 39 percent of the senior
SOURCE: COMPUTERWORLD; BASE: 200 (100 Senior IT and 100 Mid-level IT) IT people did.
4. 4 WHIT E PA P E R Data Management Wish List: IT Is Open to Big Changes
Even in cases Midlevel managers tended to be more concerned this group of respondents pointed more often to the
about technical challenges than their senior-level data quality challenge. Why senior IT is significantly
where the data associates. In addition to the data volume issue, more concerned about the inability to support
management midlevel respondents flagged technical challenges diverse data sources is a bit less clear. Again, it
infrastructure such as scalability, data redundancy and slow is possible that senior managers have a broader
querying/reporting speed in greater numbers than appreciation for the need to tap a wide range of
is performing senior IT survey participants did. Also of more information sources to remain competitive in today’s
acceptably, it concern to the midlevel managers was inadequate data-driven world.
tends to be staffing for managing and maintaining the data
management infrastructure.
“meeting”
Current Data Management
expectations Many of the technical and staffing travails afflicting Satisfaction Levels
more than midlevel IT personnel relate to the mushrooming data
volumes driven by the multitude of interconnected In addition to gauging data management objectives
“exceeding” devices and organizations that constitute the modern and concerns, the IDG Research Services survey
them. IT landscape. Although falling disk and memory provided a snapshot of satisfaction levels relating
prices make it practical to store once-unimaginable to respondents’ current data management infra-
amounts of data, this storage capacity puts signifi- structure. On the bright side, respondents indicated
cant pressures on IT for rationalizing, synchronizing, that their data infrastructure is often meeting their
accessing or analyzing massive data volumes. needs across a range of functional and operational
metrics. On the not-so-bright side, a high percentage
Meanwhile, in a likely reflection of senior IT’s reported that their infrastructure is falling short of
concerns about the strategic value of good data, expectations in certain areas.
FIGURE 3. EFFECTIVENESS OF THE CURRENT DATA MANAGEMENT ENVIRONMENT
Effectiveness of Current Falling
Data Management Environment Exceeding Meeting short of Not Top 2
in Each Area expectations expectations expectations applicable Unsure (NET)
Fit with existing infrastructure 15% 68% 12% 2% 4% 83%
High availability/reliability 13% 66% 13% 3% 3% 79%
In-house expertise 16% 62% 20% 1% 3% 78%
In-house expertise 10% 67% 18% 2% 4% 77%
Availability of data management tools 9% 66% 21% 2% 3% 75%
Ability to use the database as a
foundation for other in-house applications
14% 59% 21% 4% 3% 73%
Ability to handle complex queries 12% 57% 24% 4% 4% 69%
Ease of training/certifying on the solution 9% 59% 26% 4% 3% 68%
Ease of management/maintenance 8% 59% 26% 3% 5% 67%
Ability to deal with diverse data sources 9% 58% 25% 5% 4% 67%
Total Cost of Ownership 13% 53% 29% 2% 4% 66%
Querying/reporting speed 9% 57% 28% 3% 5% 65%
SOURCE: COMPUTERWORLD; BASE: 200 (100 Senior IT and 100 Mid-level IT)
5. 5 WHIT E PA P E R Data Management Wish List: IT Is Open to Big Changes
Companies The bottom line: Even in cases where the data 50 percent suggested that building out appli-
management infrastructure is performing accept- cations on an existing database platform is a
often focus ably, it tends to be “meeting” expectations more consideration.
initially on the than “exceeding” them. The top-ranked “exceeding
importance expectations” category was in-house expertise. The These three areas of consideration aren’t mutually
fact that in-house expertise ranked high says more exclusive, of course, and could in many cases be
of securing about the staffing capabilities of the respondents’ complementary to one another.
mobile and companies than it does about the quality of the data
cloud-based management infrastructure itself. And in an environ- Most telling of the shortcomings in existing data
ment of ever-increasing data management demands management infrastructure—and/or the pressing
data but soon and real-time-data dependencies, simply meeting need for more functionality and better economics:
come to realize old expectations won’t make the grade. Roughly one-quarter of the survey respondents
that their cited a willingness to move to an entirely new data-
Meanwhile, the two areas in which expectations base platform.
systems must have come up the shortest proved critically impor-
also be able to tant. TCO, the top-ranked objective, is also the “I’m not surprised that 27 percent overall are willing
keep mobile area of the greatest shortcoming, with 29 percent to move to a new data management infrastructure,”
noting unmet expectations. Querying and reporting says Steve Lucas, executive VP and general manager
and centrally speed—another top objective—was cited as falling of SAP’s Database and Technology organization.
stored data short by 28 percent of the respondents. It isn’t too He cites several data management trends and
closely big of a leap to assume that this shortfall is one of challenges—including the rise of big data applica-
the main factors behind the earlier ranking of access tions, the growing popularity of the Apache Hadoop
synchronized to and analysis of real-time data as the second- distributed application solution, the growth of social
and—once most-important data management objective. media and other unstructured data and the need
again— for real-time analysis—as catalysts for making a
When assessing the ability of existing data manage- change. “Many companies are weighed down by
available in ment environments to meet a diverse set of needs, legacy database infrastructures that can’t marry all
real time. midlevel IT managers were more prone than senior these trends and concepts,” he adds.
IT to see shortcomings. That higher degree of criti-
cality makes sense, given that midlevel IT must deal Despite the incentives to considering a database
directly with any operational and functional prob- change, the survey highlighted several barriers to
lems. Once again, however, the senior and midlevel following this path. Economic issues come into
IT respondents found common ground on TCO. play here, as do strong concerns about data migra-
tion. However, aside from these two issues, all the
The combination of persistent needs and “wish other database change challenges—such as data
list” objectives has many organizations planning integration, time constraints and ROI justification—
to evaluate new data management solutions and garnered mention by only 35 percent or less of
approaches. Nearly half of the respondents said the respondents. These relatively low percentages
they plan to do so in the next 12 to 24 months. suggest that, overall, the challenges of moving to a
Senior IT proved more bullish on that planning, new database platform aren’t seen as overwhelming
which suggests that it is highly likely that such evalu- by a majority of the respondents.
ations will come to fruition.
Beyond the challenges specifically associated with
moving to a new database, the survey explored the
Database Change Among Data top criteria organizations would use when evaluating
Management Options new data management solutions. These criteria
need to reflect more than the organizations’ current
When it came to evaluating new data management data management activities. They must also address
solutions, the survey respondents expressed their the demands presented by ever-escalating data
opinions on three different approaches or initiatives: volumes and the requirements of newly emerging
real-time applications.
55 percent reported that they would aim to
provide increased access to real-time data, a top
Notably, when the survey participants were asked
objective in data management.
about the importance of different features and
51 percent said they would consider consoli- issues, TCO ranked second, not No. 1. Sitting at the
dating their existing database platforms. top of the criteria list was high availability and reli-
6. 6 WHIT E PA P E R Data Management Wish List: IT Is Open to Big Changes
ability. As much as CEOs and CFOs may want IT to An Integrated Approach to
rein in capital expenses and operational costs, TCO Data Management
can’t take precedence over the fundamental need
to keep systems up and running reliably. Any cost Organizations exploring new data management solu-
savings initially realized can quickly evaporate if a tions have no shortage of products and approaches
company’s employees can’t access the data they to consider. Broadly speaking, though, most data
need in order to do their jobs or if customers can’t management solutions fit within one of three main
access a Website to conduct business. categories:
1. Turnkey hardware/software bundles
The study revealed a dramatic gap between the
effectiveness of existing databases and the criteria 2. Custom-built solutions
considered to be critically or very important. Alarm- 3. Integrated software platforms
ingly, some of the biggest discrepancies exist in the
areas of greatest importance to the survey respon- Each of these categories has its pros and cons.
dents: respondents suggested that their companies Turnkey solutions, for example, provide organizations
are falling short in implementation to meet the highly with a prebuilt and preintegrated data management
important need for lower TCO and the top-ranked environment that contains all the hardware and
requirement for high availability and reliability. Going software needed to get up and running quickly. Such
forward, if IT managers can’t deliver to meet these solutions, however, can be relatively expensive and—
critical needs, they won’t be able to count on having more importantly—can sometimes lock customers
much job security. Undoubtedly, these and other into vendor-specific platforms and solutions.
gaps are factors that motivate organizations to
consider new data management solutions and even Custom-built solutions—often delivered in part or
new database platforms. in their entirety by third-party consultants—have
FIGURE 4. TOP CRITERIA FOR EVALUATING NEW DATA MANAGEMENT SOLUTIONS
Importance of Criteria Critical/Very
When Evaluating Data Important Very Somewhat Not very Not at all
Management Solutions (NET) Critical important important important important
High availability/reliability 89% 51% 38% 11% 0% 1%
Total Cost of Ownership 86% 42% 44% 13% 1% 1%
Fit with existing infrastructure 79% 42% 51% 17% 5% 1%
Ease of management/maintenance 78% 25% 53% 20% 2% 1%
Scalability 75% 37% 38% 21% 5% 1%
In-house expertise 75% 28% 47% 22% 3% 1%
Ability to use the database as a
foundation for other in-house applications
74% 24% 51% 19% 5% 2%
Querying/reporting speed 73% 23% 50% 25% 3% 1%
Availability of data management tools 73% 20% 53% 25% 2% 1%
Ability to handle complex queries 72% 25% 47% 23% 6% 1%
Ability to deal with diverse data sources 62% 21% 41% 29% 8% 2%
Ease of training/certifying on the solution 61% 19% 43% 31% 7% 1%
SOURCE: COMPUTERWORLD; BASE: 200 (100 Senior IT and 100 Mid-level IT)
7. 7 WHIT E PA P E R Data Management Wish List: IT Is Open to Big Changes
By relying the potential advantage of giving customers a data willing to spend as necessary to get the functional
management environment fine-tuned to meet characteristics and high availability and reliability
on open, their exact needs. This custom fit usually comes required of their data management systems. And no
integrated data at a high price, however, and—as with the turnkey single functional demand tops the growing need for
management category—can involve proprietary elements that access to and analysis of real-time data.
make it difficult to leverage off-the-shelf open data
platforms, management solutions. This profile of data management needs and objec-
organizations tives aligns well with the product portfolio of SAP. The
can minimize “Adopting the hardware-based turnkey approach company expanded its data management presence
seems like it would be too specific and restrictive,” in a big way with its mid-2010 acquisition of Sybase
their risks says Stephen Parks, IT manager at Absolute Analysis, Inc. At the time, SAP had already developed SAP
and maximize a manufacturer of test equipment. “You’d be locked HANA®, an in-memory database optimized for near-
their rewards into the hardware the vendor chooses, and it would instantaneous access to and analysis of real-time
probably cost more. I also wouldn’t want a huge data and is cross-pollinating those capabilities with all
as their amount of consulting involved, due to the high cost.” the elements in the extensive Sybase portfolio.
dependence
on access to The concerns expressed by Parks seem to be “SAP HANA represents a brand-new concept in the
shared by many of the survey respondents. By far database world,” explains VP and general manager
and analysis of the preferred approach to data management was Lucas. “It delivers a consolidated database and
real-time data to adopt an integrated software platform. This column-based analytics engine. Before, you had
skyrockets. approach isn’t tied to specific hardware and usually to break out analytics, warehousing and prediction
relies on adherence to open standards to provide a from the relational database. SAP HANA enables you
software platform that can be easily expanded and to collapse the data management universe into a
integrated with solutions from one or more vendors. more efficient form.”
Nearly two-thirds of the survey respondents found
the integrated software approach to be either SAP’s open, standards-based integrated platform
extremely or very appealing. This approach—which approach to data management and the company’s
offers cost-effectiveness, flexibility and adaptability, highly optimized and efficient technology provide an
which are greatly prized by nearly every corporate attractive blend of high performance, easy integra-
executive—proved particularly attractive to senior tion and low TCO—right in line with the needs and
IT, with 70 percent of this group ranking it highly. objectives highlighted by the IDG Research Services
survey. SAP’s ability to leverage both SAP HANA and
When it came to the custom-built category, a the various Sybase products is equally important in
divergence was revealed between the respondent providing access to and analysis of real-time data for
groups. Some 35 percent of the midlevel IT survey virtually any data management applications.
participants identified custom solutions as extremely
or very appealing, whereas just 28 percent of the The scope of capabilities SAP has marshaled proves
senior IT respondents gave this category one of these that solutions exist to not only meet but also exceed
top two rankings. It’s possible that more midlevel today’s data management needs. When shortcom-
IT managers find the custom approach appealing ings fall in the most critical areas and real-time, next-
because their ability to perform custom development generation applications outpace the capabilities of
themselves is often a central part of their job as well many legacy data management systems, it becomes
as an important résumé enhancer. clear that the status quo just isn’t good enough.
Of course, no significant IT change is without
Delivering on Real-Time, risk—and that is certainly the case when it comes
Integrated Data Management to altering or even replacing essential data manage-
ment systems. But, increasingly, the riskiest strategy
In aggregate, the IDG Research Services study paints is to do nothing or to push a legacy system beyond
a fairly comprehensive and consistent picture of the its comfort zone. By relying on open, integrated data
current data management landscape and its coming management platforms, organizations can mini-
evolution. Organizations will always want to keep mize their risks and maximize their rewards as their
their capital and operational expenses at a minimum, dependence on access to and analysis of real-time
regardless of the state of the economy, but they are data skyrockets.