Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
MicroStrategy The BI Survey 13
1. SUMMARY RESULTS FROM
The BI Survey is the most comprehensive independent survey of the on-line analytical processing and business intelligence market
This summary of the major result categories of The BI Survey 13 results was produced by MicroStrategy with full approval by BARC.
THE
BI SURVEY 13
3. TABLE OF CONTENTS
Overview of The BI Survey 13 Page 3
Are The BI Survey 13 results consistent with the trends
from the prior 11 years? Page 3
Are the differences between the mega-vendors and
an independent vendor like MicroStrategy significant? Page 4
Are the differences between the specialty vendors and
an independent vendor like MicroStrategy significant? Page 4
How important is product response time and performance? Page 4
How should organizations select products? Page 4
The BI Survey 13 summary results Page 4
Business value Page 5
Mobile BI Page 5
Innovation Page 6
Advanced information design Page 7
Product performance Page 8
Data volume Page 8
Product satisfaction Page 9
Vendor relationship Page 10
Vendor support Page 10
Conclusion Page 11
For more information about The BI Survey 13, please visit: www. bi-survey.com
4.
5. THE BI Survey 13 - Summary Results
3
SUMMARY RESULTS FROM THE BI SURVEY 13
The BI Survey is the world’s most comprehensive independent survey of the business intelligence (BI) market space and products and is
conducted annually by the Business Application Research Center (BARC). The BI Survey 13 follows eleven successful editions of The BI
Survey. It is important to note that last year the numbering of The BI Survey has changed so that The Survey number now aligns with
the year in which the data was collected.
Overview of The BI Survey
The Survey is the largest and most thorough fact-based analysis of the BI
market currently available, using 12 years of experience to analyze market
trends and debunk many myths surrounding the BI industry.
The BI Surveys provide insight into actual BI implementation experiences
as well as the usage patterns and technical characteristics of the most
popular BI products. The BI Surveys examine how companies choose
their BI products, how they use these products, and how successful they
are with them. The Survey is also notable in that it takes on challenging
issues not covered by typical BI product reviews, such as barriers to wider
deployments and factors leading to product discontinuance. As a result,
the Survey is uniquely positioned to detail BI purchasing and deployment
best practices.
The BI Survey conclusions are solely based on statistical analysis of
information provided by respondents who have delivered business
benefit. This year, statistically-significant data was collected for 30 different
BI products. This edition has increased the range of products reviewed. It
includes not just products from well-known BI giants, but also specialist
tools from much smaller vendors and open source vendors. Each of these
30 BI products was analyzed across 28 Key Performance Indicators (KPIs).
Products analyzed in The BI Survey 13, listed in alphabetical order
and including the number of responses per product, were: arcplan
(98), Bissantz (92), BOARD (74), Corporate Planning (34) Cubeware
Cockpit (88), Cyberscience (60), Dimensional Insight (61), Evidanza
(29), IBM Cognos BI (96), IBM Cognos TM1 (51), Infor (85), Information
Builders (52), Jedox (127), Logi Analytics (41), Microsoft Excel (44),
Microsoft SSAS (145), Microsoft SSRS (50), MicroStrategy (128), Oracle Essbase
(54), Oracle BI Foundation Suite (47), Pentaho (36), Phocas (68), Pyramid
Analytics (45), QlikTech (178), SAP BO Webl (71), SAP BW (103), SAS (36),
Tableau (48), TARGIT (62), Yellowfin (30) and Others (133).
This BI Survey 13 Summary, prepared by MicroStrategy using BARC’s results
and charts, focuses not only on the six largest BI platform vendors, including
MicroStrategy, SAP Business Objects, SAP BW, Oracle BIEE, IBM Cognos, and
Microsoft SSRS to make direct comparisons within a like group of vendors
typically considered for similar types of BI applications but also the specialty
vendorsTableau and QlikTech to compare visual data discovery capabilities
and to account for multiple product offerings within a product suite.
The BI Survey is 100% independent of any BI vendor influence and is not
commissioned, funded, suggested, or sponsored by vendors in any way.
Vendors have no input into the questions or into the analysis of Survey
results. Therefore, business intelligence consumers can be reassured that
the survey accurately reflects real-world experiences of individuals in
companies like theirs and is free from vendor influence and author bias.
In total, 3,149 people responded to The Survey with 2,298 answering a
series of detailed questions about their usage of a named product.
The KPIs are calculated so that better-than-average products always have
scores of greater than 1.0, while less good products score less than 1.0.
When viewing the peer group KPI charts, note that the average for each
peer group will usually be either higher or lower than 1.0 because the peer
groups are all subsets of the overall sample.
The products are sorted by value, the better the product the higher
the value. The average is displayed as a green bar and separates
the products into two groups, the ones that have performed
better than average and the ones that have performed worse
than average.
Are The BI Survey 13 results consistent with the trends from
the prior 11 years?
Though the results range widely between vendors, most of these findings
are consistent with prior survey findings. Interestingly, the same vendors
6. 4
which outperformed in The BI Survey 13 have outperformed in the market
over the previous eleven years. Similarly, the set of vendors who did not
generally perform well this year have also not fared well in the past eleven
years of the survey.
Specifically, MicroStrategy has scored at, or been very close to, the
top in Data Volume, Mobile BI, Innovation, Business Benefit, Vendor
Support, and Product Quality/Satisfaction and across all Scalability and
Performance categories for eleven years running. In contrast, SAP BO
has been at or near the bottom in these same categories over the same
twelve-year time frame.
Are the differences between the mega-vendors and an
independent vendor like MicroStrategy significant?
Based on the survey results, significant differences exist between the mega-
vendors and an independent vendor like MicroStrategy. As an independent
or “best-of-breed”vendor MicroStrategy is wholly focused on BI, optimized
for open system solutions and has been developed completely organically.
Conglomerate or“mega-vendors”are vendors such as SAP BO, IBM Cognos,
Oracle and Microsoft that offer a full enterprise software stack and optimize
their BI offerings for their software stack and grow by acquisition.
This document will show that the mega-vendors often score lower than
independent vendors like MicroStrategy. Furthermore, MicroStrategy
outperformed the conglomerate vendors in most key areas such as Data
Volume, Mobile BI, Innovation, Business Benefit, Product Satisfaction,
Support Quality, Query Performance, Advanced Information Design and
Recommendation among others.
Are the differences between the specialty vendors and an
independent vendor like MicroStrategy significant?
Based on the survey results, significant differences exist between specialty
vendors like Tableau and QlikTech and an independent vendor like
MicroStrategy.MicroStrategyoffersagilityandexcellentvisualdatadiscovery
capabilitiesalongwithgovernance.ThisdocumentshowsthatMicroStrategy
outperformed Tableau and QlikTech in key areas like Investment,
Data Volume, Mobile BI, Product Satisfaction, Chosen as Standard and
CompetitiveWin Rate.
How important is product response time and performance?
The BI Survey 13 looked closely at the impact of query performance and
found, as in every year the survey has been conducted, the most frequently-
reported product problem continues to be poor query performance. If users
have to wait too long every time they run a query, they become frustrated
and user adoption is poor. As expected, The BI Survey 13 also found that
fast query performance continues to be amongst the most frequently
cited selection criteria for software. According to The BI Survey 13, “sites
that used good query performance as a key selection criterion were more
successful in business terms than those that did not.”1
Organizations should
prioritize query performance as a key criterion in their vendor selection to
maximizeoverallprojectsuccess.AsBARCsays,“…Mostparticipantsfocused
instead on criteria such as‘functionality‘ (47 percent),‘ease-of-use for report
recipients’ (42 percent), ‘fast query performance’ (36 percent) and ‘ease-of-
use for report designers’(34 percent).”2
This continues to remain equally valid
inThe BI Survey 13.
How should organizations select products?
The BI Survey 13 looked at the impact of multi-product competitive
evaluations on project success. Once again, BI projects based on a multi-
product competitive evaluation and selection process achieve far more
business benefits than those based on a single product selection or
no formal product evaluation. Vendors such as SAP Business Objects
and Oracle, which are selected most often for corporate reasons, such
as product bundling, without a multi-product competitive evaluation
achieve low scores in all of the business benefit and project success
areas analyzed.
The BI Survey 13 Summary Results
This document evaluates MicroStrategy against different peer groups like
Competitive peer group, Large International Vendors, Dashboard Vendors
and the specialty vendors QlikTech and Tableau. The Competitive peer
group is a custom peer group and represents the set of products that are
typically considered for similar types of enterprise BI applications. It consists
of the following vendors: MicroStrategy, SAP Business Objects, IBM Cognos,
Oracle OBIEE, Microsoft SSRS, SAP BW. There is also a comparison with the
specialty vendors QlikTech and Tableau who offer dashboarding and visual
data discovery capabilities.The document evaluates the peer groups across
a number of the KPIs analyzed in The BI Survey 13. The KPIs presented here
aregroupedintothreecriticalareastoallowthereadertoquicklyassesshow
the BI platform products perform in real-world deployments:
• BusinessValue
• Product Performance
• Vendor Relationship
1 BARC “The BI Survey 13 The Results” by Melanie Mack and Dr. Carsten Bange, January, 2014
2 BARC “The BI Survey 13 Best Practices” by Melanie Mack and Dr. Carsten Bange, January, 2014
13. THE BI Survey 13 - Summary Results
11
Conclusion
The BI Survey 13, the leading independent survey of real-world BI
implementations provides unique, statistically significant insight into actual
BI implementations and customer experiences with various BI products.
The results of the survey provide an important guide to the product
capabilities and support that users can expect from the various vendors.
Survey respondents are both critical and candid in their assessments. Since
the choice of a BI product has a significant impact on overall BI project
success, it is recommended that meaningful product evaluations, starting
with a close review of the product benchmarks in The BI Survey 13, should
be conducted when embarking on new BI projects.
Notable in The BI Survey 13 results are the widely varying customer
experiences and product results among the BI products. Some of the many
categories in which clear vendor trends have emerged over the past twelve
years include:
• DataVolume
• Vendor Support
• Innovation
• Mobile BI
• Chosen as a Standard
• Investment
• Product Satisfaction
• CompetitiveWin Rate
In the above categories, for the select peer group, MicroStrategy has
consistently been a leader, sometimes by a wide margin, in the twelve
years The BI Survey has been conducted. MicroStrategy ranked first in
Data Volume, Mobile, and Innovation among large international vendors
in a comprehensive survey of companies using business intelligence
software products.
In addition to achieving high ratings in the large international vendor peer
group, MicroStrategy also achieved high ratings in Dashboard vendor
peer group.
“Over a number of consecutive BI Surveys, MicroStrategy has consistently
scored at or near the top of its peer group in Data volume, Performance,
Mobile and Innovation. This trend has continued in The BI Survey 13.
This is a reflection of MicroStrategy’s continued focus on the quality and
performance of the platform as well as its dedication to innovation,” said
Dr. Carsten Bange, Founder and CEO of BARC. He added, “The results of
The BI Survey match closely with BARC’s field experience. MicroStrategy is
one of the top vendors in query performance, user satisfaction, and mobile
support. It also shows it can compete not only with the big vendors but
also in the Ad-hoc Analysis and Dashboard peer groups with smaller and
specialized products”.
Melanie Mack, co-author ofThe BI Survey, stated:“I attribute MicroStrategy’s
continued high rankings in The BI Survey to its focus on maintaining the
integrity and quality of its unified platform. In addition, the company
continues to be at the forefront of new functionality.”