90% of Enterprises are Using DataOps. Why Aren’t You?
•3 likes•925 views
Report
Share
Download to read offline
It’s no secret that data is your most valuable asset. But if not managed and secured properly, it can be your biggest liability. Data is exploding across the business and everyone in the company wants - no needs - immediate, continuous access to innovate, analyze and understand customer behavior. Compound this with wide-sweeping data privacy regulations and the process is slowed even more. In a world where every company is a data company, how will enterprises ensure the fast, secure delivery of data? The answer, as many of the world’s most important brands already know, is DataOps. According to new findings by 451 Research, nearly 90% of respondents plan to increase investment in DataOps strategies and platforms and 92% of enterprise respondents agreed that improved DataOps would have a positive impact on their organization’s success.
Recommended
More Related Content
What's hot
What's hot(20)
Similar to 90% of Enterprises are Using DataOps. Why Aren’t You?
Similar to 90% of Enterprises are Using DataOps. Why Aren’t You?(20)
More from Delphix
More from Delphix(20)
Recently uploaded
Recently uploaded(20)
90% of Enterprises are Using DataOps. Why Aren’t You?
- 1. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. DataOps: the foundation for agility, security and transformational change Matt Aslett, Research VP, Data, AI & Analytics 27 March 2019
- 2. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. 451 Research is a leading IT research & advisory company Founded in 2000 250+ employees, including over 120 analysts 1,000+ clients: Technology & service providers, corporate advisory, finance, professional services and IT decision-makers 2,000+ technology & service providers under coverage 451 Research and its sister company, Uptime Institute, are the two divisions of The 451 Group Headquartered in New York City, with offices in London, Boston, San Francisco, Washington DC, Austin, Mexico, Costa Rica, Brazil, Spain, UAE, Russia, Taiwan, Singapore and Malaysia
- 3. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. Agenda Conclusions What is DataOps? Why DataOps? DataOps Benefits
- 4. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. Conclusions ► Companies that are already engaged with DataOps overwhelmingly agree that it is having a positive impact on their organization. ► While improved agility and efficiency are closely associated with DataOps, the biggest driver, priority and benefit is related to security and compliance. ► Enterprises that have adopted DataOps are more advanced in terms of transitioning to the cloud and executing digital transformation strategies – as such they are better-placed to gain competitive advantage. ► DataOps adopters are enjoying benefits to the extent that they are doubling- down to invest even further in products, services and process and organizational change. ► As such, while it is relatively unknown as a mainstream term today, DataOps can be expected to have a growing impact on the market in the coming years. ► DataOps is a vehicle for driving agility, security and transformational change
- 5. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. Respondents: DataOps Maturity Q. What level of DataOps maturity best characterizes your organization? 5% 3% 34% 37% 21% Low Maturity – No DataOps strategy in place Nascent – Are piloting DataOps technologies and processes Emerging – A DataOps strategy is being defined Accelerated – DataOps technologies and initiatives are scaling across multiple departments Optimized – DataOps is ingrained in company culture n=150
- 6. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. The positive impact of DataOps Q. To what extent do you agree or disagree with the following statement: ‘Improved DataOps would have a positive impact on my organization's success.’ n=150 1% 0 1% 6% 9% 38% 45% 0% 10% 20% 30% 40% 50% Disagree strongly Disagree Disagree somewhat Neutral Agree somewhat Agree Agree strongly
- 7. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. DataOps driving organizational/process change Q. To what extent will your organization change its processes, organizational structure, or training/consulting to improve DataOps in the next 12 months? 38% 51% 10% 1% Significant change Moderate change Slight change No change n=150
- 8. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. DataOps investment plans Q. How would you characterize your organization’s spending, investment, or development on DataOps technologies in the next 12 months 41% 45% 11% 1% 2% Significant increase Slight increase Remain the same Slight decrease Significant decrease n=150
- 9. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. 451RESEARCH.COM ©2018 451 Research. All Rights Reserved. What is DataOps?
- 10. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. 451RESEARCH.COM ©2018 451 Research. All Rights Reserved. “DataOps is the alignment of people, process and technology to enable more agile and automated approaches to data management. DataOps aims to provide easier access to data to meet the demands of various stakeholders who are part of the data supply chain (including developers, data scientists, business analysts, DevOps professionals, etc.) in support of a broad range of use cases.” 4 5 1 R E S E A R C H
- 11. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. 451RESEARCH.COM ©2018 451 Research. All Rights Reserved. Why DataOps?
- 12. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. Data Management Challenges Q. What are the primary data management challenges faced by your organization? (Select all that apply) 33% 36% 39% 42% 42% 43% 44% 51% 60% 68% 0% 10% 20% 30% 40% 50% 60% 70% 80% Data sprawl Access to external data Data format complexity Understanding data privacy/compliance… Data delivery/provisioning Data pipeline reliability Access to internal data Management/governance of distributed data Data quality Data security n=150
- 13. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. Data Growth Per Day Q. How fast would you estimate your data is growing per day? 1% 8% 18% 29% 19% 12% 13% <500MB 500MB-1GB 1GB-100GB 100GB-500GB 500GB-1TB 1TB-2TB 2TB+ 0% 5% 10% 15% 20% 25% 30% 35% n=150
- 14. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. Number of People Involved in Data Provisioning Q. How many different individuals (e.g. system admin, storage admin, DBA) are involved in the data provisioning process? 1% 9% 24% 23% 16% 26% 1% One Two Three Four Five More than five Don’t know 0% 5% 10% 15% 20% 25% 30% n=150
- 15. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. Time to provision a new data environment Q. How long does it take, on average, for your organization to provision a new data environment for development, QA, BI, or other use cases? 5% 17% 47% 17% 14% Less than a day 1-3 days 4-5 days 6-7 days More than one week n=150
- 16. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. Impact on Efficiency, Productivity, Speed Q. To what extent do you agree or disagree with the following statement: ‘Lack of access to the right data negatively impacts organizational efficiency, productivity, and/or speed.’ 1% 3% 2% 10% 19% 37% 28% 0% 10% 20% 30% 40% Disagree strongly Disagree Disagree somewhat Neutral Agree somewhat Agree Agree strongly n=150
- 17. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. Securing Data for Sharing is a Concern Q. To what extent do you agree or disagree with the following statement: ‘Securing data shared with internal and external users is a concern within my organization.’ 1% 1% 4% 9% 17% 39% 29% 0% 10% 20% 30% 40% Disagree strongly Disagree Disagree somewhat Neutral Agree somewhat Agree Agree strongly n=150
- 18. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. 451RESEARCH.COM ©2018 451 Research. All Rights Reserved. DataOps Benefits
- 19. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. DataOps Drivers Q. What is driving organizational focus on DataOps? (Select all that apply) 1% 51% 52% 55% 63% 65% 0% 10% 20% 30% 40% 50% 60% 70% 80% Other Need for greater business agility and speed The introduction of innovative, application Business demands for cost reduction/ROI Demands from IT to improve operational efficiencies Security and compliance concerns n=150
- 20. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. Culture/Process DataOps Priorities Q. What are your priorities in terms of DataOps culture and process? (Select all that apply) 1% 42% 57% 57% 60% 61% 0% 10% 20% 30% 40% 50% 60% 70% 80% Other Buy-in from leadership and management Organizational responsiveness and support for development Greater collaboration and alignment across functions Smoothly introducing new tools and methodologies (cloud, DevOps, containers, etc.) More secure and compliant processes n=150
- 21. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. DataOps Business Benefits Q. What do you perceive to be the business benefits of DataOps to your organization? (Check all) 42% 49% 54% 55% 63% 66% 0% 10% 20% 30% 40% 50% 60% 70% 80% Cross-functional alignment Cost reduction / operational efficiency The introduction of innovative, application- driven business capabilities More business insight / improved decision making Increased business agility and faster time to market Greater security and compliance n=150
- 22. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. Activities Benefit From Improved DataOps Q. Which of the following activities would benefit from improved DataOps? (Check all that apply) 41% 41% 53% 59% 59% 63% 63% 65% 0% 10% 20% 30% 40% 50% 60% 70% 80% Reporting Archiving Artificial Intelligence / Machine Learning Development and Testing Compliance / Risk Management Backup / Disaster Recovery BI/Analytics Cloud Migration n=150
- 23. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. 451RESEARCH.COM ©2018 451 Research. All Rights Reserved. 451 Take
- 24. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. 451 Take ► While the concept of DataOps is most associated with operational efficiencies, those efficiency, improvements are not just related to agility, but also to security and transformational change. ► Companies that are already engaged with DataOps overwhelmingly agree that it is having a positive impact on their organization, and while improved agility and efficiency are closely associated with DataOps, the biggest driver, priority and benefit is actually related to security and compliance. ► Those enterprises that have adopted DataOps are more advanced in terms of transitioning to the cloud and executing digital transformation strategies – and as such they are better- placed to gain competitive advantage over their rivals. ► In addition, the early adopters of DataOps are enjoying benefits to the extent that they are doubling-down to invest even further in products and services as well as process and organizational change. ► As such, the survey results reinforce our view that while it is still relatively unknown as a mainstream term today, DataOps can be expected to have a growing impact on the wider market in the coming years.
- 25. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. 451research.com US +1 212.505.3030 EUROPE +44 (0) 203 929 5700 Thank you @451Research New York London Boston Washington, D.C. San Francisco @maslett
- 26. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. 451RESEARCH.COM ©2018 451 Research. All Rights Reserved. Demographics
- 27. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. Respondents by number of employees 39% 31% 30% 1,000 – 4,999 employees 5000-9,999 employees 10,000+ employees Q. Approximately how many employees work in your entire organization? Please include all subsidiaries, divisions and branches worldwide. n=150
- 28. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. Respondents by Industry n=150 Q. What is the primary industry of your business? 3% 7% 11% 13% 15% 15% 17% 18% Telecom/Media Insurance Government / Public Sector Retail Manufacturing Technology Healthcare Banking and Financial Services 0% 2% 4% 6% 8% 10% 12% 14% 16% 18% 20%
- 29. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. Volume of data under management Q. Approximately how much data does your organization have under management? n=150 27% 37% 37% 2PB-5PB 5PB-10PB 10PB+
- 30. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. Respondents by Role n=150 Q. Which of the following functions best describes your role at work? 2% 3% 4% 5% 6% 6% 6% 7% 8% 9% 10% 13% 14% 0% 5% 10% 15% 20% DBA Developers BI Director DataOps Director VP Application Development Senior Architect VP BI Director Application Development Director DevOps QA Database engineer Senior Development Manager IT Ops Director
- 31. 451RESEARCH.COM ©2019 451 Research. All Rights Reserved. Digital Transformation Maturity Q. How would you characterize your organization’s level of maturity with respect to digital transformation? n=150 67% 28% 5% Execution. We have a formal strategy and are actively digitizing our business processes and/or assets Evaluation. We are planning and researching to develop a digital transformation strategy Consideration. We are considering it but have no formal plans No strategy. We currently have no ongoing digital transformation strategy(None)
Editor's Notes
- The circle marker can be dragged up or down the vertical bar to designate position in the Agenda, and bolding should be changed accordingly. Make sure circle marker is centered in front of bolded Agenda text item.
- 451 Research’s DataOps Survey was conducted in October 2018 with 150 representatives of North American organizations with more than 1,000 employees and a minimum of 2PBs of data under management who had a solid understanding of their organization’s data management strategy. We deliberately targeted companies that are already engaged with DataOps. 21% declared themselves Optimized (with DataOps ingrained in company culture), while 37% saw themselves as Accelerated (with DataOps technologies and initiatives across multiple departments), and 34% Emerging (in the process of defining a DataOps strategy). Only 3% considered their level of DataOps maturity to be Nascent (piloting DataOps technologies and processes), while 5% admitted to being of Low Maturity (with no DataOps strategy in place).
- Almost all respondents – 92% – agree to some extent with the statement that improved DataOps would have a positive impact on their organization’s success.
- 89% of respondents expect to significantly or moderately change their processes, organizational structure or training/consulting to improve DataOps in the next 12 months.
- 86% of respondents plan to increase spending, investment or development effort on DataOps technologies in the next 12 months.
- DataOps is about reducing the complexity involved in data provisioning and enabling self-service access to data in order to accelerate the development of data-driven applications and data-driven decision-making, as well as supporting business agility in response to rapidly changing business requirements A key element of this is reducing ‘data friction,’ which arises when the demands of data consumers (such as data analysts, developers and senior decision-makers) are not met by data operators (e.g., data management and IT professionals). As an umbrella term, DataOps can refer to a range of related technologies and processes, and is as much about cultural and organizational change as it is about the adoption of emerging data management products and services. For the purposes of this paper and its associated survey, DataOps is defined as:
- 451 Research believes that an agile approach to data management is critical if enterprises are to realize the benefits of investing in data processing and analytics technologies to develop new applications that deliver improvements in operational efficiencies and competitive advantage to drive transformational change. Being data-driven is a goal for most enterprises, but is more difficult to achieve in practice given the need to balance the requirements of various users (data analysts, data scientists, developers, IT operations and business executives for example) and sometimes competing requirements (such as agility, security, privacy and compliance One of the most significant challenges that organizations face as they seek to become more data-driven relates to the data itself: how to manage and govern it in an efficient manner to deliver the desired benefits. This is an age-old challenge, but one that is made more complicated by the increasing pace and volume at which data is generated.
- Our DataOps Survey results indicate that data management is not a single challenge, per se, but encapsulates a range of challenges (see Figure 2). The most significant of these, according to our survey respondents, is security, which was cited by 68% of respondents as a data management challenge, followed by data quality (60%) and the management/governance of distributed data (51%). Individually, each of these factors is a significant challenge. Data security is a perennial concern, of course, while addressing data quality is essential if organizations are to ensure they are making decision based on accurate data. However, these factors do not occur in isolation. Survey respondents selected, on average, 4.7 different options as the primary data management challenges faced by their organizations. It is the confluence of this range of factors – including not just data security, quality and distributed management, but also data access, data provisioning, data privacy and data sprawl, along with reliability and data format complexity – that makes data management so challenging.
- One of the primary trends shaping the data processing and analytics market in recent years has been the growth of data. This has driven the adoption of emerging data platforms and analytics techniques, and it has also been accelerated by the use of more economical data storage and processing products and services – which has enabled enterprises to store and process data that was previously ignored. Our DataOps Survey results illustrate the continuing challenge in relation to the growth of data, the growing number of data sources, and a growing range of data processing locations (see Figure 3). In terms of data growth: 29% of respondents stated that their organization’s data is growing at between 100-500GB per day, with 19% reporting growth between 500GB-1TB per day, 12% between 1TB-2TB per day, and 13% reporting data growth in excess of 2TB per day. While traditionally enterprises had to deal with multiple relational database providers, perhaps with a few specialist nonrelational databases, the growth of NoSQL and Apache Hadoop means that many enterprises are now having to deal with a plethora of data platforms In addition to the growing number of data platforms, the growing range of data processing locations is also a challenge, and one that is likely to grow as a greater volume of data processing and storage occurs in cloud computing platforms.
- While storing, processing and analyzing greater volumes of data brings potential advantages in terms of greater business intelligence, more data also means more data management challenges. This is particularly true in relation to provisioning and managing data management environments: while agile development and DevOps practices mean that enterprises are able to develop and provision new application environments at a much faster rate than ever before, the provisioning of data to support those applications remains a bottleneck to operational efficiencies. Two-thirds of survey respondents currently have four or more individuals involved in the data provisioning process, and those with the greater data growth require more participants: 42% of respondents with data growing at more than 1TB per day have more than five people involved in the data provisioning process, compared with 26% of all respondents.
- Additionally, 78% of survey respondents indicated that it takes their organization four days or more to provision a new data environment, and those with the greatest data growth face greater delays: 21% of respondents with data growing more than 1TB per day take more than a week to provision a new data environment, compared to 14% of all respondents
- Complexity in the provisioning of data isn’t just a data management headache: it also has significant implications in terms of business efficiency and productivity, as well as data security. According to the survey results, 65% of respondents agree (37%) or strongly agree (28%) that lack of access to the right data negatively impacts organizational efficiency, productivity and/or speed.
- In particular this can lead to challenges with regard to sharing data – either internally with employees, or externally with customers and partners – and 68% of respondents agree (39%) or strongly agree (29%) that securing data shared with internal and external users is a concern within their organization.
- While DataOps is closely associated with agility and operational efficiency, the survey results also indicate that DataOps has the potential to help alleviate security and compliance as cross-functional concerns related to data management. In fact, concern about security and compliance is actually the number one driver for focusing on DataOps, cited by 65% of respondents. While this is in keeping with security being the number one data management challenge (see ‘Impact of DataOps’ above), it is still interesting that security and compliance concerns score higher than improved operational efficiencies (63%), cost reduction/ROI (55%), the introduction of innovative, application-driven business capabilities (52%), and the need for greater business agility and speed (51%). The fact that all of these responses were cited by more than half of survey respondents illustrates that DataOps is a multifaceted initiative that is by no means solely focused on agility. The
- The list of priorities in terms of DataOps culture and processes tells a similar story. Again, security topped the list, specifically more secure and compliant processes (61%), while the smooth introduction of new tools and methodologies was cited by 60% of respondents, followed by greater collaboration and alignment across functions (57%), as well as organizational responsiveness and support for development (also 57%).
- In relation to perceived business benefits of DataOps, security is again top of mind with two-thirds of respondents citing greater security and compliance, followed by increased business agility and faster time to market (63%), as well as greater business insight and improved decision-making (55%), and the introduction of innovative, application-driven business capabilities (54%).
- respondents perceive that there are a range of business activities that could benefit from DataOps. These include cloud migration (cited by 65% of respondents), business intelligence/analytics (63%), and backup and recovery (63%), as well as compliance and risk management (59%), development and testing (59%), and also artificial intelligence and machine learning (63%).
- Organizations ‘Optimized’ for DataOps Are more advanced in terms of digital transformation: 94% are executing digital transformation (versus 67% of all respondents)