5 Factors in Modern Data Design

Dan Sexton
Dan SextonIntrapreneur, IoT & Analytics at redchipventures.com
Modern Data Strategy
By Dan
5 Design Factors
Daniel Sexton, Red Chip Ventures© 2017
Audience
2
Ideas
For
Data
Strategy
Non-technical executives, tech-savvy managers
and technical people who want fresh ideas and
perspectives on modern enterprise data strategy
and design.
Daniel Sexton, Red Chip Ventures© 2017
Abstract
3
Ideas
For
Data
Strategy
Abstract: As infrastructure and services rapidly
commoditize, IT is being asked to assume a more
strategic and proactive role in most large businesses.
This document introduces a set of concepts and tools
that may be helpful in integrating and aligning a data
strategy with the overall enterprise.
Five key factors that have proven relevant to the survival
of firms and strategies are introduced along with five
practical tools that can be used to consider integrative
strategies from a robust set of perspectives.
Daniel Sexton, Red Chip Ventures© 2017
Modern Data Strategy
Table of Contents
Laying The Foundation
1. Revisiting The Basics
2. AWS Basics
3. Design Snapshot in AWS
5 Factors in Data Strategy
1. Movement
2. Uncertainty
3. Defensibility
4. Responsiveness
5. Alignment
4
5 practical tools
to prepare for
the rise of the machines
Daniel Sexton, Red Chip Ventures© 2017
Revisit The
Basics Often
Data Strategy: A plan
designed to improve all of
the ways data is acquired,
stored, managed, shared
and used.
▪ What is truly valued at the organization?
▪ What does the competitive landscape look
like?
▪ What does the company do well?
▪ What are the strategic opportunities for
growth?
5
https://hbr.org/2015/03/why-strategy-execution-unravelsand-what-to-do-about-it
https://hbr.org/2015/01/we-still-dont-know-the-difference-between-change-and-transformation
http://dataconomy.com/2014/11/why-organizations-need-a-data-strategy/
https://www.sas.com/content/dam/SAS/en_us/doc/whitepaper1/5-essential-components-of-data-strategy-108109.pdf
Daniel Sexton, Red Chip Ventures© 2017
Why revisit the
“obvious” basics
often?
New brain research
indicates that there are two
distinct modes of thinking--
focused and diffuse.
The transition between
modes is the key to
creativity and productivity.
1. Brain Science:
Breakthrough ideas are more
likely to come during casual
reflection after new
technologies and information
have been absorbed.
6
Source Prof Barbara Oakley :http://tdlc.ucsd.edu/educators/educators_webinar_oakley_031213.html
NIH Study: https://www.ncbi.nlm.nih.gov/pubmed/24904169
The Innovator’s Mindset: http://georgecouros.ca/blog/archives/5715
Science of Creativity: https://blogs.scientificamerican.com/beautiful-minds/the-real-neuroscience-of-creativity/
Focused Diffuse
Prefrontal cortex, concentrated Diffused, dispersed
Writing code, spreadsheets Big picture, mind wanders
Deadlines, functionality,
complexity
Revisit basics, reflection,
simple solutions, more with less
Daniel Sexton, Red Chip Ventures© 2017
Why revisit the
“obvious”
basics often?
According to research, it is
not possible to be in both
thought modes at the
same time.
Planning activities that
encourage relevant modes
of thinking at different
stages may lead to more a
effective dynamic.
7
Implementation & Execution: https://hbr.org/2015/03/defining-strategy-implementation-and-execution
5 Pillars of Strategy: https://www.cebglobal.com/blogs/the-five-pillars-of-strategy-execution/
Strategy
Analysis
Strategy
Formation
Strategy
Execution
Measure & Observe
Results
Daniel Sexton, Red Chip Ventures© 2017
No plan
survives this
More
Diffuse
Thought
More
Focused
Thought
Why revisit the
“obvious”
basics often?
Modern strategies
are integrative
2. Collaboration helps strategy
8
70% fail: https://www.forbes.com/sites/insead/2016/01/08/five-reasons-most-companies-fail-at-strategy-execution/#e0ef3c33480a
Strategy Execution: https://hbr.org/2015/03/why-strategy-execution-unravelsand-what-to-do-about-it
4A Model: https://ideas.darden.virginia.edu/2015/09/beyond-strategy-three-lessons-and-four-ingredients-of-execution/
According to research, at least 70% of
corporate strategies fail. Strategy execution
often breaks down across departments.
Revisiting basics provides a common
ground that people with diverse
backgrounds can understand and contribute
to.
This can facilitate communication,
teamwork, and a collaborative culture which
can improve strategic analysis, formation
and execution.
Strategy
Analysis
Strategy
Formation
Strategy
Execution
Daniel Sexton, Red Chip Ventures© 2017
Why revisit the
“obvious” basics
often?
3. Discretion is key
▪ Change often happens faster than execution
▪ > 60% of IT projects fail
9
Source: https://www.linkedin.com/pulse/why-45-all-software-features-production-never-used-david-rice
50% fail: http://www.cio.com/article/3068502/project-management/more-than-half-of-it-projects-still-failing.html
Daniel Sexton, Red Chip Ventures© 2017
Industry
Trends
10
MicroservicesMonolith
CloudOn-Premises
Daniel Sexton, Red Chip Ventures© 2017
Industry
Trends
11
Microservices
Cloud
Daniel Sexton, Red Chip Ventures© 2017
?
?
Industry
Trends
Getting too far
ahead…
12
?
?
Daniel Sexton, Red Chip Ventures© 2017
???
???
Monolith to
Microservices
Cloud platforms
encourage
modern design
such as
microservices.
i.e. AWS Lambda
coerces serverless,
microservices
13
Monolith Microservices
Scaling
Vertical
Harder
Expensive
Horizontal
Simpler
Cheaper
Release Cycles
2-6 weeks,
Error-prone
1-7 days
Decoupled
Deployment
Model
Simple, Unified Discrete
Design
Contracts
Refactoring Large Codesets Strong Module Boundaries
Degradation
Binary Failure
100% Limits- CPU, Memory,
Disk
Graceful
AWS Lambda, S3
Adapting
Technologies
Technology Monoculture Technology Diversity
Teams
Larger, Diffuse Responsibility
- UI Team
- App Logic Team
- DBA Team
Smaller, More Vertical
- Accounts Team
- Personalization Team
- Mobile Team
Strangling the Monolith: https://developer.ibm.com/tv/microservices-tv-episode-16-strangling-monolith/
Monolith to Microservices: https://www.nginx.com/blog/refactoring-a-monolith-into-microservices/
Microservices: http://microservices.io/patterns/microservices.html
https://www.youtube.com/watch?v=oRIYtOsAlzk - Monolith to Microservices, AWS Daniel Sexton, Red Chip Ventures© 2017
Modern Data
Design
Overview
Some
Key
Activities
14
Source
Data
Analytics &
ETL
Data
Ingestion
Business
Intelligence
Analytics
Data
Onsite
Data
Metadata &
Delta
Capture
Service
Discovery
Lifecycle
Management
Data Governance
Daniel Sexton, Red Chip Ventures© 2017
Modern Data
Design using
AWS
Current
Snapshot
See Index
15Daniel Sexton, Red Chip Ventures© 2017
5 Factors in a
Modern
Data
Strategy
the machines are coming
16
Movement Defensibility
Uncertainty
Alignment
Agility
Daniel Sexton, Red Chip Ventures© 2017
Factor 1
Movement
17
Movement
Movement is the changing of
technology, its place in the
business cycle, and its use
and adoption. The best
strategies and designs
anticipate movement.
● Commoditization
● Convergence
● Technology Adoption
Daniel Sexton, Red Chip Ventures© 2017
Commoditization
is the process by which
technologies that are at
first innovations-- scarce,
expensive and
distinguishable -- become
commodities-- ubiquitous,
inexpensive, homogenous,
interchangeable.
This curve depicts the path
that all business activities
follow from inception to
commodity.
18
Movement
As value chain components move
up commoditization curve, the
associated project loses strategic
value.
Innovation
Commodity
Inputs
Highly
Differentiated
Products
Strategic
Advantages
Less
Differentiated
Products
Services,
Commodities
Buy,
Outsource,
Cheap
Build,
Assemble,
Higher Costs
Prevalence
Maturity
Moore’s Chasm
Daniel Sexton, Red Chip Ventures© 2017
Agile
Six Sigma
Geoffrey A. Moore, Crossing the chasm (Chichester: Capstone, 1998).
Rogers, Everett M. Diffusion of innovations. New York: Free Press, 2005.
The Value Chain
is the set of inputs or
components that are
used to deliver a
product or service.
Each of these components
exists somewhere along
its lifecycle on this curve.
Where these components
are on their lifecycle is
critical to overall strategy,
design, marketing and
other activities.
19
Movement
Example Project Value Chain
Prevalence
Maturity
Daniel Sexton, Red Chip Ventures© 2017
Predictive Analytics
Salesforce
Search,
Solr
IoT
Commodity
Inputs
Strategic
Advantages
Value Chain
12-18 months later
20
Movement
Competition increases as it
becomes cheaper and easier
to enter market
Prevalence
Maturity
Daniel Sexton, Red Chip Ventures© 2017
Predictive Analytics
Salesforce
Search,
Solr
IoT
Buy?
Build
Value Chain
Costs
21
Prevalence
Maturity
Daniel Sexton, Red Chip Ventures© 2017
Difficultly/Cost
Maturity
$1000
$10
$0.10
$1
Build
Buy
$100
Services, Commodities
Value Chain
Costs
22Daniel Sexton, Red Chip Ventures© 2017
Custom-built provides
competitive advantage
Costs justify the
results?
Products
cheaper/better than
building
Value Chain
Costs
Example: Big data
strategy moves into
ancillary components.
23Daniel Sexton, Red Chip Ventures© 2017
Hadoop ecosystem,
2005
Hadoop ecosystem,
2012
Hadoop ecosystem,
2020
BI driven by business
more than IT
Convergence
is the tendency for
different technological
systems to evolve
toward performing
similar tasks.
This appears to happen
when new technological
value chains emerge to
address customer needs
at a viable value
proposition level.
24
Movement
As technologies change,
different systems may
converge towards solving
similar tasks.
Daniel Sexton, Red Chip Ventures© 2017
25
Movement
Daniel Sexton, Red Chip Ventures© 2017
Technology
Adoption
refers to the adoption of
a new technology
according to the
demographic and
psychological
characteristics of
defined adopter groups.
Technology Adoption Lifecycle
Geoffrey A. Moore, Crossing the chasm (Chichester: Capstone, 1998).
Rogers, Everett M. Diffusion of innovations. New York: Free Press, 2005.
26
Movement
Daniel Sexton, Red Chip Ventures© 2017
Technology
Adoption
Custom-built IT projects
and their value chains
also have adoption
lifecycles. Where are
your projects on the
lifecycle? What type of
consumer are you?
Moore’s Chasm refers to
the marketing problem
of driving adoption
across populations
(mostly) with tech
startups.
Technology Adoption Lifecycle
Pace of Adoption: https://hbr.org/2013/11/the-pace-of-technology-adoption-is-speeding-up
IoT
Predictive
Analytics
Solr Salesforce
Factor 2
Uncertainty
Strategy, design
and organizational
structure should
handle several
possible future
scenarios.
27
Uncertainty
Trends and movement, such as commoditization,
are somewhat predictable. Other factors are not.
Technology solutions are
vulnerable to uncertain
future scenarios.
Daniel Sexton, Red Chip Ventures© 2017
28
Company-Level Examples
Daniel Sexton, Red Chip Ventures© 2017
Factor 3
Defensibility
Being big doesn’t
work anymore
29
Defensibility
Democratization of technology is
moving defensibility for large
enterprises away from
engineering costs into other areas.
Threat of substitutes and new
entrants is high as value chains
commoditize.
Data is the asset. The data itself
should be defensible.
Democratization: Amazon Data Center
Daniel Sexton, Red Chip Ventures© 2017
Defensibility: https://techcrunch.com/2016/09/15/defensibility-creates-the-most-value-for-founders/
Design, Technology and Design: https://www.bipsync.com/blog/three-moats-defensible-scalable-internet-startup/
Strategic
Data Matrix
30Daniel Sexton, Red Chip Ventures© 2017
Strategic
Data
Matrices
3 Axes
Defensibility of
Data
It should be difficult or
impossible for others to
recreate the content
and capabilities of
strategic data.
The data itself should
be defensible.
Fitness To
Modeling
The data and design
should allow for data
scientists and
statisticians to test
valid hypotheses.
Hypotheses tested
against defensible data
can provide strategic
advantages.
31
Robustness to
Strategic
Possibilities
The data and design
should be robust to an
organization’s strategy
and possible future
scenarios. Hypothesis
testing should align
with strategy.
Data & design should
allow a wide range of
viable options to be
tested and explored.
Daniel Sexton, Red Chip Ventures© 2017
Factor 4
Agility
32
Agility is the ability to adapt quickly and effectively to:
● Markets
● Competitors
● Threats, including security threats
● Technology Movement
Agility
Daniel Sexton, Red Chip Ventures© 2017
Factor 4
Agility
Market favors
those who
execute quickly.
33
Agile software development is an
important part of overall agility.
Agility
Daniel Sexton, Red Chip Ventures© 2017
Factor 5
Alignment
the machines are coming
34
Alignment
Daniel Sexton, Red Chip Ventures© 2017
Factor 5
Alignment
35Daniel Sexton, Red Chip Ventures© 2017
Time
New studies
say time is
a factor
Traditional
Alignment
Factors
McKinsey
7S
Strategy
Structure
Systems
Skills
Style
Staff
Shared
Values
Internal
&
External
Mini-
Innovation
Timelines can
be misaligned
McKinsey
Three
Horizons
Moore’s
Zone To Win
36Daniel Sexton, Red Chip Ventures© 2017
Time
Horizon 1 - 0-12 Months
Horizon 2- 12-36
Months
Horizon 3- 36-72
Months
Three Horizons:
http://www.mckinsey.com/business-functions/strategy-and-corporate-finance/our-insights/enduring-ideas-the-three-horizons-of-growt
h
Moore. 2015. "Zone To Win: Organizing To Compete In The Age Of Disruption". Slideshare.Net. Accessed June 29 2017.
https://www.slideshare.net/rstrad1/zone-to-win-organizing-to-compete-in-the-age-of-disruption.
Many companies struggle taking
Horizon 2 projects to market.
TotalReturns
Time
A common misconception is that
companies fail because they fail to
innovate.
If all of a company’s effort and
resources are tied up in
operations, disruptions will
eventually put it out of business.
Thanks!
Hope you found this SlideShare helpful in
generating ideas for your own Data Design!
Please send helpful comments and suggestions
to
Thanks! Dan
1 of 37

Recommended

Industrial IoT Market Winter 2018 by
Industrial IoT Market Winter 2018Industrial IoT Market Winter 2018
Industrial IoT Market Winter 2018Dan Sexton
2.4K views31 slides
Data Intelligence: come abilitare il valore aziendale by
Data Intelligence: come abilitare il valore aziendaleData Intelligence: come abilitare il valore aziendale
Data Intelligence: come abilitare il valore aziendaleIDC Italy
1.5K views11 slides
Cognitive/AI: views, perspectives & directions by
Cognitive/AI: views, perspectives & directionsCognitive/AI: views, perspectives & directions
Cognitive/AI: views, perspectives & directionsIDC Italy
2K views20 slides
Fujitsu World Tour 2017 - Powering Digital Transformation with Intel by
Fujitsu World Tour 2017 - Powering Digital Transformation with IntelFujitsu World Tour 2017 - Powering Digital Transformation with Intel
Fujitsu World Tour 2017 - Powering Digital Transformation with IntelFujitsu India
112 views7 slides
Le mutazioni del rischio IT nell’era della privacy e dell’intelligenza artifi... by
Le mutazioni del rischio IT nell’era della privacy e dell’intelligenza artifi...Le mutazioni del rischio IT nell’era della privacy e dell’intelligenza artifi...
Le mutazioni del rischio IT nell’era della privacy e dell’intelligenza artifi...IDC Italy
1.1K views8 slides
IoT for Organizations: Avoiding Common Pitfalls by
IoT for Organizations: Avoiding Common PitfallsIoT for Organizations: Avoiding Common Pitfalls
IoT for Organizations: Avoiding Common PitfallsMark Benson
452 views31 slides

More Related Content

What's hot

Fujitsu World Tour India 2017-Digital Co-Creation with Fujitsu by
Fujitsu World Tour India 2017-Digital Co-Creation with FujitsuFujitsu World Tour India 2017-Digital Co-Creation with Fujitsu
Fujitsu World Tour India 2017-Digital Co-Creation with FujitsuFujitsu India
215 views38 slides
L'IT che vedevamo, l'IT che vedremo: i servizi data center nell'era delle riv... by
L'IT che vedevamo, l'IT che vedremo: i servizi data center nell'era delle riv...L'IT che vedevamo, l'IT che vedremo: i servizi data center nell'era delle riv...
L'IT che vedevamo, l'IT che vedremo: i servizi data center nell'era delle riv...IDC Italy
622 views13 slides
Top10 Emerging Technologies Report (June 2016) by
Top10 Emerging Technologies Report (June 2016)Top10 Emerging Technologies Report (June 2016)
Top10 Emerging Technologies Report (June 2016)Turlough Guerin GAICD FGIA
240 views18 slides
Future of Work: dal Cosa al Come by
Future of Work: dal Cosa al ComeFuture of Work: dal Cosa al Come
Future of Work: dal Cosa al ComeIDC Italy
1.4K views23 slides
IoT And Its Manifold Business Benefits - Flexsin Inc by
IoT And Its Manifold Business Benefits - Flexsin IncIoT And Its Manifold Business Benefits - Flexsin Inc
IoT And Its Manifold Business Benefits - Flexsin IncFlexsin
30 views8 slides
Digital Transformation in COVID time by
Digital Transformation in COVID timeDigital Transformation in COVID time
Digital Transformation in COVID timeAhmad Gohar
132 views35 slides

What's hot(20)

Fujitsu World Tour India 2017-Digital Co-Creation with Fujitsu by Fujitsu India
Fujitsu World Tour India 2017-Digital Co-Creation with FujitsuFujitsu World Tour India 2017-Digital Co-Creation with Fujitsu
Fujitsu World Tour India 2017-Digital Co-Creation with Fujitsu
Fujitsu India215 views
L'IT che vedevamo, l'IT che vedremo: i servizi data center nell'era delle riv... by IDC Italy
L'IT che vedevamo, l'IT che vedremo: i servizi data center nell'era delle riv...L'IT che vedevamo, l'IT che vedremo: i servizi data center nell'era delle riv...
L'IT che vedevamo, l'IT che vedremo: i servizi data center nell'era delle riv...
IDC Italy 622 views
Future of Work: dal Cosa al Come by IDC Italy
Future of Work: dal Cosa al ComeFuture of Work: dal Cosa al Come
Future of Work: dal Cosa al Come
IDC Italy 1.4K views
IoT And Its Manifold Business Benefits - Flexsin Inc by Flexsin
IoT And Its Manifold Business Benefits - Flexsin IncIoT And Its Manifold Business Benefits - Flexsin Inc
IoT And Its Manifold Business Benefits - Flexsin Inc
Flexsin 30 views
Digital Transformation in COVID time by Ahmad Gohar
Digital Transformation in COVID timeDigital Transformation in COVID time
Digital Transformation in COVID time
Ahmad Gohar132 views
The Rise of Platforms in the IoT by Mark Benson
The Rise of Platforms in the IoTThe Rise of Platforms in the IoT
The Rise of Platforms in the IoT
Mark Benson602 views
Big Data, Big True by IDC Italy
Big Data, Big TrueBig Data, Big True
Big Data, Big True
IDC Italy 912 views
Business Analytics and the Internet of Things by Mark Benson
Business Analytics and the Internet of ThingsBusiness Analytics and the Internet of Things
Business Analytics and the Internet of Things
Mark Benson378 views
Fujitsu World Tour 2017 - Fujitsu's Broad Portfolio For Digital Transformation by Fujitsu India
Fujitsu World Tour 2017 - Fujitsu's Broad Portfolio For Digital TransformationFujitsu World Tour 2017 - Fujitsu's Broad Portfolio For Digital Transformation
Fujitsu World Tour 2017 - Fujitsu's Broad Portfolio For Digital Transformation
Fujitsu India128 views
Nuovi modelli di sicurezza IT: le trasformazioni degli Innovation Accelerators by IDC Italy
Nuovi modelli di sicurezza IT: le trasformazioni degli Innovation AcceleratorsNuovi modelli di sicurezza IT: le trasformazioni degli Innovation Accelerators
Nuovi modelli di sicurezza IT: le trasformazioni degli Innovation Accelerators
IDC Italy 417 views
Democritization of Data v2 by Sandy Strauss
Democritization of Data v2Democritization of Data v2
Democritization of Data v2
Sandy Strauss579 views
Developing a Future-Proof IoT Roadmap for Connected Devices and Data by Mark Benson
Developing a Future-Proof IoT Roadmap for Connected Devices and DataDeveloping a Future-Proof IoT Roadmap for Connected Devices and Data
Developing a Future-Proof IoT Roadmap for Connected Devices and Data
Mark Benson528 views
IT Ops Teams: 15 Trends That You Need To Embrace Right Now by Vistara
IT Ops Teams: 15 Trends That You Need To Embrace Right NowIT Ops Teams: 15 Trends That You Need To Embrace Right Now
IT Ops Teams: 15 Trends That You Need To Embrace Right Now
Vistara196 views
redhat-IoT_use_cases-DavidBericat by David Bericat
redhat-IoT_use_cases-DavidBericatredhat-IoT_use_cases-DavidBericat
redhat-IoT_use_cases-DavidBericat
David Bericat556 views
Data Analytics for IoT Device Deployments: Industry Trends and Architectural ... by Mark Benson
Data Analytics for IoT Device Deployments: Industry Trends and Architectural ...Data Analytics for IoT Device Deployments: Industry Trends and Architectural ...
Data Analytics for IoT Device Deployments: Industry Trends and Architectural ...
Mark Benson1.2K views
Industrial Business Transformation Through Connected Products by Mark Benson
Industrial Business Transformation Through Connected ProductsIndustrial Business Transformation Through Connected Products
Industrial Business Transformation Through Connected Products
Mark Benson337 views
IoT: 3 keys to handling the oncoming barrage of use cases by Abhishek Sood
 IoT: 3 keys to handling the oncoming barrage of use cases IoT: 3 keys to handling the oncoming barrage of use cases
IoT: 3 keys to handling the oncoming barrage of use cases
Abhishek Sood64 views

Similar to 5 Factors in Modern Data Design

How to harness big data to drive performance across your project portfolio by
How to harness big data to drive performance across your project portfolioHow to harness big data to drive performance across your project portfolio
How to harness big data to drive performance across your project portfolioSmart ERP Solutions, Inc.
281 views22 slides
Applied tactics for your transformation by
Applied tactics for your transformationApplied tactics for your transformation
Applied tactics for your transformationStuart Charlton
302 views82 slides
Data Virtualization, a Strategic IT Investment to Build Modern Enterprise Dat... by
Data Virtualization, a Strategic IT Investment to Build Modern Enterprise Dat...Data Virtualization, a Strategic IT Investment to Build Modern Enterprise Dat...
Data Virtualization, a Strategic IT Investment to Build Modern Enterprise Dat...Denodo
1.3K views20 slides
The new dominant companies are running on data by
The new dominant companies are running on data The new dominant companies are running on data
The new dominant companies are running on data SnapLogic
252 views24 slides
Big Data LDN 2017: The New Dominant Companies Are Running on Data by
Big Data LDN 2017: The New Dominant Companies Are Running on DataBig Data LDN 2017: The New Dominant Companies Are Running on Data
Big Data LDN 2017: The New Dominant Companies Are Running on DataMatt Stubbs
68 views24 slides
Big Data LDN 2017: The New Dominant Companies Are Running on Data by
Big Data LDN 2017: The New Dominant Companies Are Running on DataBig Data LDN 2017: The New Dominant Companies Are Running on Data
Big Data LDN 2017: The New Dominant Companies Are Running on DataMatt Stubbs
85 views24 slides

Similar to 5 Factors in Modern Data Design(20)

How to harness big data to drive performance across your project portfolio by Smart ERP Solutions, Inc.
How to harness big data to drive performance across your project portfolioHow to harness big data to drive performance across your project portfolio
How to harness big data to drive performance across your project portfolio
Applied tactics for your transformation by Stuart Charlton
Applied tactics for your transformationApplied tactics for your transformation
Applied tactics for your transformation
Stuart Charlton302 views
Data Virtualization, a Strategic IT Investment to Build Modern Enterprise Dat... by Denodo
Data Virtualization, a Strategic IT Investment to Build Modern Enterprise Dat...Data Virtualization, a Strategic IT Investment to Build Modern Enterprise Dat...
Data Virtualization, a Strategic IT Investment to Build Modern Enterprise Dat...
Denodo 1.3K views
The new dominant companies are running on data by SnapLogic
The new dominant companies are running on data The new dominant companies are running on data
The new dominant companies are running on data
SnapLogic252 views
Big Data LDN 2017: The New Dominant Companies Are Running on Data by Matt Stubbs
Big Data LDN 2017: The New Dominant Companies Are Running on DataBig Data LDN 2017: The New Dominant Companies Are Running on Data
Big Data LDN 2017: The New Dominant Companies Are Running on Data
Matt Stubbs68 views
Big Data LDN 2017: The New Dominant Companies Are Running on Data by Matt Stubbs
Big Data LDN 2017: The New Dominant Companies Are Running on DataBig Data LDN 2017: The New Dominant Companies Are Running on Data
Big Data LDN 2017: The New Dominant Companies Are Running on Data
Matt Stubbs85 views
Total Economic Impact of Data Virtualization Using Denodo Platform by Denodo
Total Economic Impact of Data Virtualization Using Denodo PlatformTotal Economic Impact of Data Virtualization Using Denodo Platform
Total Economic Impact of Data Virtualization Using Denodo Platform
Denodo 95 views
Borys Pratsiuk "How to be NVidia partner" by Lviv Startup Club
Borys Pratsiuk "How to be NVidia partner"Borys Pratsiuk "How to be NVidia partner"
Borys Pratsiuk "How to be NVidia partner"
Lviv Startup Club132 views
Software Entrepreneurship by Krit Kamtuo
Software EntrepreneurshipSoftware Entrepreneurship
Software Entrepreneurship
Krit Kamtuo759 views
How to make your data scientists happy by Hussain Sultan
How to make your data scientists happy How to make your data scientists happy
How to make your data scientists happy
Hussain Sultan159 views
Getting to Approval Faster Through Technology Innovation by PAREXEL International
Getting to Approval Faster Through Technology InnovationGetting to Approval Faster Through Technology Innovation
Getting to Approval Faster Through Technology Innovation
Data Virtualization - Enabling Next Generation Analytics by Denodo
Data Virtualization - Enabling Next Generation AnalyticsData Virtualization - Enabling Next Generation Analytics
Data Virtualization - Enabling Next Generation Analytics
Denodo 849 views
Innovation med big data – chr. hansens erfaringer by Microsoft
Innovation med big data – chr. hansens erfaringerInnovation med big data – chr. hansens erfaringer
Innovation med big data – chr. hansens erfaringer
Microsoft148 views
Denodo DataFest 2016: Data Science: Operationalizing Analytical Models in Rea... by Denodo
Denodo DataFest 2016: Data Science: Operationalizing Analytical Models in Rea...Denodo DataFest 2016: Data Science: Operationalizing Analytical Models in Rea...
Denodo DataFest 2016: Data Science: Operationalizing Analytical Models in Rea...
Denodo 316 views
Data Discovery vs BI Webinar by Birst
Data Discovery vs BI WebinarData Discovery vs BI Webinar
Data Discovery vs BI Webinar
Birst1.1K views
Agile Data Management with Enterprise Data Fabric (ASEAN) by Denodo
Agile Data Management with Enterprise Data Fabric (ASEAN)Agile Data Management with Enterprise Data Fabric (ASEAN)
Agile Data Management with Enterprise Data Fabric (ASEAN)
Denodo 79 views
Advanced Analytics and Machine Learning with Data Virtualization by Denodo
Advanced Analytics and Machine Learning with Data VirtualizationAdvanced Analytics and Machine Learning with Data Virtualization
Advanced Analytics and Machine Learning with Data Virtualization
Denodo 54 views
Smart Data for Smart Labs by OSTHUS
Smart Data for Smart Labs Smart Data for Smart Labs
Smart Data for Smart Labs
OSTHUS582 views
Cloud Migration Strategies that Ensure Greater Value for the Business by Denodo
Cloud Migration Strategies that Ensure Greater Value for the BusinessCloud Migration Strategies that Ensure Greater Value for the Business
Cloud Migration Strategies that Ensure Greater Value for the Business
Denodo 52 views
Agents for Agility - The Just-in-Time Enterprise Has Arrived by Inside Analysis
Agents for Agility - The Just-in-Time Enterprise Has ArrivedAgents for Agility - The Just-in-Time Enterprise Has Arrived
Agents for Agility - The Just-in-Time Enterprise Has Arrived
Inside Analysis742 views

Recently uploaded

Infomatica-MDM.pptx by
Infomatica-MDM.pptxInfomatica-MDM.pptx
Infomatica-MDM.pptxKapil Rangwani
11 views16 slides
Chapter 3b- Process Communication (1) (1)(1) (1).pptx by
Chapter 3b- Process Communication (1) (1)(1) (1).pptxChapter 3b- Process Communication (1) (1)(1) (1).pptx
Chapter 3b- Process Communication (1) (1)(1) (1).pptxayeshabaig2004
7 views30 slides
Employees attrition by
Employees attritionEmployees attrition
Employees attritionMaryAlejandraDiaz
5 views5 slides
[DSC Europe 23] Rania Wazir - Opening up the box: the complexity of human int... by
[DSC Europe 23] Rania Wazir - Opening up the box: the complexity of human int...[DSC Europe 23] Rania Wazir - Opening up the box: the complexity of human int...
[DSC Europe 23] Rania Wazir - Opening up the box: the complexity of human int...DataScienceConferenc1
5 views17 slides
4_4_WP_4_06_ND_Model.pptx by
4_4_WP_4_06_ND_Model.pptx4_4_WP_4_06_ND_Model.pptx
4_4_WP_4_06_ND_Model.pptxd6fmc6kwd4
7 views13 slides
PRIVACY AWRE PERSONAL DATA STORAGE by
PRIVACY AWRE PERSONAL DATA STORAGEPRIVACY AWRE PERSONAL DATA STORAGE
PRIVACY AWRE PERSONAL DATA STORAGEantony420421
7 views56 slides

Recently uploaded(20)

Chapter 3b- Process Communication (1) (1)(1) (1).pptx by ayeshabaig2004
Chapter 3b- Process Communication (1) (1)(1) (1).pptxChapter 3b- Process Communication (1) (1)(1) (1).pptx
Chapter 3b- Process Communication (1) (1)(1) (1).pptx
ayeshabaig20047 views
[DSC Europe 23] Rania Wazir - Opening up the box: the complexity of human int... by DataScienceConferenc1
[DSC Europe 23] Rania Wazir - Opening up the box: the complexity of human int...[DSC Europe 23] Rania Wazir - Opening up the box: the complexity of human int...
[DSC Europe 23] Rania Wazir - Opening up the box: the complexity of human int...
4_4_WP_4_06_ND_Model.pptx by d6fmc6kwd4
4_4_WP_4_06_ND_Model.pptx4_4_WP_4_06_ND_Model.pptx
4_4_WP_4_06_ND_Model.pptx
d6fmc6kwd47 views
PRIVACY AWRE PERSONAL DATA STORAGE by antony420421
PRIVACY AWRE PERSONAL DATA STORAGEPRIVACY AWRE PERSONAL DATA STORAGE
PRIVACY AWRE PERSONAL DATA STORAGE
antony4204217 views
Lack of communication among family.pptx by ahmed164023
Lack of communication among family.pptxLack of communication among family.pptx
Lack of communication among family.pptx
ahmed1640237 views
[DSC Europe 23][AI:CSI] Dragan Pleskonjic - AI Impact on Cybersecurity and P... by DataScienceConferenc1
[DSC Europe 23][AI:CSI]  Dragan Pleskonjic - AI Impact on Cybersecurity and P...[DSC Europe 23][AI:CSI]  Dragan Pleskonjic - AI Impact on Cybersecurity and P...
[DSC Europe 23][AI:CSI] Dragan Pleskonjic - AI Impact on Cybersecurity and P...
Ukraine Infographic_22NOV2023_v2.pdf by AnastosiyaGurin
Ukraine Infographic_22NOV2023_v2.pdfUkraine Infographic_22NOV2023_v2.pdf
Ukraine Infographic_22NOV2023_v2.pdf
AnastosiyaGurin1.4K views
[DSC Europe 23] Ivan Dundovic - How To Treat Your Data As A Product.pptx by DataScienceConferenc1
[DSC Europe 23] Ivan Dundovic - How To Treat Your Data As A Product.pptx[DSC Europe 23] Ivan Dundovic - How To Treat Your Data As A Product.pptx
[DSC Europe 23] Ivan Dundovic - How To Treat Your Data As A Product.pptx
Best Home Security Systems.pptx by mogalang
Best Home Security Systems.pptxBest Home Security Systems.pptx
Best Home Security Systems.pptx
mogalang7 views
Data Journeys Hard Talk workshop final.pptx by info828217
Data Journeys Hard Talk workshop final.pptxData Journeys Hard Talk workshop final.pptx
Data Journeys Hard Talk workshop final.pptx
info82821710 views
[DSC Europe 23] Ales Gros - Quantum and Today s security with Quantum.pdf by DataScienceConferenc1
[DSC Europe 23] Ales Gros - Quantum and Today s security with Quantum.pdf[DSC Europe 23] Ales Gros - Quantum and Today s security with Quantum.pdf
[DSC Europe 23] Ales Gros - Quantum and Today s security with Quantum.pdf
6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf by 10urkyr34
6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf
6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf
10urkyr346 views
LIVE OAK MEMORIAL PARK.pptx by ms2332always
LIVE OAK MEMORIAL PARK.pptxLIVE OAK MEMORIAL PARK.pptx
LIVE OAK MEMORIAL PARK.pptx
ms2332always7 views
CRM stick or twist workshop by info828217
CRM stick or twist workshopCRM stick or twist workshop
CRM stick or twist workshop
info82821712 views

5 Factors in Modern Data Design

  • 1. Modern Data Strategy By Dan 5 Design Factors Daniel Sexton, Red Chip Ventures© 2017
  • 2. Audience 2 Ideas For Data Strategy Non-technical executives, tech-savvy managers and technical people who want fresh ideas and perspectives on modern enterprise data strategy and design. Daniel Sexton, Red Chip Ventures© 2017
  • 3. Abstract 3 Ideas For Data Strategy Abstract: As infrastructure and services rapidly commoditize, IT is being asked to assume a more strategic and proactive role in most large businesses. This document introduces a set of concepts and tools that may be helpful in integrating and aligning a data strategy with the overall enterprise. Five key factors that have proven relevant to the survival of firms and strategies are introduced along with five practical tools that can be used to consider integrative strategies from a robust set of perspectives. Daniel Sexton, Red Chip Ventures© 2017
  • 4. Modern Data Strategy Table of Contents Laying The Foundation 1. Revisiting The Basics 2. AWS Basics 3. Design Snapshot in AWS 5 Factors in Data Strategy 1. Movement 2. Uncertainty 3. Defensibility 4. Responsiveness 5. Alignment 4 5 practical tools to prepare for the rise of the machines Daniel Sexton, Red Chip Ventures© 2017
  • 5. Revisit The Basics Often Data Strategy: A plan designed to improve all of the ways data is acquired, stored, managed, shared and used. ▪ What is truly valued at the organization? ▪ What does the competitive landscape look like? ▪ What does the company do well? ▪ What are the strategic opportunities for growth? 5 https://hbr.org/2015/03/why-strategy-execution-unravelsand-what-to-do-about-it https://hbr.org/2015/01/we-still-dont-know-the-difference-between-change-and-transformation http://dataconomy.com/2014/11/why-organizations-need-a-data-strategy/ https://www.sas.com/content/dam/SAS/en_us/doc/whitepaper1/5-essential-components-of-data-strategy-108109.pdf Daniel Sexton, Red Chip Ventures© 2017
  • 6. Why revisit the “obvious” basics often? New brain research indicates that there are two distinct modes of thinking-- focused and diffuse. The transition between modes is the key to creativity and productivity. 1. Brain Science: Breakthrough ideas are more likely to come during casual reflection after new technologies and information have been absorbed. 6 Source Prof Barbara Oakley :http://tdlc.ucsd.edu/educators/educators_webinar_oakley_031213.html NIH Study: https://www.ncbi.nlm.nih.gov/pubmed/24904169 The Innovator’s Mindset: http://georgecouros.ca/blog/archives/5715 Science of Creativity: https://blogs.scientificamerican.com/beautiful-minds/the-real-neuroscience-of-creativity/ Focused Diffuse Prefrontal cortex, concentrated Diffused, dispersed Writing code, spreadsheets Big picture, mind wanders Deadlines, functionality, complexity Revisit basics, reflection, simple solutions, more with less Daniel Sexton, Red Chip Ventures© 2017
  • 7. Why revisit the “obvious” basics often? According to research, it is not possible to be in both thought modes at the same time. Planning activities that encourage relevant modes of thinking at different stages may lead to more a effective dynamic. 7 Implementation & Execution: https://hbr.org/2015/03/defining-strategy-implementation-and-execution 5 Pillars of Strategy: https://www.cebglobal.com/blogs/the-five-pillars-of-strategy-execution/ Strategy Analysis Strategy Formation Strategy Execution Measure & Observe Results Daniel Sexton, Red Chip Ventures© 2017 No plan survives this More Diffuse Thought More Focused Thought
  • 8. Why revisit the “obvious” basics often? Modern strategies are integrative 2. Collaboration helps strategy 8 70% fail: https://www.forbes.com/sites/insead/2016/01/08/five-reasons-most-companies-fail-at-strategy-execution/#e0ef3c33480a Strategy Execution: https://hbr.org/2015/03/why-strategy-execution-unravelsand-what-to-do-about-it 4A Model: https://ideas.darden.virginia.edu/2015/09/beyond-strategy-three-lessons-and-four-ingredients-of-execution/ According to research, at least 70% of corporate strategies fail. Strategy execution often breaks down across departments. Revisiting basics provides a common ground that people with diverse backgrounds can understand and contribute to. This can facilitate communication, teamwork, and a collaborative culture which can improve strategic analysis, formation and execution. Strategy Analysis Strategy Formation Strategy Execution Daniel Sexton, Red Chip Ventures© 2017
  • 9. Why revisit the “obvious” basics often? 3. Discretion is key ▪ Change often happens faster than execution ▪ > 60% of IT projects fail 9 Source: https://www.linkedin.com/pulse/why-45-all-software-features-production-never-used-david-rice 50% fail: http://www.cio.com/article/3068502/project-management/more-than-half-of-it-projects-still-failing.html Daniel Sexton, Red Chip Ventures© 2017
  • 12. Industry Trends Getting too far ahead… 12 ? ? Daniel Sexton, Red Chip Ventures© 2017 ??? ???
  • 13. Monolith to Microservices Cloud platforms encourage modern design such as microservices. i.e. AWS Lambda coerces serverless, microservices 13 Monolith Microservices Scaling Vertical Harder Expensive Horizontal Simpler Cheaper Release Cycles 2-6 weeks, Error-prone 1-7 days Decoupled Deployment Model Simple, Unified Discrete Design Contracts Refactoring Large Codesets Strong Module Boundaries Degradation Binary Failure 100% Limits- CPU, Memory, Disk Graceful AWS Lambda, S3 Adapting Technologies Technology Monoculture Technology Diversity Teams Larger, Diffuse Responsibility - UI Team - App Logic Team - DBA Team Smaller, More Vertical - Accounts Team - Personalization Team - Mobile Team Strangling the Monolith: https://developer.ibm.com/tv/microservices-tv-episode-16-strangling-monolith/ Monolith to Microservices: https://www.nginx.com/blog/refactoring-a-monolith-into-microservices/ Microservices: http://microservices.io/patterns/microservices.html https://www.youtube.com/watch?v=oRIYtOsAlzk - Monolith to Microservices, AWS Daniel Sexton, Red Chip Ventures© 2017
  • 14. Modern Data Design Overview Some Key Activities 14 Source Data Analytics & ETL Data Ingestion Business Intelligence Analytics Data Onsite Data Metadata & Delta Capture Service Discovery Lifecycle Management Data Governance Daniel Sexton, Red Chip Ventures© 2017
  • 15. Modern Data Design using AWS Current Snapshot See Index 15Daniel Sexton, Red Chip Ventures© 2017
  • 16. 5 Factors in a Modern Data Strategy the machines are coming 16 Movement Defensibility Uncertainty Alignment Agility Daniel Sexton, Red Chip Ventures© 2017
  • 17. Factor 1 Movement 17 Movement Movement is the changing of technology, its place in the business cycle, and its use and adoption. The best strategies and designs anticipate movement. ● Commoditization ● Convergence ● Technology Adoption Daniel Sexton, Red Chip Ventures© 2017
  • 18. Commoditization is the process by which technologies that are at first innovations-- scarce, expensive and distinguishable -- become commodities-- ubiquitous, inexpensive, homogenous, interchangeable. This curve depicts the path that all business activities follow from inception to commodity. 18 Movement As value chain components move up commoditization curve, the associated project loses strategic value. Innovation Commodity Inputs Highly Differentiated Products Strategic Advantages Less Differentiated Products Services, Commodities Buy, Outsource, Cheap Build, Assemble, Higher Costs Prevalence Maturity Moore’s Chasm Daniel Sexton, Red Chip Ventures© 2017 Agile Six Sigma Geoffrey A. Moore, Crossing the chasm (Chichester: Capstone, 1998). Rogers, Everett M. Diffusion of innovations. New York: Free Press, 2005.
  • 19. The Value Chain is the set of inputs or components that are used to deliver a product or service. Each of these components exists somewhere along its lifecycle on this curve. Where these components are on their lifecycle is critical to overall strategy, design, marketing and other activities. 19 Movement Example Project Value Chain Prevalence Maturity Daniel Sexton, Red Chip Ventures© 2017 Predictive Analytics Salesforce Search, Solr IoT Commodity Inputs Strategic Advantages
  • 20. Value Chain 12-18 months later 20 Movement Competition increases as it becomes cheaper and easier to enter market Prevalence Maturity Daniel Sexton, Red Chip Ventures© 2017 Predictive Analytics Salesforce Search, Solr IoT Buy? Build
  • 21. Value Chain Costs 21 Prevalence Maturity Daniel Sexton, Red Chip Ventures© 2017 Difficultly/Cost Maturity $1000 $10 $0.10 $1 Build Buy $100 Services, Commodities
  • 22. Value Chain Costs 22Daniel Sexton, Red Chip Ventures© 2017 Custom-built provides competitive advantage Costs justify the results? Products cheaper/better than building
  • 23. Value Chain Costs Example: Big data strategy moves into ancillary components. 23Daniel Sexton, Red Chip Ventures© 2017 Hadoop ecosystem, 2005 Hadoop ecosystem, 2012 Hadoop ecosystem, 2020 BI driven by business more than IT
  • 24. Convergence is the tendency for different technological systems to evolve toward performing similar tasks. This appears to happen when new technological value chains emerge to address customer needs at a viable value proposition level. 24 Movement As technologies change, different systems may converge towards solving similar tasks. Daniel Sexton, Red Chip Ventures© 2017
  • 25. 25 Movement Daniel Sexton, Red Chip Ventures© 2017 Technology Adoption refers to the adoption of a new technology according to the demographic and psychological characteristics of defined adopter groups. Technology Adoption Lifecycle Geoffrey A. Moore, Crossing the chasm (Chichester: Capstone, 1998). Rogers, Everett M. Diffusion of innovations. New York: Free Press, 2005.
  • 26. 26 Movement Daniel Sexton, Red Chip Ventures© 2017 Technology Adoption Custom-built IT projects and their value chains also have adoption lifecycles. Where are your projects on the lifecycle? What type of consumer are you? Moore’s Chasm refers to the marketing problem of driving adoption across populations (mostly) with tech startups. Technology Adoption Lifecycle Pace of Adoption: https://hbr.org/2013/11/the-pace-of-technology-adoption-is-speeding-up IoT Predictive Analytics Solr Salesforce
  • 27. Factor 2 Uncertainty Strategy, design and organizational structure should handle several possible future scenarios. 27 Uncertainty Trends and movement, such as commoditization, are somewhat predictable. Other factors are not. Technology solutions are vulnerable to uncertain future scenarios. Daniel Sexton, Red Chip Ventures© 2017
  • 28. 28 Company-Level Examples Daniel Sexton, Red Chip Ventures© 2017
  • 29. Factor 3 Defensibility Being big doesn’t work anymore 29 Defensibility Democratization of technology is moving defensibility for large enterprises away from engineering costs into other areas. Threat of substitutes and new entrants is high as value chains commoditize. Data is the asset. The data itself should be defensible. Democratization: Amazon Data Center Daniel Sexton, Red Chip Ventures© 2017 Defensibility: https://techcrunch.com/2016/09/15/defensibility-creates-the-most-value-for-founders/ Design, Technology and Design: https://www.bipsync.com/blog/three-moats-defensible-scalable-internet-startup/
  • 30. Strategic Data Matrix 30Daniel Sexton, Red Chip Ventures© 2017
  • 31. Strategic Data Matrices 3 Axes Defensibility of Data It should be difficult or impossible for others to recreate the content and capabilities of strategic data. The data itself should be defensible. Fitness To Modeling The data and design should allow for data scientists and statisticians to test valid hypotheses. Hypotheses tested against defensible data can provide strategic advantages. 31 Robustness to Strategic Possibilities The data and design should be robust to an organization’s strategy and possible future scenarios. Hypothesis testing should align with strategy. Data & design should allow a wide range of viable options to be tested and explored. Daniel Sexton, Red Chip Ventures© 2017
  • 32. Factor 4 Agility 32 Agility is the ability to adapt quickly and effectively to: ● Markets ● Competitors ● Threats, including security threats ● Technology Movement Agility Daniel Sexton, Red Chip Ventures© 2017
  • 33. Factor 4 Agility Market favors those who execute quickly. 33 Agile software development is an important part of overall agility. Agility Daniel Sexton, Red Chip Ventures© 2017
  • 34. Factor 5 Alignment the machines are coming 34 Alignment Daniel Sexton, Red Chip Ventures© 2017
  • 35. Factor 5 Alignment 35Daniel Sexton, Red Chip Ventures© 2017 Time New studies say time is a factor Traditional Alignment Factors McKinsey 7S Strategy Structure Systems Skills Style Staff Shared Values Internal & External Mini- Innovation
  • 36. Timelines can be misaligned McKinsey Three Horizons Moore’s Zone To Win 36Daniel Sexton, Red Chip Ventures© 2017 Time Horizon 1 - 0-12 Months Horizon 2- 12-36 Months Horizon 3- 36-72 Months Three Horizons: http://www.mckinsey.com/business-functions/strategy-and-corporate-finance/our-insights/enduring-ideas-the-three-horizons-of-growt h Moore. 2015. "Zone To Win: Organizing To Compete In The Age Of Disruption". Slideshare.Net. Accessed June 29 2017. https://www.slideshare.net/rstrad1/zone-to-win-organizing-to-compete-in-the-age-of-disruption. Many companies struggle taking Horizon 2 projects to market. TotalReturns Time A common misconception is that companies fail because they fail to innovate. If all of a company’s effort and resources are tied up in operations, disruptions will eventually put it out of business.
  • 37. Thanks! Hope you found this SlideShare helpful in generating ideas for your own Data Design! Please send helpful comments and suggestions to Thanks! Dan