SlideShare a Scribd company logo
1 of 34
Download to read offline
Reshaping the Hype Cycle
Lessons learnt and opinions from ten years spent in web analytics
Alban Gérôme
@albangerome
MEE London
17-18 October 2018
The Gartner Hype Cycle
@albangerome
Innovation
Trigger
Peak of Inflated
Expectations
Trough of
Disillusionment
Slope of
Enlightenment
Plateau of
Productivity
A composite of 2 curves?
@albangerome
Hype curve
A composite of 2 curves?
@albangerome
Hype curve
Acceptance curve
A composite of 2 curves?
@albangerome
Gartner hype cycle
Reshaping the Hype Cycle
Giving hype a haircut
Before the haircut
@albangerome
Snip #1
@albangerome
1. Experts top to bottom
Snip #2
@albangerome
1. Experts top to bottom
2. No noise, all signal
Snip #3
@albangerome
1. Experts top to bottom
2. No noise, all signal
3. Huge uplifts
Snip #4
@albangerome
1. Experts top to bottom
2. No noise, all signal
3. Huge uplifts
4. Very supportive culture
Snip #5
@albangerome
1. Experts top to bottom
2. No noise, all signal
3. Huge uplifts
4. Very supportive culture
5. “No coding necessary”
Reshaping the Hype Cycle
Lifting up the
acceptance curve
Acceptance lift #1
@albangerome
Acceptance lift #1
@albangerome
1. Prove value early
Acceptance lift #2
@albangerome
1. Prove value early
2. IT can’t implement
Acceptance lift #3
@albangerome
1. Prove value early
2. IT can’t implement
3. Scarcity & Social Proof
Acceptance lift #4
@albangerome
1. Prove value early
2. IT can’t implement
3. Scarcity & Social Proof
4. Hub & Spoke Model
Acceptance lift #5
@albangerome
1. Prove value early
2. IT can’t implement
3. Scarcity & Social Proof
4. Hub & Spoke Model
5. Canaries
Acceptance lift #6
@albangerome
1. Prove value early
2. IT can’t implement
3. Scarcity & Social Proof
4. Hub & Spoke Model
5. Canaries
6. Automated tests
Reshaping the Hype Cycle
All together now…
Hype curve post haircut…
@albangerome
Hype curve
… and iterative implementation
@albangerome
Hype curve
Acceptance curve
The reshaped curve
@albangerome
Before and after
Original Gartner Hype Cycle Reshaped Hype Cycle
Reshaping the Hype Cycle
A few closing thoughts
@albangerome
Escalation of commitment
@albangerome
Construction
proposal
Model and
blueprints revealed
Extra budget
unlocked
Building
inauguration day
What a nice
building!
Inexperienced but confident
@albangerome
Confidence
Experience
Be data-informed not data-driven!
51% of C-suite executives
fully support their
organisation’s digital and
analytics strategy
58% of the executives say
employee engagement
and adoption of data
requires leadership by
example
The Economist Intelligence Unit 2015KPMG 2017
Thank you!
http://www.albangerome.com
@albangerome

More Related Content

What's hot

#TapIntoTwitter - London - 15 May 2018
#TapIntoTwitter - London - 15 May 2018#TapIntoTwitter - London - 15 May 2018
#TapIntoTwitter - London - 15 May 2018Angus Fox
 
What's Up in the Library?
What's Up in the Library? What's Up in the Library?
What's Up in the Library? Tevyan Grommesh
 
Mec mary meeker v1 test 11
Mec mary meeker v1 test 11Mec mary meeker v1 test 11
Mec mary meeker v1 test 11Silver1233
 
Mec mary meeker v3 test
Mec mary meeker v3 testMec mary meeker v3 test
Mec mary meeker v3 testSilver1233
 
TravelTag - Freedom from Baggage Carousels
TravelTag - Freedom from Baggage CarouselsTravelTag - Freedom from Baggage Carousels
TravelTag - Freedom from Baggage CarouselsDigital Wavefront
 
Marketing 2017, Special Interest Publishing & OMR
Marketing 2017, Special Interest Publishing & OMRMarketing 2017, Special Interest Publishing & OMR
Marketing 2017, Special Interest Publishing & OMROnline Marketing Rockstars
 
Katie Taylor Digital Marketplace All Staff
Katie Taylor Digital Marketplace All StaffKatie Taylor Digital Marketplace All Staff
Katie Taylor Digital Marketplace All StaffGOVUKDigiMkt
 
How to perform Google Analytics magic
How to perform Google Analytics magicHow to perform Google Analytics magic
How to perform Google Analytics magicInviqa
 

What's hot (8)

#TapIntoTwitter - London - 15 May 2018
#TapIntoTwitter - London - 15 May 2018#TapIntoTwitter - London - 15 May 2018
#TapIntoTwitter - London - 15 May 2018
 
What's Up in the Library?
What's Up in the Library? What's Up in the Library?
What's Up in the Library?
 
Mec mary meeker v1 test 11
Mec mary meeker v1 test 11Mec mary meeker v1 test 11
Mec mary meeker v1 test 11
 
Mec mary meeker v3 test
Mec mary meeker v3 testMec mary meeker v3 test
Mec mary meeker v3 test
 
TravelTag - Freedom from Baggage Carousels
TravelTag - Freedom from Baggage CarouselsTravelTag - Freedom from Baggage Carousels
TravelTag - Freedom from Baggage Carousels
 
Marketing 2017, Special Interest Publishing & OMR
Marketing 2017, Special Interest Publishing & OMRMarketing 2017, Special Interest Publishing & OMR
Marketing 2017, Special Interest Publishing & OMR
 
Katie Taylor Digital Marketplace All Staff
Katie Taylor Digital Marketplace All StaffKatie Taylor Digital Marketplace All Staff
Katie Taylor Digital Marketplace All Staff
 
How to perform Google Analytics magic
How to perform Google Analytics magicHow to perform Google Analytics magic
How to perform Google Analytics magic
 

More from Alban Gérôme

Avoir de l’impact, autrement
Avoir de l’impact, autrementAvoir de l’impact, autrement
Avoir de l’impact, autrementAlban Gérôme
 
Earning more as a Digital or Web Analyst
Earning more as a Digital or Web AnalystEarning more as a Digital or Web Analyst
Earning more as a Digital or Web AnalystAlban Gérôme
 
Is it just me, or the C-suite doesn't care about data?
Is it just me, or the C-suite doesn't care about data?Is it just me, or the C-suite doesn't care about data?
Is it just me, or the C-suite doesn't care about data?Alban Gérôme
 
Cracking trading cards packs and web analytics
Cracking trading cards packs and web analyticsCracking trading cards packs and web analytics
Cracking trading cards packs and web analyticsAlban Gérôme
 
Spicy javascript: Create your first Chrome extension for web analytics QA
Spicy javascript: Create your first Chrome extension for web analytics QASpicy javascript: Create your first Chrome extension for web analytics QA
Spicy javascript: Create your first Chrome extension for web analytics QAAlban Gérôme
 
The us vs the uk web analytics job slideshare
The us vs the uk web analytics job slideshareThe us vs the uk web analytics job slideshare
The us vs the uk web analytics job slideshareAlban Gérôme
 
Implementing Web Analytics on Single Page Applications
Implementing Web Analytics on Single Page ApplicationsImplementing Web Analytics on Single Page Applications
Implementing Web Analytics on Single Page ApplicationsAlban Gérôme
 
Automating boring tasks with Powershell
Automating boring tasks with PowershellAutomating boring tasks with Powershell
Automating boring tasks with PowershellAlban Gérôme
 
Influence and Persuasion
Influence and PersuasionInfluence and Persuasion
Influence and PersuasionAlban Gérôme
 
Claiming credit for being data-driven
Claiming credit for being data-drivenClaiming credit for being data-driven
Claiming credit for being data-drivenAlban Gérôme
 
Acceptance, Accessible, Applicable et Auditable
Acceptance, Accessible, Applicable et AuditableAcceptance, Accessible, Applicable et Auditable
Acceptance, Accessible, Applicable et AuditableAlban Gérôme
 
Acceptance, Accessible, Actionable and Auditable
Acceptance, Accessible, Actionable and AuditableAcceptance, Accessible, Actionable and Auditable
Acceptance, Accessible, Actionable and AuditableAlban Gérôme
 
Are you still working for a data justified company?
Are you still working for a data justified company?Are you still working for a data justified company?
Are you still working for a data justified company?Alban Gérôme
 
Build your own analytics power tools
Build your own analytics power toolsBuild your own analytics power tools
Build your own analytics power toolsAlban Gérôme
 
Is data visualisation bullshit?
Is data visualisation bullshit?Is data visualisation bullshit?
Is data visualisation bullshit?Alban Gérôme
 
Acceptance, accessible, actionable and auditable
Acceptance, accessible, actionable and auditableAcceptance, accessible, actionable and auditable
Acceptance, accessible, actionable and auditableAlban Gérôme
 

More from Alban Gérôme (20)

Avoir de l’impact, autrement
Avoir de l’impact, autrementAvoir de l’impact, autrement
Avoir de l’impact, autrement
 
Earning more as a Digital or Web Analyst
Earning more as a Digital or Web AnalystEarning more as a Digital or Web Analyst
Earning more as a Digital or Web Analyst
 
Is it just me, or the C-suite doesn't care about data?
Is it just me, or the C-suite doesn't care about data?Is it just me, or the C-suite doesn't care about data?
Is it just me, or the C-suite doesn't care about data?
 
Cracking trading cards packs and web analytics
Cracking trading cards packs and web analyticsCracking trading cards packs and web analytics
Cracking trading cards packs and web analytics
 
Spicy javascript: Create your first Chrome extension for web analytics QA
Spicy javascript: Create your first Chrome extension for web analytics QASpicy javascript: Create your first Chrome extension for web analytics QA
Spicy javascript: Create your first Chrome extension for web analytics QA
 
The us vs the uk web analytics job slideshare
The us vs the uk web analytics job slideshareThe us vs the uk web analytics job slideshare
The us vs the uk web analytics job slideshare
 
Implementing Web Analytics on Single Page Applications
Implementing Web Analytics on Single Page ApplicationsImplementing Web Analytics on Single Page Applications
Implementing Web Analytics on Single Page Applications
 
Tagging differently
Tagging differentlyTagging differently
Tagging differently
 
Automating boring tasks with Powershell
Automating boring tasks with PowershellAutomating boring tasks with Powershell
Automating boring tasks with Powershell
 
Influence and Persuasion
Influence and PersuasionInfluence and Persuasion
Influence and Persuasion
 
Claiming credit for being data-driven
Claiming credit for being data-drivenClaiming credit for being data-driven
Claiming credit for being data-driven
 
Acceptance, Accessible, Applicable et Auditable
Acceptance, Accessible, Applicable et AuditableAcceptance, Accessible, Applicable et Auditable
Acceptance, Accessible, Applicable et Auditable
 
Acceptance, Accessible, Actionable and Auditable
Acceptance, Accessible, Actionable and AuditableAcceptance, Accessible, Actionable and Auditable
Acceptance, Accessible, Actionable and Auditable
 
Logic or emotions
Logic or emotionsLogic or emotions
Logic or emotions
 
Hub and spoke model
Hub and spoke modelHub and spoke model
Hub and spoke model
 
Are you still working for a data justified company?
Are you still working for a data justified company?Are you still working for a data justified company?
Are you still working for a data justified company?
 
Persuasion
PersuasionPersuasion
Persuasion
 
Build your own analytics power tools
Build your own analytics power toolsBuild your own analytics power tools
Build your own analytics power tools
 
Is data visualisation bullshit?
Is data visualisation bullshit?Is data visualisation bullshit?
Is data visualisation bullshit?
 
Acceptance, accessible, actionable and auditable
Acceptance, accessible, actionable and auditableAcceptance, accessible, actionable and auditable
Acceptance, accessible, actionable and auditable
 

Recently uploaded

Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityStrategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityAggregage
 
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Guido X Jansen
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Vladislav Solodkiy
 
CCS336-Cloud-Services-Management-Lecture-Notes-1.pptx
CCS336-Cloud-Services-Management-Lecture-Notes-1.pptxCCS336-Cloud-Services-Management-Lecture-Notes-1.pptx
CCS336-Cloud-Services-Management-Lecture-Notes-1.pptxdhiyaneswaranv1
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerPavel Šabatka
 
How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?sonikadigital1
 
Virtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product IntroductionVirtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product Introductionsanjaymuralee1
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxVenkatasubramani13
 
5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best PracticesDataArchiva
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationGiorgio Carbone
 
CI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionCI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionajayrajaganeshkayala
 
Rock Songs common codes and conventions.pptx
Rock Songs common codes and conventions.pptxRock Songs common codes and conventions.pptx
Rock Songs common codes and conventions.pptxFinatron037
 
Optimal Decision Making - Cost Reduction in Logistics
Optimal Decision Making - Cost Reduction in LogisticsOptimal Decision Making - Cost Reduction in Logistics
Optimal Decision Making - Cost Reduction in LogisticsThinkInnovation
 
ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructuresonikadigital1
 
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxTINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxDwiAyuSitiHartinah
 
Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...PrithaVashisht1
 

Recently uploaded (16)

Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityStrategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
 
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023
 
CCS336-Cloud-Services-Management-Lecture-Notes-1.pptx
CCS336-Cloud-Services-Management-Lecture-Notes-1.pptxCCS336-Cloud-Services-Management-Lecture-Notes-1.pptx
CCS336-Cloud-Services-Management-Lecture-Notes-1.pptx
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayer
 
How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?
 
Virtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product IntroductionVirtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product Introduction
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptx
 
5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - Presentation
 
CI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionCI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual intervention
 
Rock Songs common codes and conventions.pptx
Rock Songs common codes and conventions.pptxRock Songs common codes and conventions.pptx
Rock Songs common codes and conventions.pptx
 
Optimal Decision Making - Cost Reduction in Logistics
Optimal Decision Making - Cost Reduction in LogisticsOptimal Decision Making - Cost Reduction in Logistics
Optimal Decision Making - Cost Reduction in Logistics
 
ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructure
 
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxTINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
 
Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...
 

Reshaping the Hype Cycle

Editor's Notes

  1. The Black Eyed Peas were singing ‘I Gotta A Feeling”. “Inglourious Basterds”, “The Hangover” and “Avatar” came onto the screens. TMZ just published rumours that Michael Jackson had been found dead in Beverly Hills. I lost my job as a senior front-end developer. About a year earlier, I was working at a London start-up called Touch Clarity, which was soon acquired by Omniture but I had not used SiteCatalyst at that point, only our Touch Clarity tool. Omniture SiteCatalyst became Adobe Analytics and Touch Clarity was part of what is now known as became Adobe Target. Then, a job ad about web analytics caught my attention, I applied, got the role and I never looked back. It certainly was no walk in the park and here are lessons I have learnt and opinions I have formed over my first 10 years in web analytics I would like to share with you arranged around 3 main themes: implementation, data analysis and the culture
  2. The organisation had easy access to not one but possibly a team of implementation experts. It also had a web analyst, also an expert trained by the vendor. All may well even be certified if the vendor provides these and the web analyst has rehearsed his demo. Getting experts of that calibre to work on your websites will not come cheaply and your organisation will not have budgeted for this. You do not have to depend on the vendor’s consultants but you will need implementation experts and people experienced in using the tool. In fact, you will need a analytics department.
  3. The organisation had easy access to not one but possibly a team of implementation experts. It also had a web analyst, also an expert trained by the vendor. All may well even be certified if the vendor provides these and the web analyst has rehearsed his demo. Getting experts of that calibre to work on your websites will not come cheaply and your organisation will not have budgeted for this. You do not have to depend on the vendor’s consultants but you will need implementation experts and people experienced in using the tool. In fact, you will need a analytics department.
  4. The data used in the demo shows an obvious spike that took no time to find. As you track more and more metrics, add more dimensions, the signal to noise ratio increases and it quickly becomes harder to know where to start. Attention bias can prevent us from spotting something interesting. Then we might go round the PDCA loop more than once before zeroing in on the correct hypothesis instead of being spot on with the very first one. Leverage anomaly detection if your tool allows this. Managing analysis paralysis requires an analysis method such as REAN, AAARR or something similar and only analysts with prior experience know this.
  5. The return on analytics spend rarely grows in spurts but slowly and incrementally. Your nuggets, if you ever find them, are probably someone else’s massive mistake. What if this nugget gets the person responsible in trouble or even lose their job? Possible. Has your competition all made the same error? Unlikely. Correcting these mistakes will probably just make you catch up the competition on a certain dimension rather than giving you the edge and lead. What gives you that lead is a sound foundation topped with the cumulative effect of many small incremental changes.
  6. A supportive culture that gives credit to where it’s due. In the demo, recommendations get implemented, no questions asked. Then the analyst can claim credit and leads to a virtuous spiral toward digital transformation and data-based decision-making. In many organisations, the analyst or analytics team has been demoted to a pure support function leveraging the valid point that they lack domain knowledge and come up with recommendations that are not aligned with the business. The organisations consider them as the guardians of data quality, ask them to produce reports, to extract huge amounts of data for the incumbent teams who will try to extract the actionable insight themselves and take all the credit. The incumbent teams do not want to feel like they are placed under conservatorship and been told what to do by a support team.
  7. The minimal tagging effort will give you some reports out of the box to be sure. But that’s just an ad for a flat in a new exclusive housing project. The pictures you see in the ad is for one of the most expensive flats in the building and then the ad says “Starting at £400,000”. £400,000 will not buy the kind of flat shown in the ad. No coding necessary will probably will not give the kind of report displayed in the demo. Sooner or later you will need to go through the motions. Collecting the business questions, prioritising them, getting them shaped into a tagging guide, IT to implement, QA. That’s probably how far down we can go for now. Over time, as organisations mature, they will have a more realistic approach to a launching an analytics programme. We can reshape the acceptance curve too and lift it up.
  8. IT will do the implementation will lead to a disaster, do not do a big bang implementation, go agile Do not succumb to premature democratisation Implement a hub and spoke model where the hub should eventually disappear or dissipate into the organisation once mature enough Data extracts should be verified by a colleague and/or have the data extraction steps documented Keep the resulting curve above the threshold below which you could lose key supporters
  9. Aim for a MVP implementation to demonstrate the value faster. John Gall, a system theory expert of the 1970’s wrote: “Some complex systems actually work but building a complex one from scratch never works. You have to start over, beginning with a working simple system.” That becomes “Some complex data capture implementations actually work but building a complex one from scratch never works. You have to start over, beginning with a working simple implementation.” So if you try to track everything 2 things happen to your acceptance curve, you reach the plateau much later and getting there takes longer
  10. IT can get you started on your implementation pretty fast but in the long run, you will have stunted analytics capabilities Analytics may be just Javascript, IT has Javascript experts and is used to capturing the requirements to be sure. But since when analytics is taught in Computer Science? Analytics implementations leverage proprietary Javascript functions. Some vendors might only give you an implementation manual if you paid for implementation training! Other vendors might give public access to their implementation documentation but in any case, that’s a lot to study and in the meantime the clock is ticking. Some of the promised implementation features may well end-up descoped or deferred to a later release. That will not help an analytics implementation MVP grow because the resources earmarked for the phase 2 are used to tackle deferred phase 1 features and so on. An implementation consultant could start after IT can and yet still deliver more implementation features for phase 1 because their learning days are behind them and they can collect the requirements too. Remember that your implementation is never “done” once and for all, you will need that consultant back regularly
  11. Your implementation MVP is not the only thing that will grow with each iteration. You should only grant access to happy few to analytics to begin with and then grow that small group by only a few new people. In the 18th century Antoine-Augustin Parmentier was an advocate for the introduction of potatoes to the French diet and throughout Europe. Potatoes were introduced in dinners where prominent guests, offering to royals bouquets of potato blossoms. But his master trick was have a very visible potato field watched by armed guards during the day and then letting them go home at night, prompting the crowd to steal the potatoes. That was the real purpose of that field. Scarcity and Social Proof, 2 concepts of Robert Cialdini more commonly leveraged by Apple today, will help drive the appetite across the organisation for analytics access. This Social Proof from highly prominent people translate at organisational level by C-suite support. They need to lead by example
  12. 2 people believe they have extracted the same data and find huge discrepancies. This is largely a reproducibility issue, both believe they have extracted the same data the same way but that is not possible or the figures would match. Earlier in my career, I worked in pharmaceutical industry, double-blind medical trials to be precise and I was on the database team for a little bit. When the nurses could not get a bottle number from the automated voice response system to resupply a tester, they would call the support line who would use an graphical interface and get a suitable bottle number for the titration the tester was randomised into. It that also failed, they contacted people like me who would go into the Oracle database, write a short SQL script to get a bottle number. If that script was wrong, it could kill someone, literally because it might have taken someone who was randomised to placebo to suddenly getting the highest possible titration they could have been randomised into instead of placebo. So, we ran the SQL script once, rollback, i.e. cancel the execution of the code and print it out and then a colleague would do the same thing and both resulted in the same bottle number, one of the two of us ran the same script again but for real this time. Both print outs were dated, signed by 2 database developers and then filed. If the 2 aspiring web analysts could do something similar there would be a single version of the truth but that may not be very practical. Luckily, there’s an alternative and it’s called a hub and spoke model. You create a new dedicated analytics team made of analytics experts and analytics enthusiasts, junior analysts in the incumbent teams. That new team as not budgeted for either, I know. The hub should focus on finding actionable insights. A rivalry for the data-driven crown might emerge between this new analytics hub, often called the analytics centre of excellence, and the incumbent teams. The C-suite has asked these incumbent teams to become data-driven and they might want to treat this new team as a pure support team who will do nothing more than extracting the data, do all the reporting and ensuring the data quality. Do not expect to find and kind analytics experts very long if the incumbent teams get their way. Expect these experts to leave and tell all their friends about what a “fine” organisation you are operating. But they lack “domain knowledge”, “business acumen“, I get that. So instead provide them with a steer by asking them the business questions you would like them to answer instead of bombarding them with data extracts only to cherry-pick the 1% that confirms prior beliefs. That’s not data-driven, that’s what I call “data-justified”! The credit for making the organisation data-driven must translate into different things in each team involved: The incumbent teams can claim credit for giving a steer to the analytics team and helping them becoming better aligned with the business, helping them develop their domain knowledge and even let these few data experts spend some time in their team to gain operational knowledge as part of a rotation between departments. These incumbent teams can also claim credit for operating as spokes and developing their analytics skills The analytics hub can claim credit for shielding the other teams from making data extracting errors that would occur if they were thrown at the deep end without much training but also against many congnitive biases such as “belief persistence”, “confirmation bias”, “cognitive dissonance”, not afraid to show data that reveals issues and ensure a high level of objectivity
  13. The spokes are people who have been with the business for some time and have some data literacy, people from the finance department for example. They will do all the reporting and monitoring for the data that is of immediate concern for their team. It will be much easier for them to spot issues because the remit is much smaller than what the analytics centre of excellence would have to contend with. Also they have skin in the game because any anomalies in that data impacts them directly. The spokes will be your “canaries in the coalmine”, spotting issues much more reliably and faster. When a massive issue is impacting your analytics, the analytics hub will get one and then a few calls from the various spokes. By call #2, the hub could call all the other spokes and know the whole scope of the issue, in parallel rather than by in serial manner. Mistakes are part of the learning process but they will be spotted fast and addressed fast too.
  14. Ask your implementation contractors to speak to IT as well about how they run automated tests before going live. The implementation experts will know how good looks like and help IT include additional tests scripts that will check the integrity of the analytics implementation. Expect this process to gain in sophistication after a few iterations there too. Eventually, any potential analytics reporting outages should be captured even before going live, before your canaries can spot them. This double layer of checks breeds high trust in the data across the organisation. If that data goes against the beliefs held prior, the business will find playing the “what if this data were the result of a bad implementation” card much more difficult.
  15. Construction projects are often good examples of this escalation of commitment. At first people are seduced by the blueprints, early models and 3d computer simulations. The budget is signed-off, construction starts and people are giddy with excitement. Then the first unexpected issues appear, adjustments are made but soon a bigger budget is required or the project grinds to a halt. Nobody wants the eyesore or a half-completed construction site, demolishing would require money anyway. If that demolition budget was spent as extra budget for the completion of the project, it might just get completed. The Eurotunnel is a good example of a project that totally exceeded its initial estimates but is widely considered a success. Letting go of a dream is painful so people will overcommit to see it becoming true. If they knew of the total commitment required upfront the project would never get off the ground. It seems that many construction projects will fail without escalation of commitment. Most technologies go through the Gartner hype cycle rather than following this ideal adoption curve and analytics is no exception. An HBR article of June 2016 reported that: "More than half of senior executives experienced a backlog of at least two years on critical new analytics applications.“ Is escalation of commitment really the only way to deliver a successful analytics programme? Every client is different but the analytics vendors are well placed to know that there will be surprises along the way and even the best budget and delivery estimates will fly out of the window. They will focus on the common denominator: regardless of the type of organisation you are, our tool is awesome, easy to use and can deliver return on your investment. This focus maximises sales of product licences, implementation consulting time, training courses including on-site. In 10 to 20 years from now the adoption curve for analytics may look like a sigma curve with a slowly increasing plateau. But for now, the need for fast results will make organisations make unwise decisions and the adoption curve will look like the Gartner hype cycle.
  16. Most of the people sitting at these demos do not have significant experience in our field. They are the people who will hold the purse strings, however. Bertrand Russell said: “The whole problem with the world is that fools and fanatics are always so certain of themselves, and wiser people so full of doubts”. He was not the first to come to this conclusion, we can trace this idea all the way to Confucius. These decision-makers will confuse the Pollyanna world of these demos with reality. But the external experts you have recruited for your new analytics department are just as prone to this effect. They might believe that actionable insight that is not aligned to the business strategy can have a bigger return than one that is aligned. Inexperienced people tend to feel more confident about their abilities and underestimate the difficulties they might face regardless of the side of the fence they are on, strategic or tactical. But quickly reality brings them down earth. With more experience, they will start doubting themselves and reach a real low. With even more experience, their initial foolish assumptions are slowly replaced by tried and tested practices. Eventually, we reach mastery but we retain a healthy dose of self-doubt, more open to learning something new and seeing our assumptions challenged. We are looking at the Dunning-Kruger Effect and the fact that this curve bears a similarity to Gartner hype cycle. In fact, I believe that this is the key driver of the hype curve. There are many aspects of these demos that should be met with more healthy scepticism:
  17. You need support from the C-suite, that will send the message loud and clear that if the senior managers want a shot at the C-suite, they will have to learn how to combine their years of experience and domain knowledge with increased data literacy to become data-informed. No support from the C-suite sends the clear message that it is not required once the senior managers reach that stage because it’s all but another fad. People see themselves as very rational in their decision-making but in fact, we take decisions on more emotional level. The data and the facts are useful but only when we have to defend and justify the decisions we took based on emotions. So the resistance is understandable but taking decisions on a pure data-driven basis is not desirable either. In 2016, the Indonesian government offered a bounty to fight against the proliferation of rats, $1.50 per rat. 40% of the population lives on less than $2 a day. This may have worked for a while but then people starting running rat farms to ensure bigger and more regular earnings. The decision was data-driven in my view but people gamed it and this backfired. Data-informed is in my view the ideal compromise of the experience and a data-based approach. The C-suite and the senior managers should find this prospect more palatable.