SharePoint Saturday UK - Measuring the Intangible, SharePoint ROI.
Ant Clay talks about how you can measure the seemingly intangible value of the social features of Microsoft SharePoint 2010.
14. An engaged workforce has 2.6 *
earnings per share growth rate
CodeCamp / SharePoint Saturday, March 26th 2011
15. Failing to engage employees: $300
Billion in wasted productivity
CodeCamp / SharePoint Saturday, March 26th 2011
16. ..average employee spends less than two-
and-a-half days per week actually doing
their job.
The rest of the time is spent navigating a
virtual forest of information.
CodeCamp / SharePoint Saturday, March 26th 2011
21. Measurement fact
âNot everything that can be counted
counts, and not everything that counts
can be counted.â
âHard things to measure are the ones
you probably should be measuring!â
CodeCamp / SharePoint Saturday, March 26th 2011
22. Measure⊠what?
CodeCamp / SharePoint Saturday, March 26th 2011
23. Reduction
in email
Work / Life
Balance
CodeCamp / SharePoint Saturday, March 26th 2011
24. Up & to the right = #WIN ?
CodeCamp / SharePoint Saturday, March 26th 2011
63. âThe greatest challenge has to do with
making technologists sufficiently user-
like - getting them to stop thinking in
terms of bells and whistles and
elaborate functionality, and to start
thinking instead about busy users with
short attention spans who need to get
something done, and who can always
reach for email.â
- Andrew McAfee
CodeCamp / SharePoint Saturday, March 26th 2011
64. Any Questions
CodeCamp / SharePoint Saturday, March 26th 2011
65. Thanks for your
time & attention
www.21apps.com
@AndrewWoody #spsuk #rwsbs
[twitter] Measuring the Intangible, SharePoint Social ROI session about to start ï [/twitter]Â
Talk briefly about my role and 21apps
Whatâs the most intangible set of features in SharePointâŠ. Ask the audienceâŠSocial FeaturesSocial is people based
Ask the audience why we should measure at all?
Well not directly⊠ROI = [ (Gain â Cost) / (Cost) ] *100I want to talk about the really tricky bit of that equation âGAINâ
Letâs start with what I think is a key problem with SharePoint generally, but especially when itâs a Social ProjectCelery contains 6 calories. But the mere act of digesting said stalk burns more like 10 calories, resulting in a negative caloric intake.This is like spending lots of time and effort, licenses, hardware and project time and money, but not delivering anything the business needsŸ of SharePoint projects I was aware of over the past 5 years DID NOT deliver true Business ValueNEGATIVE ROI[twitter] Talking about âThe Celery Effectâ [/twitter]Â
SharePoint projects are people projects; therefore they are inherently squishy and hard to figure out!But letâs face it theyâre more tangible and less squishy than sayâŠ[twitter] SharePoint projects are PEOPLE projects [/twitter]Â
B.O.B (Monster vs Aliens)âŠSo we have some structure, some ideas, âgood practiceâ, some avenues to pursue and some ways that we can measure if we really try!Letâs 1st have a chat about why Social is such a big deal because that indicates why its apparently so hard to measure[twitter] SharePoint isnât as squishy as B.O.B (Monsters vs Aliens) [/twitter]Â
Cynefin framework â Dave SnowdenExchange projects are ComplicatedSharePoint projects are Complex â Why, because you donât know that you will make progress towards your goal until youâve done something (i.e. delivered some features for users to use)[twitter] SharePoint is COMPLEX in the Cynefin framework [/twitter]Â
Social Media Today stated in a recent article on âbenefit measuresâ of internal social media thatThe business value (ROI) of internal social media networks depends on how effectively the social media tools help drive:Enhanced employee engagementStreamlined operationsBetter, faster innovation[twitter] Going through some âsocialâ facts [/twitter]Â
Social Media Today stated in a recent article on âbenefit measuresâ of internal social media thatThe business value (ROI) of internal social media networks depends on how effectively the social media tools help drive:Enhanced employee engagementStreamlined operationsBetter, faster innovation
Social Media Today stated in a recent article on âbenefit measuresâ of internal social media thatThe business value (ROI) of internal social media networks depends on how effectively the social media tools help drive:Enhanced employee engagementStreamlined operationsBetter, faster innovation
Social Media Today stated in a recent article on âbenefit measuresâ of internal social media thatThe business value (ROI) of internal social media networks depends on how effectively the social media tools help drive:Enhanced employee engagementStreamlined operationsBetter, faster innovation
Gallup Study identified:
Gallup Study identified:
New Zealand Article22 October 2010 http://www.stuff.co.nz/business/opinion/4264080/Enough-already-information-overload[twitter] Avg. employee spends less than 2.5 days/week doing their real job [/twitter]Â
Organisational changesMoving from Command and Control organisations.Value isnât something thatâs generated at the top and taken by the guys at the bottomâŠ
David Weinberger stated in the Book âClueTrain Manifestoâ in 1999 "hyperlinks subvert hierarchies â This is now finally happeningHow many of you âget things doneâ by who you know and not âthe formal processâ??Connected to people, knowing peoples skills etc All Social activities[twitter] Referencing the book - ClueTrain Manifesto â Hyperlinks subvert hierarchies //@mattgroves [/twitter]Â
Whether we like it or not we are all in a VERY competitive global marketplace
So that is why for most businesses who have SharePoint, social features absolutely make sense. But how do we know that in our organisation our SharePoint project thatâs deploying Social Features is actually making a difference?We know it should but is it really? Is it enough? Is our progress in the right direction? Are we delivering value
[twitter] Measurement facts by the Einstein & @AndrewWoodyï [/twitter]Â
Social Features:What do we want to measure?How are we going to measure it?[twitter] What should we measure in a SharePoint Social features based project? [/twitter]Â
List out a set of Social Feature Based metrics⊠some are vanity ones
So if our metrics are âup and to the rightâ thatâs a win yes?Audience, what do they think?[twitter] If your metrics are âUp & to the Rightâ is that always a good thing? [/twitter]Â
Why would we think that? Is that really true?No I donât think it isâŠI think metrics on their own can be very very misleading
Let me take you away from the SharePoint World!Taken from the book âThe Lean Start-Upâ by Eric RiesWe will focus on one key aspect for this talk â âInnovation Accountingâ.3 learning milestonesIn the book it talks about â Innovation Accountingâ and thatâs what we at 21apps use to drive our business and to ensure we deliver maximum value from our SharePoint projects.[twitter] Talking about âThe Lean Startupâ by @ericries[/twitter]Â [twitter] Specifically how Innovation Accounting can be used in SharePoint projects! [/twitter]Â
Baseline â where are we and where we going?
2. Tune the engine â build the solution, iterations, continuous improvement, measurement and insights testing our baseline assumptions
3. Pivot or Persevere â Making progress then continue, not making progress then Pivot (Watch for Vanity Metrics)
In the book it talks about â Innovation Accountingâ and thatâs what we at 21apps use to drive our business and to ensure we deliver maximum value from our SharePoint projects.Assumption is where we are going / what we are trying to achieveMetric is how we would measure that progress (not a Vanity metric)Experiment â Is what we will build to test the assumption[twitter] How does Innovation Accounting really work? [/twitter]Â
Baseline â where are we and where we going?[twitter] Innovation Accounting in SharePoint projects â Have an awesome baseline! Boom, how low can we goâŠ[/twitter]Â
Reference the book⊠Simon Sinek â âStart with WhyâWhy are we doing this project, why SharePoint Social Features?Has to be to âMake a Positive DifferenceâNo platitudes[twitter] Referencing Simon Sinekâs book âStart with Whyâ[/twitter]Â
Humffrom Nick Jnr.Book - âBuilt to Last: Successful Habits of Visionary Companiesâ by James Collins and Jerry PorrasExplain BHAG â There needs to be a bold, big reason (no platitudes) for doing the project that the SharePoint project team can believe in[twitter] Humf, Big Hairy Audacious Goals and NO Platitiudes [/twitter]Â
Where are we today? (Social Focus)Good or bad, itâs reality
2. Tune the engine â build the solution, iterations, continuous improvement, measurement and insights testing our baseline assumptions[twitter] Tune the Engine â Continuous delivery, adaptive organisations, measurements & insights [/twitter]Â
This is project delivery... But we must remember to:Iterate, Agile, small projects with clear actionable business outcomes Not talking year long cycles or quarters or even months but weeks and daysContinuous improvementAdaptive organisation
Measure
Vanity metrics.Is what your measuring and the results your seeing because of something you have just done (cause and effect) or because of: âold momentumââexternal factorsâ[twitter] Innovation Accounting in SharePoint projects - Beware of Vanity Metrics [/twitter]Â
Is what you have learnt (feedback and measurement) taking you towards your goals / Your original Assumptions?[twitter] Innovation Accounting in SharePoint projects â Validated learning [/twitter]Â
3. Pivot or Persevere â Making progress then continue, not making progress then Pivot (Watch for Vanity Metrics)Detail on next slide[twitter] Innovation Accounting in SharePoint projects â Once measured, âPivot or Persevereâ [/twitter]Â
Donât just buildDonât just measureYou need to do something with those metricsâŠBe proactive[twitter] Innovation Accounting in SharePoint projects â Get off your ass, donât be lazy [/twitter]Â
Pivot or PersevereAre we making progress towards our Big Hairy Audacious Goal?If we are great, if we arenât then Pivot â based upon what we have learnt start another iteration of the project (sprint) based on new assumptions of how we will reach our goal.
So what tools are there around for measuring these intangibles?[twitter] Tools to measure intangibles in SharePoint Social projects [/twitter]Â
Use both![twitter] Use both Quantitative and Qualitative tools to measure SharePoint Social [/twitter]Â
What do they think? End-users, stakeholders, howâs the support call volumes? Whatâs the vibe in the organisation?Get out of the IT team and into the business.. Open your eyes[twitter] Tools to measure intangibles in SharePoint Social projects â End Users [/twitter]Â
Site trafficSearch metricsBad behaviours still happening (email use, folders, phone calls, file server etc)A/B Split Testing â Use Audiences to achieve thisWhat else?[twitter] Tools to measure intangibles in SharePoint Social projects â SharePoint Metrics [/twitter]Â
Draw OutVision ï +ve Change ï Business Outcomes ï Social features ï Project GoalProgress towards your business goalsHow does the delivery of social features meet our project goals, how does that meet the programme goals how does that meet our organisational vision and strategy?[twitter] Tools to measure intangibles in SharePoint Social projects â Goal Alignment [/twitter]Â
[twitter] Tools to measure intangibles in SharePoint Social projects â Kapitola Pathways [/twitter]Â
Should you trust this⊠I think so.Shouldnât be relied upon but shouldnât be discarded[twitter] Tools to measure intangibles in SharePoint Social projects â Your Gut Feel [/twitter]Â
Then show that everything in Delivery AND Realisation must be traced back to support Vision & Outcomes[twitter] Tools to measure intangibles in SharePoint Social projects â 21shift model[/twitter]Â
If youâre hitting challenges, maybe try using the â5 whys techniqueâTaiichiOhno â The Five Whyâs?Toyota Production System / Lean ManufacturingAsk why 5 times of an issue or challenge and you will get to the root cause, usually not a systemic problem, more likely to be a âhumanâ issue.[twitter] Tools to measure intangibles in SharePoint Social projects â TaiichiOhnoâs 5 Whys [/twitter]Â
Storytelling:Get end users to tell you stories, listen for stories (water-cooler, meetingsetc)1. This is what the future looks like2. I did these things and this was the result (ÂŁ, efficiencies etc)Anecdotes⊠Gather, store, analyseBook: The Leaderâs Guide To Storytelling - By Stephen Denning[twitter] Tools to measure intangibles in SharePoint Social projects â Storytelling (my favourite) [/twitter] [twitter] Book: The Leaderâs Guide To Storytelling - By Stephen Denning [/twitter]Â
Innovation Games â born out of market research:Customer insights, product development, customer engagement, prioritisation[twitter] Tools to measure intangibles in SharePoint Social projects â Innovation Games (See our next session!) #InnovGames [/twitter]Â [twitter] Book: Innovation Games - By Luke Hohmann [/twitter]Â
Where do we go now? What can we do..
Rule #1 â Start with âWhy?âRule #2 â BHAGRule #3 â Base-line (measurable business outcomes)Rule #4 â Tune the Engine -> Continuously improve -> on-going agile projects -> Measure & gain validated learningRule #5 â Beware âvanity metricsâRule #6 - Pivot or persevere[twitter] Measuring the intangible, SharePoint Social ROI â 6 ingredients in the recipe for success![/twitter]Â
Rule #1 â Start with âWhy?âRule #2 â BHAGRule #3 â Base-line (measurable business outcomes)Rule #4 â Tune the Engine -> Continuously improve -> on-going agile projects -> Measure & gain validated learningRule #5 â Beware âvanity metricsâRule #6 - Pivot or persevere
Rule #1 â Start with âWhy?âRule #2 â BHAGRule #3 â Base-line (measurable business outcomes)Rule #4 â Tune the Engine -> Continuously improve -> on-going agile projects -> Measure & gain validated learningRule #5 â Beware âvanity metricsâRule #6 - Pivot or persevere
Rule #1 â Start with âWhy?âRule #2 â BHAGRule #3 â Base-line (measurable business outcomes) not technical featuresRule #4 â Tune the Engine -> Continuously improve -> on-going agile projects -> Measure & gain validated learningRule #5 â Beware âvanity metricsâRule #6 - Pivot or persevere
Rule #1 â Start with âWhy?âRule #2 â BHAGRule #3 â Base-line (measurable business outcomes)Rule #4 â Tune the Engine -> Continuously improve -> on-going agile projects -> Measure & gain validated learningRule #5 â Beware âvanity metricsâRule #6 - Pivot or persevere
Rule #1 â Start with âWhy?âRule #2 â BHAGRule #3 â Base-line (measurable business outcomes)Rule #4 â Tune the Engine -> Continuously improve -> on-going agile projects -> Measure & gain validated learningRule #5 â Beware âvanity metricsâRule #6 - Pivot or persevere
Rule #1 â Start with âWhy?âRule #2 â BHAGRule #3 â Base-line (measurable business outcomes)Rule #4 â Tune the Engine -> Continuously improve -> on-going agile projects -> Measure & gain validated learningRule #5 â Beware âvanity metricsâRule #6 - Pivot or persevere
Final point is that IMHO this process (SharePoint Social projects) is infiniteâŠHave to be making progress towards the goals (What and Why) but organisations change, tech maturity evolves, the process is ongoing.[twitter] SharePoint Social projects â Expect this to be an infinite journey towards your goals [/twitter]Â
[twitter] Andrew McAfee Quote - start thinking abt busy users with short attention who need 2 GTD & can always reach for email.â [/twitter]Â
Any further questions?[twitter] That was âMeasuring the Intangible, SharePoint Social ROI sessionâ. Thank you all[/twitter]Â
[twitter] Donât forget to come to 21apps next session - SharePoint âInnovation Gamesâ Workshop #spsuk38 [/twitter]Â