1. The Tech Leadership Academy is made possible by generous funding from Microsoft Community Affairs Evaluation: Technology ROI Beth KanterAuthor, Beth’s BlogPartner, Zoetica These materials are available under the Creative Commons Attribution-NonCommercial 3.0 License.
2. Understanding how to apply an ROI process to technology decision-making with help your organization avoid making mistakes and save valuable time and resources. These materials are available under the Creative Commons Attribution-NonCommercial 3.0 License.
6. Provide a methodology for analyzing the return on investment of technology that includes both quantitative and qualitative outcomesThese materials are available under the Creative Commons Attribution-NonCommercial 3.0 License.
7. INSERT Poll: Have you ever asked or been asked these questions What is the value (of x technology) ? Should we invest our time or money in this technology?
8. Has your organization conducted an ROI analysis or study as part of a technology investment? Yes No
9. Objective 1 Understand the importance of evaluation in successfully managing technology :
10. What three words are top of Mind when you think about A successful ROI process? TYPE into the CHAT
11. What: Return on Investment An analysis that looks at the benefits, costs, and value of a technology initiative over time.
20. How much time will staff members save with laptops? How does access to technology and information improve services to client? Laptop Project Pilot
21. Cost of travel time from monthly time sheet Mileage # Trips Needed w/out laptop # Trips Needed w/laptop Value of Shifted Time
22. Articulated value of using Facebook and Twitter as: -Customer Service-Efficient way for staff to answer public health questions -Efficient communication with journalists Quantified: Saved TimeSaved Paper and Postage Positive word of mouth -
23. “People regard our program as honest and informative. After almost two years on the social media front, we’ve developed a good system to get timely and accurate public health messaging to our communities. We firmly believe that our presence on social media sites has really enhanced our communication with the media and public. Executive Director, Gary Edwards said it best in our 2010 Annual Report; that during tough economic times, SLVHD rose to the occasion and found innovative, cost effective ways to communicate with our community. “ - VannaLivaditis, New Media Coordinator
24. Ladder of Value Results Impact $ Investment Interaction Insight Number of Months Strategy, Measure, Improve
25. Use ROI if….. Long Life Cycle Mission Critical Linked to Strategic Goals Large Investment Visible or Controversial Change management Large Target Audience And ….
27. Discussion: Do these principles make sense? Why or why not? Anything missing from the list? Is there a time when you didn’t follow one of the principles? What happened? What did you learn from it? What are some ways that you have applied these principles to your own ROI work?
28. Objective 2: Provide a methodology for analyzing the return on investment of technology that includes both quantitative and qualitative outcomes
31. Efficiency Improves the ability to maintain a system Eliminates duplicate systems Accommodates increases in workload or demand without additional costs Reduces manual operations Improves efficiency Reduces Travel Cost/Time
32. Improves ability to deliver Improves access to services Improves access to information Improves accuracy Improves effectiveness of information delivered Effectiveness
41. Keep in Mind List all benefits regardless of whether or not they initially appear difficult to support or quantify
42. ConversionTest 1. Does an acceptable, standard metric exist for the measure? 2. Can the conversion be accomplished with minimum resources? 3. Can the conversion process be described to an executive director and secure their buy-in in five minutes?
43. “Anything can be measured in a way that is superior to not measuring it at all“
48. Staff Surveys Staff Interviews Client surveys Clients Interviews Data from system Task Analysis Times Sheet Analysis Articles Field research Observation Secondary research reports Benchmark studies Budget and Financial Analysis
102. Summary Focus on benefits, not features Resist fondling the hammer Don’t ignore intangibles Use ROI Story Telling techniques Compare costs of alternatives, cost/benefit, and cost of not doing Pilot project to get credible numbers Collect the data you need Use ROI to drive change/buy-in, if needed
103. For Friday Small Groups: Using the principles and methods, design an ROI project for a technology investment your organization is considering .
Editor's Notes
Understanding how to apply an ROI process to technology decision-making with help your organization avoid making mistakes and save valuable time and resources.
Understand the importance of evaluation in successfully managing technologyProvide a methodology for analyzing the return on investment of technology that includes both quantitative and qualitative outcomes
http://www.youtube.com/watch?v=_ANboUjG6GQ&feature=player_embeddedFacebook has become a forum to get people’s questions answered about public healthIf someone asks a question, and they didn’t get to it in time – other people answer itBooking an appointment, couldn’t make it appointment, taking two weeksAsking people for advicePaying attentionQuestion about the two different types of flu vacines ..Person answered, manager put a clarifying answer onTwitter: Helpful, esp. with h1n1 – real-time input – real time conversation, get people’s updates fastConversation – re: h1n1 – help me understand why it is so much more dangerous than regular flu?Helpful to reach reporters – first day h1n1 – fox 13 was camped outside city clinic – getting people to go another clinicReporter had tweeted he was sitting outside at one – and she suggested an alternativeSee you thereDid not take any effort
. To promote interaction, might you ask for participants to think of examples and/or nonexamples? When has following what you have outlined been productive for them? When has failure to follow the ROI principles caused difficulties?Do these principles make sense? Why or why not?Anything missing from the list?Is there a time when you didn’t follow one of the principles? What happened? What did you learn from it?What are some ways that you have applied these principles to your own ROI work?
Understand the importance of evaluation in successfully managing technology