This workshop provided an overview of becoming a data-informed organization through measuring social change and media efforts. The presenters discussed the five stages of measurement acceptance from denial to becoming data-informed. They provided case studies of organizations at different levels of maturity including the Humane Society of the United States and an arts nonprofit. Key lessons included establishing clear goals and KPIs, overcoming silos between departments, learning from both successes and failures, and using data to continuously improve strategies.
Measuring Your Mission: Using Data to Track Organizational Health and Success...Idealware
As a leader of your organization, you'd probably like to see clear metrics to track your programs, outreach efforts, and the financial health of your organization. It can be daunting to define the right measures though -- where do you even start? Based on NTEN's and Idealware's research into what's actually working for nonprofits, we'll talk through what you should think about to define your own data-based metrics strategy, and hear from organizations who have successfully implemented their own strategies.
Things you should know about cloud HR solutions Rob Scott
To get the booklet go to www.presenceofit.com.au/news-events/things-you-should-know-about-cloud-hr-solutions
We are about to release our research booklet entitled "Things you should know about cloud HR solutions". It's a fascinating insight into 8 key areas to be aware of during a cloud HR solution implementation.
Mobile strategy for community news and engagementAmy Gahran
Amy Gahran's presentation on how local or regional news and info projects can use mobile technology to engage communities: where to start, what to focus on. For the Knight Community Info Challenge bootcamp, Sept. 24, 2012.
Measuring Your Mission: Using Data to Track Organizational Health and Success...Idealware
As a leader of your organization, you'd probably like to see clear metrics to track your programs, outreach efforts, and the financial health of your organization. It can be daunting to define the right measures though -- where do you even start? Based on NTEN's and Idealware's research into what's actually working for nonprofits, we'll talk through what you should think about to define your own data-based metrics strategy, and hear from organizations who have successfully implemented their own strategies.
Things you should know about cloud HR solutions Rob Scott
To get the booklet go to www.presenceofit.com.au/news-events/things-you-should-know-about-cloud-hr-solutions
We are about to release our research booklet entitled "Things you should know about cloud HR solutions". It's a fascinating insight into 8 key areas to be aware of during a cloud HR solution implementation.
Mobile strategy for community news and engagementAmy Gahran
Amy Gahran's presentation on how local or regional news and info projects can use mobile technology to engage communities: where to start, what to focus on. For the Knight Community Info Challenge bootcamp, Sept. 24, 2012.
Mary will discuss the Pew Internet Project’s latest research on Americans’ use of social media, including how different demographic groups use various platforms. She’ll also present findings from a recent report looking at the phenomenon of “Facebook fatigue,” and help us to understand how usage patterns might be shifting in the future.
There is a big difference between those companies that manage and deliver performance well and those that don't. Good performance management improves decision making and competitiveness. Poor performance management delivers nothing but added costs. Here are the secrets that set these companies apart.
How Digital Is Becoming A Mobile First ExperienceYuan Wang
We present the latest 2016 mobile marketing statistics and insights, showing increasing consumer adoption and changing behaviour around how people use mobile. We explore various options for using mobile in your marketing such as advertising, apps and campaigns. We summarise the factors influencing how a mobile experience differs from others. We revisit the App vs responsive website debate and propose a new approach. We provide tips on managing your own mobile presence – dos and don’ts, as well as case studies of excellent brand mobile marketing – advertising vs app, larger budget vs smaller budget.
Integrating web analysis in the user experience design processinternetarchitects
Measuring has become more and more important to the job of the information architect.
* We need to measure the KPI's of our projects to assure we meet our customers business objectives.
* We need to measure the usage of the site to assure it's effectiveness.
* We need to measure the users behaviour on the site so we can optimize the information architecture to meet their needs.
* We need to measure business parameters such as sales numbers, conversion rates, ... and compare them to the traffic analysis.
Measuring becomes essential to define what we do but also to define why we do it. We need to justify and document the effect our work has on the overall business. A new generation of tools allows us to integrate data from traffic analysis, CRM, ERP, with our traditional work of defining navigations, taxonomies, content organization, etc.
Most usability tests only include a small sample of users meanwhile there is data available on all of our visitors behaviours, we need to exploit this data and use it to define and refine the overall user experience of our online projects.
Conteúdo formulado especialmente para o workshop ministrado no Social Media Week São Paulo 2012 (http://socialmediaweek.org/saopaulo/)
As planilhas de referência citadas na apresentação estão disponíveis para download em http://www.mediafire.com/?n60n98wubsb36
The Top 5 Performance Management ToolsBernard Marr
Summary of a report that looked at the state-of-the-art in performance management. It identifies the top 5 tools used today to manage performance and adds some words of advice.
Key Performance Indicators (KPIs) should be used to understand performance and drive better decision-making. However, most companies struggle to find the vital few KPIs. Here is a list of the 25 top KPIs is use today.
Becoming a Data Informed Nonprofit - Beth Kanter WebinarSalesforce.org
Nonprofits spend considerable time creating and curating content to share on Twitter, Facebook, and other social networks. But most groups aren’t properly measuring whether these efforts are worth the time and cost. And it can seem like a daunting task to put together an effective strategy for collecting and analyzing data about your social-media efforts.
How does one know where to begin? Beth Kanter, co-author of Measuring the Networked Nonprofit, will discuss how to measure the return on social-media investments with a FREE WEBINAR.
During this free webinar, you’ll learn how to:
• Do more than just count friends and followers.
• Explore how to identify what data is available.
• Collect and analyze these numbers so that you can make smart decisions about your social-media strategies.
Beth Kanter, co-author of Measuring the Networked Nonprofit, will teach this webinar.
Nonprofits spend considerable time reaching out to supporters via Twitter, Facebook, and other social networks. But most groups aren’t properly measuring whether these efforts are worth the time and cost. And it can seem like a daunting task to put together an effective strategy for collecting and analyzing data about your social-media efforts. Beth Kanter shares tips for how to measure your social media efforts.
Learning Analytics Primer: Getting Started with Learning and Performance Anal...Watershed
Navigating the scope of disruptive analytics solutions to deliver maximum impact. Learn more about the importance of scalable learning in organizations that want to embrace an environment of continuous improvement. Mike Rustici provides a workshop on the five steps to get started with learning and performance analytics. Ranging from gathering your data using methods like experience API, to setting metrics and evaluating impact of learning programs.
Finding Meaning in the Numbers: Making Data-Informed Decisions Across Your Or...TechSoup Canada
Does your nonprofit track vital data -- but lack the time and resources to make sense of it? Don't worry! TechSoup Canada is here to help make your data work for you.
Join us to learn how to create a reasonable and manageable data strategy, and how to foster a culture of data-informed decision making across your entire organization.
In this webinar, you will learn how to:
-harness the potential of business intelligence and Big Data
-create and implement an integrated data strategy
-overcome institutional resistance and foster a culture of data-informed decision making
-use dashboards to gain insight into a variety of data sources
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
GridMate - End to end testing is a critical piece to ensure quality and avoid...ThomasParaiso2
End to end testing is a critical piece to ensure quality and avoid regressions. In this session, we share our journey building an E2E testing pipeline for GridMate components (LWC and Aura) using Cypress, JSForce, FakerJS…
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...SOFTTECHHUB
The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing.
One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
Removing Uninteresting Bytes in Software FuzzingAftab Hussain
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
Maruthi Prithivirajan, Head of ASEAN & IN Solution Architecture, Neo4j
Get an inside look at the latest Neo4j innovations that enable relationship-driven intelligence at scale. Learn more about the newest cloud integrations and product enhancements that make Neo4j an essential choice for developers building apps with interconnected data and generative AI.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Climate Impact of Software Testing at Nordic Testing DaysKari Kakkonen
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank
Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.
Communications Mining Series - Zero to Hero - Session 1DianaGray10
This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered:
• Communication Mining Overview
• Why is it important?
• How can it help today’s business and the benefits
• Phases in Communication Mining
• Demo on Platform overview
• Q/A
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
UiPath Test Automation using UiPath Test Suite series, part 5DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 5. In this session, we will cover CI/CD with devops.
Topics covered:
CI/CD with in UiPath
End-to-end overview of CI/CD pipeline with Azure devops
Speaker:
Lyndsey Byblow, Test Suite Sales Engineer @ UiPath, Inc.
3. Katie Delahaye Paine
Publisher
The Measurement Standard
News Group International
kdpaine@kdpaine.com
www.themeasurementstandard.com
http:/kdpaine.blogs.com
Fellow and Board Member: Society for New Communications Research
IPR Measurement Commission
3/7/2013 www.themeaasurementstandard.com
4. David J. Neff, Author and creator
Lights. Camera. Help. / SXSW
2013
@daveiam
@npfilm
7. Who are you?
Raise your hand if …….
- Social Media Manager for Nonprofit
- Social Media Manager for For-Profit
- Other Nonprofit Staff
- Consultant/Social Media
- Consultant/Measurement or Evaluation
- Other
8. And your Org?
Raise your hand if
organization is budget is ..
-Less than $1 million
-$1-$5 million
-Over $5 million
Type ..
-Social Service
-Environment
-Arts
-Education
-Animal Welfare
-Community Services
-Health Care
-Other
9. Workshop Agenda
AGENDA
OUTCOMES
Introduction Understand how to
get started with a
measurement
Data Informed
program for your
Organization organization’s social
media
Case Studies
FRAMING
7 Steps of
Measurement Interactive
Case Studies Fun
Wrap Up #NETNON
10. Raise Your Hand If Your Strategy Goal Is ….
Improve relationships
Change behavior
Increase awareness
Increase engagement
Increase dollars
Increase action
28. Why did it fail?
What did we learn?
What insights can
use next time
around?
DoSomething.Org’s Fail Fest
29. CWRF: Becoming Data Informed: What Does It look like?
Crawl Walk Run Fly
Lacks consistent data Data collection Data from multiple Org Wide KPIs
collection consistent but not sources
shared
No reporting or Data not linked to System and structure Organizational
synthesis results, could be for data collection Dashboard with
wrong data different views,
sharing
Decisions based on gut Rarely makes decisions Discussed at staff Data visualization,
to improve meetings, decisions reporting, formal
made using it reflection process
Analysis
Tools
Sense-Making
31. [HSUS Is Data Informed]
HSUS is the nation’s largest and most effective animal welfare organization.
Most Important KPI’s:
• Amount raised
• # of action takers
• # names new to file
• Growth rate
• Customer service wins
32. [Not Every Department Is Data-Informed]
2011: FEAR stage
Web: 1% of donations
2013: DATA INFORMED stage
Web: 33% of donations
35. Measurement Indicators: Analysis
CRAWL WALK RUN FLY
Lacks consistent data Data collection is Data is from multiple Establishes organizational
collection or formal consistent, but not sources and shared KPIs and tracks in
reporting. Draws shared between across departments organizational dashboard
conclusions from departments. Not all through a dashboard. with different views for
incomplete data or data is linked to Does not collect data it departments or levels.
“drive by” analysis. decision-making for doesn’t use. May have data analyst on
better results. Measurable objectives staff.
are based on
benchmarking.
LCH
HSUS
36. [ 2 = WALK Stage for Analysis]
(Some people are
still not all about it
and resist the change
in process )
Our Analysis Process: Our Challenges:
• Everyone gathers their data • Reports aren’t distributed org-wide yet
• We sit in a room and analyze it • Still making some decisions based on what
• The project manager develops a report of we think, not supported by data
“what we did/what we learned/what we • Upper management still not on board, just
recommend for next time “+ data wants things to get done
38. Maturity of Practice: CWRF - Tools
CRAWL WALK RUN FLY
Not using or not Using free or low Using free/low cost Uses professional
using fully. cost analytics tools analytics tools to measurement and
to collect metrics collect metrics and analytics tools.
and analyze further analyze further in Provides training or
in spreadsheets if spreadsheets if uses expert
required for required for consultants to assist
actionable insights. actionable insights. in data/analysis.
Uses social media
management/metric
s professional tool
to collect data.
HSUS LCH
39. [ 3- RUN Stage for Tools ]
• We have the tools in place
• We’ve trained people on how to pull the data
• We’re using several different tools
• We’re keeping a running spreadsheet of data
41. Maturity of Practice: CWRF – Adjustment
CRAWL WALK RUN FLY
Does not use Uses data for Reports are Formal process
data to make decision-making discussed at for analyzing,
planning but not a formal staff meetings discussing, and
decisions. organizational and used to applying results.
process. make decisions Data
that improve visualization and
results. formal reflection
processes.
LCH
HSUS
42. [ 3 – RUN Stage for Adjustment ]
How we’ve adjusted:
• Reports are discussed
• Reports are revisited before
making campaign plans the next
year
• Decisions are based on previous
reports
Example: Hurricane Sandy
• Sharing fundraising worked really
well, will continue to optimize
this technology
• Text to give featured as
prominent giving vehicle in social
media for the first time
• Did very well working in
conjunction with donation link on
Facebook photo album
• Will use again – in disaster
planning will set up social media
text to give code immediately
45. [ Some Advice… ]
1. Patience. It was so hard to get everyone on
board that “data matters.” Be patient.
2. Baby steps. We tried to do too much and
ended up right back where we started.
3. Put together a digestible, ONE PAGE report
on your findings.
4. Figure out the technical stuff. It may take
forever, but you’ll be glad you did.
5. Campaign. Teach others why data and
analysis is so important.
6. Develop a tracking system. Create a
naming convention for your tracking links,
and hold people accountable
7. Narrow it down. Again, don’t try to do too
much. Figure out what matters.
8. Share your successes! Give stakeholders
the report, don’t hoard it!
46. TOP FIVE PIECES OF ADVICE
1) Make it a priority – It’s not just your team in the process
2) Organize – Call an all staff meeting or get it part of a future all
staff meeting
3) Plan using a tool – Find a framework you want to use. Such as
the OGST format
4) Involve your volunteers/board – What data driven professional
can help you solve this issue? Think mgmt consultants,
Programmers, Data designers.
5) Experiment with the tech – Don’t end with Excel. Fail forward
with the best tool for your level of data collection. Pivot Tables
101 anyone?
49. It’s not about you, so get over it
Conversations
Member
Development Research Volunteers Funders HR Recipients
Service
Savings, shorter cycles, more renewals, better ideas,
research
3/7/2013 www.themeaasurementstandard.com
50. The 7 steps to Social Media Measurement
Step 1: Define your goal(s). What outcomes is this strategy
or tactic going to achieve? What are your measurable
objectives?
Step 2: Define your audiences. Who are you are trying to
reach? How do your efforts connect with those audiences
to achieve the goal.
Step 3: Define your investments. What is it really costing
you to achieve this outcome?
Step 4: Define your benchmarks. Who or what are you
going to compare your results to?
Step 5: Define your metrics. What are the indicators to
judge your progress?
Step 6: Select your data collection tool(s).
Step 7: Analyze your data, turn it into action, measure
again
3/7/2013 www.themeaasurementstandard.com
51. Step 1: Define the goals: Why Social Media?
What return is expected? – Define in terms of the mission.
What problems is Social Media supposed to solve?
What were you hired to do? What difference are you
expected to make?
If you are celebrating complete 100% success a year from
now, what is different about the organization?
If your Social Media is eliminated, what would be
different?
51
3/7/2013 www.themeaasurementstandard.com
52. Goals, Actions and Metrics
Goal Action Activity Metric Outcome Metric
Increased Conduct a Number of likes & % increase in donations
Donations photo contest share of contest Cost per new donor
link acquired
Increase Modify % increase in traffic % increase in
membership content, add to web site membership as share of
interactivity income
functions
3/7/2013 www.themeaasurementstandard.com
53. Step 2: Don’t ask me, ask your stakeholders
What you need to listen for:
– What keeps them up at night?
– What are they currently
seeing?
– Where do they go for
information?
– What influences their
decisions?
– What’s important to them?
– What makes them act?
53
3/7/2013 www.themeaasurementstandard.com
54. Step 3: Establish benchmarks
Past Performance
Think 3
– Peer
– Underdog competing for share of
wallet
– Stretch goal
Whatever keeps the Board suite
up at night
3/7/2013 www.themeaasurementstandard.com
55. Step 4: Why you need a Kick-Butt Index
The Perfect KPI
Is actionable
Is there when you need it
Specific to your priority
Continuously improves your
processes
Gets you where you want to go
You become what you measure,
so pick your KPI carefully
55
3/7/2013 www.themeaasurementstandard.com
56. Step 5: Define your investment
Be honest – Social Media is not “free”
Be transparent
Don’t forget opportunity costs
The CFAC example
3/7/2013 www.themeaasurementstandard.com
57. Step 6: Pick the right measurement tools
If you want to measure messaging,
positioning, themes, sentiment: Content
analysis
If you want to measure awareness,
perception, relationships, preference:
Survey research
If you want to measure engagement,
action, purchase: Web analytics
If you want predictions and correlations
you need two out of three 57
3/7/2013 www.themeaasurementstandard.com
58. Step 6: Selecting a measurement tool
Objective KPI Tool
Increase inquiries, web traffic, % increase in traffic Web Analytics: Google Analytics,
recruitment #s of clickthrus or downloads Omniture, Web trends
Increase awareness/preference % of audience preferring your brand Survey: Phone Calls, SurveyMonkey,
to the competition or Mail
Engage marketplace Conversation index greater than .8 Web analytics or Content Analysis:
Rankings Facebook Insights, Convio, Omniture,
% increase in engagement Google Analytics
Communicate messages % of articles containing key Media content analysis, Survey
messages Research
Total opportunities to see key
messages
Cost per opportunity to see key
messages
58
3/7/2013 www.themeaasurementstandard.com
59. The ROI of Emily
59
3/7/2013 www.themeaasurementstandard.com
60. So What = Revenue
35,152,789 OTS
Red line
indicates
media
6,253,852 OTS impressions
60
3/7/2013 www.themeaasurementstandard.com
61. Thank You!
For more information on measurement, read my blog:
http://kdpaine.blogs.com or subscribe to The Measurement Standard:
www.themeasurementstandard.com
For a copy of this presentation go to: http://www.kdpaine.com
Follow me on Twitter: KDPaine
Friend me on Facebook: Katie Paine
3/7/2013 www.themeaasurementstandard.com
63. [ 7 Steps of Measurement – Hurricane Sandy ]
Goal: Audience:
Investment:
Raise $x million to people who love
staff time,
support animal animals and want
technology hosting
relief efforts to help
Metrics:
Tools: Benchmarks:
amt. of donations,
Convio, Tweetdeck, last hurricane
donations by
Facebook Insights, (Isaac) we raised $x
source,
Twitter ad platform thousand
sentiment %
Insights:
text to give fundraising in social media works really well so we need to do more of
it, we raised a significant amount of money via sharing so we need to continue to
optimize that medium, Facebook photo album tied to donations worked because
people are so visual so we need to use photos more to tell our story.
68. INVESTMENT
Staff Time
Consultant Time
Volunteer time
Technology costs (App, VWALL, Web Site, Hosting)
69. BENCHMARK
Adoption is hard to track (multiple shelters/locations/city vs
nonprofit)
Varied programs that have varied results across the United
States.
No previous adoption program that contained all the metrics and
goals that we would be experimenting with.
70. METRICS
Once again, adoption is hard to track
What can we track to get people to think about adoption?
- Pledges to Adopt
- Pledges to visit a shelter
- Pledges to walk a dog at a shelter
- Pledges to tell their friends about adoption on social channels
- Pledges to take a photo of a dog at a shelter
- Join a fundraising event in your area
71. TOOLS
HTML/CSS for Site
iPhone = C++
Android = Java
Vwalls = Java
Social Channels = FB, Twitter, YouTube, Later Foursquare
Meetup.com. Wait? People still use that? YES.
Measuring with TweetReach and SproutSocial
72. INSIGHT
1) Should of defined a tighter audience with personas.
2) Undertaking dual app development in concurrent work streams
is a GIANT PAIN IN THE ASS.
3) Working with Apple to get an app in the app store is a GIANT
PAIN.
4) People loved sharing user generated content. We even had
people create meme’s around invisible dogs. Community for
BFAS is inspiring.
5) App market is crowded. Needed to spend more budget towards
marketing the adoption app.
73. It is your turn
to apply the
7 steps!
Step 1: Pick A Result
Improve relationships
Change behavior
Increase awareness
Increase engagement
Increase dollars
Increase action
Measuring Social Change & Media: Beyond BS This workshop will dramatically demonstrate how the practice of measurement, social media, social change, and networks have evolved over the past 5 years. In 2009, the "Social Media ROI Poetry Slam" SXSW lead to a book "Measuring the Networked Nonprofit." The thesis: For nonprofit organizations there are two key processes that lead to social change: To become networked, and to use measurement. The book's co-authors, Beth Kanter and KD Paine will facilitate an updated of the original poetry-slam session with the same four nonprofit leaders about they have used networked strategies and measurement to improve results and transform failure into success. http://www.flickr.com/photos/e06158/6953185456/
Overview of what Lights. Camera. Help. is. How It was founded why it’s important. A little about the book and that it’s for sale after the session.
Measuring Social Change & Media: Beyond BSMonday March 1111am-1:30pmAT&T Conference CenterClassroom 2041900 University Avenue Learning ObjectivesWalk away with a basic understanding of what it means to be data-informed and the 7 steps of measurementLearn about how leading nonprofits are using measurement to improve results of their social media and have a data-informed cultureHow to apply the first step of the 7 steps of measurement – linking your organization’s success to your department’s KPI
http://www.flickr.com/photos/tom-poes/505598151/in/photostreamI’ve been watching you ….Some of you already know that ….
The c-suite has just approved your strategy to leverage networks and social media for your mission. But, if your internal culture is not a social one how can you possibly expect to be successful? This workshop will share strategies and techniques for changing your nonprofits culture to be more agile, training other staff to be social to scale, and managing your nonprofit's c-suite and board. The workshop will share tips and techniques for culture change, training, and adoption. Best of all, there's nothing like peer to peer support in this effort to keep inspired. Designed as a peer learning session with Internationally acclaimed Master Trainer Beth Kanter and leading social media nonprofit practitioners like NWF's Danielle Bridiga, Rachel Weidinger from Upwell, and Laura Fitton from Hubspot. Walk away with a basic understanding of what it means to be data-informed and the 7 steps of measurementLearn about how leading nonprofits are using measurement to improve results of their social media and have a data-informed cultureHow to apply the first step of the 7 steps of measurement – linking your organization’s success to your department’s KPI
There’s another important organizational skill - data-informed this describes agile, responsive, and intelligent nonprofitsthat are better able to succeed in a rapidly changing environment and can fuel networks of networks. DoSomething.org has a big hairy social change goal: To harnesses teenage energy and unleash it on causes teens care about by launching a national campaign per week. The call to action is always something that has a real impact and does not require money, an adult, or a car. Their measurable goal is to get 5 million active teen members engaged in social change campaigns by 2015. Their use of social media, mobile, and data all strategically selected and use to reach that goal.They are a networked nonprofit with a data informed culture – and it started at the top with their board and advisors ..Reid Hoffman and DjPatil – “A Data Scientist” – have advised the CEO – Nancy Lublin – not only what infrastructure is needed to collect and make sense of data, but how she as the leader can’t rely on hunches – decisions – have to be informed by data.
http://www.flickr.com/photos/mkrigsman/3428179614/DoSomething has two data analyst positions on staff .. And they aren’t sitting in the corner playing with their spreadsheetsWhile a big part of their job is to become the stewards of the dashboard, they work with staff – so that making sense of data Is not an adhoc process, but one of continous improvement of the programs. The data analysts work collaboratively with staff to help them apply and understand their data.
One of their organizational mantra is “Spend More Time Thinking About The Data, Less On Collecting ItPregnancy Text” Campaign featured on their quarterly dashboard. This clever sex education campaign is an updated version of the teen pregnancy education program where young people carried eggs around and pretend they are babies. It was a text campaign where teens opted in to receive texts on their mobile phones from the “baby.” Once they joined (and they could share it with their friends). they received regular annoying text messages at all hours from the “baby” that poops, cries, and needs their immediate attention.The team at DoSomething.org uses data to base the program design, key performance indicators and a hypothesis to be tested. They looked at survey data from the National Campaign: nearly 9 in 10 (87%) young people surveyed also say that it would be much easier for teens to delay sexual activity and avoid teen pregnancy if they were able to have more open, honest conversations about these topics with their parents and/or friends. So, success of this campaign would be mean that participants talk with their family or friends about the issue and delay sexual activity.The basic design had those who signed up challenge their friends to take care of a text baby either by (1) going to DoSomething website and selecting 5 friends to challenge or (2) after receiving a text from DoSomething (sent to DoSomething’s 300k mobile subscribers) would opt to challenge friends after reading a quick stat on US teen pregnancy. Participants that accepted the challenge would then start receiving texts the following morning from the text-baby. After completing the challenge user were prompted to send it to their own friends.DoSomething.org also followed up with 5k of the users with a text-based survey to measure impact.Once defining success and identifying the right data collect, here’s some of the insights they gleaned according to Nancy Lublin, CEO of DoSomething and Jeffrey Bladt:SMS as a platform: They are monitoring engagement per communication channel and it has revealed SMS to be 30xs more powerful for getting their users to take action as compared to emailChallenging 5 friends: we’ve tested various group sizes for SMS experience and have found the a group of 6 (1 alpha inviting friends) leads to the highest overall engagementResearch Based Messaging: The general messaging for the campaign was based on survey findings that found (1) big scare tactics (e.g. getting pregnant = not going to college) we not as effective as highlighting who being a teen parent changes daily life (e.g can’t go to the movies because baby sitter cancelled); (2) a CDC report that found: “The impact of strong pregnancy prevention messages directed to teenagers has been credited with the [recent] teen birth rates decline.A/B Testing: They pre-tested different messages and frequency of sending the messages to smaller test groups of teens to optimize the number of messages the baby would send during the day, as well as the content. They ended up doubling the frequency and rewording several interactions as well as building in a response system (so the baby would respond if teen texted an unsolicited response). The insights from these tests pushed up engagement and likelihood of forwarding at the end.Impact: They did a survey to measure this. 1 in 2 teens said that taking the Pregnancy Text made it more likely that they would talk about the issue of teen pregnancy with their family and friends.As you can see from the above insights, DoSomething just not gather and analyze topline data:101,444 people took part in the campaign with 100,000 text-babies delivered171,000 unsolicited incoming messages, or 1 every 20 seconds for the duration of the campaign. During the initial launch period (first 2 weeks), a new text message was received every 10 seconds.For every 1 direct sign-up, DoSomething gained 2.3 additional sign-ups from forward to a friend functionality. The viral coefficient was between 0.60 and 0.70 for the campaign.1 in 4 (24%) of teens could not finish a day with their text-baby (texted a stop word to the baby)DoSomething.org uses its data to continuously improve programs, develop content, and shape campaign strategies. So DoSomething.org wants its staff to spend more of its brainpower thinking about the data, rather than collecting it. To ensure that this happens, DoSomething.org’s Data Analyst Bob Filbin’s job is more than programming formulas in Excel spreadsheets. Says Filbin, “One of the biggest barriers in nonprofits is finding the time to collect data, the time to analyze, and the time to act on it. Unless someone is put in charge of data, and it’s a key part of their job description, accelerating along the path towards empowered data-informed culture is going to be hard, if not impossible.”
No addhttp://www.youtube.com/watch?v=QhgsJjNVbu0http://gawker.com/5950941/kathie-lee-dropped-a-puppy-on-his-head-on-live-tv-todayhttp://www.youtube.com/watch?v=sQzo_3yIc8M
Back in the office, the data scientists were looking at the data in real time to figure out what was driving people to their landing page and getting them to sign up.
Fail Fest And Pink Boas: Don’t Be Afraid To FailDoSomething.org doesn’t use its data to pat itself on the back or make the staff feel good. Lublin notes that they’re not afraid of failure. They hold regular “Fail Fest” meetings, where each person on staff has to present a campaign or program failure. They share three things they learned about themselves and three things the organization learned. To remove the stigma from failure, Lublin says, “We have to wear pink boas when we present.” http://www.flickr.com/photos/ruminatrix/2734602916/in/faves-cambodia4kidsorg/
The “Crawl, Walk, Run, Fly” Maturity of Social Media practice framework is in Beth’s next book, Measuring the Networked Nonprofit. We used to help us design the program, determine process outcomes, and help us evaluate our progress.Explain modelPhotos: Runhttp://www.flickr.com/photos/clover_1/2647983567/Flyhttp://www.flickr.com/photos/micahtaylor/5018789937/
Slide 1: Organizational Elevator Speech and Key Results for Social Media – What is an example of your KPI metric linked to your department or personal goal/definition of successNotes: My favorite is the customer service wins. These are the intangible benefits of social media, which we showcase via screenshots in a weekly Social Media Mentions Report. This way, executives can see when we turn people around one-by-one, even though there is no numerical way to measure this.
Notes:It was hard to get the web team to buy into source coding. It was a change in their daily routines of publishing content: now they had to get a source code for each hyperlink they inserted. But when they saw the change from the disaster campaign last year to this year, and web got much more credit for fundraising, they were really excited. They felt accomplished. That was what it took to get them to accept.
Overview of what Lights. Camera. Help. is. How It was founded why it’s important. A little about the book and that it’s for sale after the session.
This is great – you could link this to KD Paines “Think about a key performance indicators as a “kicking butt index” – and what would result if you could say, “Boy are we kicking butt” – also to ask what would it look like if “Wow, we’re getting butt kicked” More on selling tickets and how we measure that.
For your action learning projects, it will be important for crawlers – to set up a regular system and discipline – don’t take on too big a project .. Make it small winFor those walking, important to get everyone’s input …. I know this can be tricky – but we are here to support you.
Slide 2: Where are you on the CWRF scale for the measurement indicator: analysis? Why? Share a screen capture, photo, or something that you can explain why. Walk-2Data collection is consistent, but not shared between departments. Not all data is linked to decision-making for better results.(I will insert audience poll – and depending on the results ask you for your advice to walkers to get to running, etc)
Analysis. Organization data collection is consistent, but not shared between departments. Not all data is linked to decision-making for better results.Data is from multiple sources and shared across departments through meetings. No dashboard, no staff to collect, just volunteers and board members helping get it all up and running.
Slide 3: Where are you on the CWRF scale for the measurement indicator for tools? Why? Screen shot, photo, or something. You can talk about your organization’s favorite metrics/analysis tool and why?ToolsUsing free/low cost analytics tools to collect metrics and analyze further in spreadsheets if required for actionable insights. Uses social media management/metrics professional tool to collect data. Notes: my favorite is Google Analytics because I can create reports based on what I’m looking for. I do like SmallAct too, because it can drill down data on specific users, and there’s something very cool and big brother about that.
We are executing great on our tools and collection of information through those tools. Using free/low cost analytics tools to collect metrics and analyze further in spreadsheets if required for actionable insights. Uses social media management/metrics professional tool to collect data. Uses professional measurement and analytics tools. However not training people or other volunteers. No outside experts helping us.
Slide 4: Where are you on the CWRF scale for the measurement indicator adjustment? This is about how you use your data for decision-making. It would be great to have an example of a data point that you collected – an KPI related to your goals – what the data said and how you applied to getting results or adjusting what you’re doing. Any formal processes for data visualization, learning from failure, etc would be great to cover. AdjustmentReports are discussed at staff meetings and used to make decisions that improve results.
We are not identifying our data correctly. And not sourcing it correctly. Hence the Taxonomy fail. And since we are an all run volunteer organization it’s hard for us take action on the adjustments. Much like mindless zombies we repeat the mistakes of the past. We are big believers in failing fast and learning from our mistakes. As an all volunteer org this can be a hard thing to keep inYour DNA. So how are we planning to fix this in 2013?
Slide 5: Your wisdom or advice to audience about becoming data informed.Notes:We created a “source jar” where if you did the sourcing convention wrong (lazy) you had to put a quarter in the source jar. When we got enough money, we’d all go out for ice cream. We haven’t gotten enough money yet!From NTEN:Change, a quarterly journal for nonprofit leadersTech Across Your Org: Internal Communications Carie Lewis, HSUS How to Talk About the Right Data in the Right Way Within Your OrgThe Humane Society of the United States has a well-established and successful online communications program. But here’s one thing we’re not so great at: the world of data. And we know it. But we decided to turn that around this year, and so far it’s been successful for us.Our online team is 30 staffers strong, broken up by channel: email, website, social, mobile, and online advertising. There is no specific role for reporting; we all are pretty much on our own to evaluate our work. We’re always winning campaigns and creating real change for animals, but what if we could do that in a way that was – smarter?So we made a commitment to move towards a more data-driven culture. We wanted to know: how can we use statistical data to work smarter and make better decisions about how to be more effective in our work? Not having any existing structure, we made the mistake of getting in too deep to start. Each channel manager came to a meeting where we’d fill out this huge excel spreadsheet full of numbers, as well as a word document filled with explanations and screenshots. It seemed brilliant – every data point we could possibly get in one place! Until we had to do it again. It was such a huge task (not to mention exhausting) that we just gave up on it. We couldn’t even make meaning of the data anyway because there was too much of it. So we stopped meeting. And tracking. And we failed.Then, we realized our problem. We were trying to do too much. We decided we had to narrow down the stats to what meant the most to us (which for us is usually advocacy and fundraising-focused). We then had to determine what really mattered for the whole process -- why were we doing these reports? For us, it was to evaluate what we did, what worked (and what didn’t), and determine how we could do things differently next time. And from that was born our new reporting system which has worked very well for us so far in 2012.The New Reporting Process:Each time an online campaign is over, the channel managers meet to discuss how the campaign performed. We all have our own metrics and data, depending on what’s important to our channel, and have only 10 minutes to share with the rest of the group. (We’re all about reducing meeting time here at HSUS as well.) The discussion is usually very productive and eye-opening. We’ve found that metrics change from campaign to campaign, so it’s helpful NOT to have a standard template with every metric available. But the most important metric to focus on across all campaigns is conversions – in the end, did people do what you wanted them to do?After the initial meeting, each channel manager sends the campaign’s project manager a summary of the most relevant information, and the project manager compiles it into a one-pager. It’s easy for everyone (including executives!) to digest, and breaks the campaign down into what we did, what we learned, and what we recommend for next time. In the end, that’s exactly what we want the data to tell us.The Lessons We Learned:- Data matters. Do track – even if it’s exhausting.- Educate others on the importance of tracking and how to do it consistently.- Don’t try to do too much – it’s better to track a few key metrics consistently than to track a lot of data inconsistently or to the point that you give up.- Narrow down the stats that matter most to your bottom line.- Present data in a way that is easily digestible by anyone at your organization.As I mentioned, our biggest “ah-ha” moment was when we realized we were trying to do too much, and we lost focus and interest and just gave up. Figure out what really matters and how you can get that data. It was essential that we educate others about the importance of using trackable links and come up with a naming convention for those links so that when we pulled the data, we’d know where conversions were coming from. There’s a huge cross-organization education task here. We had to teach colleagues that don’t work in Online Communications why a page view wasn’t an acceptable success metric (it’s about conversions!)So, how is it going? I’ll let you know next year when we pull out the one-pager during the campaign planning process! The goal is for these one-pagers to help us make informed campaign planning decisions. Each one-pager represents the key take-aways from this year’s campaigns so we can see what worked and what didn’t. We can replicate the tactics that worked and improve or eliminate the tactics that failed.I can tell you that since we instituted this new tracking system we’ve garnered over 100,000 action takers from social media so far this year, which is double our goal for the year! That’s really great information as I work to prove the impact that social media has on our bottom line here at HSUS. And that’s really what it’s all about – meeting your goals and working smarter.
See slide and will add color.
Where do I start? Is a question I get frequently, and my response always is “Don’t ask me, ask your stakeholders.” You may need to do some research before you jump in. That’s what listening really is, isn’t it? You need to know what keeps them up at night, where they go for information, what ELSE they’re seeing out there and what makes them act.
Measurement is a comparative tool. You don’t know if your results are good or bad unless you can put them into context, either looking at them over time, or in comparison to a peer group. The most important entity to measure against is whatever keeps your bosses up at night.
There really are only three times of tools in social media measurement If you want to measure messaging, positioning, themes, sentiment you need Content analysisIf you want to measure awareness, perception, preference you need Survey researchIf you want to measure engagement, action, purchase: you need Web analyticsIf you want predictions and correlations you need two out of three
David and Carrie presentations on how their organizations applied 7 steps for a campaign or project or something – 12 minutes each – w/ 3 minutes of questions from KDGoal > Audience > Cost > Benchmark > Metrics > Tool > InsightStep 1: Define your goal(s). What outcomes is this strategyor tactic going to achieve? What are your measurableobjectives?Step 2: Define your audiences. Who are you are trying toreach? How do your efforts connect with those audiences toachieve the goal.Step 3: Define your investments. What is it really costing youto achieve this outcome?Step 4: Define your benchmarks. Who or what are you goingto compare your results to?Step 5: Define your metrics. What are the indicators to judgeyour progress?Step 6: Select your data collection tool(s).Step 7: Analyze your data, turn it into action, measure again
Launch the campaignRun a donations by source report in Convio, export to ExcelFill in reporting templateMeet with other channel managers to discuss dataFill out What we did/what we learned/what we recommend for next time reportSend report to stakeholdersLook at report before the next campaign and make decisions based on content of the report
Move people some simple awareness up the “Adoption” ladder to REAL ADOPTION. Shocking but true. You can watch the Sarah McLaughlin commmericals and donate all you want. But how do you get people to take action?
The problem with this project is that our audience was a littefuzZY. Just like this photo. And as our project involved User Generated Content (both from the app and the from the VWALL) we had a couple of weirdos pop up from the audience. Much like this guy in the front row. : )
Talk about costs and app development and user generated content
See slide and will add color
See slide and David will add color.
Overall numbers were very good for moving a tough subject into the public’s eye. As we talked about in the book on page 88 we had over 40k people visit the first month and got over 2,000 of them to take the pledge at one level of the engagement ladder or another. However Best Friends learned that the app was popular but not enough to keep it in the store. As part of this we launched the National Shelter Check-in Day. That program still takes places. It was initally a small part of this overall project. However it’s popularity was sustained and it’s remained a viable program for BFAS into 2013 and beyond.