Evaluating Social Media: American Association of Museums (AAM) 2010


Published on

How to navigate a sea of social media technologies and begin to measure success. This presentation explores planning for implementation, developing metrics, defining success, measuring costs and benefits, and applying lessons learned to other online and offline efforts.

Dana M. Allen-Greil - National Museum of American History

Angelina Russo - Associate Professor, Swinburne University Faculty of Design

Published in: Technology, Business
1 Comment
  • great - sorry I missed the session
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • The –RT is better than just the mentions column because it filters out RTs.
  • Evaluating Social Media: American Association of Museums (AAM) 2010

    1. 1. Evaluating Social Media<br />We’re here to talk about:<br />navigating sea of social media technologies<br />planning for implementation<br />developing metrics<br />defining success<br />challenges<br />applying lessons learned to other online and offline efforts<br />
    2. 2. Your conversation influencers<br />Dana Allen-GreilNew Media Project Manager, National Museum of American History@danamuses<br />Angelina Russo, Ph.D.Associate Professor, Swinburne University@artech05<br />
    3. 3. Angelina Russo, PhDAssociate Professor, Swinburne University<br />Angelina Russo leads the ARC research project Engaging with Social Media in Museums at Swinburne University,  which brings together three Australian museums and the Smithsonian’s Cooper Hewitt National Design Museum to explore the impact of social media on museum learning and communication. Between 2005 & 2008 she led the research project New Literacy, New Audiences which examined the development of user-generated content in collaboration with six major Australian cultural institutions.<br />In 2006 Angelina received the prestigious Queensland Premiere’s Smithsonian Fellowship and in 2007 an Australian Postdoctoral Fellowship. Angelina holds a Bachelor of Design in Human Environment Design from University of South Australia and a PhD in Architecture and Design from University of South Australia. <br />
    4. 4. Dana Allen-GreilNew Media Project Manager National Museum of American History<br />Dana manages a range of new media projects including online exhibitions, e-mail newsletters, interactive kiosks, mobile interpretation, online fundraising campaigns, blogs, social media strategies – you name it. <br />Projects she’s most proud of include: the “O Say Can You See?” blog (for which she’s managing editor); the Smithsonian’s first YouTube contest (a national anthem singing competition); and the major redesign of the museum’s Web site in 2005. <br />She’s fascinated by the possibilities of Twitter, and has recently contributed two chapters for the book, Twitter for Museums. <br />She teaches the graduate course, “Museums and Technology,” at The George Washington University.<br />
    5. 5. This is going to get social…<br />Tweet using hashtag #aamSocial(Note: conference hashtag: #aam10)<br />Text to 202.550.9095<br />
    6. 6. What is your biggest social media challenge?<br />Send a tweet to @pollwith the message <br />“26514 + your answer”<br />Send a text to 22333with the message <br />“26514 + your answer”<br />http://www.polleverywhere.com/free_text_polls/LTM2MjQwMjExNg<br />
    7. 7. Sticky<br />Museum Matter<br />Presentation to <br />American Association of Museums<br />23 May 2010<br />Associate Professor, Angelina Russo, PhD<br />
    8. 8. Reflections on social media<br />Can we connect across typologies? <br />Collaborations across the sector are vital <br />Enable audience to develop a sense of national stories<br />how do audiences translate and use materials at a local level? <br />
    9. 9. Reflections on relevance<br />big issues of today – whose problems are they?<br />Build visibility of holders of research data, researchers, technologists – a network of different skill-sets<br />There need to be many paths for describing data<br />
    10. 10. Reflections on audience<br />Need to know who you are trying to reach<br />A clear value proposition (what's in it for them?)<br />Social media provides transparency - builds on goodwill<br />
    11. 11. Relevance<br />Connecting with relevant issues<br />Working with audiences<br />Measurements of success<br />
    12. 12. Listening<br />through aggregation sites like Google Alerts, RSS feeds etc. for topics which are sticky<br />
    13. 13. Identification<br />Identify sticky issues<br />From what standpoint can the museum discuss?<br />How can this discussion add value to the community?<br />
    14. 14. Taking a stand<br />Statement either through an internal or external blog/ radio/ tv <br />Interview/ youtube video - some form of media that connects this issue with the museum for audiences<br />
    15. 15. Communication<br />Dissemination re-distribute through multiple social media sites (Facebook, Ning, Twitter, broadcast tools etc) and you capture the interest through Listening (Google Alerts etc).<br />
    16. 16. Demonstrating Relevance<br />Now you have a form of front end evaluation for topics which are of interest to the public and which you as a museum can contribute to and add value to.<br />
    17. 17. Innovation<br />model where different individuals can contribute where they feel most comfortable<br />
    18. 18. Making museums relevant to the entire community…<br />Desiree Rogers<br />
    19. 19. Next steps…<br />Identify potential projects<br />Experience: multi-platform design & scientific communication (end-to end program which captures imagination, curiosity and illustrates relevant issues)<br />Engagement: co-created content, multiple channels (blog, game, physical exhibit)<br />Environment: flexible practices, organisational management (exhibition scheduled due to public interest)<br />
    20. 20. Engagement<br />what type of engagement you are hoping to achieve based on the issue<br />
    21. 21. Environment<br />what resources do you have available to you?<br />Staff<br />Audiences<br />Independent content creators<br />Educators<br />Other organisations<br />
    22. 22. Audience engagement<br />Content creators as beacons of cultural production <br />Situate creators as leaders in their field<br />Give voice to end-users <br />New networks<br />Potential engagement in pilots and/or cultural prototypes<br />
    23. 23. Experience<br />not everything has to end in an exhibition and/or website.<br />
    24. 24. Creating a discourse<br />agility in responding to issues is sometimes more (or at least just) as valuable than scheduling an exhibition.<br />
    25. 25. Evaluation<br />decide upfront what your measures of success will be for each experience. <br />
    26. 26. Coordination<br />Delegate ownership across the museum; the coordination needs to be led by someone. <br />
    27. 27. How good are you at this whole social media thing?<br />We’re good!<br />We’re great!<br />We’re learning!<br />We stink.<br />Find tweet from @danamuses and click link to poll <br />or use this URL: http://twtpoll.com/ykz916<br />
    28. 28. How good are you at this whole social media thing?<br />http://twtpoll.com/ykz916<br />We’re good!<br />We’re great!<br />We’re learning!<br />We stink.<br />“If you chose anything except #3, you’re wrong.”<br />-Jim Sterne, Social Media Metrics<br />
    29. 29. Evaluating Social Media: A 6 Step Process<br />See “Measuring, Analyzing, Reporting” in Twitter for Museums for details.<br />
    30. 30. 1. Listening<br />They say brilliant conversationalists are actually really just great listeners…<br />What are people saying about you?<br />What aren’t they saying but you wish they were?<br />Flickr photo by vagawi<br />
    31. 31. Basic: Searching on Twitter<br />
    32. 32. Fancy: HootSuite columns<br />
    33. 33. Search for:<br />Your museum’s name (including abbreviations and variations)<br />Exhibition titles<br />Key objects (e.g., “ruby slippers”)<br />Your topic focus (e.g., Holocaust history)<br />Hashtags<br />Places to search:<br />Technorati<br />Social Mention<br />Google<br />
    34. 34. The virtual tour you always wish you had? YouTube<br />
    35. 35. A keyword goldmine: del.icio.us<br />
    36. 36. The image you want to portray? Flickr<br />
    37. 37. Search as conversation<br />When people arrive at your site from a search engine, they are looking for something in particular and are communicating their intent.<br />When people search for something on your site they are communicating their inability to find it through your navigation.<br />-Jim Sterne, Social Media Metrics: How to Measure and Optimize Your Marketing Investment<br />
    38. 38. RSS feeds are your friend!Google Reader Play<br />http://www.google.com/reader/play/ <br />
    39. 39. Create a listening post<br />http://www.netvibes.com/thedailyinfluence <br />
    40. 40. Create a “Makeshift Twitter Archive”<br />Categorizing by a human (time intensive but valuable)<br /><ul><li>Bookmark tweets in delicious using Firefox Bookmark Add-on and tag them (can also then be sucked out as RSS for other uses; can also track blog posts, photos, videos, etc. this way)</li></ul>Passive collection<br /><ul><li>Use a 3rd party notification tool (e.g., TweetBeep) and have it send alerts to Gmail (highly searchable).
    41. 41. Create a TweetScan Twitter Backup (CSV or HTML export).</li></ul>See “Using Twitter for Research” by Beck Tench in Twitter for Museums<br />
    42. 42. What Twitter lists say about you<br />http://www.mustexist.com/list_tags/amhistorymuseum <br />
    43. 43. Defining success<br />“Success in social media is not found in how many people got your message; it’s found in how many people thought your message was remarkable.”<br />-Jim Sterne, Social Media Metrics: How to Measure and Optimize Your Marketing Investment<br />
    44. 44. 2. Benchmarking or Where are you now?<br />Your “baseline” is your line in the sand.<br />Followers/fans<br />@ replies and retweets<br />Clicks to your Website coming from social media<br />Search engine rankings for key terms<br />Flickr photo by Egan Snow<br />
    45. 45. Where are your peers?<br />Benchmarks help you understand where you are in relation to something else. They are points of reference, standards by which your efforts can be measured or judged. <br />Flickr photo by JACoulter<br />
    46. 46. Finding your peers: GraphEdge<br />Who else is your audience listening to?<br />GraphEdge presents a list of other users ranked by what percentage of your followers also follow that account. <br />For each peer on your shortlist take a look at their follower numbers, how actively they're tweeting, etc. <br />Capture only the details you want to focus on in your own efforts.<br />
    47. 47. Putting it into practice<br />Environment<br />Engagement<br />Experience<br />Evaluation<br />
    48. 48. Short term<br />Communication<br />Directing visitors to your collection<br />Responding to topical issues in simple ways, ie: twitter<br />Campaign<br /><ul><li>Raising awareness of events which relate to this issue</li></ul>Linking existing programs/events to topical issues ie: facebook<br />
    49. 49. Medium Term<br />Critique<br />In-depth analysis of topical issues of the day<br /> blog postings which give historical context to important issues<br />Conversation<br /><ul><li>Engaging in conversations on reputable sites</li></ul>Demonstrating relevance by referring existing conversations to your collection (ie: blogs, wikis)<br />
    50. 50. Long Term<br />Connection<br /><ul><li>Between your organisation and public
    51. 51. Your onsite and online activities
    52. 52. Your collection and public interests</li></li></ul><li>Experience<br />This one is relatively easy.<br />Most organisations have determined what they want<br />Find out what your organisation aims for and work with that!<br />
    53. 53. Environment<br />This one is trickier…<br />it’s about looking at what you currently do and how you can connect the dots so that your online and onsite experiences match up!<br />
    54. 54. Engagement<br />This one is the most contentious. It regularly produces<br />a cold sweat in management<br />resounding indifference in many staff<br />discussions re: the authority of the organisation<br />a desperate call for more resources <br />A look of hopelessness and despair<br />
    55. 55. Evaluation<br />Increasingly, evaluation needs to occur in two parts. One is relatively easy, the other more laboured…<br />Tracking of metrics – whether using free or commercial services<br />
    56. 56. Evaluation<br />Active strategy of research to find out <br />What are others saying about democracy?<br />Where they are saying it?<br />What you can contribute to that discussion?<br />
    57. 57. What do you need to make this happen?<br />The most common response is…<br />Time<br />Training <br />Staff<br />Senior management buy-in<br />
    58. 58. But there’s more!<br />Commitment <br />from top down and bottom up<br />Collaboration <br />between departments and individuals<br />Connection <br />with what matters to the public<br />Cooperation<br />To achieve the policy aims <br />
    59. 59. 3. Setting goals<br />Where do you want to go?<br />What is your definition of success?<br />
    60. 60. Goals?<br />
    61. 61. Consider not <br />“What can I do with social media?” <br />but <br />“How can social media help me achieve the museum’s mission?”<br />
    62. 62. Ask: <br />“What is unique about social media?” <br />and, more importantly, “What can I bring to social media that is unique?”<br />
    63. 63. What is your #1 social media goal?<br />Tweet using hashtag #aamSocial<br />Text to 202.550.9095<br />
    64. 64. 4 & 5. Measuring and Analyzing<br />What data should you collect?<br />How should you collect it?<br />
    65. 65. 100 Ways to Measure Social Media<br />http://www.marketersstudio.com/2009/11/100-ways-to-measure-social-media-.html <br />
    66. 66.
    67. 67. You want to do the least amount of work needed to gain actionable insights.<br />You want to spend your time acting, not analyzing.<br />
    68. 68. Who will find this chart useful?<br />
    69. 69. Input<br />
    70. 70. Response<br />
    71. 71. Where to measure<br />
    72. 72. “Lamest measure of success”: followers<br />Measuring followers or fans is simply a measure of input<br />Doesn’t focus on customer behavior or outcomes<br />Instead use:<br />Klout: Inbound Messages per Outbound Message (conversation rate)<br />Are you shouting or having a conversation?<br />
    73. 73. Success vs. Awareness<br />“Follower numbers, like website traffic statistics, don’t necessarily represent success, but can be used as a rough measurement of public awareness of your account and potential influence.”<br />See Zambonini<br />
    74. 74. Content analysis<br />Perform a content analysis—use a random sample or a full set from a small time period and categorize them.<br />Message type<br />Tone<br />Topics<br />
    75. 75. Focus on the “critical few”<br />Separate the need to know from the nice to know or you’ll be buried in data<br />Avoid analysis paralysis<br />See Avinash Kaushik http://www.newcommcollaborative.com/knowledge/877-exploring-social-media-analytics-with-avinash-kaushik<br />
    76. 76. 6. Actionable reporting<br />
    77. 77. REVISIT: What is your biggest social media challenge?<br />Send a tweet to @pollwith the message <br />“26514 + your answer”<br />Send a text to 22333with the message <br />“26514 + your answer”<br />http://www.polleverywhere.com/free_text_polls/LTM2MjQwMjExNg<br />
    78. 78. Challenge: Transparency<br />Be human<br />Post a link to your comment or social media policy<br />Identify who is behind your accounts<br />Be sincere<br />Be willing to listen<br />Be willing to respond and make changes<br />Be agile<br />
    79. 79. You’re only human (born to make mistakes…)<br />
    80. 80. A “very crowded cocktail party”<br />Catch up with old friends<br />Meet new people<br />Introduce people to one another<br />Make connections <br />Share information<br />Strengthen ties<br />Your network of fans are visible to one another<br />See Elizabeth Stewart, Twitter for Museums<br />
    81. 81. Do you sound like a human?<br />What department or person in your museum is currently responsible for social media? Are these the right people for the job?<br />Tweet using hashtag #aamSocial<br />Text to 202.550.9095<br />
    82. 82. Convincing the skeptics<br />How will these new tasks impact their already busy jobs? (I’m afraid it will take too much time!)<br />What will the quality be like since resources are at a premium?<br />Will it distract from the museum’s core tasks?<br />See “Confessions of a Long-Tail Visionary” and “Clearing the Path for Sisyphus” by Jeff Gates in Twitter for Museums<br />
    83. 83. Convincing the skeptics<br />What is the most common push-back you get from colleagues in trying to adopt social media practices?<br />Tweet using hashtag #aamSocial<br />Text to 202.550.9095<br />
    84. 84. The future (is now?) . . . Integrating social media<br />Is the museum Web site dead?<br />Incorporating your social media into your existing site—a good idea?<br />Applying social principles to your site (online and in the building)<br />
    85. 85. A few resources<br />Mashable, “world’s largest blog focused exclusively on Web 2.0 and Social Media news,” www.mashable.com<br />Social Media Today, “moderated business community for the web's best thinkers on Social Media and Web 2.0,” www.socialmediatoday.com<br />SmartBrief on Social Media, “the best news and insights on the business of social media,” www.smartbrief.com/socialmedia<br />Beth Kanter's blog, How Nonprofit Organizations Can Use Social Media to Power Social Networks for Change, http://beth.typepad.com/<br />
    86. 86. A few tools<br />FREE<br />Google Alerts<br />Tweetbeep<br />Retweetrank<br />Twitalyzer<br />Technorati Authority<br />Social Mention<br />Twitter Sentiment<br />Trackbacks<br />Blogscope<br />Wefollow (find topic-based people)<br />Postrank<br />Google Analytics<br />HootSuite<br />Facebook Insights<br />YouTube Insights<br />Flickr Statistics<br />NOT SO FREE<br />Attensity<br />ScoutLabs<br />Nielsen BuzzMetrics<br />Hitwise<br />comScore<br />Omniture SiteCatalyst<br />Radian6<br />WebTrends<br />
    87. 87. Contact<br />New Media Project ManagerNational Museum of American History<br />Dana Allen-Greil<br />allen-greil@si.edu<br />http://www.linkedin.com/in/danaallengreil<br />Twitter: danamuses<br />http://americanhistory.si.edu<br />http://blog.americanhistory.si.edu<br />
    88. 88. Contact<br />Associate Professor<br />Angelina Russo, PhD<br />angelinarusso01@optusnet.com.au<br />http://www.linkedin.com/in/angelinarusso<br />Twitter: artech05<br />http://www.museum30.ning.com<br />http://nlablog.wordpress.com<br />
    89. 89. Join the conversation<br />www.museum30.ning.com<br />