Vsa 2011 exhibit files v.5

321 views

Published on

Knowledge, Identity, and Networks in the Informal Learning, Visitor Studies Association, July 2011, Community Wendy Pollock, Wendy Pollock LLC
Carey Tisdal, Tisdal Consulting

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
321
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • ExhibitFiles is an online site for exhibit practitioners developed by the Association of Science-Technology Centers (ASTC) with funding from the National Science Foundation (NSF). The website provides an infrastructure for sharing and building knowledge about exhibition development and design practices. Open in April of 2001/www.exhibitfiles.orgRegistered Members can publish:ProfileCase StudiesReviewsBitsParticipate by:ReadingCommentingFavoritiingConBlog
  • Wendy talked about the development and evolution of the site. I’m going to share some findings from the remedial evaluation of the site and talk about how they influenced how we approached the summative evaluation of the site.
  • At the end of the Remedial Evaluation we had revised our understanding of impact and moved up a level of the system. Yet, we realized that this theory was still incomplete.
  • Vsa 2011 exhibit files v.5

    1. 1. Knowledge, Identity, and Networks in the Informal Learning Community <br />Wendy Pollock, Wendy Pollock LLC<br />Carey Tisdal, Tisdal Consulting<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />1<br />
    2. 2. Improving Practice?<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />2<br />
    3. 3. Three Big Ideas<br />Professional knowledge and identity are defined by and shared through complex networks of people and media<br />These networks, people, and media are constantly evolving and changing<br />Ways of understanding networks, people, and media are evolving and changing<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />3<br />
    4. 4. ExhibitFiles<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />4<br />
    5. 5. ExhibitFiles<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />5<br />
    6. 6. ExhibitFilesEmergence in a changing media landscapewendy.pollock@gmail.com<br />
    7. 7. ExhibitFiles <br />Advisors and Core Contributors<br />Dave Bailey<br />Andrea Bandelli<br />Joanna Fisher<br />Gretchen Jennings<br />Jeff Kennedy<br />Kathy Krafft<br />Tom Nielsen<br />Paul Orselli<br />Claire Pillsbury <br />Jenny Sayre Ramberg<br />Christine Reich<br />Beth Redmond-Jones<br />Justine Roberts<br />Beverly Serrell<br />Eric Siegel<br />Jason Jay Stevens<br />Joan Waltermire<br />Martin Weiss<br />Katherine Whitney<br />NAME  Board and members<br />The 1,950+ members of ExhibitFiles <br />Development Team<br />Wendy PollockKathy McLean Ideum, led by Jim Spadaccini<br /> <br />Administrative Home<br />Association of Science-Technology Centers<br />Administrative support: Wendy Hancock <br /> <br />Funding<br />National Science Foundation<br />Grant No. ESI-054026<br />
    8. 8.   "Learning is least useful when it is private and hidden; it is most powerful when it becomes public and communal."  Lee S. Shulman, 1999<br />
    9. 9. "One of the things that might be done is some kind of collecting activity to retrieve memories of things that were wonderful."<br /> <br />Mike Spock <br />
    10. 10. 1980s<br /> <br />Workshops<br />Conferences <br />Print publications<br /> <br /> <br />Desktops<br />Files, folders <br />
    11. 11. 1990s<br /> <br />Pages, links, webs<br />
    12. 12. Early 2000s <br />Web 2.0<br />ForumsUser-contributed content<br />
    13. 13.
    14. 14.
    15. 15.  <br />Community<br />"Communities of practice are formed by people who engage in a process of collective learning in a shared domain of human endeavor." <br /> <br />- Etienne Wenger<br />
    16. 16. Collection<br />"Learning within [communities of interest] ... requires externalizations in the form of boundary objects."<br /> <br />- Gerhard Fischer<br />
    17. 17. Community + Collection = "ExhibitFiles is an online community of exhibit practitioners building a shared collection of exhibition records and reviews."<br />
    18. 18.  <br />Simplicity<br />
    19. 19. Language<br />Culture <br />
    20. 20.
    21. 21.
    22. 22. <ul><li>one niche in learning ecology</li></ul> <br /><ul><li>flows, not walls</li></ul> <br /><ul><li>emergent design </li></ul> <br /><ul><li>requires ongoing commitment of resources</li></li></ul><li>Evaluating Social Media Designed to Improved Professional Practice<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />23<br />
    23. 23. Design<br />Questions<br />How did the design team assume the site would work to produce impacts?<br />To what extent and in what ways did users value and use the functions provided by the website? <br />To what extent did users perceive themselves as members of a community<br />To what extent and in what ways were strategies successful in accomplishing the project impacts? <br />Methodology & Methods<br />Naturalistic Inquiry<br />Methods<br />Program theory Weiss (1998)<br />Analysis of the website database (N =1357)<br />Comparison to an association membership database (N = 830)<br />Online survey of registered members (N = 286<br />In-depth interviews with the project team and registered members (N = 18). <br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />24<br />Remedial Evaluation<br />
    24. 24. Program Theory<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />25<br />Remedial Evaluation<br />
    25. 25. Target Audience<br />Who used ExhibitFiles?<br />59.1% exhibition professionals<br />40.9% roles connected to exhibition development (e.g. administrators, educators, evaluators)<br />Where did ExhibitFiles members work? <br />37.7% work in science-technology centers/museums, natural history museums, zoos or aquaria, botanical gardens/arboreta, and nature or interpretive centers<br />63.3% work in other settings including other museum types (art, history, children’s) and design firms.<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />26<br />Remedial Evaluation<br />
    26. 26. Frequency of Use<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />27<br />Remedial Evaluation<br />Figure 22. How often do you visit ExhibitFiles? (N = 264)<br />
    27. 27. Visit Prompts<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />28<br />Remedial Evaluation<br />Figure 23. What prompts you to visit ExhibitFiles? (N = 245)<br />
    28. 28. Social Connections<br />Who on ExhibitFiles has influenced your work?<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />29<br />Remedial Evaluation<br />Already know them, however I did connect with [name] due to fascinating case history in ExhibitFiles<br />I have not contacted them via ExhibitFiles - I knew them before.<br />I knew all of these individuals before the creation of ExhibitFiles.<br />[Name] is my manager and mentor<br />Worked together<br />
    29. 29. Level of Participation<br />ExhibitFiles (online survey)<br />10.0% contributed at least one case study<br />10.0% contributed at least one review<br />90.0% neither.<br />Low levels of favoriting and comment<br />Site somewhat difficult to search<br />Neilson’s 90-9- 1 rule (2006)<br />90% of users are lurkers (i.e., read or observe)<br />9% of users contribute from time to time, but other priorities dominate their time. <br />1% of users participate a lot and account for most contributions<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />30<br />Remedial Evaluation<br />
    30. 30. Influence on Work<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />31<br />Remedial Evaluation<br />
    31. 31. Reasons for Contributing <br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />32<br />Remedial Evaluation<br />Figure 30. Reasons for publishing a review (N = 23)<br />
    32. 32. Remedial Findings<br />How could ExhibitFiles be more useful and relevant? <br />Email reminders to return to site<br />Improved search functions on site<br />Connect search with other sites<br />Greater range of contributors<br />More non-science contributions<br />More contributions from outside the US<br />More critical discussion/edgier content<br />More discussion of what didn’t work<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />33<br />Remedial Evaluation<br />
    33. 33. Revised Theory<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />34<br />Remedial Evaluation<br />
    34. 34. Focusing<br />What information was most critically needed? <br />By whom? (stakeholders)<br />What is the future of ExhibitFiles? (sustainability)<br />What evaluation approach will help answer these questions? <br />Do we need a revised theory? <br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />35<br />Summative Evaluation<br />
    35. 35. Theory -- Ecosystem<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />36<br />Summative Evaluation<br />
    36. 36. Levels of Ecosystem<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />37<br />Summative Evaluation<br />Individual<br />
    37. 37. Levels of Ecosystem<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />38<br />Summative Evaluation<br />Groups<br />
    38. 38. Levels of Ecosystem<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />39<br />Summative Evaluation<br />Fields<br />
    39. 39. Ecosystem<br />Visitor Studies Association Conference -- Tuesday, July 26, 2011 -- 9:00 to 10:15 a.m.<br />40<br />Summative Evaluation<br />Fields<br />More than one Fields?<br />
    40. 40. Lessons Learned<br /><ul><li>not just a site - part of learning ecology - multiple flows/stream </li></ul> <br /><ul><li>breaks down traditional walls (e.g., between novice and expert,) </li></ul> <br /><ul><li>emergent design, never finished, must continue to evolve </li></ul> <br /><ul><li>caring for the emergent collection/resource/community  requires ongoing commitment of resources</li>

    ×