Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
SUSAN HARUM NOVEMBER 6, 2007 Agile Assessment for Aquifer American Social History Online http://www.dlfaquifer.org
Why Agile? <ul><li>Experimental – small development team, distributed environment </li></ul><ul><li>Facilitate feedback fo...
Methodology <ul><li>August 29 – November 2 (8 weeks) </li></ul><ul><li>Questions for participants drafted by the SWG </li>...
Target Audience <ul><li>8 participants  </li></ul><ul><ul><li>1 faculty </li></ul></ul><ul><ul><li>3 graduate students  </...
Initial Brainstorming call <ul><li>Question users about the workflow of their research </li></ul><ul><li>Developers presen...
“ A site that seems to increase my chances of coming across things is good--there might be things there that lead me in a ...
Browsing and Searching <ul><li>Dates - How best to interpret? Groupings by era or groupings by decade?  </li></ul><ul><li>...
“ Wouldn't have known I would have wanted a breakdown by decades until I saw the breakdown. I see that there's a flurry of...
Sorting and Narrowing, Full Record Results, Social Networking and Tagging <ul><li>Sorting and Narrowing </li></ul><ul><li>...
 “ My colleagues and I use Zotero all the time ....Refworks is in a world of trouble.” <ul><li>Limiting Search Results </l...
Zotero continued, Topical browsing continued… <ul><li>Controlled vocabulary for browsing? </li></ul><ul><li>Zotero – Firef...
 “ I like using my own terms and narrowing the search myself” <ul><li>Controlled vocabulary for browsing? </li></ul><ul><u...
What Was Learned <ul><li>Agile Assessment drove the prioritization of tasks </li></ul><ul><li>Multiple phone interviews an...
Next in Assessment….. <ul><li>SWG currently planning for 2008 formal  </li></ul><ul><li>assessment of: </li></ul><ul><ul><...
Upcoming SlideShare
Loading in …5
×

Agile Assessment of the Aquifer American Social History Online

851 views

Published on

description and outcome of 8 week agile user assessment of the draft portal and what's next

Published in: Business, Technology
  • Be the first to comment

  • Be the first to like this

Agile Assessment of the Aquifer American Social History Online

  1. 1. SUSAN HARUM NOVEMBER 6, 2007 Agile Assessment for Aquifer American Social History Online http://www.dlfaquifer.org
  2. 2. Why Agile? <ul><li>Experimental – small development team, distributed environment </li></ul><ul><li>Facilitate feedback for the iterative development process of the portal </li></ul><ul><li>Allow users to drive the development of the portal </li></ul><ul><li>Focus on the user's goals and not the attributes of the software </li></ul><ul><li>Large verbal component - frequent conversations for more effective communication. </li></ul>
  3. 3. Methodology <ul><li>August 29 – November 2 (8 weeks) </li></ul><ul><li>Questions for participants drafted by the SWG </li></ul><ul><li>Group conference call on August 27th, 2007, including system architect and developer </li></ul><ul><li>3 additional individual phone interviews </li></ul><ul><li>Questions regarding search and find, identify, obtain, manage and use, and user workflow </li></ul><ul><li>Began assessment with: </li></ul><ul><ul><li>Draft of portal based on site at UM </li></ul></ul><ul><ul><li>Common Business Functions by SWG </li></ul></ul>
  4. 4. Target Audience <ul><li>8 participants </li></ul><ul><ul><li>1 faculty </li></ul></ul><ul><ul><li>3 graduate students </li></ul></ul><ul><ul><li>4 librarians </li></ul></ul><ul><li>Recruited by members of the Services Working group </li></ul><ul><li>Librarians as user proxies </li></ul>
  5. 5. Initial Brainstorming call <ul><li>Question users about the workflow of their research </li></ul><ul><li>Developers present to hear what participants say </li></ul><ul><li>Developers able to prioritize next tasks immediately after the call </li></ul>
  6. 6. “ A site that seems to increase my chances of coming across things is good--there might be things there that lead me in a new direction.” <ul><li>Need to see size and scale of collection to determine how much time to spend searching and browsing - </li></ul><ul><ul><li>Implementation of collection registry and “browse collections” feature. </li></ul></ul><ul><li>Need ability to limit a search (once you have results) in many ways </li></ul><ul><ul><li>Implementation of additional ways to limit after initial search </li></ul></ul><ul><ul><li>Implementation of date range limiting </li></ul></ul><ul><li>Importance of ability to browse </li></ul><ul><ul><li>Implementation of subject clouds for browsing – still working on faceting for additional browsing </li></ul></ul><ul><li>Importance of visual aids, especially for undergraduate students </li></ul><ul><ul><li>Implementation of timeline view for results </li></ul></ul><ul><li>Need for information for both about and creation of an object </li></ul><ul><ul><li>Feedback to MWG </li></ul></ul>
  7. 7. Browsing and Searching <ul><li>Dates - How best to interpret? Groupings by era or groupings by decade? </li></ul><ul><li>Topic - How important is the ability to browse and winnow by topic vs. applying keyword limits? </li></ul><ul><li>Subject - Persons and Organizations, Geographic Coverage, Temporal Coverage, Genre </li></ul><ul><li>Genre - is browsing and winnowing by genre necessary if there is a choice for Type of Resource? </li></ul><ul><li>Previews - what type of previews preferred for things that aren't images? </li></ul>
  8. 8. “ Wouldn't have known I would have wanted a breakdown by decades until I saw the breakdown. I see that there's a flurry of activity for this decade.” <ul><li>Dates – Took the feedback from participants to SWG and MWG </li></ul><ul><ul><li>Use of CDL date normalization utility based on TEMPER recommendations </li></ul></ul><ul><ul><li>Eras definitely out </li></ul></ul><ul><li>Previews </li></ul><ul><ul><li>Implementation of Thumbgrabber to provide more thumbnails of non-image items </li></ul></ul><ul><ul><li>Implementation of both “list” and “grid” views for results </li></ul></ul><ul><li>Genre </li></ul><ul><ul><li>Implementation of genre as option for limiting </li></ul></ul>
  9. 9. Sorting and Narrowing, Full Record Results, Social Networking and Tagging <ul><li>Sorting and Narrowing </li></ul><ul><li>Full Record Results </li></ul><ul><li>Social Networking and Tagging </li></ul><ul><li>Information Storage Preferences (local or remote) </li></ul><ul><li>Sharing search strategies </li></ul>
  10. 10. “ My colleagues and I use Zotero all the time ....Refworks is in a world of trouble.” <ul><li>Limiting Search Results </li></ul><ul><ul><li>Feedback to Chick that users want to “drill down” in the search (continue to narrow using different limiters) </li></ul></ul><ul><li>Full Record Results </li></ul><ul><ul><li>Normalization of collection names </li></ul></ul><ul><ul><li>Feedback to MWG of the importance of access condition and locator for using items in publications </li></ul></ul><ul><li>Social Networking and Tagging </li></ul><ul><ul><li>Implementation of StumbleIt for full records </li></ul></ul><ul><li>Sorting and Narrowing </li></ul><ul><ul><li>Implementation of more options to limit </li></ul></ul><ul><ul><li>Feedback to SWG and MWG to begin planning on implementation of faceting browsing </li></ul></ul>
  11. 11. Zotero continued, Topical browsing continued… <ul><li>Controlled vocabulary for browsing? </li></ul><ul><li>Zotero – Firefox limitation </li></ul><ul><li>Zotero add to appeal of AASHO site? </li></ul><ul><li>Your feedback influence design? </li></ul>
  12. 12. “ I like using my own terms and narrowing the search myself” <ul><li>Controlled vocabulary for browsing? </li></ul><ul><ul><li>SWG and MWG will help with development of faceting browsing </li></ul></ul><ul><li>Your feedback influence design? </li></ul><ul><ul><li>Buy in from participants </li></ul></ul>
  13. 13. What Was Learned <ul><li>Agile Assessment drove the prioritization of tasks </li></ul><ul><li>Multiple phone interviews and email updates resulted in buy in for participants </li></ul><ul><li>Brainstorming session for distributed group not as effective as personal interviews </li></ul><ul><li>Next time…… </li></ul><ul><ul><li>Mix personal interviews with on-site observations, brief surveys, etc. </li></ul></ul><ul><ul><li>Invite more graduate students to participate </li></ul></ul><ul><ul><li>Shorter, more frequent interviews if possible </li></ul></ul>
  14. 14. Next in Assessment….. <ul><li>SWG currently planning for 2008 formal </li></ul><ul><li>assessment of: </li></ul><ul><ul><li>AASHO portal </li></ul></ul><ul><ul><li>Zotero implementation </li></ul></ul><ul><ul><li>Sakai implementation </li></ul></ul><ul><ul><li>Meta-search implementation </li></ul></ul><ul><ul><li>Google implementation </li></ul></ul>

×