Presentation File
Upcoming SlideShare
Loading in...5
×

Like this? Share it with your network

Share
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
835
On Slideshare
835
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
4
Comments
0
Likes
1

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • * Consolidating Steps 1 through 5: The application’s development is already underway and a test deployment deadline fast approaching This application is forging a new way to conduct research & pedagogy and thus conducting ad-hoc user testing to validate concepts * Can’t do Step 11 because we’re a small team * Currently practicing Steps 6 through 10
  • Video Playback Page Goals - Multilayer level of access - Visual Timeline, Collection Hierarchy 1 Participants used both 1.2 Timeline draggable not clear. Video Playback zone not clear. Segment Hierarchy concept
  • 19 Questions in the QUIS Questionnaire Inapplicable Questions : The information such as online help provided with this system is clear The system gives me error messages that clearly tell me how to fix problems that I am having
  • Aesthetic - Banner too big Alternative Metaphors - Resetting Video Playback Zone 2. Timeline Zoom Graphics 3. Timeline Dialog Box Zoom/Play Icons
  • Browse Page: Not high priority at the moment

Transcript

  • 1. EVIA Digital Archive Iterative Development & Usability Testing Presented by William G. Cowan and Shahrier Akram Ethnographic Video for Instruction and Analysis Digital Archive Development Team DLP Brown Bag Presentation September 26, 2007
  • 2. Agile Software Development: Intro
    • Characteristics of Agile Software Development
      • Light-weight methodology
      • Small to medium sized teams
      • Vague and/or changing requirements
      • Vague and/or changing technologies
      • Simple design
      • Minimal system into production
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • 3. Agile Software Development : Intro
    • What Agile Software Development does not do:
      • No complete up-front analysis
      • No up-front infrastructure and framework
      • Don’t write and maintain implementation documentation
      • All programmers participate in all critical activities
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • 4. Agile Software Development in EVIA
    • Why Agile Software Development for EVIA?
      • Shifting requirements
      • Changing technology decisions
      • Short development cycle with user review
      • Keep focus on high priority items
      • Small Development Team
      • Daily review of progress
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • 5. Usability in EVIADA Agile Software Development
    • How can we incorporate some of the standard usability techniques into EVIADA’s Agile Software Development?
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • 6. Rapid Contextual Design
    • Set project focus
    • Contextual Inquiry with potential customers
    • Build an affinity
    • Introduce data to the larger team
    • Identify issues
    • Build User Stories
    • Run the Planning Game
    • Design detailed User Interfaces (UIs)
    • Test UIs with users
    • Deliver to development
    • Continue iterations in parallel
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing Beyer, H., K. Holtzblatt, et al. "An Agile User-Centered Method: Rapid Contextual Design. ” Available at http://www. incontextdesign .com/resource/pdf/XPUniverse2004. pdf
  • 7. EVIADA Agile Usability
    • Pick task(s) from Use Cases Inventory
      • Prioritize tasks based on their critical need, anticipated frequency or commonality & complexity
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • 8. EVIADA Agile Usability Contd.
    • Create Descriptive User Stories
      • Short Narrations, User Intentions & System Responsibilities, Sequence Models
    • Run the planning game with User Stories
      • Detailed UI Mockups to determine the complexity and thereby time estimate to implement the features
    • Test
      • Lo-Fi Paper Prototype of N Iteration
        • Refine design
      • Acceptance of N - 1 Iteration
        • Refine design
    • Continue Design and Development
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • 9. EVIADA: Iteration Turnaround Challenges
    • Developing unique task workflows
      • User testing and feedbacks to validate concepts
    • Adopting new software technologies
    • Unforeseen technical roadblocks
      • Cross-browser Incompatibilities
    • Sequential design and development workflow
      • Resource constraints
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • 10. Usability Study
    • Participants
      • 2 Faculty
      • 1 Graduate Student
      • 2 General Public
    • Test Hi-Fi Prototype Video Playback Page ( Iteration 1 )
      • Find relevant information based on user scenarios
      • (In)validate currently implemented concepts
      • Obtain qualitative, quantitative and informal feedbacks
      • Demo Link
    • Test Lo-Fi Paper Prototype Browse Page ( Iteration 2 )
      • Find information based on user scenarios
      • (In)validate layout and labeling
      • Obtain informal feedbacks
      • Demo Link
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • 11. Iteration 1 Usability Study: Qualitative Response
    • Negatives
      • “ I was not aware if there was a page explaining some basics about scene, action, event and other aspects such as basic vocabulary ”
      • “ The hierarchy of Collection, Event, Scene (& Action) wasn't spelled out very well in the interface ”
    • Positives
      • “ After familiarizing myself with the interface I did not feel put off or frustrated ”
      • “ LOTS of relevant information available about each segment I viewed ”
      • “ Good use of color for displaying complex data ”
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • 12. Iteration 1 Usability Study - Quantitative Response Sep 26, 2007 EVIADA : Iterative Design & Usability Testing Computer System Usability Questionnaire
    • Overall, I am satisfied with how easy it is to use the system
    • It was simple to use the system
    • I can effectively complete my work using this system
    • I am able to complete my work quickly using this system
    • I am able to efficiently complete my work using this system
    • … .
    Questionnaire available at: http: //hcibib . org/perlman/question . cgi
  • 13. Iteration 1: Pending Issues
    • Conveying the segment hierarchy concept
      • What are Collections, Events, Scenes & Actions?
      • Alternative Approach: Sliding Drawer Demo
    • Mixed reception to the Interactive Visual Timeline
      • Enhance level of interaction
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • 14. Iteration 1: Development Status
    • Enhanced Video Player
      • Full Screen Video Playback
      • Player Reload vs Page Reload
    • Improved Collection Hierarchy Representation
    • Cross-Browser Compatible
    • Graphic Design & Labeling Updates
      • Aesthetics
      • Visual Metaphors
      • Labels
    • New Features
      • Transcriptions
      • Technical Problems
      • Glossary References
      • Bibliographic References
    • Demo Link
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • 15. Upcoming Objectives:
    • Complete Iteration 1 - Video Playback Page
      • Do acceptance testing for the updates and enhancements
      • Include students in the next usability study, if possible
      • Incorporate feedback to refine design, if necessary
    • Iteration 2 : Browse Page
      • On hold
    • Develop Design for Iteration 3 - Search Page
      • Higher Priority
      • Lo-Fi Paper Prototype
      • Obtain feedback for proposed design
      • Incorporate feedback to refine design, if necessary
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • 16.
    • Thank You!
    • [email_address] . edu
    • [email_address] . edu
    • Special Thanks to:
    • Mark Notess & The DLP Usability Working Group
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing Questions & Comments ..