Your SlideShare is downloading. ×
Presentation File
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Introducing the official SlideShare app

Stunning, full-screen experience for iPhone and Android

Text the download link to your phone

Standard text messaging rates apply

Presentation File

659
views

Published on


0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
659
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
4
Comments
0
Likes
1
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide
  • * Consolidating Steps 1 through 5: The application’s development is already underway and a test deployment deadline fast approaching This application is forging a new way to conduct research & pedagogy and thus conducting ad-hoc user testing to validate concepts * Can’t do Step 11 because we’re a small team * Currently practicing Steps 6 through 10
  • Video Playback Page Goals - Multilayer level of access - Visual Timeline, Collection Hierarchy 1 Participants used both 1.2 Timeline draggable not clear. Video Playback zone not clear. Segment Hierarchy concept
  • 19 Questions in the QUIS Questionnaire Inapplicable Questions : The information such as online help provided with this system is clear The system gives me error messages that clearly tell me how to fix problems that I am having
  • Aesthetic - Banner too big Alternative Metaphors - Resetting Video Playback Zone 2. Timeline Zoom Graphics 3. Timeline Dialog Box Zoom/Play Icons
  • Browse Page: Not high priority at the moment
  • Transcript

    • 1. EVIA Digital Archive Iterative Development & Usability Testing Presented by William G. Cowan and Shahrier Akram Ethnographic Video for Instruction and Analysis Digital Archive Development Team DLP Brown Bag Presentation September 26, 2007
    • 2. Agile Software Development: Intro
      • Characteristics of Agile Software Development
        • Light-weight methodology
        • Small to medium sized teams
        • Vague and/or changing requirements
        • Vague and/or changing technologies
        • Simple design
        • Minimal system into production
      Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
    • 3. Agile Software Development : Intro
      • What Agile Software Development does not do:
        • No complete up-front analysis
        • No up-front infrastructure and framework
        • Don’t write and maintain implementation documentation
        • All programmers participate in all critical activities
      Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
    • 4. Agile Software Development in EVIA
      • Why Agile Software Development for EVIA?
        • Shifting requirements
        • Changing technology decisions
        • Short development cycle with user review
        • Keep focus on high priority items
        • Small Development Team
        • Daily review of progress
      Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
    • 5. Usability in EVIADA Agile Software Development
      • How can we incorporate some of the standard usability techniques into EVIADA’s Agile Software Development?
      Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
    • 6. Rapid Contextual Design
      • Set project focus
      • Contextual Inquiry with potential customers
      • Build an affinity
      • Introduce data to the larger team
      • Identify issues
      • Build User Stories
      • Run the Planning Game
      • Design detailed User Interfaces (UIs)
      • Test UIs with users
      • Deliver to development
      • Continue iterations in parallel
      Sep 26, 2007 EVIADA : Iterative Design & Usability Testing Beyer, H., K. Holtzblatt, et al. "An Agile User-Centered Method: Rapid Contextual Design. ” Available at http://www. incontextdesign .com/resource/pdf/XPUniverse2004. pdf
    • 7. EVIADA Agile Usability
      • Pick task(s) from Use Cases Inventory
        • Prioritize tasks based on their critical need, anticipated frequency or commonality & complexity
      Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
    • 8. EVIADA Agile Usability Contd.
      • Create Descriptive User Stories
        • Short Narrations, User Intentions & System Responsibilities, Sequence Models
      • Run the planning game with User Stories
        • Detailed UI Mockups to determine the complexity and thereby time estimate to implement the features
      • Test
        • Lo-Fi Paper Prototype of N Iteration
          • Refine design
        • Acceptance of N - 1 Iteration
          • Refine design
      • Continue Design and Development
      Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
    • 9. EVIADA: Iteration Turnaround Challenges
      • Developing unique task workflows
        • User testing and feedbacks to validate concepts
      • Adopting new software technologies
      • Unforeseen technical roadblocks
        • Cross-browser Incompatibilities
      • Sequential design and development workflow
        • Resource constraints
      Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
    • 10. Usability Study
      • Participants
        • 2 Faculty
        • 1 Graduate Student
        • 2 General Public
      • Test Hi-Fi Prototype Video Playback Page ( Iteration 1 )
        • Find relevant information based on user scenarios
        • (In)validate currently implemented concepts
        • Obtain qualitative, quantitative and informal feedbacks
        • Demo Link
      • Test Lo-Fi Paper Prototype Browse Page ( Iteration 2 )
        • Find information based on user scenarios
        • (In)validate layout and labeling
        • Obtain informal feedbacks
        • Demo Link
      Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
    • 11. Iteration 1 Usability Study: Qualitative Response
      • Negatives
        • “ I was not aware if there was a page explaining some basics about scene, action, event and other aspects such as basic vocabulary ”
        • “ The hierarchy of Collection, Event, Scene (& Action) wasn't spelled out very well in the interface ”
      • Positives
        • “ After familiarizing myself with the interface I did not feel put off or frustrated ”
        • “ LOTS of relevant information available about each segment I viewed ”
        • “ Good use of color for displaying complex data ”
      Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
    • 12. Iteration 1 Usability Study - Quantitative Response Sep 26, 2007 EVIADA : Iterative Design & Usability Testing Computer System Usability Questionnaire
      • Overall, I am satisfied with how easy it is to use the system
      • It was simple to use the system
      • I can effectively complete my work using this system
      • I am able to complete my work quickly using this system
      • I am able to efficiently complete my work using this system
      • … .
      Questionnaire available at: http: //hcibib . org/perlman/question . cgi
    • 13. Iteration 1: Pending Issues
      • Conveying the segment hierarchy concept
        • What are Collections, Events, Scenes & Actions?
        • Alternative Approach: Sliding Drawer Demo
      • Mixed reception to the Interactive Visual Timeline
        • Enhance level of interaction
      Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
    • 14. Iteration 1: Development Status
      • Enhanced Video Player
        • Full Screen Video Playback
        • Player Reload vs Page Reload
      • Improved Collection Hierarchy Representation
      • Cross-Browser Compatible
      • Graphic Design & Labeling Updates
        • Aesthetics
        • Visual Metaphors
        • Labels
      • New Features
        • Transcriptions
        • Technical Problems
        • Glossary References
        • Bibliographic References
      • Demo Link
      Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
    • 15. Upcoming Objectives:
      • Complete Iteration 1 - Video Playback Page
        • Do acceptance testing for the updates and enhancements
        • Include students in the next usability study, if possible
        • Incorporate feedback to refine design, if necessary
      • Iteration 2 : Browse Page
        • On hold
      • Develop Design for Iteration 3 - Search Page
        • Higher Priority
        • Lo-Fi Paper Prototype
        • Obtain feedback for proposed design
        • Incorporate feedback to refine design, if necessary
      Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
    • 16.
      • Thank You!
      • [email_address] . edu
      • [email_address] . edu
      • Special Thanks to:
      • Mark Notess & The DLP Usability Working Group
      Sep 26, 2007 EVIADA : Iterative Design & Usability Testing Questions & Comments ..