Presentation File
Upcoming SlideShare
Loading in...5
×
 

Presentation File

on

  • 623 views

 

Statistics

Views

Total Views
623
Views on SlideShare
623
Embed Views
0

Actions

Likes
1
Downloads
1
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • * Consolidating Steps 1 through 5: The application’s development is already underway and a test deployment deadline fast approaching This application is forging a new way to conduct research & pedagogy and thus conducting ad-hoc user testing to validate concepts * Can’t do Step 11 because we’re a small team * Currently practicing Steps 6 through 10
  • Video Playback Page Goals - Multilayer level of access - Visual Timeline, Collection Hierarchy 1 Participants used both 1.2 Timeline draggable not clear. Video Playback zone not clear. Segment Hierarchy concept
  • 19 Questions in the QUIS Questionnaire Inapplicable Questions : The information such as online help provided with this system is clear The system gives me error messages that clearly tell me how to fix problems that I am having
  • Aesthetic - Banner too big Alternative Metaphors - Resetting Video Playback Zone 2. Timeline Zoom Graphics 3. Timeline Dialog Box Zoom/Play Icons
  • Browse Page: Not high priority at the moment

Presentation File Presentation File Presentation Transcript

  • EVIA Digital Archive Iterative Development & Usability Testing Presented by William G. Cowan and Shahrier Akram Ethnographic Video for Instruction and Analysis Digital Archive Development Team DLP Brown Bag Presentation September 26, 2007
  • Agile Software Development: Intro
    • Characteristics of Agile Software Development
      • Light-weight methodology
      • Small to medium sized teams
      • Vague and/or changing requirements
      • Vague and/or changing technologies
      • Simple design
      • Minimal system into production
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • Agile Software Development : Intro
    • What Agile Software Development does not do:
      • No complete up-front analysis
      • No up-front infrastructure and framework
      • Don’t write and maintain implementation documentation
      • All programmers participate in all critical activities
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • Agile Software Development in EVIA
    • Why Agile Software Development for EVIA?
      • Shifting requirements
      • Changing technology decisions
      • Short development cycle with user review
      • Keep focus on high priority items
      • Small Development Team
      • Daily review of progress
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • Usability in EVIADA Agile Software Development
    • How can we incorporate some of the standard usability techniques into EVIADA’s Agile Software Development?
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • Rapid Contextual Design
    • Set project focus
    • Contextual Inquiry with potential customers
    • Build an affinity
    • Introduce data to the larger team
    • Identify issues
    • Build User Stories
    • Run the Planning Game
    • Design detailed User Interfaces (UIs)
    • Test UIs with users
    • Deliver to development
    • Continue iterations in parallel
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing Beyer, H., K. Holtzblatt, et al. "An Agile User-Centered Method: Rapid Contextual Design. ” Available at http://www. incontextdesign .com/resource/pdf/XPUniverse2004. pdf
  • EVIADA Agile Usability
    • Pick task(s) from Use Cases Inventory
      • Prioritize tasks based on their critical need, anticipated frequency or commonality & complexity
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • EVIADA Agile Usability Contd.
    • Create Descriptive User Stories
      • Short Narrations, User Intentions & System Responsibilities, Sequence Models
    • Run the planning game with User Stories
      • Detailed UI Mockups to determine the complexity and thereby time estimate to implement the features
    • Test
      • Lo-Fi Paper Prototype of N Iteration
        • Refine design
      • Acceptance of N - 1 Iteration
        • Refine design
    • Continue Design and Development
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • EVIADA: Iteration Turnaround Challenges
    • Developing unique task workflows
      • User testing and feedbacks to validate concepts
    • Adopting new software technologies
    • Unforeseen technical roadblocks
      • Cross-browser Incompatibilities
    • Sequential design and development workflow
      • Resource constraints
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • Usability Study
    • Participants
      • 2 Faculty
      • 1 Graduate Student
      • 2 General Public
    • Test Hi-Fi Prototype Video Playback Page ( Iteration 1 )
      • Find relevant information based on user scenarios
      • (In)validate currently implemented concepts
      • Obtain qualitative, quantitative and informal feedbacks
      • Demo Link
    • Test Lo-Fi Paper Prototype Browse Page ( Iteration 2 )
      • Find information based on user scenarios
      • (In)validate layout and labeling
      • Obtain informal feedbacks
      • Demo Link
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • Iteration 1 Usability Study: Qualitative Response
    • Negatives
      • “ I was not aware if there was a page explaining some basics about scene, action, event and other aspects such as basic vocabulary ”
      • “ The hierarchy of Collection, Event, Scene (& Action) wasn't spelled out very well in the interface ”
    • Positives
      • “ After familiarizing myself with the interface I did not feel put off or frustrated ”
      • “ LOTS of relevant information available about each segment I viewed ”
      • “ Good use of color for displaying complex data ”
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • Iteration 1 Usability Study - Quantitative Response Sep 26, 2007 EVIADA : Iterative Design & Usability Testing Computer System Usability Questionnaire
    • Overall, I am satisfied with how easy it is to use the system
    • It was simple to use the system
    • I can effectively complete my work using this system
    • I am able to complete my work quickly using this system
    • I am able to efficiently complete my work using this system
    • … .
    Questionnaire available at: http: //hcibib . org/perlman/question . cgi
  • Iteration 1: Pending Issues
    • Conveying the segment hierarchy concept
      • What are Collections, Events, Scenes & Actions?
      • Alternative Approach: Sliding Drawer Demo
    • Mixed reception to the Interactive Visual Timeline
      • Enhance level of interaction
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • Iteration 1: Development Status
    • Enhanced Video Player
      • Full Screen Video Playback
      • Player Reload vs Page Reload
    • Improved Collection Hierarchy Representation
    • Cross-Browser Compatible
    • Graphic Design & Labeling Updates
      • Aesthetics
      • Visual Metaphors
      • Labels
    • New Features
      • Transcriptions
      • Technical Problems
      • Glossary References
      • Bibliographic References
    • Demo Link
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
  • Upcoming Objectives:
    • Complete Iteration 1 - Video Playback Page
      • Do acceptance testing for the updates and enhancements
      • Include students in the next usability study, if possible
      • Incorporate feedback to refine design, if necessary
    • Iteration 2 : Browse Page
      • On hold
    • Develop Design for Iteration 3 - Search Page
      • Higher Priority
      • Lo-Fi Paper Prototype
      • Obtain feedback for proposed design
      • Incorporate feedback to refine design, if necessary
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing
    • Thank You!
    • [email_address] . edu
    • [email_address] . edu
    • Special Thanks to:
    • Mark Notess & The DLP Usability Working Group
    Sep 26, 2007 EVIADA : Iterative Design & Usability Testing Questions & Comments ..