PowerPoint Presentation - Iterative Development


Published on

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

PowerPoint Presentation - Iterative Development

  1. 1. Iterative Development & Usability Testing EVIA Digital Archive Presented by William G. Cowan and Shahrier Akram Ethnographic Video for Instruction and Analysis Digital Archive Development Team DLP Brown Bag Presentation September 26, 2007
  2. 2. EVIADA : Iterative Design & Usability Testing Sep 26, 2007 Agile Software Development: Intro o Characteristics of Agile Software Development • Light-weight methodology • Small to medium sized teams • Vague and/or changing requirements • Vague and/or changing technologies • Simple design • Minimal system into production
  3. 3. EVIADA : Iterative Design & Usability Testing Sep 26, 2007 Agile Software Development : Intro o What Agile Software Development does not do: • No complete up-front analysis • No up-front infrastructure and framework • Don’t write and maintain implementation documentation • All programmers participate in all critical activities
  4. 4. EVIADA : Iterative Design & Usability Testing Sep 26, 2007 Agile Software Development in EVIA o Why Agile Software Development for EVIA? • Shifting requirements • Changing technology decisions • Short development cycle with user review • Keep focus on high priority items • Small Development Team • Daily review of progress
  5. 5. EVIADA : Iterative Design & Usability Testing Sep 26, 2007 Usability in EVIADA Agile Software Development o How can we incorporate some of the standard usability techniques into EVIADA’s Agile Software Development?
  6. 6. EVIADA : Iterative Design & Usability Testing Sep 26, 2007 Rapid Contextual Design 1. Set project focus 1. Determine the complexity of the project and 2. Contextual Inquiry with potential the level of innovation at least 3 people in each 2. Gather data from required. Identify the customers 13. Build the task models showing howrelease or 2 to produce Affinity this product specific Rolekey customer roles Notes and Sequence 4.Models of and plan customer visits. the will supportcurrently done that which this team Summarize key findings, then walk tasks are as-is tasks. 3. Build an affinity 5. Determine how the allow the team will be affinity to current issues through the support. Thisthe sequence models 6.project willby the project. is a representation User stories guided by Brainstorm how to addressed these userwork practice. 4. Introduce data to the larger team of the “as-is” customer the current will show howcomprehendstories into Iterations. 7. Organize members to the system will resolve the better support thepaper and develop sequence 5. Identify issues 8. Develop lo-fi work customer environment. prototypes necessary Prioritize and eliminate stories as issues models round test with 3 to 4 users and use 9. First to meet resource constraints. 6. Build User Stories 10. Provideto refine design. Time the paper the results the User Stories and permitting, 7. Run the Planning Game 11. second Designthe development team the prototypes UIs to Team with the refined do The UI round of testsbegins work on 8. Design detailed User Interfaces (UIs) next Iteration. Turn over specs to for implementation design. 9. Test UIs with users Development team when they complete their current Iteration. Repeat steps 6 - 10 until 10. Deliver to development project completion. 11. Continue iterations in parallel Beyer, H., K. Holtzblatt, et al. "An Agile User-Centered Method: Rapid Contextual Design.” Available at http://www.incontextdesign.com/resource/pdf/XPUniverse2004.pdf
  7. 7. EVIADA : Iterative Design & Usability Testing Sep 26, 2007 EVIADA Agile Usability o Pick task(s) from Use Cases Inventory • Prioritize tasks based on their critical need, anticipated frequency or commonality & complexity
  8. 8. EVIADA : Iterative Design & Usability Testing Sep 26, 2007 EVIADA Agile Usability Contd. o Create Descriptive User Stories • Short Narrations, User Intentions & System Responsibilities, Sequence Models o Run the planning game with User Stories • Detailed UI Mockups to determine the complexity and thereby time estimate to implement the features o Test • Lo-Fi Paper Prototype of N Iteration • Refine design • Acceptance of N - 1 Iteration • Refine design o Continue Design and Development
  9. 9. EVIADA : Iterative Design & Usability Testing Sep 26, 2007 EVIADA: Iteration Turnaround Challenges o Developing unique task workflows • User testing and feedbacks to validate concepts o Adopting new software technologies o Unforeseen technical roadblocks • Cross-browser Incompatibilities o Sequential design and development workflow • Resource constraints
  10. 10. EVIADA : Iterative Design & Usability Testing Sep 26, 2007 Usability Study o Participants • 2 Faculty • 1 Graduate Student • 2 General Public o Test Hi-Fi Prototype Video Playback Page (Iteration 1) • Find relevant information based on user scenarios • (In)validate currently implemented concepts • Obtain qualitative, quantitative and informal feedbacks • Demo Link o Test Lo-Fi Paper Prototype Browse Page (Iteration 2) • Find information based on user scenarios • (In)validate layout and labeling • Obtain informal feedbacks • Demo Link
  11. 11. EVIADA : Iterative Design & Usability Testing Sep 26, 2007 Iteration 1 Usability Study: Qualitative Response o Negatives • “I was not aware if there was a page explaining some basics about scene, action, event and other aspects such as basic vocabulary” • “The hierarchy of Collection, Event, Scene (& Action) wasn't spelled out very well in the interface” o Positives • “After familiarizing myself with the interface I did not feel put off or frustrated” • “LOTS of relevant information available about each segment I viewed” • “Good use of color for displaying complex data”
  12. 12. R a tin g s O ve ra ll , I am sa ti sf ie I d ca w I I n it h am am ef ho ab fe w ab le ct le iv ea to el sy to co y to co It it m m w is ef pl as to fi c et pl ie e et e si m us Th e nt m m e ly y y pl e th W sy co w w to is st m or he em I k or us sy ne be pl qu k e st Th lie et us th em e 0 1 2 3 4 5 6 7 8 ve gi ic e r ve ve m in is in I s I kl y g fo m I fe y th sy rm ak er ro be It el w us is st w or in e r ca co k g sy em at io a m m as m th st n m es e ea fo us is em is pr rt in (s ta sa od sy ab g sy uc ge th st h ke s uc to le is em Th as us th ti le us e Th in at ve ar in sy in e on g cl qu n g st fo in l in th to th em rm fo e e ea ic is rm rl kl us at he sy y y e sy io at lp st te us th st n io , em ll in is em Th is n on m g e It , e sy ef fe pr is -s I th st or ov cr re ho is ga ct id ea ee co w sy em iv ed sy n to ni e m ve st za in fo to r f ix em t io r f in es ea Th n he th d sa si pr is of lp e ge ly .. . in sy th sy in g e s, an st fo m st in d EVIADA : Iterative Design & Usability Testing em an em rm e fo d .. . at co is rm ot ha io m he s n pl ea at io .. al Th on et sy n . lt h e th e to I e in e th ne fu I te sy e un ed ta de Questions nc l ik rf st ed t io e ac sk rs ns us e em s ta of an nd in sc d an g th re d th is en s. .. O ca e sy s ve pa in st is ra bi te em cl ll , lit rf ea I ie ac is r am s e pl I of ea sa ex th sa ti pe is nt sf ct sy ie it d st w to em it h ha th ve is sy st em Average Rating (0-7) • …. work using this system Questionnaire available at: quickly using this system my work using this system easy it is to use the system Iteration 1 Usability Study - Quantitative Response Computer System • I can effectively complete my • I am able to complete my work • Overall, I am satisfied with how • It was simple to use the system Usability Questionnaire • I am able to efficiently complete http://hcibib.org/perlman/question.cgi Sep 26, 2007
  13. 13. EVIADA : Iterative Design & Usability Testing Sep 26, 2007 Iteration 1: Pending Issues o Conveying the segment hierarchy concept • What are Collections, Events, Scenes & Actions? • Alternative Approach: Sliding Drawer Demo o Mixed reception to the Interactive Visual Timeline • Enhance level of interaction
  14. 14. EVIADA : Iterative Design & Usability Testing Sep 26, 2007 Iteration 1: Development Status o Enhanced Video Player • Full Screen Video Playback • Player Reload vs Page Reload o Improved Collection Hierarchy Representation o Cross-Browser Compatible o Graphic Design & Labeling Updates • Aesthetics • Visual Metaphors • Labels o New Features • Transcriptions • Technical Problems • Glossary References • Bibliographic References o Demo Link
  15. 15. EVIADA : Iterative Design & Usability Testing Sep 26, 2007 Upcoming Objectives: o Complete Iteration 1 - Video Playback Page • Do acceptance testing for the updates and enhancements • Include students in the next usability study, if possible • Incorporate feedback to refine design, if necessary o Iteration 2 : Browse Page • On hold o Develop Design for Iteration 3 - Search Page • Higher Priority • Lo-Fi Paper Prototype • Obtain feedback for proposed design • Incorporate feedback to refine design, if necessary
  16. 16. EVIADA : Iterative Design & Usability Testing Sep 26, 2007 Questions & Comments .. Thank You! sakram@indiana.edu wgcowan@indiana.edu Special Thanks to: Mark Notess & The DLP Usability Working Group