SlideShare a Scribd company logo
1 of 57
@Carologic




             Making Usable Software

                             September 10, 2012
                      Indiana UXPA and AgileIndy
"The biggest waste of all
is building something
no one wants"




  - @ericries #LeanStartupMI in 2011 via @MelBugai
Create a great,
usable, accessible,
and relevant experience
Workshop
Best Practices
Integrating with Agile



                                      Sprint 1




                                                             Sprint 2




                                                                                    Sprint 3
      Phase / Sprint 0
                         User                    Design                 U Test                 U Test
                         Research                for S2                 Design                 Design
UX




                         Design                  UR for S3              for S3                 for S4
                         for S1                                         UR for S4              UR for S5


                                    Increased understanding of Users
      Phase / Sprint 0




                                      Sprint 1




                                                             Sprint 2




                                                                                    Sprint 3
                         Pre-                    Dev                    Dev                    Dev
                         Dev
Dev
Agile Integration
 Use each study to pick up information
 Additional user research done in parallel

                      User                    Design for              U Test                  U Test                  U Test                  U Test                  U Test
           Sprint 0




                                   Sprint 1




                                                           Sprint 2




                                                                                   Sprint 3




                                                                                                           Sprint 4




                                                                                                                                   Sprint 5




                                                                                                                                                           Sprint 6
                      Research                S2
    UX




                                                                      Design for              Design for              Design for              Design for              Design for
                      Design for              UR for S3               S3                      S4                      S5                      S6                      S7
                      S1                                              UR for S4               UR for S5               UR for S6               UR for S7               UR for S8


                        User Observations                                          Interviews                                      Survey
                                                                                         Personas
                                                    Increased understanding of Users
          Sprint 0




                                   Sprint 1




                                                           Sprint 2




                                                                                   Sprint 3




                                                                                                            Sprint 4




                                                                                                                                    Sprint 5




                                                                                                                                                             Sprint 6
                     Pre-Dev                  Dev                     Dev                     Dev                      Dev                     Dev                      Dev
    Dev
Experience Driven Agile:
Developing Up to an Experience,
         Not Down to a Feature
Rehash of a Webinar by: Kaleb Walton & Brian Anderson
The “Pitch”
   Quickly conveys background of problem,
                                                           Effective Prioritization and
    proposed solution and statement of value               Assignment of Work Items
   Shirt-size estimates make for easy                     The problem is that systems
    prioritization (story points are fine too)             managers spend too much time
                                                           prioritizing and assigning their
   Sprinkle in risk and value to make                     team's daily work efforts.
    prioritization even easier                             Imagine if Systems Manager
                                                           Plus offered better prioritization
   Prioritize dozens of experiences, not                  capabilities and automated
                                                           assignment based on definable
    hundreds                                               business rules.
   General format:                                        This solution would result in
                                                           reduced cost for systems
    The problem is <problem>. Imagine if                   managers by enabling more
    <solution>. This solution would result in              efficient work assignment,
                                                           leading to better response
    <value statement>.                                     times.
   Lightweight precursor to...

    Copyright © 2012 Kaleb Walton, Brian Anderson, Michael Hughes and Terri Whitt
The “Scenario”

 Borrowed from UX discipline
 Paints a clear picture of an entire
  experience
 Extremely versatile and ready for use
  outside development
 Ourreal-world example of a person's
   “A definition:
       experience with a product, describing context
       with a problem and a proposed solution.”



    Copyright © 2012 Kaleb Walton, Brian Anderson, Michael Hughes and Terri Whitt
Scenarios Are Agile
   Just Barely Good Enough and Just in Time: Fidelity
    naturally matches immediate need.
   Ya Ain’t Gonna Need It: Does it enable the scenario?
   Minimum Viable Product: What is
    the minimum experience someone
    would pay for?
   Lightweight: Low cost to develop,
    flexible and quick to communicate.
   Better Contract: More reliable
    as it's written in terms of Experience
    rather than Features.

    Copyright © 2012 Kaleb Walton, Brian Anderson, Michael Hughes and Terri Whitt
Telling a Story




 Copyright © 2012 Kaleb Walton, Brian Anderson, Michael Hughes and Terri Whitt
Example Scenario
EFFECTIVE PRIORITIZATION AND ASSIGNMENT OF WORK ITEMS
PROBLEM
Mary, a systems manager at ABC Health, is responsible for a team of 12 system administrators
who handle steady state support of their health care systems and network. One of her biggest
time sinks is prioritizing and assigning her teams daily work efforts. The tool she uses, Systems
Manager Plus, doesn't give her any prioritization features except for the ability to sort on a
'priority' field when reviewing work items.
As she spends half of her time prioritizing she ends up working over time to tend to her other
duties.
SOLUTION
After a major update Mary signs into Systems Manager Plus, heads to the work items area and
is pleasantly surprised to see a number of new prioritization capabilities. There are more fields
available to sort and filter, as well as a “smart assignment” system that enables her to specify
rules that will result in automatic assignment to specific members of her team.
Mary creates a few rules, applies them to existing work items, and is excited to see that over a
quarter of the items were automatically assigned. She proceeds to sort and filter the remaining
work items to prioritize and assign to her team. As more work items trickle in she notices that
many of them are being auto-assigned.
These improvements have enabled Mary to focus less on prioritizing and more on doing.


   Copyright © 2012 Kaleb Walton, Brian Anderson, Michael Hughes and Terri Whitt
Easily Pull Out Stories and Epics

Additional sorting capabilities
As a systems manager I want to sort work items by
additional fields such as created date, severity and
platform so that I can more effectively prioritize them.
Additional filtering capabilities
As a systems manager I want to filter work items by
additional fields such as created date, severity and
platform so that I can more effectively prioritize them.

Smart assignment system (epic)
As a systems manager I want to specify assignment rules for the system to use
to automatically assign work items so that I don't have to assign every work item
manually.

Apply new smart assignment rules to existing work items
As a systems manager I want to apply new smart assignment rules to existing
work items so that I can use smart assignment on work items created after the
smart assignment process has executed.
   Copyright © 2012 Kaleb Walton, Brian Anderson, Michael Hughes and Terri Whitt
Scenarios Are Agile
   Just Barely Good Enough and Just in Time: Fidelity
    naturally matches immediate need.
   Ya Ain’t Gonna Need It: Does it enable the scenario?
   Minimum Viable Product: What is
    the minimum experience someone
    would pay for?
   Lightweight: Low cost to develop,
    flexible and quick to communicate.
   Better Contract: More reliable
    as it's written in terms of Experience
    rather than Features.

    Copyright © 2012 Kaleb Walton, Brian Anderson, Michael Hughes and Terri Whitt
Basic Experience Driven Agile
                          Involvement Over Time by Role
                                                              Scrum Masters, Developers
Product Owners,                                               and Testers
UX Analysts, Architects and Stakeholders
Product Mgt




                      Product Backlog                    Iteration Backlog
Activities




                    Pitches                Scenarios             Stories



                         Estimate, Valuate                       Estimate
                         Assess, Prioritize

   Copyright © 2012 Kaleb Walton, Brian Anderson, Michael Hughes and Terri Whitt
Experience Driven Agile At Scale
                          Involvement Over Time by Role
                                                              Scrum Masters, Developers
Product Owners,                                               and Testers
UX Analysts, Architects and Stakeholders


              Portfolio Backlog
Product Mgt




                                           Product                  Iteration
Activities




                     Pitches               Backlogs                 Backlogs


                                           Scenarios                  Stories
                   Scenarios




 Estimate, Valuate                         Prioritize            Estimate
 Assess, Prioritize

   Copyright © 2012 Kaleb Walton, Brian Anderson, Michael Hughes and Terri Whitt
Contact Us

       Kaleb                          Brian Anderson
                                      user.experience.guy@gmail.com
       Walton
       kalebwalton@gmail.com


Thanks to Other Experience Driven Agile Contributors

          Michael Hughes, Ph.D             Terri Whitt
          michaelhughesua@gmail.com        tw30306@yahoo.com




        http://experiencedrivenagile.com
Usability Testing
in Agile Environments
Any Method Can be Adapted
 Quick
 Bare minimum of effort
 Get needed feedback
 Provide recommendations
 Repeatable
Scope Effort
 Consider budget, resources
 Time
       Recruiting
       Facilitating
       Analyzing
   Adding participants increases budget &
    time
Paper, Clickable or Real Code?
   Always start with paper
       Guerilla / hallway test
       Users may misunderstand
   Clickable prototypes
       Easier to understand
       Can easily change
   Real Code
       Great if it’s the right solution
Paper or Clickable Prototype
 Rapid Iterative Testing & Evaluation (RITE)
 Traditional Testing
       In-Person
       Remote more challenging
Rapid Iterative Testing & Evaluation
   Qualitative user feedback
       actions + comments
 Series of small usability tests
 3 participants each day
 Minimum of 3 days of testing
       Iteration between testing days
       Total of 5 days
RITE Process

            Priority
 Test   & Level of Effort   Update   Test
              1 High

              2 Medium

              3 Low




                                            25
Recap Sessions
 End of each day - after the last session
 Room with a whiteboard.
 About 30 minutes.
 Discuss:
       trends seen
       concerns
       recommendations
       prioritize changes for the next round
       list lower priority changes for future iterations

                                                            26
RITE Results
   Final prototype
       Vetted with users
       Base for recommendations
   Light Report: “Caterpillar to Butterfly”
       Screenshots show progressions
       What changes were made and why
What Works for RITE
   Best used early in project lifecycle
       Early concepts
       Need to be vetted with users
       Can assist in quickly shaping designs




                                                28
General Testing

 Traditional Testing
 In-Person
 Remote
       Moderated or Unmoderated
   Less users, shorter sessions: analyze at
    lunch
       Recommend 3 or more users
       Half hour to 1 hour each
Regular Testing




        (Yes, this is an old idea; a great one!)
Bring it On!
 Small focused tests
 Reduce waiting for recruitment
 Once per week or per Sprint
 Same day mid-week (not Monday or
  Friday)
User Testing Day!
 Make team aware
 Invite everyone
       Watch remotely
       Recurring meeting invites for stakeholders
What could I test?
   Identify what to test at start of Sprint
       Work in Progress
       Multiple projects
       Prototypes
       Concepts, rough ideas, brainstorming
       Competing designs, (A/B testing)
       Comparative studies across market
       Conduct interviews to inform research
       More…
“Teams should stretch to get
                           work into that day’s test
                       and use the cadence to drive
                                      productivity.”




- Jeff Gothelf - http://blog.usabilla.com/5-effective-ways-for-usability-testing-to-play-nice-with-
agile/
Why Regular?
   Team becomes:
       accustomed to steady stream of qualitative
        insight
       insight ensures quick decisions…line up with
        business and user goals




              Adapted from Jeff Gothelf - http://blog.usabilla.com/5-effective-ways-for-
              usability-testing-to-play-nice-with-agile/
Include PWD
   People with disabilities
       “We are all only temporarily able-bodied.
        Accessibility is good for us all.”
       Get to spirit of the law (Section 508, WCAG
        2.0)




              -@mollydotcom at #stirtrek 2011 via @carologic
Make it Repeatable
Pre-Book Your Rooms
 Test & Observation Rooms
 Any location will do
       Conference rooms
       Offices
       Quiet corner of cafeteria
       Remote
Create Reusable Templates
   Screener
   Technology use/experience
   Knowledge of topic
 Scripts/Guides
 Consent Forms
 Data Collection
Debriefing After Testing
Find Patterns Quickly

    Issue          P1           P2           P3

    Search Used    Yes          No           No

    Widget 1       Used         N/A          Used –
                                             unsure
                                             about
    Task 1 Notes   3 – easy     2 – needed   3 – easy
                                help
    Task 2 Notes   2 – needed   2 – easy     2 – needed
                   help                      help
    Task 3 Notes   2 – needed   3 – easy     Ran out of
                   help                      time
    Task 4 Notes   2 – needed   3 – easy     Ran out of
                   help                      time
True Statements
 All interfaces have usability problems
 Limited resources to fix them
 More problems than resources
 Less serious problems distract
 Intense focus on fixing most serious
  problems first




         Adapted from: Rocket Surgery Made Easy: The Do-It-Yourself Guide to Finding and
         Fixing Usability Problems. By Steve Krug
Debrief with Team
   Assumes stakeholders watched tests
       If not, wait for UX analysis
 Quick analysis to quick decisions
 All decision makers MUST be present
Goal
   Identify top 5 or 10 most serious issues
       Top 3 from each list
       Prioritize from lists
       Commit resources for next sprint
       Stop




              Adapted from: Rocket Surgery Made Easy: The Do-It-Yourself Guide to Finding and
              Fixing Usability Problems. By Steve Krug
Guidelines
 Stay on Topic
 Be Constructive
 Don’t get distracted by small problems
 Intense focus on fixing most serious
  problems first
Make Useful & Usable
Recommendations - Quickly
Transform Data
 Look for patterns
 Read “between the lines”
 Know what you’ve got
       Sort, reorganize, review, repeat
       What refutes your expectations?
       Surprises?
       Outliers?
Short and Direct Communication
   Email or One Pager
       Think about audience
       How will it be used?
   Include
       Goal of study
       What will be fixed and who assigned to
       Tasks attempted
       Who observed
       Future research/enhancements
Tweak, Don’t Redesign
   Small iterative changes
       Make it better now
       Don’t break something else
   Take something away
       Reduce distractions
       Don’t add – question it




              Rocket Surgery Made Easy: The Do-It-Yourself Guide to Finding and Fixing Usability
              Problems. By Steve Krug
Do UX Early & Often
 Make users visible
 Information radiators
       Test findings
       Artifacts
       Personas
       Word Clouds - IA
Recommended Readings




Gothelf, Jeff. Lean UX: Getting Out of the Deliverables Business. (Anticipated in
Feb. 2013)                                                                      5
Contact Carol
    @Carologic

 Email: Carologic@gmail.com



 SlideShare.net/Carologic



 SpeakerRate.com/speakers/15585-CarolJSmith
Tool Considerations
•   In-person or remote?
•   Lab or on-site?
•   Prototype limitations (can it be online?, is it a document
    or a clickable site?)
•   Number of observers, number of participants?
•   Number of facilitators?
•   Logging and video editing needs (time on task, highlight
    video creation)?
•   Surveys before or after?
•   Eye tracking?
Usability Testing Software
•   Morae
•   Ovo
•   SilverBack (Mac only)
•   UserWorks
•   Noldus
•   Tobii (Eye-tracker)
•   SMI (Eye-tracker)
•   SurveyMonkey
Screen Sharing Software
   GoToMeeting – http://www.gotomeeting.com
   Lotus Sametime Unyte – http://www.unyte.com
   YuuGuu -- http://www.yuuguu.com
   WebEx – http://www.webex.com
   Yugma -- https://www.yugma.com/

   Trouble Shooting: CoPilot -
    https://www.copilot.com/
Recommended Sites
   Usability.gov
   W3C Web Accessibility Initiative
       http://www.w3.org/WAI/
   Accessibility Standards in US (Section 508)
       http://www.access-board.gov/sec508/508standards.htm
   Jakob Nielsen
       http://www.useit.com
   UPA – professional UX association
       http://www.upainternational.org/
References
   Albert, Bill, Tom Tullis, and Donna Tedesco. Beyond the Usability Lab.
   Beyer, Hugh. User-Centered Agile Methods (Synthesis Lectures on Human-
    Centered Informatics)
   Gothelf , Jeff. http://blog.usabilla.com/5-effective-ways-for-usability-testing-
    to-play-nice-with-agile/
   Henry, S.L. and Martinson, M. Evaluating for Accessibility, Usability Testing
    in Diverse Situations. Tutorial, 2003 UPA Conference.
   Krug, Steve. Rocket Surgery Made Easy: The Do-It-Yourself Guide to
    Finding and Fixing Usability Problems.
   Ratcliffe, Lindsay and Marc McNeill. Agile Experience Design: A Digital
    Designer's Guide to Agile, Lean, and Continuous.
   Rubin, Jeffrey and Dana Chisnell. Handbook of Usability Testing: How to
    Plan, Design, and Conduct Effective Tests. John Wiley & Sons, Inc.

More Related Content

Similar to Making Usable Software - at Agile Indy / UXPA Joint Meeting

Project Management With Scrum
Project Management With ScrumProject Management With Scrum
Project Management With ScrumTommy Norman
 
The Lean Company @ Moonpig.com
The Lean Company @ Moonpig.comThe Lean Company @ Moonpig.com
The Lean Company @ Moonpig.comMai Quay
 
UX @ Agile - Myths, Legends and the path to success
UX @ Agile - Myths, Legends and the path to successUX @ Agile - Myths, Legends and the path to success
UX @ Agile - Myths, Legends and the path to successRan Liron
 
Sprint Zero in Scrum
Sprint Zero in ScrumSprint Zero in Scrum
Sprint Zero in ScrumAgile Vietnam
 
Agile/Scrum Implemented in Large-Scale Distributed Program
Agile/Scrum Implemented in Large-Scale Distributed ProgramAgile/Scrum Implemented in Large-Scale Distributed Program
Agile/Scrum Implemented in Large-Scale Distributed ProgramCognizant
 
Dr. Ronen Bar-Nahor - Optimizing Agile Testing in Complex Environments
Dr. Ronen Bar-Nahor - Optimizing Agile Testing in Complex EnvironmentsDr. Ronen Bar-Nahor - Optimizing Agile Testing in Complex Environments
Dr. Ronen Bar-Nahor - Optimizing Agile Testing in Complex EnvironmentsAgileSparks
 
People Dynamics - agility to our rescue, Agilia June 11 '14, Budapest
People Dynamics - agility to our rescue, Agilia June 11 '14, BudapestPeople Dynamics - agility to our rescue, Agilia June 11 '14, Budapest
People Dynamics - agility to our rescue, Agilia June 11 '14, BudapestJisha Sharma
 
Agile & Lean UX
Agile & Lean UXAgile & Lean UX
Agile & Lean UXCyber-Duck
 
Danny Bluestone - Agile UX – a digital agency’s view’.
Danny Bluestone - Agile UX – a digital agency’s view’.Danny Bluestone - Agile UX – a digital agency’s view’.
Danny Bluestone - Agile UX – a digital agency’s view’.UCDUK
 
[Agile Portugal 2012] TSP/PSP and Agile-SCRUM: Similarities & Differences Stu...
[Agile Portugal 2012] TSP/PSP and Agile-SCRUM: Similarities & Differences Stu...[Agile Portugal 2012] TSP/PSP and Agile-SCRUM: Similarities & Differences Stu...
[Agile Portugal 2012] TSP/PSP and Agile-SCRUM: Similarities & Differences Stu...Strongstep - Innovation in software quality
 
Big agile - It's not just for small projects anymore
Big agile - It's not just for small projects anymoreBig agile - It's not just for small projects anymore
Big agile - It's not just for small projects anymoreJesse Fewell
 
Seapine Scrum Reference Card
Seapine Scrum Reference CardSeapine Scrum Reference Card
Seapine Scrum Reference CardSeapine Software
 
How product designer work in agile scrum team
How product designer work in agile scrum teamHow product designer work in agile scrum team
How product designer work in agile scrum teamMike Li
 
Scrum - A different approach to project management
Scrum - A different approach to project managementScrum - A different approach to project management
Scrum - A different approach to project managementAndres Vargas
 

Similar to Making Usable Software - at Agile Indy / UXPA Joint Meeting (20)

Project Management With Scrum
Project Management With ScrumProject Management With Scrum
Project Management With Scrum
 
Practical application of scrum final
Practical application of scrum finalPractical application of scrum final
Practical application of scrum final
 
The Lean Company @ Moonpig.com
The Lean Company @ Moonpig.comThe Lean Company @ Moonpig.com
The Lean Company @ Moonpig.com
 
Ran Liron
Ran LironRan Liron
Ran Liron
 
UX @ Agile - Myths, Legends and the path to success
UX @ Agile - Myths, Legends and the path to successUX @ Agile - Myths, Legends and the path to success
UX @ Agile - Myths, Legends and the path to success
 
Sprint Zero in Scrum
Sprint Zero in ScrumSprint Zero in Scrum
Sprint Zero in Scrum
 
Agile/Scrum Implemented in Large-Scale Distributed Program
Agile/Scrum Implemented in Large-Scale Distributed ProgramAgile/Scrum Implemented in Large-Scale Distributed Program
Agile/Scrum Implemented in Large-Scale Distributed Program
 
Dr. Ronen Bar-Nahor - Optimizing Agile Testing in Complex Environments
Dr. Ronen Bar-Nahor - Optimizing Agile Testing in Complex EnvironmentsDr. Ronen Bar-Nahor - Optimizing Agile Testing in Complex Environments
Dr. Ronen Bar-Nahor - Optimizing Agile Testing in Complex Environments
 
Agile 101
Agile 101Agile 101
Agile 101
 
People Dynamics - agility to our rescue, Agilia June 11 '14, Budapest
People Dynamics - agility to our rescue, Agilia June 11 '14, BudapestPeople Dynamics - agility to our rescue, Agilia June 11 '14, Budapest
People Dynamics - agility to our rescue, Agilia June 11 '14, Budapest
 
Scrum with VS2010
Scrum with VS2010  Scrum with VS2010
Scrum with VS2010
 
Agile & Lean UX
Agile & Lean UXAgile & Lean UX
Agile & Lean UX
 
Danny Bluestone - Agile UX – a digital agency’s view’.
Danny Bluestone - Agile UX – a digital agency’s view’.Danny Bluestone - Agile UX – a digital agency’s view’.
Danny Bluestone - Agile UX – a digital agency’s view’.
 
[Agile Portugal 2012] TSP/PSP and Agile-SCRUM: Similarities & Differences Stu...
[Agile Portugal 2012] TSP/PSP and Agile-SCRUM: Similarities & Differences Stu...[Agile Portugal 2012] TSP/PSP and Agile-SCRUM: Similarities & Differences Stu...
[Agile Portugal 2012] TSP/PSP and Agile-SCRUM: Similarities & Differences Stu...
 
Big agile - It's not just for small projects anymore
Big agile - It's not just for small projects anymoreBig agile - It's not just for small projects anymore
Big agile - It's not just for small projects anymore
 
Agile product development
Agile product developmentAgile product development
Agile product development
 
Seapine Scrum Reference Card
Seapine Scrum Reference CardSeapine Scrum Reference Card
Seapine Scrum Reference Card
 
Zen of Scrum
Zen of ScrumZen of Scrum
Zen of Scrum
 
How product designer work in agile scrum team
How product designer work in agile scrum teamHow product designer work in agile scrum team
How product designer work in agile scrum team
 
Scrum - A different approach to project management
Scrum - A different approach to project managementScrum - A different approach to project management
Scrum - A different approach to project management
 

More from Carol Smith

Navigating the Complexity of Trust at UXPA Boston 2021
Navigating the Complexity of Trust at UXPA Boston 2021Navigating the Complexity of Trust at UXPA Boston 2021
Navigating the Complexity of Trust at UXPA Boston 2021Carol Smith
 
Implementing Ethics: Developing Trustworthy AI PyCon 2020
Implementing Ethics: Developing Trustworthy AI PyCon 2020Implementing Ethics: Developing Trustworthy AI PyCon 2020
Implementing Ethics: Developing Trustworthy AI PyCon 2020Carol Smith
 
Designing Trustworthy AI: A User Experience Framework at RSA 2020
Designing Trustworthy AI: A User Experience Framework at RSA 2020Designing Trustworthy AI: A User Experience Framework at RSA 2020
Designing Trustworthy AI: A User Experience Framework at RSA 2020Carol Smith
 
IA is Elemental: People are Fundamental at World IA Day 2020 Pittsburgh
IA is Elemental: People are Fundamental at World IA Day 2020 PittsburghIA is Elemental: People are Fundamental at World IA Day 2020 Pittsburgh
IA is Elemental: People are Fundamental at World IA Day 2020 PittsburghCarol Smith
 
Gearing up for Ethnography, Michigan State, World Usability Day 2019
Gearing up for Ethnography, Michigan State, World Usability Day 2019Gearing up for Ethnography, Michigan State, World Usability Day 2019
Gearing up for Ethnography, Michigan State, World Usability Day 2019Carol Smith
 
Designing Trustworthy AI: A Human-Machine Teaming Framework to Guide Developm...
Designing Trustworthy AI: A Human-Machine Teaming Framework to Guide Developm...Designing Trustworthy AI: A Human-Machine Teaming Framework to Guide Developm...
Designing Trustworthy AI: A Human-Machine Teaming Framework to Guide Developm...Carol Smith
 
On the Road: Best Practices for Autonomous Experiences at WUC19
On the Road: Best Practices for Autonomous Experiences at WUC19On the Road: Best Practices for Autonomous Experiences at WUC19
On the Road: Best Practices for Autonomous Experiences at WUC19Carol Smith
 
Designing More Ethical and Unbiased Experiences - Abstractions
Designing More Ethical and Unbiased Experiences - AbstractionsDesigning More Ethical and Unbiased Experiences - Abstractions
Designing More Ethical and Unbiased Experiences - AbstractionsCarol Smith
 
Dynamic UXR: Ethical Responsibilities and AI. Carol Smith at Strive in Toronto
Dynamic UXR: Ethical Responsibilities and AI. Carol Smith at Strive in TorontoDynamic UXR: Ethical Responsibilities and AI. Carol Smith at Strive in Toronto
Dynamic UXR: Ethical Responsibilities and AI. Carol Smith at Strive in TorontoCarol Smith
 
Prototyping for Beginners - Pittsburgh Inclusive Innovation Summit 2019
Prototyping for Beginners - Pittsburgh Inclusive Innovation Summit 2019Prototyping for Beginners - Pittsburgh Inclusive Innovation Summit 2019
Prototyping for Beginners - Pittsburgh Inclusive Innovation Summit 2019Carol Smith
 
Navigating challenges in IA people management at IAC19
Navigating challenges in IA people management at IAC19Navigating challenges in IA people management at IAC19
Navigating challenges in IA people management at IAC19Carol Smith
 
What can DesignOps do for you? by Carol Smith at TLMUX in Montreal
What can DesignOps do for you? by Carol Smith at TLMUX in MontrealWhat can DesignOps do for you? by Carol Smith at TLMUX in Montreal
What can DesignOps do for you? by Carol Smith at TLMUX in MontrealCarol Smith
 
Designing Trustable AI Experiences at IxDA Pittsburgh, Jan 2019
Designing Trustable AI Experiences at IxDA Pittsburgh, Jan 2019Designing Trustable AI Experiences at IxDA Pittsburgh, Jan 2019
Designing Trustable AI Experiences at IxDA Pittsburgh, Jan 2019Carol Smith
 
Designing Trustable AI Experiences at World Usability Day in Cleveland
Designing Trustable AI Experiences at World Usability Day in ClevelandDesigning Trustable AI Experiences at World Usability Day in Cleveland
Designing Trustable AI Experiences at World Usability Day in ClevelandCarol Smith
 
Gearing up for Ethnography at Midwest UX 2018
Gearing up for Ethnography at Midwest UX 2018Gearing up for Ethnography at Midwest UX 2018
Gearing up for Ethnography at Midwest UX 2018Carol Smith
 
Designing AI for Humanity at dmi:Design Leadership Conference in Boston
Designing AI for Humanity at dmi:Design Leadership Conference in BostonDesigning AI for Humanity at dmi:Design Leadership Conference in Boston
Designing AI for Humanity at dmi:Design Leadership Conference in BostonCarol Smith
 
Product Design in Agile Environments: Making it Work at ProductCamp Pittsburgh
Product Design in Agile Environments: Making it Work at ProductCamp PittsburghProduct Design in Agile Environments: Making it Work at ProductCamp Pittsburgh
Product Design in Agile Environments: Making it Work at ProductCamp PittsburghCarol Smith
 
Demystifying Artificial Intelligence: Solving Difficult Problems at ProductCa...
Demystifying Artificial Intelligence: Solving Difficult Problems at ProductCa...Demystifying Artificial Intelligence: Solving Difficult Problems at ProductCa...
Demystifying Artificial Intelligence: Solving Difficult Problems at ProductCa...Carol Smith
 
UX in the Age of AI: Leading with Design UXPA2018
UX in the Age of AI: Leading with Design UXPA2018UX in the Age of AI: Leading with Design UXPA2018
UX in the Age of AI: Leading with Design UXPA2018Carol Smith
 
IA in the Age of AI: Embracing Abstraction and Change at IA Summit 2018
IA in the Age of AI: Embracing Abstraction and Change at IA Summit 2018IA in the Age of AI: Embracing Abstraction and Change at IA Summit 2018
IA in the Age of AI: Embracing Abstraction and Change at IA Summit 2018Carol Smith
 

More from Carol Smith (20)

Navigating the Complexity of Trust at UXPA Boston 2021
Navigating the Complexity of Trust at UXPA Boston 2021Navigating the Complexity of Trust at UXPA Boston 2021
Navigating the Complexity of Trust at UXPA Boston 2021
 
Implementing Ethics: Developing Trustworthy AI PyCon 2020
Implementing Ethics: Developing Trustworthy AI PyCon 2020Implementing Ethics: Developing Trustworthy AI PyCon 2020
Implementing Ethics: Developing Trustworthy AI PyCon 2020
 
Designing Trustworthy AI: A User Experience Framework at RSA 2020
Designing Trustworthy AI: A User Experience Framework at RSA 2020Designing Trustworthy AI: A User Experience Framework at RSA 2020
Designing Trustworthy AI: A User Experience Framework at RSA 2020
 
IA is Elemental: People are Fundamental at World IA Day 2020 Pittsburgh
IA is Elemental: People are Fundamental at World IA Day 2020 PittsburghIA is Elemental: People are Fundamental at World IA Day 2020 Pittsburgh
IA is Elemental: People are Fundamental at World IA Day 2020 Pittsburgh
 
Gearing up for Ethnography, Michigan State, World Usability Day 2019
Gearing up for Ethnography, Michigan State, World Usability Day 2019Gearing up for Ethnography, Michigan State, World Usability Day 2019
Gearing up for Ethnography, Michigan State, World Usability Day 2019
 
Designing Trustworthy AI: A Human-Machine Teaming Framework to Guide Developm...
Designing Trustworthy AI: A Human-Machine Teaming Framework to Guide Developm...Designing Trustworthy AI: A Human-Machine Teaming Framework to Guide Developm...
Designing Trustworthy AI: A Human-Machine Teaming Framework to Guide Developm...
 
On the Road: Best Practices for Autonomous Experiences at WUC19
On the Road: Best Practices for Autonomous Experiences at WUC19On the Road: Best Practices for Autonomous Experiences at WUC19
On the Road: Best Practices for Autonomous Experiences at WUC19
 
Designing More Ethical and Unbiased Experiences - Abstractions
Designing More Ethical and Unbiased Experiences - AbstractionsDesigning More Ethical and Unbiased Experiences - Abstractions
Designing More Ethical and Unbiased Experiences - Abstractions
 
Dynamic UXR: Ethical Responsibilities and AI. Carol Smith at Strive in Toronto
Dynamic UXR: Ethical Responsibilities and AI. Carol Smith at Strive in TorontoDynamic UXR: Ethical Responsibilities and AI. Carol Smith at Strive in Toronto
Dynamic UXR: Ethical Responsibilities and AI. Carol Smith at Strive in Toronto
 
Prototyping for Beginners - Pittsburgh Inclusive Innovation Summit 2019
Prototyping for Beginners - Pittsburgh Inclusive Innovation Summit 2019Prototyping for Beginners - Pittsburgh Inclusive Innovation Summit 2019
Prototyping for Beginners - Pittsburgh Inclusive Innovation Summit 2019
 
Navigating challenges in IA people management at IAC19
Navigating challenges in IA people management at IAC19Navigating challenges in IA people management at IAC19
Navigating challenges in IA people management at IAC19
 
What can DesignOps do for you? by Carol Smith at TLMUX in Montreal
What can DesignOps do for you? by Carol Smith at TLMUX in MontrealWhat can DesignOps do for you? by Carol Smith at TLMUX in Montreal
What can DesignOps do for you? by Carol Smith at TLMUX in Montreal
 
Designing Trustable AI Experiences at IxDA Pittsburgh, Jan 2019
Designing Trustable AI Experiences at IxDA Pittsburgh, Jan 2019Designing Trustable AI Experiences at IxDA Pittsburgh, Jan 2019
Designing Trustable AI Experiences at IxDA Pittsburgh, Jan 2019
 
Designing Trustable AI Experiences at World Usability Day in Cleveland
Designing Trustable AI Experiences at World Usability Day in ClevelandDesigning Trustable AI Experiences at World Usability Day in Cleveland
Designing Trustable AI Experiences at World Usability Day in Cleveland
 
Gearing up for Ethnography at Midwest UX 2018
Gearing up for Ethnography at Midwest UX 2018Gearing up for Ethnography at Midwest UX 2018
Gearing up for Ethnography at Midwest UX 2018
 
Designing AI for Humanity at dmi:Design Leadership Conference in Boston
Designing AI for Humanity at dmi:Design Leadership Conference in BostonDesigning AI for Humanity at dmi:Design Leadership Conference in Boston
Designing AI for Humanity at dmi:Design Leadership Conference in Boston
 
Product Design in Agile Environments: Making it Work at ProductCamp Pittsburgh
Product Design in Agile Environments: Making it Work at ProductCamp PittsburghProduct Design in Agile Environments: Making it Work at ProductCamp Pittsburgh
Product Design in Agile Environments: Making it Work at ProductCamp Pittsburgh
 
Demystifying Artificial Intelligence: Solving Difficult Problems at ProductCa...
Demystifying Artificial Intelligence: Solving Difficult Problems at ProductCa...Demystifying Artificial Intelligence: Solving Difficult Problems at ProductCa...
Demystifying Artificial Intelligence: Solving Difficult Problems at ProductCa...
 
UX in the Age of AI: Leading with Design UXPA2018
UX in the Age of AI: Leading with Design UXPA2018UX in the Age of AI: Leading with Design UXPA2018
UX in the Age of AI: Leading with Design UXPA2018
 
IA in the Age of AI: Embracing Abstraction and Change at IA Summit 2018
IA in the Age of AI: Embracing Abstraction and Change at IA Summit 2018IA in the Age of AI: Embracing Abstraction and Change at IA Summit 2018
IA in the Age of AI: Embracing Abstraction and Change at IA Summit 2018
 

Recently uploaded

PLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. StartupsPLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. StartupsStefano
 
IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoTAnalytics
 
ECS 2024 Teams Premium - Pretty Secure
ECS 2024   Teams Premium - Pretty SecureECS 2024   Teams Premium - Pretty Secure
ECS 2024 Teams Premium - Pretty SecureFemke de Vroome
 
Optimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through ObservabilityOptimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through ObservabilityScyllaDB
 
Powerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaPowerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaCzechDreamin
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Patrick Viafore
 
A Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System StrategyA Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System StrategyUXDXConf
 
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka DoktorováCzechDreamin
 
The UX of Automation by AJ King, Senior UX Researcher, Ocado
The UX of Automation by AJ King, Senior UX Researcher, OcadoThe UX of Automation by AJ King, Senior UX Researcher, Ocado
The UX of Automation by AJ King, Senior UX Researcher, OcadoUXDXConf
 
Syngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon
 
Connecting the Dots in Product Design at KAYAK
Connecting the Dots in Product Design at KAYAKConnecting the Dots in Product Design at KAYAK
Connecting the Dots in Product Design at KAYAKUXDXConf
 
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfIntroduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfFIDO Alliance
 
Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024Enterprise Knowledge
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceSamy Fodil
 
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptxWSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptxJennifer Lim
 
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...FIDO Alliance
 
Buy Epson EcoTank L3210 Colour Printer Online.pdf
Buy Epson EcoTank L3210 Colour Printer Online.pdfBuy Epson EcoTank L3210 Colour Printer Online.pdf
Buy Epson EcoTank L3210 Colour Printer Online.pdfEasyPrinterHelp
 
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...FIDO Alliance
 
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdfHow Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdfFIDO Alliance
 
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutesconfluent
 

Recently uploaded (20)

PLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. StartupsPLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. Startups
 
IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024
 
ECS 2024 Teams Premium - Pretty Secure
ECS 2024   Teams Premium - Pretty SecureECS 2024   Teams Premium - Pretty Secure
ECS 2024 Teams Premium - Pretty Secure
 
Optimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through ObservabilityOptimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through Observability
 
Powerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaPowerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara Laskowska
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024
 
A Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System StrategyA Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System Strategy
 
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
 
The UX of Automation by AJ King, Senior UX Researcher, Ocado
The UX of Automation by AJ King, Senior UX Researcher, OcadoThe UX of Automation by AJ King, Senior UX Researcher, Ocado
The UX of Automation by AJ King, Senior UX Researcher, Ocado
 
Syngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdf
 
Connecting the Dots in Product Design at KAYAK
Connecting the Dots in Product Design at KAYAKConnecting the Dots in Product Design at KAYAK
Connecting the Dots in Product Design at KAYAK
 
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfIntroduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
 
Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM Performance
 
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptxWSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
 
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
 
Buy Epson EcoTank L3210 Colour Printer Online.pdf
Buy Epson EcoTank L3210 Colour Printer Online.pdfBuy Epson EcoTank L3210 Colour Printer Online.pdf
Buy Epson EcoTank L3210 Colour Printer Online.pdf
 
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
 
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdfHow Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
 
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
 

Making Usable Software - at Agile Indy / UXPA Joint Meeting

  • 1. @Carologic Making Usable Software September 10, 2012 Indiana UXPA and AgileIndy
  • 2. "The biggest waste of all is building something no one wants" - @ericries #LeanStartupMI in 2011 via @MelBugai
  • 3. Create a great, usable, accessible, and relevant experience
  • 6. Integrating with Agile Sprint 1 Sprint 2 Sprint 3 Phase / Sprint 0 User Design U Test U Test Research for S2 Design Design UX Design UR for S3 for S3 for S4 for S1 UR for S4 UR for S5 Increased understanding of Users Phase / Sprint 0 Sprint 1 Sprint 2 Sprint 3 Pre- Dev Dev Dev Dev Dev
  • 7. Agile Integration  Use each study to pick up information  Additional user research done in parallel User Design for U Test U Test U Test U Test U Test Sprint 0 Sprint 1 Sprint 2 Sprint 3 Sprint 4 Sprint 5 Sprint 6 Research S2 UX Design for Design for Design for Design for Design for Design for UR for S3 S3 S4 S5 S6 S7 S1 UR for S4 UR for S5 UR for S6 UR for S7 UR for S8 User Observations Interviews Survey Personas Increased understanding of Users Sprint 0 Sprint 1 Sprint 2 Sprint 3 Sprint 4 Sprint 5 Sprint 6 Pre-Dev Dev Dev Dev Dev Dev Dev Dev
  • 8. Experience Driven Agile: Developing Up to an Experience, Not Down to a Feature Rehash of a Webinar by: Kaleb Walton & Brian Anderson
  • 9. The “Pitch”  Quickly conveys background of problem, Effective Prioritization and proposed solution and statement of value Assignment of Work Items  Shirt-size estimates make for easy The problem is that systems prioritization (story points are fine too) managers spend too much time prioritizing and assigning their  Sprinkle in risk and value to make team's daily work efforts. prioritization even easier Imagine if Systems Manager Plus offered better prioritization  Prioritize dozens of experiences, not capabilities and automated assignment based on definable hundreds business rules.  General format: This solution would result in reduced cost for systems The problem is <problem>. Imagine if managers by enabling more <solution>. This solution would result in efficient work assignment, leading to better response <value statement>. times.  Lightweight precursor to... Copyright © 2012 Kaleb Walton, Brian Anderson, Michael Hughes and Terri Whitt
  • 10. The “Scenario”  Borrowed from UX discipline  Paints a clear picture of an entire experience  Extremely versatile and ready for use outside development  Ourreal-world example of a person's “A definition: experience with a product, describing context with a problem and a proposed solution.” Copyright © 2012 Kaleb Walton, Brian Anderson, Michael Hughes and Terri Whitt
  • 11. Scenarios Are Agile  Just Barely Good Enough and Just in Time: Fidelity naturally matches immediate need.  Ya Ain’t Gonna Need It: Does it enable the scenario?  Minimum Viable Product: What is the minimum experience someone would pay for?  Lightweight: Low cost to develop, flexible and quick to communicate.  Better Contract: More reliable as it's written in terms of Experience rather than Features. Copyright © 2012 Kaleb Walton, Brian Anderson, Michael Hughes and Terri Whitt
  • 12. Telling a Story Copyright © 2012 Kaleb Walton, Brian Anderson, Michael Hughes and Terri Whitt
  • 13. Example Scenario EFFECTIVE PRIORITIZATION AND ASSIGNMENT OF WORK ITEMS PROBLEM Mary, a systems manager at ABC Health, is responsible for a team of 12 system administrators who handle steady state support of their health care systems and network. One of her biggest time sinks is prioritizing and assigning her teams daily work efforts. The tool she uses, Systems Manager Plus, doesn't give her any prioritization features except for the ability to sort on a 'priority' field when reviewing work items. As she spends half of her time prioritizing she ends up working over time to tend to her other duties. SOLUTION After a major update Mary signs into Systems Manager Plus, heads to the work items area and is pleasantly surprised to see a number of new prioritization capabilities. There are more fields available to sort and filter, as well as a “smart assignment” system that enables her to specify rules that will result in automatic assignment to specific members of her team. Mary creates a few rules, applies them to existing work items, and is excited to see that over a quarter of the items were automatically assigned. She proceeds to sort and filter the remaining work items to prioritize and assign to her team. As more work items trickle in she notices that many of them are being auto-assigned. These improvements have enabled Mary to focus less on prioritizing and more on doing. Copyright © 2012 Kaleb Walton, Brian Anderson, Michael Hughes and Terri Whitt
  • 14. Easily Pull Out Stories and Epics Additional sorting capabilities As a systems manager I want to sort work items by additional fields such as created date, severity and platform so that I can more effectively prioritize them. Additional filtering capabilities As a systems manager I want to filter work items by additional fields such as created date, severity and platform so that I can more effectively prioritize them. Smart assignment system (epic) As a systems manager I want to specify assignment rules for the system to use to automatically assign work items so that I don't have to assign every work item manually. Apply new smart assignment rules to existing work items As a systems manager I want to apply new smart assignment rules to existing work items so that I can use smart assignment on work items created after the smart assignment process has executed. Copyright © 2012 Kaleb Walton, Brian Anderson, Michael Hughes and Terri Whitt
  • 15. Scenarios Are Agile  Just Barely Good Enough and Just in Time: Fidelity naturally matches immediate need.  Ya Ain’t Gonna Need It: Does it enable the scenario?  Minimum Viable Product: What is the minimum experience someone would pay for?  Lightweight: Low cost to develop, flexible and quick to communicate.  Better Contract: More reliable as it's written in terms of Experience rather than Features. Copyright © 2012 Kaleb Walton, Brian Anderson, Michael Hughes and Terri Whitt
  • 16. Basic Experience Driven Agile Involvement Over Time by Role Scrum Masters, Developers Product Owners, and Testers UX Analysts, Architects and Stakeholders Product Mgt Product Backlog Iteration Backlog Activities Pitches Scenarios Stories Estimate, Valuate Estimate Assess, Prioritize Copyright © 2012 Kaleb Walton, Brian Anderson, Michael Hughes and Terri Whitt
  • 17. Experience Driven Agile At Scale Involvement Over Time by Role Scrum Masters, Developers Product Owners, and Testers UX Analysts, Architects and Stakeholders Portfolio Backlog Product Mgt Product Iteration Activities Pitches Backlogs Backlogs Scenarios Stories Scenarios Estimate, Valuate Prioritize Estimate Assess, Prioritize Copyright © 2012 Kaleb Walton, Brian Anderson, Michael Hughes and Terri Whitt
  • 18. Contact Us Kaleb Brian Anderson user.experience.guy@gmail.com Walton kalebwalton@gmail.com Thanks to Other Experience Driven Agile Contributors Michael Hughes, Ph.D Terri Whitt michaelhughesua@gmail.com tw30306@yahoo.com http://experiencedrivenagile.com
  • 20. Any Method Can be Adapted  Quick  Bare minimum of effort  Get needed feedback  Provide recommendations  Repeatable
  • 21. Scope Effort  Consider budget, resources  Time  Recruiting  Facilitating  Analyzing  Adding participants increases budget & time
  • 22. Paper, Clickable or Real Code?  Always start with paper  Guerilla / hallway test  Users may misunderstand  Clickable prototypes  Easier to understand  Can easily change  Real Code  Great if it’s the right solution
  • 23. Paper or Clickable Prototype  Rapid Iterative Testing & Evaluation (RITE)  Traditional Testing  In-Person  Remote more challenging
  • 24. Rapid Iterative Testing & Evaluation  Qualitative user feedback  actions + comments  Series of small usability tests  3 participants each day  Minimum of 3 days of testing  Iteration between testing days  Total of 5 days
  • 25. RITE Process Priority Test & Level of Effort Update Test 1 High 2 Medium 3 Low 25
  • 26. Recap Sessions  End of each day - after the last session  Room with a whiteboard.  About 30 minutes.  Discuss:  trends seen  concerns  recommendations  prioritize changes for the next round  list lower priority changes for future iterations 26
  • 27. RITE Results  Final prototype  Vetted with users  Base for recommendations  Light Report: “Caterpillar to Butterfly”  Screenshots show progressions  What changes were made and why
  • 28. What Works for RITE  Best used early in project lifecycle  Early concepts  Need to be vetted with users  Can assist in quickly shaping designs 28
  • 29. General Testing  Traditional Testing  In-Person  Remote  Moderated or Unmoderated  Less users, shorter sessions: analyze at lunch  Recommend 3 or more users  Half hour to 1 hour each
  • 30. Regular Testing (Yes, this is an old idea; a great one!)
  • 31. Bring it On!  Small focused tests  Reduce waiting for recruitment  Once per week or per Sprint  Same day mid-week (not Monday or Friday)
  • 32. User Testing Day!  Make team aware  Invite everyone  Watch remotely  Recurring meeting invites for stakeholders
  • 33. What could I test?  Identify what to test at start of Sprint  Work in Progress  Multiple projects  Prototypes  Concepts, rough ideas, brainstorming  Competing designs, (A/B testing)  Comparative studies across market  Conduct interviews to inform research  More…
  • 34. “Teams should stretch to get work into that day’s test and use the cadence to drive productivity.” - Jeff Gothelf - http://blog.usabilla.com/5-effective-ways-for-usability-testing-to-play-nice-with- agile/
  • 35. Why Regular?  Team becomes:  accustomed to steady stream of qualitative insight  insight ensures quick decisions…line up with business and user goals Adapted from Jeff Gothelf - http://blog.usabilla.com/5-effective-ways-for- usability-testing-to-play-nice-with-agile/
  • 36. Include PWD  People with disabilities  “We are all only temporarily able-bodied. Accessibility is good for us all.”  Get to spirit of the law (Section 508, WCAG 2.0) -@mollydotcom at #stirtrek 2011 via @carologic
  • 38. Pre-Book Your Rooms  Test & Observation Rooms  Any location will do  Conference rooms  Offices  Quiet corner of cafeteria  Remote
  • 39. Create Reusable Templates  Screener  Technology use/experience  Knowledge of topic  Scripts/Guides  Consent Forms  Data Collection
  • 41. Find Patterns Quickly Issue P1 P2 P3 Search Used Yes No No Widget 1 Used N/A Used – unsure about Task 1 Notes 3 – easy 2 – needed 3 – easy help Task 2 Notes 2 – needed 2 – easy 2 – needed help help Task 3 Notes 2 – needed 3 – easy Ran out of help time Task 4 Notes 2 – needed 3 – easy Ran out of help time
  • 42. True Statements  All interfaces have usability problems  Limited resources to fix them  More problems than resources  Less serious problems distract  Intense focus on fixing most serious problems first Adapted from: Rocket Surgery Made Easy: The Do-It-Yourself Guide to Finding and Fixing Usability Problems. By Steve Krug
  • 43. Debrief with Team  Assumes stakeholders watched tests  If not, wait for UX analysis  Quick analysis to quick decisions  All decision makers MUST be present
  • 44. Goal  Identify top 5 or 10 most serious issues  Top 3 from each list  Prioritize from lists  Commit resources for next sprint  Stop Adapted from: Rocket Surgery Made Easy: The Do-It-Yourself Guide to Finding and Fixing Usability Problems. By Steve Krug
  • 45. Guidelines  Stay on Topic  Be Constructive  Don’t get distracted by small problems  Intense focus on fixing most serious problems first
  • 46. Make Useful & Usable Recommendations - Quickly
  • 47. Transform Data  Look for patterns  Read “between the lines”  Know what you’ve got  Sort, reorganize, review, repeat  What refutes your expectations?  Surprises?  Outliers?
  • 48. Short and Direct Communication  Email or One Pager  Think about audience  How will it be used?  Include  Goal of study  What will be fixed and who assigned to  Tasks attempted  Who observed  Future research/enhancements
  • 49. Tweak, Don’t Redesign  Small iterative changes  Make it better now  Don’t break something else  Take something away  Reduce distractions  Don’t add – question it Rocket Surgery Made Easy: The Do-It-Yourself Guide to Finding and Fixing Usability Problems. By Steve Krug
  • 50. Do UX Early & Often  Make users visible  Information radiators  Test findings  Artifacts  Personas  Word Clouds - IA
  • 51. Recommended Readings Gothelf, Jeff. Lean UX: Getting Out of the Deliverables Business. (Anticipated in Feb. 2013) 5
  • 52. Contact Carol @Carologic Email: Carologic@gmail.com SlideShare.net/Carologic SpeakerRate.com/speakers/15585-CarolJSmith
  • 53. Tool Considerations • In-person or remote? • Lab or on-site? • Prototype limitations (can it be online?, is it a document or a clickable site?) • Number of observers, number of participants? • Number of facilitators? • Logging and video editing needs (time on task, highlight video creation)? • Surveys before or after? • Eye tracking?
  • 54. Usability Testing Software • Morae • Ovo • SilverBack (Mac only) • UserWorks • Noldus • Tobii (Eye-tracker) • SMI (Eye-tracker) • SurveyMonkey
  • 55. Screen Sharing Software  GoToMeeting – http://www.gotomeeting.com  Lotus Sametime Unyte – http://www.unyte.com  YuuGuu -- http://www.yuuguu.com  WebEx – http://www.webex.com  Yugma -- https://www.yugma.com/  Trouble Shooting: CoPilot - https://www.copilot.com/
  • 56. Recommended Sites  Usability.gov  W3C Web Accessibility Initiative  http://www.w3.org/WAI/  Accessibility Standards in US (Section 508)  http://www.access-board.gov/sec508/508standards.htm  Jakob Nielsen  http://www.useit.com  UPA – professional UX association  http://www.upainternational.org/
  • 57. References  Albert, Bill, Tom Tullis, and Donna Tedesco. Beyond the Usability Lab.  Beyer, Hugh. User-Centered Agile Methods (Synthesis Lectures on Human- Centered Informatics)  Gothelf , Jeff. http://blog.usabilla.com/5-effective-ways-for-usability-testing- to-play-nice-with-agile/  Henry, S.L. and Martinson, M. Evaluating for Accessibility, Usability Testing in Diverse Situations. Tutorial, 2003 UPA Conference.  Krug, Steve. Rocket Surgery Made Easy: The Do-It-Yourself Guide to Finding and Fixing Usability Problems.  Ratcliffe, Lindsay and Marc McNeill. Agile Experience Design: A Digital Designer's Guide to Agile, Lean, and Continuous.  Rubin, Jeffrey and Dana Chisnell. Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests. John Wiley & Sons, Inc.