The talk can be summarised as follows: In enterprise scale agile developments, UX is often heavily outnumbered by the rest of the team. The pressure to maintain a certain level of engagement mounts until, inevitably, elements of the product fall through the cracks. I propose that the UX team needs to 'Set the bar' for ux engagement on individual features, and I have proposed a technique for tracking this engagement through the agile development lifecycle. In doing so, we will see a ‘UX engagement trend’ which allows us to: - Measure UX engagement across agile teams and features - Improve the efficiency of UX resources - Facilitate discussions of quality with management and business - Track UX debt - Spot potential weaknesses in the product

1. Managing UX-pectations
By Warwick Bracken

2. http://www.meetup.com/The-UX-Design-Group-of-Melbourne/

3. Attribute: http://www.scaledagileframework.com

4. UCD gets lost
in the system
• UX becomes a bottleneck
• Rushed designs
• No UX input at all
• Communication breakdown

5. 1. We need to set realistic
expectations on UX
engagement and quality.
2. We need visibility of what
is falling through the
cracks.

6. Target experience quality
Aarron Walters hierarchy of user needs.
Functional
Reliable
Usable
Pleasurable

7. Business
Management
Engineering
We work with mere
mortals…

8. UX is a
dark art

9. DISTRIBUTED MODEL
UX management needs to keep an eye
on the whole feature.
Then we have to deal with multiple
component teams…huh?
Story Story Story
Story
Story Story Story

10. In an “Agency” UX
engagement model…

11. Dependencies… ouch.

12. We may need an alibi…
•Poor designs
•No user testing
•No UX engagement at all
•Blown deadlines
•UX debt is swept under the rug

13. • Managing expectations
• Arm ourselves with metrics
How to get
Away
With murder…

14. UX Engagement
• Which features will we work on
• Which model are we going to use this release
• Dependencies and timeframes
• Responsibilities and communication
• Timing of UX rituals (Design reviews, workshops)
Managing
expectations

15. Functional
Reliable
Usable
Pleasurable

16. Meeting: “Setting the bar”
When: Release & iteration planning sessions
Who: Stream leads & UX team
Agenda: • Set a target quality for MVP
• UX Engagement
• Estimation process
• Quality gates
• UX trend
• Predicting debt

17. UX DebtSet a target quality
for MVP
Factors the group should
consider:
• Timeframes
• Available resources
• Iterations
• Business/User value
Functional
Reliable
Usable
Pleasurable
MVP

18. UX Engagement
• Which model are we going to use this release
• Dependencies
• Timing of UX rituals (Design reviews, workshops)
• Time allocated for research and future work

19. Estimation
of features or stories
MVP
Set some basic standards for
UX engagement:
Business signoff
UX Engagement
Visual design
SME Workshops
Prototype
Guerilla testing
Functional
Reliable
Usable
Pleasurable

20. MVP
Business signoff
UX Engagement
Visual design
SME Workshops
Prototype
Guerilla testing
Functional
Reliable
Usable
Pleasurable
Estimation
of features or stories

21. System Usability Score
Micro-interactions
Fully functional prototypes
Guerilla testing
Paper prototypes
Team design reviews
Workshops
Visual designs
Lo-fi wireframes
UX engagement
Business signoff
MVP
Functional
Reliable
Usable
Pleasurable
Estimation
of features or stories

22. Focus groups
Contextual enquiries
Eye tracking
Interviews
System Usability Score
Micro-interactions
Fully functional prototypes
Guerilla testing
Paper prototypes
Team design reviews
Workshops
Visual designs
Lo-fi wireframes
UX engagement
Business signoff
MVP
Functional
Reliable
Usable
Pleasurable
Estimation
of features or stories

23. Prioritisation …
• Business value
• Weighted shorted job first
• We may not get a seat at the table
• Will probably result in “Bronze”

24. UX DebtUX Debt management

25. UX trend
Rush job = -1 point
No UX input = - 2 points

26. Custom JIRA value

27. Quality gates
Gates give us an opportunity to review designs, and
adjust our UX trend value.
Story Story Story
Story
Story Story Story

28. Optimistic burn-up

29. Realistic burn-up

30. UX Trend Quality

31. Team dashboard
Distributed team
Hybrid team
Agency team

32. Predicted UX Debt

33. • Assists resource planning
• Encourages focus on quality
• Facilitates improvement of processes
• Highlights potential weakness
• Liberates the UX team
In the short term

34. • Correlate UX trend with other metrics
• Improve UX efficiency
• Justification for more resources
• Improved product quality
In the long term

35. Summary
• Communicate early and often
• Set the bar for UX engagement
• What gets measured gets managed
• Arm yourself with metrics

36. Thank you
Warwick Bracken
Oakton
warwick.bracken@oakton.com.au