Leading Lean : Managing Lean UX Work in the Enterprise [MX 2014 Conference by Adaptive Path]

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Hello! Principal, Intelleto.com Co-Founder, Luxr.co Sketchnoter, graphic recorder Entrepreneurship + UX @katerutter http://intelleto.com

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Around the room intros * name * role * your favorite superpower! Hello! Instant infographics With dots!

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com I am not an expert on your business. You are. My goal is to help you identify one way you can innovate using lean practices... so you can experiment and learn ﬁrst-hand if itʼs helpful. What to expect...

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com We are going to be working really, really, really fast. What to expect...

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com There is a purpose to this. I will push you to get something down rapidly. In 3 hours, you will have an experiment you can run to test-drive lean methods. We are going to be working really, really, really fast. What to expect...

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com You will be working solo and also in peer pairs. Two brains are better than one. And weʼll keep talking to a minimum. (There is a break where we can get all social!) What to expect...

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com You may not like the pace/process/ pressure/perspective, etc. etc. That is okay. All I ask is that you keep an open mind and try it. What to expect...

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com About the whole “Lean” thing

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Build. Measure. Learn Lean startup?

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Lean Startup Startup: a human institution designed to create new products or services under conditions of extreme uncertainty.

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com 3 Key Ideas Build. Measure. Learn! Validated Learning Get out of the building! Customer DevelopmentAgile Development Collaborate. Release. Improve!

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com The Agile Manifesto came about at a ski scrum in February 2001. The big idea... over over over over

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Steve Blank introduced “Customer Development” in...um...2006. The big idea...

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Eric Ries wrote a blog post on Sept 8, 2008 titled “The Lean Startup.” + incremental releases make products customers want + reduce waste The big synthesis...

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com • Experiments • Validated learning • Reduce waste Lean Startup So, what does it look like?

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com http://www.slideshare.net/ellendunne/failchat-ux- comes-ﬁrst-because-ux-is-everything-12883354 (story starts on slide 19) View the Lumatic story on Slideshare:

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Okay, ﬁne. But how does this relate to User Experience

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Features Users Uses Product Needs Company Purpose via @luxrco sketches, prototypes, wireframes pixels UI UX as a stack BUILD MEASURE LEARN

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Lean + enterprise? risk innovation focus

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com via The Lean Entrepreneur: http://leanentrepreneur.co/

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com risk timeDeﬁne The old way Design Develop Release

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com risk timeDeﬁne Design Develop Release a better old way

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com risk time A different way

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com risk time A different way MAKE release MEASURE BUILD LEARN MEASURE BUILD

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com BUILD MEASURE LEARN More cycles in less time reduce the risk. faster!

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Features Users Uses Product Needs Company Purpose via @luxrco sketches, prototypes, wireframes pixels UI Stakeholders Team purpose Programs & Processes Needs & Goals Experiments { hypotheses tests evidence learning BUILD MEASURE LEARN UX as a stack

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com New competencies • Frame our work differently • Draft and run experiments • Focus on observable metrics • Intent = learning, not time & budget

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Letʼs make stuff

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com an area to innovate an experiment • opportunity • molecule • hypothesis • evidence (metrics) • test + deﬁne it test it

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com ﬁnd an opportunity

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com {Activity} Brainstorm 6 areas to innovate Not like this... Spread collaborative design practices through all product teams More like this... Be more innovative

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com {Activity} Brainstorm 6 areas to innovate • Team dynamics • Spreading design in the enterprise • Maintaining innovation • Engaging with the rest of the organization Some themes...

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com {Activity} Brainstorm 6 areas to innovate • 1 idea per stickynote • Working solo • Focus on an internal opportunity • Speciﬁc is GOOD • Go fast! 5 min

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com more important less important {Activity} Divide into 2 piles 2 min

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com more important {Activity} Pick one 1 min

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com more important {Activity} Pick one this is your opportunity

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com letʼs hear a few

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com explore the opportunity

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com {Activity} Users + problems + solution Sketch it out Who are the stakeholders? What problems do they have? What would be a proposed solution?

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Sketch it out people + problems + solutions related to your opportunity Who are the stakeholders? What problems do they have? What would be a proposed solution?

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com “the DNA of an idea” 7 min

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com a training program for collaborative design techniques Product managers Long product release cycles Duplication of effort Silo’d product teams UX Team @ Acme.com 03 16 14 “the DNA of an idea” 7 min

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com About experiments

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com The belief you want to test. The testable “thing.” An indicator of the outcome. “We believe people like [customer type] have a need for (or problem doing) [need/action/behavior].” “The smallest thing we can do to prove that need is [experiment].” “We will know we have succeeded when [quantitative/measurable outcome] or [qualitative/observable outcome].” Hypothesis Experiment (test) Evidence Something accepted as true without proof. “Collaborative design delivers better products” Assumption Sounds like...Deﬁnition... Lean Experiments

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com http://techcrunch.com/2012/03/10/100proof/

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com ! 2000 users " high sharing

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Break!

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Make a hypothesis

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com ✓Simple, clear & speciﬁc ✓Written as a statement ✓Establishes • participants (who) • problem or need (why) • behavior (observable with evidence) ✓Testable A good hypothesis is...

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Keep it small, keep it tasty. mmmm! cupcake via @brandonschauer

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com {Activity} State the opportunity as a hypothesis. 5 min

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com {Activity} Peer check & improve 10 min Find a partner. Do a 1-minute “quiet read” Ask questions to clarify understanding. Make 2 suggestions to strengthen the work. • ~5 minutes each

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Deﬁne some evidence (aka: metrics)

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com ✓Simple, clear & speciﬁc ✓Quantiﬁable ✓Based on behavior ✓Time-dependent ✓Testable A good metric is...

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com 64 vanity total # of visits to intranet info page awesome % of PMs signing up for a workshop in first week better # of PMs signing up for a workshop in first week good # of PMs signing up for workshops useless more collaborative design thinkers A good metric measures the behavior of a person doing a speciﬁc thing that delivers value to them. Metrics Tips : Is it actionable?

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com {Activity} Brainstorm 6 metrics Not like this... % of PMs signing up for a workshop in first week More like this... more collaborative design thinkers

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com {Activity} Brainstorm 6 metrics • 1 idea per stickynote • Working solo • Focus on measuring actions or behaviors • Speciﬁc is GOOD • Go fast! 5 min

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com more important less important {Activity} Divide into 2 piles 2 min

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com more important {Activity} Divide into 2 piles these are your (working) metrics

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com {Activity} Make a dashboard. 1 min % of PMs signing up for workshops in first week # of employees attending an info session Avg daily views of intro to design thinking video

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com letʼs hear a few

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Write a test

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com ✓Simple, clear & speciﬁc ✓Generates evidence ✓Time-based ✓Uses minimum amount of time, money and effort ✓Doable - doesnʼt require approval! A good test is...

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com What you have to work with Spread collaborative design practices through all product teams opportunity hypothesis molecule evidence test

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com {Activity} The experiment template

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Create an intranet landing page for sign- ups for a 1-hour info session on collaborative methods. Put an announcement on the PM intranet site. Email all PMs, designers and developers in the division. What will you do or make? Who is involved? How much will it cost? How long will it take? (Shorter is better. Max of 2 months.) What do you need to do it? {Activity} Write a test. 10 min

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Put it all together & iterate

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com {Activity} Combine 5 min

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com {Activity} Smallify 10 min How can you get the same amount of learning in less time? Redesign the experiment in a shorter timeframe: • 2 hours • 2 days • 2 weeks

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com {Activity} Peer check & improve 15 min Find your partner. Do a 2-minute “quiet read.” Make 3 suggestions to strengthen the experiment. • 5 minutes each

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com {Activity} Reﬁne 5 min

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Letʼs share stuff

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com {Activity} Pitch practice 10 min Come up and share your experiment. 2-minute time limit. 3 volunteers!

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Q&A Discussion

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Geek out & learn more

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com This way of working is hard. But itʼs worth it.

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Go be awesome.

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com Kate Rutter @katerutter http://intelleto.com Thanks!

Leading Lean | MX 2014 | MAR 16, 2014 | @katerutter | intelleto.com HANDOUTS

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014 • Experiments • Validated learning • Reduce waste Lean Startup Customer Development • make products customers want Agile Development • Iteration & incremental releases Lean Manufacturing • Reduce waste Startup: a human institution designed to create a new product or service under conditions of extreme uncertainty.

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014 Features Users Uses Product Needs Company Purpose sketches, prototypes, pixels UI BUILD MEASURE LEARN UX Stack + Lean Startup

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014 The belief you want to test. The testable “thing.” An indicator of the outcome. “We believe people like [customer type] have a need for (or problem doing) [need/action/behavior].” “The smallest thing we can do to prove that need is [experiment].” “We will know we have succeeded when [quantitative/measurable outcome] or [qualitative/observable outcome].” Hypothesis Experiment Evidence Something accepted as true without proof. “People need our product.”Assumption Sounds like...Deﬁnition... Lean Experiments

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014 ✓Simple & clear ✓Written as a statement ✓Establishes • participants (who) • variables (whatʼs involved) • prediction of an outcome (evidence) ✓Testable A good hypothesis is...

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014 3. Is there an object basis? • “per user” [ ___/user] • “per user per week” (fancy!) • Examples: per user, per session, or by interaction or item (messages per ﬁle, emails per thread) * not required, but super-helpful • “per week” [ ___/wk ] • “per month” [ ___/mo] 2. Is there a time basis? • “number of...” [ # ] • “average number of...” [avg ] • “percent of...” [ % ] 1. Does the metric begin with a number? Metrics Tips

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014 98 vanity good betteruseless awesome total number of registered users % of users who post an update 3+ times a day, per week % of users who sign in 3+ times a day, per week % of new registered users per week sign-ups a great metric... ...makes you look at all the other metrics and say “none of those other numbers matter if we donʼt get this right ﬁrst.” a good metric... ...measures the usage of the product by a person. The usage should be speciﬁc to features that deliver value to the user. * In this example, posting an update is a key feature of the product. Metrics Tips : Is it actionable?

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014 HypothesisHypothesis Team name date / / “We believe people like ________________________________ have a need for (or problem doing) _______________________________ _______________________________ _______________________________.” customer type need/action/behavior

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014 Experiment We believe that... We will do/make... We will know the hypothesis is valid if by we get... Hypothesis date quantitative measurable outcomes TestEvidence qualitative observable outcome Team name date / /

MX Conference : Leading Lean Workshop : March 16, 2014 http://luxr.co @luxrco © 2014 !"#$%& Evidence dashboard !"#$%& !"#$%& by Goal Notes / / / / / / '()*++"++),$(-$"++.)/")/%00)!"*+1$")#2"+")!"#$%&+3 4*#"