SlideShare a Scribd company logo
Lisa Fast
@lisavation
#GOAT2017
Not Too Minimal:
UX Research in a Government
Minimum Viable Product
2
Original Minimum Viable Product View – focus on user need
http://blog.crisp.se/2016/01/25/henrikkniberg/making-sense-of-mvp
3
“The MVP Build-Measure-Learn
feedback loop is at the core of the
Lean Startup model. An experiment
is … also a first product.”
- Eric Ries
4
Minimum Valuable Product
https://www.quora.com/What-is-the-difference-between-a-
prototype-and-a-minimum-viable-product-MVP

Recommended for you

Mark Andersen DFW DevOps Days 2017
Mark Andersen DFW DevOps Days 2017Mark Andersen DFW DevOps Days 2017
Mark Andersen DFW DevOps Days 2017

Capital One transitioned to DevOps by starting with a SWAT team that automated builds, deployments, and infrastructure for two applications. This improved speed and removed handoffs. Challenges included trying to automate everything at once and handoffs when automation was returned to application teams. Key lessons included focusing on automation and API's, reducing handoffs, avoiding silos, and delivering working solutions over perfection.

devopscloud
Top Lessons Learned From The DevOps Handbook
Top Lessons Learned From The DevOps HandbookTop Lessons Learned From The DevOps Handbook
Top Lessons Learned From The DevOps Handbook

Gene Kim, DevOps thought leader and Strategic Advisor at XebiaLabs, gives his keynote presentation at the DevOps Leadership Summit in Boston MA.

devops leadership summitaracontinuous deployment
Cloud Academy Webinar: Recipe for DevOps Success: Capital One Style
Cloud Academy Webinar: Recipe for DevOps Success: Capital One StyleCloud Academy Webinar: Recipe for DevOps Success: Capital One Style
Cloud Academy Webinar: Recipe for DevOps Success: Capital One Style

Capital One transitioned to a DevOps model to improve speed of delivery and reduce handoffs between teams. They started with a SWAT team that automated builds, deployments, and infrastructure for two applications. This proved successful and they expanded automation to more applications. Challenges included trying to automate everything at once and handoffs when automation was returned to application teams. Key lessons included focusing on automation, removing handoffs, training application teams on automation, and delivering working solutions incrementally rather than waiting for perfection.

devopscloudcloud computing
5
“A Minimum Viable Product is the
smallest thing you can build that
delivers customer value (and as a
bonus captures some of that value
back).”
– Ash Maurya
https://blog.leanstack.com/minimum-viable-product-mvp-7e280b0b9418
6
https://hackernoon.com/the-mvp-is-dead-long-live-the-rat-233d5d16ab02
7
Risky assumption testing requires a level of
Agile maturity not present in most of the
Government of Canada.
In this project, the idea of starting small
was a struggle, most expected to get the
complete product at launch – despite
ongoing mega-project troubles…
8

Recommended for you

Agileand saas davepatterson_armandofox_050813webinar
Agileand saas davepatterson_armandofox_050813webinarAgileand saas davepatterson_armandofox_050813webinar
Agileand saas davepatterson_armandofox_050813webinar

Cucumber and RSpec are testing tools used in behavior-driven development and test-driven design. Cucumber tests user stories written in a business-readable language and converts them to automated acceptance tests. RSpec is a testing framework that allows writing unit tests in a domain-specific language. Together, Cucumber and RSpec support a test-first approach to agile software development where user requirements are tested through acceptance tests before code is written to pass unit tests.

Building a design system with (p)react
Building a design system with (p)reactBuilding a design system with (p)react
Building a design system with (p)react

The document summarizes a front-end lead's discussion of their organization's design system called Poncho. It describes Poncho as including documentation, Sketch symbols, and Preact components to help 14 teams build products more efficiently. The process for Poncho involves shared ownership and review. It also discusses how they motivated adoption of Poncho and the technical choices including using Preact for its smaller size compared to React.

preactreactdesign systems
Conference Room Prototype – a low cost, high value approach to selecting the ...
Conference Room Prototype – a low cost, high value approach to selecting the ...Conference Room Prototype – a low cost, high value approach to selecting the ...
Conference Room Prototype – a low cost, high value approach to selecting the ...

How can you best evaluate a solution before making the big investment? Over several years Mekon has worked with many companies, from medical and semi-conductor manufacturers to software and professional publishers, helping them to select a technology solution fit for purpose. Gathering requirements and choosing the right tools is often more difficult than many companies expect. Use cases and non-functional requirements that accurately reflect what you need are crucial to the success of any IT project, yet evidence suggests typical use cases and requirements are too loose and high level to really do the job. This presentation will: * Explain methods that Mekon has developed. * Evaluate customer experience in conducting the Conference Room Prototype (CRP). * Outline what metrics can be used to evaluate the tools and what surprises you may encounter.

lavacon lavacon2014
9
Receptive moment in government
10
UX Research is all about
Value & Viability
Understanding needs for value
Ensuring they can derive that value
11
The challenge: Email-only Consultations for Gazette Part I
Part I: “a final opportunity to review and comment on a proposed regulation at the last
stages of the regulation-making process, before it is enacted”
12
Starting Point: US eRegulations -18F Comment Pilot Test in June 2016
https://18f.gsa.gov/2016/07/26/new-pilot-aims-to-streamline-notice-and-comment-process/
https://epa-notice.usa.gov/

Recommended for you

UXPA 2023: The Report is Dead, Long Live the Report! How to Communicate Usabi...
UXPA 2023: The Report is Dead, Long Live the Report! How to Communicate Usabi...UXPA 2023: The Report is Dead, Long Live the Report! How to Communicate Usabi...
UXPA 2023: The Report is Dead, Long Live the Report! How to Communicate Usabi...

The best way to improve products is to have people use them, but researchers struggle to share what they’ve learned in a way that has immediate and long-lasting impact. How do we keep the design process moving while grounding it thoroughly in research? This talk will present evidence for and against reports, and explore characteristics of reports that make them more and less successful at effecting change. We will describe where approaches like debriefs, co-design, and video have succeeded and fallen short. Based on survey data from UX practitioners and experiences in the field, we’ll address these questions: Is it worth it to write a report? Are there quicker, more engaging alternatives? What makes a compelling report? How do we make usability research usable? We’ll offer a framework for choosing the best reporting approach, and share best practices for determining what to communicate, and how.

uxuserexperienceuser experience
The Report is Dead, Long Live the Report! How to Communicate UX Research Find...
The Report is Dead, Long Live the Report! How to Communicate UX Research Find...The Report is Dead, Long Live the Report! How to Communicate UX Research Find...
The Report is Dead, Long Live the Report! How to Communicate UX Research Find...

The best way to improve products is to have people use them, but researchers struggle to share what they’ve learned in a way that has immediate and long-lasting impact. How do we keep the design process moving while grounding it thoroughly in research? This talk will present evidence for and against reports, and explore characteristics of reports that make them more and less successful at effecting change. We will describe where approaches like debriefs, co-design, and video have succeeded and fallen short. Based on interviews and survey data from UX practitioners, as well as our experiences in the field, we’ll address these questions: Is it worth it to write a report? Are there quicker, more engaging alternatives? What makes a compelling report? How do we make usability research usable? We’ll offer a framework for choosing the best reporting approach, and share best practices for determining what to communicate, and how.

uxuser experienceuser research
The Report is Dead, Long Live the Report ! Communicating Usability Research F...
The Report is Dead, Long Live the Report ! Communicating Usability Research F...The Report is Dead, Long Live the Report ! Communicating Usability Research F...
The Report is Dead, Long Live the Report ! Communicating Usability Research F...

The best way to improve products is to have people use them, but UX researchers struggle to share what they’ve learned in a way that has immediate and long-lasting impact. How do we keep the design process moving while grounding it thoroughly in research? This talk presents evidence for and against reports, and explores characteristics of reports that make them more and less successful at effecting change. We describe where approaches like debriefs, co-design, and video have succeeded and fallen short. Based on survey data from UX practitioners and experiences in the field, we address these questions: Is it worth it to write a report? Are there quicker, more engaging alternatives? What makes a compelling report? How do we make usability research usable? We offer a framework for choosing the best reporting approach, and share best practices for determining what to communicate, and how.

uxuser researchusability
13
LEAN UX Pilot assumptions:
We believe that online regulatory consultations will lead to effective commenting & analysis –
teams just fell into emails & spreadsheets as people stopped sending letters
This will improve:
the quality and efficiency of commenting by Canadians and analysis by government teams
We will have demonstrated this when we can measure*:
More time to think about comments – less time ’handling’ them:
• A decrease in frequency of copy/paste for receivers & analysts and decrease in ‘lost’ comments
• A decrease in time from closing date to completed analysis/review
• Improved quality and coverage of comments in review and decision process
Clearer and more thorough comments from Canadians:
• An increase in comments clearly associated with a specific section of the RIAS or proposed regulatory text
• An increase in the number of comments overall
* Measurement will be ‘loose’ for this pilot since so few submissions are expected for the selected regulation.
14
Start with prototype
before contract as
proof of concept
- assume that 18F
design is good start
15
UX Research sessions
started on prototype,
progressed to dev site as
features were implemented
Exploratory sessions – use and talk
16
Task: Get started - Orient the commenter
PROTOTYPE COMMENT MVP
Name and submit was at bottom of page
• First participant looked for it at top, wanted an idea of
what to expect, what was possible
Moved name etc. to top & added ‘Skip to first comment box’
to orient users to where they could enter comments.
Add ‘View summary /Submit’ buttons to top of page

Recommended for you

Welcome to User Experience (UX) Design at EMBL-EBI
Welcome to User Experience (UX) Design at EMBL-EBI Welcome to User Experience (UX) Design at EMBL-EBI
Welcome to User Experience (UX) Design at EMBL-EBI

Interested in learning how User Experience (UX) design can help you meet your goals? Join the UX designers of EMBL-EBI on Friday, 3 March at 11am in the Kendrew Lecture Theatre to hear about what they do and how they make data services better for researchers. During this 45-minute seminar we will introduce you to UX design, show how it can be applied and demonstrate how it can make a positive difference. The seminar will be followed by a discussion and refreshments, so you can meet EMBL-EBI's UX designers in person and explore how you might benefit from UX design in your own work. Speakers: Nikiforos Karamamis, Gabby Yordanova, Revathi Nathaniel & Michele Ide-Smith Organisers & on-hand for questions: Jenny Cham & Joseph Rossetto

user experienceusabilityux design
Create Great CNCF User-Base from Lessons Learned from Other Open Source Commu...
Create Great CNCF User-Base from Lessons Learned from Other Open Source Commu...Create Great CNCF User-Base from Lessons Learned from Other Open Source Commu...
Create Great CNCF User-Base from Lessons Learned from Other Open Source Commu...

The document discusses best practices for building communities around open source projects based on lessons learned from other successful open source communities like Apache, Docker, Eclipse, Cloud Foundry, OpenStack, ODL/ONOS, Linux Foundation, and Kubernetes. It provides examples of community activities from these projects that could be adopted by CNCF communities, such as meetups, test beds, certification programs, equal opportunity initiatives, and ambassador reporting. The document calls for a discussion on further developing CNCF communities.

kubernetescommunityevangelism
Applying Usability to Improve Value and Reduce Risk
Applying Usability to Improve Value and Reduce RiskApplying Usability to Improve Value and Reduce Risk
Applying Usability to Improve Value and Reduce Risk

This technical session was presented by Nathalie Cotte at the online IDEAS conference hosted by the Center for Information Development-Management - to explain how we care more and more about customers, but that we also need to remind everyone that developers also have needs to be considered!

tech writinghuman factorssoftware development
17
Task: Enter comments
• Research participants wanted reassurance it was saved
P2: “I'm always worried about saving– that’s what drives
us back to Word.”
• Had been burned by other experiences
• P1: “3 times I went to submit and it cleared my input - 3
times!!
PROTOTYPE COMMENT MVP
• Save button and saved message added
• P3: “Good to see that saved message!”
• P4: “This is very straightforward”
18
Task: Review summary before submit
PROTOTYPE
Participants were clear they need a record of their
submission for their members. Some post it on their
website. Would prefer a table view of their comments.
P1: If there was a table.”
P2: “I want to see a table of ALL possible comments with
blanks where I missed them”
Changed to table view in MVP –for Pilot, must return to main
page to edit/enter, long term should build it into here, also want to
email a copy of this to themselves
P4: “Display empty comments - That makes sense to see what you missed
especially if it was very long. I might put ‘read it’ in there for myself”
COMMENT MVP
19
Aha! Associations Perform Same Share-Receive-Analyze Process
Just like government, associations gather member comments, review & synthesize the
comments into a submission - need support & integration, not add-on copy/paste work
Participant 2: “So I could send them a link to see our actual submission- I like that idea as long as it was easy for them to do”.
Participant 4: “if we could do this, would we even keep a Word copy? Because it’s tedious… this could streamline our process”
Future is participative
democracy: invite
them in to the system,
let them use it with
their members & feed
their submission in
directly
Association members
Association
submission
Individual commenter
20
On-time launch of Comment Pilot in French & English
Site launched on-time on March 4th
simultaneous with Gazette on-line
launch of the proposed amendment

Recommended for you

Lean UX
Lean UXLean UX
Lean UX

Lean UX integrates UX design into Agile development by following a process of declaring assumptions, creating minimum viable products (MVPs), running experiments with users, and incorporating feedback into subsequent sprints. The process involves cross-functional teams collaborating to understand problems, develop initial solutions, test prototypes with users, analyze results, and refine ideas. User feedback is gathered continuously to guide iterative design improvements within each 2-week sprint cycle.

user experienceuxlean ux
306 belmont ssp08agileit
306 belmont ssp08agileit306 belmont ssp08agileit
306 belmont ssp08agileit

The document summarizes how one publisher changed its approach to online development to become more agile in 45 days. Key steps included assembling a highly skilled team, adopting an iterative "observe-orient-decide-act" process, using paper prototyping and frequent user testing to quickly iterate on designs, and optimizing meetings and communication through online project management tools. This allowed the team to rapidly implement new features and improvements through a series of biweekly sprints.

"Open" includes users - Leverage their input
"Open" includes users - Leverage their input"Open" includes users - Leverage their input
"Open" includes users - Leverage their input

This document discusses various user research methods that can be used to improve open source software and ensure diversity. It begins by explaining the importance of intentionally including a diverse user base to drive innovation. It then provides an overview of common user research methods such as interviews, usability testing, card sorting, and analytics reviews. Specific examples are given around label testing and task-based navigation that resulted in improved user experiences and outcomes. The overall message is that proactively involving and understanding users is critical for the success of any software, including open source projects.

uxopen sourcediversity
21
Hold up stickies to vote on 4 UX research sessions
– in 6 weeks from contract to launch
Too much
Too minimal
Just right
Minimum viable
Not
enough
Not minimal
22
External Stakeholders really got ‘minimal’
• Result: Only 1 of 5 association stakeholders submitted their comments online – the rest stuck to email
and the HC team entered their emailed comments into the system themselves to learn
• 18F pilot had slightly more, about half of submissions came in via the pilot, was better integrated but
their participants also sought in-progress drafts and mult—session editing
Participant 1: “I get that this is much better for the government, then it’s all laid out in a table for them…
But it creates more work for me. It’s a second layer – I put it in a table and say hey members, send out
a table to them and get them to do it. There’s no save and share option here.”
23
Make notes on stickies during next bit
Not enough
Too minimal
Just right Too much
Not minimal
Your noteYour noteYour note
24
External Commenter Site Internal Analysis Toolkit
Now to the other VALUE - the back end (18F MVP did not do this)

Recommended for you

1 rapid prototyping model
1 rapid prototyping model1 rapid prototyping model
1 rapid prototyping model

Rapid prototyping is a process that involves quickly building a prototype or working model to test design features, ideas, concepts, functionality, output, and performance before fully developing the final product. It originated in the late 1960s and became more accessible in the 1980s. Rapid prototyping decreases development time by allowing for early corrections and has advantages like increasing variants, complexity, communication and decreasing delivery times and costly mistakes. However, it can fail to replicate the real product and overlook problems, requiring endless revisions. The rapid prototyping process involves analyzing requirements, identifying objects and actions, organizing them logically, getting feedback, and iterating the prototype-feedback cycle until customers are satisfied before final development.

Framework for Agile Living Labs - FALL
Framework for Agile Living Labs - FALLFramework for Agile Living Labs - FALL
Framework for Agile Living Labs - FALL

The Framework for Agile Living Labs (FALL) projects aim to provide practitioners with actionable guidelines on how to run a Living Lab project in an agile way. Developed by imec.livinglabs

livinglabsliving labsfall
Radical Roadmapping - Creating Synchronized Agile Product and Technology Road...
Radical Roadmapping - Creating Synchronized Agile Product and Technology Road...Radical Roadmapping - Creating Synchronized Agile Product and Technology Road...
Radical Roadmapping - Creating Synchronized Agile Product and Technology Road...

This session will discuss why a company would create and maintain three major artifacts - Innovation Roadmap, Infrastructure/ Platform Roadmap, and Operations/DevOps Roadmap - as well as the process to do so. Further, it will cover how to synchronize them in order to move away from making "OR" decisions to making "AND" decisions that will please all stakeholders. It will also discuss key cultural changes that must be present in order to achieve maximum benefit from this approach and challenges experienced along the way to making this a reality at Socialware, a SaaS product company. Finally, this session will include real world examples of the evolution of these roadmaps over 18 months that participants can take away and use as guidelines for their own situations. This was presented at the Keep Austin Agile 2016 conference, the #AgileAustin Product SIG and Product Camp Austin 2016 (#PCATX17)

software developmentleadershipagile
25
UX Research: Kicked off with Discovery workshop to discover
various roles, user needs & pain points in current process
Prepare Gazette Receive (Reg Management)
Worry: lose a comment or
lose track of a comment
Analyze (Programs)
Worry: miss an important
comment or issue
Review (all and TBS)
26
Discovery – your vote?
Too much
Too minimal
Just right
Minimum viable
Not
enough
Not minimal
27
Process from Discovery Maps Onto Key Tasks in Toolkit
demo
28
Data Model

Recommended for you

Software Prototyping
Software PrototypingSoftware Prototyping
Software Prototyping

The document discusses software prototyping. It defines prototyping as building initial versions of a software application that demonstrate functionality but may not contain the full logic of the final product. This allows getting early feedback from customers to better understand requirements. Different types of prototyping are covered, including throwaway, evolutionary, incremental, and extreme prototyping. The document also reviews best practices like reviewing prototypes with stakeholders and revising based on feedback. Potential applications and pros and cons of prototyping are presented.

businessmanagementsoftware
Full stack conference talk slides
Full stack conference talk slidesFull stack conference talk slides
Full stack conference talk slides

The slides for a talk at https://ar-fullstack.tech about how to create a great User Experience in Open Source Software.

open sourceuser experience
Open / Drupal Camp Presentation: Brent Bice
Open / Drupal Camp Presentation: Brent BiceOpen / Drupal Camp Presentation: Brent Bice
Open / Drupal Camp Presentation: Brent Bice

In this session we'll discuss how agile analysis and project management processes can be applied to Drupal implementation. We'll discuss the setting of expectations for stakeholders when planning and executing a Drupal project, and how to avoid the typical pitfalls. You'll also learn how a multi-disciplined project team can smooth your project execution, and increase your chance for overall success.

development and strategywebsite designdallas
29
Consultation Toolkit MVP co-designed with Health Canada team
UX research: Sketching, 4 co-design workshops & 2 usability test sessions with team members
30
Toolkit: View comments by
submission (commentary) or
by document section
31
Notes capture
analysis, progress and
decisions:
- See public notes by
other analysts
- Assign note a status
- Add public and
private notes
32
Co-design process – your vote?
Too much
Too minimal
Just right
Minimum viable
Not
enough
Not minimal

Recommended for you

Lean UX и дизайн-спринты: как построить ведущий продукт на рынке за пять дней
Lean UX и дизайн-спринты: как построить ведущий продукт на рынке за пять днейLean UX и дизайн-спринты: как построить ведущий продукт на рынке за пять дней
Lean UX и дизайн-спринты: как построить ведущий продукт на рынке за пять дней

The document discusses Lean UX design sprints, which involve solving problems in 5-day intervals through activities like mapping customer goals, sketching solutions, deciding on a prototype, prototyping it, and then testing it with users. It provides an example of how Pocket used sprints to increase user activation. Sprints follow a process of understanding the problem on Day 1, sketching solutions on Day 2, deciding on a prototype on Day 3, prototyping on Day 4, and then testing with users on Day 5. Metrics like the System Usability Scale and Net Promoter Score are used to evaluate prototypes.

cee-secr2016lean uxwrike
The Agile Readiness Assessment Tool Essay
The Agile Readiness Assessment Tool EssayThe Agile Readiness Assessment Tool Essay
The Agile Readiness Assessment Tool Essay

This report discusses Scrum, an agile software development methodology. It describes the key roles in Scrum - Product Owner, Scrum Master, and Development Team. It also outlines the core Scrum events - Sprint Planning, Daily Scrum, Sprint Review, and Sprint Retrospective. The report examines the Scrum process and how it aims to deliver working software frequently through short development cycles called sprints. It emphasizes that Scrum provides structure through its roles, events, and artifacts while allowing flexibility through its iterative approach.

theagilereadiness
Protection and referral for CBP members.ppt
Protection and referral for CBP members.pptProtection and referral for CBP members.ppt
Protection and referral for CBP members.ppt

Protection in humanitarian responses is very important· and it is heart· of all humanitarian activities . Effective referral· through updated referral· pathways is vital for protection· responses . To ensure· community· resilience for protection· risk· mitigation and prevention· , capacity-building on referral· pathways is essential· . The slides for this topic· helps you to guide· some basic knowledge· to teach· CBP members on that.

humanitarianprotectioncommunity-based protection
33
18F MVP did not provide analysis toolkit – it was
performed by an external consultant. Made their job easier
34
Analysis toolkit had more discovery time – got farther
Got closer to meeting needs of receivers, analysts and reviewers – co-created site with them
“I definitely think we are headed in the right direction – Very supportive of proceeding”
“I’m supportive of proceeding with changes to terminology, documentation and reporting”.
All consultations entered online - team performed analysis & review on the Toolkit
Lots of unimplemented bits – preparation of the document for launch was done by hand
35
eRegs Pilot Consultation System - Design Components Map
External Commenter Site
Internal Analysis Toolkit
Written in Swift
36
Open Source Code
3500 lines of Swift written for the MVP and 52000
lines of Swift including the open source used.
750 lines of Javascript written on WET/ JQuery base
250 lines of CSS with WET and Bootstrap reuse
2800 lines of web page template code
“My experience is that Swift was a productive choice. Good quality, stability,
maintainability. Swift and Vapor are in rapid evolution phases and this will
require ongoing code maintenance to stay current.” – Steve Hume

Recommended for you

Donate to Girl Child Education & Make Nation Stronger
Donate to Girl Child Education & Make Nation StrongerDonate to Girl Child Education & Make Nation Stronger
Donate to Girl Child Education & Make Nation Stronger

We all can see the increase in the literacy rate over the past few years. This is great because it showcases India has been growing at a rapid pace. Education is the key to entire nation growth. But the major concern is the education of the girl child education. Every other lower-middle-class family or people from rural areas families prefer to send their son to school and daughters are still not sent to school because of financial troubles. Donate Us https://serudsindia.org/donate-girl-child-education/ #sponsorforgirlchild, #donateforgirleducation, #girlchildeducation, #ngochildeducation, #donateforeducation, #donationforchildeducation, #sponsorforgirlchildeducation, #onlinegirlchildeducation, #educationforgirlchild, #seruds, #charitydonation, #kurnool, #educationkitforgirlchild

donate girl child educationgirl child educationsupport girl child education
In PROTEA_SOUTH_GARDENS [(+27633867063*)] 🏥 Abortion Pills For Sale in PROTEA...
In PROTEA_SOUTH_GARDENS [(+27633867063*)] 🏥 Abortion Pills For Sale in PROTEA...In PROTEA_SOUTH_GARDENS [(+27633867063*)] 🏥 Abortion Pills For Sale in PROTEA...
In PROTEA_SOUTH_GARDENS [(+27633867063*)] 🏥 Abortion Pills For Sale in PROTEA...

In PROTEA_SOUTH_GARDENS [(+27633867063*)] 🏥 Abortion Pills For Sale in PROTEA_SOUTH_GARDENS ● Women's Abortion Clinic in PROTEA_SOUTH_GARDENS ● Abortion Pill Prices in PROTEA_SOUTH_GARDENS 🏥🚑!! Abortion Doctors Near me, Abortion Services Near Me, Abortion Pills Over The Counter, Abortion Pill Doctors' Offices, Abortion Clinics, Abortion Places Near Me, Cheap Abortion Places Near Me, Medical Abortion & Surgical Abortion, approved cyctotec pills and womb cleaning pills too plus all the instructions needed This Discrete women’s Termination Clinic offers same day services that are safe and pain free, we use approved pills and we clean the womb so that no side effects are present. Our main goal is that of preventing unintended pregnancies and unwanted births every day to enable more women to have children by choice, not chance. We offer Terminations by Pill and The Morning After Pill.” Our Private VIP Abortion Service offers the ultimate in privacy, efficiency and discretion. we do safe and same day termination and we do also womb cleaning as well its done from 1 week up to 28 weeks. We do delivery of our services world wide SAFE ABORTION CLINICS/PILLS ON SALE WE DO DELIVERY OF PILLS ALSO Abortion clinic at very low costs, 100% Guaranteed and it’s safe, pain free and a same day service. It Is A 45 Minutes Procedure, we use tested abortion pills and we do womb cleaning as well. Alternatively the medical abortion pill and womb cleansing !!!

abortion pills for saletermination pillscytotec pills
Lucknow Girls Call Mohanlalganj 08630512678 Girls Call Service
Lucknow Girls Call Mohanlalganj 08630512678  Girls Call ServiceLucknow Girls Call Mohanlalganj 08630512678  Girls Call Service
Lucknow Girls Call Mohanlalganj 08630512678 Girls Call Service

Lucknow Girls Call Mohanlalganj 08630512678 Girls Call Service

37
No documentation or
automated test case
development - it’s an
MVP
- ran out of time and $
38
“We recognise that it would be a lot for someone to take
on the code base as it stands, in such an early prototype
state. The limited time to deliver an MVP, leads to the
code being less robust than we’d like. However, by
sharing the project progress and research we hope it will
be useful to any council considering a similar technical
tool for their ways into work programme.”
https://blog.wearefuturegov.com/lets-open-source-by-default-fb06f509dd9e
39
Open source code base – your vote?
Too much
Too minimal
Just right
Minimum viable
Not
enough
Not minimal
40
Minimum Viable Product is a team approach – learn together
Learning from 1st MVP
experiment dictates what
to build for next
experiment
Each iteration adds &
tests new assumptions
Product Owner
maintains this vision,
makes final call on
each experiment step,
is present throughout
the process
* We acted as product
owner – Government
needs to be product
owner!

Recommended for you

LESSONS LEARNT RUSSIA - UKRAINE CONFLICT 20 may 22.pptx
LESSONS LEARNT RUSSIA - UKRAINE CONFLICT 20 may  22.pptxLESSONS LEARNT RUSSIA - UKRAINE CONFLICT 20 may  22.pptx
LESSONS LEARNT RUSSIA - UKRAINE CONFLICT 20 may 22.pptx

Russia Ukraine war lessons

russia ukraine war lessons
The Role of Youth in Setting up a Just Transition in Ida-Virumaa, Estonia
The Role of Youth in Setting up a Just Transition in Ida-Virumaa, EstoniaThe Role of Youth in Setting up a Just Transition in Ida-Virumaa, Estonia
The Role of Youth in Setting up a Just Transition in Ida-Virumaa, Estonia

This presentation by Ivan Sergejev from the Estonian Ministry of Finance was part of the Expert Exchange "Youth Empowerment for a Just Energy Transition" held on June 18, 2024.

2023--Annual-Survey-for-Marginal-Farmers.pdf
2023--Annual-Survey-for-Marginal-Farmers.pdf2023--Annual-Survey-for-Marginal-Farmers.pdf
2023--Annual-Survey-for-Marginal-Farmers.pdf

marginal farmer status-India

marginal farmers in india
Questions?
MVP regulation consultation for commenters – demo link: https://dev.regconsultation.ca:8080/
• Article on LinkedIn: https://www.linkedin.com/pulse/government-minimum-viable-product-learning-from-small-lisa-fast
• US 18F pilot results: https://github.com/18F/epa-notice/files/548513/FinalDemo-Phase3UserResearchFindings.pdf
• Repository https://github.com/canada-ca/regs-consult-wet
@lisavation
lisa@vation.ca

More Related Content

What's hot

JUG CH September 2021 - Debugging distributed systems
JUG CH September 2021 - Debugging distributed systemsJUG CH September 2021 - Debugging distributed systems
JUG CH September 2021 - Debugging distributed systems
Bert Jan Schrijver
 
Dev ops lpi-701
Dev ops lpi-701Dev ops lpi-701
Dev ops lpi-701
Radhouen Assakra
 
Introduction to DevOps
Introduction to DevOpsIntroduction to DevOps
Introduction to DevOps
Md. Mazharul Anwar
 
Mark Andersen DFW DevOps Days 2017
Mark Andersen DFW DevOps Days 2017Mark Andersen DFW DevOps Days 2017
Mark Andersen DFW DevOps Days 2017
Mark Andersen
 
Top Lessons Learned From The DevOps Handbook
Top Lessons Learned From The DevOps HandbookTop Lessons Learned From The DevOps Handbook
Top Lessons Learned From The DevOps Handbook
XebiaLabs
 
Cloud Academy Webinar: Recipe for DevOps Success: Capital One Style
Cloud Academy Webinar: Recipe for DevOps Success: Capital One StyleCloud Academy Webinar: Recipe for DevOps Success: Capital One Style
Cloud Academy Webinar: Recipe for DevOps Success: Capital One Style
Mark Andersen
 

What's hot (6)

JUG CH September 2021 - Debugging distributed systems
JUG CH September 2021 - Debugging distributed systemsJUG CH September 2021 - Debugging distributed systems
JUG CH September 2021 - Debugging distributed systems
 
Dev ops lpi-701
Dev ops lpi-701Dev ops lpi-701
Dev ops lpi-701
 
Introduction to DevOps
Introduction to DevOpsIntroduction to DevOps
Introduction to DevOps
 
Mark Andersen DFW DevOps Days 2017
Mark Andersen DFW DevOps Days 2017Mark Andersen DFW DevOps Days 2017
Mark Andersen DFW DevOps Days 2017
 
Top Lessons Learned From The DevOps Handbook
Top Lessons Learned From The DevOps HandbookTop Lessons Learned From The DevOps Handbook
Top Lessons Learned From The DevOps Handbook
 
Cloud Academy Webinar: Recipe for DevOps Success: Capital One Style
Cloud Academy Webinar: Recipe for DevOps Success: Capital One StyleCloud Academy Webinar: Recipe for DevOps Success: Capital One Style
Cloud Academy Webinar: Recipe for DevOps Success: Capital One Style
 

Similar to Too minimal - role of UX research in government MVP

Agileand saas davepatterson_armandofox_050813webinar
Agileand saas davepatterson_armandofox_050813webinarAgileand saas davepatterson_armandofox_050813webinar
Agileand saas davepatterson_armandofox_050813webinar
Roberto Jr. Figueroa
 
Building a design system with (p)react
Building a design system with (p)reactBuilding a design system with (p)react
Building a design system with (p)react
Bart Waardenburg
 
Conference Room Prototype – a low cost, high value approach to selecting the ...
Conference Room Prototype – a low cost, high value approach to selecting the ...Conference Room Prototype – a low cost, high value approach to selecting the ...
Conference Room Prototype – a low cost, high value approach to selecting the ...
Mekon Ltd.
 
UXPA 2023: The Report is Dead, Long Live the Report! How to Communicate Usabi...
UXPA 2023: The Report is Dead, Long Live the Report! How to Communicate Usabi...UXPA 2023: The Report is Dead, Long Live the Report! How to Communicate Usabi...
UXPA 2023: The Report is Dead, Long Live the Report! How to Communicate Usabi...
UXPA International
 
The Report is Dead, Long Live the Report! How to Communicate UX Research Find...
The Report is Dead, Long Live the Report! How to Communicate UX Research Find...The Report is Dead, Long Live the Report! How to Communicate UX Research Find...
The Report is Dead, Long Live the Report! How to Communicate UX Research Find...
Kathi Kaiser
 
The Report is Dead, Long Live the Report ! Communicating Usability Research F...
The Report is Dead, Long Live the Report ! Communicating Usability Research F...The Report is Dead, Long Live the Report ! Communicating Usability Research F...
The Report is Dead, Long Live the Report ! Communicating Usability Research F...
Centralis
 
Welcome to User Experience (UX) Design at EMBL-EBI
Welcome to User Experience (UX) Design at EMBL-EBI Welcome to User Experience (UX) Design at EMBL-EBI
Welcome to User Experience (UX) Design at EMBL-EBI
EMBL-EBI Web Development
 
Create Great CNCF User-Base from Lessons Learned from Other Open Source Commu...
Create Great CNCF User-Base from Lessons Learned from Other Open Source Commu...Create Great CNCF User-Base from Lessons Learned from Other Open Source Commu...
Create Great CNCF User-Base from Lessons Learned from Other Open Source Commu...
Lee Calcote
 
Applying Usability to Improve Value and Reduce Risk
Applying Usability to Improve Value and Reduce RiskApplying Usability to Improve Value and Reduce Risk
Applying Usability to Improve Value and Reduce Risk
Bonitasoft
 
Lean UX
Lean UXLean UX
306 belmont ssp08agileit
306 belmont ssp08agileit306 belmont ssp08agileit
306 belmont ssp08agileit
Society for Scholarly Publishing
 
"Open" includes users - Leverage their input
"Open" includes users - Leverage their input"Open" includes users - Leverage their input
"Open" includes users - Leverage their input
Randy Earl
 
1 rapid prototyping model
1 rapid prototyping model1 rapid prototyping model
1 rapid prototyping model
delaco
 
Framework for Agile Living Labs - FALL
Framework for Agile Living Labs - FALLFramework for Agile Living Labs - FALL
Framework for Agile Living Labs - FALL
European Network of Living Labs (ENoLL)
 
Radical Roadmapping - Creating Synchronized Agile Product and Technology Road...
Radical Roadmapping - Creating Synchronized Agile Product and Technology Road...Radical Roadmapping - Creating Synchronized Agile Product and Technology Road...
Radical Roadmapping - Creating Synchronized Agile Product and Technology Road...
Matt Roberts
 
Software Prototyping
Software PrototypingSoftware Prototyping
Software Prototyping
Shubham Sharma
 
Full stack conference talk slides
Full stack conference talk slidesFull stack conference talk slides
Full stack conference talk slides
Sameer Al-Sakran
 
Open / Drupal Camp Presentation: Brent Bice
Open / Drupal Camp Presentation: Brent BiceOpen / Drupal Camp Presentation: Brent Bice
Open / Drupal Camp Presentation: Brent Bice
LevelTen Interactive
 
Lean UX и дизайн-спринты: как построить ведущий продукт на рынке за пять дней
Lean UX и дизайн-спринты: как построить ведущий продукт на рынке за пять днейLean UX и дизайн-спринты: как построить ведущий продукт на рынке за пять дней
Lean UX и дизайн-спринты: как построить ведущий продукт на рынке за пять дней
CEE-SEC(R)
 
The Agile Readiness Assessment Tool Essay
The Agile Readiness Assessment Tool EssayThe Agile Readiness Assessment Tool Essay
The Agile Readiness Assessment Tool Essay
Heidi Owens
 

Similar to Too minimal - role of UX research in government MVP (20)

Agileand saas davepatterson_armandofox_050813webinar
Agileand saas davepatterson_armandofox_050813webinarAgileand saas davepatterson_armandofox_050813webinar
Agileand saas davepatterson_armandofox_050813webinar
 
Building a design system with (p)react
Building a design system with (p)reactBuilding a design system with (p)react
Building a design system with (p)react
 
Conference Room Prototype – a low cost, high value approach to selecting the ...
Conference Room Prototype – a low cost, high value approach to selecting the ...Conference Room Prototype – a low cost, high value approach to selecting the ...
Conference Room Prototype – a low cost, high value approach to selecting the ...
 
UXPA 2023: The Report is Dead, Long Live the Report! How to Communicate Usabi...
UXPA 2023: The Report is Dead, Long Live the Report! How to Communicate Usabi...UXPA 2023: The Report is Dead, Long Live the Report! How to Communicate Usabi...
UXPA 2023: The Report is Dead, Long Live the Report! How to Communicate Usabi...
 
The Report is Dead, Long Live the Report! How to Communicate UX Research Find...
The Report is Dead, Long Live the Report! How to Communicate UX Research Find...The Report is Dead, Long Live the Report! How to Communicate UX Research Find...
The Report is Dead, Long Live the Report! How to Communicate UX Research Find...
 
The Report is Dead, Long Live the Report ! Communicating Usability Research F...
The Report is Dead, Long Live the Report ! Communicating Usability Research F...The Report is Dead, Long Live the Report ! Communicating Usability Research F...
The Report is Dead, Long Live the Report ! Communicating Usability Research F...
 
Welcome to User Experience (UX) Design at EMBL-EBI
Welcome to User Experience (UX) Design at EMBL-EBI Welcome to User Experience (UX) Design at EMBL-EBI
Welcome to User Experience (UX) Design at EMBL-EBI
 
Create Great CNCF User-Base from Lessons Learned from Other Open Source Commu...
Create Great CNCF User-Base from Lessons Learned from Other Open Source Commu...Create Great CNCF User-Base from Lessons Learned from Other Open Source Commu...
Create Great CNCF User-Base from Lessons Learned from Other Open Source Commu...
 
Applying Usability to Improve Value and Reduce Risk
Applying Usability to Improve Value and Reduce RiskApplying Usability to Improve Value and Reduce Risk
Applying Usability to Improve Value and Reduce Risk
 
Lean UX
Lean UXLean UX
Lean UX
 
306 belmont ssp08agileit
306 belmont ssp08agileit306 belmont ssp08agileit
306 belmont ssp08agileit
 
"Open" includes users - Leverage their input
"Open" includes users - Leverage their input"Open" includes users - Leverage their input
"Open" includes users - Leverage their input
 
1 rapid prototyping model
1 rapid prototyping model1 rapid prototyping model
1 rapid prototyping model
 
Framework for Agile Living Labs - FALL
Framework for Agile Living Labs - FALLFramework for Agile Living Labs - FALL
Framework for Agile Living Labs - FALL
 
Radical Roadmapping - Creating Synchronized Agile Product and Technology Road...
Radical Roadmapping - Creating Synchronized Agile Product and Technology Road...Radical Roadmapping - Creating Synchronized Agile Product and Technology Road...
Radical Roadmapping - Creating Synchronized Agile Product and Technology Road...
 
Software Prototyping
Software PrototypingSoftware Prototyping
Software Prototyping
 
Full stack conference talk slides
Full stack conference talk slidesFull stack conference talk slides
Full stack conference talk slides
 
Open / Drupal Camp Presentation: Brent Bice
Open / Drupal Camp Presentation: Brent BiceOpen / Drupal Camp Presentation: Brent Bice
Open / Drupal Camp Presentation: Brent Bice
 
Lean UX и дизайн-спринты: как построить ведущий продукт на рынке за пять дней
Lean UX и дизайн-спринты: как построить ведущий продукт на рынке за пять днейLean UX и дизайн-спринты: как построить ведущий продукт на рынке за пять дней
Lean UX и дизайн-спринты: как построить ведущий продукт на рынке за пять дней
 
The Agile Readiness Assessment Tool Essay
The Agile Readiness Assessment Tool EssayThe Agile Readiness Assessment Tool Essay
The Agile Readiness Assessment Tool Essay
 

Recently uploaded

Protection and referral for CBP members.ppt
Protection and referral for CBP members.pptProtection and referral for CBP members.ppt
Protection and referral for CBP members.ppt
Mohammed Nizam
 
Donate to Girl Child Education & Make Nation Stronger
Donate to Girl Child Education & Make Nation StrongerDonate to Girl Child Education & Make Nation Stronger
Donate to Girl Child Education & Make Nation Stronger
SERUDS INDIA
 
In PROTEA_SOUTH_GARDENS [(+27633867063*)] 🏥 Abortion Pills For Sale in PROTEA...
In PROTEA_SOUTH_GARDENS [(+27633867063*)] 🏥 Abortion Pills For Sale in PROTEA...In PROTEA_SOUTH_GARDENS [(+27633867063*)] 🏥 Abortion Pills For Sale in PROTEA...
In PROTEA_SOUTH_GARDENS [(+27633867063*)] 🏥 Abortion Pills For Sale in PROTEA...
tumcfa
 
Lucknow Girls Call Mohanlalganj 08630512678 Girls Call Service
Lucknow Girls Call Mohanlalganj 08630512678  Girls Call ServiceLucknow Girls Call Mohanlalganj 08630512678  Girls Call Service
Lucknow Girls Call Mohanlalganj 08630512678 Girls Call Service
akarshkumar98776
 
LESSONS LEARNT RUSSIA - UKRAINE CONFLICT 20 may 22.pptx
LESSONS LEARNT RUSSIA - UKRAINE CONFLICT 20 may  22.pptxLESSONS LEARNT RUSSIA - UKRAINE CONFLICT 20 may  22.pptx
LESSONS LEARNT RUSSIA - UKRAINE CONFLICT 20 may 22.pptx
RohitBalboa
 
The Role of Youth in Setting up a Just Transition in Ida-Virumaa, Estonia
The Role of Youth in Setting up a Just Transition in Ida-Virumaa, EstoniaThe Role of Youth in Setting up a Just Transition in Ida-Virumaa, Estonia
The Role of Youth in Setting up a Just Transition in Ida-Virumaa, Estonia
Just Energy Transition in Coal Regions Knowledge Hub
 
2023--Annual-Survey-for-Marginal-Farmers.pdf
2023--Annual-Survey-for-Marginal-Farmers.pdf2023--Annual-Survey-for-Marginal-Farmers.pdf
2023--Annual-Survey-for-Marginal-Farmers.pdf
Odessa File
 
Vidhi Vaishnav 23BSPHH01jgjgjggC0469.docx
Vidhi Vaishnav 23BSPHH01jgjgjggC0469.docxVidhi Vaishnav 23BSPHH01jgjgjggC0469.docx
Vidhi Vaishnav 23BSPHH01jgjgjggC0469.docx
RohanShekar
 
Blog Version 2024 Population Estimates Summary
Blog Version 2024 Population Estimates SummaryBlog Version 2024 Population Estimates Summary
Blog Version 2024 Population Estimates Summary
ARCResearch
 
Lucknow @Girls @ℂall Gosainganj 08630512678 @Girls @ℂall Service
Lucknow @Girls @ℂall Gosainganj 08630512678  @Girls @ℂall ServiceLucknow @Girls @ℂall Gosainganj 08630512678  @Girls @ℂall Service
Lucknow @Girls @ℂall Gosainganj 08630512678 @Girls @ℂall Service
veenita788
 
Lucknow Girls Call Singar Nagar 08630512678 Girls Call Service
Lucknow Girls Call Singar Nagar 08630512678  Girls Call ServiceLucknow Girls Call Singar Nagar 08630512678  Girls Call Service
Lucknow Girls Call Singar Nagar 08630512678 Girls Call Service
anilsa9823
 
Towards a left-wing Political Science.ppt
Towards a left-wing Political Science.pptTowards a left-wing Political Science.ppt
Towards a left-wing Political Science.ppt
phuakl
 
In Johannesburg ^%[+27633867063*Abortion Pills For Sale In Johannesburg Hazy...
In Johannesburg  ^%[+27633867063*Abortion Pills For Sale In Johannesburg Hazy...In Johannesburg  ^%[+27633867063*Abortion Pills For Sale In Johannesburg Hazy...
In Johannesburg ^%[+27633867063*Abortion Pills For Sale In Johannesburg Hazy...
ivory3872
 
The Bank of Punjab. DigiBop Internet Banking. Discounts & Offers
The Bank of Punjab. DigiBop Internet Banking. Discounts & OffersThe Bank of Punjab. DigiBop Internet Banking. Discounts & Offers
The Bank of Punjab. DigiBop Internet Banking. Discounts & Offers
reema kushawaha
 
Penal code eng original of the Cameroon Government.pdf
Penal code eng original  of the Cameroon Government.pdfPenal code eng original  of the Cameroon Government.pdf
Penal code eng original of the Cameroon Government.pdf
les977
 
In Madadeni [(+27633867063*)] 🏥 Abortion Pills For Sale in Madadeni ● Women's...
In Madadeni [(+27633867063*)] 🏥 Abortion Pills For Sale in Madadeni ● Women's...In Madadeni [(+27633867063*)] 🏥 Abortion Pills For Sale in Madadeni ● Women's...
In Madadeni [(+27633867063*)] 🏥 Abortion Pills For Sale in Madadeni ● Women's...
ogwypas
 
MPA 210 : POVERTY PLAN ASSESSMENT.pptx
MPA 210 :  POVERTY PLAN  ASSESSMENT.pptxMPA 210 :  POVERTY PLAN  ASSESSMENT.pptx
MPA 210 : POVERTY PLAN ASSESSMENT.pptx
Jo Balucanag - Bitonio
 
Advancing-Womens-Leadership-in-Conflict-Resolution-ID-.pdf
Advancing-Womens-Leadership-in-Conflict-Resolution-ID-.pdfAdvancing-Womens-Leadership-in-Conflict-Resolution-ID-.pdf
Advancing-Womens-Leadership-in-Conflict-Resolution-ID-.pdf
kristelbirgit
 
MPA 210 : STRATEGIC QUALITY MANAGEMENT
MPA 210 : STRATEGIC  QUALITY  MANAGEMENTMPA 210 : STRATEGIC  QUALITY  MANAGEMENT
MPA 210 : STRATEGIC QUALITY MANAGEMENT
Jo Balucanag - Bitonio
 
SDGs-Bangladesh_Progress_Report 2020.pdf
SDGs-Bangladesh_Progress_Report 2020.pdfSDGs-Bangladesh_Progress_Report 2020.pdf
SDGs-Bangladesh_Progress_Report 2020.pdf
Shamim Hosen
 

Recently uploaded (20)

Protection and referral for CBP members.ppt
Protection and referral for CBP members.pptProtection and referral for CBP members.ppt
Protection and referral for CBP members.ppt
 
Donate to Girl Child Education & Make Nation Stronger
Donate to Girl Child Education & Make Nation StrongerDonate to Girl Child Education & Make Nation Stronger
Donate to Girl Child Education & Make Nation Stronger
 
In PROTEA_SOUTH_GARDENS [(+27633867063*)] 🏥 Abortion Pills For Sale in PROTEA...
In PROTEA_SOUTH_GARDENS [(+27633867063*)] 🏥 Abortion Pills For Sale in PROTEA...In PROTEA_SOUTH_GARDENS [(+27633867063*)] 🏥 Abortion Pills For Sale in PROTEA...
In PROTEA_SOUTH_GARDENS [(+27633867063*)] 🏥 Abortion Pills For Sale in PROTEA...
 
Lucknow Girls Call Mohanlalganj 08630512678 Girls Call Service
Lucknow Girls Call Mohanlalganj 08630512678  Girls Call ServiceLucknow Girls Call Mohanlalganj 08630512678  Girls Call Service
Lucknow Girls Call Mohanlalganj 08630512678 Girls Call Service
 
LESSONS LEARNT RUSSIA - UKRAINE CONFLICT 20 may 22.pptx
LESSONS LEARNT RUSSIA - UKRAINE CONFLICT 20 may  22.pptxLESSONS LEARNT RUSSIA - UKRAINE CONFLICT 20 may  22.pptx
LESSONS LEARNT RUSSIA - UKRAINE CONFLICT 20 may 22.pptx
 
The Role of Youth in Setting up a Just Transition in Ida-Virumaa, Estonia
The Role of Youth in Setting up a Just Transition in Ida-Virumaa, EstoniaThe Role of Youth in Setting up a Just Transition in Ida-Virumaa, Estonia
The Role of Youth in Setting up a Just Transition in Ida-Virumaa, Estonia
 
2023--Annual-Survey-for-Marginal-Farmers.pdf
2023--Annual-Survey-for-Marginal-Farmers.pdf2023--Annual-Survey-for-Marginal-Farmers.pdf
2023--Annual-Survey-for-Marginal-Farmers.pdf
 
Vidhi Vaishnav 23BSPHH01jgjgjggC0469.docx
Vidhi Vaishnav 23BSPHH01jgjgjggC0469.docxVidhi Vaishnav 23BSPHH01jgjgjggC0469.docx
Vidhi Vaishnav 23BSPHH01jgjgjggC0469.docx
 
Blog Version 2024 Population Estimates Summary
Blog Version 2024 Population Estimates SummaryBlog Version 2024 Population Estimates Summary
Blog Version 2024 Population Estimates Summary
 
Lucknow @Girls @ℂall Gosainganj 08630512678 @Girls @ℂall Service
Lucknow @Girls @ℂall Gosainganj 08630512678  @Girls @ℂall ServiceLucknow @Girls @ℂall Gosainganj 08630512678  @Girls @ℂall Service
Lucknow @Girls @ℂall Gosainganj 08630512678 @Girls @ℂall Service
 
Lucknow Girls Call Singar Nagar 08630512678 Girls Call Service
Lucknow Girls Call Singar Nagar 08630512678  Girls Call ServiceLucknow Girls Call Singar Nagar 08630512678  Girls Call Service
Lucknow Girls Call Singar Nagar 08630512678 Girls Call Service
 
Towards a left-wing Political Science.ppt
Towards a left-wing Political Science.pptTowards a left-wing Political Science.ppt
Towards a left-wing Political Science.ppt
 
In Johannesburg ^%[+27633867063*Abortion Pills For Sale In Johannesburg Hazy...
In Johannesburg  ^%[+27633867063*Abortion Pills For Sale In Johannesburg Hazy...In Johannesburg  ^%[+27633867063*Abortion Pills For Sale In Johannesburg Hazy...
In Johannesburg ^%[+27633867063*Abortion Pills For Sale In Johannesburg Hazy...
 
The Bank of Punjab. DigiBop Internet Banking. Discounts & Offers
The Bank of Punjab. DigiBop Internet Banking. Discounts & OffersThe Bank of Punjab. DigiBop Internet Banking. Discounts & Offers
The Bank of Punjab. DigiBop Internet Banking. Discounts & Offers
 
Penal code eng original of the Cameroon Government.pdf
Penal code eng original  of the Cameroon Government.pdfPenal code eng original  of the Cameroon Government.pdf
Penal code eng original of the Cameroon Government.pdf
 
In Madadeni [(+27633867063*)] 🏥 Abortion Pills For Sale in Madadeni ● Women's...
In Madadeni [(+27633867063*)] 🏥 Abortion Pills For Sale in Madadeni ● Women's...In Madadeni [(+27633867063*)] 🏥 Abortion Pills For Sale in Madadeni ● Women's...
In Madadeni [(+27633867063*)] 🏥 Abortion Pills For Sale in Madadeni ● Women's...
 
MPA 210 : POVERTY PLAN ASSESSMENT.pptx
MPA 210 :  POVERTY PLAN  ASSESSMENT.pptxMPA 210 :  POVERTY PLAN  ASSESSMENT.pptx
MPA 210 : POVERTY PLAN ASSESSMENT.pptx
 
Advancing-Womens-Leadership-in-Conflict-Resolution-ID-.pdf
Advancing-Womens-Leadership-in-Conflict-Resolution-ID-.pdfAdvancing-Womens-Leadership-in-Conflict-Resolution-ID-.pdf
Advancing-Womens-Leadership-in-Conflict-Resolution-ID-.pdf
 
MPA 210 : STRATEGIC QUALITY MANAGEMENT
MPA 210 : STRATEGIC  QUALITY  MANAGEMENTMPA 210 : STRATEGIC  QUALITY  MANAGEMENT
MPA 210 : STRATEGIC QUALITY MANAGEMENT
 
SDGs-Bangladesh_Progress_Report 2020.pdf
SDGs-Bangladesh_Progress_Report 2020.pdfSDGs-Bangladesh_Progress_Report 2020.pdf
SDGs-Bangladesh_Progress_Report 2020.pdf
 

Too minimal - role of UX research in government MVP

  • 1. Lisa Fast @lisavation #GOAT2017 Not Too Minimal: UX Research in a Government Minimum Viable Product
  • 2. 2 Original Minimum Viable Product View – focus on user need http://blog.crisp.se/2016/01/25/henrikkniberg/making-sense-of-mvp
  • 3. 3 “The MVP Build-Measure-Learn feedback loop is at the core of the Lean Startup model. An experiment is … also a first product.” - Eric Ries
  • 5. 5 “A Minimum Viable Product is the smallest thing you can build that delivers customer value (and as a bonus captures some of that value back).” – Ash Maurya https://blog.leanstack.com/minimum-viable-product-mvp-7e280b0b9418
  • 7. 7 Risky assumption testing requires a level of Agile maturity not present in most of the Government of Canada. In this project, the idea of starting small was a struggle, most expected to get the complete product at launch – despite ongoing mega-project troubles…
  • 8. 8
  • 10. 10 UX Research is all about Value & Viability Understanding needs for value Ensuring they can derive that value
  • 11. 11 The challenge: Email-only Consultations for Gazette Part I Part I: “a final opportunity to review and comment on a proposed regulation at the last stages of the regulation-making process, before it is enacted”
  • 12. 12 Starting Point: US eRegulations -18F Comment Pilot Test in June 2016 https://18f.gsa.gov/2016/07/26/new-pilot-aims-to-streamline-notice-and-comment-process/ https://epa-notice.usa.gov/
  • 13. 13 LEAN UX Pilot assumptions: We believe that online regulatory consultations will lead to effective commenting & analysis – teams just fell into emails & spreadsheets as people stopped sending letters This will improve: the quality and efficiency of commenting by Canadians and analysis by government teams We will have demonstrated this when we can measure*: More time to think about comments – less time ’handling’ them: • A decrease in frequency of copy/paste for receivers & analysts and decrease in ‘lost’ comments • A decrease in time from closing date to completed analysis/review • Improved quality and coverage of comments in review and decision process Clearer and more thorough comments from Canadians: • An increase in comments clearly associated with a specific section of the RIAS or proposed regulatory text • An increase in the number of comments overall * Measurement will be ‘loose’ for this pilot since so few submissions are expected for the selected regulation.
  • 14. 14 Start with prototype before contract as proof of concept - assume that 18F design is good start
  • 15. 15 UX Research sessions started on prototype, progressed to dev site as features were implemented Exploratory sessions – use and talk
  • 16. 16 Task: Get started - Orient the commenter PROTOTYPE COMMENT MVP Name and submit was at bottom of page • First participant looked for it at top, wanted an idea of what to expect, what was possible Moved name etc. to top & added ‘Skip to first comment box’ to orient users to where they could enter comments. Add ‘View summary /Submit’ buttons to top of page
  • 17. 17 Task: Enter comments • Research participants wanted reassurance it was saved P2: “I'm always worried about saving– that’s what drives us back to Word.” • Had been burned by other experiences • P1: “3 times I went to submit and it cleared my input - 3 times!! PROTOTYPE COMMENT MVP • Save button and saved message added • P3: “Good to see that saved message!” • P4: “This is very straightforward”
  • 18. 18 Task: Review summary before submit PROTOTYPE Participants were clear they need a record of their submission for their members. Some post it on their website. Would prefer a table view of their comments. P1: If there was a table.” P2: “I want to see a table of ALL possible comments with blanks where I missed them” Changed to table view in MVP –for Pilot, must return to main page to edit/enter, long term should build it into here, also want to email a copy of this to themselves P4: “Display empty comments - That makes sense to see what you missed especially if it was very long. I might put ‘read it’ in there for myself” COMMENT MVP
  • 19. 19 Aha! Associations Perform Same Share-Receive-Analyze Process Just like government, associations gather member comments, review & synthesize the comments into a submission - need support & integration, not add-on copy/paste work Participant 2: “So I could send them a link to see our actual submission- I like that idea as long as it was easy for them to do”. Participant 4: “if we could do this, would we even keep a Word copy? Because it’s tedious… this could streamline our process” Future is participative democracy: invite them in to the system, let them use it with their members & feed their submission in directly Association members Association submission Individual commenter
  • 20. 20 On-time launch of Comment Pilot in French & English Site launched on-time on March 4th simultaneous with Gazette on-line launch of the proposed amendment
  • 21. 21 Hold up stickies to vote on 4 UX research sessions – in 6 weeks from contract to launch Too much Too minimal Just right Minimum viable Not enough Not minimal
  • 22. 22 External Stakeholders really got ‘minimal’ • Result: Only 1 of 5 association stakeholders submitted their comments online – the rest stuck to email and the HC team entered their emailed comments into the system themselves to learn • 18F pilot had slightly more, about half of submissions came in via the pilot, was better integrated but their participants also sought in-progress drafts and mult—session editing Participant 1: “I get that this is much better for the government, then it’s all laid out in a table for them… But it creates more work for me. It’s a second layer – I put it in a table and say hey members, send out a table to them and get them to do it. There’s no save and share option here.”
  • 23. 23 Make notes on stickies during next bit Not enough Too minimal Just right Too much Not minimal Your noteYour noteYour note
  • 24. 24 External Commenter Site Internal Analysis Toolkit Now to the other VALUE - the back end (18F MVP did not do this)
  • 25. 25 UX Research: Kicked off with Discovery workshop to discover various roles, user needs & pain points in current process Prepare Gazette Receive (Reg Management) Worry: lose a comment or lose track of a comment Analyze (Programs) Worry: miss an important comment or issue Review (all and TBS)
  • 26. 26 Discovery – your vote? Too much Too minimal Just right Minimum viable Not enough Not minimal
  • 27. 27 Process from Discovery Maps Onto Key Tasks in Toolkit demo
  • 29. 29 Consultation Toolkit MVP co-designed with Health Canada team UX research: Sketching, 4 co-design workshops & 2 usability test sessions with team members
  • 30. 30 Toolkit: View comments by submission (commentary) or by document section
  • 31. 31 Notes capture analysis, progress and decisions: - See public notes by other analysts - Assign note a status - Add public and private notes
  • 32. 32 Co-design process – your vote? Too much Too minimal Just right Minimum viable Not enough Not minimal
  • 33. 33 18F MVP did not provide analysis toolkit – it was performed by an external consultant. Made their job easier
  • 34. 34 Analysis toolkit had more discovery time – got farther Got closer to meeting needs of receivers, analysts and reviewers – co-created site with them “I definitely think we are headed in the right direction – Very supportive of proceeding” “I’m supportive of proceeding with changes to terminology, documentation and reporting”. All consultations entered online - team performed analysis & review on the Toolkit Lots of unimplemented bits – preparation of the document for launch was done by hand
  • 35. 35 eRegs Pilot Consultation System - Design Components Map External Commenter Site Internal Analysis Toolkit Written in Swift
  • 36. 36 Open Source Code 3500 lines of Swift written for the MVP and 52000 lines of Swift including the open source used. 750 lines of Javascript written on WET/ JQuery base 250 lines of CSS with WET and Bootstrap reuse 2800 lines of web page template code “My experience is that Swift was a productive choice. Good quality, stability, maintainability. Swift and Vapor are in rapid evolution phases and this will require ongoing code maintenance to stay current.” – Steve Hume
  • 37. 37 No documentation or automated test case development - it’s an MVP - ran out of time and $
  • 38. 38 “We recognise that it would be a lot for someone to take on the code base as it stands, in such an early prototype state. The limited time to deliver an MVP, leads to the code being less robust than we’d like. However, by sharing the project progress and research we hope it will be useful to any council considering a similar technical tool for their ways into work programme.” https://blog.wearefuturegov.com/lets-open-source-by-default-fb06f509dd9e
  • 39. 39 Open source code base – your vote? Too much Too minimal Just right Minimum viable Not enough Not minimal
  • 40. 40 Minimum Viable Product is a team approach – learn together Learning from 1st MVP experiment dictates what to build for next experiment Each iteration adds & tests new assumptions Product Owner maintains this vision, makes final call on each experiment step, is present throughout the process * We acted as product owner – Government needs to be product owner!
  • 41. Questions? MVP regulation consultation for commenters – demo link: https://dev.regconsultation.ca:8080/ • Article on LinkedIn: https://www.linkedin.com/pulse/government-minimum-viable-product-learning-from-small-lisa-fast • US 18F pilot results: https://github.com/18F/epa-notice/files/548513/FinalDemo-Phase3UserResearchFindings.pdf • Repository https://github.com/canada-ca/regs-consult-wet @lisavation lisa@vation.ca

Editor's Notes

  1. Kniberg calls it earliest testable product “The Minimum Viable Product Build-Measure-Learn feedback loop is at the core of the Lean Startup model. An experiment is more than just a theoretical inquiry; it is also a first product.”  ― Eric Ries, The Lean Startup: How Today's Entrepreneurs Use Continuous Innovation to Create Radically Successful Businesses You don’t start building the 2nd MVP until the learning from the first is done. That’s what drives the knowledge of what to add to the next iteration.
  2. Really relevant to government because the learning is at all levels he skateboard is actually a usable product that helps the customer get from A to B. Not great, but a tiny bit better than nothing. So we tell the customer “don’t worry, the project is not finished, this was just the first of many iterations. We’re still aiming to build a car, but in the meantime please try this and give us feedback“. Think big, but deliver in small functionally viable increments. We might learn some really surprising things. Suppose the customer says he hates the skateboard, we ask why, and he says “I hate the color”. We’re like “uh…. the color? That’s all?”. And the customer says “Yeah, make it blue! Other than that, it’s fine!”. You just saved *alot* of money not building the car! Not likely, but who knows?
  3. https://www.quora.com/What-is-the-difference-between-a-prototype-and-a-minimum-viable-product-MVP Bit of a backlash - focus on value – not a prototype – table with differences between a prototype and product
  4. https://hackernoon.com/the-mvp-is-dead-long-live-the-rat-233d5d16ab02
  5. https://blog.leanstack.com/minimum-viable-product-mvp-7e280b0b9418
  6. Kniberg calls it earliest testable product “The Minimum Viable Product Build-Measure-Learn feedback loop is at the core of the Lean Startup model. An experiment is more than just a theoretical inquiry; it is also a first product.”  ― Eric Ries, The Lean Startup: How Today's Entrepreneurs Use Continuous Innovation to Create Radically Successful Businesses You don’t start building the 2nd MVP until the learning from the first is done. That’s what drives the knowledge of what to add to the next iteration.
  7. Lots of initial work and pre-publication consultations precede publication in Part I of the Gazette. eRegs can address that as well as it grows. This would build up a set of stakeholders for a particular topic who can follow along, contribute online. This is done informally and sometimes formally now, but there is no continuity between the steps in the process, for the GC team or the stakeholders. P2 Aviation Association: “By the time it gets to the Gazette, it's almost all over for us - we've given a lot of input”.
  8. Relied on XML, unilingual. Evaluation of 18F open source was completed in November – large source code-base with many team members, most of the eRegs code is to re-display various sets of existing regulations in a consistent well-formatted way, small pilot of online commenting with no results reported, commenting pilot relies on the structure of the e-regs ouput (in Canada, the Gazette output for CG1 is not at all consistent or highly structured), no support for multiple languages in the code base - notice focus on individual comments by section, each comment opens on new page (tedious, lose context) First step of eRegs is to reformat the regulations into new format – then they layer on the commenting https://18f.gsa.gov/2016/07/26/new-pilot-aims-to-streamline-notice-and-comment-process/
  9. Architecture of the system will be designed in microservices and APIs, so that different teams/provinces/associations can use some or all of the system
  10. Purchased domain name previous week, gave up on Cloud Received marked-up Word doc with comment tag markers – in English – then French Gazette can’t proceed until it’s released to them – they do the web publishing into HTML & PDF Received Gazette-formatted HTML EN & FR on March 3rd Reviewed with team for Go-No Go on morning of 4th Decision was Go Design: Oriented to 18F-style for individual commenters Backlog: rethink design in light of stakeholder needs – possibly provide them access to full system for more participatory role. For next MVP, at minimum provide editable Summary View
  11. 18 F results had same learning – about half of their submissions came in via the new system, and it was built-in to the process in a way that ours was not - Their participants also sought in-progress drafts and multi-session editing Gazette page displayed a link with the email address – very hard to notice and required taking that extra step of clicking it to see the pilot page
  12. After launch, work began in earnest on the internal analysis toolkit
  13. Process from discovery was mapped into the new design A commentary is the set of comments submitted by one person System was built using Canada’s Web Experience Toolkit (used for Canada.ca) – accessible Accounts were created for the HC regulatory team
  14. Meetings with team and some research sessions to understand their needs and meet them through the design.
  15. Did not build a back end – hired a consultant to build a spreadsheet for them
  16. Lots of things in the backlog from discussions with team