DIY Usability Testing for Business Analysts (BA)

•Download as PPTX, PDF•

3 likes•3,358 views

This presentation provides techniques for business analysts (BA's) to begin conducting their own usability tests. This was presented to the Pittsburgh IIBA Chapter on January 9, 2017.

Software

http://creativecommons.org/licenses/by-sa/2.0/
http://www.flickr.com/photos/raphaelquinet/513351385/sizes/l/in/photostream/
http://www.flickr.com/photos/raphaelquinet/
Usability Testing

Image from Steve Krug’s “Rocket Surgery Made Easy“

http://www.flickr.com/photos/dwulff/12256075/sizes/m/in/photostream/
http://www.flickr.com/photos/dwulff/

*See guidance for Observers in Resources section

Rubin, Jeffrey. Handbook of Usability Testing. John Wiley & Sons, Inc.; 1994.
Computer
/ Concept
Facilitator
Participant
Observer
Timer Logger

Photo by Roebot at http://www.flickr.com/photos/roebot/2964156413/
http://www.flickr.com/photos/nzdave/491411546/sizes/o/in/photostream/
http://www.flickr.com/photos/nzdave/
Participant
observed through
2 way mirror and
on screens

Photo by Roebot at
http://www.flickr.com/photos/roebot/2964156413/

Rocket Surgery Made Easy: The Do-It-Yourself Guide to Finding and Fixing Usability Problems. By Steve Krug

Adapted from: Rocket Surgery Made Easy: The Do-It-Yourself Guide to Finding and Fixing Usability Problems. By Steve Krug

in/CarolJSmith
@Carologic
slideshare.net/carologic

http://www.useit.com/alertbox/20000319.html
Jakob Nielsen’s Alertbox.WhyYou Only Need toTest with 5 Users. March 19, 2000.
Number ofTest Participants

Quote by @mollydotcom at #stirtrek 2011 via @carologic

Photo By Kenyaboy7AndrewChipley
http://www.flickr.com/photos/kenyaboy7/3749535540/

Activity ______________________________________
Who are you observing? (e.g. SME in soft-goods manufacturing, application admin)
What is the situation? ___________________________
(e.g. phone interview, their work at their desk in person, remote usability study, etc.)
Date: __________________
Time: __________________
Location: ________________
Note-Taker: ______________
People (P)
Who are you observing? Who
else is involved in the
experience?
Objects (O)
What objects do they interact
with? What apps? Phone, etc.?
Environment (E)
Characteristics of the setting,
number/types of interruptions
Messages (M)
What is communicated? How is it
transmitted?
Services (S)
What services are available to
them?
Watch for these types of observations and put additional Questions/Ideas on the back. Content in this document described by Vijay Kumar in his book: 101 Design Methods
Physical
What do they interact with?
Cognitive
How associate meanings? How learn?
Social
Interactions, decision making, scheduling,
work?
Cultural
What are shared norms, habits, values?
Emotional
What emotions are expressed and how?
What are your biggest takeaways?
What did you learn? What surprised you?
What is the participants need?
Interview & Observation Notetaking Form

Adapted from the book Paper Prototyping by Carolyn Snyder, published by Morgan Kaufmann
Publishers. Copyright (c) 2003 Elsevier. All rights reserved.

DIY Usability Testing for Business Analysts (BA)

What's hot

Improving Website User Experience with A/B Testing Workshop

ALATechSource

Observing a usability test is like witnessing an accident; everyone sees it go down differently. One of the most important steps in usability testing, and yet often skipped by a lot of firms, is conducting a thorough debrief with the observers after testing is complete. Research should not be performed while working in a vacuum. The data and feedback collected from end users is not complete without understanding the observers’ perspectives, which oftentimes is different from the moderator's. The process for running an observer debrief involves getting all the observers (and even people who did not observe, but should have) to attend a meeting where we review the notes for each test and document the observations and perceived implications. In this session, you will learn various methods for running a debrief, when to use them, and walk away better prepared to get the most out of your research! After attending this practical session, attendees will be able to take what they have learned and execute a thorough debrief the next day. I will discuss various methods for running a debrief, spending more time on one method in particular, the Wish for/how-to/what-if method. For those that are not familiar, this method is executed by asking observers to create implications for each observation in the form of: Wish for... (W4) How to... (H2) What if... (Wif). The benefit being that stakeholders do not focus on actual solutions at this time, but instead open the discussion up for more out of the box thinking. What attendees will learn: - The importance of running a debrief - How to run a debrief (various options) - How to keep observers engaged during testing - Understanding the difference between observation, inference, opinion, and a recommendation - Pitfalls to avoid Who will benefit from the presentation and why: Anyone who moderates usability tests or research studies will benefit greatly from this session. They will learn how to distill the key findings from the observers and keep them engaged throughout the testing process.

Whoa! Did You See That? Collaborative Data Collection and Analysis

Kyle Soucy

Are you the sole User Experience Researcher in your organization? Do you struggle to get timely research insights and feedback for your stakeholders? Online research tools offer practitioners the ability to gather feedback quickly and asynchronously, without the need for direct facilitation or moderation. In this presentation, we provide an overview of some of the many online research tools that are available for gathering quick, asynchronous feedback on requirements, designs, and stakeholder sentiment. We offer general guidelines for recruiting, planning, implementing, and analyzing feedback, and then present how to use specific methods that have proven particularly useful for design and requirements research.

How to effectively implement different online research methods - UXPA 2015 - ...

Steve Fadden

Carol Smith presented this topic at the Heart of Agile conference in Pittsburgh, PA in April 2017. UX Slows Agile down! Do you hear that a lot? Carol shared best practices and how to dispel this myth in this session. The presentation included discussions of how to successfully embedding the UX team and the pros and cons of Agile projects. Carol will introduce methods for the UX team to break down and include their work in the backlog so it can get prioritized. Finally, Carol will discuss several successful ways to integrate usability testing across iterations.

Making Faster UX in an Agile World - HOAPitt 2017

Carol Smith

Selfish Accessibility: a11y Camp Toronto 2014

Adrian Roselli

Eye Tracking the UX of Mobile: What You Need to Know

Jennifer Romano Bergstrom

Improving Forms with User Experience Testing and Eye Tracking

Jennifer Romano Bergstrom

Do you have to be an actual designer, a creative type of person, to be good at the UX design process? Essentially, everyone who has any influence over the design is, in part, a designer. In this talk, you will learn how the world needs more UX superheroes within an organization and that ALL team members are an intrinsic part of the UX design process. I'll give an overview of the User Experience Design Process that involves shaping the product and getting it right from the beginning while touching on essential UX methods such as user research and field study techniques, personas, card sorting, brainstorming with sketches, wireframes, interactive prototypes, and testing.

UX Superpowers

Cara Nelson

Usability--What is it?

Ann Krause

Agile & Lean UX

Adrian Howard

Designing Better Experiences - UX London 2013

Cyber-Duck

Launch With Confidence! Integrate UX Research Throughout Development

Jennifer Romano Bergstrom

Originally presented 26 July 2015 at ALIA New Librarian Symposium 7 (http://nls7.org) in Sydney, Australia. This is an introductory overview on how library websites may optimise user experience. The foundations of user experience are explored, with an emphasis on the importance of personas. With four sample personas of a child, a university student, an older adult, and a mobile user, best practices for providing optimal user experiences for these typical users are detailed. Further reading and a bibliography are provided at the end of the presentation. Please feel free to leave a comment or tweet me with feedback or questions.

User Experience for Library Websites

jjs6791

Pros and Cons of Eyetracking

Luke Hay

A contextual inquiry is a research study that involves in-depth interviews where users walk through common tasks in the physical environment in which they typically perform them. It can be used to better understand the intents and motivations behind user behavior. In this session, learn what’s needed to conduct a contextual inquiry and how to analyze the ethnographic data once collected. I'll cover how to synthesize and visualize your findings as sequence models and affinity diagrams that directly inform the development of personas and common task flows. Finally, learn how this process can help guide your design and content strategy efforts while constructing a rich picture of the user experience.

Impact your Library UX with Contextual Inquiry

Rachel Vacek

Eye Tracking the User Experience of Mobile: What You Need To Know

UXPA DC

The Paying for College website is designed to help consumers make informed decisions about college finance. The Consumer Financial Protection Bureau (CFPB) began development with a user-centered design process for this tool-set, which is now in its 4th iteration. The college cost and financial aid comparison tool, a central feature of these resources, supports efforts by the Department of Education to standardize financial aid disclosures. During this session, we’ll cover the most recent rounds of usability testing conducted with multiple groups across the U.S. We’ll highlight difficulties when designing and testing for multiple audiences with different needs as well as testing and iterating with live and prototype versions of the site. Data will also be emphasized as we share collection methodologies (click paths, eye tracking, questionnaires, etc.) and the importance of each. We’ll also provide insights into planning, execution, and reporting and how these findings informed major changes on the website.

User-Centered Research on the Paying for College Website and Tools - EDUI 2014

Jennifer Romano Bergstrom

Live Usability Lab ELUNA 2008: Long Beach California

teaguese

Lean UX sits at the intersection of the Agile, Lean Startup & User Experience communities of practice. This workshop will introduce you to the basics of the Lean UX approach, and take you through the process of applying Lean UX techniques at different stages of the product/business development process. Learning outcomes: * Lean UX and its relation to Lean Startup, Agile UX & general Lean approaches the common myths and misunderstandings about Lean UX * How to apply Lean UX approaches within your own company * How the hypothesis/experiment model differs from traditional requirements * How Lean UX can be used to understand customers better, discover new product ideas, and reduce risk in new product development

Fundamentals of Lean UX, Agile on the Beach 2014

Adrian Howard

Developing new medicines is an extremely challenging process with more than 50% of new medicines failing in late-stage development where the cost is the greatest. One of the main reasons for attrition is insufficient knowledge about the nature of the gene or protein (target) involved in a disease. Scientists in pharmaceutical research and development use diverse data and software applications to aid decision-making for drug target identification and validation. We have been designing a new web portal to support researchers working within the pharmaceutical industry and academic organisations with the aim to make early drug target identification more efficient. We will report on how we applied a range of participatory design methods including interviews, observations, sketching workshops, paper prototyping and usability testing to understand how experts carry out the very early stages of drug discovery. We will discuss the challenges of working in this domain and the extent to which standard UX approaches helped us understand what matters for our potential users so we could design and deliver solutions within an Agile framework. We also mention when popular UX methods didn't work in this complex environment and how we addressed these issues. This work has been carried out via the Centre for Therapeutic Target Validation, a partnership between the European Bioinformatics Institute, the Wellcome Trust Sanger Institute and GlaxoSmithKline. See www.targetvalidation.org

A UX Journey into the World of Early Drug Discovery

Jennifer Cham

What's hot (20)

Improving Website User Experience with A/B Testing Workshop

Whoa! Did You See That? Collaborative Data Collection and Analysis

How to effectively implement different online research methods - UXPA 2015 - ...

Making Faster UX in an Agile World - HOAPitt 2017

Selfish Accessibility: a11y Camp Toronto 2014

Eye Tracking the UX of Mobile: What You Need to Know

Improving Forms with User Experience Testing and Eye Tracking

UX Superpowers

Usability--What is it?

Agile & Lean UX

Designing Better Experiences - UX London 2013

Launch With Confidence! Integrate UX Research Throughout Development

User Experience for Library Websites

Pros and Cons of Eyetracking

Impact your Library UX with Contextual Inquiry

Eye Tracking the User Experience of Mobile: What You Need To Know

User-Centered Research on the Paying for College Website and Tools - EDUI 2014

Live Usability Lab ELUNA 2008: Long Beach California

Fundamentals of Lean UX, Agile on the Beach 2014

A UX Journey into the World of Early Drug Discovery

Viewers also liked

Proyecto café (siembra beneficio torrefacción) agrop luna y sol jun_2015 comp...

Carlos González

Cata del café

elianavasque

Implementación de nitrógeno al proceso de empacado del café tostado y molido ...

Geral Prada

Monografia sobre fertilizacion del cultivo de cafe

Rocio Suarez

Cata de-café-

angelpro269

SPEAKING ASSIGNMENT-DEISY MENESES RIVERA

Deisy Johana Meneses Rivera

Proyecto Torre-factora de Cafe

Ruben Zavala Jacome

Tesis creacion de fuentes de financiamiento en la actividad agrícola del café

Mario Roberto Herrera Siliezar

Factores que influencian la calidad de taza del café

Roberto Mojica

Análisis sensorial de café

Ines Larra Mtz

Analisis fisico del cafe

Michael Vasquez

011 b-cafe

Cynthia Salazar

Cata de cafe

LuisAngelCerA

Cafe especial libro

Nery Yaneth Galvez Jeri

Proyecto torrefactora de café

Karen Bourgeot

Mature Products: The Cycle of UX Reinvention UXPA 2016

Carol Smith

Presented to the IIBA (International Institute of Business Analysis) Pittsburgh, PA Chapter on February 8, 2016. Most Business Analysts have plenty of experience when it comes to mapping database fields across a system interface, but where do you put those fields in a user interface? As BAs, we're used to wearing different hats: Project Manager, Tester, Developer. But since the invention of the iPod, everyone is becoming more aware of User Experience. We've all experienced a hard-to-use website or those old green screen applications where you had the F-Key menus memorized by the end of your first month. But F-Keys and clicking through ten pages of options to get to the submit button won't cut it anymore. In this presentation Carol Smith walks us through some basics to help you create a User Experience that won't make your end users to throw up their hands in frustration. Methods such as user focused interviews, card sorts and usability testing best practices are introduced with the intent that BA's can use these tools immediately in their workplace.

User Experience for Business Analysts

Carol Smith

AI for IA's: Machine Learning Demystified at IA Summit 2017 - IAS17

Carol Smith

Everything is designed, yet some interactions are much better than others. What does it take to make a great experience? What are the areas that UX specialists focus on? How do skills in cognitive psycology, computer science and design come together? Carol introduces basic concepts in user experience design that you can use to improve the user's expeirence and/or clearly communicate with designers.

Making Great User Experiences, Pittsburgh Scrum MeetUp, Oct 17, 2017

Carol Smith

What is machine learning? Is UX relevant in the age of artificial intelligence (AI)? How can I take advantage of cognitive computing? Get answers to these questions and learn about the implications for your work in this session. Carol will help you understand at a basic level how these systems are built and what is required to get insights from them. Carol will present examples of how machine learning is already being used and explore the ethical challenges inherent in creating AI. You will walk away with an awareness of the weaknesses of AI and the knowledge of how these systems work.

AI and Machine Learning Demystified by Carol Smith at Midwest UX 2017

Carol Smith

Viewers also liked (20)

Proyecto café (siembra beneficio torrefacción) agrop luna y sol jun_2015 comp...

Cata del café

Implementación de nitrógeno al proceso de empacado del café tostado y molido ...

Monografia sobre fertilizacion del cultivo de cafe

Cata de-café-

SPEAKING ASSIGNMENT-DEISY MENESES RIVERA

Proyecto Torre-factora de Cafe

Tesis creacion de fuentes de financiamiento en la actividad agrícola del café

Factores que influencian la calidad de taza del café

Análisis sensorial de café

Analisis fisico del cafe

011 b-cafe

Cata de cafe

Cafe especial libro

Proyecto torrefactora de café

Mature Products: The Cycle of UX Reinvention UXPA 2016

User Experience for Business Analysts

AI for IA's: Machine Learning Demystified at IA Summit 2017 - IAS17

Making Great User Experiences, Pittsburgh Scrum MeetUp, Oct 17, 2017

AI and Machine Learning Demystified by Carol Smith at Midwest UX 2017

Similar to DIY Usability Testing for Business Analysts (BA)

User Research Techniques by Vikram Rao, RSA

STC India UX SIG

Advanced Methods for User Evaluation in Enterprise AR

Mark Billinghurst

Observation and interviewing

Yaowaluck Promdee

Young people are connecting with one another through technology in unprecedented ways. Computers, wi-fi networks, and smart phones allow young people 24/7 access to technology and to one another. Using smart devices in educational settings as learning and community building tools can promote interpersonal communication and encourage young people to positively express their individuality and build their student-to-student, student-to-educator relationships. The activities that will be presented and experienced during this workshop use the technology that young people use - cell phones, social networking sites, laptops, blogs, and digital cameras. These activities focus upon and build diversity and cultural sensitivity, teamwork and problem solving, self-reflection and self-exploration, and communication and self-expression (adapted from Wolfe & Sparkman, 2009).

Experiential Mobile Learning

Jackie Gerstein, Ed.D

Does the field of user-centered design mystify you? Does user research seem like the last thing you have time to think about? Any team can look at analytics to understand what users are doing and how often they’re doing it. What analytics won’t tell you is *why* users are doing certain things — sometimes you need more context. That’s where user research comes in. This session will map out a framework for incorporating user research into your development cycle.

Homespun UX: Going Beyond Web Analytics

Mary Ann Brody

203CR Portfolio 2 UCD

Job Shadow

Job Shadow

Practical Usability

This articles presents a design method called co-creation toolkits that are conducted during a co-creation session in which a designer facilitate to participants a number of exercises that involve active making with an aim to better understand the context and the users of the design. The article answer the what, when, why and how questions related to this method. Presenting the most common types of co-creation toolkits, and their content. A case study from the healthcare design will help demonstrate the value of this method. Finally issues related to this method is discussed.

A Practical Guide to Co-design

Hoda Hamouda

"Sweating The Method; Getting The Most Out Of Your (Limited) Research Window" Wei Lieh NG, UX Manager at StarHub shares the tips on how to maximise the opportunities to gather data in a limited research window. About Wei Lieh: Wei Lieh is a 10+ year UX practitioner who has worked in telecoms, automotive and printer industries creating both digital and product user experiences. Wei Lieh is currently the head of user experience at StarHub Ltd, a public listed telecommunication provider overseeing the overall UX of the online store and smartphone apps. Wei Lieh is a graduate of Nanyang Technological University with an MS in Human Factors and a B.Eng in Mechanical Engineering.

DBA #15 Sweating the Method: Getting the Most Out of Your (Limited) Research ...

Design Bootcamp Asia

International Business User Research: Methods and Tools

Yong Zhang

UNIT II EMPATHIZE IN DESIGN THINKING AND ANALYSIS

GOWSIKRAJA PALANISAMY

Facilitating Online Interaction 4 Learning Resource Slides

Nancy Wright White

Art Center Interactive Design 4 - #4 Usability Testing

Joy Liu

This was a presentation by Jonathan Steingiesser given to entrepreneurs at Angelhack Dubai in May 2014. It is an Introduction to UX and practical advice on how to turn research into insight and action. During the presentation two activities were given to participants regarding their startup initiative. - Persona development of the target audience - Experience mapping: creating a proto persona (short summary) of the target audience and a user journey based on a day or week in the life of this persona. Then adding the user stories/requirements/features that are needed for each step in that journey Templates and examples can be seen in this presentation. REFERENCE: Content for this presentation was sourced from various materials, predominately Leah Buley's The User Experience Team of One: A Research and Design Survival Guide which can be purchased at http://rosenfeldmedia.com/books/ux-team-of-one/

Introduction to UX and Turning Research into Insight and Action - Angelhack D...

Jonathan Steingiesser

Yes U can! - User Checks; iterative usability testing with actionable results

Anouschka Scholten

Session 5 - Measuring UX + Getting Into UX

Leanna Gingras

Recruiting the right participants is often the most difficult and challenging aspect of conducting research studies. A well-managed recruitment process can be pivotal to the success of achieving your research objectives. Join JonDelina (“JD”) Buckley, Manager of User Experience Research at Kelley Blue Book, and Aaron Rager, Client Development Manager at Research Now, to learn about some of the best practices on recruiting the right participants for remote unmoderated user testing.

Best Practices on Recruiting Participants for Remote User Testing

UserZoom

DNB202 Usability Report for Cameras

SuzanneWootton

Similar to DIY Usability Testing for Business Analysts (BA) (20)

User Research Techniques by Vikram Rao, RSA

Advanced Methods for User Evaluation in Enterprise AR

Observation and interviewing

Experiential Mobile Learning

Homespun UX: Going Beyond Web Analytics

203CR Portfolio 2 UCD

Job Shadow

Practical Usability

A Practical Guide to Co-design

DBA #15 Sweating the Method: Getting the Most Out of Your (Limited) Research ...

International Business User Research: Methods and Tools

UNIT II EMPATHIZE IN DESIGN THINKING AND ANALYSIS

Facilitating Online Interaction 4 Learning Resource Slides

Art Center Interactive Design 4 - #4 Usability Testing

Introduction to UX and Turning Research into Insight and Action - Angelhack D...

Yes U can! - User Checks; iterative usability testing with actionable results

Session 5 - Measuring UX + Getting Into UX

Best Practices on Recruiting Participants for Remote User Testing

DNB202 Usability Report for Cameras

More from Carol Smith

Trust is complex and transient. Context, safety, privacy, respect, and many other considerations are built into each individuals’ concept of trust. How can we examine this complexity in a way that supports the work of making digital experiences? What research supports this work and how can we use practices of responsible development to make systems that earn appropriate levels of trust? What is an appropriate level of trust for emerging technologies such as machine learning systems? This talk will examine trust and how UX practitioners can define and measure it. Carol J. Smith September 24, 2021 Carnegie Mellon University, SEI Twitter: @carologic @sei_etc

Navigating the Complexity of Trust at UXPA Boston 2021

Carol Smith

Ethics discussions abound, but translating “do no harm” into our work is frustrating at best, and obfuscatory at worst. We can agree that keeping humans safe and in control is important, but implementing ethics is intimidating work. Learn how to wield your preferred technology ethics code to make an AI system that is accountable, de-risked, respectful, secure, honest and usable. The presenter will introduce the topic of ethics and then step through a user experience (UX) framework to guide AI development teams successfully through this process. Presented virtually for PyCon 2020 which was to be held in Pittsburgh, PA, but was reorganized online due to Covid-19.

Implementing Ethics: Developing Trustworthy AI PyCon 2020

Carol Smith

Artificial intelligence (AI) holds great promise to empower us with knowledge and scaled effectiveness. To harness the power of AI systems, we can—and must—ensure that we keep humans safe and in control. This session will introduce a new user experience (UX) framework to guide the creation of AI systems that are accountable, de-risked, respectful, secure, honest and usable. Presented at the RSA Conference 2020 in San Francisco, CA on February 28, 2020.

Designing Trustworthy AI: A User Experience Framework at RSA 2020

Carol Smith

Information architects work in a system with ourselves at the center. We are fundamental to making great experiences and as such, we must care for ourselves in order to best represent the people using the systems we are creating. Prioritizing the needs of users comes next, and with that protecting them by caring about diversity, inclusion and ethics. Finally, collaboration with colleagues and communities that influence our work can be done by educating them about IA work.

IA is Elemental: People are Fundamental at World IA Day 2020 Pittsburgh

Carol Smith

Prepping for UX research can be intimidating, and there is never enough time or resources. Carol will share her personal experiences in the field, both good and bad. She has learned the hard way, doing observations in moving vehicles, coal mines, hospitals, schools, homes, and offices. She will also share interesting anecdotes from colleagues and review both ethical and behavioral standards for researchers. The key is to prepare well, learn to be flexible and to adapt to the situation. Presented at World Usability Day 2019 at Michigan State University with Michigan UXPA

Gearing up for Ethnography, Michigan State, World Usability Day 2019

Carol Smith

"Designing Trustworthy AI: A Human-Machine Teaming Framework to Guide Development" is a paper presented at the AAAI 2019 Fall Symposium on AI in Government and the Public Sector, (sponsored by the Association for the Advancement of Artificial Intelligence) in Washington, DC, November 7–9, 2019. Artificial intelligence (AI) holds great promise to empower us with knowledge and augment our effectiveness. We can -- and must -- ensure that we keep humans safe and in control, particularly with regard to government and public sector applications that affect broad populations. How can AI development teams harness the power of AI systems and design them to be valuable to humans? Diverse teams are needed to build trustworthy artificial intelligent systems, and those teams need to coalesce around a shared set of ethics. There are many discussions in the AI field about ethics and trust, but there are few frameworks available for people to use as guidance when creating these systems. The Human-Machine Teaming (HMT) Framework for Designing Ethical AI Experiences described in this paper, when used with a set of technical ethics, will guide AI development teams to create AI systems that are accountable, de-risked, respectful, secure, honest, and usable. To support the team's efforts, activities to understand people's needs and concerns will be introduced along with the themes to support the team's efforts. For example, usability testing can help determine if the audience understands how the AI system works and complies with the HMT Framework. The HMT Framework is based on reviews of existing ethical codes and best practices in human-computer interaction and software development. Human-machine teams are strongest when human users can trust AI systems to behave as expected, safely, securely, and understandably. Using the HMT Framework to design trustworthy AI systems will provide support to teams in identifying potential issues ahead of time and making great experiences for humans.

Designing Trustworthy AI: A Human-Machine Teaming Framework to Guide Developm...

Carol Smith

Presented at the World Usability Congress in Graz, Austria on October 16, 2019. Self-driving vehicles are still a rarity in most cities, but as they become more common and as more and more humans interact with them we need to consider the wide variety of human experiences that occur within and along-side these vehicles. What information does the driver need when the vehicle is getting started vs. on it’s way? What information engenders trust and how much is too much? What changes due to experience level and comfort? How do we account for reliable easy commutes and people who use vehicles differently each day? How do these vehicles interact with other drivers, pedestrians, bicyclists and general society?

On the Road: Best Practices for Autonomous Experiences at WUC19

Carol Smith

Presented at Abstractions, Pittsburgh, PA Karen Bachmann and Carol Smith, August 23, 2019 Humans are biased, and sadly, we are not always able to filter our deeply ingrained biases. UX designers and researchers have long understood this, but as we watch major technology companies make significant mistakes with regard to ethics and bias, the cost of not accounting for bias and ethics is becoming more evident and widely known. Even knowing what pitfalls exist, we still miss opportunities for doing good as a result of our own human biases obscuring our vision. We need tools to explore and challenge our biases in a productive way to deliver better outcomes. We need a set of shared values within teams and, ultimately, across the industry to promote our common responsibility to deliver the greatest benefit while causing the least amount of harm. How can we work together to intensify the focus on ethical design? In this session, we’ll share ways you can empower yourself and your teams to do the right thing for people.

Designing More Ethical and Unbiased Experiences - Abstractions

Carol Smith

Artificially intelligent (AI) technologies are exciting and with them come a lot of new user experience research (UXR) responsibilities. How do we understand and clarify our users need for transparency, control, and access (and more) when the system is constantly changing? These dynamic systems are already part of our everyday lives and quickly becoming part of our jobs. What are our responsibilities with regard to ethics and protecting users from bias? Presented at Strive, June 7, 2019 in Toronto, Ontario, Canada. Strive is the 2019 UX Research Conference presented by the UX Research Collective Inc.

Dynamic UXR: Ethical Responsibilities and AI. Carol Smith at Strive in Toronto

Carol Smith

To design for inclusion we often must try out different ideas. In this interactive session you'll learn about all types of prototyping and how to get feedback on your ideas from your users. This session will briefly introduce a variety of prototypes and materials and evaluation methods for early learning. Participants will have time to build a quick prototype and practice getting feedback on it. We'll cover designing for accessibility and inclusion even at the prototype stage. You'll have the information you need to launch your ideas as early as possible to learn from the experience and improve more quickly. Presented at the Pittsburgh Inclusive Innovation Summit March 30, 2019 held at Point Park University.

Prototyping for Beginners - Pittsburgh Inclusive Innovation Summit 2019

Carol Smith

Whether you are building a team, managing experience practitioners or navigating career changers, managing a team of creative and analytical IA practitioners can be challenging. The welcome change towards diverse and inclusive hiring practices can add even more challenges. Learn how an experienced manager navigated through painful challenges and wonderful successes while managing large and small design departments in organizations with employees around the world. Presented at IA Conference 2019 in Orlando Florida by Carol Smith.

Navigating challenges in IA people management at IAC19

Carol Smith

You have probably seen the terms DesignOps and/or ResearchOps float by in your social media queue. These teams make designing (and researching) at scale beautifully efficient and successful. Carol steps through how these teams work, the types of activities they perform, situations they are helpful for, and ways you can leverage these types of programs in your organization. Carol will share examples from her experiences and stories from other organizations that are using Design Ops to do effective design at scale. Presented at Tout le monde UX in Montreal, Quebec, Canada on February 28, 2019. http://toutlemonde-ux.com/

What can DesignOps do for you? by Carol Smith at TLMUX in Montreal

Carol Smith

How can we, as designers, create artificially intelligent systems that don’t hurt humans? What should we think about to make these systems transparent? What information needs to be available to users to engender trust? This talk proposes a model for talking about the major decision points in building an AI. Carol will tackle the biggest challenges inherent with AI including issues of ethics and the implications for your work. Wondering why you keep hearing about the Trolley Problem? Has someone claimed that your AI is nearly sentient? Bring your questions and curiosity for this engaging evening, and she’ll warn you before spoilers of The Good Place (©2019 NBCUniversal Media, LLC).

Designing Trustable AI Experiences at IxDA Pittsburgh, Jan 2019

Carol Smith

How can designers improve trust of cognitive systems? What can we do to make these systems transparent? What information needs to be transparent? The biggest challenges inherent with AI will be discussed, specifically the ethical conflicts and the implications for your work, along with the basics of these concepts so that you can distinguish between simply smart systems and AI. Presented at the World World Usability Day 2018 celebration in Cleveland, Ohio.

Designing Trustable AI Experiences at World Usability Day in Cleveland

Carol Smith

We are all low on time and resources, and our UX research must occur wherever and whenever possible. Carol will share her personal experiences in the field, both good and bad. She has learned the hard way doing observations in moving vehicles, coal mines, hospitals, schools, homes, and offices. She will also share interesting anecdotes from colleagues and review both ethical and behavioral standards for researchers. The key is to prepare well, learn to be flexible and to adapt to the situation. Presented at Midwest UX 2018 held in Chicago, IL.

Gearing up for Ethnography at Midwest UX 2018

Carol Smith

As design leaders we must enable our teams with skills and knowledge to take on the new and exciting opportunities that building powerful AI systems bring. Dynamic systems require transparency regarding data provenance, bias, training methods, and more, to gain user’s trust. Carol will cover these topics and challenge us as design leaders, to represent our fellow humans by provoking conversations regarding critical ethical and safety needs. Presented at dmi:Design Leadership Conference in Boston in October 2018.

Designing AI for Humanity at dmi:Design Leadership Conference in Boston

Carol Smith

Can Product Design work in Agile environments? Yes! Balancing people and process can be complicated, and in this talk, Carol will provide you guidance to make it work. You can inform good design with strong user experience (UX) research and support continuous releases in a fast-paced environment. We'll look at ways to achieve a flexible approach that meets the needs of these seemingly conflicting efforts. Participants will come away with the tools they need to successfully integrate design thinking methods, in an Agile environment, one sprint at a time. Selected for presentation at ProductCamp Pittsburgh in September 2018 at Carnegie Mellon University (CMU).

Product Design in Agile Environments: Making it Work at ProductCamp Pittsburgh

Carol Smith

Artificially intelligent systems are becoming part of our everyday lives. This session will answer your questions about artificial intelligence, machine learning, and the ethical conflicts and the implications inherent in these technologies. Topics covered will include: discussions of bias in data; how to focus on the user experience; what is necessary to build a good cognitive computing systems; data needs; levels of accuracy; making safe and secure AI's; and discussions on ethics in AI and our role in leading those conversations. Carol will propose simple models for thinking about these systems and provide time for questions. You will walk away with an awareness of the weaknesses of AI and the knowledge of how these systems work. Selected by the audience to be presented at ProductCamp Pittsburgh in September 2018

Demystifying Artificial Intelligence: Solving Difficult Problems at ProductCa...

Carol Smith

UX in the Age of AI: Leading with Design UXPA2018

Carol Smith

This session focuses on the questions we need to ask to create good, ethical experiences for our users. Information Architects must push to… - Keep people at the center of our work. - Lead with our user’s goals. - Ease of use, usability, findability, effectiveness, efficiency… We must work to mature organizations approach - Push back on “technology first” ideas. - Lead on ethics - for our users, humanity.

IA in the Age of AI: Embracing Abstraction and Change at IA Summit 2018

Carol Smith

More from Carol Smith (20)