Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Dynamic UXR: Ethical
Responsibilities and AI
Carol Smith @carologic
Strive, Toronto, June 6, 2019
This work is licensed un...
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Humanity…
AI is as imperfect
as the humans making it
Dynamic UXR: Ethical Responsibilities and AI / @carologic
What is artificial intelligence?
AI is present when machines:
– Exhibit intelligence
– Perceive environment
– Take action / make decision
to maximize chanc...
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Types of AI
Image: Best Artificial Intelligence Software, © 2019...
Dynamic UXR: Ethical Responsibilities and AI / @carologic
AI
Algorithms
Know ONLY what you teach
Control ONLY what given c...
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Taxonomies and Ontologies coming to life
(NOT like humans learn)...
Not sentient
Not unknowable black box
“We need
AI for that!”
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Like any good UX research
Understand people and problem deeply
S...
Dynamic UXR: Ethical Responsibilities and AI / @carologic
UXR for AI - what changes?
Provoke discussions around decision p...
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Ethics 101
Dynamic UXR: Ethical Responsibilities and AI / @carologic
What is Ethics? By Manuel Velasquez, Claire Andre, Thomas Shanks...
Dynamic UXR: Ethical Responsibilities and AI / @carologic
What is Ethics? By Manuel Velasquez, Claire Andre, Thomas Shanks...
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Images of trolleys and an anxious hypothetical trolley car lever...
NSF…
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Ethical UXR
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Decision Points
Content
and curation
TrainingManagement
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Goal: Prevent doubt
? ?
? ?
? ?
? ?
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Content and curation
Content
and curation
TrainingManagement
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Content Source
Exists
Available
Quantity
Quality
Photo by sunlig...
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Number Five “Needs Input”
Short Circuit (1986 film)
Ally Sheedy ...
Content
Data
AI
Are Biased
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Bias?
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Due to…
Social class
Resource availability
Race, gender, sexuali...
Right humans
are required to
reduce bias
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Question…
What curated?
Respected sources?
What is diversity?
Only as good as data
(and time spent improving)
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Training and Accuracy
Content
and curation
TrainingManagement
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Annotating Content
Image created by Angela Swindell, Visual Desi...
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Identify experts to train system
Trusted by users?
Vetting proce...
Difficult
conversations
Dynamic UXR: Ethical Responsibilities and AI / @carologic
What is priority of accuracy?
What is ROI? 90-99%+
accuracy
60-8...
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Management
Content
and curation
TrainingManagement
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Be Intentional
Make it your
business to keep
people safe
Image: ...
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Code of Conduct / Ethics
What do you value?
What lines won’t you...
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Black Mirror Brainstorms
Create Black Mirror
episode about misus...
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Unintended consequences
Becomes a Nazi?
Who can report?
To whom?...
Dynamic UXR: Ethical Responsibilities and AI / @carologic
“Ensure humans can unplug the machines”
– Grady Booch, Ted Talk
...
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Cycle: Represent Humans at Ethical Decisions Points
Content
and ...
Evangelize for human
values in AI.
Ethical. Transparent. Fair.
Dynamic UXR: Ethical Responsibilities and AI / @carologic
Continue the conversation...
LinkedIn: CarolJSmith
Twitter: @Car...
Dynamic UXR: Ethical Responsibilities and AI. Carol Smith at Strive in Toronto
Upcoming SlideShare
Loading in …5
×

Dynamic UXR: Ethical Responsibilities and AI. Carol Smith at Strive in Toronto

2,999 views

Published on

Artificially intelligent (AI) technologies are exciting and with them come a lot of new user experience research (UXR) responsibilities. How do we understand and clarify our users need for transparency, control, and access (and more) when the system is constantly changing?

These dynamic systems are already part of our everyday lives and quickly becoming part of our jobs. What are our responsibilities with regard to ethics and protecting users from bias?

Presented at Strive, June 7, 2019 in Toronto, Ontario, Canada. Strive is the 2019 UX Research Conference presented by the UX Research Collective Inc.

Published in: Design
  • Be the first to like this

Dynamic UXR: Ethical Responsibilities and AI. Carol Smith at Strive in Toronto

  1. 1. Dynamic UXR: Ethical Responsibilities and AI Carol Smith @carologic Strive, Toronto, June 6, 2019 This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License except where noted otherwise.
  2. 2. Dynamic UXR: Ethical Responsibilities and AI / @carologic Humanity…
  3. 3. AI is as imperfect as the humans making it
  4. 4. Dynamic UXR: Ethical Responsibilities and AI / @carologic What is artificial intelligence?
  5. 5. AI is present when machines: – Exhibit intelligence – Perceive environment – Take action / make decision to maximize chance of success at goal
  6. 6. Dynamic UXR: Ethical Responsibilities and AI / @carologic Types of AI Image: Best Artificial Intelligence Software, © 2019 G2 Crowd, Inc. All rights reserved
  7. 7. Dynamic UXR: Ethical Responsibilities and AI / @carologic AI Algorithms Know ONLY what you teach Control ONLY what given control of Aware of nuances and can continue to learn
  8. 8. Dynamic UXR: Ethical Responsibilities and AI / @carologic Taxonomies and Ontologies coming to life (NOT like humans learn) Photo: https://commons.wikimedia.org/wiki/File:Baby_Boy_Oliver.jpg
  9. 9. Not sentient Not unknowable black box
  10. 10. “We need AI for that!”
  11. 11. Dynamic UXR: Ethical Responsibilities and AI / @carologic Like any good UX research Understand people and problem deeply Solve right problem Solve it right
  12. 12. Dynamic UXR: Ethical Responsibilities and AI / @carologic UXR for AI - what changes? Provoke discussions around decision points Content and curation TrainingManagement
  13. 13. Dynamic UXR: Ethical Responsibilities and AI / @carologic Ethics 101
  14. 14. Dynamic UXR: Ethical Responsibilities and AI / @carologic What is Ethics? By Manuel Velasquez, Claire Andre, Thomas Shanks, S.J., and Michael J. Meyer. Markkula Center for Applied Ethics https://www.scu.edu/ethics/ethics-resources/ethical-decision-making/what-is-ethics/ Ethics Based on well-founded standards of right and wrong. Prescribe what humans ought to do.
  15. 15. Dynamic UXR: Ethical Responsibilities and AI / @carologic What is Ethics? By Manuel Velasquez, Claire Andre, Thomas Shanks, S.J., and Michael J. Meyer. Markkula Center for Applied Ethics https://www.scu.edu/ethics/ethics-resources/ethical-decision-making/what-is-ethics/ Ethics in terms of… Rights Obligations Benefits to society Fairness Specific virtues
  16. 16. Dynamic UXR: Ethical Responsibilities and AI / @carologic Images of trolleys and an anxious hypothetical trolley car lever operator. Does the Trolley Problem Have a Problem? What if your answer to an absurd hypothetical question had no bearing on how you behaved in real life? By Daniel Engber. Slate.com. June 18, 2018. https://slate.com/technology/2018/06/psychologys-trolley-problem-might-have-a-problem.html Not the Trolley Problem
  17. 17. NSF…
  18. 18. Dynamic UXR: Ethical Responsibilities and AI / @carologic Ethical UXR
  19. 19. Dynamic UXR: Ethical Responsibilities and AI / @carologic Decision Points Content and curation TrainingManagement
  20. 20. Dynamic UXR: Ethical Responsibilities and AI / @carologic Goal: Prevent doubt ? ? ? ? ? ? ? ?
  21. 21. Dynamic UXR: Ethical Responsibilities and AI / @carologic Content and curation Content and curation TrainingManagement
  22. 22. Dynamic UXR: Ethical Responsibilities and AI / @carologic Content Source Exists Available Quantity Quality Photo by sunlightfoundation https://www.flickr.com/photos/sunlightfoundation/2385174105
  23. 23. Dynamic UXR: Ethical Responsibilities and AI / @carologic Number Five “Needs Input” Short Circuit (1986 film) Ally Sheedy and Number Five (Tim Blaney) https://en.wikipedia.org/wiki/Short_Circuit_(1986_film)
  24. 24. Content Data AI Are Biased
  25. 25. Dynamic UXR: Ethical Responsibilities and AI / @carologic Bias?
  26. 26. Dynamic UXR: Ethical Responsibilities and AI / @carologic Due to… Social class Resource availability Race, gender, sexuality Culture, theology, tradition More…
  27. 27. Right humans are required to reduce bias
  28. 28. Dynamic UXR: Ethical Responsibilities and AI / @carologic Question… What curated? Respected sources? What is diversity?
  29. 29. Only as good as data (and time spent improving)
  30. 30. Dynamic UXR: Ethical Responsibilities and AI / @carologic Training and Accuracy Content and curation TrainingManagement
  31. 31. Dynamic UXR: Ethical Responsibilities and AI / @carologic Annotating Content Image created by Angela Swindell, Visual Designer, IBM
  32. 32. Dynamic UXR: Ethical Responsibilities and AI / @carologic Identify experts to train system Trusted by users? Vetting process Availability Maintain quality
  33. 33. Difficult conversations
  34. 34. Dynamic UXR: Ethical Responsibilities and AI / @carologic What is priority of accuracy? What is ROI? 90-99%+ accuracy 60-89% accuracy Financial Ecommerce Weeks Months
  35. 35. Dynamic UXR: Ethical Responsibilities and AI / @carologic Management Content and curation TrainingManagement
  36. 36. Dynamic UXR: Ethical Responsibilities and AI / @carologic Be Intentional Make it your business to keep people safe Image: 2001: A Space Odyssey (1968) “Odyssee im weltraum” – German DVD disc cover. From IMBD.
  37. 37. Dynamic UXR: Ethical Responsibilities and AI / @carologic Code of Conduct / Ethics What do you value? What lines won’t your AI cross? Track progress? Inspired by “3 guiding principles for ethical AI, from IBM CEO Ginni Rometty” by Alison DeNisco. January 17, 2017, Tech Republic http://www.techrepublic.com/article/3-guiding-principles-for-ethical-ai-from-ibm-ceo-ginni-rometty/
  38. 38. Dynamic UXR: Ethical Responsibilities and AI / @carologic Black Mirror Brainstorms Create Black Mirror episode about misuse of your product Pair with @brownorama's "abusability testing" Tweet by @aaronzlewis: https://twitter.com/aaronzlewis/status/1063544871472914432
  39. 39. Dynamic UXR: Ethical Responsibilities and AI / @carologic Unintended consequences Becomes a Nazi? Who can report? To whom? Turn off? Who notified? Consequences? Google’s tensor processing units: https://www.nytimes.com/2018/02/12/technology/google-artificial-intelligence-chips.html
  40. 40. Dynamic UXR: Ethical Responsibilities and AI / @carologic “Ensure humans can unplug the machines” – Grady Booch, Ted Talk Grady Booch, Scientist, philosopher, IBM’er https://www.ted.com/talks/grady_booch_don_t_fear_superintelligence
  41. 41. Dynamic UXR: Ethical Responsibilities and AI / @carologic Cycle: Represent Humans at Ethical Decisions Points Content and curation TrainingManagement
  42. 42. Evangelize for human values in AI. Ethical. Transparent. Fair.
  43. 43. Dynamic UXR: Ethical Responsibilities and AI / @carologic Continue the conversation... LinkedIn: CarolJSmith Twitter: @Carologic Slideshare: carologic Toward ethical, transparent and fair AI/ML: a critical reading list By Eirini Malliaraki, Feb 19 via tweet from @robmccargow https://medium.com/@eirinimalliaraki/toward- ethical-transparent-and-fair-ai-ml-a-critical-reading-list-d950e70a70ea

×