20. High Model Accuracy
Low Model Accuracy
High
User Intent
Low
User Intent
user asked
for it
(e.g. clicked a
button)
predict with
high
confidence
predict with
low
confidence
flip a coin
21. High Model Accuracy
Low Model Accuracy
High
User Intent
Low
User Intent
always
right
flip a coin
usually
right
sometimes
right
User Experience for Intelligent Features
22. Don’t build these.
High Model Accuracy
Low Model Accuracy
High
User Intent
Low
User Intent
High
confidence
answers we
know you
want.
Strong UX
You want
answers, but
we aren’t sure.
Fail gracefully
We’re pretty
sure you want
this, though
you haven’t
asked.
In-line, but
easy to
ignore
We’re not sure what you want,
but we think this might be useful.
Visible, but off to the side
User Experience for Intelligent Features
23. Don’t build these.
Focus Effort Here
High Model Accuracy
Low Model Accuracy
High
User Intent
Low
User Intent
User Experience for Intelligent Features
26. 1. Design your model using concrete goals for fairness and
inclusion
27. 1. Design your model using concrete goals for fairness and
inclusion
2. Use representative datasets to train and test your model
28. 1. Design your model using concrete goals for fairness and
inclusion
2. Use representative datasets to train and test your model
3. Check the system for unfair biases
29. 1. Design your model using concrete goals for fairness and
inclusion
2. Use representative datasets to train and test your model
3. Check the system for unfair biases
4. Analyze performance
