We are catapulting into the era of AI automation - long in coming and now arriving with a bang. Design as a discipline has barely kept up with the good and bad of our product decisions. We have seen it in the scooters scattered around city centers, blocking pedestrians, or the recent podcast by Ezra Klein on the increase of teenage suicides and mental health closely linked to the increase in social media consumption.
We don’t believe it is solely the Designers’ role to think about the social responsibility or human impact of our product. Yet we do play a role and need to raise our voices if we think about the changes that are upon us.
The challenge we put forth: we - as Design - have drifted along with companies' short-term revenue focus, including processes around agility and automation. Design has adapted to it, but has rarely challenged it.
As we enter this AI future, Pamela and Ricardo will share their thoughts on embracing yet challenging AI with eyes wide open, while adapting to the rapidly changing reality of our day-to-day work.
Microsoft CSP Briefing Pre-Engagement - Questionnaire
Human Centeredness AI at a time of Amplified Business Metrics_UXDX_EMEA_2023
1. SumUp | Docusign
Human
Centeredness
Pamela Mead
SVP Global Design, SumUp
1
Ricardo Marquez
Sr. Director Design, DocuSign
At a time of AI
Amplified Business
Metrics
UXDX Dublin
October, 2023
3. SumUp | Docusign 3
Broad adoption of LLM/Generative AI
has accelerated exponentially
25%
7.2% 49% 18.2%
POLL of 1000+ companies with revenue > $1billion:
Importance of adopting xGPT/LLMs/generative AI as
part of AI transformation during fiscal year 2023
LESS MOST
1 2 3 4 5
4. SumUp | Docusign 4
How many of you have
been asked to integrate
AI to your roadmap
in the past …?
5. SumUp | Docusign
What is within our power to work
responsibly with GenAI and LLMs
as we are adopting it faster than our
capacity to anticipate the consequences?
“
5
“
6. SumUp | Docusign 6
Business
Metrics
Efficiency
Human
Centeredness
Business
Metrics
Revenue
7. SumUp | Docusign 7
Business
Metrics
Efficiency
Happy Path
MVPs
Agile sprint
cycles
Business
Metrics
Revenue
8. SumUp | Docusign 8
Business
Metrics
Cutting
costs
Happy Path
MVPs
Agile sprint
cycles
Business
Metrics
Increased
adoption
9. SumUp | Docusign
“All in”
for AI
9
$ 51.2B
Revenue
58,000
Global start-ups
Private investment
$ 91.9B
US start-ups
14,000
10. SumUp | Docusign 10
Pharma
100k
AlphaFold
protein structures
2016
200M
AlphaFold
protein structures
predicted today
30 days
From liver cancer
target to viable
solution
11. SumUp | Docusign 11
Porcha
is suing for wrongful arrest
Face Recognition
2015 2021
Credits: New York Times Eight Months Pregnant and Arrested
12. SumUp | Docusign 12
Chase 16,
died by suicide.
His parents are suing
Tik Tok for wrongful death.
Recommendations
36 min
for a WSJ bot to get
content that is
93% sad
Credits: Bloomberg TikTok Effects on Mental Health
13. SumUp | Docusign 13
Often using unreliable data or applying non-inclusive models
Unchallenged system results
Untested over time
Focused on a single metric
Fast, autonomous
Human ability
LLM
Gen AI
2023
Exceeding our ability
14. SumUp | Docusign
What is within our power to work
responsibly with GenAI and LLMs
as we are adopting it faster than our
capacity to anticipate the consequences?
“
14
“
15. SumUp | Docusign 15
Understand and verify
data sources, models
Verify
who and when it
was created
Report
biases due to
sampling, gaps
Plan
to cover biases
from your industry
18. SumUp | Docusign 18
Design
with inclusivity
Review your own team’s diversity.
Co-create with internal partners
and support employees.
Use your product daily, for long
periods of time.
Credits:
WEF
19. SumUp | Docusign 19
May Habib
CEO, Writer, Inc
60%
of our leadership
team are women
62%
of our overall team are
women or minorities of
all types — ethnic,
racial, LGBTQ+.
Credits:
Writer
Inc
20. SumUp | Docusign 20
Sony AI | Advancing Fairness in Computer Vision:
A Multi-Dimensional Approach to Skin Color Analysis
Credits:
Sony
AI
21. SumUp | Docusign 21
Extend beyond core
use cases and scenarios
Consider factors
that constrain us
Ignorance, short-termism,
values, fear, error in
assumptions, and now
speed.
Anticipate
motivations
Power, control, inclusion,
exclusion
Capture extended
use cases
Anticipate impact
23. SumUp | Docusign
What is within our power to work
responsibly with GenAI and LLMs
as we are adopting it faster than our
capacity to anticipate the consequences?
“
23
“
24. SumUp | Docusign
What is within our power to work
responsibly with GenAI and LLMs
as we are adopting it faster than our
capacity to anticipate the consequences?
“
24
“Understand and verify
data sources, models
Design with Inclusivity
Extend beyond core use
cases and scenarios
25. SumUp | Docusign 25
Generative AI isn’t
replacing people
…but people who
engage with Gen AI are
replacing people who
don’t
Human
Centeredness
Billy Seabrook
IBM Consulting
27. SumUp | Docusign
Appendix Recommended articles & podcasts
Your Undivided Attention | Center for Humane Technology
Fascinating series from Tristan Harris and Asa Raskin
exploring the consequences of A.I. in our current context
Future Tense Fiction | Welcome to the AI Haunted House
Fiction and reality of AI applications from research scientist
and sci-fi author Janelle Shane
Ezra Klein Show | A.I. Could Solve some of humanity’s
hardest problems. It already has.
Demis Hassabis from DeepMind discusses how AI systems
can accelerate scientific research
Artefact Group | Taro of Tech Cars | Cards | Video
Tarot-like cards to inspire critical thinking about potential
consequences of products and technologies
Forbes | Racism and AI
Discussion on how AI is amplifying racism.
Bloomberg | TikTok’s Algorithm keeps Pushing Suicide
to Vulnerable Kids
Chase’s unfortunate story and the role of TikTok
New York Times | Eight Months Pregnant and Arrested
after a False Face Recognition Match
Portia’s story with the Detroit police case
Robert Merton | The Unanticipated Consequences of
Purposive Social Action
Robert Merton was a Sociologist in 1936 at Harvard writing
about behaviors that drive unanticipated consequences
Joy Buolamwini | Coded Bias
Documentary on Joy Boulamwini’s journey to create the
first US legislation against algorithmic bias
