+ Updated version for UX Camp Hamburg #uxcamphh +
Deep learning is a new and exciting subfield of machine learning which attempts to sidestep the whole feature design process. In this session, I'll explain how it derives from AI, why it quietly became a part of user experience and how it will change the actual design workflow. The talk highlights a few examples and doesn't forget to illustrate why user experience design for artificial intelligence matters the other way around.
In this talk, presented at the UX Forum in Munich, I had a look at the Artificial Intelligence landscape, and the differences between Machine Learning and Deep Learning. The session walks through a big range of use cases in fields such as object and face recognition and showcases how the design industry is charging up with new powers.
In this session, I explain why user experience design for artificial intelligence matters. How you make machine learning transparent to users is one of the great design challenges of our time—but a necessary one.
+ Updated version for NEXT Conference Hamburg +
https://nextconf.eu/event/how-deep-learning-is-changing-the-design-process/
Deep learning is a new and exciting subfield of machine learning which attempts to sidestep the whole feature design process. This session explains how it derives from AI, why it quietly became a part of user experience and how it also changes the actual design workflow. The talk highlights a range of use cases and doesn’t forget to illustrate why user experience design for artificial intelligence matters the other way around.
Holistic experience design (HxD) for Nasdaq Proconf 2015Fritz Desir
A rapid fire talk I gave on an evolving area I've been studying which I call Holistic Experience Design. HxD eschews silo thinking whether at the team level (dept vs. dept vs. agency vs. consultant) or at the artifact level (service vs. product) to look at what can be made by combining.
It is still a work in progress. Feedback welcomed.
In this talk, presented at the UX Forum in Munich, I had a look at the Artificial Intelligence landscape, and the differences between Machine Learning and Deep Learning. The session walks through a big range of use cases in fields such as object and face recognition and showcases how the design industry is charging up with new powers.
In this session, I explain why user experience design for artificial intelligence matters. How you make machine learning transparent to users is one of the great design challenges of our time—but a necessary one.
+ Updated version for NEXT Conference Hamburg +
https://nextconf.eu/event/how-deep-learning-is-changing-the-design-process/
Deep learning is a new and exciting subfield of machine learning which attempts to sidestep the whole feature design process. This session explains how it derives from AI, why it quietly became a part of user experience and how it also changes the actual design workflow. The talk highlights a range of use cases and doesn’t forget to illustrate why user experience design for artificial intelligence matters the other way around.
Holistic experience design (HxD) for Nasdaq Proconf 2015Fritz Desir
A rapid fire talk I gave on an evolving area I've been studying which I call Holistic Experience Design. HxD eschews silo thinking whether at the team level (dept vs. dept vs. agency vs. consultant) or at the artifact level (service vs. product) to look at what can be made by combining.
It is still a work in progress. Feedback welcomed.
Digital Transformation agency MullenLowe Profero and their UK team take a look through the trends that will challenge brands and shape digital experiences in 2020.
Openbar 4 - Leuven - AI for Public Services - Stewie - ArintiOpenbar
In deze sessie zal Wouter meer vertellen over de mogelijkheden van conversational interfaces in de publieke sector en enkele business cases toelichten. Hij vertelt wat de uitdagingen zijn en laat zien wat er vandaag al kan en bestaat. Tot slot geeft hij je ook een blik op de toekomst van Chat- en Voicebots.
Building an Immersive, Interactive Customer Experience using AI and Augmented...Amazon Web Services
Artificial Intelligence and Augmented Reality (AR) are quickly becoming mainstream digital strategies to add new immersive experiences across industries from video games to e-commerce, and to increase user accessibility. In this session, we will explore how we can get started on using AWS AI services with AR/VR capabilities of Amazon Sumerian to build a new type of visually rich, engaging mobile application to increase brand interaction and delight your customers. Come and join us to learn how you can get started creating your very first AI and AR powered app!
To guard against errors, maintain uptime, and protect performance, it is critical to have visibility into your applications and systems. In this session, learn how DevOps enables us to build better systems by leveraging the perspectives of different teams to gain that visibility.
Building an Immersive, Interactive Customer Experience using Artificial Intel...Amazon Web Services
Artificial intelligence and augmented reality are quickly becoming mainstream digital strategies to add new immersive experiences; transforming how organisations interact with customers, strengthening relationships, and distinguishing themselves from the competition. In this session we will explore how you can get started with AWS Artificial Intelligence services, paired with the augmented reality/virtual reality capabilities of Amazon Sumerian to build a new type of visually rich, engaging, customer experiences.
Gain Maximum Visibility into Your Applications - DEM03 - Chicago AWS SummitAmazon Web Services
Visibility into your applications and systems is critical to guarding against errors, maintaining uptime, and protecting performance. In this session, we show how DevOps enables us to build better systems by leveraging the perspectives of different teams in order to gain that visibility. This session is brought to you by AWS partner, Datadog.
The experience of the mobile home screen being a bank of app icons that lead to independent destinations is dying. And that changes how we need to design and build digital products.
In this talk I show current trends and examples and explain what it means for User Experience Design and for businesses.
Slide deck from ITP Unconference 2016.
I ran an introductory workshop on mobile UX that covered the basics of UX, mobile specific aspects of UX design, and how to get started fast
Gain Maximum Visibility into Your Applications - DEM04 - Atlanta AWS SummitAmazon Web Services
Visibility into your applications and systems is critical to guarding against errors, maintaining uptime, and protecting performance. In this session, we show how DevOps enables us to build better systems by leveraging the perspectives of different teams in order to gain that visibility. This session is brought to you by AWS partner, Datadog.
Beginners' guide to designing apps. Follow this simple steps to get started with the right foot when designing mobile, desktop, web or even smartwatch apps.
Die Digitalisierung aus der Sicht der historischen Analogie. Sie wird verglichen mit der Erfindung eines revolustionären Produkte, wie des Autos, mit der Industrialisierung und mit der Einführung des Buchdrucks.
Visibility into your applications and systems is critical in guarding against errors, maintaining uptime, and protecting performance. In this session, learn how DevOps enables us to build better systems by leveraging the perspectives of different teams in order to gain that visibility.
100% Visibility - Jason Yee - Codemotion Amsterdam 2018Codemotion
Monitoring systems has traditionally been the responsibility of Ops teams. But our goal is to align devs, ops, & other roles in the organization (aka DevOps), so we need to ensure they are all monitoring critical business systems & do so in ways that take advantage of the unique perspective that each role offers. In this session, I’ll break down the expansive monitoring landscape into 5 categories that each provide a unique view of your systems. I’ll show how each category allows your team to have complete observability, avoid blind spots, & work together to quickly resolve issues & outages.
What is Tokenization? Are tokens the future of ownership?
-
The advantage of token-based social networks, and why tokens will disrupt all forms of ownership.
More Related Content
Similar to 2017 How Deep Learning Changes the Design Process (Update)
Digital Transformation agency MullenLowe Profero and their UK team take a look through the trends that will challenge brands and shape digital experiences in 2020.
Openbar 4 - Leuven - AI for Public Services - Stewie - ArintiOpenbar
In deze sessie zal Wouter meer vertellen over de mogelijkheden van conversational interfaces in de publieke sector en enkele business cases toelichten. Hij vertelt wat de uitdagingen zijn en laat zien wat er vandaag al kan en bestaat. Tot slot geeft hij je ook een blik op de toekomst van Chat- en Voicebots.
Building an Immersive, Interactive Customer Experience using AI and Augmented...Amazon Web Services
Artificial Intelligence and Augmented Reality (AR) are quickly becoming mainstream digital strategies to add new immersive experiences across industries from video games to e-commerce, and to increase user accessibility. In this session, we will explore how we can get started on using AWS AI services with AR/VR capabilities of Amazon Sumerian to build a new type of visually rich, engaging mobile application to increase brand interaction and delight your customers. Come and join us to learn how you can get started creating your very first AI and AR powered app!
To guard against errors, maintain uptime, and protect performance, it is critical to have visibility into your applications and systems. In this session, learn how DevOps enables us to build better systems by leveraging the perspectives of different teams to gain that visibility.
Building an Immersive, Interactive Customer Experience using Artificial Intel...Amazon Web Services
Artificial intelligence and augmented reality are quickly becoming mainstream digital strategies to add new immersive experiences; transforming how organisations interact with customers, strengthening relationships, and distinguishing themselves from the competition. In this session we will explore how you can get started with AWS Artificial Intelligence services, paired with the augmented reality/virtual reality capabilities of Amazon Sumerian to build a new type of visually rich, engaging, customer experiences.
Gain Maximum Visibility into Your Applications - DEM03 - Chicago AWS SummitAmazon Web Services
Visibility into your applications and systems is critical to guarding against errors, maintaining uptime, and protecting performance. In this session, we show how DevOps enables us to build better systems by leveraging the perspectives of different teams in order to gain that visibility. This session is brought to you by AWS partner, Datadog.
The experience of the mobile home screen being a bank of app icons that lead to independent destinations is dying. And that changes how we need to design and build digital products.
In this talk I show current trends and examples and explain what it means for User Experience Design and for businesses.
Slide deck from ITP Unconference 2016.
I ran an introductory workshop on mobile UX that covered the basics of UX, mobile specific aspects of UX design, and how to get started fast
Gain Maximum Visibility into Your Applications - DEM04 - Atlanta AWS SummitAmazon Web Services
Visibility into your applications and systems is critical to guarding against errors, maintaining uptime, and protecting performance. In this session, we show how DevOps enables us to build better systems by leveraging the perspectives of different teams in order to gain that visibility. This session is brought to you by AWS partner, Datadog.
Beginners' guide to designing apps. Follow this simple steps to get started with the right foot when designing mobile, desktop, web or even smartwatch apps.
Die Digitalisierung aus der Sicht der historischen Analogie. Sie wird verglichen mit der Erfindung eines revolustionären Produkte, wie des Autos, mit der Industrialisierung und mit der Einführung des Buchdrucks.
Visibility into your applications and systems is critical in guarding against errors, maintaining uptime, and protecting performance. In this session, learn how DevOps enables us to build better systems by leveraging the perspectives of different teams in order to gain that visibility.
100% Visibility - Jason Yee - Codemotion Amsterdam 2018Codemotion
Monitoring systems has traditionally been the responsibility of Ops teams. But our goal is to align devs, ops, & other roles in the organization (aka DevOps), so we need to ensure they are all monitoring critical business systems & do so in ways that take advantage of the unique perspective that each role offers. In this session, I’ll break down the expansive monitoring landscape into 5 categories that each provide a unique view of your systems. I’ll show how each category allows your team to have complete observability, avoid blind spots, & work together to quickly resolve issues & outages.
Similar to 2017 How Deep Learning Changes the Design Process (Update) (20)
What is Tokenization? Are tokens the future of ownership?
-
The advantage of token-based social networks, and why tokens will disrupt all forms of ownership.
Resonate (http://resonate.io) is a festival at the intersection of art, media and technology. Held each year in Belgrade, Serbia, the conference provides an overview of current situation in the fields of music, visual arts and digital culture.
This session walks through speakers and personal highlights of the 2017 conference.
This talk, made with Kristina Bonitz (@kristinabonitz), tries to highlight the differences within the conversational design landscape and shows benefits and drawbacks alongside current examples.
Chat bots are programs that mimic conversation with people sometimes using artificial intelligence. They can transform the way you interact with the web from a series of self-initiated tasks to a quasi-conversation.
(c) 2017
Modern interaction design - see Flat Design - is more than ever based on letters.
This talk highlights strong examples and explains how to achieve an aesthetic and powerful set of typography for any project, and how to handle it in the digital workflow.
"Tone of voice" is a super important instrument to build personality into digital products. It's not about copywriting, it's an expression of the brand identity.
Prototypes are one of the most important steps in the design process, yet still confusing for some designers and project teams.
This session, made with Iker Ortiz de Arri (@ikertxo), showcases our workflow approach, answers the question how to choose the right prototyping tool for a project and and compares some of the major players in this exploding landscape.
What are the main and also often underlooked differences between native app development and web technologies when building a mobile product? What is the current stare of technology in terms of combing both?
This talk, made with Iker Ortiz de Arri (@ikertxo), showcases benefits, drawbacks and similarities from an UX point of view. It also features PWA (progressive web apps), Android Instant Apps, React, and more.
OFFF Barcelona (http://offf.barcelona) is a post-digital culture festival.
This session walks through speakers and personal highlights of the 2016 conference.
In this talk presented at the Swipe x PAGE Academy (http://page-online.de), we gave an overview of the Swipe workflow building mobile products, from an UX/UI point of view.
http://swipe.de
This talk presented at the Swipe x PAGE Academy (http://page-online.de) is about my personal work manifesto for building teams, atmosphere and greater products at Swipe (http://swipe.de).
This session as part of the Swipe x PAGE Academy (http://page-online.de) gave examples of how we create UX/UI at Swipe (http://swipe.de) efficiently when building digital products.
This talk presented at the Swipe x PAGE Academy (http://page-online.de) is about my personal approach for getting design sold without too many sacrifices.
Did you ever tried to make a screenshot on a range of different android devices? Did your client ever?
In this talk presented at the Selfmade Lab (http://selfmadelab.de) in Hamburg, I looked back at my personal experiences building mobile products - in comparison to print and also web design.
10 questions you need an answer for before starting the creative process. It should be common sense, but in reality it always needs a little more time and effort to gather information from different stakeholders and to pinpoint the relevant facts.
This short summary as part of the Swipe x PAGE Academy (http://page-online.de) is a quick guide to recapitulate the important briefing questions.
Maximize Your Content with Beautiful Assets : Content & Asset for Landing Page pmgdscunsri
Figma is a cloud-based design tool widely used by designers for prototyping, UI/UX design, and real-time collaboration. With features such as precision pen tools, grid system, and reusable components, Figma makes it easy for teams to work together on design projects. Its flexibility and accessibility make Figma a top choice in the digital age.
Hello everyone! I am thrilled to present my latest portfolio on LinkedIn, marking the culmination of my architectural journey thus far. Over the span of five years, I've been fortunate to acquire a wealth of knowledge under the guidance of esteemed professors and industry mentors. From rigorous academic pursuits to practical engagements, each experience has contributed to my growth and refinement as an architecture student. This portfolio not only showcases my projects but also underscores my attention to detail and to innovative architecture as a profession.
EASY TUTORIAL OF HOW TO USE CAPCUT BY: FEBLESS HERNANEFebless Hernane
CapCut is an easy-to-use video editing app perfect for beginners. To start, download and open CapCut on your phone. Tap "New Project" and select the videos or photos you want to edit. You can trim clips by dragging the edges, add text by tapping "Text," and include music by selecting "Audio." Enhance your video with filters and effects from the "Effects" menu. When you're happy with your video, tap the export button to save and share it. CapCut makes video editing simple and fun for everyone!
Book Formatting: Quality Control Checks for DesignersConfidence Ago
This presentation was made to help designers who work in publishing houses or format books for printing ensure quality.
Quality control is vital to every industry. This is why every department in a company need create a method they use in ensuring quality. This, perhaps, will not only improve the quality of products and bring errors to the barest minimum, but take it to a near perfect finish.
It is beyond a moot point that a good book will somewhat be judged by its cover, but the content of the book remains king. No matter how beautiful the cover, if the quality of writing or presentation is off, that will be a reason for readers not to come back to the book or recommend it.
So, this presentation points designers to some important things that may be missed by an editor that they could eventually discover and call the attention of the editor.
Between Filth and Fortune- Urban Cattle Foraging Realities by Devi S Nair, An...Mansi Shah
This study examines cattle rearing in urban and rural settings, focusing on milk production and consumption. By exploring a case in Ahmedabad, it highlights the challenges and processes in dairy farming across different environments, emphasising the need for sustainable practices and the essential role of milk in daily consumption.
Fonts play a crucial role in both User Interface (UI) and User Experience (UX) design. They affect readability, accessibility, aesthetics, and overall user perception.
Can AI do good? at 'offtheCanvas' India HCI preludeAlan Dix
Invited talk at 'offtheCanvas' IndiaHCI prelude, 29th June 2024.
https://www.alandix.com/academic/talks/offtheCanvas-IndiaHCI2024/
The world is being changed fundamentally by AI and we are constantly faced with newspaper headlines about its harmful effects. However, there is also the potential to both ameliorate theses harms and use the new abilities of AI to transform society for the good. Can you make the difference?
4. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
AI landscape
THE TERMS ARTIFICIAL INTELLIGENCE
AND MACHINE LEARNING
ARE OFTEN USED INTERCHANGEABLY –
YET THEY AREN’T THE SAME
5. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Machine Learning
Machine learning is the ability to learn without
being explicitly programmed.
Programs that can learn from their own mistakes
and improve their performance over time.
6. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Machine Learning
Data mining
Image recognition
Facebook newsfeed
Netflix suggestions
Big Data analysis
Amazon suggestions
Predictive analytics
7. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Machine Learning
Notifications
Predictive Keyboards
Spam/Quality Control Systems
Copywriting
Design Patterns
Gesture Recognition
Content Actions/Feedback
Magic Numbers
Search
Related Content
Character Recognition
14. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Deep Learning
Deep Learning is based on Artificial Neural
Networks.
These are systems that are designed to process
information in ways that are similar to the ways
biological brains work. It uses a certain set of
Machine Learning algorithms that run in multiple
layers.
16. „H O W D E E P
L E A R N I N G C H A N G E S
T H E D E S I G N
P R O C E S S
AI HAS BY NOW SUCCEEDED
IN DOING ESSENTIALLY EVERYTHING THAT
REQUIRES ‘THINKING’
BUT HAS FAILED TO DO MOST OF WHAT PEOPLE DO
‘WITHOUT THINKING.’
Donald Knuth, Stanford University
19. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Why it is important?
Google has decided to pivot its business model from that
simple mobile-first toward machine learning.
31. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Google Lens
Can an algorithm see what you see and help you take
action based on this information?
32. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Google Lens
Google Lens turns the camera from a passive tool
that’s capturing the world around you to one that’s
allowing you to interact with what’s in your camera’s
viewfinder.
39. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Photoeditor SDK
Can an algorithm extract foreground content
from its background?
40. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Photoeditor SDK
Professional image editing tools help you to select
distinctive objects, but, they aren’t available on your
mobile device, where you take and publish the images,
and they usually require some hands-on time, before
you can produce anything usable.
42. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Photoeditor SDK
43. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Adobe - Deep Image Matting
Can an algorithm extract foreground content
from its background – in movies too?
44. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Adobe - Deep Image Matting
Previous algorithms have poor performance when an
image has similar foreground and background colors
or complicated textures. With neural networks you
can extract foreground content from its background
intelligently and accurately - in movies. This might kill
the green screen.
49. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Entrupy
Can an algorithm help to spot a real
Chanel bag from a fake?
50. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Entrupy
Counterfeits are a painful thorn in the side of luxury
fashion brands but they can be even more of a
headache for digital re-sellers. Trying to spot a real
Chanel from a fake? Deep Learning tech can help.
51. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Entrupy
Entrupy is a portable scanning device that instantly detects
imitation designer bags by taking microscopic pictures that
take into account details of the material, processing,
workmanship, serial number, and wear/tear. It then employs
the technique of deep learning to compare the images
against a vast database that includes top luxury brands and
if the bag is deemed authentic, users immediately get a
Certificate of Authenticity.
53. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Google Research
Can an algorithm understand what makes
good photography?
54. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Google Research
360-degree images are fascinating to explore but they’re not
exactly the best looking photos, often lackluster in color and
exposure. Google engineers used Deep learning to teach the
machine to understand what makes good photography. They
even added automatic fine-tuning of the images: Instead of
filters, the AI understands what elements exist in the image
and, in turn, tweaks the lighting accordingly.
59. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
EyeEm - Vision
Can an algorithm learn and suggest aesthetics
in a way an art director would?
60. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
EyeEm - Vision
Can a machine learn aesthetics in a way a human
would? Could it then look at a set of photos, and draw
on those same aesthetics to reproduce a different
set?
61. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
EyeEm - Vision
What are aesthetics anyway? Is it just what you “like”?
How does it all work? When you as a human find it
hard to express what you like do you think a machine
going to find it easy?
62. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
EyeEm - VisionEyeEm - Vision
63. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Neural Storyteller
Can an algorithm make up stories from
any given image?
64. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Neural Storyteller
Neural Storyteller is an artificial intelligence
model that when given an image, can generate a
story about the image using features in the image.
65. Neural Storyteller
H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
66. Neural Storyteller
H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
67. Neural Storyteller
H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
68. Neural Storyteller
H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
69. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Rapto
Can an algorithm turn your normal day
into a rap song?
70. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Rapto
Rapto lets you create music using artificial
intelligence & your camera. Simply point the camera
towards any object around you and Rapto will use it's
inbuilt neural network to understand the object &
create rap music!
71. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Rapto
73. E P I C O R C H A P T E R
Subtopic or example
New versions of facial recognition technologies use
Deep Learning, as it is especially effective for image
recognition because it makes a computer zero in on
the facial features that will most reliably identify a
person.
76. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Google Allo
Can an algorithm create a Bitmoji for you on the fly?
77. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Google Allo
With Google Allo simply snap a selfie, and it’ll return
an automatically generated illustrated version of you,
on the fly.
80. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Nest Cam IQ
Can an algorithm detect strangers?
81. E P I C O R C H A P T E R
Nest Cam IQ
The Nest Cam IQ can differentiate between friends
and family members, or a stranger. Insights can range
from telling you the kids are home from school to
sending an alert if an unfamiliar person is in the living
room.
83. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
China & Russia
Can an algorithm register me at events?
84. E P I C O R C H A P T E R
China & Russia
In China, facial recognition technology is already
finding consumer applications.
In Russia, FindFace is an controversial an app used to
identify members of a crowd to match them with
social network accounts.
90. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Google Quick Draw
Can an algorithm understand what you are drawing?
91. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Google Quick Draw
Can a neural network learn to recognize doodles?
Help teach it by adding your drawings to the world’s
largest doodle data set.
92. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Google Quick Draw
93. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Google Quick Draw
94. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Google AutoDraw
Can an algorithm help to teach you drawing?
95. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Google AutoDraw
AutoDraw’s suggestion tool uses the same technology
used in QuickDraw, to guess what you’re trying to
draw. Right now, it can guess hundreds of drawings
and we look forward to adding more over time.
96. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Google AutoDraw
97. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Google AutoDraw
98. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
pix2pix
Can an algorithm take your drawings
to generate images?
99. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
pix2pix
Image-to-image is a Tensorflow port of pix2pix.
The pix2pix model works by training on pairs of
images such as building facade labels to building
facades, and then attempts to generate the
corresponding output image from any input image
you give it.
100. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
pix2pix
101. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
pix2pix
104. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Drawing music
Can an algorithm take your drawings
to generate music?
105. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Drawing music
Kene Cogan has built an experiment where a
classified musical object triggers an according
sound track in Ableton Live.
106. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Drawing music
108. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Lyrebird
Can an algorithm help to mimic the voice of
a given person?
109. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Lyrebird
Lyrebird is an API for speech synthesis. Record 1 minute from
someone's voice and Lyrebird can compress her/his voice's
DNA into a unique key.
110. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Lyrebird
111. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
pix2code
Can an algorithm program a user interface
from a given layout?
112. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
pix2code
Transforming a graphical user interface created by a designer
into code is a typical task conducted by a developer in order
to build software, websites and mobile applications.
Deep Learning techniques can be leveraged to automatically
generate code given a graphical user interface screenshot as
input.
115. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Style Transfer
Can an algorithm re-create complex aesthetics
and even fine art?
116. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Style Transfer
In fine art humans have mastered the skill to create unique
visual experiences through composing a complex interplay
between content and style.
Style Transfer is an artificial system that creates artistic
images of high perceptual quality.
124. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Creative Adversarial Networks
Can an algorithm invent new styles of art?
125. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Creative Adversarial Networks
Researchers modified a type of algorithm in which two neural
nets play off against each other to get better and better
results. One creates a solution, the other judges it.
AIs that can tweak photos to mimic the style of famous
painters are already widely available. But the new system is
designed to produce original works from scratch.
129. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Fontjoy
Can an algorithm generate font combinations?
130. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Logo Experiment
Can an algorithm generate logo artworks?
131. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Logo Experiment
Rob Peart tried to generate Death Metal
logos from Neural Networks ;)
139. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Logo Experiment
Can an algorithm generate logo artworks?
140. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
NVIDIA - Iray
Can an algorithm squash 3D render times?
141. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
NVIDIA - Iray
NVIDIA brings AI to ray tracing to speed graphics
workloads. Upload your partially rendered image and
AI Renderer renders the rest for you.
By predicting final images from only partly finished
results, Iray AI produces accurate, photorealistic
models without having to wait for the final image to
be rendered.
144. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Autodesk - DreamCatcher
Can an algorithm generate physical products
that solve complex problems?
145. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Autodesk - DreamCatcher
Dreamcatcher is a generative CAD system that
enables designers to craft a definition of their design
problem through goals and constraints.
146. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Autodesk - DreamCatcher
The three structural elements shown are all designed to carry
the same structural loads and forces.
147. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Autodesk - DreamCatcher
A Lightweight bike stem generated by an algorithm
148. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Autodesk - DreamCatcher
This is a car frame that is designed by a generative algorithm
149. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Autodesk - DreamCatcher
A a lightweight load-bearing engine block
151. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Objectifier
Can an algorithm help objects to respond to
human gestures?
152. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Objectifier
Objectifier empowers people to train objects in
their daily environment to respond to their unique
behaviors. It gives an experience of training an
artificial intelligence; much like training a dog -
you teach it only what you want it to care about.
Just like a dog, it sees and understands its
environment.
153. Objectifier
H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
154. Objectifier
H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
155. Objectifier
H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
157. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
What’s next?
Computers can now see, hear, and translate
languages with unprecedented accuracies.
They are also learning to generate images,
sound, and text.
158. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
What’s next?
However the systems we’re building still fall into the
category of “Narrow AI” — they can achieve super-
human performance in a specific domain, but lack
the ability to do anything sensible outside of it.
160. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Open AI - UNIVERSE
161. „H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S SMACHINE LEARNING IS GOING TO UPEND YOUR
INDUSTRY AND YOUR PRODUCT.
Ken Norton, Google Ventures
163. „H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
MACHINE LEARNING WON’T REACH ITS POTENTIAL
– AND MAY ACTUALLY CAUSE HARM –
IF IT DOESN’T DEVELOP
IN TANDEM WITH USER EXPERIENCE DESIGN.
Caroline Sinders, Fast Company
164. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Challenges for UX
Develop relevant use cases
165. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Spotify - Discovery Weekly
Discovery Weekly is an automated music
recommendation digest for each Spotify user every
monday. It uses a feedback loop mechanism to
personalize, optimize or automate the existing
service.
168. „H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S SMACHINE LEARNING WILL CHANGE CUSTOMER
PERSONAS FOREVER
Andre Smith, Digitalist Magazine / SAP
169. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Challenges for UX
Re-think customer personas
170. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Challenges for UX
Re-think customer personas
Thanks to machine learning, computers will soon know your
customers better than your customers know themselves.
• They’re much better at „guesswork“ than humans are
• More efficient targeting of new customers
• More cost-effective
171. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Challenges for UX
Create intuitive AI interfaces
172. „H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
THE FUTURE OF MACHINE LEARNING
IS COMING UP WITH A HYBRID LANGUAGE THAT
BRIDGES DESIGN AND ENGINEERING.
Caroline Sinders, Fast Company
173. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Challenges for UX
Make tons of data manageable
174. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Challenges for UX
Use data to be super-relevant or be silent
175. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Challenges for UX
Let users tell about poor information
176. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Challenges for UX
Let users tell about poor information
For example in banking, one could consider the temporal evolution of
account balances to segment savings behaviors. This type of
algorithms that leads to decision-making needs to learn to be more
precise.
It’s the designer’s job to find ways to let users tell implicitly or
explicitly about poor information.
178. „H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S SEVERY TIME I CHECK MY PHONE, I’M PLAYING
THE SLOT MACHINE
Tristan Harris, a former Google product manager
179. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Challenges for UX
Design for engagement responsibly
180. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Challenges for UX
Design for engagement responsibly
Today, algorithms typically score the relevance of social and news
content. Major online services are fighting to hook people, grab their
attention for as long as possible. Their business is to keep users
active as long and frequently as possible on their platforms. They use
techniques that promote addiction = hooking people endlessly
searching for the next reward.
That new power raises the need for new design principles in the age
of machine learning.
181. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Challenges for UX
Empathy is not (yet) available
182. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Challenges for UX
Empathy is not (yet) available
The ethical and practical considerations of machine learning
have to be shaped by how products using machine learning
affect users and how users can understand and see those
effects.
185. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Challenges for UX
Illustrate for transparency
186. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Challenges for UX
Illustrate for transparency
When users don’t understand how an algorithm gets its results,
it can be difficult to trust the system. Transparency
communicates trust.
187. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Challenges for UX
Seamful design
188. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Challenges for UX
Seamful design
Designers must know that a „Prediction Feature“ is not the
same as informing, and consider how well such a prediction
could support a user action.
189. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Challenges for UX
Machine bias: AI can lead to discrimination
190. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Challenges for UX
Machine bias: AI can lead to discrimination
Most of the current facial recognition techniques use the same
data set, which was trained on mainly white people. It would
not recognise people with other skintones.
191. „H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
ULTIMATELY,
DESIGNERS MUST ACT AS A BULWARK
AGAINST IRRESPONSIBLE,
UNETHICAL USE OF AI.
Katharine Schwab, Fast Company
192. H O W D E E P L E A R N I N G
C H A N G E S T H E
D E S I G N P R O C E S S
Principles for designing AI responsibly
• AI must be designed to assist humanity
• AI must be transparent
• AI must maximize efficiencies without destroying the dignity of people
• AI must be designed for intelligent privacy
• AI must have algorithmic accountability
• AI must guard against bias
Satya Nadella, Microsoft CEO