SlideShare a Scribd company logo
Algorithmic Transparency & Accountability in Practice
Do you use
any of these
platforms?
• Amazon
• Instagram
• Netflix
• Spotify
• …
News
• Google
• Bing
• Social media
• …
Interaction
time!
How many times have you noticed a coffee-related ad
on your newsfeed while having breakfast?
(Or similar experiences)
You can respond once.
This question is anonymous. No names will be
tracked.
https://pollev.com/oscaralvarad759
HCI
Research
Human-Computer Interaction
Questions of design
in a computerized world
ISO 9241-210
http://iso9241-210.blogspot.com/2010/04/iso-9241-210-on-ilmestynyt-korvaa-iso.html
Within the field of human computer interaction (HCI) and
design thinking, there has been a growing shift from what is
called user-centered design, where the end-user plays a
central but rather passive role, towards co-design or
participatory design, in which (end-)users are actively
involved in the design process
“
“
Sanders & Stappers (2012)
Research Goal
Explore design principles & guidelines
for algorithmic transparency
Topic:
News curation and recommendation in
social media feeds
Why together?
Legal - HCI
Research
• How to present their rights?
• How to make they real / effective?
How are users
receiving this
information?
What is missing?
What is the
platform
communicating?
Privacy
policy
Outcomes
Legal Experts
Co-design
Design
elements
Empirical surveys
1, 2 and 4
• Users’ perspective
• Attention to
– Algorithmic experience
(Alvarado & Waern 2018)
– Algorithmic imaginaries (Bucher 2017)
& folk theories(Eslami ea 2016)
– Returning voice & control
(Harambam ea 2018)
• How to complement
“right to explanation”
in design?
Approach
READ THE PRIVACY POLICY
User path in different devices
User path in different devices
• Summary of main points
• Table of content
• Icons
Language(s)
and formats
• Audiovisual explanations
• Expanding text layers
Language(s)
and formats
Personal Data
Personal Data(Sensitive)
Research
Techniques
Co-design
In practice:
Diary study
Workshop
Diary study
‘sensitizing activity’
Co-design Workshops
To leave room for creativity and freedom of thought whilst guiding the
participants in their creative process and ensuring useful results.
Co-design workshop
Relaxed, creative atmosphere
Mitigate social dynamics
(equal amounts of input and chances to talk)
Provide participants with necessary tools to be creative
Structured approach
Research
Techniques
Later stage:
Prototypes
Testing
Prototype
/ mock up
Alvarado & Waern (2018)
https://www.ttclabs.net/design/making-data-controls-more-human
CiTiP | Ingrid, Pierre, Jef, Aleksandra, Laurens
Mintlab | Elias, Luciana, Oscar, David
Thanks
Oscar Alvarado
Oscar.Alvarado@cs.kuleuven.be
Luciana Monteiro Krebs
Luciana.MonteiroKrebs@student.kuleuven.be

More Related Content

What's hot (6)

Introduction to Interaction Design
Introduction to Interaction DesignIntroduction to Interaction Design
Introduction to Interaction Design
 
ICS3211 Lecture 08 2020
ICS3211 Lecture 08 2020ICS3211 Lecture 08 2020
ICS3211 Lecture 08 2020
 
ICS3211 lecture 10
ICS3211 lecture 10ICS3211 lecture 10
ICS3211 lecture 10
 
ICT Tool Sharing
ICT Tool SharingICT Tool Sharing
ICT Tool Sharing
 
Crafting a Place for Interaction
Crafting a Place for InteractionCrafting a Place for Interaction
Crafting a Place for Interaction
 
AT Overview
AT OverviewAT Overview
AT Overview
 

Similar to 20190221 Algorithmic transparency and accountability in practice

Ucd Techniques - Shad MUN 2008
Ucd Techniques - Shad MUN 2008Ucd Techniques - Shad MUN 2008
Ucd Techniques - Shad MUN 2008
Patañjali Chary
 

Similar to 20190221 Algorithmic transparency and accountability in practice (20)

Open Source Design Pattern Library, Spreading Communities Thick: Open Source ...
Open Source Design Pattern Library, Spreading Communities Thick: Open Source ...Open Source Design Pattern Library, Spreading Communities Thick: Open Source ...
Open Source Design Pattern Library, Spreading Communities Thick: Open Source ...
 
EdMedia 2017 Outstanding Paper Award
EdMedia 2017 Outstanding Paper AwardEdMedia 2017 Outstanding Paper Award
EdMedia 2017 Outstanding Paper Award
 
Impact the UX of Your Website with Contextual Inquiry
Impact the UX of Your Website with Contextual InquiryImpact the UX of Your Website with Contextual Inquiry
Impact the UX of Your Website with Contextual Inquiry
 
Design Patterns as Guidance for Designers of Groupware Used by Team for the D...
Design Patterns as Guidance for Designers of Groupware Used by Team for the D...Design Patterns as Guidance for Designers of Groupware Used by Team for the D...
Design Patterns as Guidance for Designers of Groupware Used by Team for the D...
 
Interaction design: desiging user interfaces for digital products
Interaction design: desiging user interfaces for digital productsInteraction design: desiging user interfaces for digital products
Interaction design: desiging user interfaces for digital products
 
Creating Digital Learning Resources for Open Sharing
Creating Digital Learning Resources for Open SharingCreating Digital Learning Resources for Open Sharing
Creating Digital Learning Resources for Open Sharing
 
Composing the perfect research symphony – What are the key elements to conduc...
Composing the perfect research symphony – What are the key elements to conduc...Composing the perfect research symphony – What are the key elements to conduc...
Composing the perfect research symphony – What are the key elements to conduc...
 
Libraries as Enablers: Cultivating Contributors in the Age of Curation - Libe...
Libraries as Enablers: Cultivating Contributors in the Age of Curation - Libe...Libraries as Enablers: Cultivating Contributors in the Age of Curation - Libe...
Libraries as Enablers: Cultivating Contributors in the Age of Curation - Libe...
 
Rosenhan "User Research"
Rosenhan "User Research"Rosenhan "User Research"
Rosenhan "User Research"
 
Defense Ates Gursimsek Mutlimodal Semiotics and Collaborative Design
Defense Ates Gursimsek Mutlimodal Semiotics and Collaborative DesignDefense Ates Gursimsek Mutlimodal Semiotics and Collaborative Design
Defense Ates Gursimsek Mutlimodal Semiotics and Collaborative Design
 
ResearchOps Berlin Meetup #2 - UX Maturity - How to Grow User Research in you...
ResearchOps Berlin Meetup #2 - UX Maturity - How to Grow User Research in you...ResearchOps Berlin Meetup #2 - UX Maturity - How to Grow User Research in you...
ResearchOps Berlin Meetup #2 - UX Maturity - How to Grow User Research in you...
 
Curating an Effective Digital Research Presence - Nicola Osborne, EDINA
Curating an Effective Digital Research Presence - Nicola Osborne, EDINACurating an Effective Digital Research Presence - Nicola Osborne, EDINA
Curating an Effective Digital Research Presence - Nicola Osborne, EDINA
 
Requirements Engineering for the Humanities
Requirements Engineering for the HumanitiesRequirements Engineering for the Humanities
Requirements Engineering for the Humanities
 
Beyond Co-design. How open collaboration formats can enhance your design proc...
Beyond Co-design. How open collaboration formats can enhance your design proc...Beyond Co-design. How open collaboration formats can enhance your design proc...
Beyond Co-design. How open collaboration formats can enhance your design proc...
 
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
 
UCD Workshop - Shad MUN 2008
UCD Workshop - Shad MUN 2008UCD Workshop - Shad MUN 2008
UCD Workshop - Shad MUN 2008
 
Ucd Techniques - Shad MUN 2008
Ucd Techniques - Shad MUN 2008Ucd Techniques - Shad MUN 2008
Ucd Techniques - Shad MUN 2008
 
UX Design - Client presentation
UX Design - Client presentationUX Design - Client presentation
UX Design - Client presentation
 
HuggingFace AI - Hugging Face lets users create interactive, in-browser demos...
HuggingFace AI - Hugging Face lets users create interactive, in-browser demos...HuggingFace AI - Hugging Face lets users create interactive, in-browser demos...
HuggingFace AI - Hugging Face lets users create interactive, in-browser demos...
 
Co design-workshop
Co design-workshopCo design-workshop
Co design-workshop
 

More from Brussels Legal Hackers

20190528 - Guidelines for Trustworthy AI
20190528 - Guidelines for Trustworthy AI20190528 - Guidelines for Trustworthy AI
20190528 - Guidelines for Trustworthy AI
Brussels Legal Hackers
 
20190316 - CLBFest - Blockchain is WTF - Gerrie Smits
20190316 - CLBFest - Blockchain is WTF - Gerrie Smits20190316 - CLBFest - Blockchain is WTF - Gerrie Smits
20190316 - CLBFest - Blockchain is WTF - Gerrie Smits
Brussels Legal Hackers
 

More from Brussels Legal Hackers (20)

20190528 - Guidelines for Trustworthy AI
20190528 - Guidelines for Trustworthy AI20190528 - Guidelines for Trustworthy AI
20190528 - Guidelines for Trustworthy AI
 
20190423 PRiSE model to tackle data protection impact assessments and data pr...
20190423 PRiSE model to tackle data protection impact assessments and data pr...20190423 PRiSE model to tackle data protection impact assessments and data pr...
20190423 PRiSE model to tackle data protection impact assessments and data pr...
 
20190316 - CLBFest - Blockchain & the law - Willem Van de Wiele
20190316 - CLBFest - Blockchain & the law - Willem Van de Wiele20190316 - CLBFest - Blockchain & the law - Willem Van de Wiele
20190316 - CLBFest - Blockchain & the law - Willem Van de Wiele
 
20190316 - CLBFest - Blockchain is WTF - Gerrie Smits
20190316 - CLBFest - Blockchain is WTF - Gerrie Smits20190316 - CLBFest - Blockchain is WTF - Gerrie Smits
20190316 - CLBFest - Blockchain is WTF - Gerrie Smits
 
20190316 - CLBFest - 1337 to legal - Koen Vingerhoets
20190316 - CLBFest - 1337 to legal - Koen Vingerhoets20190316 - CLBFest - 1337 to legal - Koen Vingerhoets
20190316 - CLBFest - 1337 to legal - Koen Vingerhoets
 
20190316 - CLBFest - GDPR & Blockchain - Axel Beelen
20190316 - CLBFest - GDPR & Blockchain - Axel Beelen20190316 - CLBFest - GDPR & Blockchain - Axel Beelen
20190316 - CLBFest - GDPR & Blockchain - Axel Beelen
 
20190316 - CLBFest - Cryptocurrencies and tax - Hendrik Putman
20190316 - CLBFest - Cryptocurrencies and tax - Hendrik Putman20190316 - CLBFest - Cryptocurrencies and tax - Hendrik Putman
20190316 - CLBFest - Cryptocurrencies and tax - Hendrik Putman
 
20190221 Data subject rights in practice
20190221 Data subject rights in practice20190221 Data subject rights in practice
20190221 Data subject rights in practice
 
20180619 Controller-to-Processor agreements
20180619 Controller-to-Processor agreements20180619 Controller-to-Processor agreements
20180619 Controller-to-Processor agreements
 
20180607 - Tech Summit presentation
20180607 - Tech Summit presentation20180607 - Tech Summit presentation
20180607 - Tech Summit presentation
 
20180317 CLBfest 2018 - Trase
20180317 CLBfest 2018 - Trase20180317 CLBfest 2018 - Trase
20180317 CLBfest 2018 - Trase
 
20171108 IAPP Congress - Privacy by Design presentation
20171108 IAPP Congress - Privacy by Design presentation20171108 IAPP Congress - Privacy by Design presentation
20171108 IAPP Congress - Privacy by Design presentation
 
20171106 - Privacy Design Lab - LINDDUN
20171106 - Privacy Design Lab - LINDDUN20171106 - Privacy Design Lab - LINDDUN
20171106 - Privacy Design Lab - LINDDUN
 
20170601 - Digital festival presentation
20170601 - Digital festival presentation20170601 - Digital festival presentation
20170601 - Digital festival presentation
 
20170801 GDPR Q&A intro
20170801 GDPR Q&A intro20170801 GDPR Q&A intro
20170801 GDPR Q&A intro
 
20170620 MEETUP intro to blockchain and smart contracts (2)
20170620 MEETUP intro to blockchain and smart contracts (2)20170620 MEETUP intro to blockchain and smart contracts (2)
20170620 MEETUP intro to blockchain and smart contracts (2)
 
20170620 MEETUP smart contracts proof of concept for prescriptions
20170620 MEETUP smart contracts proof of concept for prescriptions20170620 MEETUP smart contracts proof of concept for prescriptions
20170620 MEETUP smart contracts proof of concept for prescriptions
 
20170620 MEETUP intro to blockchain and smart contracts (1)
20170620 MEETUP intro to blockchain and smart contracts (1)20170620 MEETUP intro to blockchain and smart contracts (1)
20170620 MEETUP intro to blockchain and smart contracts (1)
 
20170418 MEETUP on Creative Commons
20170418 MEETUP on Creative Commons20170418 MEETUP on Creative Commons
20170418 MEETUP on Creative Commons
 
20170122 MEETUP on autonomous vehicles
20170122 MEETUP on autonomous vehicles20170122 MEETUP on autonomous vehicles
20170122 MEETUP on autonomous vehicles
 

Recently uploaded

Recently uploaded (20)

Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
 
50 ĐỀ LUYỆN THI IOE LỚP 9 - NĂM HỌC 2022-2023 (CÓ LINK HÌNH, FILE AUDIO VÀ ĐÁ...
50 ĐỀ LUYỆN THI IOE LỚP 9 - NĂM HỌC 2022-2023 (CÓ LINK HÌNH, FILE AUDIO VÀ ĐÁ...50 ĐỀ LUYỆN THI IOE LỚP 9 - NĂM HỌC 2022-2023 (CÓ LINK HÌNH, FILE AUDIO VÀ ĐÁ...
50 ĐỀ LUYỆN THI IOE LỚP 9 - NĂM HỌC 2022-2023 (CÓ LINK HÌNH, FILE AUDIO VÀ ĐÁ...
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 
NCERT Solutions Power Sharing Class 10 Notes pdf
NCERT Solutions Power Sharing Class 10 Notes pdfNCERT Solutions Power Sharing Class 10 Notes pdf
NCERT Solutions Power Sharing Class 10 Notes pdf
 
Matatag-Curriculum and the 21st Century Skills Presentation.pptx
Matatag-Curriculum and the 21st Century Skills Presentation.pptxMatatag-Curriculum and the 21st Century Skills Presentation.pptx
Matatag-Curriculum and the 21st Century Skills Presentation.pptx
 
Fish and Chips - have they had their chips
Fish and Chips - have they had their chipsFish and Chips - have they had their chips
Fish and Chips - have they had their chips
 
Sectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdfSectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdf
 
The Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve ThomasonThe Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve Thomason
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
 
Home assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdfHome assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdf
 
Salient features of Environment protection Act 1986.pptx
Salient features of Environment protection Act 1986.pptxSalient features of Environment protection Act 1986.pptx
Salient features of Environment protection Act 1986.pptx
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
 
Benefits and Challenges of Using Open Educational Resources
Benefits and Challenges of Using Open Educational ResourcesBenefits and Challenges of Using Open Educational Resources
Benefits and Challenges of Using Open Educational Resources
 
The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
 
Palestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptxPalestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptx
 
PART A. Introduction to Costumer Service
PART A. Introduction to Costumer ServicePART A. Introduction to Costumer Service
PART A. Introduction to Costumer Service
 
NLC-2024-Orientation-for-RO-SDO (1).pptx
NLC-2024-Orientation-for-RO-SDO (1).pptxNLC-2024-Orientation-for-RO-SDO (1).pptx
NLC-2024-Orientation-for-RO-SDO (1).pptx
 
INU_CAPSTONEDESIGN_비밀번호486_업로드용 발표자료.pdf
INU_CAPSTONEDESIGN_비밀번호486_업로드용 발표자료.pdfINU_CAPSTONEDESIGN_비밀번호486_업로드용 발표자료.pdf
INU_CAPSTONEDESIGN_비밀번호486_업로드용 발표자료.pdf
 
Basic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumersBasic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumers
 

20190221 Algorithmic transparency and accountability in practice