SlideShare a Scribd company logo
It looks like you’re trying to
make a user interface for AI.
Do you need assistance?
The UI of AI
Prof. Lydia Chilton
chilton@cs.columbia.edu
Computer Science Department
People interact with systems to accomplish a goal
Set the room temperatureSend an email Find information
Good technology is often invisible.
Technology is best when it helps users
achieve their goal without drawing attention
to the technology itself.
Technology that requires users to remember
low-level details and execute many functions
are difficult to use.
Bad AI Interfaces
Aggressive interfaces that the draw
attention to themselves. This causes
users to lose focus on their goal.
Making decisions for you with a poor
understanding of your goals and context.
Good AI interfaces are aligned with your goals
Spam Detection in your inbox
Spam detection in your inbox
(that you never notice)
So you focus on your emails tasks.
Text prediction in email,
Triggers automatically.
User accepts or rejects prediction
The default is to ignore it.
Object recognition on the phone
(for blind/low vision people)
Easy to pull out the phone and
snap a photo
Invisible Ask for confirmation Used out in the world,
in context
AI is about pattern recognition
Label data Predict data
Transform data
Now is the time to shape what goals
AI helps us accomplish
• How can AI help us? In the following examples of User Interfaces for
AI, think about how similar problems or solutions could be applied in
your domain.
• The more ideas the better. For every 20 ideas, one is probably
possible to do. Don’t get discouraged, just have more ideas. You never
know what is possible for institutions to implement.
• Share you ideas widely. Consider posting them on twitter, or a blog.
Contact local universities with students looking for programming
projects.
Interfaces that use labeling AI
Image labeling:
embedded in social networks,
Aligned with your goal,
Asks for confirmation
Text labeling:
Embedded in your inbox
Organizes email into:
spam, importance, reply?
Easy to dismiss or undo
Help you stay organized
Interfaces that use prediction AI
Predicting Images:
Take a photo and see yourself
projected 20 years older
(sell skin crème and retirement
planning)
Predicting Text:
Embedded in writing tasks.
UIs present conservative suggestions.
The default is to not accept them
Predicting Numbers:
Embedded in recommender systems,
And decision support software
(Ticket prices, criminal sentencing, offering loans)
Take a photo
You in 20
years
Help you made decisions
Interfaces that use data transformation AI
Images to Text Language -> language Voice to Text Numbers to Text
Mobile UI –
to translate where you are. Easy data entry. Turn data into
readable stories
Text is easier to process
than images.
Put data in the right format so you can use it.
AI applications on mobile, wearable, home and
vehicle platforms extend the contexts of use.
Home devices
Mobile
Driving assistance –
parking, directions, health/stress monitoring
Help you use achieve goals within a context
AI is imperfect. It needs people to guide it’s
application to real problems.
Carrie J. Cai, et al. 2019. Human Centered Tools for Coping with Imperfect Algorithms During Medical Decision
Making. CHI 2019.
Summary
People interact with systems to accomplish a goal
Set the room temperatureSend an email Find information
Good technology is often invisible.
Technology is best when it helps users
achieve their goal without drawing attention
to the technology itself.
Technology that requires users to remember
low-level details and execute many functions
are difficult to use.
Bad AI Interfaces draw attention to themselves
and away from the goal
Aggressive interfaces that the draw
attention to themselves. This causes
users to lose focus on their goal.
Making decisions for you with a poor
understanding of your goals and context.
Good AI interfaces are aligned with your goals
Spam Detection in your inbox
Spam detection in your inbox
(that you never notice)
So you focus on your emails tasks.
Text prediction in email,
Triggers automatically.
User accepts or rejects prediction
The default is to ignore it.
Object recognition on the phone
(for blind/low vision people)
Easy to pull out the phone and
snap a photo
Invisible Ask for confirmation Used out in the world,
in context
Now is the time to shape what goals
AI helps us accomplish
• How can AI help us? In the following examples of User Interfaces for
AI, think about how similar problems or solutions could be applied in
your domain.
• The more ideas the better. For every 20 ideas, one is probably
possible to do. Don’t get discouraged, just have more ideas. You never
know what is possible for institutions to implement.
• Share you ideas widely. Consider posting them on twitter, or a blog.
Contact local universities with students looking for programming
projects.
What goals can AI help people accomplish?
• What goals could be aided by pattern recognition:
• Cognition: organization, decision making, data formatting, searching data
• Task: labeling, predicting, or transforming data.
• User: Patients, technicians, doctors, nurses, administrators
• Location: Home, office, hospital, mobile
• Device: desktop, mobile, wearable, car, home
• What feedback do you need to guide it?

More Related Content

What's hot

Simplified Introduction to AI
Simplified Introduction to AISimplified Introduction to AI
Simplified Introduction to AI
Deepu S Nath
 
Responsible AI
Responsible AIResponsible AI
Responsible AI
Neo4j
 
Artificial Intelligence (AI).
Artificial Intelligence (AI).Artificial Intelligence (AI).
Artificial Intelligence (AI).
Tina Coffey
 
Captcha
CaptchaCaptcha
Captcha
Sumit Garg
 
Generative AI and Security (1).pptx.pdf
Generative AI and Security (1).pptx.pdfGenerative AI and Security (1).pptx.pdf
Generative AI and Security (1).pptx.pdf
Priyanka Aash
 
Conversational AI– Beyond the chatbot hype
 Conversational AI– Beyond the chatbot hype Conversational AI– Beyond the chatbot hype
Conversational AI– Beyond the chatbot hype
NUS-ISS
 
The Future is in Responsible Generative AI
The Future is in Responsible Generative AIThe Future is in Responsible Generative AI
The Future is in Responsible Generative AI
Saeed Al Dhaheri
 
Leveraging Generative AI & Best practices
Leveraging Generative AI & Best practicesLeveraging Generative AI & Best practices
Leveraging Generative AI & Best practices
DianaGray10
 
CAPTCHA
CAPTCHACAPTCHA
CAPTCHA
Dhruv Patel
 
KSIT Tech Form - Introduction to artificial intelligence (AI)
KSIT Tech Form - Introduction to artificial intelligence (AI)KSIT Tech Form - Introduction to artificial intelligence (AI)
KSIT Tech Form - Introduction to artificial intelligence (AI)
Santosh Kumar
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligence
dhruvsingh124
 
Responsible AI in Industry (ICML 2021 Tutorial)
Responsible AI in Industry (ICML 2021 Tutorial)Responsible AI in Industry (ICML 2021 Tutorial)
Responsible AI in Industry (ICML 2021 Tutorial)
Krishnaram Kenthapadi
 
Building AI Product using AI Product Thinking
Building AI Product using AI Product Thinking Building AI Product using AI Product Thinking
Building AI Product using AI Product Thinking
Saurabh Kaushik
 
Power Point Presentation on Artificial Intelligence and Cool Current Projects...
Power Point Presentation on Artificial Intelligence and Cool Current Projects...Power Point Presentation on Artificial Intelligence and Cool Current Projects...
Power Point Presentation on Artificial Intelligence and Cool Current Projects...
PuneetGautam6
 
Responsible AI in Industry: Practical Challenges and Lessons Learned
Responsible AI in Industry: Practical Challenges and Lessons LearnedResponsible AI in Industry: Practical Challenges and Lessons Learned
Responsible AI in Industry: Practical Challenges and Lessons Learned
Krishnaram Kenthapadi
 
Responsible AI
Responsible AIResponsible AI
Responsible AI
Data Con LA
 
Responsible AI in Industry (Tutorials at AAAI 2021, FAccT 2021, and WWW 2021)
Responsible AI in Industry (Tutorials at AAAI 2021, FAccT 2021, and WWW 2021)Responsible AI in Industry (Tutorials at AAAI 2021, FAccT 2021, and WWW 2021)
Responsible AI in Industry (Tutorials at AAAI 2021, FAccT 2021, and WWW 2021)
Krishnaram Kenthapadi
 
AI in Higher Education – Challenges & Opportunities #edlw2019
AI in Higher Education – Challenges & Opportunities #edlw2019AI in Higher Education – Challenges & Opportunities #edlw2019
AI in Higher Education – Challenges & Opportunities #edlw2019
EDEN Digital Learning Europe
 
Artificial Intelligence & Human Intelligence
Artificial Intelligence & Human Intelligence Artificial Intelligence & Human Intelligence
Artificial Intelligence & Human Intelligence
Himani Kashyap
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligence
Nitesh Kumar
 

What's hot (20)

Simplified Introduction to AI
Simplified Introduction to AISimplified Introduction to AI
Simplified Introduction to AI
 
Responsible AI
Responsible AIResponsible AI
Responsible AI
 
Artificial Intelligence (AI).
Artificial Intelligence (AI).Artificial Intelligence (AI).
Artificial Intelligence (AI).
 
Captcha
CaptchaCaptcha
Captcha
 
Generative AI and Security (1).pptx.pdf
Generative AI and Security (1).pptx.pdfGenerative AI and Security (1).pptx.pdf
Generative AI and Security (1).pptx.pdf
 
Conversational AI– Beyond the chatbot hype
 Conversational AI– Beyond the chatbot hype Conversational AI– Beyond the chatbot hype
Conversational AI– Beyond the chatbot hype
 
The Future is in Responsible Generative AI
The Future is in Responsible Generative AIThe Future is in Responsible Generative AI
The Future is in Responsible Generative AI
 
Leveraging Generative AI & Best practices
Leveraging Generative AI & Best practicesLeveraging Generative AI & Best practices
Leveraging Generative AI & Best practices
 
CAPTCHA
CAPTCHACAPTCHA
CAPTCHA
 
KSIT Tech Form - Introduction to artificial intelligence (AI)
KSIT Tech Form - Introduction to artificial intelligence (AI)KSIT Tech Form - Introduction to artificial intelligence (AI)
KSIT Tech Form - Introduction to artificial intelligence (AI)
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligence
 
Responsible AI in Industry (ICML 2021 Tutorial)
Responsible AI in Industry (ICML 2021 Tutorial)Responsible AI in Industry (ICML 2021 Tutorial)
Responsible AI in Industry (ICML 2021 Tutorial)
 
Building AI Product using AI Product Thinking
Building AI Product using AI Product Thinking Building AI Product using AI Product Thinking
Building AI Product using AI Product Thinking
 
Power Point Presentation on Artificial Intelligence and Cool Current Projects...
Power Point Presentation on Artificial Intelligence and Cool Current Projects...Power Point Presentation on Artificial Intelligence and Cool Current Projects...
Power Point Presentation on Artificial Intelligence and Cool Current Projects...
 
Responsible AI in Industry: Practical Challenges and Lessons Learned
Responsible AI in Industry: Practical Challenges and Lessons LearnedResponsible AI in Industry: Practical Challenges and Lessons Learned
Responsible AI in Industry: Practical Challenges and Lessons Learned
 
Responsible AI
Responsible AIResponsible AI
Responsible AI
 
Responsible AI in Industry (Tutorials at AAAI 2021, FAccT 2021, and WWW 2021)
Responsible AI in Industry (Tutorials at AAAI 2021, FAccT 2021, and WWW 2021)Responsible AI in Industry (Tutorials at AAAI 2021, FAccT 2021, and WWW 2021)
Responsible AI in Industry (Tutorials at AAAI 2021, FAccT 2021, and WWW 2021)
 
AI in Higher Education – Challenges & Opportunities #edlw2019
AI in Higher Education – Challenges & Opportunities #edlw2019AI in Higher Education – Challenges & Opportunities #edlw2019
AI in Higher Education – Challenges & Opportunities #edlw2019
 
Artificial Intelligence & Human Intelligence
Artificial Intelligence & Human Intelligence Artificial Intelligence & Human Intelligence
Artificial Intelligence & Human Intelligence
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligence
 

Similar to The User Interface of AI

Revolutionizing Social Media Marketing: The Role of Artificial Intelligence
Revolutionizing Social Media Marketing: The Role of Artificial IntelligenceRevolutionizing Social Media Marketing: The Role of Artificial Intelligence
Revolutionizing Social Media Marketing: The Role of Artificial Intelligence
JulioLopez260338
 
Top Artificial Intelligence Project Ideas.pdf
Top Artificial Intelligence Project Ideas.pdfTop Artificial Intelligence Project Ideas.pdf
Top Artificial Intelligence Project Ideas.pdf
Lucas Lagone
 
Area's of Artificial Inteligence .pptx
Area's of Artificial Inteligence .pptxArea's of Artificial Inteligence .pptx
Area's of Artificial Inteligence .pptx
JIMSVKII
 
Top And Best Digital Marketing Agency With AI
Top And Best Digital Marketing Agency With AITop And Best Digital Marketing Agency With AI
Top And Best Digital Marketing Agency With AI
amdigitalmark15
 
Mind Reading Computers Report
Mind Reading Computers ReportMind Reading Computers Report
Mind Reading Computers Report
Aman Raj
 
Artificial Intelligence: How to prepare yourself for the future
Artificial Intelligence: How to prepare yourself for the futureArtificial Intelligence: How to prepare yourself for the future
Artificial Intelligence: How to prepare yourself for the future
Folasade Adedeji
 
How to Use AI to Design Better Mobile App User Experience.pdf
How to Use AI to Design Better Mobile App User Experience.pdfHow to Use AI to Design Better Mobile App User Experience.pdf
How to Use AI to Design Better Mobile App User Experience.pdf
Parangat Technologies
 
Artificial Intelligence (AI) in Communication.pptx
Artificial Intelligence (AI) in Communication.pptxArtificial Intelligence (AI) in Communication.pptx
Artificial Intelligence (AI) in Communication.pptx
Dr.A.Prabaharan Professor & Research Director, Public Action
 
UNIT 1 IX (1) (1).pptx
UNIT 1 IX (1) (1).pptxUNIT 1 IX (1) (1).pptx
UNIT 1 IX (1) (1).pptx
siddhichaddha2
 
UNIT 1 IX (1) (2) (1).pptx
UNIT 1 IX (1) (2) (1).pptxUNIT 1 IX (1) (2) (1).pptx
UNIT 1 IX (1) (2) (1).pptx
siddhichaddha2
 
UNIT 1 IX (1) (2) (3).pptx
UNIT 1 IX (1) (2) (3).pptxUNIT 1 IX (1) (2) (3).pptx
UNIT 1 IX (1) (2) (3).pptx
siddhichaddha2
 
UNIT 1 IX (1) (2) (2).pptx
UNIT 1 IX (1) (2) (2).pptxUNIT 1 IX (1) (2) (2).pptx
UNIT 1 IX (1) (2) (2).pptx
siddhichaddha2
 
Unit-I Artificial IntelligencEGTRHe.pptx
Unit-I Artificial IntelligencEGTRHe.pptxUnit-I Artificial IntelligencEGTRHe.pptx
Unit-I Artificial IntelligencEGTRHe.pptx
shamam21bcom
 
Atharva latest
Atharva latestAtharva latest
Atharva latest
Dr. Sinora Banker
 
Online Personal Data Curation with Benevolent Intention & Safeguards
Online Personal Data Curation with Benevolent Intention & SafeguardsOnline Personal Data Curation with Benevolent Intention & Safeguards
Online Personal Data Curation with Benevolent Intention & Safeguards
Sandra Annette Rogers
 
THE PATH OF ARTIFICIAL INTELLIGENCE IN 2019
THE PATH OF ARTIFICIAL INTELLIGENCE IN 2019THE PATH OF ARTIFICIAL INTELLIGENCE IN 2019
THE PATH OF ARTIFICIAL INTELLIGENCE IN 2019
VARUN KESAVAN
 
Machine Learning Fundamentals.docx
Machine Learning Fundamentals.docxMachine Learning Fundamentals.docx
Machine Learning Fundamentals.docx
HaritvKrishnagiri
 
Ai in Society
Ai in SocietyAi in Society
Aritificial intelligence
Aritificial intelligenceAritificial intelligence
Aritificial intelligence
Dr. Jasmine Beulah Gnanadurai
 
HOW HUMAN-CENTRIC AI WILL TRANSFORM BUSINESS
HOW HUMAN-CENTRIC AI WILL TRANSFORM BUSINESSHOW HUMAN-CENTRIC AI WILL TRANSFORM BUSINESS
HOW HUMAN-CENTRIC AI WILL TRANSFORM BUSINESS
TekRevol LLC
 

Similar to The User Interface of AI (20)

Revolutionizing Social Media Marketing: The Role of Artificial Intelligence
Revolutionizing Social Media Marketing: The Role of Artificial IntelligenceRevolutionizing Social Media Marketing: The Role of Artificial Intelligence
Revolutionizing Social Media Marketing: The Role of Artificial Intelligence
 
Top Artificial Intelligence Project Ideas.pdf
Top Artificial Intelligence Project Ideas.pdfTop Artificial Intelligence Project Ideas.pdf
Top Artificial Intelligence Project Ideas.pdf
 
Area's of Artificial Inteligence .pptx
Area's of Artificial Inteligence .pptxArea's of Artificial Inteligence .pptx
Area's of Artificial Inteligence .pptx
 
Top And Best Digital Marketing Agency With AI
Top And Best Digital Marketing Agency With AITop And Best Digital Marketing Agency With AI
Top And Best Digital Marketing Agency With AI
 
Mind Reading Computers Report
Mind Reading Computers ReportMind Reading Computers Report
Mind Reading Computers Report
 
Artificial Intelligence: How to prepare yourself for the future
Artificial Intelligence: How to prepare yourself for the futureArtificial Intelligence: How to prepare yourself for the future
Artificial Intelligence: How to prepare yourself for the future
 
How to Use AI to Design Better Mobile App User Experience.pdf
How to Use AI to Design Better Mobile App User Experience.pdfHow to Use AI to Design Better Mobile App User Experience.pdf
How to Use AI to Design Better Mobile App User Experience.pdf
 
Artificial Intelligence (AI) in Communication.pptx
Artificial Intelligence (AI) in Communication.pptxArtificial Intelligence (AI) in Communication.pptx
Artificial Intelligence (AI) in Communication.pptx
 
UNIT 1 IX (1) (1).pptx
UNIT 1 IX (1) (1).pptxUNIT 1 IX (1) (1).pptx
UNIT 1 IX (1) (1).pptx
 
UNIT 1 IX (1) (2) (1).pptx
UNIT 1 IX (1) (2) (1).pptxUNIT 1 IX (1) (2) (1).pptx
UNIT 1 IX (1) (2) (1).pptx
 
UNIT 1 IX (1) (2) (3).pptx
UNIT 1 IX (1) (2) (3).pptxUNIT 1 IX (1) (2) (3).pptx
UNIT 1 IX (1) (2) (3).pptx
 
UNIT 1 IX (1) (2) (2).pptx
UNIT 1 IX (1) (2) (2).pptxUNIT 1 IX (1) (2) (2).pptx
UNIT 1 IX (1) (2) (2).pptx
 
Unit-I Artificial IntelligencEGTRHe.pptx
Unit-I Artificial IntelligencEGTRHe.pptxUnit-I Artificial IntelligencEGTRHe.pptx
Unit-I Artificial IntelligencEGTRHe.pptx
 
Atharva latest
Atharva latestAtharva latest
Atharva latest
 
Online Personal Data Curation with Benevolent Intention & Safeguards
Online Personal Data Curation with Benevolent Intention & SafeguardsOnline Personal Data Curation with Benevolent Intention & Safeguards
Online Personal Data Curation with Benevolent Intention & Safeguards
 
THE PATH OF ARTIFICIAL INTELLIGENCE IN 2019
THE PATH OF ARTIFICIAL INTELLIGENCE IN 2019THE PATH OF ARTIFICIAL INTELLIGENCE IN 2019
THE PATH OF ARTIFICIAL INTELLIGENCE IN 2019
 
Machine Learning Fundamentals.docx
Machine Learning Fundamentals.docxMachine Learning Fundamentals.docx
Machine Learning Fundamentals.docx
 
Ai in Society
Ai in SocietyAi in Society
Ai in Society
 
Aritificial intelligence
Aritificial intelligenceAritificial intelligence
Aritificial intelligence
 
HOW HUMAN-CENTRIC AI WILL TRANSFORM BUSINESS
HOW HUMAN-CENTRIC AI WILL TRANSFORM BUSINESSHOW HUMAN-CENTRIC AI WILL TRANSFORM BUSINESS
HOW HUMAN-CENTRIC AI WILL TRANSFORM BUSINESS
 

Recently uploaded

Observability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetryObservability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetry
Eric D. Schabell
 
Implementations of Fused Deposition Modeling in real world
Implementations of Fused Deposition Modeling  in real worldImplementations of Fused Deposition Modeling  in real world
Implementations of Fused Deposition Modeling in real world
Emerging Tech
 
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptxDublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Kunal Gupta
 
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Bert Blevins
 
Pigging Unit Lubricant Oil Blending Plant
Pigging Unit Lubricant Oil Blending PlantPigging Unit Lubricant Oil Blending Plant
Pigging Unit Lubricant Oil Blending Plant
LINUS PROJECTS (INDIA)
 
Calgary MuleSoft Meetup APM and IDP .pptx
Calgary MuleSoft Meetup APM and IDP .pptxCalgary MuleSoft Meetup APM and IDP .pptx
Calgary MuleSoft Meetup APM and IDP .pptx
ishalveerrandhawa1
 
Password Rotation in 2024 is still Relevant
Password Rotation in 2024 is still RelevantPassword Rotation in 2024 is still Relevant
Password Rotation in 2024 is still Relevant
Bert Blevins
 
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
Kief Morris
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
Adam Dunkels
 
“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...
“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...
“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...
Edge AI and Vision Alliance
 
Best Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdfBest Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdf
Tatiana Al-Chueyr
 
WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf
WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdfWhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf
WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf
ArgaBisma
 
Tirana Tech Meetup - Agentic RAG with Milvus, Llama3 and Ollama
Tirana Tech Meetup - Agentic RAG with Milvus, Llama3 and OllamaTirana Tech Meetup - Agentic RAG with Milvus, Llama3 and Ollama
Tirana Tech Meetup - Agentic RAG with Milvus, Llama3 and Ollama
Zilliz
 
Salesforce AI & Einstein Copilot Workshop
Salesforce AI & Einstein Copilot WorkshopSalesforce AI & Einstein Copilot Workshop
Salesforce AI & Einstein Copilot Workshop
CEPTES Software Inc
 
Applying Retrieval-Augmented Generation (RAG) to Combat Hallucinations in GenAI
Applying Retrieval-Augmented Generation (RAG) to Combat Hallucinations in GenAIApplying Retrieval-Augmented Generation (RAG) to Combat Hallucinations in GenAI
Applying Retrieval-Augmented Generation (RAG) to Combat Hallucinations in GenAI
ssuserd4e0d2
 
How to build a generative AI solution A step-by-step guide (2).pdf
How to build a generative AI solution A step-by-step guide (2).pdfHow to build a generative AI solution A step-by-step guide (2).pdf
How to build a generative AI solution A step-by-step guide (2).pdf
ChristopherTHyatt
 
(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf
(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf
(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf
Priyanka Aash
 
Use Cases & Benefits of RPA in Manufacturing in 2024.pptx
Use Cases & Benefits of RPA in Manufacturing in 2024.pptxUse Cases & Benefits of RPA in Manufacturing in 2024.pptx
Use Cases & Benefits of RPA in Manufacturing in 2024.pptx
SynapseIndia
 
High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...
High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...
High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...
bhumivarma35300
 
Comparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdfComparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdf
Andrey Yasko
 

Recently uploaded (20)

Observability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetryObservability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetry
 
Implementations of Fused Deposition Modeling in real world
Implementations of Fused Deposition Modeling  in real worldImplementations of Fused Deposition Modeling  in real world
Implementations of Fused Deposition Modeling in real world
 
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptxDublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
 
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
 
Pigging Unit Lubricant Oil Blending Plant
Pigging Unit Lubricant Oil Blending PlantPigging Unit Lubricant Oil Blending Plant
Pigging Unit Lubricant Oil Blending Plant
 
Calgary MuleSoft Meetup APM and IDP .pptx
Calgary MuleSoft Meetup APM and IDP .pptxCalgary MuleSoft Meetup APM and IDP .pptx
Calgary MuleSoft Meetup APM and IDP .pptx
 
Password Rotation in 2024 is still Relevant
Password Rotation in 2024 is still RelevantPassword Rotation in 2024 is still Relevant
Password Rotation in 2024 is still Relevant
 
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
 
“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...
“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...
“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...
 
Best Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdfBest Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdf
 
WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf
WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdfWhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf
WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf
 
Tirana Tech Meetup - Agentic RAG with Milvus, Llama3 and Ollama
Tirana Tech Meetup - Agentic RAG with Milvus, Llama3 and OllamaTirana Tech Meetup - Agentic RAG with Milvus, Llama3 and Ollama
Tirana Tech Meetup - Agentic RAG with Milvus, Llama3 and Ollama
 
Salesforce AI & Einstein Copilot Workshop
Salesforce AI & Einstein Copilot WorkshopSalesforce AI & Einstein Copilot Workshop
Salesforce AI & Einstein Copilot Workshop
 
Applying Retrieval-Augmented Generation (RAG) to Combat Hallucinations in GenAI
Applying Retrieval-Augmented Generation (RAG) to Combat Hallucinations in GenAIApplying Retrieval-Augmented Generation (RAG) to Combat Hallucinations in GenAI
Applying Retrieval-Augmented Generation (RAG) to Combat Hallucinations in GenAI
 
How to build a generative AI solution A step-by-step guide (2).pdf
How to build a generative AI solution A step-by-step guide (2).pdfHow to build a generative AI solution A step-by-step guide (2).pdf
How to build a generative AI solution A step-by-step guide (2).pdf
 
(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf
(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf
(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf
 
Use Cases & Benefits of RPA in Manufacturing in 2024.pptx
Use Cases & Benefits of RPA in Manufacturing in 2024.pptxUse Cases & Benefits of RPA in Manufacturing in 2024.pptx
Use Cases & Benefits of RPA in Manufacturing in 2024.pptx
 
High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...
High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...
High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...
 
Comparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdfComparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdf
 

The User Interface of AI

  • 1. It looks like you’re trying to make a user interface for AI. Do you need assistance? The UI of AI Prof. Lydia Chilton chilton@cs.columbia.edu Computer Science Department
  • 2. People interact with systems to accomplish a goal Set the room temperatureSend an email Find information
  • 3. Good technology is often invisible. Technology is best when it helps users achieve their goal without drawing attention to the technology itself. Technology that requires users to remember low-level details and execute many functions are difficult to use.
  • 4. Bad AI Interfaces Aggressive interfaces that the draw attention to themselves. This causes users to lose focus on their goal. Making decisions for you with a poor understanding of your goals and context.
  • 5. Good AI interfaces are aligned with your goals Spam Detection in your inbox Spam detection in your inbox (that you never notice) So you focus on your emails tasks. Text prediction in email, Triggers automatically. User accepts or rejects prediction The default is to ignore it. Object recognition on the phone (for blind/low vision people) Easy to pull out the phone and snap a photo Invisible Ask for confirmation Used out in the world, in context
  • 6. AI is about pattern recognition Label data Predict data Transform data
  • 7. Now is the time to shape what goals AI helps us accomplish • How can AI help us? In the following examples of User Interfaces for AI, think about how similar problems or solutions could be applied in your domain. • The more ideas the better. For every 20 ideas, one is probably possible to do. Don’t get discouraged, just have more ideas. You never know what is possible for institutions to implement. • Share you ideas widely. Consider posting them on twitter, or a blog. Contact local universities with students looking for programming projects.
  • 8. Interfaces that use labeling AI Image labeling: embedded in social networks, Aligned with your goal, Asks for confirmation Text labeling: Embedded in your inbox Organizes email into: spam, importance, reply? Easy to dismiss or undo Help you stay organized
  • 9. Interfaces that use prediction AI Predicting Images: Take a photo and see yourself projected 20 years older (sell skin crème and retirement planning) Predicting Text: Embedded in writing tasks. UIs present conservative suggestions. The default is to not accept them Predicting Numbers: Embedded in recommender systems, And decision support software (Ticket prices, criminal sentencing, offering loans) Take a photo You in 20 years Help you made decisions
  • 10. Interfaces that use data transformation AI Images to Text Language -> language Voice to Text Numbers to Text Mobile UI – to translate where you are. Easy data entry. Turn data into readable stories Text is easier to process than images. Put data in the right format so you can use it.
  • 11. AI applications on mobile, wearable, home and vehicle platforms extend the contexts of use. Home devices Mobile Driving assistance – parking, directions, health/stress monitoring Help you use achieve goals within a context
  • 12. AI is imperfect. It needs people to guide it’s application to real problems. Carrie J. Cai, et al. 2019. Human Centered Tools for Coping with Imperfect Algorithms During Medical Decision Making. CHI 2019.
  • 14. People interact with systems to accomplish a goal Set the room temperatureSend an email Find information
  • 15. Good technology is often invisible. Technology is best when it helps users achieve their goal without drawing attention to the technology itself. Technology that requires users to remember low-level details and execute many functions are difficult to use.
  • 16. Bad AI Interfaces draw attention to themselves and away from the goal Aggressive interfaces that the draw attention to themselves. This causes users to lose focus on their goal. Making decisions for you with a poor understanding of your goals and context.
  • 17. Good AI interfaces are aligned with your goals Spam Detection in your inbox Spam detection in your inbox (that you never notice) So you focus on your emails tasks. Text prediction in email, Triggers automatically. User accepts or rejects prediction The default is to ignore it. Object recognition on the phone (for blind/low vision people) Easy to pull out the phone and snap a photo Invisible Ask for confirmation Used out in the world, in context
  • 18. Now is the time to shape what goals AI helps us accomplish • How can AI help us? In the following examples of User Interfaces for AI, think about how similar problems or solutions could be applied in your domain. • The more ideas the better. For every 20 ideas, one is probably possible to do. Don’t get discouraged, just have more ideas. You never know what is possible for institutions to implement. • Share you ideas widely. Consider posting them on twitter, or a blog. Contact local universities with students looking for programming projects.
  • 19. What goals can AI help people accomplish? • What goals could be aided by pattern recognition: • Cognition: organization, decision making, data formatting, searching data • Task: labeling, predicting, or transforming data. • User: Patients, technicians, doctors, nurses, administrators • Location: Home, office, hospital, mobile • Device: desktop, mobile, wearable, car, home • What feedback do you need to guide it?

Editor's Notes

  1. Your goal is to have the right temperature in your house. Nest learns from you settings.
  2. These aid organiazation
  3. These help you make decisions
  4. Your goal is to have the right temperature in your house. Nest learns from you settings.