SlideShare a Scribd company logo
Humans to the Rescue: Troubleshooting
AI Systems with Human-in-the-loop
Ece Kamar
Senior Researcher, Microsoft Research AI
eckamar@microsoft.com
Exciting Times
AI and the Crowd
training data
accuracy
test data
Power of Data
[Banko&Brill, 2001]
In the Wild
In the Wild
Hybrid Intelligence
Human
Intelligence
AI Systems
AI Applied to Critical Domains
Power of the Hybrid
[Courtesy of Murray Campbell]
Troubleshooting of ML Systems
training data
accuracy
test data
query
system
response
execution
data
In the lab
In the wild
What is the performance in the wild?
How does the system fail?
Why does the system fail?
How the system can be improved?
Biases in ML
[Lakkaraju, K., Caruana, Horvitz; AAAI 2017]
Biases in ML
[Lakkaraju, K., Caruana, Horvitz; AAAI 2017]
Biases in ML
[Lakkaraju, K., Caruana, Horvitz; AAAI 2017]
Where do Blind Spots Come From?
M
cats
dogs
cat
(conf = 0.96)
Unknown unknowns: Data points with confident but incorrect predictions.
Blind-spots: Feature spaces with high concentration of unknown unknowns
Blind-spots Detection
execution data
Beat the Machine
[Attenberg, Ipeirotis, Provost, 2011]
Exploration of Unknown Unknowns
[Lakkaraju, K., Caruana, Horvitz, 2011]
Step 1:
Descriptive
Space
Partitioning
execution data
Step 2:
Multi-armed
Bandit
based
Exploration
Troubleshooting Complex Systems
Challenge
Possible fixes
for each
component
Limited development time
Where to invest
development time for
biggest impact?
Human-assisted troubleshooting methodology
system
outputComponent
1
Component
2
Component
3
I/OI/O
Evaluation
Failures
Fixes
[Nushi, K., Kossmann, Horvitz, 2011]
Complex Issues
Fairness Biases
TransparencyResponsibility
Good
vs. Bad
Policy & Law
Complex challenges
require collective efforts
No AI is perfect

More Related Content

Similar to Humans to the Rescue: Troubleshooting AI Systems with Human-in-the-loop

Deep Learning in the Real World
Deep Learning in the Real WorldDeep Learning in the Real World
Deep Learning in the Real World
Lukas Biewald
 
Responsible AI in Industry (ICML 2021 Tutorial)
Responsible AI in Industry (ICML 2021 Tutorial)Responsible AI in Industry (ICML 2021 Tutorial)
Responsible AI in Industry (ICML 2021 Tutorial)
Krishnaram Kenthapadi
 
ML basics.pptx
ML basics.pptxML basics.pptx
ML basics.pptx
PriyadharshiniG41
 
Machine Learning - Lecture2.pptx
Machine Learning - Lecture2.pptxMachine Learning - Lecture2.pptx
Machine Learning - Lecture2.pptx
NsitTech
 
Predictive analytics and big data tutorial
Predictive analytics and big data tutorial Predictive analytics and big data tutorial
Predictive analytics and big data tutorial
Benjamin Taylor
 
An Elementary Introduction to Artificial Intelligence, Data Science and Machi...
An Elementary Introduction to Artificial Intelligence, Data Science and Machi...An Elementary Introduction to Artificial Intelligence, Data Science and Machi...
An Elementary Introduction to Artificial Intelligence, Data Science and Machi...
Dozie Agbo
 
UKSG 2024 - Demystifying AI - Evaluating future uses and limits in library co...
UKSG 2024 - Demystifying AI - Evaluating future uses and limits in library co...UKSG 2024 - Demystifying AI - Evaluating future uses and limits in library co...
UKSG 2024 - Demystifying AI - Evaluating future uses and limits in library co...
UKSG: connecting the knowledge community
 
Machine Learning - Challenges, Learnings & Opportunities
Machine Learning - Challenges, Learnings & OpportunitiesMachine Learning - Challenges, Learnings & Opportunities
Machine Learning - Challenges, Learnings & Opportunities
CodePolitan
 
Robust Testing Strategies for Machine Learning Models
Robust Testing Strategies for Machine Learning Models Robust Testing Strategies for Machine Learning Models
Robust Testing Strategies for Machine Learning Models
Agile Testing Alliance
 
Machine Learning - Lecture1.pptx.pdf
Machine Learning - Lecture1.pptx.pdfMachine Learning - Lecture1.pptx.pdf
Machine Learning - Lecture1.pptx.pdf
NsitTech
 
Fairness and Privacy in AI/ML Systems
Fairness and Privacy in AI/ML SystemsFairness and Privacy in AI/ML Systems
Fairness and Privacy in AI/ML Systems
Krishnaram Kenthapadi
 
Machine learning-in-details-with-out-python-code
Machine learning-in-details-with-out-python-codeMachine learning-in-details-with-out-python-code
Machine learning-in-details-with-out-python-code
Osama Ghandour Geris
 
Performance Analysis of Supervised Machine Learning Techniques for Sentiment ...
Performance Analysis of Supervised Machine Learning Techniques for Sentiment ...Performance Analysis of Supervised Machine Learning Techniques for Sentiment ...
Performance Analysis of Supervised Machine Learning Techniques for Sentiment ...
Biswaranjan Samal
 
From Data to AI with the ML Canvas
From Data to AI with the ML CanvasFrom Data to AI with the ML Canvas
From Data to AI with the ML Canvas
Alexandra Petruș
 
Java one2016 con3054-watsonap-is
Java one2016 con3054-watsonap-isJava one2016 con3054-watsonap-is
Java one2016 con3054-watsonap-is
sandhya kapoor
 
Building Cognitive Applications with Watson APIs
Building Cognitive Applications with Watson APIs Building Cognitive Applications with Watson APIs
Building Cognitive Applications with Watson APIs
Dev_Events
 
Java one2016 con3054-watsonap-is
Java one2016 con3054-watsonap-isJava one2016 con3054-watsonap-is
Java one2016 con3054-watsonap-is
sandhya kapoor
 
Machine_Learning_with_MATLAB_Seminar_Latest.pdf
Machine_Learning_with_MATLAB_Seminar_Latest.pdfMachine_Learning_with_MATLAB_Seminar_Latest.pdf
Machine_Learning_with_MATLAB_Seminar_Latest.pdf
Carlos Paredes
 
Machine Learning Classifiers
Machine Learning ClassifiersMachine Learning Classifiers
Machine Learning Classifiers
Mostafa
 

Similar to Humans to the Rescue: Troubleshooting AI Systems with Human-in-the-loop (20)

Deep Learning in the Real World
Deep Learning in the Real WorldDeep Learning in the Real World
Deep Learning in the Real World
 
Responsible AI in Industry (ICML 2021 Tutorial)
Responsible AI in Industry (ICML 2021 Tutorial)Responsible AI in Industry (ICML 2021 Tutorial)
Responsible AI in Industry (ICML 2021 Tutorial)
 
ML basics.pptx
ML basics.pptxML basics.pptx
ML basics.pptx
 
Machine Learning - Lecture2.pptx
Machine Learning - Lecture2.pptxMachine Learning - Lecture2.pptx
Machine Learning - Lecture2.pptx
 
Predictive analytics and big data tutorial
Predictive analytics and big data tutorial Predictive analytics and big data tutorial
Predictive analytics and big data tutorial
 
An Elementary Introduction to Artificial Intelligence, Data Science and Machi...
An Elementary Introduction to Artificial Intelligence, Data Science and Machi...An Elementary Introduction to Artificial Intelligence, Data Science and Machi...
An Elementary Introduction to Artificial Intelligence, Data Science and Machi...
 
UKSG 2024 - Demystifying AI - Evaluating future uses and limits in library co...
UKSG 2024 - Demystifying AI - Evaluating future uses and limits in library co...UKSG 2024 - Demystifying AI - Evaluating future uses and limits in library co...
UKSG 2024 - Demystifying AI - Evaluating future uses and limits in library co...
 
Machine Learning - Challenges, Learnings & Opportunities
Machine Learning - Challenges, Learnings & OpportunitiesMachine Learning - Challenges, Learnings & Opportunities
Machine Learning - Challenges, Learnings & Opportunities
 
Robust Testing Strategies for Machine Learning Models
Robust Testing Strategies for Machine Learning Models Robust Testing Strategies for Machine Learning Models
Robust Testing Strategies for Machine Learning Models
 
Machine Learning - Lecture1.pptx.pdf
Machine Learning - Lecture1.pptx.pdfMachine Learning - Lecture1.pptx.pdf
Machine Learning - Lecture1.pptx.pdf
 
Features.pdf
Features.pdfFeatures.pdf
Features.pdf
 
Fairness and Privacy in AI/ML Systems
Fairness and Privacy in AI/ML SystemsFairness and Privacy in AI/ML Systems
Fairness and Privacy in AI/ML Systems
 
Machine learning-in-details-with-out-python-code
Machine learning-in-details-with-out-python-codeMachine learning-in-details-with-out-python-code
Machine learning-in-details-with-out-python-code
 
Performance Analysis of Supervised Machine Learning Techniques for Sentiment ...
Performance Analysis of Supervised Machine Learning Techniques for Sentiment ...Performance Analysis of Supervised Machine Learning Techniques for Sentiment ...
Performance Analysis of Supervised Machine Learning Techniques for Sentiment ...
 
From Data to AI with the ML Canvas
From Data to AI with the ML CanvasFrom Data to AI with the ML Canvas
From Data to AI with the ML Canvas
 
Java one2016 con3054-watsonap-is
Java one2016 con3054-watsonap-isJava one2016 con3054-watsonap-is
Java one2016 con3054-watsonap-is
 
Building Cognitive Applications with Watson APIs
Building Cognitive Applications with Watson APIs Building Cognitive Applications with Watson APIs
Building Cognitive Applications with Watson APIs
 
Java one2016 con3054-watsonap-is
Java one2016 con3054-watsonap-isJava one2016 con3054-watsonap-is
Java one2016 con3054-watsonap-is
 
Machine_Learning_with_MATLAB_Seminar_Latest.pdf
Machine_Learning_with_MATLAB_Seminar_Latest.pdfMachine_Learning_with_MATLAB_Seminar_Latest.pdf
Machine_Learning_with_MATLAB_Seminar_Latest.pdf
 
Machine Learning Classifiers
Machine Learning ClassifiersMachine Learning Classifiers
Machine Learning Classifiers
 

More from Crowdsourcing Week

Crowdsourcing à la sbv IMPROVER: the challenge of being your own client
Crowdsourcing à la sbv IMPROVER: the challenge of being your own clientCrowdsourcing à la sbv IMPROVER: the challenge of being your own client
Crowdsourcing à la sbv IMPROVER: the challenge of being your own client
Crowdsourcing Week
 
Transforming the Global Payments Operation
Transforming the Global Payments OperationTransforming the Global Payments Operation
Transforming the Global Payments Operation
Crowdsourcing Week
 
Crowdsourced to Outsourced: How online platforms are shaping the future of work
Crowdsourced to Outsourced: How online platforms are shaping the future of workCrowdsourced to Outsourced: How online platforms are shaping the future of work
Crowdsourced to Outsourced: How online platforms are shaping the future of work
Crowdsourcing Week
 
Malasya's Experience in Crowd Labour and Sharing Economy
Malasya's Experience in Crowd Labour and Sharing EconomyMalasya's Experience in Crowd Labour and Sharing Economy
Malasya's Experience in Crowd Labour and Sharing Economy
Crowdsourcing Week
 
LM Industries: Harnessing The Power of Crowdsourced Innovation to Build the F...
LM Industries: Harnessing The Power of Crowdsourced Innovation to Build the F...LM Industries: Harnessing The Power of Crowdsourced Innovation to Build the F...
LM Industries: Harnessing The Power of Crowdsourced Innovation to Build the F...
Crowdsourcing Week
 
Human Collective Intelligence: the future of corporate innovation
Human Collective Intelligence: the future of corporate innovationHuman Collective Intelligence: the future of corporate innovation
Human Collective Intelligence: the future of corporate innovation
Crowdsourcing Week
 
9 Ways to Ruin Your Open Innovation Challenge
9 Ways to Ruin Your Open Innovation Challenge9 Ways to Ruin Your Open Innovation Challenge
9 Ways to Ruin Your Open Innovation Challenge
Crowdsourcing Week
 
Disruptive Crowdsourcing
Disruptive CrowdsourcingDisruptive Crowdsourcing
Disruptive Crowdsourcing
Crowdsourcing Week
 
Accelerating Hardware Development: Ideation and Engineering
Accelerating Hardware Development: Ideation and EngineeringAccelerating Hardware Development: Ideation and Engineering
Accelerating Hardware Development: Ideation and Engineering
Crowdsourcing Week
 
Attracting and Retaining Top Partners with a Best-in-Class Payments Experience
Attracting and Retaining Top Partners with a Best-in-Class Payments ExperienceAttracting and Retaining Top Partners with a Best-in-Class Payments Experience
Attracting and Retaining Top Partners with a Best-in-Class Payments Experience
Crowdsourcing Week
 
Crowdsourcing Disaster Relief
Crowdsourcing Disaster ReliefCrowdsourcing Disaster Relief
Crowdsourcing Disaster Relief
Crowdsourcing Week
 
Core + Crowd: Why (and how) crowdsourcing is about to become mainstream
Core + Crowd: Why (and how) crowdsourcing is about to become mainstreamCore + Crowd: Why (and how) crowdsourcing is about to become mainstream
Core + Crowd: Why (and how) crowdsourcing is about to become mainstream
Crowdsourcing Week
 
Smart and Secure Cities and Communities
Smart and Secure Cities and Communities Smart and Secure Cities and Communities
Smart and Secure Cities and Communities
Crowdsourcing Week
 
How Successful Crowdsourcing Depends on asking 'Interesting Questions'
How Successful Crowdsourcing Depends on asking 'Interesting Questions'How Successful Crowdsourcing Depends on asking 'Interesting Questions'
How Successful Crowdsourcing Depends on asking 'Interesting Questions'
Crowdsourcing Week
 
Contestant Centered Design: creative approaches to designing competitions
Contestant Centered Design: creative approaches to designing competitionsContestant Centered Design: creative approaches to designing competitions
Contestant Centered Design: creative approaches to designing competitions
Crowdsourcing Week
 
How Crypto can Monetize Crowdsourcing
How Crypto can Monetize CrowdsourcingHow Crypto can Monetize Crowdsourcing
How Crypto can Monetize Crowdsourcing
Crowdsourcing Week
 
A New Report on the State of Open Innovation and What it Means For you
A New Report on the State of Open Innovation and What it Means For youA New Report on the State of Open Innovation and What it Means For you
A New Report on the State of Open Innovation and What it Means For you
Crowdsourcing Week
 
Expert Operating System: Business On-Demand
Expert Operating System: Business On-DemandExpert Operating System: Business On-Demand
Expert Operating System: Business On-Demand
Crowdsourcing Week
 
Crowdsourcing: Changing the Faces of Innovation at NASA
Crowdsourcing: Changing the Faces of Innovation at NASACrowdsourcing: Changing the Faces of Innovation at NASA
Crowdsourcing: Changing the Faces of Innovation at NASA
Crowdsourcing Week
 
Crowdfunding an ICO Without Getting In Trouble
Crowdfunding an ICO Without Getting In TroubleCrowdfunding an ICO Without Getting In Trouble
Crowdfunding an ICO Without Getting In Trouble
Crowdsourcing Week
 

More from Crowdsourcing Week (20)

Crowdsourcing à la sbv IMPROVER: the challenge of being your own client
Crowdsourcing à la sbv IMPROVER: the challenge of being your own clientCrowdsourcing à la sbv IMPROVER: the challenge of being your own client
Crowdsourcing à la sbv IMPROVER: the challenge of being your own client
 
Transforming the Global Payments Operation
Transforming the Global Payments OperationTransforming the Global Payments Operation
Transforming the Global Payments Operation
 
Crowdsourced to Outsourced: How online platforms are shaping the future of work
Crowdsourced to Outsourced: How online platforms are shaping the future of workCrowdsourced to Outsourced: How online platforms are shaping the future of work
Crowdsourced to Outsourced: How online platforms are shaping the future of work
 
Malasya's Experience in Crowd Labour and Sharing Economy
Malasya's Experience in Crowd Labour and Sharing EconomyMalasya's Experience in Crowd Labour and Sharing Economy
Malasya's Experience in Crowd Labour and Sharing Economy
 
LM Industries: Harnessing The Power of Crowdsourced Innovation to Build the F...
LM Industries: Harnessing The Power of Crowdsourced Innovation to Build the F...LM Industries: Harnessing The Power of Crowdsourced Innovation to Build the F...
LM Industries: Harnessing The Power of Crowdsourced Innovation to Build the F...
 
Human Collective Intelligence: the future of corporate innovation
Human Collective Intelligence: the future of corporate innovationHuman Collective Intelligence: the future of corporate innovation
Human Collective Intelligence: the future of corporate innovation
 
9 Ways to Ruin Your Open Innovation Challenge
9 Ways to Ruin Your Open Innovation Challenge9 Ways to Ruin Your Open Innovation Challenge
9 Ways to Ruin Your Open Innovation Challenge
 
Disruptive Crowdsourcing
Disruptive CrowdsourcingDisruptive Crowdsourcing
Disruptive Crowdsourcing
 
Accelerating Hardware Development: Ideation and Engineering
Accelerating Hardware Development: Ideation and EngineeringAccelerating Hardware Development: Ideation and Engineering
Accelerating Hardware Development: Ideation and Engineering
 
Attracting and Retaining Top Partners with a Best-in-Class Payments Experience
Attracting and Retaining Top Partners with a Best-in-Class Payments ExperienceAttracting and Retaining Top Partners with a Best-in-Class Payments Experience
Attracting and Retaining Top Partners with a Best-in-Class Payments Experience
 
Crowdsourcing Disaster Relief
Crowdsourcing Disaster ReliefCrowdsourcing Disaster Relief
Crowdsourcing Disaster Relief
 
Core + Crowd: Why (and how) crowdsourcing is about to become mainstream
Core + Crowd: Why (and how) crowdsourcing is about to become mainstreamCore + Crowd: Why (and how) crowdsourcing is about to become mainstream
Core + Crowd: Why (and how) crowdsourcing is about to become mainstream
 
Smart and Secure Cities and Communities
Smart and Secure Cities and Communities Smart and Secure Cities and Communities
Smart and Secure Cities and Communities
 
How Successful Crowdsourcing Depends on asking 'Interesting Questions'
How Successful Crowdsourcing Depends on asking 'Interesting Questions'How Successful Crowdsourcing Depends on asking 'Interesting Questions'
How Successful Crowdsourcing Depends on asking 'Interesting Questions'
 
Contestant Centered Design: creative approaches to designing competitions
Contestant Centered Design: creative approaches to designing competitionsContestant Centered Design: creative approaches to designing competitions
Contestant Centered Design: creative approaches to designing competitions
 
How Crypto can Monetize Crowdsourcing
How Crypto can Monetize CrowdsourcingHow Crypto can Monetize Crowdsourcing
How Crypto can Monetize Crowdsourcing
 
A New Report on the State of Open Innovation and What it Means For you
A New Report on the State of Open Innovation and What it Means For youA New Report on the State of Open Innovation and What it Means For you
A New Report on the State of Open Innovation and What it Means For you
 
Expert Operating System: Business On-Demand
Expert Operating System: Business On-DemandExpert Operating System: Business On-Demand
Expert Operating System: Business On-Demand
 
Crowdsourcing: Changing the Faces of Innovation at NASA
Crowdsourcing: Changing the Faces of Innovation at NASACrowdsourcing: Changing the Faces of Innovation at NASA
Crowdsourcing: Changing the Faces of Innovation at NASA
 
Crowdfunding an ICO Without Getting In Trouble
Crowdfunding an ICO Without Getting In TroubleCrowdfunding an ICO Without Getting In Trouble
Crowdfunding an ICO Without Getting In Trouble
 

Recently uploaded

Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
Adtran
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
KAMESHS29
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
名前 です男
 
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex ProofszkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
Alex Pruden
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Neo4j
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
RinaMondal9
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
sonjaschweigert1
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Nexer Digital
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
DianaGray10
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
SOFTTECHHUB
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Matthew Sinclair
 
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
SOFTTECHHUB
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 

Recently uploaded (20)

Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
 
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex ProofszkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
 
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 

Humans to the Rescue: Troubleshooting AI Systems with Human-in-the-loop