SlideShare a Scribd company logo
1 of 32
Download to read offline
Research 
Large-Scale 
Evaluation of Call- 
Availability 
Prediction 
Martin Pielot, 
Telefónica Research 
ACM UbiComp’14, Sep, 2014, Seattle, USA 
Wed, Sep 17, 2014 – 14:00 – 15:30 
Session: Interruptability & Notifications 
"2007Computex e21Forum-MartinCooper" by 
Rico Shen. Via Wikimedia. CC-SA 3.0.
Phone calls reach us 
anywhere, 
anytime 
makelessnoise. Phon-ey Call. via Flickr, Jul 07, 2006 (CC BY 2.0)
30% 
of all calls 
are missed 
WilliamTheaker. Hamhung cyclist. via Wikipedia, Apr 17, 2012 (CC
Please raise hands: 
Who of you would take a call 
right now? 
Kaz. Hände. Via Pixabay, Nov 26, 2013. (Public Domain
Interruption!
Callers want to know: 
 Location and time, 
 physical, social, 
emotional availability, 
 and current activity. 
De Guzman et al. 2007 
"White Diamonds Party" by Club Skirts Dinah Shore Weekend - Own work. via Wikimedia Commons. CC BY-SA 
3.0 -
Callers want to know: 
 Location and time, 
 physical, social, 
emotional availability, 
 and current activity. 
De Guzman et al. 2007 
"White Diamonds Party" by Club Skirts Dinah Shore Weekend - Own work. via Wikimedia Commons. CC BY-SA 
3.0 - 
Callees react depend. 
on: 
 Location and time, 
 Presence of 
others, 
 and current activity. 
Danninger et al. 2006
People have concerns sharing too much 
contextual information Knittel et al. 2011 
"No trespassing" by Djuradj Vujcic - Own work. via Wikimedia Commons. CC BY-SA 
3.0.
Availability 
Location 
Time 
Presence of others 
Current Activity 
… 
Machine-Learning 
User Model 
…
Related Approaches 
Horvitz et al. 
2005 
Using calendar details from Outlook to 
predict cost of interruption by call
Related Approaches 
Horvitz et al. 
2005 
Using calendar details from Outlook to 
predict cost of interruption by call 
Rosenthal et 
al. 2011 
Use ESM to train phones to mute ringer in 
certain situations
Related Approaches 
Horvitz et al. 
2005 
Using calendar details from Outlook to 
predict cost of interruption by call 
Rosenthal et 
al. 2011 
Use ESM to train phones to mute ringer in 
certain situations 
Pejovic and 
Musolesi 2014 
Identifying opportune moments for mobile 
device-based interruptions
Opportunities to Advance Line of Work 
(1)Actual reaction 
(1) Sample selection & size
Study
On shake
Anonymous 
logs
Sep 17, 2014, 15:20 
Screen 
Status 
Reaction to 
the call 
Proximity 
Sensor 
Day and 
Time 
Ringer 
mode 
Charging
Results
31,311 calls 
from 418 distinct user
Extracted 15 Basic Features 
Category Feature 
Last Active Last ringer change (time) 
Last Active Last screen change (time) 
Last Active Last (un)plugged (time) 
Last Active Last call (time) 
Currently Active Screen status 
Currently Active Pitch of phone 
Relationship How often called by caller 
Context Day of the week 
Context Hour of the day 
Context Charger (un)plugged 
Context Ringer mode 
Context Last call silenced 
Context Activity / Acceleration 
Context Screen (not) covered 
Context Last call picked
Prediction 
Random Forest (10 trees) 
Classes: available | not available 
Accuracy 83.2% (κ=.646) 
(10-fold cross-validation)
19,175 calls picked up 
61.2% baseline 
accuracy
Advantages of large data set
Model accuracy over time 
85 
83 
81 
79 
77 
75 
73 
71 
Accuracy (%) 
Number of instances (phone calls)
Random Forest Model 
Personalized model 
Subset of 120 calls: 87.0% (κ=.640)
Features Ranked by Prediction Power 
Category Feature Mean Rank 
Last Active Last ringer change (time) 1 
Last Active Last screen change (time) 2 
Currently Active Screen status 3.6 
Last Active Last (un)plugged (time) 5.4 
Last Active Last call (time) 6.8 
Context Activity / Acceleration 7.3 
Relationship How often called by caller 7.6 
Context Day of the week 9.4 
Context Hour of the day 10 
Context Charger (un)plugged 10.1 
Context Ringer mode 11.4 
Context Last call silenced 12.4 
Currently Active Pitch of phone 12.5 
Context Screen (not) covered 13 
Context Last call picked 14.1
Application
Mute the ringer
Communicate 
Non-Availability
Communicate 
Non-Availability Likely to be 
unavailable
Large-Scale Evaluation of Call-Availalability Prediction. 
First large-scale study (31,311 calls) of call-availability 
prediction 
Prediction possible with 15 basic features 
83% accuracy (generic models) 
87% accuracy (personalized models) 
Strongest 5 predictors 
4 features regarding time of last activity 
Screen status 
Use cases 
Mute ringer on unavailability 
Allow caller to check availability 
Large-Scale 
Evaluation of Call- 
Availability 
Prediction 
Martin Pielot, 
Telefónica Research 
martin.pielot@telefonica.com 
ACM UbiComp’14, 
Sep, 2014, Seattle, USA 
Wed, Sep 17, 2014 – 14:00 – 
15:30 
Interruptability & Notifications 
Q&A

More Related Content

Similar to Large-Scale Evaluation of Call-Availability Prediction

Predictive Modeling of Human Behavior: Supervised Learning from Telecom Metad...
Predictive Modeling of Human Behavior: Supervised Learning from Telecom Metad...Predictive Modeling of Human Behavior: Supervised Learning from Telecom Metad...
Predictive Modeling of Human Behavior: Supervised Learning from Telecom Metad...Andrey Bogomolov
 
Aaai 2011 event processing tutorial
Aaai 2011 event processing tutorialAaai 2011 event processing tutorial
Aaai 2011 event processing tutorialOpher Etzion
 
Rocket City Keynote
Rocket City KeynoteRocket City Keynote
Rocket City KeynoteLearon Dalby
 
Satellite-based drought monitoring in Kenya in an operational setting
Satellite-based drought monitoring in Kenya in an operational settingSatellite-based drought monitoring in Kenya in an operational setting
Satellite-based drought monitoring in Kenya in an operational settingILRI
 
Debs 2010 context based computing tutorial
Debs 2010 context based computing tutorialDebs 2010 context based computing tutorial
Debs 2010 context based computing tutorialOpher Etzion
 
hsd-faculty-lunch-jan06
hsd-faculty-lunch-jan06hsd-faculty-lunch-jan06
hsd-faculty-lunch-jan06webuploader
 
The path to personalized, on-device virtual assistant
The path to personalized, on-device virtual assistantThe path to personalized, on-device virtual assistant
The path to personalized, on-device virtual assistantQualcomm Research
 
Subword and spatiotemporal models for identifying actionable information in ...
Subword and spatiotemporal models for identifying actionable information in ...Subword and spatiotemporal models for identifying actionable information in ...
Subword and spatiotemporal models for identifying actionable information in ...Robert Munro
 
A cognitive psychologist's approach to data mining
A cognitive psychologist's approach to data miningA cognitive psychologist's approach to data mining
A cognitive psychologist's approach to data miningmaggiexyz
 
Mobile Phone Instruments, the Possibilities of Networks, and OSC
Mobile Phone Instruments, the Possibilities of Networks, and OSCMobile Phone Instruments, the Possibilities of Networks, and OSC
Mobile Phone Instruments, the Possibilities of Networks, and OSCNathanBowen8
 
Understanding and Supporting Mobile Application Usage
Understanding and Supporting Mobile Application UsageUnderstanding and Supporting Mobile Application Usage
Understanding and Supporting Mobile Application UsageMatthias Böhmer
 
UH Professor Arthur Weglein's M-OSRP Annual Report, 2013
UH Professor Arthur Weglein's M-OSRP Annual Report, 2013UH Professor Arthur Weglein's M-OSRP Annual Report, 2013
UH Professor Arthur Weglein's M-OSRP Annual Report, 2013Arthur Weglein
 
Daily Happiness Recognition from Mobile Phone Data
Daily Happiness Recognition from Mobile Phone DataDaily Happiness Recognition from Mobile Phone Data
Daily Happiness Recognition from Mobile Phone DataAndrey Bogomolov
 
Semantics in Sensor Networks
Semantics in Sensor NetworksSemantics in Sensor Networks
Semantics in Sensor NetworksOscar Corcho
 
Machine Learning for Societal Applications
Machine Learning for Societal ApplicationsMachine Learning for Societal Applications
Machine Learning for Societal ApplicationsDavid Lary
 
Tech Jam 2015: Agenda
Tech Jam 2015: Agenda Tech Jam 2015: Agenda
Tech Jam 2015: Agenda US-Ignite
 
The emergent opportunity of Big Data for Social Good - Nuria Oliver @ PAPIs C...
The emergent opportunity of Big Data for Social Good - Nuria Oliver @ PAPIs C...The emergent opportunity of Big Data for Social Good - Nuria Oliver @ PAPIs C...
The emergent opportunity of Big Data for Social Good - Nuria Oliver @ PAPIs C...PAPIs.io
 
Open data & crowdsourcing of environmental observations in MMEA
Open data & crowdsourcing of environmental observations in MMEA Open data & crowdsourcing of environmental observations in MMEA
Open data & crowdsourcing of environmental observations in MMEA CLIC Innovation Ltd
 

Similar to Large-Scale Evaluation of Call-Availability Prediction (20)

Predictive Modeling of Human Behavior: Supervised Learning from Telecom Metad...
Predictive Modeling of Human Behavior: Supervised Learning from Telecom Metad...Predictive Modeling of Human Behavior: Supervised Learning from Telecom Metad...
Predictive Modeling of Human Behavior: Supervised Learning from Telecom Metad...
 
On Stream Reasoning
On Stream ReasoningOn Stream Reasoning
On Stream Reasoning
 
Aaai 2011 event processing tutorial
Aaai 2011 event processing tutorialAaai 2011 event processing tutorial
Aaai 2011 event processing tutorial
 
Rocket City Keynote
Rocket City KeynoteRocket City Keynote
Rocket City Keynote
 
Satellite-based drought monitoring in Kenya in an operational setting
Satellite-based drought monitoring in Kenya in an operational settingSatellite-based drought monitoring in Kenya in an operational setting
Satellite-based drought monitoring in Kenya in an operational setting
 
Debs 2010 context based computing tutorial
Debs 2010 context based computing tutorialDebs 2010 context based computing tutorial
Debs 2010 context based computing tutorial
 
hsd-faculty-lunch-jan06
hsd-faculty-lunch-jan06hsd-faculty-lunch-jan06
hsd-faculty-lunch-jan06
 
The path to personalized, on-device virtual assistant
The path to personalized, on-device virtual assistantThe path to personalized, on-device virtual assistant
The path to personalized, on-device virtual assistant
 
Subword and spatiotemporal models for identifying actionable information in ...
Subword and spatiotemporal models for identifying actionable information in ...Subword and spatiotemporal models for identifying actionable information in ...
Subword and spatiotemporal models for identifying actionable information in ...
 
A cognitive psychologist's approach to data mining
A cognitive psychologist's approach to data miningA cognitive psychologist's approach to data mining
A cognitive psychologist's approach to data mining
 
Mobile Phone Instruments, the Possibilities of Networks, and OSC
Mobile Phone Instruments, the Possibilities of Networks, and OSCMobile Phone Instruments, the Possibilities of Networks, and OSC
Mobile Phone Instruments, the Possibilities of Networks, and OSC
 
Understanding and Supporting Mobile Application Usage
Understanding and Supporting Mobile Application UsageUnderstanding and Supporting Mobile Application Usage
Understanding and Supporting Mobile Application Usage
 
UH Professor Arthur Weglein's M-OSRP Annual Report, 2013
UH Professor Arthur Weglein's M-OSRP Annual Report, 2013UH Professor Arthur Weglein's M-OSRP Annual Report, 2013
UH Professor Arthur Weglein's M-OSRP Annual Report, 2013
 
Daily Happiness Recognition from Mobile Phone Data
Daily Happiness Recognition from Mobile Phone DataDaily Happiness Recognition from Mobile Phone Data
Daily Happiness Recognition from Mobile Phone Data
 
Semantics in Sensor Networks
Semantics in Sensor NetworksSemantics in Sensor Networks
Semantics in Sensor Networks
 
Machine Learning for Societal Applications
Machine Learning for Societal ApplicationsMachine Learning for Societal Applications
Machine Learning for Societal Applications
 
Goal andga oct01
Goal andga oct01Goal andga oct01
Goal andga oct01
 
Tech Jam 2015: Agenda
Tech Jam 2015: Agenda Tech Jam 2015: Agenda
Tech Jam 2015: Agenda
 
The emergent opportunity of Big Data for Social Good - Nuria Oliver @ PAPIs C...
The emergent opportunity of Big Data for Social Good - Nuria Oliver @ PAPIs C...The emergent opportunity of Big Data for Social Good - Nuria Oliver @ PAPIs C...
The emergent opportunity of Big Data for Social Good - Nuria Oliver @ PAPIs C...
 
Open data & crowdsourcing of environmental observations in MMEA
Open data & crowdsourcing of environmental observations in MMEA Open data & crowdsourcing of environmental observations in MMEA
Open data & crowdsourcing of environmental observations in MMEA
 

Recently uploaded

Q4-Mod-1c-Quiz-Projectile-333344444.pptx
Q4-Mod-1c-Quiz-Projectile-333344444.pptxQ4-Mod-1c-Quiz-Projectile-333344444.pptx
Q4-Mod-1c-Quiz-Projectile-333344444.pptxtuking87
 
Abnormal LFTs rate of deco and NAFLD.pptx
Abnormal LFTs rate of deco and NAFLD.pptxAbnormal LFTs rate of deco and NAFLD.pptx
Abnormal LFTs rate of deco and NAFLD.pptxzeus70441
 
Charateristics of the Angara-A5 spacecraft launched from the Vostochny Cosmod...
Charateristics of the Angara-A5 spacecraft launched from the Vostochny Cosmod...Charateristics of the Angara-A5 spacecraft launched from the Vostochny Cosmod...
Charateristics of the Angara-A5 spacecraft launched from the Vostochny Cosmod...Christina Parmionova
 
Environmental Acoustics- Speech interference level, acoustics calibrator.pptx
Environmental Acoustics- Speech interference level, acoustics calibrator.pptxEnvironmental Acoustics- Speech interference level, acoustics calibrator.pptx
Environmental Acoustics- Speech interference level, acoustics calibrator.pptxpriyankatabhane
 
Observation of Gravitational Waves from the Coalescence of a 2.5–4.5 M⊙ Compa...
Observation of Gravitational Waves from the Coalescence of a 2.5–4.5 M⊙ Compa...Observation of Gravitational Waves from the Coalescence of a 2.5–4.5 M⊙ Compa...
Observation of Gravitational Waves from the Coalescence of a 2.5–4.5 M⊙ Compa...Sérgio Sacani
 
Unveiling the Cannabis Plant’s Potential
Unveiling the Cannabis Plant’s PotentialUnveiling the Cannabis Plant’s Potential
Unveiling the Cannabis Plant’s PotentialMarkus Roggen
 
BACTERIAL DEFENSE SYSTEM by Dr. Chayanika Das
BACTERIAL DEFENSE SYSTEM by Dr. Chayanika DasBACTERIAL DEFENSE SYSTEM by Dr. Chayanika Das
BACTERIAL DEFENSE SYSTEM by Dr. Chayanika DasChayanika Das
 
Introduction of Human Body & Structure of cell.pptx
Introduction of Human Body & Structure of cell.pptxIntroduction of Human Body & Structure of cell.pptx
Introduction of Human Body & Structure of cell.pptxMedical College
 
Combining Asynchronous Task Parallelism and Intel SGX for Secure Deep Learning
Combining Asynchronous Task Parallelism and Intel SGX for Secure Deep LearningCombining Asynchronous Task Parallelism and Intel SGX for Secure Deep Learning
Combining Asynchronous Task Parallelism and Intel SGX for Secure Deep Learningvschiavoni
 
linear Regression, multiple Regression and Annova
linear Regression, multiple Regression and Annovalinear Regression, multiple Regression and Annova
linear Regression, multiple Regression and AnnovaMansi Rastogi
 
GENERAL PHYSICS 2 REFRACTION OF LIGHT SENIOR HIGH SCHOOL GENPHYS2.pptx
GENERAL PHYSICS 2 REFRACTION OF LIGHT SENIOR HIGH SCHOOL GENPHYS2.pptxGENERAL PHYSICS 2 REFRACTION OF LIGHT SENIOR HIGH SCHOOL GENPHYS2.pptx
GENERAL PHYSICS 2 REFRACTION OF LIGHT SENIOR HIGH SCHOOL GENPHYS2.pptxRitchAndruAgustin
 
EGYPTIAN IMPRINT IN SPAIN Lecture by Dr Abeer Zahana
EGYPTIAN IMPRINT IN SPAIN Lecture by Dr Abeer ZahanaEGYPTIAN IMPRINT IN SPAIN Lecture by Dr Abeer Zahana
EGYPTIAN IMPRINT IN SPAIN Lecture by Dr Abeer ZahanaDr.Mahmoud Abbas
 
The Sensory Organs, Anatomy and Function
The Sensory Organs, Anatomy and FunctionThe Sensory Organs, Anatomy and Function
The Sensory Organs, Anatomy and FunctionJadeNovelo1
 
complex analysis best book for solving questions.pdf
complex analysis best book for solving questions.pdfcomplex analysis best book for solving questions.pdf
complex analysis best book for solving questions.pdfSubhamKumar3239
 
CHROMATOGRAPHY PALLAVI RAWAT.pptx
CHROMATOGRAPHY  PALLAVI RAWAT.pptxCHROMATOGRAPHY  PALLAVI RAWAT.pptx
CHROMATOGRAPHY PALLAVI RAWAT.pptxpallavirawat456
 
Probability.pptx, Types of Probability, UG
Probability.pptx, Types of Probability, UGProbability.pptx, Types of Probability, UG
Probability.pptx, Types of Probability, UGSoniaBajaj10
 

Recently uploaded (20)

Q4-Mod-1c-Quiz-Projectile-333344444.pptx
Q4-Mod-1c-Quiz-Projectile-333344444.pptxQ4-Mod-1c-Quiz-Projectile-333344444.pptx
Q4-Mod-1c-Quiz-Projectile-333344444.pptx
 
Abnormal LFTs rate of deco and NAFLD.pptx
Abnormal LFTs rate of deco and NAFLD.pptxAbnormal LFTs rate of deco and NAFLD.pptx
Abnormal LFTs rate of deco and NAFLD.pptx
 
Charateristics of the Angara-A5 spacecraft launched from the Vostochny Cosmod...
Charateristics of the Angara-A5 spacecraft launched from the Vostochny Cosmod...Charateristics of the Angara-A5 spacecraft launched from the Vostochny Cosmod...
Charateristics of the Angara-A5 spacecraft launched from the Vostochny Cosmod...
 
Environmental Acoustics- Speech interference level, acoustics calibrator.pptx
Environmental Acoustics- Speech interference level, acoustics calibrator.pptxEnvironmental Acoustics- Speech interference level, acoustics calibrator.pptx
Environmental Acoustics- Speech interference level, acoustics calibrator.pptx
 
Observation of Gravitational Waves from the Coalescence of a 2.5–4.5 M⊙ Compa...
Observation of Gravitational Waves from the Coalescence of a 2.5–4.5 M⊙ Compa...Observation of Gravitational Waves from the Coalescence of a 2.5–4.5 M⊙ Compa...
Observation of Gravitational Waves from the Coalescence of a 2.5–4.5 M⊙ Compa...
 
Ultrastructure and functions of Chloroplast.pptx
Ultrastructure and functions of Chloroplast.pptxUltrastructure and functions of Chloroplast.pptx
Ultrastructure and functions of Chloroplast.pptx
 
Unveiling the Cannabis Plant’s Potential
Unveiling the Cannabis Plant’s PotentialUnveiling the Cannabis Plant’s Potential
Unveiling the Cannabis Plant’s Potential
 
AZOTOBACTER AS BIOFERILIZER.PPTX
AZOTOBACTER AS BIOFERILIZER.PPTXAZOTOBACTER AS BIOFERILIZER.PPTX
AZOTOBACTER AS BIOFERILIZER.PPTX
 
BACTERIAL DEFENSE SYSTEM by Dr. Chayanika Das
BACTERIAL DEFENSE SYSTEM by Dr. Chayanika DasBACTERIAL DEFENSE SYSTEM by Dr. Chayanika Das
BACTERIAL DEFENSE SYSTEM by Dr. Chayanika Das
 
Introduction of Human Body & Structure of cell.pptx
Introduction of Human Body & Structure of cell.pptxIntroduction of Human Body & Structure of cell.pptx
Introduction of Human Body & Structure of cell.pptx
 
Combining Asynchronous Task Parallelism and Intel SGX for Secure Deep Learning
Combining Asynchronous Task Parallelism and Intel SGX for Secure Deep LearningCombining Asynchronous Task Parallelism and Intel SGX for Secure Deep Learning
Combining Asynchronous Task Parallelism and Intel SGX for Secure Deep Learning
 
linear Regression, multiple Regression and Annova
linear Regression, multiple Regression and Annovalinear Regression, multiple Regression and Annova
linear Regression, multiple Regression and Annova
 
Let’s Say Someone Did Drop the Bomb. Then What?
Let’s Say Someone Did Drop the Bomb. Then What?Let’s Say Someone Did Drop the Bomb. Then What?
Let’s Say Someone Did Drop the Bomb. Then What?
 
PLASMODIUM. PPTX
PLASMODIUM. PPTXPLASMODIUM. PPTX
PLASMODIUM. PPTX
 
GENERAL PHYSICS 2 REFRACTION OF LIGHT SENIOR HIGH SCHOOL GENPHYS2.pptx
GENERAL PHYSICS 2 REFRACTION OF LIGHT SENIOR HIGH SCHOOL GENPHYS2.pptxGENERAL PHYSICS 2 REFRACTION OF LIGHT SENIOR HIGH SCHOOL GENPHYS2.pptx
GENERAL PHYSICS 2 REFRACTION OF LIGHT SENIOR HIGH SCHOOL GENPHYS2.pptx
 
EGYPTIAN IMPRINT IN SPAIN Lecture by Dr Abeer Zahana
EGYPTIAN IMPRINT IN SPAIN Lecture by Dr Abeer ZahanaEGYPTIAN IMPRINT IN SPAIN Lecture by Dr Abeer Zahana
EGYPTIAN IMPRINT IN SPAIN Lecture by Dr Abeer Zahana
 
The Sensory Organs, Anatomy and Function
The Sensory Organs, Anatomy and FunctionThe Sensory Organs, Anatomy and Function
The Sensory Organs, Anatomy and Function
 
complex analysis best book for solving questions.pdf
complex analysis best book for solving questions.pdfcomplex analysis best book for solving questions.pdf
complex analysis best book for solving questions.pdf
 
CHROMATOGRAPHY PALLAVI RAWAT.pptx
CHROMATOGRAPHY  PALLAVI RAWAT.pptxCHROMATOGRAPHY  PALLAVI RAWAT.pptx
CHROMATOGRAPHY PALLAVI RAWAT.pptx
 
Probability.pptx, Types of Probability, UG
Probability.pptx, Types of Probability, UGProbability.pptx, Types of Probability, UG
Probability.pptx, Types of Probability, UG
 

Large-Scale Evaluation of Call-Availability Prediction

  • 1. Research Large-Scale Evaluation of Call- Availability Prediction Martin Pielot, Telefónica Research ACM UbiComp’14, Sep, 2014, Seattle, USA Wed, Sep 17, 2014 – 14:00 – 15:30 Session: Interruptability & Notifications "2007Computex e21Forum-MartinCooper" by Rico Shen. Via Wikimedia. CC-SA 3.0.
  • 2. Phone calls reach us anywhere, anytime makelessnoise. Phon-ey Call. via Flickr, Jul 07, 2006 (CC BY 2.0)
  • 3. 30% of all calls are missed WilliamTheaker. Hamhung cyclist. via Wikipedia, Apr 17, 2012 (CC
  • 4. Please raise hands: Who of you would take a call right now? Kaz. Hände. Via Pixabay, Nov 26, 2013. (Public Domain
  • 6. Callers want to know:  Location and time,  physical, social, emotional availability,  and current activity. De Guzman et al. 2007 "White Diamonds Party" by Club Skirts Dinah Shore Weekend - Own work. via Wikimedia Commons. CC BY-SA 3.0 -
  • 7. Callers want to know:  Location and time,  physical, social, emotional availability,  and current activity. De Guzman et al. 2007 "White Diamonds Party" by Club Skirts Dinah Shore Weekend - Own work. via Wikimedia Commons. CC BY-SA 3.0 - Callees react depend. on:  Location and time,  Presence of others,  and current activity. Danninger et al. 2006
  • 8. People have concerns sharing too much contextual information Knittel et al. 2011 "No trespassing" by Djuradj Vujcic - Own work. via Wikimedia Commons. CC BY-SA 3.0.
  • 9. Availability Location Time Presence of others Current Activity … Machine-Learning User Model …
  • 10. Related Approaches Horvitz et al. 2005 Using calendar details from Outlook to predict cost of interruption by call
  • 11. Related Approaches Horvitz et al. 2005 Using calendar details from Outlook to predict cost of interruption by call Rosenthal et al. 2011 Use ESM to train phones to mute ringer in certain situations
  • 12. Related Approaches Horvitz et al. 2005 Using calendar details from Outlook to predict cost of interruption by call Rosenthal et al. 2011 Use ESM to train phones to mute ringer in certain situations Pejovic and Musolesi 2014 Identifying opportune moments for mobile device-based interruptions
  • 13. Opportunities to Advance Line of Work (1)Actual reaction (1) Sample selection & size
  • 14. Study
  • 15.
  • 18. Sep 17, 2014, 15:20 Screen Status Reaction to the call Proximity Sensor Day and Time Ringer mode Charging
  • 20. 31,311 calls from 418 distinct user
  • 21. Extracted 15 Basic Features Category Feature Last Active Last ringer change (time) Last Active Last screen change (time) Last Active Last (un)plugged (time) Last Active Last call (time) Currently Active Screen status Currently Active Pitch of phone Relationship How often called by caller Context Day of the week Context Hour of the day Context Charger (un)plugged Context Ringer mode Context Last call silenced Context Activity / Acceleration Context Screen (not) covered Context Last call picked
  • 22. Prediction Random Forest (10 trees) Classes: available | not available Accuracy 83.2% (κ=.646) (10-fold cross-validation)
  • 23. 19,175 calls picked up 61.2% baseline accuracy
  • 25. Model accuracy over time 85 83 81 79 77 75 73 71 Accuracy (%) Number of instances (phone calls)
  • 26. Random Forest Model Personalized model Subset of 120 calls: 87.0% (κ=.640)
  • 27. Features Ranked by Prediction Power Category Feature Mean Rank Last Active Last ringer change (time) 1 Last Active Last screen change (time) 2 Currently Active Screen status 3.6 Last Active Last (un)plugged (time) 5.4 Last Active Last call (time) 6.8 Context Activity / Acceleration 7.3 Relationship How often called by caller 7.6 Context Day of the week 9.4 Context Hour of the day 10 Context Charger (un)plugged 10.1 Context Ringer mode 11.4 Context Last call silenced 12.4 Currently Active Pitch of phone 12.5 Context Screen (not) covered 13 Context Last call picked 14.1
  • 32. Large-Scale Evaluation of Call-Availalability Prediction. First large-scale study (31,311 calls) of call-availability prediction Prediction possible with 15 basic features 83% accuracy (generic models) 87% accuracy (personalized models) Strongest 5 predictors 4 features regarding time of last activity Screen status Use cases Mute ringer on unavailability Allow caller to check availability Large-Scale Evaluation of Call- Availability Prediction Martin Pielot, Telefónica Research martin.pielot@telefonica.com ACM UbiComp’14, Sep, 2014, Seattle, USA Wed, Sep 17, 2014 – 14:00 – 15:30 Interruptability & Notifications Q&A

Editor's Notes

  1. http://commons.wikimedia.org/wiki/File:2007Computex_e21Forum-MartinCooper.jpg#mediaviewer/File:2007Computex_e21Forum-MartinCooper.jpg
  2. makelessnoise. Phon-ey Call. via Flickr, Jul 07, 2006 (CC BY 2.0) https://www.flickr.com/photos/makelessnoise/195088755/
  3. http://en.wikipedia.org/wiki/Economy_of_North_Korea#mediaviewer/File:Hamhung_cyclist.jpg
  4. Kaz. Hände. Via Pixabay, Nov 26, 2013. (Public Domain CC0) http://pixabay.com/p-220163/
  5. http://commons.wikimedia.org/wiki/File:White_Diamonds_Party.jpg#mediaviewer/File:White_Diamonds_Party.jpg
  6. http://commons.wikimedia.org/wiki/File:White_Diamonds_Party.jpg#mediaviewer/File:White_Diamonds_Party.jpg
  7. People are only willing to share some contextual information, such as current location, current activity, or presence of appointments. [Knittel et al. 2011] http://en.wikipedia.org/wiki/Trespass#mediaviewer/File:No_trespassing_by_Djuradj_Vujcic.jpg "No trespassing by Djuradj Vujcic" by Djuradj Vujcic - Own work. Licensed under Creative Commons Attribution-Share Alike 3.0 via Wikimedia Commons - http://commons.wikimedia.org/wiki/File:No_trespassing_by_Djuradj_Vujcic.jpg#mediaviewer/File:No_trespassing_by_Djuradj_Vujcic.jpg
  8. Be present in the lives of a large number of users
  9. 3,320, that is 10.8% of the calls where muted by shaking the phone and not answering the call That is, they were most likely interruptive
  10. http://pixabay.com/de/geschlossen-angeln-gegangen-315859/