Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
 9/25/12	            1	  
An	  Elephant	  and	  Six	  Blind	  Men	  
An	  Elephant	  is	  NOT	  •    Wall	  •    Rope	  •    Snake	  •    Spear	  •    Tree	  •    Fan	  
An	  Elephant	  is	  …	    an	  Elephant	  
Mobile	  Social	  Search	  (MSS)	           is	  NOT	  Mobile	  	            is	  NOT	  Social	  	           is	  NOT	  Se...
Changing	  Times	  in	  Search	  Mobile	  Social	  Search:	  	  Search	  ‘inside’	  problem	  solving	  in	  real	  ;me.	 ...
MSS:	  A	  Problem	  of	  Riches	     When	  we	  were	  (data)	  poor	  –	     we	  searched.	     	        Now	  that	  ...
Then       Now
Then       Now
•  What	  is	  an	  Italian	  Restaurant?	      –  List	  Italian	  Restaurants	  in	  Brussels.	  •  Show	  me	  Italian	...
•  What	  are	  symptoms	  of	  Swine	  Flu?	  •  Is	  there	  a	  major	  Swine	  Flu	  outbreak	  in	  my	  area?	  •  Y...
Social	  Networks	  	  Connecting  People
Social	  Life	  Networks	                     Connecting            Information                        	         	        ...
Concept	  recogni;on	  from	  data	                                                                                       ...
Proprietary	  and	  ConfidenTal,	  Not	  For	  9/25/12	                                                           16	      ...
•  SituaTon:	  An	  acTonable	  abstracTon	  of	     observed	  spaTo-­‐temporal	  characterisTcs.	  •  Allow	  users	  to...
Swine	  flu:	  Situa;on	  Segmenta;on	                into	  ‘high’	  and	  ‘low	  ’ac;vity	  zones.	                      ...
(a) Pollen levels (Source: Visual)           (b) Census data (Source: text file)           (c) Reports on ‘Hurricanes’ (so...
Level	  0:	  Raw	  data	  streams	  	  e.g.	  tweets,	  cameras,	  traffic,	  weather,	  …	                                 ...
Billions	  of	  data	  sources.	  	  Selec;ng	  and	  combining	  appropriate	  sources	  to	  detect	  situa;ons.	  	  In...
Front	  End	  GUI               New         New                          E-­‐mage                             Alert       ...
9/25/12	     23	  
S.	  No	   Operator	                              Input	                           Output	  1	                   Selection...
Personal	  SituaTon	                     Proprietary	  and	  ConfidenTal,	  Not	  For	  9/25/12	                           ...
Macro	  situa;on	                                                                               Alert	  Level=High	       ...
Planetary	                             1)	  Macro	  	  	  	  	  scale	  sensing	                        situaTon	  Social	...
Classify (Flood level - Shelter                                      Flood         Shelter)                Twitter        ...
Taking	  personalized	  acTons	  9/25/12	                                            29	  
•  Was	  for	  Archived	  data	  and	  mostly	  for	     researchers	  (using	  Desktop).	  •  Currently:	  Mobile	  clien...
Thanks	  for	  your	  Tme	  and	  alenTon.	       For	  quesTons:	  
Applica;on	  scenarios	    ¨          Business	  decision	  making:	  Demand-­‐supply	  analysis,	                opening...
Upcoming SlideShare
Loading in …5

Mobile social search


Published on

My presentation at Search Computing on a topic that I think is going to be quite popular soon.

Published in: Health & Medicine, Technology
  • Be the first to comment

Mobile social search

  1. 1.  9/25/12   1  
  2. 2. An  Elephant  and  Six  Blind  Men  
  3. 3. An  Elephant  is  NOT  •  Wall  •  Rope  •  Snake  •  Spear  •  Tree  •  Fan  
  4. 4. An  Elephant  is  …   an  Elephant  
  5. 5. Mobile  Social  Search  (MSS)   is  NOT  Mobile     is  NOT  Social     is  NOT  Search   Is  Mobile  Social  Search  
  6. 6. Changing  Times  in  Search  Mobile  Social  Search:    Search  ‘inside’  problem  solving  in  real  ;me.   Problem  Solving       Search    
  7. 7. MSS:  A  Problem  of  Riches   When  we  were  (data)  poor  –   we  searched.     Now  that  we  are  (data)  rich  –   we  need  mobile  social   search.    
  8. 8. SearchConnecting
  9. 9. Then Now
  10. 10. Then Now
  11. 11. •  What  is  an  Italian  Restaurant?   –  List  Italian  Restaurants  in  Brussels.  •  Show  me  Italian  Restaurants?   –  Use  Yelp  (or  any  other  social  approach)  and  distance   from  me  to  rank  them.  •  Where  should  I  go  to  eat  Italian  food  NOW?   –  Consider  Tme  taken,  current  ambiance,  and  quality   of  food  into  consideraTon.  
  12. 12. •  What  are  symptoms  of  Swine  Flu?  •  Is  there  a  major  Swine  Flu  outbreak  in  my  area?  •  You  are  likely  to  be  very  sick  with  extreme  case   of  Swine  Flu  soon,  your  doctor  is  ready  with  the   set  up.  
  13. 13. Social  Networks    Connecting People
  14. 14. Social  Life  Networks   Connecting Information     People Aggregation Situation Alerts and Detection CompositionAnd Queries Resources9/25/12   14  
  15. 15. Concept  recogni;on  from  data   Heterogeneous  Media   Heterogeneous  Media   LocaTon   Scenes   Single  Media   Environm Trajectories   SituaTons   aware   ents   K   3.4   Single  Media   LocaTon   Visual   Real  world   Visual   360  K   11.4K   AcTviTes   unaware   Objects   Objects   Events   StaTc   Dynamic   SPACE   TIME   15  
  16. 16. Proprietary  and  ConfidenTal,  Not  For  9/25/12   16   DistribuTon  
  17. 17. •  SituaTon:  An  acTonable  abstracTon  of   observed  spaTo-­‐temporal  characterisTcs.  •  Allow  users  to  define  their  own  spaTo-­‐ temporal  features  and  create  the  situaTon   detecTon  filters.    9/25/12   17  
  18. 18. Swine  flu:  Situa;on  Segmenta;on   into  ‘high’  and  ‘low  ’ac;vity  zones.   Proprietary  and  ConfidenTal,  Not  For  9/25/12   18   DistribuTon  
  19. 19. (a) Pollen levels (Source: Visual) (b) Census data (Source: text file) (c) Reports on ‘Hurricanes’ (source: Twitter stream)  d) Cloud cover (Source: Satellite imagery) (e) Predicted hurricane path (source: KML) (f) Open shelters coverage(Source: KML)   Representa;on  for  different  data  sources  into  a  common   spa;o-­‐temporal  format.    
  20. 20. Level  0:  Raw  data  streams    e.g.  tweets,  cameras,  traffic,  weather,  …   …   Level  1:  Unified   representaTon   ProperTes (STT  Data)   STT  Stream   Level  2:   AggregaTon   ProperTes Emage   (Emage)     Level  3:   Symbolic  rep.   ProperTes SituaTon   (SituaTons)  
  21. 21. Billions  of  data  sources.    Selec;ng  and  combining  appropriate  sources  to  detect  situa;ons.    Interac;ons  with  different  types  of  Users    Decision  Makers                            Individuals     9/25/12   21  
  22. 22. Front  End  GUI New New E-­‐mage Alert Data Query Stream Request Source Back  End  Controller E-­‐mage  Stream Personalized   Registered Stream  Query  Processor Queries Alert  Unit E-­‐mage  Stream User  Info Registered Data Data  Ingestor Raw  Data Storage Sources API  Calls Raw  Spatial   Data  Stream Data  Cloud9/25/12   22  
  23. 23. 9/25/12   23  
  24. 24. S.  No   Operator   Input   Output  1   Selection  σ   Temporal     Temporal     E-­‐mage  Set   E-­‐mage  Set  2   Arithmetic    &   K*Temporal  E-­‐mage   Temporal  E-­‐mage  Set   Logical⊕   Set  3   Aggregation  α   Temporal  E-­‐mage  set   Temporal  E-­‐mage  Set  4   Grouping  γ   Temporal  E-­‐mage  Set   Temporal  E-­‐mage  Set  5   Characterization  :   • Spatial  φ   • Temporal  E-­‐mage  Set   • Temporal  Pixel  Set   • Temporal  τ   • Temporal  Pixel  Set   • Temporal  Pixel  Set  6   Pattern  Matching  ψ   • Spatial  φ   • Temporal  E-­‐mage  Set   • Temporal  Pixel  Set   • Temporal  τ   • Temporal  Pixel  Set   • Temporal  Pixel  Set   9/25/12   24  
  25. 25. Personal  SituaTon   Proprietary  and  ConfidenTal,  Not  For  9/25/12   25   DistribuTon  
  26. 26. Macro  situa;on   Alert  Level=High   Date=12/09/10   Micro  event   Situa;onal  controller   Control  Ac;on   e.g.  “Arrgggh,  I     “Please  visit  have  a  sore  throat”   • Goal     nearest  CDC   (Loc=New  York,   • Macro  SituaTon     center  at  4th  St   Date=12/09/10)   • Rules   immediately”   Level  1  personal  threat  +  Level  3  Macro  threat  -­‐>  Immediate  ac;on     9/25/12   26  
  27. 27. Planetary   1)  Macro          scale  sensing   situaTon  Social  sensors  Device  sensors  Macro  sensors   2)  Personalized     situaTon     Personal     context     Personal  life  streams         Profile/     Preferences   e.g.  High  Flu  risk   3)  Recommend                     AcTons       Available   resources   Resource  data  
  28. 28. Classify (Flood level - Shelter Flood Shelter) Twitter Flood Level Shelter9/25/12   28  
  29. 29. Taking  personalized  acTons  9/25/12   29  
  30. 30. •  Was  for  Archived  data  and  mostly  for   researchers  (using  Desktop).  •  Currently:  Mobile  clients,  Local  data,  and   Social  Graph  (SoMoLo).  •  Immediate  Future:  SituaTons  from  Real  Time   data  and  RecommendaTons.  •  Future:  PredicTve  control  of  emerging   situaTons.  
  31. 31. Thanks  for  your  Tme  and  alenTon.   For  quesTons:  
  32. 32. Applica;on  scenarios   ¨  Business  decision  making:  Demand-­‐supply  analysis,   opening  a  new  store,  offer,…   ¨  Medical  :  Epidemic  monitoring,  Asthma,  polluTon   effect  miTgaTon   ¨  Disaster  relief:  (hurricane,  flood,  fire)  direcTng   people  to  appropriate  resources.   ¨  Traffic:  SuggesTng  best  routes      9/25/12   32