SlideShare a Scribd company logo
1 of 113
Download to read offline
12/5/12	
     1	
  
•    Social	
  systems	
  rely	
  on	
  primi0ve	
  technology.	
  
•    Big	
  Data	
  has	
  opened	
  Big	
  Opportuni0es.	
  
•    Situa0on	
  recogni0on	
  is	
  a	
  key	
  technology.	
  
•    EventShop	
  may	
  be	
  useful	
  in	
  designing	
  
     Intelligent	
  Social	
  Systems.	
  
Send:	
  
 •      Comments.	
  
 •      Sugges1ons.	
  
 •      Collabora1on	
  opportuni1es.	
  
 	
  
 •      jain@ics.uci.edu	
  
 •      Gmail,	
  FB,	
  TwiBer:	
  jain49	
  
Intelligent:	
  	
  displaying	
  or	
  characterized	
  by	
  
quickness	
  of	
  understanding,	
  sound	
  thought,	
  or	
  
good	
  judgment.	
  
	
  
Social	
  Systems:	
  Social	
  systems	
  are	
  the	
  paBerns	
  
of	
  behavior	
  of	
  a	
  group	
  of	
  people	
  possessing	
  
similar	
  characteris1cs	
  due	
  to	
  their	
  existence	
  in	
  
same	
  society.	
  
	
  
	
  
•  Introduc1on	
  
•    Social	
  Systems	
  
•    Intelligent	
  Social	
  Systems	
  
•    Designing	
  Intelligent	
  Social	
  Systems	
  
•    Situa1on	
  Recogni1on	
  
•    Concept	
  recogni1ons	
  
•    Personalized	
  Situa1ons	
  
•    EventShop	
  
An	
  Interes0ng	
  Situa0on	
  	
  

                     When	
  we	
  were	
  data	
  poor	
  –	
  
                     we	
  searched	
  for	
  words	
  in	
  
                     documents.	
  
                     	
  

                        Now	
  that	
  we	
  are	
  data	
  rich	
  –	
  
                        should	
  we	
  s0ll	
  search	
  for	
  
                        words?	
  
                        	
  
Time	
  has	
  come	
  for	
  us	
  to	
  stop	
  thinking	
  data	
  poor;	
  really	
  start	
  
thinking	
  and	
  behaving	
  data	
  rich.	
  
Variety	
  


                                                   Volume	
  
Big	
  Data	
  offers	
  Big	
  Opportuni4es.	
  
But,	
  ….	
  ?????	
                                           7	
  
Most	
  aOen0on	
  by	
  
          Top	
  1.5	
               Technologists	
  –	
  so	
  far.	
  
          Billion	
  



Middle	
  	
  4	
  Billion	
  	
  
                                                    Middle	
  of	
  the	
  
                                                   Pyramid	
  (MOP):	
  	
  
                                                       Ready.	
  
 BoOom	
  2	
  Billion	
  
                                                               Not	
  Ready	
  
Data	
  is	
  Essen0al.	
  	
  	
  
But,	
  we	
  are	
  really	
  interested	
  in	
  its	
  products:	
  	
  
           	
  Informa0on,	
  	
  
           	
  Knowledge,	
  and	
  	
  
           	
  Wisdom.	
  
                                                                              9	
  
	
  
Recognize	
  
                                               Objects	
  
                                               Situa0ons	
  
                     Knowledge	
  
   Observe	
  
   Big	
  Data	
  
                                     Act	
  
                                        Planning	
  
12/5/12	
                               Control	
        10	
  
Past is EXPERIENCE
              Present is EXPERIMENT
              Future is EXPECTATION

                  Use your Experiences
                  In your Experiments
              To achieve your Expectations

12/5/12	
                                    11	
  
 	
  	
  Astrology	
  



                           To	
  
                                 Astronomical	
  
                                 Volumes	
  of	
  
                                 Data	
  
                                 	
  
12/5/12	
                                            12	
  
We	
  are	
  immersed	
  in	
  Networks	
  of	
  
  •  People	
  
  •  Things	
  
  •  Events	
  



It	
  is	
  now	
  possible	
  to	
  be	
  Pansophical.	
  	
  
   12/5/12	
                                                  13	
  
Our	
  mobile	
  wireless	
  infrastructure	
  can	
  be	
  
“reality	
  mined”	
  to	
  understand	
  the	
  paOerns	
  of	
  
human	
  behavior,	
  monitor	
  our	
  environments,	
  
and	
  plan	
  social	
  development.	
  	
  
	
  
-­‐-­‐-­‐-­‐	
  Pentland	
  in	
  	
  “Society’s	
  Nervous	
  System:	
  
Building	
  Effec0ve	
  Government,	
  Energy,	
  and	
  
Public	
  Health	
  Systems”	
  

                           Proprietary	
  and	
  Confiden1al,	
  Not	
  For	
  
12/5/12	
                                                                        14	
  
                                           Distribu1on	
  
•  Objects	
  -­‐-­‐	
  popular	
  in	
  the	
  West.	
  
•  Rela0onships	
  and	
  Events	
  –	
  popular	
  in	
  the	
  East.	
  
•  Objects	
  and	
  Events	
  –	
  seems	
  to	
  be	
  the	
  new	
  trend.	
  

•  The	
  Web	
  has	
  re-­‐emphasized	
  the	
  importance	
  of	
  
   every	
  object	
  and	
  event	
  being	
  connected	
  to	
  others	
  	
  
   -­‐-­‐	
  East	
  Meets	
  West.	
  

               Geography	
  of	
  Thought	
  by	
  Richard	
  NisbeB	
  
•  Data	
  	
  
•  Objects	
  	
  
•  Rela0onships	
  and	
  Events	
  
•  Take	
  place	
  in	
  the	
  real	
  world.	
  
•  Captured	
  using	
  different	
  sensory	
  mechanism.	
  
    –  Each	
  sensor	
  captures	
  only	
  a	
  limited	
  aspect	
  of	
  the	
  
       event.	
  
•  Can	
  be	
  used	
  to	
  bridge	
  the	
  seman1c	
  gap.	
  
Events:	
  Types	
  and	
  Granulari1es	
  
         •  Conferences	
  
               –  Days	
  
                    •  Sessions	
  
                          –  Talks	
  
                               »  Purpose	
  of	
  the	
  talk	
  
         •    Wedding	
  
         •    An	
  Earthquake	
  
         •    The	
  Big	
  Bang	
  
         •    World	
  Wide	
  Web	
  
         •    Yahoo:	
  Winter	
  School	
  2012	
  
         •    Me	
  
               –  My	
  Birth,	
  	
  
               –  Being	
  here,	
  and	
  	
  
               –  Dying	
  in	
  100	
  years.	
  
People	
  
Things	
  
Places	
  
Time	
  
Experiences	
  
Events	
  
      E	
  	
  by	
  Westerman	
  and	
  	
  Jain	
  
               	
  
      E*	
  by	
  Gupta	
  and	
  Jain	
  
Sense	
  making	
  from	
  mul1modal	
  
massive	
  geo-­‐social	
  data-­‐streams.	
  	
  




                                                 20	
  
 
•  Introduc1on	
  
• Social	
  Systems	
  
•    Intelligent	
  Social	
  Systems	
  
•    Designing	
  Intelligent	
  Systems	
  
•    Situa1on	
  Recogni1on	
  
•    Concept	
  recogni1ons	
  
•    Personalized	
  Situa1ons	
  
•    EventShop	
  
Poli0cs	
                     Religion	
  



              Educa0on	
  


Health	
                     Economics	
  
Connec4ng	
  People	
  to	
  Resources	
  	
  
effec4vely,	
  efficiently,	
  and	
  promptly	
  	
  
       in	
  given	
  situa4ons.	
  
•  Minimize	
  hunger	
  in	
  the	
  world.	
  
•  Maximize	
  female	
  educa1on	
  in	
  India.	
  
•  Minimize	
  ‘deaths’	
  in	
  the	
  coming	
  hurricane	
  in	
  
   Florida.	
  
•  Minimize	
  work-­‐hours	
  lost	
  in	
  traffic	
  during	
  
   week	
  days	
  in	
  Bangalore.	
  
•  System:	
  
   –  	
  	
  A	
  set	
  of	
  diverse	
  parts	
  forming	
  a	
  whole.	
  
   –  Parts	
  are	
  put	
  together	
  with	
  a	
  common	
  objec1ve/
      purpose.	
  
•  Each	
  part	
  could	
  be	
  considered	
  a	
  system.	
  
•  Each	
  part	
  plays	
  a	
  role	
  towards	
  the	
  system	
  
   objec1ve.	
  
•  Designing	
  the	
  informa1on	
  flow	
  among	
  parts	
  is	
  
   essen1al	
  to	
  make	
  a	
  system	
  work	
  apprpriately.	
  

   	
  
•  A	
  social	
  system	
  is	
  composed	
  of	
  persons	
  or	
  
   groups	
  who	
  share	
  a	
  common	
  objec1ve.	
  
•  An	
  individual	
  objec1ve	
  is	
  usually	
  a	
  part	
  of	
  the	
  
   group’s	
  objec1ve.	
  	
  
•    Persons	
  
•    Families	
  
•    Organiza1ons	
  
•    Communi1es:	
  City,	
  State,	
  Country	
  
•    Socie1es	
  
•    Cultures	
  
•  Top	
  Down:	
  
   –  The	
  social	
  system	
  determines	
  its	
  parts.	
  
   –  People’s	
  behavior	
  determined	
  by	
  society.	
  
•  BoBom	
  Up:	
  
   –  The	
  Society	
  is	
  the	
  sum	
  of	
  its	
  indivduals	
  
   –  Individual	
  ac1ons	
  determine	
  the	
  character	
  of	
  the	
  
      society.	
  
•  Each	
  social	
  en1ty	
  is	
  a	
  holon.	
  
•  Holon:	
  Each	
  en1ty	
  is	
  simultaneously	
  a	
  part	
  and	
  a	
  
   whole.	
  
•  A	
  social	
  component	
  is	
  made	
  up	
  of	
  parts	
  and	
  at	
  the	
  
   same	
  1me	
  maybe	
  part	
  of	
  some	
  larger	
  whole.	
  
•  Any	
  system	
  is	
  by	
  defini1on	
  both	
  part	
  and	
  whole.	
  
•  The	
  primary	
  ‘currency’	
  	
  of	
  a	
  social	
  system	
  is	
  
   informa1on.	
  
•  System	
  behavior	
  can	
  be	
  understood	
  as	
  the	
  
   movement	
  of	
  informa1on:	
  
     –  Within	
  a	
  system	
  
     –  Between	
  the	
  system	
  and	
  its	
  environment	
  
•  Informa1on	
  is	
  used	
  to	
  sense	
  as	
  well	
  as	
  to	
  control	
  or	
  
   act.	
  
 
•  Introduc1on	
  
•  Social	
  Systems	
  
•  Intelligent	
  Social	
  Systems	
  
•    Designing	
  Intelligent	
  Systems	
  
•    Situa1on	
  Recogni1on	
  
•    Concept	
  recogni1ons	
  
•    Personalized	
  Situa1ons	
  
•    EventShop	
  
•  Systems	
  that	
  perceive,	
  reason,	
  learn,	
  and	
  act	
  
   intelligently.	
  
•  Adaptability	
  to	
  varying	
  environmental	
  
   situa1ons	
  is	
  a	
  key	
  element	
  of	
  intelligent	
  
   systems	
  
•  Social	
  systems	
  that	
  perceive,	
  reason,	
  learn,	
  
   and	
  act	
  intelligently.	
  
•  What	
  does	
  ‘perceive’,	
  ‘reason’,	
  ‘learn’,	
  and	
  
   ‘act’	
  mean	
  in	
  the	
  context	
  of	
  social	
  systems?	
  
 
•  Introduc1on	
  
•  Social	
  Systems	
  
•  Intelligent	
  Social	
  Systems	
  
• Designing	
  Intelligent	
  Social	
  
  Systems	
  
•    Situa1on	
  Recogni1on	
  
•    Concept	
  recogni1ons	
  
•    Personalized	
  Situa1ons	
  
•    EventShop	
  
•  Desired	
  state	
  (Goal)	
  
•  System	
  model	
  and	
  Control	
  Signal	
  
   (Ac0ons)	
  
•  Current	
  State	
  (for	
  Feedback)	
  
 
                      bserve d	
  State
                                                                               	
  
                  O
                                                                     Fe edback
Observa0ons	
  




                                                                        Control	
  
                                                                        Signals	
  

                                                        Events	
  
                                      Real	
  World	
  
Social	
  Networks	
  	
  



Connecting
  People
Needs	
  and	
  Resources	
  


                            Not	
  even	
  
                           FaceBook!	
  
Current	
  
              	
  Social	
  
              Networks	
  


              Important	
  
              Unsa1sfied	
  	
  
              Needs	
  

12/5/12	
                         46	
  
•  Resources	
  	
  
    –  Physical:	
  food,	
  water,	
  goods,	
  …	
  
    –  Informa:onal:	
  Wikipedia,	
  Doctors,	
  …	
  
    –  Transporta:on	
  
    –  Employment	
  
    –  Spiritual	
  
•  Timeliness	
  
•  Efficiency	
  
Connecting            Information
                   	
         	
  
                        People
              Aggregation Situation    Alerts
                 and      Detection
              CompositionAnd
                                      Queries
              Resources



12/5/12	
                                         48	
  
 
•    Introduc1on	
  
•    Social	
  Systems	
  
•    Intelligent	
  Social	
  Systems	
  
•    Designing	
  Intelligent	
  Systems	
  

• Situa0on	
  Recogni0on	
  
•  Concept	
  recogni1ons	
  
•  Personalized	
  Situa1ons	
  
•  EventShop	
  
Connec4ng	
  People	
  to	
  Resources	
  	
  
effec4vely,	
  efficiently,	
  and	
  promptly	
  	
  
       in	
  given	
  situa4ons.	
  
•  rela1ve	
  posi1on	
  or	
  combina1on	
  of	
  
   circumstances	
  at	
  a	
  certain	
  moment.	
  
•  The	
  combina1on	
  of	
  circumstances	
  at	
  a	
  given	
  
   moment;	
  a	
  state	
  of	
  affairs.	
  
•  Situa1on	
  awareness,	
  or	
  SA,	
  is	
  the	
  percep1on	
  
   of	
  environmental	
  elements	
  within	
  a	
  volume	
  of	
  
   1me	
  and	
  space,	
  the	
  comprehension	
  of	
  their	
  
   meaning,	
  and	
  the	
  projec1on	
  of	
  their	
  status	
  in	
  
   the	
  near	
  future.	
  
•  What	
  is	
  happening	
  around	
  you	
  to	
  understand	
  
   how	
  informa1on,	
  events,	
  and	
  your	
  own	
  
   ac1ons	
  will	
  impact	
  your	
  goals	
  and	
  objec1ves,	
  
   both	
  now	
  and	
  in	
  the	
  near	
  future.	
  
•  Example	
  1:	
  	
  
    –  A	
  person	
  shou1ng.	
  
    –  1000	
  people	
  shou1ng.	
  
         •  In	
  a	
  contained	
  building	
  
         •  In	
  main	
  parts	
  of	
  a	
  city	
  
•  Example	
  2:	
  
    –  One	
  person	
  complaining	
  about	
  flu.	
  
    –  Many	
  people	
  from	
  different	
  areas	
  of	
  a	
  country	
  
       complaining	
  about	
  flu.	
  
Facebook	
  and	
  TwiBer	
  
             (now	
  GOOGLE	
  +)	
  

Have	
  been	
  repor0ng	
  events	
  as	
  micro-­‐blogs	
  
            Massive	
  collec1on	
  of	
  events.	
  
Time	
  
Does	
  the	
  flap	
  of	
  a	
  buEerfly’s	
  wings	
  in	
  Brazil	
  set	
  off	
  a	
  
     tornado	
  in	
  Texas?	
  
	
  
	
  
	
  
Have	
  been	
  repor0ng	
  events	
  as	
  micro-­‐blogs	
  

Sensors	
  and	
  Internet	
  of	
  Things	
  are	
  crea1ng	
  and	
  
  repor1ng	
  	
  even	
  more	
  events	
  than	
  humans	
  
  are.	
  

  12/5/12	
                                                      57	
  
FROM TWEETS TO REVOLUTIONS
Atomic	
  and	
  Composite	
  Events	
  




        Time	
  
•  Given	
  a	
  plethora	
  of	
  event	
  data.	
  How	
  can	
  we:	
  
    –  Disambiguate	
  relevant	
  and	
  irrelevant	
  events?	
  
    –  Combine	
  events	
  into	
  meaningful	
  representa1ons	
  ?	
  
    –  Allow	
  inference	
  and	
  cascading	
  effects?	
  
    –  Support	
  different	
  interpreta1ons	
  based	
  on	
  
       applica1on	
  domain?	
  
    –  Support	
  Control	
  &	
  decision	
  making?	
  	
  
1.  Inherent	
  support	
  for	
  event-­‐based	
  (temporal)	
  
    reasoning	
  
2.  The	
  ability	
  of	
  the	
  controller	
  to	
  reason	
  based	
  
    on	
  symbols	
  (rather	
  than	
  just	
  signals)	
  
3.  Explicit	
  inclusion	
  of	
  domain	
  seman1cs	
  (to	
  
    support	
  mul1ple	
  applica1ons)	
  
An	
  ac4onable	
  abstrac4on	
  of	
  observed	
  
spa4o-­‐temporal	
  characteris0cs.	
  




                                                      62	
  
 
•    Introduc1on	
  
•    Social	
  Systems	
  
•    Intelligent	
  Social	
  Systems	
  
•    Designing	
  Intelligent	
  Systems	
  
•    Situa1on	
  Recogni1on	
  
• Concept	
  recogni0ons	
  
•  Personalized	
  Situa1ons	
  
•  EventShop	
  
Data	
  Type	
  




                   1950	
                        2000	
  
                              Time	
  Line	
  
Situa0on	
  	
  
                                                                                    2010	
  



                                                        Events	
  	
  
Data	
  Type	
  




                                                        1986	
  



                                   Objects	
  	
  
                                   1963	
  


                              Speech	
  
                              1962	
  

                        Character	
  
                        1959	
  


                   1950	
                                                2000	
  
                                                     Time	
  Line	
  
Loca1on	
      Scenes	
  
                  Environm                 Trajectories	
  
                                            Situa1ons	
  
     aware	
        ents	
  




                                                              Single	
  Media	
  
    Loca1on	
       Visual	
  
                  Real	
  world	
            Visual	
  
                   Objects	
  
                   Objects	
                Ac1vi1es	
  
                                             Events	
  
    unaware	
  

                    Sta1c	
                 Dynamic	
  
     SPACE	
  
                                TIME	
  



Data	
  =	
  Text	
  or	
  Images	
  or	
  Video	
  
                                                                                    66	
  
Trajectory	
   Situa1on	
  
      Object	
   Scene	
                  Event	
  



1960	
                1970	
     1980	
             1990	
       2000	
     2010	
  




•    1963:	
  Object	
  Recogni1on	
  [Lawrence	
  +	
  Roberts]	
  
•    1967:	
  Scene	
  Analysis	
  [Guzman]	
  
•    1984:	
  Trajectory	
  detec1on	
  [Ed	
  Chang+	
  Kurz]	
  
•    1986:	
  Event	
  Recogni1on	
  [Haynes	
  +	
  Jain]	
  
•    1988:	
  Situa1on	
  Recogni1on	
  [Dickmanns]	
  
Heterogeneous	
  Media	
  
                      Loca1on	
     Environm
                                                             Situa1ons	
  
                       aware	
        ents	
  



                      Loca1on	
     Real	
  world	
  
                                     Objects	
                Ac1vi1es	
  
                      unaware	
  

                                      Sta1c	
                Dynamic	
  
                       SPACE	
  
                                                  TIME	
  


Data	
  is	
  just	
  Data.	
  
Meta-­‐data	
  is	
  also	
  data.	
  	
  Caste	
  system	
  does	
  not	
  exist	
  here.	
  
Medium	
  and	
  sources	
  do	
  not	
  maOer.	
                                      68	
  
 
•    Introduc1on	
  
•    Social	
  Systems	
  
•    Real	
  Time	
  Social	
  Systems	
  
•    Designing	
  Real	
  Time	
  Systems	
  
•    Situa1on	
  Recogni1on	
  
•    Concept	
  recogni1ons	
  

• Personalized	
  Situa0ons	
  
•  EventShop	
  
A)	
  Situa0on	
  Modeling	
                   B)	
  Situa0on	
  Recogni0on	
     C)	
  Visualiza0on,	
  Personaliza0on,
                                                                                                 and	
  Alerts	
  


                                                                                    i)	
  Visualiza1on	
  
             C1	
  




                                                                   …	
  
                      ⊕

    v2	
                   v3	
                                                         Personal	
  
                                                                                        context	
             ii)	
  Personaliza1on	
  
                                                                                                                  Personali
                  v5	
              v6	
                                                                             zed	
  
                                               STT	
  Stream	
                                                    situa1on	
  



                                                                                                  Available	
  
                                                                                                  resources	
  

                                                Emage	
  


                                                                                                                          iii)	
  Alerts	
  
                                             Situa1on	
  



                                                                                                                                    70	
  	
  	
  	
  
Proprietary	
  and	
  Confiden1al,	
  Not	
  For	
  
12/5/12	
                                                           71	
  
                              Distribu1on	
  
Aggrega1on,	
  	
   Opera1ons	
  


                                                                                 Alert	
  level	
  	
  
                                                                                   =	
  High	
  




                                              Date:	
  3rd	
  Jun,	
  2011	
  



      STT	
  data	
                              Situa1on	
  Detec1on	
  
          	
                                                     	
                                             User-­‐Feedback	
  
                                        1)	
  	
  	
  Classifica1on	
                                                        	
  
       Tweet:	
                                                  	
  
                                                                                                          ‘Please	
  visit	
  Dr.	
  Cureit	
  at	
  
   ‘Urrgh…	
  sinus’	
                                           	
  
                                        2)	
  	
  	
  Control	
  ac1on	
                                     4th	
  St	
  immediately’	
  
          	
                                                     	
  

    Loc:	
  NYC,	
  
Date:	
  3rd	
  Jun,	
  2011	
  
 Theme:	
  Allergy	
  
                                                                                                                                                  73	
  
 
•    Introduc1on	
  
•    Social	
  Systems	
  
•    Intelligent	
  Social	
  Systems	
  
•    Designing	
  Intelligent	
  Systems	
  
•    Situa1on	
  Recogni1on	
  
•    Concept	
  recogni1ons	
  
•    Personalized	
  Situa1ons	
  

• EventShop	
  
•  E-­‐mage	
  
	
  
	
  
	
  
	
  	
  
    –  Visualiza1on	
  
    –  Intui1ve	
  query	
  and	
  mental	
  model	
  
    –  Common	
  spa1o	
  temporal	
  data	
  representa1on	
  
    –  Data	
  analysis	
  using	
  media	
  processing	
  operators	
  	
  
       (e.g.	
  segmenta1on,	
  background	
  subtrac1on,	
  
       convolu1on)	
  
                                                                               76	
  	
  	
  	
  
•  Spa1o-­‐temporal	
  element	
  
    –  STTPoint	
  =	
  {s-­‐t-­‐coord,	
  theme,	
  value,	
  pointer}	
  
•  E-­‐mage	
  
    –  g	
  =	
  (x,	
  {(tm,	
  v(x))}|xϵ X	
  =	
  R2	
  ,	
  tm ϵ	
  θ,	
  and	
  v(x)	
  ϵ	
  V	
  =	
  N)	
  
•  Temporal	
  E-­‐mage	
  Stream	
  
    –  TES=((ti,	
  gi),	
  ...,	
  (tk,	
  gk))	
  
•  Temporal	
  Pixel	
  Stream	
  
    –  TPS	
  =	
  ((ti,	
  pi),	
  ...,	
  (tk,	
  pk))	
  


                                                                                                                     77	
  
Proprietary	
  and	
  Confiden1al,	
  Not	
  For	
  
12/5/12	
                                                           78	
  
                              Distribu1on	
  
Proprietary	
  and	
  Confiden1al,	
  Not	
  For	
  
12/5/12	
                                                           79	
  
                              Distribu1on	
  
Retail	
  Store	
  
                                                                    Loca0ons	
  




                                                                    Net	
  Catchment	
  
                                                                    area	
  




              Proprietary	
  and	
  Confiden1al,	
  Not	
  For	
  
12/5/12	
                                                                                  80	
  
                              Distribu1on	
  
•  Humans	
  as	
  sensors	
  
  •  Space	
  +	
  Time	
  as	
  fundamental	
  axes	
  	
  
  •  Real	
  0me	
  situa0on	
  evalua0on	
  (E-­‐mage	
  Streams)	
  




(a) Pollen levels (Source: Visual)           (b) Census data (Source: text file)           (c) Reports on ‘Hurricanes’ (source: Twitter stream)	
  




d) Cloud cover (Source: Satellite imagery)    (e) Predicted hurricane path (source: KML)   (f) Open shelters coverage(Source: KML)	
  



                                                                                                                                     81	
  
•  Help	
  domain	
  experts	
  externalize	
  their	
  internal	
  
      models	
  of	
  situa1ons	
  of	
  interest	
  e.g.	
  epidemic.	
  
   •  Building	
  blocks:	
  	
  
          –  Operators	
  	
  
          –  Operands	
  	
  
   •  Wizard:	
  	
  
          –  A	
  prescrip1ve	
  approach	
  for	
  modeling	
  situa1ons	
  using	
  the	
  
             operators	
  and	
  operands	
  	
  



Singh,	
  Gao,	
  Jain:	
  Situa:on	
  recogni:on:	
  An	
  evolving	
  problem	
  for	
  heterogeneous	
  dynamic	
  big	
  
                                                                                                                  82	
  
                                   mul:media	
  data,	
  ACM	
  Mul0media	
  ‘12.	
  
 Knowledge	
  or	
  data	
  driven	
  building	
  blocks	
  

                      Growth	
  rate	
  	
  
                      (Flu	
  reports)	
  
                                               Feature	
  

                           TwiBer-­‐Flu	
      Data	
  source	
  

                 -­‐Emage	
  (#Reports)	
       Representa1on	
  level	
  

                          Thresholds	
  
                            (0,	
  50)	
       Meta-­‐data	
  


                                                                             83	
  
Get_components (v){                                                                                v                        ϵ	
  {	
  Low,	
  
                                                                                                                           Mid,	
  High}	
  
                                                                                          f1	
      ⊕                               	
  

1)  Identify output state space                                                                                          <USA,	
  	
  5	
  mins,	
  
                                                                                                                          0.01x	
  0.01>	
  
                                                                                                                               	
  


2)  Identify S-T bounds
                                                                        v2	
                       v3	
  
3)  Define component                                                                      f2	
  
                                                                                                                                           v4	
  
                                                                         @                          ⊕                                          ∏
    features:
   v=f(v1, …, vk)                                                       Emage	
  
                                                                                    v5	
                    v6	
  
                                                                                                                                           Emage	
  
           •  If (type = imprecise)                                                    ∏                       @
                                                                           Δ                                                                   Δ
                  –  identify learning data source, method   	
  	
  

4)  ForEach (feature vi) {                                               D1	
       Emage	
                 Emage	
  
                                                                                                                                             D2	
  

  	
  	
  	
  If (atomic)                                                              Δ                        Δ
           •  Identify Data source.
                                                                                      D2	
                      D3	
  
                  •  Type, URL, ST bounds
           •  Identify highest Rep. level reqd.
           •  Identify operations

    Else
       Get_components(vi)                                                                                                         84	
  
3)	
  Instan1ate	
  
2)	
  Revise	
  
1) Model	
  	
                                                                              Epidemic	
                               ϵ	
  {Low,	
  mid,	
  high},	
  
                                                                                            Outbreaks	
  
	
  
                                                                                                                                    <USA,	
  5	
  mins,	
  0.01x	
  
                                                      Classifica1on:	
                                                                         0.01>	
  
                                                      Thresh	
  (30,70)	
  
                                                                                        Growing	
  Unusual	
  
                                                                                            ac1vity	
  
                                                                                                                                  Mul1ply	
  


                                                             Unusual	
  
                                                             Ac1vity?	
                                                                                Growth	
  Rate	
  

                                                                                            Subtract       	
  
                      Historical	
                                            Current	
  ac1vity	
                                                          Emage	
  	
  
                     ac1vity	
  level	
                                            level	
                                                               (#reports	
  ILI)	
  
                                                                                                                   Subtract	
  
                                                                                                                                   Normalize	
  
            Emage	
  (Historical	
                                                                                                  [0,100]	
  
                 avg)	
  
                                                                            Emage	
  Emage	
  	
  
                                                                                                                                                               TwiBer-­‐Flu	
  
                                                                                       	
                            Emage	
  
                                                                               (#reports	
  ILI)	
  
                                                                         (#reports	
  ILI)	
                      (popula1on)	
                                                       TwiBer.com	
  
                                                                                                                                                                                     <USA,	
  5	
  mins,	
  	
  
                           TwiBer-­‐Avg	
  
                                                                                                                                                                                      0.01x	
  0.01>	
  
      DB,	
  	
                                TwiBer.com	
                             TwiBer-­‐Flu	
                   CSV-­‐	
                       Census.gov,	
  	
  
                                                             TwiBer.com	
    TwiBer-­‐Flu	
  
 <USA,	
  5	
  mins,	
  	
                    <USA,	
  5	
  mins,	
  	
                                               Popula1on	
                      <USA,	
  5	
  mins,	
  	
  
                                                            <USA,	
  5	
  mins,	
  	
  
  0.01x	
  0.01>	
                             0.01x	
  0.01>	
                                                                                         0.01x	
  0.01>	
                              85	
  	
  	
  	
  
                                                             0.01x	
  0.01>	
  
Level	
  0:	
  Raw	
  data	
  streams	
  	
  
    e.g.	
  tweets,	
  cameras,	
  traffic,	
  weather,	
  …	
  




                                                                                                 …	
  
                              Level	
  1:	
  Unified	
  
                              representa1on	
                    Proper1es
                                (STT	
  Data)	
  
                                                                             STT	
  Stream	
  


                                  Level	
  2:	
  
                                Aggrega1on	
                     Proper1es   Emage	
  
                                 (Emage)	
  
                       	
  
Opera1ons	
  
                                  Level	
  3:	
  
                               Symbolic	
  rep.	
                Proper1es   Situa1on	
  
                                (Situa1ons)	
  

                                                                                                         86	
  
Suppor1ng	
  
   Operator	
  Type	
     Data	
  
                                         parameter(s)	
  
                                                                  Output	
  


 Filter	
                            +
                                                Mask
                                                 	
  


 Aggregate	
                         +

                                            Classifica1on	
  
 Classifica1on	
                                method
                                                   	
  



Characteriza1on	
                            Property	
  	
     Growth	
  Rate	
  
                                             required	
         =	
  125%	
  



PaBern	
  Matching	
  
                                     +                                        72%	
  
                                               PaBern
                                                  	
  




                                                                                        87	
  	
  	
  	
  
Suppor1ng	
  
                                      Operator	
  Type	
     Data	
  
                                                                                            parameter(s)	
  
                                                                                                                        Output	
  

 1)	
  Data	
  into	
  right	
  
  representa1on	
                  Transform	
                                  …	
  
                                                                                               Spa1o-­‐temporal	
  
                                                                                                  window	
  




                                    Filter	
                                            +
                                                                                                   Mask
                                                                                                    	
  


                                    Aggregate	
                                         +

 2)	
  Analyze	
  data	
  to	
                                                                 Classifica1on	
  
  derive	
  features	
  	
          Classifica1on	
                                                method
                                                                                                      	
  



                                   Characteriza1on	
                                            Property	
  	
        Growth	
  Rate	
  
                                                                                                required	
            =	
  125%	
  



                                   PaBern	
  Matching	
  
                                                                                        +
                                                                                                  PaBern                            72%	
  
                                                                                                     	
  
                                                             {Features}	
  
3)	
  Use	
  features	
  to	
       Learn	
                             f	
                       Learning	
  	
  
                                                                                                                            f	
  
evaluate	
  situa1ons	
                                       {Situa1on}	
  
                                                                                                  method	
  
                                                                                                                                              88	
  	
  	
  	
  
S.	
  No   Operator                        Input                                                Output
1          Filter	
  ∏                     Temporal	
  E-­‐mage	
  Stream                       Temporal	
  	
  E-­‐mage	
  Stream

2          Aggrega0on	
  ⊕                 K*Temporal	
  E-­‐mage	
  Stream                     Temporal	
  E-­‐mage	
  Stream

3          Classifica0on	
  γ               Temporal	
  E-­‐mage	
  Stream                       Temporal	
  E-­‐mage	
  Stream

4          Characteriza0on	
  :	
  @	
          	
  	
                                               	
  	
  
           •  Spa0al	
  	
                 •               Temporal	
  E-­‐mage	
  Stream	
     •               Temporal	
  Pixel	
  Stream	
  
           •  Temporal	
                   •               Temporal	
  Pixel	
  Stream          •               Temporal	
  Pixel	
  Stream


5          PaOern	
  Matching	
  ψ	
            	
  	
                                               	
  	
  
           •  Spa0al	
  	
                 •               Temporal	
  E-­‐mage	
  Stream	
     •               Temporal	
  Pixel	
  Stream	
  
           •  Temporal	
                   •               Temporal	
  Pixel	
  Stream          •               Temporal	
  Pixel	
  Stream




 Singh, Gao, Jain: Social Pixels: Genesis and Evaluation, ACM Multimedia 89	
  
                                                                         ‘10.	
  
•  Select	
  E-­‐mages	
  of	
  US	
  for	
  theme	
  ‘Obama’.	
  
     –  ∏spa1al(region=[24,-­‐125],[24,-­‐65])	
     (TEStheme=Obama)	
  
•  Iden1fy	
  3	
  clusters	
  for	
  each	
  E-­‐mage	
  above.	
  
     –  γkmeans(3)	
  (∏spa1al(region=[24,-­‐125],[24,-­‐65])(TEStheme=Obama))	
  
•  Show	
  me	
  the	
  speed	
  for	
  each	
  cluster	
  of	
  ‘Katrina’	
  e-­‐
   mages	
  
                  (
     –  @speed @epicenter         (γkmeans(n=3)	
  (∏spa1al(region=[24,-­‐125],[24,-­‐65])	
  (TEStheme=Katrina))))	
  
•  How	
  similar	
  is	
  paBern	
  above	
  to	
  ‘exponen1al	
  increase’?	
  
     –  ψexp-­‐increase(@speed(@epicenter(γkmeans(n=3)	
  (∏spa1al(region=[24,-­‐125],[24,-­‐65])	
  
        (TEStheme=Katrina))))	
  




                                                                                                                      90	
  
Personalized	
  situa0on:	
  An	
  ac4onable	
  integra4on	
  of	
  
a	
  user's	
  personal	
  context	
  with	
  surrounding	
  
spa4otemporal	
  situa4on.	
  
                         1)	
  Macro	
  
                         situa0on



       Macro	
  	
  
                          Personal	
                                          2)	
  Personalized	
  
    data-­‐sources	
      Context	
                                                  situa0on

                           Profile	
  +	
  
                         Preferences	
  	
                                                                           3)	
  Personalized	
  
                                                                                                                             alerts	
  

                            User	
  	
                                              Available	
  
                            data	
                                                  resources	
  

                                                                                  Resource	
  
                                                                                    data	
  

                                   IF	
  person	
  ui	
  <is-­‐in>	
  (PSj)	
  THEN	
  <connect-­‐to>	
  rk	
  	
  	
  

                                                                                                                                              91	
  
Personalized	
  Situa1on	
  Recogni1on:	
  
            Operators	
  
                                                          Suppor1ng	
  
          Operator	
  Type	
              Data	
  
                                                         parameter(s)	
  
                                                                                          Output	
  


        Filter	
                                                                  …	
  
                                                     +
                                                            User	
  loca1on
                                                                     	
  


        Aggregate	
              …	
                 + …	
                        …	
  


                                                            Classifica1on	
  
        Classifica1on	
            …	
                          method             …	
  
                                                                   	
  



       Characteriza1on	
          …	
                          Property	
  	
        Growth	
  Rate	
  
                                                               required	
            =	
  125%	
  



       PaBern	
  Matching	
       …	
  
                                                     +                               Match=	
  42%	
  
                                                               PaBern
                                                                  	
  




                                                                                                          92	
  	
  	
  	
  
•  IF   𝑢𝑖   𝑖𝑠𝑖𝑛   𝑧𝑗     𝑇𝐻𝐸𝑁   𝑐𝑜𝑛𝑛𝑒𝑐𝑡  ( 𝑢𝑖,   𝑛𝑒𝑎𝑟𝑒𝑠𝑡(𝑢𝑖,  
    𝑟𝑘))  	
  

              1)  𝑖 𝑠𝑖𝑛(𝑢𝑖,   𝑧𝑗)  → 𝑚𝑎𝑡𝑐ℎ( 𝑢𝑖,   𝑟𝑘))  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
   𝑓:( 𝑈× 𝑍)→( 𝑈× 𝑅)	
  
           •  U	
  =	
  Users	
  	
  
           •  Z	
  =	
  Personalized	
  Situa1ons	
  
           •  R	
  =	
  Resources	
  

2)  𝑛 𝑒𝑎𝑟𝑒𝑠𝑡(𝑢𝑖,   𝑟𝑘)= 𝑎𝑟𝑔𝑚𝑖𝑛  ( 𝑢𝑖. 𝑙𝑜𝑐,     𝑟𝑘. 𝑙𝑜𝑐𝑠)	
  

                                                                     93	
  
Billions	
  of	
  data	
  sources.	
  
	
  
Selec0ng	
  and	
  combining	
  appropriate	
  sources	
  to	
  
detect	
  situa0ons.	
  
	
  
Interac0ons	
  with	
  different	
  types	
  of	
  Users	
  
                                    	
  Decision	
  Makers	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Individuals	
  
	
  
 12/5/12	
                                                     94	
  
12/5/12	
     95	
  
Front	
  End	
  GUI


               New         New                          E-­‐mage                             Alert
               Data        Query                        Stream                              Request
              Source

                                    Back	
  End	
  Controller
                                                        E-­‐mage	
  Stream


                                                                                     Personalized	
  
                  Registered       Stream	
  Query	
  Processor
                   Queries                                                            Alert	
  Unit


                                                        E-­‐mage	
  Stream                    User	
  Info

              Registered
                Data                     Data	
  Ingestor                              Raw	
  Data
                                                                                        Storage
               Sources



                                         API	
  Calls           Raw	
  Spatial	
  
                                                                Data	
  Stream

                                          Data	
  Cloud
12/5/12	
                                                                                                    96	
  
11/28/2012	
     97	
  
Emage
                                                                                                                                                          -­‐theme	
  :	
  String
                                                                                              STTPoint                                                    -­‐start	
  :	
  Date
                                                                                       -­‐theme	
  :	
  String                                            -­‐end	
  :	
  Date
                                                                                       -­‐value	
  :	
  double                                            -­‐latUnit	
  :	
  double
                                                              Iterator                 -­‐start	
  :	
  Date                        Iterator              -­‐longUnit	
  :	
  double               Iterator
                                                                                       -­‐end	
  :	
  Date                                                -­‐swLat	
  :	
  double
                                                                                       -­‐latUnit	
  :	
  double                                          -­‐swLong	
  :	
  double
                                                   +hasNext()	
  :	
  bool             -­‐longUnit	
  :	
  double         +hasNext()	
  :	
  bool         -­‐neLat	
  :	
  double       +hasNext()	
  :	
  bool
                                                   +next()	
  :	
  <unspecified>       -­‐latitude	
  :	
  double         +next()	
  :	
  <unspecified>   -­‐neLong	
  :	
  double      +next()	
  :	
  <unspecified>
                                                                                       -­‐longitude	
  :	
  double                                        -­‐image
  FrameParameters
 -­‐timeWindow	
  :	
  long




                                                                                                                                                                 1..*
                                                                                                      1..*
 -­‐syncTime	
  :	
  long
 -­‐latUnit	
  :	
  double     -­‐Parameterize          STTPointIterator                                                       EmageIterator                                                     STMerger
 -­‐longUnit	
  :	
  double
 -­‐swLat	
  :	
  double                           +hasNext()	
  :	
  bool
                                                                                   1                                 1
                                                                                                                         +hasNext()	
  :	
  bool
                                                                                                                                                          1..*                     1
                                                                                                                                                                                       +hasNext()	
  :	
  bool
 -­‐swLong	
  :	
  double      1           1
                                                   +next()	
  :	
  STTPoint                                              +next()	
  :	
  Emage                                         +next()	
  :	
  Emage
 -­‐neLat	
  :	
  double
 -­‐neLong	
  :	
  double                                                                                                                                        1      1

                                            Wrapper                      DBSTTPointIterator                              VisualImageIterator                     ResolutionMapper
                                                                                                                                                                 -­‐initResolution
                                         +setURL()                                                                       +setURL()                               -­‐finalResolution
                                         +setTheme()                                                                     +setTheme()
                                         +setParas()                                                                     +setParas()




 TwitterWrapper                    FlickrWrapper                 CSVWrapper                 KMLWrapper


+setBagOfWords()              +setBagOfWords()
11/28/2012	
                  +setColors()                                                                                                                                                                       98	
  
Macro	
  situa0on	
  

                                                                             Alert	
  Level=High	
  



                                           Date=12/09/10	
  


   Micro	
  event	
                    Situa0onal	
  controller	
                    Control	
  Ac0on	
  
  e.g.	
  “Arrgggh,	
  I	
                           	
                                “Please	
  visit	
  
have	
  a	
  sore	
  throat”	
        • Goal	
  	
                                     nearest	
  CDC	
  
 (Loc=New	
  York,	
                  • Macro	
  Situa1on	
  	
                      center	
  at	
  4th	
  St	
  
 Date=12/09/10)	
                     • Rules	
                                       immediately”	
  

   Level	
  1	
  personal	
  threat	
  +	
  Level	
  3	
  Macro	
  threat	
  -­‐>	
  Immediate	
  ac0on	
  	
  
     12/5/12	
                                                                                             99	
  
•  What	
  personal	
  informa1on	
  can	
  be	
  shared?	
  
•  How	
  should	
  it	
  be	
  shared	
  to	
  benefit	
  the	
  user?	
  
•  Developing	
  an	
  architecture	
  for	
  personal	
  
   informa1on	
  management.	
  
Macro	
  situa1on	
  model	
  
                                       Asthma	
  Threat	
  
                                                                       c	
  ϵ	
  {Low,	
  mid,	
  high},	
  
                                           level	
                                [USA,	
  	
  6	
  hrs,	
  
                                                                                    0.1x	
  0.1]	
  	
  	
  




     Air	
  Quality	
                    Pollen	
  Count	
                             Allergy	
  reports	
  




            Emage	
  	
                  Emage	
  (Pollen	
                                Emage	
  (Number	
  of	
  
            (AQI.)	
                        Level)	
                                           reports)	
  




        Visual-­‐	
                              Visual-­‐	
                                            TwiOer-­‐Allergy	
  
       Air	
  quality	
                        Pollen	
  level	
  


Weather.com,	
                                                                                      TwiOer	
  API,	
  
[USA,	
  	
  6	
  hrs,	
                  Pollen.com,	
  
                                          [USA,	
  	
  6	
  hrs,	
                                  [USA,	
  	
  6	
  hrs,	
  
  0.1x	
  0.1]	
                                                                                      0.1x	
  0.1]	
  
                                            0.1x	
  0.1]	
  




                                                                                                                                 102	
  
Personal	
  
                                                                                    c	
  ϵ	
  {Low,	
  mid,	
  
                                                    threat	
  level	
                          high}	
  

                   Classifica0on:	
  
                   Thresh(30,70)	
  
                                                                          And	
  



                   Physical	
  exer0on	
                                    Asthma	
  threat	
  
                                                                                level	
  
Normalize	
                                                                                                                      Normalize	
  (0,	
  
 (0,	
  100)	
                                                                                                                      100)	
  

                                                                               TPS	
  (Asthma)	
  
                      TPS	
  (Funf)	
  

                                                                                                                                     UserLoc	
  


                        Funf-­‐ac0vity	
                                            EventShop	
  

                                                                                                                  [USA,	
  	
  6	
  hrs,	
  
                     Phone	
  sensors,	
  	
                                                                        0.1x	
  0.1]	
  
                   (relaxMinder	
  app),	
  
                       [USA,	
  	
  6	
  hrs,	
  
                         0.1x	
  0.1]	
  
                                                                                                                                                        103	
  	
  /	
  
Personal	
  
                                                      threat	
  level	
           c	
  ϵ	
  {Low,	
  mid,	
  
                                                                                             high}	
  

                   Classifica0on:	
  
                   Thresh(30,70)	
  
                                                                            And	
  


                           Physical	
                                            Asthma	
  
                           exer0on	
                                           threat	
  level	
  
Normalize	
                                                                                                              Normalize	
  
 (0,	
  100)	
                                                                                                            (0,	
  100)	
  

                                                                                     TPS	
  
                       TPS	
  (Funf)	
                                            (Asthma)	
  

                                                                                                                                 UserLoc	
  

                       Funf-­‐ac0vity	
  
                                                                                 EventShop	
  

                                	
                                                                              [USA,	
  	
  6	
  hrs,	
  
                        Phone	
  sensors,	
  	
                                                                   0.1x	
  0.1]	
  
                      (relaxMinder	
  app),	
  
                         [USA,	
  	
  6	
  hrs,	
  
                           0.1x	
  0.1]	
  




                                                                                                                                               104	
  	
  	
  	
  
Classify (Flood level - Shelter
                                      Flood         Shelter)


                Twitter


              Flood Level
                Shelter




12/5/12	
                                                      107	
  
12/5/12	
     108	
  
Proprietary	
  and	
  Confiden1al,	
  Not	
  For	
  
12/5/12	
                                                           109	
  
                              Distribu1on	
  
Outline	
  
•    Introduc1on	
  
•    Social	
  Systems	
  
•    Real	
  Time	
  Social	
  Systems	
  
•    Designing	
  Real	
  Time	
  Systems	
  
•    Situa1on	
  Recogni1on	
  
•    Concept	
  recogni1ons	
  
•    Personalized	
  Situa1ons	
  
•    EventShop	
  
• Going	
  Forward	
  
•  Social	
  observa1ons	
  are	
  now	
  possible	
  with	
  liBle	
  
   latency.	
  
•  Now	
  possible	
  to	
  design	
  social	
  systems	
  with	
  
   feedback.	
  
•  Situa1on	
  Recogni1on	
  and	
  Need-­‐Availability	
  
   iden1fica1on	
  of	
  resources	
  becomes	
  a	
  major	
  
   challenge.	
  
•  	
  EventShop	
  is	
  a	
  step	
  in	
  the	
  direc1on	
  of	
  
   implemen1ng	
  Social	
  Life	
  Networks.	
  
Useful	
  Links	
  
•  Demo:	
  
        –  hBp://auge.ics.uci.edu/eventshop	
  
•  Data	
  Defini1on	
  Language	
  Schema	
  
        –  hBp://auge.ics.uci.edu/eventshop/documents/
           EventShop_DDL_Schema	
  
•  Query	
  Language	
  Schema	
  
        –  hBp://auge.ics.uci.edu/eventshop/documents/
           EventShop_QL_Schema	
  
•  Example	
  Query	
  in	
  JSON	
  
        –  hBp://auge.ics.uci.edu/eventshop/documents/
           EventShop_Example_Query	
  

11/28/2012	
                                             112	
  
Thanks	
  for	
  your	
  1me	
  and	
  aBen1on.	
  




     For	
  ques1ons:	
  jain@ics.uci.edu	
  

More Related Content

What's hot

Neurological dimension
Neurological dimensionNeurological dimension
Neurological dimensionspasmore
 
Mind in a designed world
Mind in a designed world Mind in a designed world
Mind in a designed world Karlos Svoboda
 
Technology and cognition situated cognition2013
Technology and cognition   situated cognition2013Technology and cognition   situated cognition2013
Technology and cognition situated cognition2013Lex Pit
 
ALGIM 2009: Gov 2.0
ALGIM 2009: Gov 2.0ALGIM 2009: Gov 2.0
ALGIM 2009: Gov 2.0gnat
 
Emergent MEDIA, NEXT GEN THINKING
Emergent MEDIA, NEXT GEN THINKINGEmergent MEDIA, NEXT GEN THINKING
Emergent MEDIA, NEXT GEN THINKINGAnn DeMarle
 
Wisdom of the Crowd vs. Collective Intelligence.
Wisdom of the Crowd vs. Collective Intelligence.Wisdom of the Crowd vs. Collective Intelligence.
Wisdom of the Crowd vs. Collective Intelligence.The New School
 
Knowledge From Crowds - Better with Institutions + Algorithms
Knowledge From Crowds - Better with Institutions + AlgorithmsKnowledge From Crowds - Better with Institutions + Algorithms
Knowledge From Crowds - Better with Institutions + AlgorithmsShaun Abrahamson
 
Intro to Crowdstorming at NYU Stern School
Intro to Crowdstorming at NYU Stern SchoolIntro to Crowdstorming at NYU Stern School
Intro to Crowdstorming at NYU Stern SchoolShaun Abrahamson
 
Atlas Mapping in the Hybrid Age
Atlas Mapping in the Hybrid AgeAtlas Mapping in the Hybrid Age
Atlas Mapping in the Hybrid AgeAileen Buckley
 
No Yin Without Yang: Community Needs Civic Intelligence to be Complete
No Yin Without Yang: Community Needs Civic Intelligence to be CompleteNo Yin Without Yang: Community Needs Civic Intelligence to be Complete
No Yin Without Yang: Community Needs Civic Intelligence to be CompleteDouglas Schuler
 
Digital Media and Getting in Touch with Your Museum Audience
Digital Media and Getting in Touch with Your Museum AudienceDigital Media and Getting in Touch with Your Museum Audience
Digital Media and Getting in Touch with Your Museum AudienceTerry Burton
 
Atlas mapping in the hybrid age
Atlas mapping in the hybrid ageAtlas mapping in the hybrid age
Atlas mapping in the hybrid ageAileen Buckley
 
Innovative Failure and Digital Trends
Innovative Failure and Digital TrendsInnovative Failure and Digital Trends
Innovative Failure and Digital TrendsJoanna Beltowska
 
Objective storytelling 141106
Objective storytelling 141106Objective storytelling 141106
Objective storytelling 141106Ramesh Jain
 
Enchanted Objects: The next wave of the web
Enchanted Objects: The next wave of the webEnchanted Objects: The next wave of the web
Enchanted Objects: The next wave of the webDavid Rose
 
Accounting, Reporting, Auditing, and Analysis in a Digital Environmentintro
Accounting, Reporting, Auditing, and Analysis in a Digital EnvironmentintroAccounting, Reporting, Auditing, and Analysis in a Digital Environmentintro
Accounting, Reporting, Auditing, and Analysis in a Digital EnvironmentintroCharles Hoffman
 
HunchWorks: Combining Human Expertise and Big Data
HunchWorks: Combining Human Expertise and Big DataHunchWorks: Combining Human Expertise and Big Data
HunchWorks: Combining Human Expertise and Big DataDane Petersen
 
Free the Patterns! The Vital Challenge to the Pattern Community
Free the Patterns! The Vital Challenge to the Pattern CommunityFree the Patterns! The Vital Challenge to the Pattern Community
Free the Patterns! The Vital Challenge to the Pattern CommunityDouglas Schuler
 
Privacy tipping points 23112
Privacy tipping points 23112Privacy tipping points 23112
Privacy tipping points 23112Yoel Raban
 

What's hot (20)

Neurological dimension
Neurological dimensionNeurological dimension
Neurological dimension
 
Mind in a designed world
Mind in a designed world Mind in a designed world
Mind in a designed world
 
Technology and cognition situated cognition2013
Technology and cognition   situated cognition2013Technology and cognition   situated cognition2013
Technology and cognition situated cognition2013
 
ALGIM 2009: Gov 2.0
ALGIM 2009: Gov 2.0ALGIM 2009: Gov 2.0
ALGIM 2009: Gov 2.0
 
Emergent MEDIA, NEXT GEN THINKING
Emergent MEDIA, NEXT GEN THINKINGEmergent MEDIA, NEXT GEN THINKING
Emergent MEDIA, NEXT GEN THINKING
 
Wisdom of the Crowd vs. Collective Intelligence.
Wisdom of the Crowd vs. Collective Intelligence.Wisdom of the Crowd vs. Collective Intelligence.
Wisdom of the Crowd vs. Collective Intelligence.
 
Knowledge From Crowds - Better with Institutions + Algorithms
Knowledge From Crowds - Better with Institutions + AlgorithmsKnowledge From Crowds - Better with Institutions + Algorithms
Knowledge From Crowds - Better with Institutions + Algorithms
 
Intro to Crowdstorming at NYU Stern School
Intro to Crowdstorming at NYU Stern SchoolIntro to Crowdstorming at NYU Stern School
Intro to Crowdstorming at NYU Stern School
 
Atlas Mapping in the Hybrid Age
Atlas Mapping in the Hybrid AgeAtlas Mapping in the Hybrid Age
Atlas Mapping in the Hybrid Age
 
No Yin Without Yang: Community Needs Civic Intelligence to be Complete
No Yin Without Yang: Community Needs Civic Intelligence to be CompleteNo Yin Without Yang: Community Needs Civic Intelligence to be Complete
No Yin Without Yang: Community Needs Civic Intelligence to be Complete
 
Digital Media and Getting in Touch with Your Museum Audience
Digital Media and Getting in Touch with Your Museum AudienceDigital Media and Getting in Touch with Your Museum Audience
Digital Media and Getting in Touch with Your Museum Audience
 
Atlas mapping in the hybrid age
Atlas mapping in the hybrid ageAtlas mapping in the hybrid age
Atlas mapping in the hybrid age
 
Innovative Failure and Digital Trends
Innovative Failure and Digital TrendsInnovative Failure and Digital Trends
Innovative Failure and Digital Trends
 
Objective storytelling 141106
Objective storytelling 141106Objective storytelling 141106
Objective storytelling 141106
 
Enchanted Objects: The next wave of the web
Enchanted Objects: The next wave of the webEnchanted Objects: The next wave of the web
Enchanted Objects: The next wave of the web
 
Accounting, Reporting, Auditing, and Analysis in a Digital Environmentintro
Accounting, Reporting, Auditing, and Analysis in a Digital EnvironmentintroAccounting, Reporting, Auditing, and Analysis in a Digital Environmentintro
Accounting, Reporting, Auditing, and Analysis in a Digital Environmentintro
 
HunchWorks: Combining Human Expertise and Big Data
HunchWorks: Combining Human Expertise and Big DataHunchWorks: Combining Human Expertise and Big Data
HunchWorks: Combining Human Expertise and Big Data
 
Free the Patterns! The Vital Challenge to the Pattern Community
Free the Patterns! The Vital Challenge to the Pattern CommunityFree the Patterns! The Vital Challenge to the Pattern Community
Free the Patterns! The Vital Challenge to the Pattern Community
 
Privacy tipping points 23112
Privacy tipping points 23112Privacy tipping points 23112
Privacy tipping points 23112
 
The Future is NOW
The Future is NOWThe Future is NOW
The Future is NOW
 

Similar to Designing intelligent social systems 121205

Undiscovered Public Knowledge and IA
Undiscovered Public Knowledge and IAUndiscovered Public Knowledge and IA
Undiscovered Public Knowledge and IAJim Kalbach
 
The Modern Columbian Exchange: Biovision 2012 Presentation
The Modern Columbian Exchange: Biovision 2012 PresentationThe Modern Columbian Exchange: Biovision 2012 Presentation
The Modern Columbian Exchange: Biovision 2012 PresentationMerck
 
Making Decisions in a World Awash in Data: We’re going to need a different bo...
Making Decisions in a World Awash in Data: We’re going to need a different bo...Making Decisions in a World Awash in Data: We’re going to need a different bo...
Making Decisions in a World Awash in Data: We’re going to need a different bo...Micah Altman
 
Big Data Past, Present and Future – Where are we Headed? - StampedeCon 2014
Big Data Past, Present and Future – Where are we Headed? - StampedeCon 2014Big Data Past, Present and Future – Where are we Headed? - StampedeCon 2014
Big Data Past, Present and Future – Where are we Headed? - StampedeCon 2014StampedeCon
 
W1-Unit-1-Intro-info-fluency-81313-326pm
W1-Unit-1-Intro-info-fluency-81313-326pmW1-Unit-1-Intro-info-fluency-81313-326pm
W1-Unit-1-Intro-info-fluency-81313-326pmJill McKeon
 
Sql saturday denmark power bi for pdf
Sql saturday denmark power bi for pdfSql saturday denmark power bi for pdf
Sql saturday denmark power bi for pdfJen Stirrup
 
Real-World Behavior Analysis through a Social Media Lens
Real-World Behavior Analysis through a Social Media LensReal-World Behavior Analysis through a Social Media Lens
Real-World Behavior Analysis through a Social Media LensAli Abbasi
 
APLIC 2012: Discovering & Dealing with Data
APLIC 2012: Discovering & Dealing with DataAPLIC 2012: Discovering & Dealing with Data
APLIC 2012: Discovering & Dealing with DataHamilton Public Library
 
Social Localisation - What's your message
Social Localisation - What's your messageSocial Localisation - What's your message
Social Localisation - What's your messageThe Rosetta Foundation
 
Business considerations for privacy and open data: how not to get caught out
Business considerations for privacy and open data: how not to get caught outBusiness considerations for privacy and open data: how not to get caught out
Business considerations for privacy and open data: how not to get caught outtheODI
 
Dec 21 122112 Marshall Sponder
Dec 21 122112 Marshall SponderDec 21 122112 Marshall Sponder
Dec 21 122112 Marshall SponderMarshall Sponder
 
The Social Capital Effects: Resources, Tie Strength, & Digital Divides
The Social Capital Effects: Resources, Tie Strength, & Digital Divides The Social Capital Effects: Resources, Tie Strength, & Digital Divides
The Social Capital Effects: Resources, Tie Strength, & Digital Divides Wenhong Chen
 
The Social Capital Effects: Resources, Ties, and Digital Divides
The Social Capital Effects: Resources, Ties, and Digital DividesThe Social Capital Effects: Resources, Ties, and Digital Divides
The Social Capital Effects: Resources, Ties, and Digital DividesWenhong Chen
 
Privacy 2020 (Participants) EINS summer school
Privacy 2020 (Participants) EINS summer schoolPrivacy 2020 (Participants) EINS summer school
Privacy 2020 (Participants) EINS summer schooli_scienceEU
 
Reuben Binns: Social Knowledge and the Web
Reuben Binns: Social Knowledge and the WebReuben Binns: Social Knowledge and the Web
Reuben Binns: Social Knowledge and the WebPhiloWeb
 
Dionne lew libmark
Dionne lew libmarkDionne lew libmark
Dionne lew libmarkLibmark
 

Similar to Designing intelligent social systems 121205 (20)

SMART Seminar: Massively Interacting Systems
SMART Seminar: Massively Interacting SystemsSMART Seminar: Massively Interacting Systems
SMART Seminar: Massively Interacting Systems
 
Undiscovered Public Knowledge and IA
Undiscovered Public Knowledge and IAUndiscovered Public Knowledge and IA
Undiscovered Public Knowledge and IA
 
In the Pursuit of that "Moment of Insight"
In the Pursuit of that "Moment of Insight"In the Pursuit of that "Moment of Insight"
In the Pursuit of that "Moment of Insight"
 
The Modern Columbian Exchange: Biovision 2012 Presentation
The Modern Columbian Exchange: Biovision 2012 PresentationThe Modern Columbian Exchange: Biovision 2012 Presentation
The Modern Columbian Exchange: Biovision 2012 Presentation
 
Making Decisions in a World Awash in Data: We’re going to need a different bo...
Making Decisions in a World Awash in Data: We’re going to need a different bo...Making Decisions in a World Awash in Data: We’re going to need a different bo...
Making Decisions in a World Awash in Data: We’re going to need a different bo...
 
Social Responsibility 1
Social Responsibility 1Social Responsibility 1
Social Responsibility 1
 
Big Data Past, Present and Future – Where are we Headed? - StampedeCon 2014
Big Data Past, Present and Future – Where are we Headed? - StampedeCon 2014Big Data Past, Present and Future – Where are we Headed? - StampedeCon 2014
Big Data Past, Present and Future – Where are we Headed? - StampedeCon 2014
 
W1-Unit-1-Intro-info-fluency-81313-326pm
W1-Unit-1-Intro-info-fluency-81313-326pmW1-Unit-1-Intro-info-fluency-81313-326pm
W1-Unit-1-Intro-info-fluency-81313-326pm
 
Sql saturday denmark power bi for pdf
Sql saturday denmark power bi for pdfSql saturday denmark power bi for pdf
Sql saturday denmark power bi for pdf
 
Real-World Behavior Analysis through a Social Media Lens
Real-World Behavior Analysis through a Social Media LensReal-World Behavior Analysis through a Social Media Lens
Real-World Behavior Analysis through a Social Media Lens
 
APLIC 2012: Discovering & Dealing with Data
APLIC 2012: Discovering & Dealing with DataAPLIC 2012: Discovering & Dealing with Data
APLIC 2012: Discovering & Dealing with Data
 
Social Localisation - What's your message
Social Localisation - What's your messageSocial Localisation - What's your message
Social Localisation - What's your message
 
Business considerations for privacy and open data: how not to get caught out
Business considerations for privacy and open data: how not to get caught outBusiness considerations for privacy and open data: how not to get caught out
Business considerations for privacy and open data: how not to get caught out
 
Dec 21 122112 Marshall Sponder
Dec 21 122112 Marshall SponderDec 21 122112 Marshall Sponder
Dec 21 122112 Marshall Sponder
 
The Social Capital Effects: Resources, Tie Strength, & Digital Divides
The Social Capital Effects: Resources, Tie Strength, & Digital Divides The Social Capital Effects: Resources, Tie Strength, & Digital Divides
The Social Capital Effects: Resources, Tie Strength, & Digital Divides
 
The Social Capital Effects: Resources, Ties, and Digital Divides
The Social Capital Effects: Resources, Ties, and Digital DividesThe Social Capital Effects: Resources, Ties, and Digital Divides
The Social Capital Effects: Resources, Ties, and Digital Divides
 
Privacy 2020 (Participants) EINS summer school
Privacy 2020 (Participants) EINS summer schoolPrivacy 2020 (Participants) EINS summer school
Privacy 2020 (Participants) EINS summer school
 
Reuben Binns: Social Knowledge and the Web
Reuben Binns: Social Knowledge and the WebReuben Binns: Social Knowledge and the Web
Reuben Binns: Social Knowledge and the Web
 
Dionne lew libmark
Dionne lew libmarkDionne lew libmark
Dionne lew libmark
 
Dionne lew libmark
Dionne lew libmarkDionne lew libmark
Dionne lew libmark
 

More from Ramesh Jain

Self Health 231006 presented at HKPoly.pptx
Self Health 231006 presented at HKPoly.pptxSelf Health 231006 presented at HKPoly.pptx
Self Health 231006 presented at HKPoly.pptxRamesh Jain
 
Multimodal Augmented Homeostasis; MMM2023 Keynote RJ.pptx
Multimodal Augmented Homeostasis; MMM2023 Keynote RJ.pptxMultimodal Augmented Homeostasis; MMM2023 Keynote RJ.pptx
Multimodal Augmented Homeostasis; MMM2023 Keynote RJ.pptxRamesh Jain
 
Food health society ashoka 210918
Food health society   ashoka 210918Food health society   ashoka 210918
Food health society ashoka 210918Ramesh Jain
 
Multimodal augmented homeostasis 200925 final
Multimodal augmented homeostasis 200925  finalMultimodal augmented homeostasis 200925  final
Multimodal augmented homeostasis 200925 finalRamesh Jain
 
Towards enjoyable healthy food 200817
Towards enjoyable healthy food 200817Towards enjoyable healthy food 200817
Towards enjoyable healthy food 200817Ramesh Jain
 
Eat, Drink, and Enjoy!
Eat, Drink, and Enjoy!Eat, Drink, and Enjoy!
Eat, Drink, and Enjoy!Ramesh Jain
 
Jain Socal HIMSS keynote 1805018
Jain Socal HIMSS keynote 1805018Jain Socal HIMSS keynote 1805018
Jain Socal HIMSS keynote 1805018Ramesh Jain
 
Rj imminent transformations in health shanghai 170510
Rj imminent transformations in health shanghai 170510Rj imminent transformations in health shanghai 170510
Rj imminent transformations in health shanghai 170510Ramesh Jain
 
ISM 2016 keynote on computing lifestyle 161211
ISM 2016 keynote on computing lifestyle 161211ISM 2016 keynote on computing lifestyle 161211
ISM 2016 keynote on computing lifestyle 161211Ramesh Jain
 
Multimedia rescue 161018
Multimedia rescue 161018Multimedia rescue 161018
Multimedia rescue 161018Ramesh Jain
 
Personal lifestyle and health 161014
Personal lifestyle and health 161014Personal lifestyle and health 161014
Personal lifestyle and health 161014Ramesh Jain
 
Micro reports and Situation Recognition at social machines workshop
Micro reports and Situation Recognition at social machines workshopMicro reports and Situation Recognition at social machines workshop
Micro reports and Situation Recognition at social machines workshopRamesh Jain
 
Objective self modeling real you
Objective self  modeling real youObjective self  modeling real you
Objective self modeling real youRamesh Jain
 
Visual Web keynote at MMSP 2015
Visual Web keynote at MMSP 2015Visual Web keynote at MMSP 2015
Visual Web keynote at MMSP 2015Ramesh Jain
 
ICSC2015 KeyNote: Semantic links in visual web
ICSC2015 KeyNote: Semantic links in visual webICSC2015 KeyNote: Semantic links in visual web
ICSC2015 KeyNote: Semantic links in visual webRamesh Jain
 
Multimedia big data 140619
Multimedia big data 140619Multimedia big data 140619
Multimedia big data 140619Ramesh Jain
 
From health persona to societal health uci 131202
From health persona to societal health  uci  131202From health persona to societal health  uci  131202
From health persona to societal health uci 131202Ramesh Jain
 
Building Social Life Networks 130818
Building Social Life Networks 130818Building Social Life Networks 130818
Building Social Life Networks 130818Ramesh Jain
 
Situation recognition acm mm 121029
Situation recognition acm mm 121029Situation recognition acm mm 121029
Situation recognition acm mm 121029Ramesh Jain
 

More from Ramesh Jain (20)

Self Health 231006 presented at HKPoly.pptx
Self Health 231006 presented at HKPoly.pptxSelf Health 231006 presented at HKPoly.pptx
Self Health 231006 presented at HKPoly.pptx
 
Multimodal Augmented Homeostasis; MMM2023 Keynote RJ.pptx
Multimodal Augmented Homeostasis; MMM2023 Keynote RJ.pptxMultimodal Augmented Homeostasis; MMM2023 Keynote RJ.pptx
Multimodal Augmented Homeostasis; MMM2023 Keynote RJ.pptx
 
Food health society ashoka 210918
Food health society   ashoka 210918Food health society   ashoka 210918
Food health society ashoka 210918
 
Multimodal augmented homeostasis 200925 final
Multimodal augmented homeostasis 200925  finalMultimodal augmented homeostasis 200925  final
Multimodal augmented homeostasis 200925 final
 
Towards enjoyable healthy food 200817
Towards enjoyable healthy food 200817Towards enjoyable healthy food 200817
Towards enjoyable healthy food 200817
 
Eat, Drink, and Enjoy!
Eat, Drink, and Enjoy!Eat, Drink, and Enjoy!
Eat, Drink, and Enjoy!
 
Jain Socal HIMSS keynote 1805018
Jain Socal HIMSS keynote 1805018Jain Socal HIMSS keynote 1805018
Jain Socal HIMSS keynote 1805018
 
Rj imminent transformations in health shanghai 170510
Rj imminent transformations in health shanghai 170510Rj imminent transformations in health shanghai 170510
Rj imminent transformations in health shanghai 170510
 
ISM 2016 keynote on computing lifestyle 161211
ISM 2016 keynote on computing lifestyle 161211ISM 2016 keynote on computing lifestyle 161211
ISM 2016 keynote on computing lifestyle 161211
 
Multimedia rescue 161018
Multimedia rescue 161018Multimedia rescue 161018
Multimedia rescue 161018
 
Personal lifestyle and health 161014
Personal lifestyle and health 161014Personal lifestyle and health 161014
Personal lifestyle and health 161014
 
Micro reports and Situation Recognition at social machines workshop
Micro reports and Situation Recognition at social machines workshopMicro reports and Situation Recognition at social machines workshop
Micro reports and Situation Recognition at social machines workshop
 
Objective self modeling real you
Objective self  modeling real youObjective self  modeling real you
Objective self modeling real you
 
Acmmm15 jalali
Acmmm15 jalaliAcmmm15 jalali
Acmmm15 jalali
 
Visual Web keynote at MMSP 2015
Visual Web keynote at MMSP 2015Visual Web keynote at MMSP 2015
Visual Web keynote at MMSP 2015
 
ICSC2015 KeyNote: Semantic links in visual web
ICSC2015 KeyNote: Semantic links in visual webICSC2015 KeyNote: Semantic links in visual web
ICSC2015 KeyNote: Semantic links in visual web
 
Multimedia big data 140619
Multimedia big data 140619Multimedia big data 140619
Multimedia big data 140619
 
From health persona to societal health uci 131202
From health persona to societal health  uci  131202From health persona to societal health  uci  131202
From health persona to societal health uci 131202
 
Building Social Life Networks 130818
Building Social Life Networks 130818Building Social Life Networks 130818
Building Social Life Networks 130818
 
Situation recognition acm mm 121029
Situation recognition acm mm 121029Situation recognition acm mm 121029
Situation recognition acm mm 121029
 

Recently uploaded

Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designMIPLM
 
Transaction Management in Database Management System
Transaction Management in Database Management SystemTransaction Management in Database Management System
Transaction Management in Database Management SystemChristalin Nelson
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...Nguyen Thanh Tu Collection
 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPCeline George
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)lakshayb543
 
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Celine George
 
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptxAUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptxiammrhaywood
 
4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptxmary850239
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxthorishapillay1
 
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...Postal Advocate Inc.
 
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfGrade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfJemuel Francisco
 
ACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdfACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdfSpandanaRallapalli
 
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYKayeClaireEstoconing
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfErwinPantujan2
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPCeline George
 
Concurrency Control in Database Management system
Concurrency Control in Database Management systemConcurrency Control in Database Management system
Concurrency Control in Database Management systemChristalin Nelson
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatYousafMalik24
 

Recently uploaded (20)

Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-design
 
Transaction Management in Database Management System
Transaction Management in Database Management SystemTransaction Management in Database Management System
Transaction Management in Database Management System
 
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptxYOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
 
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERP
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
 
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
 
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptxAUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
 
4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptx
 
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
 
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfGrade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
 
ACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdfACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdf
 
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
 
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptxLEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERP
 
Concurrency Control in Database Management system
Concurrency Control in Database Management systemConcurrency Control in Database Management system
Concurrency Control in Database Management system
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice great
 

Designing intelligent social systems 121205

  • 1. 12/5/12   1  
  • 2. •  Social  systems  rely  on  primi0ve  technology.   •  Big  Data  has  opened  Big  Opportuni0es.   •  Situa0on  recogni0on  is  a  key  technology.   •  EventShop  may  be  useful  in  designing   Intelligent  Social  Systems.  
  • 3. Send:   •  Comments.   •  Sugges1ons.   •  Collabora1on  opportuni1es.     •  jain@ics.uci.edu   •  Gmail,  FB,  TwiBer:  jain49  
  • 4. Intelligent:    displaying  or  characterized  by   quickness  of  understanding,  sound  thought,  or   good  judgment.     Social  Systems:  Social  systems  are  the  paBerns   of  behavior  of  a  group  of  people  possessing   similar  characteris1cs  due  to  their  existence  in   same  society.      
  • 5. •  Introduc1on   •  Social  Systems   •  Intelligent  Social  Systems   •  Designing  Intelligent  Social  Systems   •  Situa1on  Recogni1on   •  Concept  recogni1ons   •  Personalized  Situa1ons   •  EventShop  
  • 6. An  Interes0ng  Situa0on     When  we  were  data  poor  –   we  searched  for  words  in   documents.     Now  that  we  are  data  rich  –   should  we  s0ll  search  for   words?     Time  has  come  for  us  to  stop  thinking  data  poor;  really  start   thinking  and  behaving  data  rich.  
  • 7. Variety   Volume   Big  Data  offers  Big  Opportuni4es.   But,  ….  ?????   7  
  • 8. Most  aOen0on  by   Top  1.5   Technologists  –  so  far.   Billion   Middle    4  Billion     Middle  of  the   Pyramid  (MOP):     Ready.   BoOom  2  Billion   Not  Ready  
  • 9. Data  is  Essen0al.       But,  we  are  really  interested  in  its  products:      Informa0on,      Knowledge,  and      Wisdom.   9    
  • 10. Recognize   Objects   Situa0ons   Knowledge   Observe   Big  Data   Act   Planning   12/5/12   Control   10  
  • 11. Past is EXPERIENCE Present is EXPERIMENT Future is EXPECTATION Use your Experiences In your Experiments To achieve your Expectations 12/5/12   11  
  • 12.      Astrology   To   Astronomical   Volumes  of   Data     12/5/12   12  
  • 13. We  are  immersed  in  Networks  of   •  People   •  Things   •  Events   It  is  now  possible  to  be  Pansophical.     12/5/12   13  
  • 14. Our  mobile  wireless  infrastructure  can  be   “reality  mined”  to  understand  the  paOerns  of   human  behavior,  monitor  our  environments,   and  plan  social  development.       -­‐-­‐-­‐-­‐  Pentland  in    “Society’s  Nervous  System:   Building  Effec0ve  Government,  Energy,  and   Public  Health  Systems”   Proprietary  and  Confiden1al,  Not  For   12/5/12   14   Distribu1on  
  • 15. •  Objects  -­‐-­‐  popular  in  the  West.   •  Rela0onships  and  Events  –  popular  in  the  East.   •  Objects  and  Events  –  seems  to  be  the  new  trend.   •  The  Web  has  re-­‐emphasized  the  importance  of   every  object  and  event  being  connected  to  others     -­‐-­‐  East  Meets  West.   Geography  of  Thought  by  Richard  NisbeB  
  • 16. •  Data     •  Objects     •  Rela0onships  and  Events  
  • 17. •  Take  place  in  the  real  world.   •  Captured  using  different  sensory  mechanism.   –  Each  sensor  captures  only  a  limited  aspect  of  the   event.   •  Can  be  used  to  bridge  the  seman1c  gap.  
  • 18. Events:  Types  and  Granulari1es   •  Conferences   –  Days   •  Sessions   –  Talks   »  Purpose  of  the  talk   •  Wedding   •  An  Earthquake   •  The  Big  Bang   •  World  Wide  Web   •  Yahoo:  Winter  School  2012   •  Me   –  My  Birth,     –  Being  here,  and     –  Dying  in  100  years.  
  • 19. People   Things   Places   Time   Experiences   Events   E    by  Westerman  and    Jain     E*  by  Gupta  and  Jain  
  • 20. Sense  making  from  mul1modal   massive  geo-­‐social  data-­‐streams.     20  
  • 21.   •  Introduc1on   • Social  Systems   •  Intelligent  Social  Systems   •  Designing  Intelligent  Systems   •  Situa1on  Recogni1on   •  Concept  recogni1ons   •  Personalized  Situa1ons   •  EventShop  
  • 22. Poli0cs   Religion   Educa0on   Health   Economics  
  • 23. Connec4ng  People  to  Resources     effec4vely,  efficiently,  and  promptly     in  given  situa4ons.  
  • 24. •  Minimize  hunger  in  the  world.   •  Maximize  female  educa1on  in  India.   •  Minimize  ‘deaths’  in  the  coming  hurricane  in   Florida.   •  Minimize  work-­‐hours  lost  in  traffic  during   week  days  in  Bangalore.  
  • 25. •  System:   –     A  set  of  diverse  parts  forming  a  whole.   –  Parts  are  put  together  with  a  common  objec1ve/ purpose.   •  Each  part  could  be  considered  a  system.   •  Each  part  plays  a  role  towards  the  system   objec1ve.   •  Designing  the  informa1on  flow  among  parts  is   essen1al  to  make  a  system  work  apprpriately.    
  • 26. •  A  social  system  is  composed  of  persons  or   groups  who  share  a  common  objec1ve.   •  An  individual  objec1ve  is  usually  a  part  of  the   group’s  objec1ve.    
  • 27. •  Persons   •  Families   •  Organiza1ons   •  Communi1es:  City,  State,  Country   •  Socie1es   •  Cultures  
  • 28. •  Top  Down:   –  The  social  system  determines  its  parts.   –  People’s  behavior  determined  by  society.   •  BoBom  Up:   –  The  Society  is  the  sum  of  its  indivduals   –  Individual  ac1ons  determine  the  character  of  the   society.  
  • 29. •  Each  social  en1ty  is  a  holon.   •  Holon:  Each  en1ty  is  simultaneously  a  part  and  a   whole.   •  A  social  component  is  made  up  of  parts  and  at  the   same  1me  maybe  part  of  some  larger  whole.   •  Any  system  is  by  defini1on  both  part  and  whole.  
  • 30. •  The  primary  ‘currency’    of  a  social  system  is   informa1on.   •  System  behavior  can  be  understood  as  the   movement  of  informa1on:   –  Within  a  system   –  Between  the  system  and  its  environment   •  Informa1on  is  used  to  sense  as  well  as  to  control  or   act.  
  • 31.   •  Introduc1on   •  Social  Systems   •  Intelligent  Social  Systems   •  Designing  Intelligent  Systems   •  Situa1on  Recogni1on   •  Concept  recogni1ons   •  Personalized  Situa1ons   •  EventShop  
  • 32. •  Systems  that  perceive,  reason,  learn,  and  act   intelligently.   •  Adaptability  to  varying  environmental   situa1ons  is  a  key  element  of  intelligent   systems  
  • 33. •  Social  systems  that  perceive,  reason,  learn,   and  act  intelligently.   •  What  does  ‘perceive’,  ‘reason’,  ‘learn’,  and   ‘act’  mean  in  the  context  of  social  systems?  
  • 34.
  • 35.   •  Introduc1on   •  Social  Systems   •  Intelligent  Social  Systems   • Designing  Intelligent  Social   Systems   •  Situa1on  Recogni1on   •  Concept  recogni1ons   •  Personalized  Situa1ons   •  EventShop  
  • 36.
  • 37.
  • 38.
  • 39.
  • 40.
  • 41. •  Desired  state  (Goal)   •  System  model  and  Control  Signal   (Ac0ons)   •  Current  State  (for  Feedback)  
  • 42.   bserve d  State   O Fe edback Observa0ons   Control   Signals   Events   Real  World  
  • 43.
  • 44. Social  Networks     Connecting People
  • 45. Needs  and  Resources   Not  even   FaceBook!  
  • 46. Current    Social   Networks   Important   Unsa1sfied     Needs   12/5/12   46  
  • 47. •  Resources     –  Physical:  food,  water,  goods,  …   –  Informa:onal:  Wikipedia,  Doctors,  …   –  Transporta:on   –  Employment   –  Spiritual   •  Timeliness   •  Efficiency  
  • 48. Connecting Information     People Aggregation Situation Alerts and Detection CompositionAnd Queries Resources 12/5/12   48  
  • 49.   •  Introduc1on   •  Social  Systems   •  Intelligent  Social  Systems   •  Designing  Intelligent  Systems   • Situa0on  Recogni0on   •  Concept  recogni1ons   •  Personalized  Situa1ons   •  EventShop  
  • 50. Connec4ng  People  to  Resources     effec4vely,  efficiently,  and  promptly     in  given  situa4ons.  
  • 51. •  rela1ve  posi1on  or  combina1on  of   circumstances  at  a  certain  moment.   •  The  combina1on  of  circumstances  at  a  given   moment;  a  state  of  affairs.  
  • 52. •  Situa1on  awareness,  or  SA,  is  the  percep1on   of  environmental  elements  within  a  volume  of   1me  and  space,  the  comprehension  of  their   meaning,  and  the  projec1on  of  their  status  in   the  near  future.   •  What  is  happening  around  you  to  understand   how  informa1on,  events,  and  your  own   ac1ons  will  impact  your  goals  and  objec1ves,   both  now  and  in  the  near  future.  
  • 53. •  Example  1:     –  A  person  shou1ng.   –  1000  people  shou1ng.   •  In  a  contained  building   •  In  main  parts  of  a  city   •  Example  2:   –  One  person  complaining  about  flu.   –  Many  people  from  different  areas  of  a  country   complaining  about  flu.  
  • 54. Facebook  and  TwiBer   (now  GOOGLE  +)   Have  been  repor0ng  events  as  micro-­‐blogs   Massive  collec1on  of  events.  
  • 56. Does  the  flap  of  a  buEerfly’s  wings  in  Brazil  set  off  a   tornado  in  Texas?        
  • 57. Have  been  repor0ng  events  as  micro-­‐blogs   Sensors  and  Internet  of  Things  are  crea1ng  and   repor1ng    even  more  events  than  humans   are.   12/5/12   57  
  • 58. FROM TWEETS TO REVOLUTIONS
  • 59. Atomic  and  Composite  Events   Time  
  • 60. •  Given  a  plethora  of  event  data.  How  can  we:   –  Disambiguate  relevant  and  irrelevant  events?   –  Combine  events  into  meaningful  representa1ons  ?   –  Allow  inference  and  cascading  effects?   –  Support  different  interpreta1ons  based  on   applica1on  domain?   –  Support  Control  &  decision  making?    
  • 61. 1.  Inherent  support  for  event-­‐based  (temporal)   reasoning   2.  The  ability  of  the  controller  to  reason  based   on  symbols  (rather  than  just  signals)   3.  Explicit  inclusion  of  domain  seman1cs  (to   support  mul1ple  applica1ons)  
  • 62. An  ac4onable  abstrac4on  of  observed   spa4o-­‐temporal  characteris0cs.   62  
  • 63.   •  Introduc1on   •  Social  Systems   •  Intelligent  Social  Systems   •  Designing  Intelligent  Systems   •  Situa1on  Recogni1on   • Concept  recogni0ons   •  Personalized  Situa1ons   •  EventShop  
  • 64. Data  Type   1950   2000   Time  Line  
  • 65. Situa0on     2010   Events     Data  Type   1986   Objects     1963   Speech   1962   Character   1959   1950   2000   Time  Line  
  • 66. Loca1on   Scenes   Environm Trajectories   Situa1ons   aware   ents   Single  Media   Loca1on   Visual   Real  world   Visual   Objects   Objects   Ac1vi1es   Events   unaware   Sta1c   Dynamic   SPACE   TIME   Data  =  Text  or  Images  or  Video   66  
  • 67. Trajectory   Situa1on   Object   Scene   Event   1960   1970   1980   1990   2000   2010   •  1963:  Object  Recogni1on  [Lawrence  +  Roberts]   •  1967:  Scene  Analysis  [Guzman]   •  1984:  Trajectory  detec1on  [Ed  Chang+  Kurz]   •  1986:  Event  Recogni1on  [Haynes  +  Jain]   •  1988:  Situa1on  Recogni1on  [Dickmanns]  
  • 68. Heterogeneous  Media   Loca1on   Environm Situa1ons   aware   ents   Loca1on   Real  world   Objects   Ac1vi1es   unaware   Sta1c   Dynamic   SPACE   TIME   Data  is  just  Data.   Meta-­‐data  is  also  data.    Caste  system  does  not  exist  here.   Medium  and  sources  do  not  maOer.   68  
  • 69.   •  Introduc1on   •  Social  Systems   •  Real  Time  Social  Systems   •  Designing  Real  Time  Systems   •  Situa1on  Recogni1on   •  Concept  recogni1ons   • Personalized  Situa0ons   •  EventShop  
  • 70. A)  Situa0on  Modeling   B)  Situa0on  Recogni0on   C)  Visualiza0on,  Personaliza0on, and  Alerts   i)  Visualiza1on   C1   …   ⊕ v2   v3   Personal   context   ii)  Personaliza1on   Personali v5   v6   zed   STT  Stream   situa1on   Available   resources   Emage   iii)  Alerts   Situa1on   70        
  • 71. Proprietary  and  Confiden1al,  Not  For   12/5/12   71   Distribu1on  
  • 72.
  • 73. Aggrega1on,     Opera1ons   Alert  level     =  High   Date:  3rd  Jun,  2011   STT  data   Situa1on  Detec1on       User-­‐Feedback   1)      Classifica1on     Tweet:     ‘Please  visit  Dr.  Cureit  at   ‘Urrgh…  sinus’     2)      Control  ac1on   4th  St  immediately’       Loc:  NYC,   Date:  3rd  Jun,  2011   Theme:  Allergy   73  
  • 74.
  • 75.   •  Introduc1on   •  Social  Systems   •  Intelligent  Social  Systems   •  Designing  Intelligent  Systems   •  Situa1on  Recogni1on   •  Concept  recogni1ons   •  Personalized  Situa1ons   • EventShop  
  • 76. •  E-­‐mage             –  Visualiza1on   –  Intui1ve  query  and  mental  model   –  Common  spa1o  temporal  data  representa1on   –  Data  analysis  using  media  processing  operators     (e.g.  segmenta1on,  background  subtrac1on,   convolu1on)   76        
  • 77. •  Spa1o-­‐temporal  element   –  STTPoint  =  {s-­‐t-­‐coord,  theme,  value,  pointer}   •  E-­‐mage   –  g  =  (x,  {(tm,  v(x))}|xϵ X  =  R2  ,  tm ϵ  θ,  and  v(x)  ϵ  V  =  N)   •  Temporal  E-­‐mage  Stream   –  TES=((ti,  gi),  ...,  (tk,  gk))   •  Temporal  Pixel  Stream   –  TPS  =  ((ti,  pi),  ...,  (tk,  pk))   77  
  • 78. Proprietary  and  Confiden1al,  Not  For   12/5/12   78   Distribu1on  
  • 79. Proprietary  and  Confiden1al,  Not  For   12/5/12   79   Distribu1on  
  • 80. Retail  Store   Loca0ons   Net  Catchment   area   Proprietary  and  Confiden1al,  Not  For   12/5/12   80   Distribu1on  
  • 81. •  Humans  as  sensors   •  Space  +  Time  as  fundamental  axes     •  Real  0me  situa0on  evalua0on  (E-­‐mage  Streams)   (a) Pollen levels (Source: Visual) (b) Census data (Source: text file) (c) Reports on ‘Hurricanes’ (source: Twitter stream)   d) Cloud cover (Source: Satellite imagery) (e) Predicted hurricane path (source: KML) (f) Open shelters coverage(Source: KML)   81  
  • 82. •  Help  domain  experts  externalize  their  internal   models  of  situa1ons  of  interest  e.g.  epidemic.   •  Building  blocks:     –  Operators     –  Operands     •  Wizard:     –  A  prescrip1ve  approach  for  modeling  situa1ons  using  the   operators  and  operands     Singh,  Gao,  Jain:  Situa:on  recogni:on:  An  evolving  problem  for  heterogeneous  dynamic  big   82   mul:media  data,  ACM  Mul0media  ‘12.  
  • 83.  Knowledge  or  data  driven  building  blocks   Growth  rate     (Flu  reports)   Feature   TwiBer-­‐Flu   Data  source   -­‐Emage  (#Reports)   Representa1on  level   Thresholds   (0,  50)   Meta-­‐data   83  
  • 84. Get_components (v){ v ϵ  {  Low,   Mid,  High}   f1   ⊕   1)  Identify output state space <USA,    5  mins,   0.01x  0.01>     2)  Identify S-T bounds v2   v3   3)  Define component f2   v4   @ ⊕ ∏ features: v=f(v1, …, vk) Emage   v5   v6   Emage   •  If (type = imprecise) ∏ @ Δ Δ –  identify learning data source, method     4)  ForEach (feature vi) { D1   Emage   Emage   D2        If (atomic) Δ Δ •  Identify Data source. D2   D3   •  Type, URL, ST bounds •  Identify highest Rep. level reqd. •  Identify operations Else Get_components(vi) 84  
  • 85. 3)  Instan1ate   2)  Revise   1) Model     Epidemic   ϵ  {Low,  mid,  high},   Outbreaks     <USA,  5  mins,  0.01x   Classifica1on:   0.01>   Thresh  (30,70)   Growing  Unusual   ac1vity   Mul1ply   Unusual   Ac1vity?   Growth  Rate   Subtract   Historical   Current  ac1vity   Emage     ac1vity  level   level   (#reports  ILI)   Subtract   Normalize   Emage  (Historical   [0,100]   avg)   Emage  Emage     TwiBer-­‐Flu     Emage   (#reports  ILI)   (#reports  ILI)   (popula1on)   TwiBer.com   <USA,  5  mins,     TwiBer-­‐Avg   0.01x  0.01>   DB,     TwiBer.com   TwiBer-­‐Flu   CSV-­‐   Census.gov,     TwiBer.com   TwiBer-­‐Flu   <USA,  5  mins,     <USA,  5  mins,     Popula1on   <USA,  5  mins,     <USA,  5  mins,     0.01x  0.01>   0.01x  0.01>   0.01x  0.01>   85         0.01x  0.01>  
  • 86. Level  0:  Raw  data  streams     e.g.  tweets,  cameras,  traffic,  weather,  …   …   Level  1:  Unified   representa1on   Proper1es (STT  Data)   STT  Stream   Level  2:   Aggrega1on   Proper1es Emage   (Emage)     Opera1ons   Level  3:   Symbolic  rep.   Proper1es Situa1on   (Situa1ons)   86  
  • 87. Suppor1ng   Operator  Type   Data   parameter(s)   Output   Filter   + Mask   Aggregate   + Classifica1on   Classifica1on   method   Characteriza1on   Property     Growth  Rate   required   =  125%   PaBern  Matching   + 72%   PaBern   87        
  • 88. Suppor1ng   Operator  Type   Data   parameter(s)   Output   1)  Data  into  right   representa1on   Transform   …   Spa1o-­‐temporal   window   Filter   + Mask   Aggregate   + 2)  Analyze  data  to   Classifica1on   derive  features     Classifica1on   method   Characteriza1on   Property     Growth  Rate   required   =  125%   PaBern  Matching   + PaBern 72%     {Features}   3)  Use  features  to   Learn   f   Learning     f   evaluate  situa1ons   {Situa1on}   method   88        
  • 89. S.  No Operator Input Output 1 Filter  ∏ Temporal  E-­‐mage  Stream Temporal    E-­‐mage  Stream 2 Aggrega0on  ⊕ K*Temporal  E-­‐mage  Stream Temporal  E-­‐mage  Stream 3 Classifica0on  γ Temporal  E-­‐mage  Stream Temporal  E-­‐mage  Stream 4 Characteriza0on  :  @           •  Spa0al     •  Temporal  E-­‐mage  Stream   •  Temporal  Pixel  Stream   •  Temporal   •  Temporal  Pixel  Stream •  Temporal  Pixel  Stream 5 PaOern  Matching  ψ           •  Spa0al     •  Temporal  E-­‐mage  Stream   •  Temporal  Pixel  Stream   •  Temporal   •  Temporal  Pixel  Stream •  Temporal  Pixel  Stream Singh, Gao, Jain: Social Pixels: Genesis and Evaluation, ACM Multimedia 89   ‘10.  
  • 90. •  Select  E-­‐mages  of  US  for  theme  ‘Obama’.   –  ∏spa1al(region=[24,-­‐125],[24,-­‐65])   (TEStheme=Obama)   •  Iden1fy  3  clusters  for  each  E-­‐mage  above.   –  γkmeans(3)  (∏spa1al(region=[24,-­‐125],[24,-­‐65])(TEStheme=Obama))   •  Show  me  the  speed  for  each  cluster  of  ‘Katrina’  e-­‐ mages   ( –  @speed @epicenter (γkmeans(n=3)  (∏spa1al(region=[24,-­‐125],[24,-­‐65])  (TEStheme=Katrina))))   •  How  similar  is  paBern  above  to  ‘exponen1al  increase’?   –  ψexp-­‐increase(@speed(@epicenter(γkmeans(n=3)  (∏spa1al(region=[24,-­‐125],[24,-­‐65])   (TEStheme=Katrina))))   90  
  • 91. Personalized  situa0on:  An  ac4onable  integra4on  of   a  user's  personal  context  with  surrounding   spa4otemporal  situa4on.   1)  Macro   situa0on Macro     Personal   2)  Personalized   data-­‐sources   Context   situa0on Profile  +   Preferences     3)  Personalized   alerts   User     Available   data   resources   Resource   data   IF  person  ui  <is-­‐in>  (PSj)  THEN  <connect-­‐to>  rk       91  
  • 92. Personalized  Situa1on  Recogni1on:   Operators   Suppor1ng   Operator  Type   Data   parameter(s)   Output   Filter   …   + User  loca1on   Aggregate   …   + …   …   Classifica1on   Classifica1on   …   method …     Characteriza1on   …   Property     Growth  Rate   required   =  125%   PaBern  Matching   …   + Match=  42%   PaBern   92        
  • 93. •  IF   𝑢𝑖   𝑖𝑠𝑖𝑛   𝑧𝑗     𝑇𝐻𝐸𝑁   𝑐𝑜𝑛𝑛𝑒𝑐𝑡  ( 𝑢𝑖,   𝑛𝑒𝑎𝑟𝑒𝑠𝑡(𝑢𝑖,   𝑟𝑘))     1)  𝑖 𝑠𝑖𝑛(𝑢𝑖,   𝑧𝑗)  → 𝑚𝑎𝑡𝑐ℎ( 𝑢𝑖,   𝑟𝑘))                         𝑓:( 𝑈× 𝑍)→( 𝑈× 𝑅)   •  U  =  Users     •  Z  =  Personalized  Situa1ons   •  R  =  Resources   2)  𝑛 𝑒𝑎𝑟𝑒𝑠𝑡(𝑢𝑖,   𝑟𝑘)= 𝑎𝑟𝑔𝑚𝑖𝑛  ( 𝑢𝑖. 𝑙𝑜𝑐,     𝑟𝑘. 𝑙𝑜𝑐𝑠)   93  
  • 94. Billions  of  data  sources.     Selec0ng  and  combining  appropriate  sources  to   detect  situa0ons.     Interac0ons  with  different  types  of  Users    Decision  Makers                        Individuals     12/5/12   94  
  • 95. 12/5/12   95  
  • 96. Front  End  GUI New New E-­‐mage Alert Data Query Stream Request Source Back  End  Controller E-­‐mage  Stream Personalized   Registered Stream  Query  Processor Queries Alert  Unit E-­‐mage  Stream User  Info Registered Data Data  Ingestor Raw  Data Storage Sources API  Calls Raw  Spatial   Data  Stream Data  Cloud 12/5/12   96  
  • 97. 11/28/2012   97  
  • 98. Emage -­‐theme  :  String STTPoint -­‐start  :  Date -­‐theme  :  String -­‐end  :  Date -­‐value  :  double -­‐latUnit  :  double Iterator -­‐start  :  Date Iterator -­‐longUnit  :  double Iterator -­‐end  :  Date -­‐swLat  :  double -­‐latUnit  :  double -­‐swLong  :  double +hasNext()  :  bool -­‐longUnit  :  double +hasNext()  :  bool -­‐neLat  :  double +hasNext()  :  bool +next()  :  <unspecified> -­‐latitude  :  double +next()  :  <unspecified> -­‐neLong  :  double +next()  :  <unspecified> -­‐longitude  :  double -­‐image FrameParameters -­‐timeWindow  :  long 1..* 1..* -­‐syncTime  :  long -­‐latUnit  :  double -­‐Parameterize STTPointIterator EmageIterator STMerger -­‐longUnit  :  double -­‐swLat  :  double +hasNext()  :  bool 1 1 +hasNext()  :  bool 1..* 1 +hasNext()  :  bool -­‐swLong  :  double 1 1 +next()  :  STTPoint +next()  :  Emage +next()  :  Emage -­‐neLat  :  double -­‐neLong  :  double 1 1 Wrapper DBSTTPointIterator VisualImageIterator ResolutionMapper -­‐initResolution +setURL() +setURL() -­‐finalResolution +setTheme() +setTheme() +setParas() +setParas() TwitterWrapper FlickrWrapper CSVWrapper KMLWrapper +setBagOfWords() +setBagOfWords() 11/28/2012   +setColors() 98  
  • 99. Macro  situa0on   Alert  Level=High   Date=12/09/10   Micro  event   Situa0onal  controller   Control  Ac0on   e.g.  “Arrgggh,  I     “Please  visit   have  a  sore  throat”   • Goal     nearest  CDC   (Loc=New  York,   • Macro  Situa1on     center  at  4th  St   Date=12/09/10)   • Rules   immediately”   Level  1  personal  threat  +  Level  3  Macro  threat  -­‐>  Immediate  ac0on     12/5/12   99  
  • 100. •  What  personal  informa1on  can  be  shared?   •  How  should  it  be  shared  to  benefit  the  user?   •  Developing  an  architecture  for  personal   informa1on  management.  
  • 101.
  • 102. Macro  situa1on  model   Asthma  Threat   c  ϵ  {Low,  mid,  high},   level   [USA,    6  hrs,   0.1x  0.1]       Air  Quality   Pollen  Count   Allergy  reports   Emage     Emage  (Pollen   Emage  (Number  of   (AQI.)   Level)   reports)   Visual-­‐   Visual-­‐   TwiOer-­‐Allergy   Air  quality   Pollen  level   Weather.com,   TwiOer  API,   [USA,    6  hrs,   Pollen.com,   [USA,    6  hrs,   [USA,    6  hrs,   0.1x  0.1]   0.1x  0.1]   0.1x  0.1]   102  
  • 103. Personal   c  ϵ  {Low,  mid,   threat  level   high}   Classifica0on:   Thresh(30,70)   And   Physical  exer0on   Asthma  threat   level   Normalize   Normalize  (0,   (0,  100)   100)   TPS  (Asthma)   TPS  (Funf)   UserLoc   Funf-­‐ac0vity   EventShop   [USA,    6  hrs,   Phone  sensors,     0.1x  0.1]   (relaxMinder  app),   [USA,    6  hrs,   0.1x  0.1]   103    /  
  • 104. Personal   threat  level   c  ϵ  {Low,  mid,   high}   Classifica0on:   Thresh(30,70)   And   Physical   Asthma   exer0on   threat  level   Normalize   Normalize   (0,  100)   (0,  100)   TPS   TPS  (Funf)   (Asthma)   UserLoc   Funf-­‐ac0vity   EventShop     [USA,    6  hrs,   Phone  sensors,     0.1x  0.1]   (relaxMinder  app),   [USA,    6  hrs,   0.1x  0.1]   104        
  • 105.
  • 106.
  • 107. Classify (Flood level - Shelter Flood Shelter) Twitter Flood Level Shelter 12/5/12   107  
  • 108. 12/5/12   108  
  • 109. Proprietary  and  Confiden1al,  Not  For   12/5/12   109   Distribu1on  
  • 110. Outline   •  Introduc1on   •  Social  Systems   •  Real  Time  Social  Systems   •  Designing  Real  Time  Systems   •  Situa1on  Recogni1on   •  Concept  recogni1ons   •  Personalized  Situa1ons   •  EventShop   • Going  Forward  
  • 111. •  Social  observa1ons  are  now  possible  with  liBle   latency.   •  Now  possible  to  design  social  systems  with   feedback.   •  Situa1on  Recogni1on  and  Need-­‐Availability   iden1fica1on  of  resources  becomes  a  major   challenge.   •   EventShop  is  a  step  in  the  direc1on  of   implemen1ng  Social  Life  Networks.  
  • 112. Useful  Links   •  Demo:   –  hBp://auge.ics.uci.edu/eventshop   •  Data  Defini1on  Language  Schema   –  hBp://auge.ics.uci.edu/eventshop/documents/ EventShop_DDL_Schema   •  Query  Language  Schema   –  hBp://auge.ics.uci.edu/eventshop/documents/ EventShop_QL_Schema   •  Example  Query  in  JSON   –  hBp://auge.ics.uci.edu/eventshop/documents/ EventShop_Example_Query   11/28/2012   112  
  • 113. Thanks  for  your  1me  and  aBen1on.   For  ques1ons:  jain@ics.uci.edu