Ramesh Jain with Several Collaborators8/17/2012 1
Scarcity: inadequate supply, Insufficiency of amount or supply Abundance: an extremely plentiful or oversufficient quantity or supply Proprietary and Confidential, Not For8/17/2012 Distribution 2
Scarcity Proprietary and Confidential, Not For8/17/2012 Distribution 3
Abundance Proprietary and Confidential, Not For8/17/2012 Distribution 4
Proprietary and Confidential, Not For8/17/2012 Distribution 5
Proprietary and Confidential, Not For8/17/2012 Distribution 6
Proprietary and Confidential, Not For8/17/2012 Distribution 7
We are immersed in Networks of People Things EventsIt is now possible to be Pansophical. 8/17/2012 8
Past is EXPERIENCE Present is EXPERIMENT Future is EXPECTATION Use your Experiences In your Experiments To achieve your Expectations8/17/2012 9
Astrology To Astronomical Volumes of Data8/17/2012 10
Proprietary and Confidential, Not For8/17/2012 Distribution 11
Have been reporting events as micro-blogsSensors and Internet of Things are creating and reporting even more events than humans are. 8/17/2012 12
Objects -- popular in the West. Relationships and Events – popular in the East. Objects and Events – seems to be the new trend. The Web has re-emphasized the importance of every object and event being connected to others -- East Meets West.
Recognize Objects Situations Knowledge Observe Big Data Act Planning8/17/2012 Control 15
Take place in the real world. Captured using different sensory mechanism. Each sensor captures only a limited aspect of the event. Can be used to bridge the semantic gap.
Conferences Days Sessions Talks Purpose of the talk Wedding An Earthquake The Big Bang 9/11 Formation of Google Media Lab Trip Me My Birth, Being here, and Dying in 100 years.
PeopleThingsPlacesTimeExperiencesEvents E by Westerman and Jain E* by Gupta and Jain
Connecting Information People Aggregation Situation Alerts and Composition And Detection Queries Resources8/17/2012 29
Proprietary and Confidential, Not For8/17/2012 Distribution 30
Dynamic Event Situation Static Object Scene Atomic Composite
Situation: An actionable abstraction of observed spatio-temporal characteristics Allow users to define their own spatio- temporal features and create the situation detection filters.8/17/2012 32
(a) Pollen levels (Source: Visual) (b) Census data (Source: text file) (c) Reports on ‘Hurricanes’ (source: Twitter stream)d) Cloud cover (Source: Satellite imagery) (e) Predicted hurricane path (source: KML) (f) Open shelters coverage(Source: KML) Representation for different data sources into a common spatio-temporal format.
S. No Operator Input Output1 Selection Temporal Temporal E-mage Set E-mage Set2 Arithmetic & K*Temporal E-mage Temporal E-mage Set Logical Set3 Aggregation α Temporal E-mage set Temporal E-mage Set4 Grouping Temporal E-mage Set Temporal E-mage Set5 Characterization : •Spatial •Temporal E-mage Set •Temporal Pixel Set •Temporal •Temporal Pixel Set •Temporal Pixel Set6 Pattern Matching •Spatial •Temporal E-mage Set •Temporal Pixel Set •Temporal •Temporal Pixel Set •Temporal Pixel Set 35 8/17/2012 35
Experimentation is Front End GUIessential to deal with New Data New Query E-mage Stream Alert Requestevolving unstructured Source Back End Controllersensory data. E-mage Stream Personalized Registered Stream Query Processor Alert UnitInspired by Queries E-mage StreamPhotoshop. User Info Registered Data Data Ingestor Raw Data Storage Sources API Calls Raw Spatial Data Stream Data Cloud 8/17/2012 36
Business decision making: Demand-supply analysis, opening a new store, offer,… Medical : Epidemic monitoring, Asthma, pollution effect mitigation Disaster relief: (hurricane, flood, fire) directing people to appropriate resources. Traffic: Suggesting best routes Election8/17/2012 37
Proprietary and Confidential, Not For8/17/2012 Distribution 38
Proprietary and Confidential, Not For8/17/2012 Distribution 39
Retail Store Locations Net Catchment area Proprietary and Confidential, Not For8/17/2012 Distribution 40
Proprietary and Confidential, Not For8/17/2012 Distribution 41
Planetary scale 1) Macro sensing situationSocial sensorsDevice sensors +Macro sensors 2) Personalized Personal situation context Personal life streams + Profile/ Preferences e.g. High Flu risk 3) Recommend Actions Available resources + Resource data
into ‘high’ and ‘low ’activity zones. Proprietary and Confidential, Not For8/17/2012 Distribution 43
Macro situation Alert Level=High Date=12/09/10 Micro event Situational Control Action e.g. “Arrgggh, I controller “Please visit have a sore nearest CDC throat” •Goal center at 4th St(Loc=New York, •Macro Situation immediately”Date=12/09/10) •Rules Level 1 personal threat + Level 3 Macro threat -> Immediate 8/17/2012 action 44