SlideShare a Scribd company logo
1 of 124
CrisisMapping,CitizenSensingand
SocialMedia Analytics
Hemant Purohit Amit Sheth Carlos Castillo Patrick Meier
The Ohio Center of Excellence in
Knowledge-enabled Computing (Kno.e.sis)
Wright State, USA
Qatar Computing
Research Institute (QCRI)
Doha, Qatar
Leveraging Citizen Roles for Crisis Response Coordination
Introduction: Kno.e.sis and QCRI
• At Kno.e.sis: NSF SoCS project on ‘Social Media Enhanced Organizational Sensemaking
during Emergency Response’
• At QCRI: ‘Artificial Intelligence for Disaster Response’ (AIDR) project for Social Innovation
Outline
• Introduction
• Gaps & Challenges
• Role of Computer Science
• Applied Crisis Computing
• Design Principles
7.0 Magnitude Earthquake
Motivation - P
Ushahidi Map for Haiti
EMERGENCY HACKATHONS AFTER HAITI DEVASTATION .. Thousands of miles away!
“YOUR SITE HELPED SAVE HUNDREDS OF LIVES”
- US MARINE CORPS
Citizen Sensing
Jakarta twitter map
Digital Footprints of Twitterers..
.. Pulse of the planet
FEMA Task Force Haiti
ter
Why we care about Citizen Sensing?
- It forms Self Organizing Communities!
Crisis Response Coordination
UN Cluster
system
We all need to join
hands together for
effectively
improving
response
coordination!
- Humanitarians
- Computer and
Social Scientists
- Big Data in crisis situations
needs computing help!
- Humanitarians alone can’t handle it!
Outline
• Introduction
• Gaps & Challenges
• Scale, velocity, redundancy, heterogeneity, bias, noise & verifiability
• Role of Computer Science
• Applied Crisis Computing
• Design Principles
Puzzle of Crisis Informatics
• What emergency-responders want?
1. Any available prior knowledge about
the impact of similar past disasters in
the region?
2. Are existing response strategies
sufficient?
3. Which factors will worsen conditions?
4. How many fatalities? Extent of
damage?
What
emergency-
responders
want
What
computer
scientists can
provide
What is
supported by
current social
media data
Puzzle of Crisis Informatics
• What computer scientists can provide?
• Algorithms to detect and predict abnormal
trends
• Semantic abstraction and summarization
of data
• Human+Machine readable knowledge
organization via ontologies
• Technology to map geo-located
information
• Visual data interface for quicker
comprehension
What
emergency-
responders
want
What
computer
scientists can
provide
What is
supported by
current social
media data
Puzzle of Crisis Informatics
• What is supported by social media data?
• Real-time updates on the situation
• Textual summaries, images, videos
• Messages about needs and offers
• Geo-location metadata
What
emergency-
responders
want
What
computer
scientists can
provide
What is
supported by
current social
media data
Crisis Response Analytics
• Mainly three major methods of information extraction and
mapping:
• Manual feed (Processed info.) based
• e.g., Most of the formal and hybrid response organizations (Red Cross,
UNOCHA), Recovers.org, AIDMatrix, SparkRelief, etc.
• Crowdsourcing with limited automation
• e.g., Crowdmap/Ushahidi, etc.
• Automatized processing based
• e.g., Twitris, CrisisTracker, etc.
• Information management for resource coordination:
• e.g., Sahana
Illustrative Crisis Informatics
Projects
Project Host Team Focus
Sahana Univ. of Maryland Information Management
EPIC
(Tweak-the-Tweet)
Univ. of Colorado and UC
Irvine
Information extraction and
behavioral aspects in response
NSF SoCS Kno.e.sis, Wright State Univ.
and Ohio State Univ.
Organizational sensemaking and
Coordination
AIDR QCRI, Doha Targeted Information extraction
NSF GeoNets Univ. of Southern California Ad hoc Geospatial Data Sharing
Note that it is not an exhaustive list, see more resources here:
http://wiki.knoesis.org/index.php?title=Summary_about_Social_Media_Research_in_Disaster/Emergency_Response_Systems&oldid=5177
Illustrative Crisis Mapping and
Analytics tools
Tool
Visual
Geo
Mapping
Human
Inputs
Real-
time
Update
People to
engage
with
Topical
summary
Explore
data
Semantics
CrowdMap (Ushahidi) Y Y Y Y
Sahana Y Y Y Y Y
AIDMatrix Y Y
Recovers.org Y Y
SparkRelief Y Y Y
Twitris* Y Y Y Y Y
Crisis Tracker* Y Y Y
*Social Media driven Note that it is not an exhaustive list, see more resources here:
http://wiki.knoesis.org/index.php?title=Summary_about_Social_Media_Research_in_Disaster/Emergency_Response_Systems&oldid=5177
Tools: Sahana
• A free & open source portable web tool for Disaster Management
• Features:
• Organization Registry
• Maintains data (contact, services, etc.) of organizations and volunteers in
response
• Missing Persons / Disaster Victim Registry
• Helps track and find missing, deceased, injured and displaced people and families
• Request Management
• Tracks all requests and helps match pledges for support, aid and supplies to
fulfilment
• Shelter Registry
• Tracks data on all temporary shelters setup following the Disaster
More: http://www.slideshare.net/skbohra/sahana-disaster-management-system
Tools: Sahana (Organizationregistry)
Tools: Sahana (RequestsList)
Tools: CrowdMap
• The well-known Ushahidi’s version
• Geo-located reports
• Crowdsourced data pieces, turned into powerful information
nuggets as reports from regions
• Video:
• http://www.youtube.com/watch?v=GjPc39OXr6I
Tools: CrowdMap (Overview)
http://zombiejournalism.com/2010/09/how-to-build-manage-and-customize-a-crowdmap/
Tools: CrowdMap (Reports)
Tools Demo: Twitris
• Example of automatic processing compared to the previous
tool based on manual-feed processing for crisis computing
• A Semantic Social Web platform for comprehensive event
analysis
• Real-time monitoring and multi-faceted analysis of social signals:
• space, time, people, content, network, and additionally sentiment and
emotion
• Platform for on-going research for situational awareness and
coordination using social media and knowledge on the Web
Important tags to
summarize Big Data flow
Related to Oklahoma
tornado
Images and Videos Related
to Oklahoma tornado
Tools Demo: Twitris (Topicalnuggetsummary)
Incoming Tweets with need types
to give quick idea of what is
needed and where currently #OKC
Legends for
Different needs
#OKC
Tools Demo: Twitris (Real-timeinformationfor
needs)
Clicking on a tag brings contextual
information– relevant tweets,
news/blogs, and Wikipedia articles
Tools Demo: Twitris (Influencerstoengagewith,forspecific
needs)
Influential users are for
respective needs. Right side
shows their interaction
network on social media.
Engaging with influencers in the self organizing communities
can be very powerful for- a.) getting important information, b.)
Correcting rumors in the network, c.) Propagating important
information back into the citizen sensors community
Tools Demo: Twitris (InR&D:EngagementInterfacefor
responders)
What-Where-How-Who-Why
Coordination
Influential users to engage
with and resources for
seekers/supplies at a location,
at a timestamp
Contextual
Information for a
chosen topical
tags
Tools Demo: Twitris during Oklahoma-
Tornado disaster response
• Video of the on-going monitoring on the next morning of the
Oklahoma Tornado:
• http://twitris.knoesis.org/images/datasets-and-models/Twitris--for-
Oklahoma-disaster.mov
• Snapshots during the analysis:
• Images
Who are the people to
engage with in the evolving
ad-hoc social community?
Which needs are of
utmost importance?
Actionable information improves decision making process.
Who are the resource
seekers and suppliers?
Questions to social media tools
for Disaster Response Coordination
Where can I go for volunteering at
my location?
How and Where
can one donate?
Challenges
Challenge: Heterogeneity
• Multiple channels
• Phone, fax, TV, radio, newspapers, internet, sensor
networks, etc.
• Coexistence of technologies, a constant
• Social media is heterogeneous
• Verified accounts
• Re-tweets from well-known sources
• Eyewitness reports
• Lots more!
• Different types (unstructured text, structured,
multimedia) may require different tools
http://blogs.lse.ac.uk
Challenge: Velocity
• Social media information is more valuable in the
first minutes and hours after a disaster
• Affected people are there before anybody else
• When emergency responders arrive, their priority
may not be to keep information flowing
• After hours/days social media is still valuable, but
there is much more information from other sources
• In the early hours of a disaster, television feels so
slow in comparison
• Often a few seconds of footage repeated over and
over and over
http://seventhinc.com/
Challenge: Scale
• In some countries a sizable fraction of the
population has Internet access
• Tweets are small and nimble but they point to
webpages, include images, videos, etc.
• You need to process a lot to obtain a little
• There are many tweets but
• Only some of them contain usable information
• Only a fraction of those can be handled by
automatic systems
Top-4 countries by
Twitter penetration
among Internet
users; by Comscore
via http://5mk.co/
Challenge: Redundancy
• Information from multiple information channels
may not be unique
• Near-duplicates frustrate users and waste their
time
• Definition of abstraction level (to merge items) is
always arbitrary, depends on the application
• Automatic systems tend to pick what is
redundant first
• Not necessarily a bad thing, e.g. phrases that are
often repeated, tweets that are often re-tweeted,
etc.
Millenial’s information
sources http://ypulse.com/
Challenge: Biases
• Social Media Bias:
• Youngers better user than elders
• Educated users more existent than uneducated
• Technology Privileged users more existent than unprivileged
• Study carefully, with the grains of salt!
• Smart sampling
• Smart data cleaning
• Smart algorithms
Challenge: Noise
• Everyone wants to be heard
• Independently of adding any value
• Emotional expressions and even jokes drive the data traffic
• Informal text and jargon hinders automatic text processing
Challenge: Verifiability
• Social media users are starting to develop
their own methods to validate information
• In crisis scenarios most rumors are spread
by well-intentioned people
• But there are also some pranksters
• We need a more fine-grained approach
than true/false (we have always needed it)
Edelman 2012
http://edelman.com/trust
Outline
• Introduction
• Gaps & Challenges
• Role of Computer Science
• IR, DM, ML, NLP, SN, HCI
• Applied Crisis Computing
• Design Principles
Information Retrieval (IR)
• The research field that created web search
• No problem working with subjective definitions
• Relevance has always been in the eye of the beholder
• Can help us by providing searching and ranking operations on
social media reports
IR Method: inverted indexes
• What does it do?
• Allows to locate documents
containing a term without
having to scan a whole
Collection
How does it work?
• An inverted index contains a list of terms, and a
list of documents containing each term
• How can it help us?
• Indexing a collection of reports can help us
locate specific ones very quickly
Encyclopedia of Language and Linguistics
IR/ML Method: learning-to-rank
paradigm
• What does it do?
• Find relevant documents for a search
• How does it work?
• Modern methods use hundreds of
static (document-dependent) and
dynamic (query-document-dependent)
characteristics and a learning-to-rank
framework
• How can it help us?
• Modern IR is well beyond hard rules,
and beyond heuristic scoring functions;
no need to re-invent the wheel
http://people.dsv.su.se/~eriks/
IR Method: document clustering
• What does it do?
• Group search results in order to better scan
them; can be done on a query-dependent or
query-independent way
• How does it work?
• One way is to do a weighted dot product in
which weights are associated to how
informative (~rare) are words
• How can it help us?
• Makes it easier to deal with large, redundant
collections of text
http://carrot2.org/
Example of document clustering
Crisis Tracker
Data Mining (DM)
• The science of finding patterns in data
• Finding association rules, categories of elements, anomalies,
etc.
• Managing temporal data
• Can help us detect and track trends and topics
• Managing static data
• Can help us reduce the dimensionality of data
Yan Huang, UNT.edu
DM Method: burst detection
• What does it do?
• Reliably identifies anomalies in a time series
(e.g. volume of tweets w/hashtag vs time)
• How does it work?
• Look for increases above the norm; look for
change patterns that precede crisis
• In general it is hard over noisy signals
• How can it help us?
• Detection of sub-events in an ongoing crisis is
important to rapidly respond to them
Volume for query “boston” in
Google (trends.google.com).
DM Method: topic detection and
tracking
• What does it do?
• Track the relative
popularity of different
topics over time
• How does it work?
• Cluster documents per
time slice, merge across
times slices
• How can it help us?
• See emerging stories, track
new developments, sub-
stories, etc.
TextFlow
DM Method: dimensionality
reduction
• What does it do?
• Represent complex data in simpler
terms
• How does it work?
• Find independent pieces of
information, discard/merge
correlated ones
• How can it help us?
• We can focus on the big picture,
not just hash-tags and keywords,
but topics
4
dimensions
(x,y,z,color)
2
dimensions
(x’,y’)
X, Y axes are correlated => X’ axis
Z is independent => Y’
Color is equivalent to X’ => gone
X’
Y’
http://www.cs.otago.ac.nz/
IR/DM Method: reduce text
dimensionality
LDA. Illustration by Lisa M. Rhody
Input:
thousands of
dimensions
(one for
every word)
Output:
a handful of
dimensions (one
for every topic)
Statistical Machine Learning (ML)
• A branch of artificial intelligence
• While DM focuses on discovery, ML focuses on prediction
• ML aims at representing data and generalizing from it
• Supervised statistical machine learning is a well-established
framework to learn the relationship between inputs and
outputs
• Can help us learn from human labeling efforts to create
automatic labels for new data
ML method: supervised
classification
• What does it do?
• Learn to separate different classes
of elements, given (relatively) few
examples
• How does it work?
• Several methods to choose from,
popular ones are SVMs and
Decision Trees/Forests
• How can it help us?
• Automatic classification of reports
http://www.quora.com/
Example: automatic tweet
classification
Caution &
Advice
Information
Sources
Damage &
Casualties
Donations
Health
Shelter
Food
Water
Logistics
...
...
ML method: regression
• What does it do?
• The same as supervised
classification but the target is
numerical, not categorical
• How does it work?
• It learns the parameters of a
function that fits what is observed
• How can it help us?
• It can predict an outcome from
current data http://qcri.qa/
Natural Language Processing
(NLP)
• A research area that has fought
against several (possibly AI-complete)
problems
• Watson and other projects have
demonstrated visibly their success
• Can help us to classify and extract
information by doing automatically:
• Morphological analysis
• Dependency parsing
• Entity linking / Word sense
disambiguation
http://voices.washingtonpost.com/
NLP method: tagging
• What does it do?
• Determines classes for tokens or segments
on a text: part-of-speech tags, named
entities
• How does it work?
• Supervised learning with structured outputs
• How can it help us?
• A richer representation of tweets yields
better predictions
• Spotting named entities or key phrases can
help summarize tweets
I/preposition
can/modal
see/verb
the/determiner
flames/noun
from/preposition
here/adverb
NLP methods: dependency
parsing
• What does it do?
• Identifies relationships between
different parts of a text
• How does it work?
• Learned from labeled data using
structured output (output is a parse
tree)
• How can it help us?
• Identifying key elements on text can
help find cases where a named entity
is central on a report
“Bills on ports and immigration were
submitted by Senator Brownback,
Republican of Kansas”
http://nlp.stanford.edu/
NLP method:
disambiguation/linking
• What does it do?
• Connect named entities to concepts, e.g. a
sense on a dictionary or a URL in Wikipedia
• How does it work?
• Entities can have multiple senses; the
correct one is picked by using contextual
clues
• How can it help us?
• Once we have determined a concept we
can map it to broader classes
1 readiness to give attention
2 quality of causing attention to be given
3
activity, subject, etc., which one gives time
and attention to
4 advantage, advancement, or favour
5 a share (in a company, business, etc.)
6 money paid for the use of money
Meaning of “interest”
This may be of interest [2] to you
The money grows because of
compound interest [6]
http://www.ling.gu.se/~lager/
Graph Theory (GT) a.k.a.linkanalysis,networkanalysis
• Social graphs are important abstractions, they
represent social connections as a graph
• Lots of information can be derived from
properties of this graph
• Communities
• Central users
• Bridges
• Availability of large datasets from online social
networking sites has brought new life to this
field http://www.hackingalert.net/
GT method: graph clustering
• What does it do?
• Find communities of densely
connected nodes
• How does it work?
• There are many methods,
depending on the definition of
community
• How can it help us?
• We can identify groups of people
who are closely connected
http://griffsgraphs.com/
GT method: centrality metrics
• What does it do?
• Identify which nodes in a graph are in
more shortest paths (centrality), or are
more likely to be at the end of a random
walk (PageRank)
• How does it work?
• Pagerank is computed through iterative
calculations over the entire graph
• How can it help us?
• These are good proxies for importance
on a network
Wikipedia
Human-Computer Interaction
(HCI)
• Technologies should bring
people joy, not frustration
• Design principles and
methodologies have been
developed over years
• More important,
evaluation and validation
criteria have emerged
HCI method: user-centered
design
• What does it do?
• Ensure users can use a tool
effectively
• How does it work?
• Put users and their tasks at the
center of the design process
• How can it help us?
• We can avoid losing the focus on
our application development by
starting with the users’ concerns
http://usability.msu.edu/
HCI method: prototypes and cont.
evaluation
• What does it do?
• Help understand what users want early on,
determine if design is effective
• How does it work?
• Build mock-ups and low-fidelity prototypes early
on, evaluate them empirically
• How can it help us?
• Users may not know what they want until they see
it; integrating them in the design requires
communicating effectively; we also need to know
how are we going to measure.
Outline
• Introduction
• Gaps & Challenges
• Role of Computer Science
• Applied Crisis Computing
• DM is not the same as DM
• Design Principles
Applied Crisis
Computing Example
to Assist Coordination:
Donations Matching
Thanks, But No Thanks …
• Many people want to
donate during disasters
• Waste occurs due to
resources being over- or
under-supplied
• Goal: understanding
what is needed and what
is offered by social media
users
http://www.npr.org/2013/01/09/168946170/thanks-but-no-thanks-when-post-disaster-donations-overwhelm
Matching requests with offers
How to volunteer, donate to Hurricane
Sandy: <URL>
If you have clothes to donate to those who
are victims of Hurricane Sandy …
Red Cross is urging blood donations to
support those affected <URL>
I have TONS of cute shoes & purses I want
to donate to hurricane victims …
Does anyone know how to donate clothes
to hurricane #Sandy victims?
Does anyone know of community service
organizations to volunteer to help out?
Needs to get something, suggests scarcity:
REQUEST (demand)
Offers or wants to give, suggests abundance:
OFFER (supply)
RT @OpOKRelief:
Southgate Baptist
Church on 4th Street in
Moore has food, water,
clothes, diapers, toys,
and more. If you can't
go,call 794
Text "FOOD" to
32333, REDCROSS to
90999, or STORM to
80888 to donate $10
in storm relief.
#moore #oklahoma
#disasterrelief
#donate
Want to help animals in
#Oklahoma? @ASPCA
tells how you can help:
http://t.co/mt8l9PwzmO
CITIZEN SENSORS
RESPONSE TEAMS
(including humanitarian
org. & ‘pseudo’ responders)
VICTIM SITE
Coordination
of
needs and
offers
Using Social
Media
Does anyone
know where to
send a check to
donate to the
tornado
victims?
Where do I go to
help out for
volunteer work
around Moore?
Anyone know?
Anyone know
where to donate
to help the
animals from the
Oklahoma
disaster? #oklaho
ma #dogs
Matched
Matched
Matched
Serving the need!
If you would like to
volunteer today, help is
desperately needed in
Shawnee. Call 273-5331
for more info
A supervised learning approach
Information extraction: core &
facets
• Core of the phrase is the “what”
• Other facets may include “who”, “where”, “when”, etc.
Rotary collecting clothing and other donations in New Jersey <URL>
{ source: “Twitter”, author: “@NN”, text: “Rotary collecting clothing and other
donations in New Jersey <URL>”, donation-info: { donation-type: “Request”, donation-
type-confidence: 0.8, donation-organization: “Rotary”,
donation-item: “clothing and other donations”, donation-location: “New Jersey” }, … }
Statistics
Some example matches [naïve
method]
• Pair 1:
• Anyone know of volunteer opportunities for hurricane Sandy?
Would like to try and help in anyway possible (OFFER)
• RT @Gothamist: How To Volunteer, Donate To Help Hurricane
Sandy Victims http://t.co/fXUOnzJe (REQUEST)
• Pair 2:
• I want to send some clothes for hurricane relief (OFFER)
• Me and @CeceVancePR are coordinating a clothing/food drive for
families affected by Hurricane Sandy. If you would like to donate,
DM us. (REQUEST)
Much work remains to be done
• Matching quality depends on type of donation
• Improvements on item representation are necessary
• Sparsity is part of the problem
• Improvements on matching quality are necessary
• Hybrid approach needs to be investigated
• Budget of K crowdsourcing calls, which items to annotate?
• A real-world system should use continuous querying, is this
efficient?
Similar approach is applicable in other problem
contexts of coordination as well!
Objective: Support
Decision Making and
Coordination of
Actions
An analogy: product comparison
sites
• What product comparison sites do
today
• Collect pieces of information having
diverse structure (each site has its own)
• Enrich them with automatically-extracted
facets (photo, name, reviews, etc.)
• Cluster/de-duplicate
• Enable search by extracted facets
• In our case, there is almost no structure
to start with, just context
http://pricegrabber.com/
First: extract facets from
unstructured text
• Collect messages
• Classify according to several ontologies
• Not only content classification
• Also Author/Source classification: discover roles
• Extract core aspects / information nuggets
• Identify the key portion of a message
• Extract facets
• Geo-locate
Second: manage data and enable
faceted retrieval
• Support real-time insertions
• Must be visible immediately
• Support real-time updates
• E.g. new user assessments/labels of data
• E.g. new parameters for an automatic classifier
• Support complex queries
• Faceted retrieval on complex predicates
• Return relevant results
• Relevance is based on multiple signals (geo, time, IR-based, etc.)
Third: discover relationships and
clusters
• Clustering
• Near-duplicate detection
• Same event/story/etc.
• Data-driven geographical
regions
• Discover relationships
• Content-Reply ?
• Claim-Refutation ?
• Etc.
• Best supported by linked data
management systems
http://www.jaunted.com/
At a high level, what are the names of
the touristic hot-spots of the word?
Fourth: enable high-level
operations
• Summarization [static]
• Synthesize/extract a high-level description from a set of items
• Semantic clustering [static]
• Determine clusters based on high-level characteristics of data
• Event detection [dynamic]
• Discover large changes in the data at some level of abstraction
• Topic tracking [dynamic]
• Discover how a topic (an aspect of the data) evolves over time
Focus on decision making and
coordination
• Do not start by thinking on data visualization
• Data visualization is constrained by the richness of your data
• Start by thinking on how to make your data richer
• Key questions to prioritize R&D on these systems:
• Who will consume the data?
• What decisions does this person or this community need to take?
• Which aspects of the data support these decisions?
• How do we know the decision was correct?
• Can the end-users of the social media analysis make better decisions
than the non-users?
Example questions during
decision-making by actors
(a.) Seeker/Demander
• Whom to follow
(provider)
• Where to find resource
info
• Whom to contact in the
Responder teams
(b.) Provider/Supplier
• Whom to follow (Seeker)
• Where to find resource
scarcity info
• Whom to inform in the
Responder side
(c.) Responder
• Whom (seeker/provider)
to contact/DM/Mention
• Where to find resource
scarcity/availability info.
• Whom to communicate
to deliver the right info.
in right time
Open problems
Data availability: chicken-or-egg
problem
http://www.vtaide.com/
People’s posts don’t
include some data
Because nobody is
looking for that data
The semantic gap
• Introduced ca. 1989 in the context of multimedia retrieval
• Low-level features are far from high-level information needs
http://www.semanticmetadata.net/
• Vertical operators
facilitate
transcending from
data-information-
knowledge-wisdom
using background
knowledge
• Horizontal operators
facilitate semantic
integration of
multimodal
observations
Analogy for Low level Data to
High Level transformation
http://www.slideshare.net/apsheth/physical-cyber-social-computing-an-
early-21st-century-approach-to-computing-for-human-experience
Semantic gap: ML/DM/NLP/IR/…
• Automatic methods for classifying and extracting information
from short pieces of text are usable but from perfect
• Noisy texts make the problem harder
• Social media English is a particular dialect of English
• Short texts make the problem harder
• There is not enough context to disambiguate
• Frequency-based methods to determine key words are not usable
• Important subtleties escape us
• e.g. irony in sentiment analysis
Intentions: chicken-or-egg
problem
http://www.vtaide.com/
Some types of
coordination do not
often happen online
Because there are no
platforms supporting
such coordinations
Fine-grained analysis of intentions
• People go online during disasters for a variety of reasons
• How good is our understanding of these reasons
• Suppose we know the top-3 reasons, how many people those
reasons cover
• The only way of operating with a long-tail of information needs
is to think in the more general terms possible
• Plus opportunistically creating “vertical” systems for niche needs
Towards a generic crisis response
ontology
• UN effort on generic ontology (taxonomy and relationships)
• HXL (Humanitarian Exchange Language)
• Still a gap between what has been modeled so far vs. what can
be used (supported via data and analytics)
• Current efforts in the W3C community on ‘Emergency
Information management’ on extending HXL with other
existing relevant ontologies and create a necessary and
sufficient model
More about HXL: http://hxl.humanitarianresponse.info/ns/index.html
Continuously-evolving models
• How do we capture the existing knowledge evolving around an
event Moore is a suburb
of Oklahoma City
If you would like to volunteer
today, help is desperately
needed in Shawnee. Call 273-
5331 for more info
Shawnee is a suburb
near Moore
Geographies:
Shawnee
Moore
Focus areas for
Data collection,
processing and
analytics
Outline
• Introduction
• Gaps & Challenges
• Role of Computer Science
• Applied Crisis Computing
• Design Principles
• New systems focused on actions and coordination
Principle 1: Explicitly identify
target users
• This may not be a homogeneous groups
• Identify profiles
• Background, skills, etc.
Target users: examples
• Headquarters Humanitarians
• Policy, Information Products, Coordination
• Field Humanitarians
• Logistics, Relief, Coordination
• Digital Humanitarians
• Information Collection
• Analysis
Headquarters
The Field
Digital Humanitarians
Principle 2: Engage users in co-
design
• Do not let them offload requirements and then leave
• We want them to co-design with us
• This requires effective tools for communication
• e.g. wireframe designs, user stories, etc.
Principle 3: Socio-technical
systems
• Conceptualize the system as hybrid (human and computer
intelligence) from the beginning
• Improve response in a continuous fashion
• We want users to be part of the operation of the systems
themselves
Principle 4: Empirical evaluation
through actions
• We want systems that look good and are easy to use
• We do not evaluate based on looks
• Are the actions of users better than those of non-users?
There is a part for
everybody in this
community
Hackers, scientists, humanitarians, everybody.
Hackers
• Create and curate useful datasets
• Create dataset remixes
• Create software tools
• Create libraries
• Create interoperability
Computer scientists
• There are many open problems in ML, DM, NLP, etc.
• Collaborating and partnering in humanitarian computing
• It is easier to share data and solutions in this application domain
than in commercially-driven ones
• This is also a rich test bed for testing algorithms
• Those algorithms can be useful well beyond humanitarian
computing
Social scientists
• There are many open questions about how, why, people
coordinate, how to motivate them, what information do they
require, how to present that information, etc.
• Which organizational structures are better during different
phases of crisis- mitigation, rescue, relief, recovery and rebuild
• Humanitarian and crisis computing projects need to be
assessed and evaluated for intended impact.
• How to communicate these projects-- need to be
communicated in non-technical language that humanitarian
policy makers understand.
Humanitarian organizations
• It takes two to tango!
• Your scientific partners are not
providers/vendors
• Scientists want access to your experts and data
• Access to experts and problems is extremely
important
• This is a win-win situation: help us create
partnerships
http://worcestertango.org/
Everybody
• Interdisciplinary research is not easy to execute
• But an unidirectional approach will create only more gaps in
the research-to-practice pipeline.
Thanks to
• Nation Science Foundation (NSF) for SoCS project grant: Social Media Enhanced Organizational
Sensemaking in Emergency Response
• Kno.e.sis Twitris team, Prof. Valerie Shalin, Prof. John Flach, Andrew Hampton in the Dept. of
Psychology (Wright State U)
• Prof. Srini Parathasarathy, Yiye Ruan, Dave Fuhry (Ohio State U)
• Fernando Diaz, Microsoft Research
• Shady Elbaussoni, Beirut University
• Muhammad Imran, QCRI
• Jakob Rogstadius, Madeira University
• Our colleagues for suggestions on the material including Sahana project @UMD and ISI @USC, etc.
• Images used here belong to their respective owners, we are grateful to such usefulness of their work
that these images can be illustrative in certain contexts! Many thanks!
Questions,
Discussion and
Feedback
• References and reading material:
• http://www.knoesis.org/hemant/present/icwsm2013
• http://humanitariancomp.referata.com/
• Got Questions? – Talk to us on Twitter: @hemant_pt , @ChaToX , @PatrickMeier , @amit_p

More Related Content

What's hot

SIAM SDM2014 tutorial - Social Media and Web of Data to Assist Crisis Respons...
SIAM SDM2014 tutorial - Social Media and Web of Data to Assist Crisis Respons...SIAM SDM2014 tutorial - Social Media and Web of Data to Assist Crisis Respons...
SIAM SDM2014 tutorial - Social Media and Web of Data to Assist Crisis Respons...Artificial Intelligence Institute at UofSC
 
Iscram 2007 humanitarian-foss case disaster management
Iscram 2007 humanitarian-foss case disaster managementIscram 2007 humanitarian-foss case disaster management
Iscram 2007 humanitarian-foss case disaster managementChamindra de Silva
 
Evolution of the Sahana Open Source Project
Evolution of  the Sahana Open Source ProjectEvolution of  the Sahana Open Source Project
Evolution of the Sahana Open Source ProjectCOOPERACION 2.0 2009
 
Public Health Crisis Analytics for Gender Violence
Public Health Crisis Analytics for Gender ViolencePublic Health Crisis Analytics for Gender Violence
Public Health Crisis Analytics for Gender ViolenceHemant Purohit
 
Social Media & Web Mining for Public Services of Smart Cities - SSA Talk
Social Media & Web Mining for Public Services of Smart Cities - SSA TalkSocial Media & Web Mining for Public Services of Smart Cities - SSA Talk
Social Media & Web Mining for Public Services of Smart Cities - SSA TalkHemant Purohit
 
Real-Time Processing of Social Media Content for Social Good
Real-Time Processing of Social Media Content for Social GoodReal-Time Processing of Social Media Content for Social Good
Real-Time Processing of Social Media Content for Social GoodMuhammad Imran
 
Processing Social Media Messages in Mass Emergency: A Survey
Processing Social Media Messages in Mass Emergency: A SurveyProcessing Social Media Messages in Mass Emergency: A Survey
Processing Social Media Messages in Mass Emergency: A SurveyMuhammad Imran
 
The Role of Social Media and Artificial Intelligence for Disaster Response
The Role of Social Media and Artificial Intelligence for Disaster ResponseThe Role of Social Media and Artificial Intelligence for Disaster Response
The Role of Social Media and Artificial Intelligence for Disaster ResponseMuhammad Imran
 
Making the invisible visible. Managing the digital footprint of development p...
Making the invisible visible. Managing the digital footprint of development p...Making the invisible visible. Managing the digital footprint of development p...
Making the invisible visible. Managing the digital footprint of development p...UNDP Eurasia
 
Technology and Disaster Relief
Technology and Disaster ReliefTechnology and Disaster Relief
Technology and Disaster ReliefErica Schlaikjer
 
08 31 10 berkman presentation
08 31 10 berkman presentation08 31 10 berkman presentation
08 31 10 berkman presentationHeather Blanchard
 
Social Media Crawling and Mining Seminar (Motivation Part)
Social Media Crawling and Mining Seminar (Motivation Part)Social Media Crawling and Mining Seminar (Motivation Part)
Social Media Crawling and Mining Seminar (Motivation Part)Yiannis Kompatsiaris
 
Crowdsourcing and Crowdfeeding
Crowdsourcing and CrowdfeedingCrowdsourcing and Crowdfeeding
Crowdsourcing and CrowdfeedingAnahi Iacucci
 
Automatically Rank Social Media Requests for Emergency Services using Service...
Automatically Rank Social Media Requests for Emergency Services using Service...Automatically Rank Social Media Requests for Emergency Services using Service...
Automatically Rank Social Media Requests for Emergency Services using Service...Hemant Purohit
 
Disaster Relief Using Social Media Data
Disaster Relief Using Social Media DataDisaster Relief Using Social Media Data
Disaster Relief Using Social Media DataAli Abbasi
 

What's hot (20)

SIAM SDM2014 tutorial - Social Media and Web of Data to Assist Crisis Respons...
SIAM SDM2014 tutorial - Social Media and Web of Data to Assist Crisis Respons...SIAM SDM2014 tutorial - Social Media and Web of Data to Assist Crisis Respons...
SIAM SDM2014 tutorial - Social Media and Web of Data to Assist Crisis Respons...
 
Iscram 2007 humanitarian-foss case disaster management
Iscram 2007 humanitarian-foss case disaster managementIscram 2007 humanitarian-foss case disaster management
Iscram 2007 humanitarian-foss case disaster management
 
Evolution of the Sahana Open Source Project
Evolution of  the Sahana Open Source ProjectEvolution of  the Sahana Open Source Project
Evolution of the Sahana Open Source Project
 
Public Health Crisis Analytics for Gender Violence
Public Health Crisis Analytics for Gender ViolencePublic Health Crisis Analytics for Gender Violence
Public Health Crisis Analytics for Gender Violence
 
Japan After Action Review
Japan After Action ReviewJapan After Action Review
Japan After Action Review
 
Social Media & Web Mining for Public Services of Smart Cities - SSA Talk
Social Media & Web Mining for Public Services of Smart Cities - SSA TalkSocial Media & Web Mining for Public Services of Smart Cities - SSA Talk
Social Media & Web Mining for Public Services of Smart Cities - SSA Talk
 
Real-Time Processing of Social Media Content for Social Good
Real-Time Processing of Social Media Content for Social GoodReal-Time Processing of Social Media Content for Social Good
Real-Time Processing of Social Media Content for Social Good
 
Processing Social Media Messages in Mass Emergency: A Survey
Processing Social Media Messages in Mass Emergency: A SurveyProcessing Social Media Messages in Mass Emergency: A Survey
Processing Social Media Messages in Mass Emergency: A Survey
 
VRCs & Technology
VRCs & TechnologyVRCs & Technology
VRCs & Technology
 
The Role of Social Media and Artificial Intelligence for Disaster Response
The Role of Social Media and Artificial Intelligence for Disaster ResponseThe Role of Social Media and Artificial Intelligence for Disaster Response
The Role of Social Media and Artificial Intelligence for Disaster Response
 
Meraz
MerazMeraz
Meraz
 
Making the invisible visible. Managing the digital footprint of development p...
Making the invisible visible. Managing the digital footprint of development p...Making the invisible visible. Managing the digital footprint of development p...
Making the invisible visible. Managing the digital footprint of development p...
 
Technology and Disaster Relief
Technology and Disaster ReliefTechnology and Disaster Relief
Technology and Disaster Relief
 
08 31 10 berkman presentation
08 31 10 berkman presentation08 31 10 berkman presentation
08 31 10 berkman presentation
 
How to Leverage Social Media Communities for Crisis Response Coordination
How to Leverage Social Media Communities for Crisis Response CoordinationHow to Leverage Social Media Communities for Crisis Response Coordination
How to Leverage Social Media Communities for Crisis Response Coordination
 
Social Media Crawling and Mining Seminar (Motivation Part)
Social Media Crawling and Mining Seminar (Motivation Part)Social Media Crawling and Mining Seminar (Motivation Part)
Social Media Crawling and Mining Seminar (Motivation Part)
 
Crowdsourcing and Crowdfeeding
Crowdsourcing and CrowdfeedingCrowdsourcing and Crowdfeeding
Crowdsourcing and Crowdfeeding
 
Automatically Rank Social Media Requests for Emergency Services using Service...
Automatically Rank Social Media Requests for Emergency Services using Service...Automatically Rank Social Media Requests for Emergency Services using Service...
Automatically Rank Social Media Requests for Emergency Services using Service...
 
Social media
Social mediaSocial media
Social media
 
Disaster Relief Using Social Media Data
Disaster Relief Using Social Media DataDisaster Relief Using Social Media Data
Disaster Relief Using Social Media Data
 

Similar to Crisis Mapping, Citizen Sensing and Social Media Analytics: Leveraging Citizen Roles for Crisis Response Coordination

SOCIAM: The Theory and Practice of Social Machines
SOCIAM: The Theory and Practice of Social MachinesSOCIAM: The Theory and Practice of Social Machines
SOCIAM: The Theory and Practice of Social MachinesSOCIAM Project
 
ATHack! Inc. - Social Good Hackathons
ATHack! Inc. - Social Good HackathonsATHack! Inc. - Social Good Hackathons
ATHack! Inc. - Social Good HackathonsEhb Teng
 
Web 2.0 Technology Building Situational Awareness: Free and Open Source Too...
Web 2.0 Technology  Building Situational Awareness:  Free and Open Source Too...Web 2.0 Technology  Building Situational Awareness:  Free and Open Source Too...
Web 2.0 Technology Building Situational Awareness: Free and Open Source Too...Connie White
 
2nd Annual Geospatial Conference
2nd Annual Geospatial Conference2nd Annual Geospatial Conference
2nd Annual Geospatial ConferenceHeather Blanchard
 
Building Social Life Networks 130818
Building Social Life Networks 130818Building Social Life Networks 130818
Building Social Life Networks 130818Ramesh Jain
 
Crisiscamp Ireland Opening presentation
Crisiscamp Ireland Opening presentationCrisiscamp Ireland Opening presentation
Crisiscamp Ireland Opening presentationEvert Bopp
 
Filth and lies: analysing social media
Filth and lies: analysing social mediaFilth and lies: analysing social media
Filth and lies: analysing social mediaDiana Maynard
 
Transforming Social Big Data into Timely Decisions and Actions for Crisis Mi...
Transforming Social Big Data into Timely Decisions  and Actions for Crisis Mi...Transforming Social Big Data into Timely Decisions  and Actions for Crisis Mi...
Transforming Social Big Data into Timely Decisions and Actions for Crisis Mi...Amit Sheth
 
Citizen Sensor Data Mining, Social Media Analytics and Applications
Citizen Sensor Data Mining, Social Media Analytics and ApplicationsCitizen Sensor Data Mining, Social Media Analytics and Applications
Citizen Sensor Data Mining, Social Media Analytics and ApplicationsAmit Sheth
 
What's up at Kno.e.sis?
What's up at Kno.e.sis? What's up at Kno.e.sis?
What's up at Kno.e.sis? Amit Sheth
 
The State of Social Media (and How to Use It and Not Lose Your Job)
The State of Social Media (and How to Use It and Not Lose Your Job)The State of Social Media (and How to Use It and Not Lose Your Job)
The State of Social Media (and How to Use It and Not Lose Your Job)Andrew Krzmarzick
 

Similar to Crisis Mapping, Citizen Sensing and Social Media Analytics: Leveraging Citizen Roles for Crisis Response Coordination (20)

Disaster Volunteer Management: Trends & Opportunities
Disaster Volunteer Management: Trends & OpportunitiesDisaster Volunteer Management: Trends & Opportunities
Disaster Volunteer Management: Trends & Opportunities
 
SOCIAM: The Theory and Practice of Social Machines
SOCIAM: The Theory and Practice of Social MachinesSOCIAM: The Theory and Practice of Social Machines
SOCIAM: The Theory and Practice of Social Machines
 
08302011 cc vtc_risk
08302011 cc vtc_risk08302011 cc vtc_risk
08302011 cc vtc_risk
 
ATHack! Inc. - Social Good Hackathons
ATHack! Inc. - Social Good HackathonsATHack! Inc. - Social Good Hackathons
ATHack! Inc. - Social Good Hackathons
 
Web 2.0 Technology Building Situational Awareness: Free and Open Source Too...
Web 2.0 Technology  Building Situational Awareness:  Free and Open Source Too...Web 2.0 Technology  Building Situational Awareness:  Free and Open Source Too...
Web 2.0 Technology Building Situational Awareness: Free and Open Source Too...
 
Situational Awareness Through Social Media
 Situational Awareness Through Social Media  Situational Awareness Through Social Media
Situational Awareness Through Social Media
 
2nd Annual Geospatial Conference
2nd Annual Geospatial Conference2nd Annual Geospatial Conference
2nd Annual Geospatial Conference
 
Disaster Volunteer Management - Trends & Opportunities
Disaster Volunteer Management - Trends & OpportunitiesDisaster Volunteer Management - Trends & Opportunities
Disaster Volunteer Management - Trends & Opportunities
 
Crowdsourcing the Commons
Crowdsourcing the CommonsCrowdsourcing the Commons
Crowdsourcing the Commons
 
Building Social Life Networks 130818
Building Social Life Networks 130818Building Social Life Networks 130818
Building Social Life Networks 130818
 
Social media
Social mediaSocial media
Social media
 
Caravan Studios Update for TechSoup Global Staff
Caravan Studios Update for TechSoup Global StaffCaravan Studios Update for TechSoup Global Staff
Caravan Studios Update for TechSoup Global Staff
 
Crisiscamp Ireland Opening presentation
Crisiscamp Ireland Opening presentationCrisiscamp Ireland Opening presentation
Crisiscamp Ireland Opening presentation
 
Communication and Volunteers
Communication and Volunteers Communication and Volunteers
Communication and Volunteers
 
Filth and lies: analysing social media
Filth and lies: analysing social mediaFilth and lies: analysing social media
Filth and lies: analysing social media
 
Transforming Social Big Data into Timely Decisions and Actions for Crisis Mi...
Transforming Social Big Data into Timely Decisions  and Actions for Crisis Mi...Transforming Social Big Data into Timely Decisions  and Actions for Crisis Mi...
Transforming Social Big Data into Timely Decisions and Actions for Crisis Mi...
 
Lecture4 Social Web
Lecture4 Social Web Lecture4 Social Web
Lecture4 Social Web
 
Citizen Sensor Data Mining, Social Media Analytics and Applications
Citizen Sensor Data Mining, Social Media Analytics and ApplicationsCitizen Sensor Data Mining, Social Media Analytics and Applications
Citizen Sensor Data Mining, Social Media Analytics and Applications
 
What's up at Kno.e.sis?
What's up at Kno.e.sis? What's up at Kno.e.sis?
What's up at Kno.e.sis?
 
The State of Social Media (and How to Use It and Not Lose Your Job)
The State of Social Media (and How to Use It and Not Lose Your Job)The State of Social Media (and How to Use It and Not Lose Your Job)
The State of Social Media (and How to Use It and Not Lose Your Job)
 

Recently uploaded

VIP Moti Bagh Call Girls Free Doorstep Delivery 9873777170
VIP Moti Bagh Call Girls Free Doorstep Delivery 9873777170VIP Moti Bagh Call Girls Free Doorstep Delivery 9873777170
VIP Moti Bagh Call Girls Free Doorstep Delivery 9873777170Komal Khan
 
Models Call Girls Shettihalli - 7001305949 Escorts Service 50% Off with Cash ...
Models Call Girls Shettihalli - 7001305949 Escorts Service 50% Off with Cash ...Models Call Girls Shettihalli - 7001305949 Escorts Service 50% Off with Cash ...
Models Call Girls Shettihalli - 7001305949 Escorts Service 50% Off with Cash ...jicagig173
 
YouScan Company Overview - Social Media Listening with Visual Insights.pdf
YouScan Company Overview - Social Media Listening with Visual Insights.pdfYouScan Company Overview - Social Media Listening with Visual Insights.pdf
YouScan Company Overview - Social Media Listening with Visual Insights.pdfAlexander Sirach
 
Call Girls In Dwarka ⏩7838079806 ⏩Escort Service In Patel Nagar Delhi
Call Girls In Dwarka ⏩7838079806 ⏩Escort Service In Patel Nagar DelhiCall Girls In Dwarka ⏩7838079806 ⏩Escort Service In Patel Nagar Delhi
Call Girls In Dwarka ⏩7838079806 ⏩Escort Service In Patel Nagar Delhidelhiescort
 
When-technology-and-Humanity-Cross-1.pptx
When-technology-and-Humanity-Cross-1.pptxWhen-technology-and-Humanity-Cross-1.pptx
When-technology-and-Humanity-Cross-1.pptxReaper61
 
Amplify Your Brand with Our Tailored Social Media Marketing Services
Amplify Your Brand with Our Tailored Social Media Marketing ServicesAmplify Your Brand with Our Tailored Social Media Marketing Services
Amplify Your Brand with Our Tailored Social Media Marketing ServicesNetqom Solutions
 
The--Fraud: Netflix Original Media Pitch
The--Fraud: Netflix Original Media PitchThe--Fraud: Netflix Original Media Pitch
The--Fraud: Netflix Original Media Pitch17mos052
 
定制(ENU毕业证书)英国爱丁堡龙比亚大学毕业证成绩单原版一比一
定制(ENU毕业证书)英国爱丁堡龙比亚大学毕业证成绩单原版一比一定制(ENU毕业证书)英国爱丁堡龙比亚大学毕业证成绩单原版一比一
定制(ENU毕业证书)英国爱丁堡龙比亚大学毕业证成绩单原版一比一ra6e69ou
 
Music Video Codes and Conventions 2 .pptx
Music Video Codes and Conventions 2 .pptxMusic Video Codes and Conventions 2 .pptx
Music Video Codes and Conventions 2 .pptxjenrobinson12
 
Unveiling SOCIO COSMOS: Where Socializing Meets the Stars
Unveiling SOCIO COSMOS: Where Socializing Meets the StarsUnveiling SOCIO COSMOS: Where Socializing Meets the Stars
Unveiling SOCIO COSMOS: Where Socializing Meets the StarsSocioCosmos
 
fraud storyboards powerpoint media project
fraud storyboards powerpoint media projectfraud storyboards powerpoint media project
fraud storyboards powerpoint media project17mos052
 
Protecting Your Little Explorer at Home!
Protecting Your Little Explorer at Home!Protecting Your Little Explorer at Home!
Protecting Your Little Explorer at Home!andrekr997
 
O9654467111 Call Girls In Shahdara Women Seeking Men
O9654467111 Call Girls In Shahdara Women Seeking MenO9654467111 Call Girls In Shahdara Women Seeking Men
O9654467111 Call Girls In Shahdara Women Seeking MenSapana Sha
 
Mastering Wealth with YouTube Content Marketing.pdf
Mastering Wealth with YouTube Content Marketing.pdfMastering Wealth with YouTube Content Marketing.pdf
Mastering Wealth with YouTube Content Marketing.pdfTirupati Social Media
 
Upgrade Your Twitter Presence with Socio Cosmos
Upgrade Your Twitter Presence with Socio CosmosUpgrade Your Twitter Presence with Socio Cosmos
Upgrade Your Twitter Presence with Socio CosmosSocioCosmos
 
Cosmic Conversations with Sociocosmos...
Cosmic Conversations with Sociocosmos...Cosmic Conversations with Sociocosmos...
Cosmic Conversations with Sociocosmos...SocioCosmos
 

Recently uploaded (20)

VIP Moti Bagh Call Girls Free Doorstep Delivery 9873777170
VIP Moti Bagh Call Girls Free Doorstep Delivery 9873777170VIP Moti Bagh Call Girls Free Doorstep Delivery 9873777170
VIP Moti Bagh Call Girls Free Doorstep Delivery 9873777170
 
Models Call Girls Shettihalli - 7001305949 Escorts Service 50% Off with Cash ...
Models Call Girls Shettihalli - 7001305949 Escorts Service 50% Off with Cash ...Models Call Girls Shettihalli - 7001305949 Escorts Service 50% Off with Cash ...
Models Call Girls Shettihalli - 7001305949 Escorts Service 50% Off with Cash ...
 
YouScan Company Overview - Social Media Listening with Visual Insights.pdf
YouScan Company Overview - Social Media Listening with Visual Insights.pdfYouScan Company Overview - Social Media Listening with Visual Insights.pdf
YouScan Company Overview - Social Media Listening with Visual Insights.pdf
 
looking for escort 9953056974 Low Rate Call Girls In Vinod Nagar
looking for escort 9953056974 Low Rate Call Girls In  Vinod Nagarlooking for escort 9953056974 Low Rate Call Girls In  Vinod Nagar
looking for escort 9953056974 Low Rate Call Girls In Vinod Nagar
 
Call Girls In Dwarka ⏩7838079806 ⏩Escort Service In Patel Nagar Delhi
Call Girls In Dwarka ⏩7838079806 ⏩Escort Service In Patel Nagar DelhiCall Girls In Dwarka ⏩7838079806 ⏩Escort Service In Patel Nagar Delhi
Call Girls In Dwarka ⏩7838079806 ⏩Escort Service In Patel Nagar Delhi
 
When-technology-and-Humanity-Cross-1.pptx
When-technology-and-Humanity-Cross-1.pptxWhen-technology-and-Humanity-Cross-1.pptx
When-technology-and-Humanity-Cross-1.pptx
 
Amplify Your Brand with Our Tailored Social Media Marketing Services
Amplify Your Brand with Our Tailored Social Media Marketing ServicesAmplify Your Brand with Our Tailored Social Media Marketing Services
Amplify Your Brand with Our Tailored Social Media Marketing Services
 
The--Fraud: Netflix Original Media Pitch
The--Fraud: Netflix Original Media PitchThe--Fraud: Netflix Original Media Pitch
The--Fraud: Netflix Original Media Pitch
 
定制(ENU毕业证书)英国爱丁堡龙比亚大学毕业证成绩单原版一比一
定制(ENU毕业证书)英国爱丁堡龙比亚大学毕业证成绩单原版一比一定制(ENU毕业证书)英国爱丁堡龙比亚大学毕业证成绩单原版一比一
定制(ENU毕业证书)英国爱丁堡龙比亚大学毕业证成绩单原版一比一
 
Music Video Codes and Conventions 2 .pptx
Music Video Codes and Conventions 2 .pptxMusic Video Codes and Conventions 2 .pptx
Music Video Codes and Conventions 2 .pptx
 
Unveiling SOCIO COSMOS: Where Socializing Meets the Stars
Unveiling SOCIO COSMOS: Where Socializing Meets the StarsUnveiling SOCIO COSMOS: Where Socializing Meets the Stars
Unveiling SOCIO COSMOS: Where Socializing Meets the Stars
 
fraud storyboards powerpoint media project
fraud storyboards powerpoint media projectfraud storyboards powerpoint media project
fraud storyboards powerpoint media project
 
Protecting Your Little Explorer at Home!
Protecting Your Little Explorer at Home!Protecting Your Little Explorer at Home!
Protecting Your Little Explorer at Home!
 
O9654467111 Call Girls In Shahdara Women Seeking Men
O9654467111 Call Girls In Shahdara Women Seeking MenO9654467111 Call Girls In Shahdara Women Seeking Men
O9654467111 Call Girls In Shahdara Women Seeking Men
 
Enjoy ➥8448380779▻ Call Girls In Noida Sector 93 Escorts Delhi NCR
Enjoy ➥8448380779▻ Call Girls In Noida Sector 93 Escorts Delhi NCREnjoy ➥8448380779▻ Call Girls In Noida Sector 93 Escorts Delhi NCR
Enjoy ➥8448380779▻ Call Girls In Noida Sector 93 Escorts Delhi NCR
 
Mastering Wealth with YouTube Content Marketing.pdf
Mastering Wealth with YouTube Content Marketing.pdfMastering Wealth with YouTube Content Marketing.pdf
Mastering Wealth with YouTube Content Marketing.pdf
 
young Call girls in Dwarka sector 23🔝 9953056974 🔝 Delhi escort Service
young Call girls in Dwarka sector 23🔝 9953056974 🔝 Delhi escort Serviceyoung Call girls in Dwarka sector 23🔝 9953056974 🔝 Delhi escort Service
young Call girls in Dwarka sector 23🔝 9953056974 🔝 Delhi escort Service
 
Hot Sexy call girls in Ramesh Nagar🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Ramesh Nagar🔝 9953056974 🔝 Delhi escort ServiceHot Sexy call girls in Ramesh Nagar🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Ramesh Nagar🔝 9953056974 🔝 Delhi escort Service
 
Upgrade Your Twitter Presence with Socio Cosmos
Upgrade Your Twitter Presence with Socio CosmosUpgrade Your Twitter Presence with Socio Cosmos
Upgrade Your Twitter Presence with Socio Cosmos
 
Cosmic Conversations with Sociocosmos...
Cosmic Conversations with Sociocosmos...Cosmic Conversations with Sociocosmos...
Cosmic Conversations with Sociocosmos...
 

Crisis Mapping, Citizen Sensing and Social Media Analytics: Leveraging Citizen Roles for Crisis Response Coordination

  • 1. CrisisMapping,CitizenSensingand SocialMedia Analytics Hemant Purohit Amit Sheth Carlos Castillo Patrick Meier The Ohio Center of Excellence in Knowledge-enabled Computing (Kno.e.sis) Wright State, USA Qatar Computing Research Institute (QCRI) Doha, Qatar Leveraging Citizen Roles for Crisis Response Coordination
  • 2. Introduction: Kno.e.sis and QCRI • At Kno.e.sis: NSF SoCS project on ‘Social Media Enhanced Organizational Sensemaking during Emergency Response’ • At QCRI: ‘Artificial Intelligence for Disaster Response’ (AIDR) project for Social Innovation
  • 3. Outline • Introduction • Gaps & Challenges • Role of Computer Science • Applied Crisis Computing • Design Principles
  • 5.
  • 6.
  • 9. EMERGENCY HACKATHONS AFTER HAITI DEVASTATION .. Thousands of miles away!
  • 10. “YOUR SITE HELPED SAVE HUNDREDS OF LIVES” - US MARINE CORPS
  • 13. Digital Footprints of Twitterers.. .. Pulse of the planet
  • 14. FEMA Task Force Haiti ter
  • 15.
  • 16. Why we care about Citizen Sensing? - It forms Self Organizing Communities!
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23. We all need to join hands together for effectively improving response coordination! - Humanitarians - Computer and Social Scientists
  • 24.
  • 25. - Big Data in crisis situations needs computing help! - Humanitarians alone can’t handle it!
  • 26. Outline • Introduction • Gaps & Challenges • Scale, velocity, redundancy, heterogeneity, bias, noise & verifiability • Role of Computer Science • Applied Crisis Computing • Design Principles
  • 27. Puzzle of Crisis Informatics • What emergency-responders want? 1. Any available prior knowledge about the impact of similar past disasters in the region? 2. Are existing response strategies sufficient? 3. Which factors will worsen conditions? 4. How many fatalities? Extent of damage? What emergency- responders want What computer scientists can provide What is supported by current social media data
  • 28. Puzzle of Crisis Informatics • What computer scientists can provide? • Algorithms to detect and predict abnormal trends • Semantic abstraction and summarization of data • Human+Machine readable knowledge organization via ontologies • Technology to map geo-located information • Visual data interface for quicker comprehension What emergency- responders want What computer scientists can provide What is supported by current social media data
  • 29. Puzzle of Crisis Informatics • What is supported by social media data? • Real-time updates on the situation • Textual summaries, images, videos • Messages about needs and offers • Geo-location metadata What emergency- responders want What computer scientists can provide What is supported by current social media data
  • 30. Crisis Response Analytics • Mainly three major methods of information extraction and mapping: • Manual feed (Processed info.) based • e.g., Most of the formal and hybrid response organizations (Red Cross, UNOCHA), Recovers.org, AIDMatrix, SparkRelief, etc. • Crowdsourcing with limited automation • e.g., Crowdmap/Ushahidi, etc. • Automatized processing based • e.g., Twitris, CrisisTracker, etc. • Information management for resource coordination: • e.g., Sahana
  • 31. Illustrative Crisis Informatics Projects Project Host Team Focus Sahana Univ. of Maryland Information Management EPIC (Tweak-the-Tweet) Univ. of Colorado and UC Irvine Information extraction and behavioral aspects in response NSF SoCS Kno.e.sis, Wright State Univ. and Ohio State Univ. Organizational sensemaking and Coordination AIDR QCRI, Doha Targeted Information extraction NSF GeoNets Univ. of Southern California Ad hoc Geospatial Data Sharing Note that it is not an exhaustive list, see more resources here: http://wiki.knoesis.org/index.php?title=Summary_about_Social_Media_Research_in_Disaster/Emergency_Response_Systems&oldid=5177
  • 32. Illustrative Crisis Mapping and Analytics tools Tool Visual Geo Mapping Human Inputs Real- time Update People to engage with Topical summary Explore data Semantics CrowdMap (Ushahidi) Y Y Y Y Sahana Y Y Y Y Y AIDMatrix Y Y Recovers.org Y Y SparkRelief Y Y Y Twitris* Y Y Y Y Y Crisis Tracker* Y Y Y *Social Media driven Note that it is not an exhaustive list, see more resources here: http://wiki.knoesis.org/index.php?title=Summary_about_Social_Media_Research_in_Disaster/Emergency_Response_Systems&oldid=5177
  • 33. Tools: Sahana • A free & open source portable web tool for Disaster Management • Features: • Organization Registry • Maintains data (contact, services, etc.) of organizations and volunteers in response • Missing Persons / Disaster Victim Registry • Helps track and find missing, deceased, injured and displaced people and families • Request Management • Tracks all requests and helps match pledges for support, aid and supplies to fulfilment • Shelter Registry • Tracks data on all temporary shelters setup following the Disaster More: http://www.slideshare.net/skbohra/sahana-disaster-management-system
  • 36. Tools: CrowdMap • The well-known Ushahidi’s version • Geo-located reports • Crowdsourced data pieces, turned into powerful information nuggets as reports from regions • Video: • http://www.youtube.com/watch?v=GjPc39OXr6I
  • 39. Tools Demo: Twitris • Example of automatic processing compared to the previous tool based on manual-feed processing for crisis computing • A Semantic Social Web platform for comprehensive event analysis • Real-time monitoring and multi-faceted analysis of social signals: • space, time, people, content, network, and additionally sentiment and emotion • Platform for on-going research for situational awareness and coordination using social media and knowledge on the Web
  • 40. Important tags to summarize Big Data flow Related to Oklahoma tornado Images and Videos Related to Oklahoma tornado Tools Demo: Twitris (Topicalnuggetsummary)
  • 41. Incoming Tweets with need types to give quick idea of what is needed and where currently #OKC Legends for Different needs #OKC Tools Demo: Twitris (Real-timeinformationfor needs) Clicking on a tag brings contextual information– relevant tweets, news/blogs, and Wikipedia articles
  • 42. Tools Demo: Twitris (Influencerstoengagewith,forspecific needs) Influential users are for respective needs. Right side shows their interaction network on social media. Engaging with influencers in the self organizing communities can be very powerful for- a.) getting important information, b.) Correcting rumors in the network, c.) Propagating important information back into the citizen sensors community
  • 43. Tools Demo: Twitris (InR&D:EngagementInterfacefor responders) What-Where-How-Who-Why Coordination Influential users to engage with and resources for seekers/supplies at a location, at a timestamp Contextual Information for a chosen topical tags
  • 44. Tools Demo: Twitris during Oklahoma- Tornado disaster response • Video of the on-going monitoring on the next morning of the Oklahoma Tornado: • http://twitris.knoesis.org/images/datasets-and-models/Twitris--for- Oklahoma-disaster.mov • Snapshots during the analysis: • Images
  • 45. Who are the people to engage with in the evolving ad-hoc social community? Which needs are of utmost importance? Actionable information improves decision making process. Who are the resource seekers and suppliers? Questions to social media tools for Disaster Response Coordination Where can I go for volunteering at my location? How and Where can one donate?
  • 47. Challenge: Heterogeneity • Multiple channels • Phone, fax, TV, radio, newspapers, internet, sensor networks, etc. • Coexistence of technologies, a constant • Social media is heterogeneous • Verified accounts • Re-tweets from well-known sources • Eyewitness reports • Lots more! • Different types (unstructured text, structured, multimedia) may require different tools http://blogs.lse.ac.uk
  • 48. Challenge: Velocity • Social media information is more valuable in the first minutes and hours after a disaster • Affected people are there before anybody else • When emergency responders arrive, their priority may not be to keep information flowing • After hours/days social media is still valuable, but there is much more information from other sources • In the early hours of a disaster, television feels so slow in comparison • Often a few seconds of footage repeated over and over and over http://seventhinc.com/
  • 49. Challenge: Scale • In some countries a sizable fraction of the population has Internet access • Tweets are small and nimble but they point to webpages, include images, videos, etc. • You need to process a lot to obtain a little • There are many tweets but • Only some of them contain usable information • Only a fraction of those can be handled by automatic systems Top-4 countries by Twitter penetration among Internet users; by Comscore via http://5mk.co/
  • 50. Challenge: Redundancy • Information from multiple information channels may not be unique • Near-duplicates frustrate users and waste their time • Definition of abstraction level (to merge items) is always arbitrary, depends on the application • Automatic systems tend to pick what is redundant first • Not necessarily a bad thing, e.g. phrases that are often repeated, tweets that are often re-tweeted, etc. Millenial’s information sources http://ypulse.com/
  • 51. Challenge: Biases • Social Media Bias: • Youngers better user than elders • Educated users more existent than uneducated • Technology Privileged users more existent than unprivileged • Study carefully, with the grains of salt! • Smart sampling • Smart data cleaning • Smart algorithms
  • 52. Challenge: Noise • Everyone wants to be heard • Independently of adding any value • Emotional expressions and even jokes drive the data traffic • Informal text and jargon hinders automatic text processing
  • 53. Challenge: Verifiability • Social media users are starting to develop their own methods to validate information • In crisis scenarios most rumors are spread by well-intentioned people • But there are also some pranksters • We need a more fine-grained approach than true/false (we have always needed it) Edelman 2012 http://edelman.com/trust
  • 54. Outline • Introduction • Gaps & Challenges • Role of Computer Science • IR, DM, ML, NLP, SN, HCI • Applied Crisis Computing • Design Principles
  • 55. Information Retrieval (IR) • The research field that created web search • No problem working with subjective definitions • Relevance has always been in the eye of the beholder • Can help us by providing searching and ranking operations on social media reports
  • 56. IR Method: inverted indexes • What does it do? • Allows to locate documents containing a term without having to scan a whole Collection How does it work? • An inverted index contains a list of terms, and a list of documents containing each term • How can it help us? • Indexing a collection of reports can help us locate specific ones very quickly Encyclopedia of Language and Linguistics
  • 57. IR/ML Method: learning-to-rank paradigm • What does it do? • Find relevant documents for a search • How does it work? • Modern methods use hundreds of static (document-dependent) and dynamic (query-document-dependent) characteristics and a learning-to-rank framework • How can it help us? • Modern IR is well beyond hard rules, and beyond heuristic scoring functions; no need to re-invent the wheel http://people.dsv.su.se/~eriks/
  • 58. IR Method: document clustering • What does it do? • Group search results in order to better scan them; can be done on a query-dependent or query-independent way • How does it work? • One way is to do a weighted dot product in which weights are associated to how informative (~rare) are words • How can it help us? • Makes it easier to deal with large, redundant collections of text http://carrot2.org/
  • 59. Example of document clustering Crisis Tracker
  • 60. Data Mining (DM) • The science of finding patterns in data • Finding association rules, categories of elements, anomalies, etc. • Managing temporal data • Can help us detect and track trends and topics • Managing static data • Can help us reduce the dimensionality of data
  • 62.
  • 63. DM Method: burst detection • What does it do? • Reliably identifies anomalies in a time series (e.g. volume of tweets w/hashtag vs time) • How does it work? • Look for increases above the norm; look for change patterns that precede crisis • In general it is hard over noisy signals • How can it help us? • Detection of sub-events in an ongoing crisis is important to rapidly respond to them Volume for query “boston” in Google (trends.google.com).
  • 64. DM Method: topic detection and tracking • What does it do? • Track the relative popularity of different topics over time • How does it work? • Cluster documents per time slice, merge across times slices • How can it help us? • See emerging stories, track new developments, sub- stories, etc. TextFlow
  • 65. DM Method: dimensionality reduction • What does it do? • Represent complex data in simpler terms • How does it work? • Find independent pieces of information, discard/merge correlated ones • How can it help us? • We can focus on the big picture, not just hash-tags and keywords, but topics 4 dimensions (x,y,z,color) 2 dimensions (x’,y’) X, Y axes are correlated => X’ axis Z is independent => Y’ Color is equivalent to X’ => gone X’ Y’ http://www.cs.otago.ac.nz/
  • 66. IR/DM Method: reduce text dimensionality LDA. Illustration by Lisa M. Rhody Input: thousands of dimensions (one for every word) Output: a handful of dimensions (one for every topic)
  • 67. Statistical Machine Learning (ML) • A branch of artificial intelligence • While DM focuses on discovery, ML focuses on prediction • ML aims at representing data and generalizing from it • Supervised statistical machine learning is a well-established framework to learn the relationship between inputs and outputs • Can help us learn from human labeling efforts to create automatic labels for new data
  • 68. ML method: supervised classification • What does it do? • Learn to separate different classes of elements, given (relatively) few examples • How does it work? • Several methods to choose from, popular ones are SVMs and Decision Trees/Forests • How can it help us? • Automatic classification of reports http://www.quora.com/
  • 69. Example: automatic tweet classification Caution & Advice Information Sources Damage & Casualties Donations Health Shelter Food Water Logistics ... ...
  • 70. ML method: regression • What does it do? • The same as supervised classification but the target is numerical, not categorical • How does it work? • It learns the parameters of a function that fits what is observed • How can it help us? • It can predict an outcome from current data http://qcri.qa/
  • 71. Natural Language Processing (NLP) • A research area that has fought against several (possibly AI-complete) problems • Watson and other projects have demonstrated visibly their success • Can help us to classify and extract information by doing automatically: • Morphological analysis • Dependency parsing • Entity linking / Word sense disambiguation http://voices.washingtonpost.com/
  • 72. NLP method: tagging • What does it do? • Determines classes for tokens or segments on a text: part-of-speech tags, named entities • How does it work? • Supervised learning with structured outputs • How can it help us? • A richer representation of tweets yields better predictions • Spotting named entities or key phrases can help summarize tweets I/preposition can/modal see/verb the/determiner flames/noun from/preposition here/adverb
  • 73. NLP methods: dependency parsing • What does it do? • Identifies relationships between different parts of a text • How does it work? • Learned from labeled data using structured output (output is a parse tree) • How can it help us? • Identifying key elements on text can help find cases where a named entity is central on a report “Bills on ports and immigration were submitted by Senator Brownback, Republican of Kansas” http://nlp.stanford.edu/
  • 74. NLP method: disambiguation/linking • What does it do? • Connect named entities to concepts, e.g. a sense on a dictionary or a URL in Wikipedia • How does it work? • Entities can have multiple senses; the correct one is picked by using contextual clues • How can it help us? • Once we have determined a concept we can map it to broader classes 1 readiness to give attention 2 quality of causing attention to be given 3 activity, subject, etc., which one gives time and attention to 4 advantage, advancement, or favour 5 a share (in a company, business, etc.) 6 money paid for the use of money Meaning of “interest” This may be of interest [2] to you The money grows because of compound interest [6] http://www.ling.gu.se/~lager/
  • 75. Graph Theory (GT) a.k.a.linkanalysis,networkanalysis • Social graphs are important abstractions, they represent social connections as a graph • Lots of information can be derived from properties of this graph • Communities • Central users • Bridges • Availability of large datasets from online social networking sites has brought new life to this field http://www.hackingalert.net/
  • 76. GT method: graph clustering • What does it do? • Find communities of densely connected nodes • How does it work? • There are many methods, depending on the definition of community • How can it help us? • We can identify groups of people who are closely connected http://griffsgraphs.com/
  • 77. GT method: centrality metrics • What does it do? • Identify which nodes in a graph are in more shortest paths (centrality), or are more likely to be at the end of a random walk (PageRank) • How does it work? • Pagerank is computed through iterative calculations over the entire graph • How can it help us? • These are good proxies for importance on a network Wikipedia
  • 78. Human-Computer Interaction (HCI) • Technologies should bring people joy, not frustration • Design principles and methodologies have been developed over years • More important, evaluation and validation criteria have emerged
  • 79. HCI method: user-centered design • What does it do? • Ensure users can use a tool effectively • How does it work? • Put users and their tasks at the center of the design process • How can it help us? • We can avoid losing the focus on our application development by starting with the users’ concerns http://usability.msu.edu/
  • 80. HCI method: prototypes and cont. evaluation • What does it do? • Help understand what users want early on, determine if design is effective • How does it work? • Build mock-ups and low-fidelity prototypes early on, evaluate them empirically • How can it help us? • Users may not know what they want until they see it; integrating them in the design requires communicating effectively; we also need to know how are we going to measure.
  • 81. Outline • Introduction • Gaps & Challenges • Role of Computer Science • Applied Crisis Computing • DM is not the same as DM • Design Principles
  • 82. Applied Crisis Computing Example to Assist Coordination: Donations Matching
  • 83. Thanks, But No Thanks … • Many people want to donate during disasters • Waste occurs due to resources being over- or under-supplied • Goal: understanding what is needed and what is offered by social media users http://www.npr.org/2013/01/09/168946170/thanks-but-no-thanks-when-post-disaster-donations-overwhelm
  • 84. Matching requests with offers How to volunteer, donate to Hurricane Sandy: <URL> If you have clothes to donate to those who are victims of Hurricane Sandy … Red Cross is urging blood donations to support those affected <URL> I have TONS of cute shoes & purses I want to donate to hurricane victims … Does anyone know how to donate clothes to hurricane #Sandy victims? Does anyone know of community service organizations to volunteer to help out? Needs to get something, suggests scarcity: REQUEST (demand) Offers or wants to give, suggests abundance: OFFER (supply)
  • 85. RT @OpOKRelief: Southgate Baptist Church on 4th Street in Moore has food, water, clothes, diapers, toys, and more. If you can't go,call 794 Text "FOOD" to 32333, REDCROSS to 90999, or STORM to 80888 to donate $10 in storm relief. #moore #oklahoma #disasterrelief #donate Want to help animals in #Oklahoma? @ASPCA tells how you can help: http://t.co/mt8l9PwzmO CITIZEN SENSORS RESPONSE TEAMS (including humanitarian org. & ‘pseudo’ responders) VICTIM SITE Coordination of needs and offers Using Social Media Does anyone know where to send a check to donate to the tornado victims? Where do I go to help out for volunteer work around Moore? Anyone know? Anyone know where to donate to help the animals from the Oklahoma disaster? #oklaho ma #dogs Matched Matched Matched Serving the need! If you would like to volunteer today, help is desperately needed in Shawnee. Call 273-5331 for more info
  • 87. Information extraction: core & facets • Core of the phrase is the “what” • Other facets may include “who”, “where”, “when”, etc. Rotary collecting clothing and other donations in New Jersey <URL> { source: “Twitter”, author: “@NN”, text: “Rotary collecting clothing and other donations in New Jersey <URL>”, donation-info: { donation-type: “Request”, donation- type-confidence: 0.8, donation-organization: “Rotary”, donation-item: “clothing and other donations”, donation-location: “New Jersey” }, … }
  • 89. Some example matches [naïve method] • Pair 1: • Anyone know of volunteer opportunities for hurricane Sandy? Would like to try and help in anyway possible (OFFER) • RT @Gothamist: How To Volunteer, Donate To Help Hurricane Sandy Victims http://t.co/fXUOnzJe (REQUEST) • Pair 2: • I want to send some clothes for hurricane relief (OFFER) • Me and @CeceVancePR are coordinating a clothing/food drive for families affected by Hurricane Sandy. If you would like to donate, DM us. (REQUEST)
  • 90. Much work remains to be done • Matching quality depends on type of donation • Improvements on item representation are necessary • Sparsity is part of the problem • Improvements on matching quality are necessary • Hybrid approach needs to be investigated • Budget of K crowdsourcing calls, which items to annotate? • A real-world system should use continuous querying, is this efficient? Similar approach is applicable in other problem contexts of coordination as well!
  • 91. Objective: Support Decision Making and Coordination of Actions
  • 92. An analogy: product comparison sites • What product comparison sites do today • Collect pieces of information having diverse structure (each site has its own) • Enrich them with automatically-extracted facets (photo, name, reviews, etc.) • Cluster/de-duplicate • Enable search by extracted facets • In our case, there is almost no structure to start with, just context http://pricegrabber.com/
  • 93. First: extract facets from unstructured text • Collect messages • Classify according to several ontologies • Not only content classification • Also Author/Source classification: discover roles • Extract core aspects / information nuggets • Identify the key portion of a message • Extract facets • Geo-locate
  • 94. Second: manage data and enable faceted retrieval • Support real-time insertions • Must be visible immediately • Support real-time updates • E.g. new user assessments/labels of data • E.g. new parameters for an automatic classifier • Support complex queries • Faceted retrieval on complex predicates • Return relevant results • Relevance is based on multiple signals (geo, time, IR-based, etc.)
  • 95. Third: discover relationships and clusters • Clustering • Near-duplicate detection • Same event/story/etc. • Data-driven geographical regions • Discover relationships • Content-Reply ? • Claim-Refutation ? • Etc. • Best supported by linked data management systems http://www.jaunted.com/ At a high level, what are the names of the touristic hot-spots of the word?
  • 96. Fourth: enable high-level operations • Summarization [static] • Synthesize/extract a high-level description from a set of items • Semantic clustering [static] • Determine clusters based on high-level characteristics of data • Event detection [dynamic] • Discover large changes in the data at some level of abstraction • Topic tracking [dynamic] • Discover how a topic (an aspect of the data) evolves over time
  • 97. Focus on decision making and coordination • Do not start by thinking on data visualization • Data visualization is constrained by the richness of your data • Start by thinking on how to make your data richer • Key questions to prioritize R&D on these systems: • Who will consume the data? • What decisions does this person or this community need to take? • Which aspects of the data support these decisions? • How do we know the decision was correct? • Can the end-users of the social media analysis make better decisions than the non-users?
  • 98. Example questions during decision-making by actors (a.) Seeker/Demander • Whom to follow (provider) • Where to find resource info • Whom to contact in the Responder teams (b.) Provider/Supplier • Whom to follow (Seeker) • Where to find resource scarcity info • Whom to inform in the Responder side (c.) Responder • Whom (seeker/provider) to contact/DM/Mention • Where to find resource scarcity/availability info. • Whom to communicate to deliver the right info. in right time
  • 100. Data availability: chicken-or-egg problem http://www.vtaide.com/ People’s posts don’t include some data Because nobody is looking for that data
  • 101. The semantic gap • Introduced ca. 1989 in the context of multimedia retrieval • Low-level features are far from high-level information needs http://www.semanticmetadata.net/
  • 102. • Vertical operators facilitate transcending from data-information- knowledge-wisdom using background knowledge • Horizontal operators facilitate semantic integration of multimodal observations Analogy for Low level Data to High Level transformation http://www.slideshare.net/apsheth/physical-cyber-social-computing-an- early-21st-century-approach-to-computing-for-human-experience
  • 103. Semantic gap: ML/DM/NLP/IR/… • Automatic methods for classifying and extracting information from short pieces of text are usable but from perfect • Noisy texts make the problem harder • Social media English is a particular dialect of English • Short texts make the problem harder • There is not enough context to disambiguate • Frequency-based methods to determine key words are not usable • Important subtleties escape us • e.g. irony in sentiment analysis
  • 104. Intentions: chicken-or-egg problem http://www.vtaide.com/ Some types of coordination do not often happen online Because there are no platforms supporting such coordinations
  • 105. Fine-grained analysis of intentions • People go online during disasters for a variety of reasons • How good is our understanding of these reasons • Suppose we know the top-3 reasons, how many people those reasons cover • The only way of operating with a long-tail of information needs is to think in the more general terms possible • Plus opportunistically creating “vertical” systems for niche needs
  • 106. Towards a generic crisis response ontology • UN effort on generic ontology (taxonomy and relationships) • HXL (Humanitarian Exchange Language) • Still a gap between what has been modeled so far vs. what can be used (supported via data and analytics) • Current efforts in the W3C community on ‘Emergency Information management’ on extending HXL with other existing relevant ontologies and create a necessary and sufficient model More about HXL: http://hxl.humanitarianresponse.info/ns/index.html
  • 107. Continuously-evolving models • How do we capture the existing knowledge evolving around an event Moore is a suburb of Oklahoma City If you would like to volunteer today, help is desperately needed in Shawnee. Call 273- 5331 for more info Shawnee is a suburb near Moore Geographies: Shawnee Moore Focus areas for Data collection, processing and analytics
  • 108. Outline • Introduction • Gaps & Challenges • Role of Computer Science • Applied Crisis Computing • Design Principles • New systems focused on actions and coordination
  • 109. Principle 1: Explicitly identify target users • This may not be a homogeneous groups • Identify profiles • Background, skills, etc.
  • 110. Target users: examples • Headquarters Humanitarians • Policy, Information Products, Coordination • Field Humanitarians • Logistics, Relief, Coordination • Digital Humanitarians • Information Collection • Analysis
  • 114. Principle 2: Engage users in co- design • Do not let them offload requirements and then leave • We want them to co-design with us • This requires effective tools for communication • e.g. wireframe designs, user stories, etc.
  • 115. Principle 3: Socio-technical systems • Conceptualize the system as hybrid (human and computer intelligence) from the beginning • Improve response in a continuous fashion • We want users to be part of the operation of the systems themselves
  • 116. Principle 4: Empirical evaluation through actions • We want systems that look good and are easy to use • We do not evaluate based on looks • Are the actions of users better than those of non-users?
  • 117. There is a part for everybody in this community Hackers, scientists, humanitarians, everybody.
  • 118. Hackers • Create and curate useful datasets • Create dataset remixes • Create software tools • Create libraries • Create interoperability
  • 119. Computer scientists • There are many open problems in ML, DM, NLP, etc. • Collaborating and partnering in humanitarian computing • It is easier to share data and solutions in this application domain than in commercially-driven ones • This is also a rich test bed for testing algorithms • Those algorithms can be useful well beyond humanitarian computing
  • 120. Social scientists • There are many open questions about how, why, people coordinate, how to motivate them, what information do they require, how to present that information, etc. • Which organizational structures are better during different phases of crisis- mitigation, rescue, relief, recovery and rebuild • Humanitarian and crisis computing projects need to be assessed and evaluated for intended impact. • How to communicate these projects-- need to be communicated in non-technical language that humanitarian policy makers understand.
  • 121. Humanitarian organizations • It takes two to tango! • Your scientific partners are not providers/vendors • Scientists want access to your experts and data • Access to experts and problems is extremely important • This is a win-win situation: help us create partnerships http://worcestertango.org/
  • 122. Everybody • Interdisciplinary research is not easy to execute • But an unidirectional approach will create only more gaps in the research-to-practice pipeline.
  • 123. Thanks to • Nation Science Foundation (NSF) for SoCS project grant: Social Media Enhanced Organizational Sensemaking in Emergency Response • Kno.e.sis Twitris team, Prof. Valerie Shalin, Prof. John Flach, Andrew Hampton in the Dept. of Psychology (Wright State U) • Prof. Srini Parathasarathy, Yiye Ruan, Dave Fuhry (Ohio State U) • Fernando Diaz, Microsoft Research • Shady Elbaussoni, Beirut University • Muhammad Imran, QCRI • Jakob Rogstadius, Madeira University • Our colleagues for suggestions on the material including Sahana project @UMD and ISI @USC, etc. • Images used here belong to their respective owners, we are grateful to such usefulness of their work that these images can be illustrative in certain contexts! Many thanks!
  • 124. Questions, Discussion and Feedback • References and reading material: • http://www.knoesis.org/hemant/present/icwsm2013 • http://humanitariancomp.referata.com/ • Got Questions? – Talk to us on Twitter: @hemant_pt , @ChaToX , @PatrickMeier , @amit_p

Editor's Notes

  1. NOT JUST ACADEMIC INTEREST!
  2. ANALOG COMMUNICATION DURING CRISIS
  3. DIGITAL COMMUNICATION
  4. Haiti Coverage by Media: VIDEO – FILENAME: HaitiCNNEdit2
  5. NO ONE HAD DONE ANYTHING QUITE LIKE THIS MADE IT UP AS WE WENT ALONG VERY EXHAUSTING, TIME CONSUMING, ENTIRELY MANUAL, BURN OUT NEVER AGAIN
  6. EMERGENCY HACKATHONS SUCCESS STORY VIDEO – FILENAME: HaityReality.mov
  7. FAR FROM PERFECT, BUTSAVED LIVES
  8. IN 38 DISTINCT SOCIAL MEDIA CHANNELS, AND COUNTING CROWDS COLLECTIVELY WITNESSING, ALSO DATA EXHAUST
  9. EXAMPLE OF DATA EXHAUST (VS REPORTING) JAKARTA TWITTER MAP
  10. DIGTAL FOOTPRINTS PULSE OF THE PLANET VOLUME OFF
  11. - Sentiment evolution on Twitter during Hurricane Sandy LARGEST ALTANTIC HURRICANE IN HISTORY SECOND COSTLIEST IN US HISTORY 75BN
  12. BIG CRISIS DATA USED TO FACE DATA SCARCITY, BUT OVERFLOW EQUALLY PARALIZING 20 million tweets with “sandy, hurricane” keywords between Oct 27th and Nov 1st ½ MILLION INSTAGRAM 2ND MOST POPULAR TOPIC ON FB DURING 2012 http://www.guardian.co.uk/news/datablog/2012/oct/31/twitter-sandy-flooding http://www.huffingtonpost.com/2012/11/02/twitter-hurricane-sandy_n_2066281.html http://mashable.com/2012/10/31/hurricane-sandy-facebook/ We in our lab have quite a bit of Social Data Research going on. So I would like to focus on the use of social networks during these disasters/crisis. Twitter and Facebook are massively used during disasters. During Hurricane Sandy there were … Not only this a major outbreak of tweets were during Japan earthquake which crossed more that 2000 tweets/sec. So why do people intend to use social networks to this extent during disasters.
  13. WHY WE CARE ABOUT CITIZEN SENSING SHIFT IN COMM PARADIGM ONE TO MANY, MANY TO MANY SELF-HELP, CITIZEN EMPOWERMENT, RESILIENCE SELF ORGANIZATION IN COMMUNITIES
  14. Give examples of their 48 hrs. of effort to compile a report, can we assist in such situational assessment process and thus help coordinate ALLOCATION OPTIMIZATION, LIMITED RESOURCES, TIME, INFORMATION RAPID NEEDS/DAMAGE ASSESSMENT DEFINE ACTIONABLE ICRC ACCESS TO INFO EQUALLY IMPORTANT AS BUT INFO PERISHABLE UN Cluster coordination: Involves manually intensive work! Can computing assist Humanitarians? Need to understand: Why to coordinate, Whom to coordinate with and How 3W’s ACTIONABLE INFO NOT ONLY INFO, NEED ANALYTICS
  15. CRISIS MAPS PROVIDE SITUATIONAL AWARENESS LIKE HAVING YOUR OWN HELICOPTER FACILATES COORDINATION (5m,5) What is crisis mapping [P,H] (1) We get tons of data from social media, but data in raw form is not helpful, we want information and knowledge. Information without proper interface is useless, information should be rapidly comprehensible during critical times! -- map provides geographical dimension (1) Mapping is one way of converting data to information and knowledge, it acts as a lens over data. (3) Show the power of mapping -- motivate via Haiti Ushahidi map, Typhoon in Philippines
  16. Lets begin our first map on January 12th, 2010, at 4pm, to be exact. We turn on the TV and see this…
  17. So what was the result of the Libya Crisis Map? According to the head of OCHA’s Information Section at the time, the SBTF …
  18. APOPHENIA SAMPLE BIAS VERACITY EXPLAIN DATA SET!
  19. VIDEO – FILENAME: GhostB.mov THIS IS HOW HUMANITARIANS ARE RESPONDING AND WHY THEY NEED YOU
  20. - Let’s start with this diagram – this is the state of crisis informatics space. - Gaps between the requirements vs. offerings - So, first – what responders want -- prior knowledge/experience, response strategies,
  21. - Trend, summarization, information management, geo-mapping, visualizations - Developing methodologies/algorithms w/o end-user are like bullet firing without the concrete target!
  22. Data overload– very fast diffused information, image/video/text data about the event, needs and offers
  23. Well, lets see then what has been done so far to help solve the puzzle of this ‘cognitive mismatch’ (Patrick’s blog few days back also)
  24. Note that it is not an exhaustive list, see more resources here: http://wiki.knoesis.org/index.php?title=Summary_about_Social_Media_Research_in_Disaster/Emergency_Response_Systems&oldid=5177
  25. So, next, let me talk about few of the tools falling here with different levels of features. - Aggregation of heterogeneous data for Sense-making - Storage, Visualization and Mapping
  26. http://www.SahanaFoundation.org
  27. Now, let me show a very different genre of tools than the earlier ones. - Full automatic
  28. http://twitris.knoesis.org/oklahomatornado
  29. (It is real-time widget for monitoring of needs, so will not be active after the event has passed) http://twitris.knoesis.org/oklahomatornado
  30. Highly rich interface for response team
  31. So, now we have seen both kinds of tools, a.) driven by manual efforts, b.) those leveraging Social Media content Now, lets talk about what are the challenges to adapt social media content for critical information sources
  32. So far, we saw glimpse of different genre of tools and the question we want those tools to answer. Now, lets list the challenges we often face while answering complex analytics questions by the tools.
  33. Different formats.
  34. fast incoming info., a perishable commodity Source: http://www.mycustomer.com/files/siftmedia-mycustomer/images/BigData_wIPRO.jpg
  35. Source: http://www.ypulse.com/images/made/uploads/default/Infographic_v2-01_%281%29_591_1257.png
  36. (1) BUT, we have to be careful as social media data is huge but biased to educated and urban people with disposable income (in some cases a presidential candidate can "win" in social media and then lose big time in reality).
  37. (3) Data support: quality, actionability: often the raw data collected from social media are noisy, rich in emotional and sympathy expressions, often re-stating some simple facts that are well known, but short on reporting that can lead to actions -- hard to collect a perfect sample for actionability
  38. http://northwarddigital.com/wp_northward/wp-content/uploads/2012/06/Edelman-Trust-Barometer-Infographic.jpg
  39. keyword search and ranking for microblog post filtering.
  40. http://people.dsv.su.se/~eriks/ISBI/assignment1/example.html
  41. http://carrot2.org/
  42. Crisis Tracker
  43. burst detection; topic detection and tracking.
  44. http://www.cse.unt.edu/~huangyan/spatialMining.htm
  45. Volume for query “boston” in Google (Trends).
  46. http://www.computer.org/csdl/trans/tg/2011/12/ttg2011122412-abs.html TextFlow
  47. http://www.cs.otago.ac.nz/homepages/smartin/publications_long.php
  48. http://journalofdigitalhumanities.org/wp-content/uploads/2013/02/blei_lda_illustration.png
  49. Source: http://www.quora.com/Support-Vector-Machines
  50. http://v8doc.sas.com/sashtml/stat/chap3/sect3.htm
  51. (3) Natural Language Processing: focused on syntactic constructs to identify useful information -- location, time, etc. in the content Source: http://voices.washingtonpost.com/fasterforward/Jeopardy!%20practice%20game(2)(2).jpg
  52. http://nlp.stanford.edu/software/stanford-dependencies.shtml
  53. http://www.ling.gu.se/~lager/Home/pwe_ui.html
  54. (3) Social Networks: focused on mining patterns causing information spread/diffusion, rumor/outlier identification http://www.hackingalert.net/2011/05/what-is-social-graph-concepts-and.html
  55. http://griffsgraphs.com/tag/clustering/
  56. Likewise, we identified the important users in the Twitris network analysis demo in the previous slides
  57. Human-Computer Interaction: focused on visualization interface to communicate mined info. effectively (via maps), communication strategies for organizational actors
  58. http://usability.msu.edu/about/philosophy
  59. Example: classification, extraction and matching of donation-related information
  60. Motivation http://www.npr.org/2013/01/09/168946170/thanks-but-no-thanks-when-post-disaster-donations-overwhelm
  61. (1) Example overview
  62. - 1 (+half) minute Alright, so let’s motivate by this situation during emergency - Various actors: resource seekers, responder teams, resource providers at remote site And - each of these actor groups have questions --- - needs - providers - responders: wondering! Here we have social network to connect these actors and bridge the gap for communication platform But it’s potential use is yet to be realized for effective help
  63. Role of ML: information extraction and classification from raw citizen sensing data-- caution/advice, damage, donations, etc.
  64. Extract information nuggets for donations and other tasks. Also present in Varga et al. “ Aid is out there …” ACL 2013.
  65. (1) Statistics on creation of requests- and offers-corpora in Sandy.
  66. (1) Automatic matching of requests and offers for coordination, thus helping the actions of decision makers via recommendations.
  67. (1) Shortcomings of the method and future developments including continuous queries.
  68. (8) What kinds of analyses we can do after Crisis-Mapping of the Citizen Sensing:  Coordination, Actions and Decision Making
  69. (1) ML+DM+NLP+Geocoding = enriched information nuggets representing each individual message. http://pricegrabber.com/
  70. (2) Enabling complex query database for DcM: Creation of a rich annotated data repository with a proper information management model for storing the extracted info. nuggets and also, with flexibility to enhance via more metadata generated suing further DM analysis
  71. (2) Use of the rich annotated data repository facilitates slicing and dicing of information or decision making (request and offer with certain other attributes, such as from a geo-location, etc.) and also, its presentation on the a visual interface for coordinators to engage quickly with right kind of information, with right people (seekers/suppliers)  and in right time. Icon: Iconfinder.com
  72. (3) Making sense of the information extracted for SA, in order to provide sufficient ground for spatio-temporal coordination of resources and information -- extraction of metadata to enable decision making (DcM) -- example of request-offers classification, as well as determining who will consume info. and how, what will he/she consume (include our initial drawn table with questions for seekers/suppliers/responders of actionable coordination framework) Source: http://www.jaunted.com/story/2010/5/16/22566/7366/travel/Tweet+of+the+Week%3A+The+World%27s+Most+Touristed+Places,+Mapped!
  73. (3) Making sense of the information extracted for SA, in order to provide sufficient ground for spatio-temporal coordination of resources and information -- extraction of metadata to enable decision making (DcM) -- example of request-offers classification, as well as determining who will consume info. and how, what will he/she consume (include our initial drawn table with questions for seekers/suppliers/responders of actionable coordination framework)
  74. (10) What are challenges to address in this analytical framework for helping coordination and decision-making
  75. http://www.vtaide.com/png/chicken.htm (3) Improving DM methods to better identify information nuggets from data for coordination-- e.g., of coexistence of opposite intentions (seeking-supplying) in some cases
  76. http://www.semanticmetadata.net/2006/09/27/a-note-on-the-semantic-gap/
  77. http://www.slideshare.net/apsheth/physical-cyber-social-computing-an-early-21st-century-approach-to-computing-for-human-experience
  78. http://www.vtaide.com/png/chicken.htm (2) Performing fine-grained analysis of intentions for why to coordinate – e.g. intention to help on a pet-friendly shelter if offerer is veterinary doctor
  79. (2) Using a generic Crisis Response Ontology which models the a.) actors, b.) resources and c.) actions during response coordination
  80. (3) Continuous evolving model for a specific instance of the crisis response, which shall capture the on-going changes in the event for the thematic concepts-- e.g., ‘Moore is a suburb of Oklahoma City’  during #OK-Tornado Read more:
  81. (3) Step 1: Identifying target consumers of the designed systems. Examples of such consumers currently: what are their backgrounds? what did they study? where do they work? what is easy for them to do? what is difficult for them to do?
  82. Show typical users with stories/pictures. Who are these people? What do they study? Where do they work? Make distinction between domestic emergency management centers and international humanitarian organizations
  83. Show typical users with stories/pictures. Who are these people? What do they study? Where do they work? Who: Senior Policy Advisors and Information Management Officers Study: Government, Diplomacy, International Affairs, GIS Where: UN Office for the Coordination of Humanitarian Affairs, International Committee of the Red Cross
  84. Show typical users with stories/pictures. Who are these people? What do they study? Where do they work? Who: Young and seasoned humanitarians focused on different clusters with different lead agencies; also SAR Teams Study: International/humanitarian affairs, food security, emergency medicine, logistics Where: Various UN agencies, Red Cross, Military, [PATRICK: I SUGGEST TO INSERT HERE SOME PROTOTYPICAL EXAMPLES ABOUT USERS OF THESE PLATFORMS, MAYBE THERE ARE 2-3 ARCHETYPES]
  85. Show typical users with stories/pictures. Who are these people? What do they study? Where do they work? Who: Young and tech savvy professionals, volunteers and disaster affected communities (most are women) Study: Extremely varied; more technical Where: RC Digital Operations Center, Digital Humanitarian Network Members, everyday people
  86. (3) Step 2: Co-design with target consumers. Similar to the fact that software development "customers" should not just offload requirements and leave the design table, we want humanitarians to co-design with us.
  87. (3) Step 3:Conceptualize as socio-technical systems. Involving humans in the loop for improving response in a continuous fashion, not only at the beginning.- ‘Of Human, By Human, For Human’ We want users to be part of the operation of the systems themselves, not only co-designers.
  88. (3) Step 4: Evaluate based on actions. It is not just snazzy visualizations, of course we want systems that look good and simple to use (something even a child could use, like a Fisher-price toy), but we do not evaluate based on looks but based on to what extent actions taken by users of the system are better than actions that would be taken without it.
  89. http://worcestertango.org/TangoWalking_Print.jpg Scientists are not selling, they are often giving away.