SCRAPING THE SOCIAL GRAPH      CRISIS MONITORING WITH SOCIAL MEDIA               Georgetown University                jong...
About Ushahidi                       Notable Uses                             The ChallengeUshahidi is a free, open-source...
USHAHIDI HAITI
OILSPILL CRISIS MAP
UCHAGUZI
RUSSIAN FIRES “HELP MAP”
PAKREPORT
TUBESTRIKE CROWDMAP
PRAGUEWATCH
HARASSMAP
U-SHAHID
CHRISTCHURCH
SINSAI.INFO
“It’s not information overload. It’s filter failure.”                                            - Clay Shirky
PLATFORM GOALSConsider the context, relevance defined by the userOffer an opt-in global database of trust and authorityAlg...
KNC AWARD & RIVER IDfinal component of the veracity algorithmneeds to be able to scale massivelychanging the backend (Hado...
THIS IS A DATA PROBLEM
PROGRESS7,000+ downloads in 6 months7,000+ API Users100,000+ Lines of code5 APIs and 2 AppsData Items Processed - 70,000,0...
Sweeper - User Interface
NETWORK DYNAMICSGood crowdsourcing campaigns build upon the existing tiesbetween people and their networks. There’s a natu...
EARNING TRUST❖ Participation is permission❖ Consent is not carte blanche❖ Clarity is critical❖ Trust is Earned or Burned❖ ...
PRIVACY❖ Protection of data is different than theprotection of people/identity❖ Standards like HTTPS or SSL❖ Encryption❖ A...
VALIDATION ❖ Verify   factual occurrences (location, time, date) ❖ Verify contributor identity (who?) ❖ Verify contributor...
MOTIVATION❖ Ease of participation❖ Low risk of failure or shame❖ Social Capital❖ Repute & Accolade❖ Barter❖ Strategic Spen...
THANKS!Knight News Challenge   jg@swiftly.org     @swiftriver
Scraping the Social Graph with Ushahidi and SwiftRiver
Scraping the Social Graph with Ushahidi and SwiftRiver
Scraping the Social Graph with Ushahidi and SwiftRiver
Scraping the Social Graph with Ushahidi and SwiftRiver
Upcoming SlideShare
Loading in...5
×

Scraping the Social Graph with Ushahidi and SwiftRiver

1,833

Published on

As delivered by Jon Gosier at Georgetown University on June 28th.

Published in: Technology, Business
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,833
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
27
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Scraping the Social Graph with Ushahidi and SwiftRiver

  1. 1. SCRAPING THE SOCIAL GRAPH CRISIS MONITORING WITH SOCIAL MEDIA Georgetown University jongos@gmail.com @jongos
  2. 2. About Ushahidi Notable Uses The ChallengeUshahidi is a free, open-source Ushahidi has been deployed in As the amounts of dataplatform used for crowdsourcing major global crisis scenarios, aggregated by Ushahidi usersand visualizing data geospatially. allowing organizations to draw grows, they face a commonIt was born out of the 2008 situational awareness from the problem. How do they effectivelyelection unrest when founders crowd. To date it’s been manage this realtime data? HowJuliana Rotich, Erik Hersman, Ory downloaded over 15,000 times. can we help them discoverOkolloh and David Kobia wanted credible and actionable info fromto allow Kenyan citizens a way to S o m e o f t h e m o re n o t a b l e the deluge of reports they’ll getSMS reports of incident to know deployments include recently in from the public? The SwiftRiverwhat was occurring around them. Egypt, the Haiti earthquakes, the initiative was created to begin toThis was one of the earliest uses fires in Russia, the Queensland answer some of these questionsof crowdsourcing for crisis floods in Australia. for Ushahidi deployers.response.
  3. 3. USHAHIDI HAITI
  4. 4. OILSPILL CRISIS MAP
  5. 5. UCHAGUZI
  6. 6. RUSSIAN FIRES “HELP MAP”
  7. 7. PAKREPORT
  8. 8. TUBESTRIKE CROWDMAP
  9. 9. PRAGUEWATCH
  10. 10. HARASSMAP
  11. 11. U-SHAHID
  12. 12. CHRISTCHURCH
  13. 13. SINSAI.INFO
  14. 14. “It’s not information overload. It’s filter failure.” - Clay Shirky
  15. 15. PLATFORM GOALSConsider the context, relevance defined by the userOffer an opt-in global database of trust and authorityAlgorithms augment, but not define, human decision makingWork across media channels (Twitter, Email, Feeds, SMS)Be accessible (offline/online/mobile)Index massive amounts of the mobile/social web
  16. 16. KNC AWARD & RIVER IDfinal component of the veracity algorithmneeds to be able to scale massivelychanging the backend (Hadoop & Mongo DB)research by data scientistsuse-cases at scale and iterative improvements
  17. 17. THIS IS A DATA PROBLEM
  18. 18. PROGRESS7,000+ downloads in 6 months7,000+ API Users100,000+ Lines of code5 APIs and 2 AppsData Items Processed - 70,000,000 (liberal extrapolation)
  19. 19. Sweeper - User Interface
  20. 20. NETWORK DYNAMICSGood crowdsourcing campaigns build upon the existing tiesbetween people and their networks. There’s a natural mult-iplier, where the people in the original network becomenodes for new networks and so on.
  21. 21. EARNING TRUST❖ Participation is permission❖ Consent is not carte blanche❖ Clarity is critical❖ Trust is Earned or Burned❖ Transparency is hard to teach
  22. 22. PRIVACY❖ Protection of data is different than theprotection of people/identity❖ Standards like HTTPS or SSL❖ Encryption❖ Anonymity is not a given (TOR Project)❖ The usual fail-points are still threats (weakpasswords, compromised servers, carelessemployees)
  23. 23. VALIDATION ❖ Verify factual occurrences (location, time, date) ❖ Verify contributor identity (who?) ❖ Verify contributor credentialsEverything beyond these three points is an educatedguess. Anyone looking to game the campaign will onlybe affective if they are able to compromise theaforementioned.
  24. 24. MOTIVATION❖ Ease of participation❖ Low risk of failure or shame❖ Social Capital❖ Repute & Accolade❖ Barter❖ Strategic Spending ($)❖ Data Sharing❖ Altruism & Charity
  25. 25. THANKS!Knight News Challenge jg@swiftly.org @swiftriver
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×