Scraping the Social Graph with Ushahidi and SwiftRiver

  • 1,767 views
Uploaded on

As delivered by Jon Gosier at Georgetown University on June 28th.

As delivered by Jon Gosier at Georgetown University on June 28th.

More in: Technology , Business
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
1,767
On Slideshare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
26
Comments
0
Likes
2

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. SCRAPING THE SOCIAL GRAPH CRISIS MONITORING WITH SOCIAL MEDIA Georgetown University jongos@gmail.com @jongos
  • 2. About Ushahidi Notable Uses The ChallengeUshahidi is a free, open-source Ushahidi has been deployed in As the amounts of dataplatform used for crowdsourcing major global crisis scenarios, aggregated by Ushahidi usersand visualizing data geospatially. allowing organizations to draw grows, they face a commonIt was born out of the 2008 situational awareness from the problem. How do they effectivelyelection unrest when founders crowd. To date it’s been manage this realtime data? HowJuliana Rotich, Erik Hersman, Ory downloaded over 15,000 times. can we help them discoverOkolloh and David Kobia wanted credible and actionable info fromto allow Kenyan citizens a way to S o m e o f t h e m o re n o t a b l e the deluge of reports they’ll getSMS reports of incident to know deployments include recently in from the public? The SwiftRiverwhat was occurring around them. Egypt, the Haiti earthquakes, the initiative was created to begin toThis was one of the earliest uses fires in Russia, the Queensland answer some of these questionsof crowdsourcing for crisis floods in Australia. for Ushahidi deployers.response.
  • 3. USHAHIDI HAITI
  • 4. OILSPILL CRISIS MAP
  • 5. UCHAGUZI
  • 6. RUSSIAN FIRES “HELP MAP”
  • 7. PAKREPORT
  • 8. TUBESTRIKE CROWDMAP
  • 9. PRAGUEWATCH
  • 10. HARASSMAP
  • 11. U-SHAHID
  • 12. CHRISTCHURCH
  • 13. SINSAI.INFO
  • 14. “It’s not information overload. It’s filter failure.” - Clay Shirky
  • 15. PLATFORM GOALSConsider the context, relevance defined by the userOffer an opt-in global database of trust and authorityAlgorithms augment, but not define, human decision makingWork across media channels (Twitter, Email, Feeds, SMS)Be accessible (offline/online/mobile)Index massive amounts of the mobile/social web
  • 16. KNC AWARD & RIVER IDfinal component of the veracity algorithmneeds to be able to scale massivelychanging the backend (Hadoop & Mongo DB)research by data scientistsuse-cases at scale and iterative improvements
  • 17. THIS IS A DATA PROBLEM
  • 18. PROGRESS7,000+ downloads in 6 months7,000+ API Users100,000+ Lines of code5 APIs and 2 AppsData Items Processed - 70,000,000 (liberal extrapolation)
  • 19. Sweeper - User Interface
  • 20. NETWORK DYNAMICSGood crowdsourcing campaigns build upon the existing tiesbetween people and their networks. There’s a natural mult-iplier, where the people in the original network becomenodes for new networks and so on.
  • 21. EARNING TRUST❖ Participation is permission❖ Consent is not carte blanche❖ Clarity is critical❖ Trust is Earned or Burned❖ Transparency is hard to teach
  • 22. PRIVACY❖ Protection of data is different than theprotection of people/identity❖ Standards like HTTPS or SSL❖ Encryption❖ Anonymity is not a given (TOR Project)❖ The usual fail-points are still threats (weakpasswords, compromised servers, carelessemployees)
  • 23. VALIDATION ❖ Verify factual occurrences (location, time, date) ❖ Verify contributor identity (who?) ❖ Verify contributor credentialsEverything beyond these three points is an educatedguess. Anyone looking to game the campaign will onlybe affective if they are able to compromise theaforementioned.
  • 24. MOTIVATION❖ Ease of participation❖ Low risk of failure or shame❖ Social Capital❖ Repute & Accolade❖ Barter❖ Strategic Spending ($)❖ Data Sharing❖ Altruism & Charity
  • 25. THANKS!Knight News Challenge jg@swiftly.org @swiftriver