Strata NY Sep 2011: Big Data, Short URLs: Learning in Realtime
Upcoming SlideShare
Loading in...5
×
 

Strata NY Sep 2011: Big Data, Short URLs: Learning in Realtime

on

  • 21,640 views

 

Statistics

Views

Total Views
21,640
Views on SlideShare
3,396
Embed Views
18,244

Actions

Likes
5
Downloads
35
Comments
0

23 Embeds 18,244

http://www.hilarymason.com 17964
http://lanyrd.com 95
http://strataconf.com 93
http://www.newsblur.com 38
http://translate.googleusercontent.com 9
http://www.hilarymason.com. 9
http://www.hilarymason.com. 9
http://newsblur.com 7
http://dev.newsblur.com 5
http://webcache.googleusercontent.com 2
https://www.google.com 1
http://dev.en.oreilly.com 1
http://www.google.com.sa 1
http://fiveholiday55.blogspot.com&_=1330659557875 HTTP 1
http://fiveholiday55.blogspot.com&_=1329580266861 HTTP 1
http://fiveholiday55.blogspot.com&_=1328653253195 HTTP 1
http://205.188.242.4 1
http://www.hanrss.com 1
http://fiveholiday55.blogspot.com&_=1325546990449 HTTP 1
http://205.188.242.5 1
http://fiveholiday55.blogspot.com&_=1324594996749 HTTP 1
http://205.188.242.1 1
https://www.google.com.au 1
More...

Accessibility

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • Why did the data scientist cross the road?Two random variables were gossiping and thought they were discrete by whispering but I heard their chatter continuously.
  • Welcome to New York
  • Where do all of those identical black umbrellas COME FROM?Since you’ve been here you’ve probably seen some weird things.
  • http://www.flickr.com/photos/32443746@N07/4753829490/
  • http://bbs.keyhole.com/ubb/z0302a1700/aug07.htm
  • http://www.flickr.com/photos/74828596@N00/147208226/http://www.flickr.com/photos/spunkinator/3790112854/
  • Hadoop doesn’t work – it’s not realtime.
  • Hadoop is not realtime.
  • Creative commons: http://www.flickr.com/photos/13970152@N06/1471587677/We don’thave theluxury of time and iterations.
  • http://www.flickr.com/photos/95572727@N00/3892139852/
  • Dimensions dynamics of the network its shared on and the type of content.
  • http://www.flickr.com/photos/13668275@N07/3972173522/

Strata NY Sep 2011: Big Data, Short URLs: Learning in Realtime Strata NY Sep 2011: Big Data, Short URLs: Learning in Realtime Presentation Transcript

  • Short URLs, Big Data:Learning about the world in realtime
    Hilary Mason
    h@bit.ly @hmason
  • [nyc]
  • [NY: City of Data]
    http://smrt.io/rmcZOU
  • Dirty Secret of Social Media:It’s all GOSSIP
  • Timely
    Crosses networks
    Tells us about the world
  • [dystopia]
  • realtime?!
  • realtime, baby!
  • Realfast?
  • Infrastructure
  • metadata > data
  • What languages are in a page?
  • raw data
    "es"
    "en-us,en;q=0.5"
    "pt-BR,pt;q=0.8,en-US;q=0.6,en;q=0.4"
    "en-gb,en;q=0.5"
    "en-US,en;q=0.5"
    "es-es,es;q=0.8,en-us;q=0.5,en;q=0.3”
    "de, en-gb;q=0.9, en;q=0.8"
  • http://4sq.com/96kc1O
  • What are the languages spoken by the people who are interested in the page?
  • How long do people pay attention to things?
  • How does one idea relate to the next?
  • Gossip ... with queries
  • Timely
    Crosses networks
    Tells us about the world
  • Simple
    Fast
    Reduces friction
  • Thank you!
    h@bit.ly
    @hmason