Collecting Photo Stream in Node.js on Heroku

Collecting Photo Stream in Node.js on Heroku @stomita (ja) @shinichitomita (en)

Who am I ?• CEO at Mashmatrix, Inc.• JavaScript Developer• Formerly (almost forgot) • Identity (OpenID/SAML/SSO) @stomita • JavaEE • Oracle• Ex-Salesforce.com (2006/12-2007/12)

Objective• Collect and store photos tweeted in the world• Add metadata to photos manually by crowd • Category ? (food/people/landscape) • Venue ? (foursquare)

Twitter Streaming APIhttps://dev.twitter.com/docs/streaming-api

Photo Stream• Set tracking keywords to ﬁlter tweets with photo uploading services URL • e.g. tracks=lockerz,plixi,tweetphoto,twitpic,yfrog, photozou,twitgoo,instagr• Extract photo URLs by pre-given rule • e.g. http://twitpic.com/7wiwlw => http://twitpic.com/show/thumb/7wiwlw

ArchitectureStreaming JSON

Twitter-Nodehttps://github.com/technoweenie/twitter-node

Visualization• Present photo stream to users in real-time• Not our primary goal, but just interesting• Don’t think, FEEL.

tweet-photo-stream http://tweet-photo-stream.herokuapp.com/https://github.com/stomita/tweet-photo-stream

socket.io• A Node.js library, enabling push messaging to browsers• Stream Transport Supported : • WebSocket/FlashSocket/XHR-Multipart/ XHR-polling/JSONP-polling• Used as fallback of SocketStream

ArchitectureStreaming socket.io

Similar Work - Twitcaps http://twitcaps.com/

Twitcaps - Not Real-time Delayed Streaming Ajax Polling

Issue• Heroku Node.js doesn’t support WebSocket yet (as of Dec 2011) • Fallbacks to XHR-polling • c.f. Joyent No.de SmartMachine

http://www.scoop.it	700
http://a0.twimg.com	8
http://us-w1.rockmelt.com	6
http://translate.googleusercontent.com	1

Collecting Photo Stream in Node.js on Heroku

by Shinichi Tomita

Accessibility

Categories

Upload Details

Usage Rights

4 Embeds 715

Statistics

Collecting Photo Stream in Node.js on Heroku Presentation Transcript