Comet with node.js and V8

Comet with node.js and V8 by amix

About me • Cofounder and lead developer of Plurk.com Coded most of the frontend and backend • Mostly code in Python and JavaScript But I am proﬁcient in other languages as well (C, Java, Lisp, Lua etc.) • I have coded since I was 12 24 years old now and still love to program :-) • Not a node.js expert... But I ﬁnd it very interesting

Overview of the talk • Why JavaScript matters • What makes V8 VM special • node.js in some details • Characteristics of comet communication • Implementing comet using node.js and WebSockets • Perspective: JavaScript as the future platform

Why JavaScript matters • The pool of JavaScript programmers is huge and it’s getting bigger • JavaScript’sbrowsers that support it and allthe mobile think of all the distribution is among the largest platforms that support it or will support it... Think of Flash • Big companies like Adobe, Google, Apple and Microsoft are spending tons of $ in improving JavaScript • JavaScript is likely to become one of the most popular languages • JavaScript is gaining ground on the backend

What makes V8 special • V8 JavaScript VM is used in Google Chrome and is developed by a small Google team in Denmark. V8 is open-source • V8 team is led by Lars Bak, one of the leading VM engineers in the world with 20 years of experience in building VMs • Lars Bak was the technical lead behind HotSpot (Sun’s Java VM). HotSpot improved Java’s performance 20x times • Before HotSpot Lars Bak worked on a Smalltalk VM

What makes V8 special • No JIT, all JavaScript is compiled to assembler • Hidden classes optimization properties, instead it V8 does not dynamically lookup access from Self uses hidden classes that are created behind the scene • Improved garbage collector garbage collector stop-the-world, generational, accurate, • V8 is independent of Google Chrome • Remarks / “limitations”: threads, no processes No bytecode language, no

What is node.js? • A system built on top of V8 • Introduces: IO - non-blocking - ability to do system calls - HTTP libraries - module system (+ other things) • The non-blocking nature makes node.js a good ﬁt for comet and next generation realtime web-applications • 8000 lines of C/C++, 2000 lines of Javascript, 14 contributors

Advantages of non-blocking • nginx: non-blocking apache: threaded • non-blocking can handle more req. pr. sec and uses a lot less memory • comet does not scale at all for threaded servers... graph source: http://blog.webfaction.com/a-little-holiday-present

Major point JavaScript programming is already geared towards event based programming: • Events in browsers.... • Closures (anonymous functions) are natural part of the language document.addEventListener("click", function(event) { alert(event) }, false)

Hello world using node.js var sys = require('sys'), http = require('http') http.createServer(function (req, res) { setTimeout(function () { res.sendHeader(200, {'Content-‐Type': 'text/plain'}) res.sendBody('Hello World') res.finish() }, 2000) }).listen(8000) sys.puts('Server running at http://127.0.0.1:8000/') hello_world.js

Blocking vs. non-blocking The way to do it The way to do in most other it in node.js! languages: puts("Enter your name: ") gets(function (name) { puts("Name: " + name) puts("Enter your name: ") }) var name = gets() puts("Name: " + name) node.js design philosophy: To receive data from disk, network or another process there must be a callback.

Events in node.js • All objects which emit events are are instances of process.EventEmitter • A promise is a EventEmitter which emits either success or error, but not both var tcp = require("tcp") var stat = require("posix").stat, puts = require("sys").puts var s = tcp.createServer() var promise = stat("/etc/passwd") s.addListener("connection", promise.addCallback(function (s) { function (c) { puts("modified: " + s.mtime) c.send("hello nasty!") }) c.close() promise.addErrback(function(orgi_promise) { }) puts("Could not fetch stats on /etc/passwd") s.listen(8000) })

Comet vs. Ajax Ajax is so yesterday... Comet is the new superhero on the block Comet can be used to create real time web-applications Examples include Plurk and Google Wave. Demo of Plurk real time messaging

Ajax vs. Comet Ajax Comet (long poll) Comet (streaming) Browser Server Browser Server Browser Server request request request response x seconds event response response request event event request response response event How most do it today How some do it today How we will do it soon

Major point • Comet servers need to have a lot of open connections • One thread pr. connection does not scale • The solution is to use event based servers • It’s only possible to create event based servers in node.js!

Implementing comet • Long polling parts. Used in Plurk - works for most - is more expensive and problematic than streaming • Streaming withoutto proxies and ﬁrewalls - Very problematic due WebSockets: • Streaming with WebSockets (HTML5):side - Makes comet trivial on both client and server • In this presentation we will focus on the future: Building a chat application with WebSockets and node.js

WebSockets • Aims to expose TCP/IP sockets to browsers, while respecting the constraints of the web (security, proxies and ﬁrewalls) • A thin layer on top of TCP/IP that adds: • origin based security model • Addressing and protocol naming mechanism for supporting multiple services on one port and multiple host names on one IP address • framing mechanism for data transporation • More information: http://dev.w3.org/html5/websockets/ • Currently implemented in Google Chrome

node.websocket.js implementation demo var sys = require('sys') Room = { members = [] init: function() { Room.ws = new WebSocket('ws://127.0.0.1:8080/chat') var Module = this.Module = function() { } Room.ws.onopen = Room._onopen Room.ws.onmessage = Room._onmessage Module.prototype.onData = function(data, connection) { Room.ws.onclose = Room._onclose for(var i in members) }, //... members[i].send(data) _send: function(user, message){ }; Room.ws.send(serializeJSON({ 'from': user, Module.prototype.onConnect = function(connection) { 'message': message members.push(connection) })) } }, _onmessage: function(m) { Module.prototype.onDisconnect = function(connection) { if (m.data) { for(var i in members) { var data = evalTxt(m.data) if(members[i] == connection) { members.splice(i, 1) from = data.from break; message = data.message } //... } } Note: I have patched node.websocket.js to include onConnect...

Other comet servers • JBoss Netty: Java library for doing non- blocking networking, based on java.nio used by Plurk to handle 200.000+ open connections • erlycomet: Erlang comet server based on MochiWeb • Tornado: FriendFeed’s Python non- blocking server • I have tried most of the popular approaches and none of them feel as natural as node.js!

How does node.js perfrom? • Hello World benchmark node.js vs. Tornado non scientiﬁc - take it with a grain of salt! • Tornado is one of the fastest Python based servers $ ab -c 100 -n 1000 http://127.0.0.1:8000/ $ ab -c 100 -n 1000 http://127.0.0.1:8000/ Concurrency Level: 100 Concurrency Level: 100 Time taken for tests: 0.230 seconds Time taken for tests: 0.427 seconds Complete requests: 1000 Complete requests: 1000 Failed requests: 0 Failed requests: 0 Write errors: 0 Write errors: 0 Total transferred: 75075 bytes Total transferred: 171864 bytes HTML transferred: 11011 bytes HTML transferred: 12276 bytes Requests per second: 4340.26 [#/sec] (mean) Requests per second: 2344.36 [#/sec] (mean) Time per request: 23.040 [ms] (mean) Time per request: 42.656 [ms] (mean) Time per request: 0.230 [ms] Time per request: 0.427 [ms] Transfer rate: 318.21 [Kbytes/sec] Transfer rate: 393.47 [Kbytes/sec] node.js Tornado

CoffeScript • A Ruby inspired language that compiles to JavaScript CoffeScript JavaScript square: x => x * x. var cube, square; cube: x => square(x) * x. square = function(x) { return x * x } cube = function(x) { return square(x) * x } sys = require('sys') var sys = require('sys'), http = require('http') http = require('http') http.createServer( req, res => http.createServer(function (req, res) { setTimeout( => setTimeout(function () { res.sendHeader(200, {'Content-Type': 'text/plain'}) res.sendHeader(200, {'Content-Type': 'text/plain'}) res.sendBody('Hello World') res.sendBody('Hello World') res.finish()., 2000). res.finish() ).listen(8000) }, 2000) }).listen(8000) JavaScript: The platform of the future?

References • Ofﬁcial page of node.js: http://nodejs.org/ • Ofﬁcial page of V8: http://code.google.com/p/v8/ • CoffeScript: http://jashkenas.github.com/coffee-script/ • Websockets spec: http://dev.w3.org/html5/websockets/ • node.websocket.js: http://github.com/guille/node.websocket.js/ • Tornado: http://www.tornadoweb.org/ • JBoss Netty: http://jboss.org/netty • erlycomet: http://code.google.com/p/erlycomet/

PS: Plurk API • Plurk API is now available: http://www.plurk.com/API • Python, Ruby, PHP and Java implementations are under development • Use it to build cool applications :-)

Questions? • These slides will be posted to: www.amix.dk (my blog) • You can private plurk me on Plurk: http://www.plurk.com/amix

http://amix.dk	11183
http://stephanoff.blogspot.com	760
http://www.devhands.com	470
http://www.tutorialeonline.net	397
http://www.worldit.info	395
http://www.slideshare.net	339
http://nodejs.davidherron.com	220
http://claudck.blogspot.com	151
http://www.readytext.co.uk	132
http://stephanoff.blogspot.ru	121
http://davidherron.com	95
http://rudevich.com	85
http://paper.li	73
http://thingdaq.com	66
http://thingdaq.posterous.com	47
http://claudck.blogspot.tw	24
http://www.roussev.org	23
http://blog.newitfarmer.com	23
http://www.tutoriale.far-php.ro	20
http://www.lifeyun.com	20
http://sv-server-new.aitek.it	10
http://webcache.googleusercontent.com	8
http://translate.googleusercontent.com	7
https://si0.twimg.com	6
http://pinterest.com	6
http://www.e-presentations.us	6
http://obl8.com:8000	5
http://stephanoff.blogspot.nl	5
https://twitter.com	5
http://stephanoff.blogspot.fr	5
http://stephanoff.de	5
http://stephanoff.blogspot.com.ar	4
http://slidecastr.heroku.com	4
http://stephanoff.blogspot.de	4
http://yourails.com	4
http://stephanoff.blogspot.it	4
http://a0.twimg.com	4
http://twitter.com	3
http://posterous.com	3
http://stephanoff.blogspot.be	3
http://stephanoff.blogspot.ca	3
http://us-w1.rockmelt.com	3
http://jolidev-jolicloud.dotcloud.com	3
http://feeds.feedburner.com	2
http://stephanoff.blogspot.sk	2
http://preso.ly	2
http://claudck.blogspot.hk	2
https://twimg0-a.akamaihd.net	2
http://stephanoff.blogspot.ro	2
http://duckduckgo.com	2
http://stephanoff.blogspot.in	2

Comet with node.js and V8

by amix3k on Dec 29, 2009

Accessibility

Categories

Upload Details

Usage Rights

61 Embeds 14,780

Statistics

Comet with node.js and V8 Presentation Transcript