TX/RX 101: Transfer data efficiently

Tx/Rx 101: Transfer data efficiently SAPO Codebits 2011 Lisbon - http://codebits.eu Lourens Naudé Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

Bio Operations @ WildfireApp.com Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11A few months ago at WildﬁreApp.com I made the transition from a developer background and role to the operations team.With an Engineering mind it’s easy to get distracted by lower level details and loose sight of the bigger picture. During thistime we’ve released several products and this changed my perspective on operational complexity, moving parts and theimportance of getting and keeping stable software out in front in customers. Less is more. There will be some notes on thisduring today’s talk as well.

Communication All modern software should represent a connected world. Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Lots of trending products are actually platforms, spread across multiple devices. API and integration driven, like Twitter. Eventhis event exposes various APIs for projects to consume in the coming days. Software is social.

Communication Most social problems are communication problems. Systems aren’t any different Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Two outstanding individuals can engage in a relationship, but it’s bound to fail if there’s little or no communication.

All systems GO ! Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11http://www.ﬂickr.com/photos/23968709@N03/5452362745/

Efficiency Performant individual requests Scalability Operational complexity Minimal / no developer on boarding Cost of ownership (today and forward looking) Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Different things to different people. It’s not just about performant individual requests, but also scaling those out to multipleclients. Operational complexity and moving parts should be kept to a minimum. Often overlooked, especially in startupenvironments, is on boarding costs of new developers, especially in the presence of lower level / funky protocols etc. thatrequire a bootstrap period. Rule of thumb: your cowboy should get it. All of this directly affects the bottom line.

Efficient Scalability To maintain acceptable response times for more clients, with the same or less infrastructure Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11This is representative of most public facing production deployments. Remember, not about the speed of a singlerequest, but being able to easily handle increased throughput.

Agenda System calls and file descriptors Blocking, nonblocking and async I/O Multiplexed I/O There’s a better way ... Optimizations Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11We’ll allocate time towards system calls, ﬁle descriptors - the canonical reference used by user space apps for I/O and how allof that ﬁts into common I/O models: blocking, nonblocking and async. The next challenge is applying this knowledge at scaleusing multiplexed I/O, however apparently the world is coming to an end in 2012 and there’s much better alternatives. We’llthen phase out with a few common optimizations.

Head count ? Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Anyone currently consuming or exposing APIs ? Messing around with or using any of these technologies inproduction ?

The kernel Mediates access to system resources : I/O, memory and CPU Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Since the 60s, nothings really changed much with how we access system resources. First line of communication:between the Kernel and User space is a negotiation for resources.

User mode Sandboxed execution for security and stability requirements Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11The vast majority of processes, especially scripting languages, will spend most of their on CPU time in user mode.How does user processes access system resources ?

System calls Ruby process Kernel disk Ruby process read(5, &buf, 4000) Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Ask the Kernel to do work on behalf of a user process.

Syscall definition A protected function call from user to kernel space with the intent to interact with a system resource Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

Characteristics Uniform API on POSIX systems Ditto for behavior. LIES ! Slow emulations ssize_t read(int d, void *buf, size_t nbytes) ssize_t write(int d, const void *buf, size_t nbytes) Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Its also guaranteed to have a uniform API and behavior on POSIX compliant (read: most UNIX) systems. Just likeHTML and CSS compliance in modern browsers, most operating system implementations do not conform 100% tospec. Conﬁgure checks at compile time may conﬁrm the presence of a performant system call when in fact it’s justan emulation.

Syscall performance MUCH slower than function calls 20x and more Definite context switch Calls can block - slow upstream peers Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11An important performance characteristic of system calls is that theyre an order of magnitude more expensivethan eg. a libc functioncall in the same process. In other words, theres a context switch that affects several subsystems eg. swapping outCPU registers and memory references.They may also block indeﬁnitely or until a conditions met eg. a full buffer on a read syscall.

Who doesnt know what file descriptors or file handles are ? Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

open syscall fd = open(“/path/file”, O_READ) read(fd, &buf, 4000) Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11OPEN system call to open a ﬁle. Give it a path and it returns a resource, which is used in subsequent READ andWRITE calls for I/O.

Examples local file socket directory pipe Consistent API, semantics differ Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11A ﬁle descriptor may represent a local ﬁle, a socket, a directory or a pipe etc. Semantics for these resources differimmensely, eventhough the canonical reference is a numeric handle and the basic read and write system call APIs are equivalent.Only ever a device to the kernel.

Definition Numeric handle References a kernel allocated resource Kernel and user space buffer /path/serv.sock ( fd 5 ) User Kernel buffer buffer Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11A ﬁle descriptor (or handle) is a numeric handle representing an I/O resource allocated by the Kernel, withmetadata in the Kernel and buffers in both Kernel and User space. SIMPLE and EFFICIENT contract.

Blocking I/O A request to read a chunk of data from a descriptor may block depending on buffer state Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11File descriptors are blocking by DEFAULT. Easiest I/O model, but also unpredictable with the worst performanceguarantees.

Blocked buffer state read(5, &b, 4000) User Kernel buffer buffer 2000 1000 Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Kernel puts the caller process in a waiting state. The application ( execution thread ) sleeps until the I/O operationhas completed (or has generated an error) at which point it is scheduled to run again. Simple to use, but manydownsides. Domino effect on connected peers.

Nonblocking I/Ofd = socket (PF_INET, SOCK_STREAM, 0);fcntl (fd, F_SETFL, O_NONBLOCK) Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11The POSIX spec allows for changing this behavior by setting the O_NONBLOCK ﬂag on a descriptor.

Nonblocking I/O A read request would only be initiated if the system call won’t block Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

read(5, &b, 4000) User Kernel buffer EAGAIN buffer 2000 1000 Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11In this scenario, we’ll partial read the 1000 bytes, but errno would be set to EAGAIN, indicating that we need toissue the read request again.Lots of system call overhead – constantly making system calls to see if I/O is ready. Can be high latency if I/Oarrives and a system call is not made for a while. Efficiency is very poor due to the constant polling with systemcalls from user space

Don’t drink the kool aid Guideline only Not free - invokes a syscall Not supported by all devices Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Do note that this behavior is thus just a guideline for the caller. We’re told to retry, just not when. Its not freeeither - theres the context switch as well as system call arguments validation in the Kernel as well.Theres a considerable grey area, as per POSIX spec, that ignores O_NONBLOCK semantics on any ﬁle handle thatreferences a ﬁle on ablock device. This has an important performance impact on systems that access block devices with variableperformance characteristics, like EBS @ Amazon AWS. All system calls don’t respect non-blocking I/O either( libeio / libuv )

Async I/O myth Nonblocking I/O IS NOT asynchronous I/O Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11File descriptors change state ( read / write ) asynchronously at the Kernel layer, we handle those events in Userspace. A NIC receives data which is buffered in the kernel. We still need to ask for and copy it. The takeaway, andwhat you MUST remember here is that this IS NOT asynchronous I/O.An event occurs asynchronously, but is handled synchronously.

Async I/O Callbacks and notifications Issues I/O in parallel Direct I/O (no double buffering) Popular with database systems Tell the Kernel everything it needs to complete an I/O job Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Helps maximize I/O throughput by allowing lots of I/O to issued in parallel. Network IO is frequently notsupported.

fd : 10 op : read notify : signal buffer : 0x100431 submit job size : 4 callback() data, notify "data" Application Kernel Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

POSIX Realtime Extension aio_read, aio_write etc. Supports file I/O only Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

OS X Lion - AIO support case SIGEV_NONE: ! ! break; case SIGEV_THREAD: ! /* Unsupported [RTS] */ default: ! return (EINVAL); Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Preferred notiﬁcation mechanism is through signal ( SIGIO ), but doesn’t support passing any metadata either.Thus if there’s 10 jobs submitted, we still need to ﬁgure out which of those jobs are in a completed state.

Windows I/O Completion Ports Supports all descriptor types Very mature and stable technology Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Redmond has given us malware, but has done some things right as well.

Recap O_NONBLOCK is a guideline only Invoked in user space Data transfer in user space Blocking and nonblocking I/O terms Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Moving forward, we shall prefer the terms blocking and non-blocking I/O as the work done transferring data fromKernel to User spacebuffers is still done in user space. Even if we do change descriptor behavior with the O_NONBLOCK ﬂag, its merelya guideline for thecaller to choose a strategy as the intent and additional context is known there.

Challenges of scale Large number of file descriptors Respond to descriptor state changes Execute domain logic Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11SINGLE FDs until now. Remember, the primary uses case is increased throughput. The main challenge here ishandling a large number of ﬁle descriptors (representing client connections) efficiently in a single process.Previous examples represented single descriptors only.

Multiplexed I/O Whos familiar with select, poll, epoll or kqueue ? Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

Multiplexed I/O Nonblocking I/O is inefficient Retry on EAGAIN is polling Multiplexed I/O: concurrent blocking Notified of state changes on any registered fd Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Nonblocking I/O is inefficient - we continuously need to retry on EAGAIN error conditions and as such wasteresources polling. Multiplexed I/O allows an application to concurrently block on a set of ﬁle descriptors(thousands with epoll and kqueue) and receive notiﬁcation when any of them are in a readable or writable state.We aim to block on a set of descriptors, not just 1.

Multiplexed I/O fd 5 fd 6 fd 7 fd 8 I/O bound App Multiplexer fd 9 fd 10 fd 11 fd 12 User space Kernel space Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11At any given time a small subset of the descriptors registered with the multiplexer would be in a readable orwritable state.

Multiplexed I/O 1. Tell me when fds 1..200 are ready for a read or a write Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

Multiplexed I/O 2. Do other work until one of thems ready Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

Multiplexed I/O 3. Get woken up by the multiplexer on state changes Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

Multiplexed I/O 4. Which of fd set 1..200 are in a ready state ? Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

Multiplexed I/O 5. Handle all fds ready for I/O Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Repeat. There will almost always just be a small subset of fds ready to drive work from. The more we have, thesmaller this total : ready ratio generally becomes.

Checkpoint. Questions ? Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

ETOOCOMPLEX Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11You don’t need a UNIX beard in your department. And you should be building apps.http://www.ﬂickr.com/photos/taniwha/2237514055/

There’s a better way http://zeromq.org Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Recently I’ve spent some free time on a new set of Ruby bindings for ZeroMQ - a communications andconcurrency framework. This framework is going to change the way we do I/O moving forward - plans for LinuxKernel integration.

Super Sockets Scripting for sockets Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11We spend copious amounts of time implementing business logic, refactoring and often don’t think of howindividual components will communicate. Requirements also change over time - sockets should be “scriptable” aswell. Not an out the box technology - provides the building blocks for solutions. Like legos. Especially importantin service integration - connect with Facebook, Twitter etc. Social software. Crappy communication patterns withthird party integrations is much more likely to affect your performance proﬁles than inefficient code pathsdeployed from within your organization.

BSD sockets + Messaging patterns REQ PUB PULL PULL REP SUB SUB PUSH Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Maps to messaging patternsRequest-Reply, Publish-Subscribe, PipelinePrefers mailboxes to buffers and is asynchronous by design ( Actor Pattern )Build out topologies just in time.Allows us to focus on interfaces and patterns ﬁrst

Transport agnostic inproc (Threads) IPC TCP/IP Multicast Uniform API Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Scales to X cores: threads in a process, processes on a box, boxes on a networkSame API regardless of transportOperations can deploy a single process on ﬁrst service iteration, using threads to utilize cores. If the engineeringteam’s weak with multithreaded programming ( or the codebase is too complex ), can move to IPC transport, whichrequires managing more processes but allows developers to code for a single thread of execution. If and whencapacity is required, a TCP transport allows for scaling to multiple boxes.

Brokerless Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Broker is always a SPOFLess admin overhead to not rely on message broker.Any intermediate is slow - most brokers touch disk extensively for durabilitySometimes platforms are built around the capabilities of a particular broker implementationhttp://www.ﬂickr.com/photos/epsos/5591761716/

FAST methodmissing:rbczmq lourens$ ruby perf/local_thr.rb tcp:// 127.0.0.1:5020 10 1000000 message size: 10 [B] message count: 1000000 mean throughput: 410276 [msg/s] mean throughput: 32.822 [Mb/s] methodmissing:rbczmq lourens$ ruby perf/local_thr.rb tcp:// 127.0.0.1:5020 1024 1000000 message size: 1024 [B] message count: 1000000 mean throughput: 176342 [msg/s] mean throughput: 1444.595 [Mb/s] methodmissing:rbczmq lourens$ ruby -v ruby 1.9.2p290 (2011-07-09 revision 32553) [x86_64- darwin11.0.1] Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Minimal latency - higher than TCP (which is normal), BUT higher throuhgput than TCP ( batching )Communications and concurrency framework - can load balance between threads and processes as wellSocket options allow for tuning individual sockets - not system wide as per raw sockets

Resilient Auto-reconnects Durable sockets Socket options: backlog, HWM, SWAP Clients can come up before servers Atomic message delivery Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Manage a socket’s ability to handle variable throughput and not drop messages with the backlog, HWM and SWAPsocket options.Easy for upgrades if we don’t need to always coerce things in sequence.Fault tolerant message passing - atomic - you either get the message (blob), or you don’t

Interjection principle REQ REQ REQ ROUTER DEALER REP REP REP Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Interjection principle states that inserting an intermediary node into the topology should not change thebehavior at the endpoints.DEALER / ROUTER pair allows for non-blocking request/response. Great for slow / fast clients alike.

X Platform Multiple OS’s Multiple languages - clients ecosystem No message contracts - BLOBS Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11A good clients ecosystem is so often overlooked. There’s a Syslog module for easily tapping into event streams asneeded as well.

ZMQ efficiency Brokerless (or roll your own) Easy to re-architect Swap transport to scale to more cores Resiliency Specialize as needed with socket options Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

Working with multiple buffers Write data from multiple buffers to a single stream ... b1 b2 b3 Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

... or read data from a single stream to multiple buffers. b1 b2 b3 Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

Vectored I/O ssize_t writev(int fildes, const struct iovec *iov, int iovcnt); ssize_t readv(int fildes, const struct iovec *iov, int iovcnt); Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

Benefits Atomic - reads / writes all or nothing Reduces the amount of syscalls Fixed sized headers Database records Well supported Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Reduces the amount of system calls required to read / write data from non-contiguous buffers

Write example b1 b2 Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

Call write for each buffer write b1 write b2 Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

Allocate buffer large enough for both buffers, copy data and write once copy b1 write b3 copy b2 Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

Call writev once to output both buffers b1 writev b2 Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

ZeroMQ message batching Higher latency than TCP, but also higher throughput. Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

Message batching Sending two or more messages down the networking stack is faster than individual messages. Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

Characteristics Opportunistic batching NIC asks 0mq for messages Sends all available at any given time Low latency for single VS multiple messages use case Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

Zero-Copy sends Saves on memcpy() Delegate ownership of a buffer to omq Scripting language strings Callback function on send Tricky with Garbage Collection Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

void free_msg(void *data, void *s); zmq_msg_init_data(&m, RSTRING_PTR(s), RSTRING_LEN(s), free_msg, (void*)s); rb_gc_register_address(&s); zmq_send(s, &m); void free_msg(void *data, void *s){ rb_gc_unregister_address(&s); } Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

"message" "message" "message" callback() "message" "message" Ruby ZeroMQ Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11Message in Ruby VM VS message in ZeroMQ

Passing thoughts System calls Blocking, nonblocking and async I/O Messaging patterns ftw! Efficiency is context dependent Read http://zguide.zeromq.org Reread http://zguide.zeromq.org Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

Questions ? Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

Wildfire Interactive, Inc. is hiring Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

Thanks ! http://www.jobscore.com/jobs/ wildfireapp follow @methodmissing fork github.com/methodmissing Wildfire Interactive, Inc. | 1600 Seaport Boulevard, Suite 500, Redwood City, CA 94063 | (888) 274-0929Thursday, November 10, 11

TX/RX 101: Transfer data efficiently

by Lourens Naudé

Accessibility

Categories

Upload Details

Usage Rights

2 Embeds 2

Statistics

TX/RX 101: Transfer data efficiently Presentation Transcript

http://us-w1.rockmelt.com	1
http://a0.twimg.com	1