AHA - DOOP
(not just for counting words)
Ben.Woosley@gmail.com

STREAMING API
Any Language, inc. Ruby
Only one pass

JAVA API
Java
Or DSL: Pig, Cascading
Gives you “Main,” the orchestrator:
Chaining, Redirecting, Recursing

◦ COGROUP
◦ CROSS
◦ DISTINCT
◦ DUMP
◦ FILTER
◦ FOREACH
◦ GROUP
◦ JOIN
◦ LIMIT
◦ LOAD
◦ ORDER
◦ SPLIT
◦ STORE
◦ STREAM
◦ UNION

Terabyte 62 Seconds
Sort
Petabyte 16.25 Hours