Chasing the elephant

1,037 views

Published on

JRubyConfEU 2013

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,037
On SlideShare
0
From Embeds
0
Number of Embeds
33
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Chasing the elephant

  1. 1. @iconara CHASING THE ELEPHANT
  2. 2. Theo / @iconara
  3. 3. chief architect at BURT
  4. 4. big data analytics with JRuby
  5. 5. RUBY
  6. 6. RUBY
  7. 7. RUBY JRUBY
  8. 8. JRUBY IS AWESOME BECAUSE RUBY IS GREAT, AND THE JVM IS GREAT
  9. 9. hot_bunnies, eurydice, multimeter, mikka, msgpack-jruby
  10. 10. HADOOP
  11. 11. JRUBY SUPERCOMPUTING 40 TiB data, 120 EC2 cc2.8xlarge, 1920 cores, 7260 GiB RAM
  12. 12. JAVA ALL THE WAY DOWN
  13. 13. HADOOP STREAMING Wukong, Dumbo
  14. 14. RUBYDOOP rubydoop.org + =
  15. 15. main()
  16. 16. Class.forName("...")
  17. 17. Class.forName("...")
  18. 18. module WordCount class Mapper def map(key, value, context) value.to_s.downcase.split.each do |word| key = Hadoop::Io::Text.new(word) value = Hadoop::Io::IntWritable.new(1) context.write(key, value) end end end end
  19. 19. RUBYDOOP IS LOW LEVEL I would love to see someone write something like Scalding or Cascading on top of it
  20. 20. RUBYDOOP rubydoop.org
  21. 21. RUBYDOOP rubydoop.org v1.1.0
  22. 22. KTHXBAI @iconara github.com/iconara architecturalatrocities.com burtcorp.com

×