Rubinius - What Have You Done For Me Lately

Rubinius
What have you done for me today?

Tuesday, November 23, 2010

Rubinius?


Rubinius
Modern Ruby Implementation


Rubinius
Philosophy


Rubinius
Philosophy
Use Ruby


Rubinius
Philosophy
Allow Ruby to extend the system


module Enumerable
def map
if block_given?
ary = []
each { |o| ary << yield(o) }
ary
else
to_a
end
end
end


Rubinius
Compatibility
1.8.7


Rubinius
Compatibility
Rails 2.3 - 3+


Rubinius
Compatibility
C extensions


Rubinius
Spin Off Projects


Rubinius
Spin Off Projects
RubySpec


Rubinius
Spin Off Projects
FFI


Rubinius
Drop In Compatible


Rubinius
Technology


Rubinius
Technology
Bring techniques to Ruby


Optimized to
Machine Code


Optimized to
Machine Code

Bytecode VM


Optimized to
Machine Code

Bytecode VM

Soph"ticated Garba# Collection


Rubinius
Technology
Efﬁcient Memory Layout


obj.ivars = {
:@name => “Evan”,
:@age => 31
}


obj.class.ivars = {
:@name => 0,
:@age => 1
}
obj.ivars = [
“Evan”,
31
]


Flags

Class

Extra Ivars

@name

@age


Developers!


Developers!
Developers!


Developers!
Developers!
Developers!


API Driven
Build tools around APIs


API Driven
Allow users to build more!


API Driven
Example
Bytecode Compiler


API Driven
Example
Bytecode and Compiler


API Driven
Example
Fancy Language


Why use
Rubinius?


Why?
Focus on Developers


Why?
I’m a Ruby developer


Why?
Tools born from need


Problem:
Improve an Algorithm


Improving
Step 1


Improving
Step 1
Benchmark


require 'benchmark'
cc = CoworkersCode.new

Benchmark.bm do |x|
x.report("initial") {
cc.calculate_awesome_score
}
end


user system total real
initial 0.071788 0.001601 0.073389 ( 29.998823)


29.998823


user: 0.071788
system: 0.001601
total: 0.073389
real: 29.998823


User
Time running code


System
Time inside the kernel


Total
Sum of user and system


Real
Elapsed wall clock time


Wall Clock
Time measured by a stop watch


0.073389

!=
29.998823


??
0.073389

!=
29.998823


Improving
Step 2
Proﬁle


» rbx -Xprofile scratch/profile_sample.rb

% cumulative self self total
time seconds seconds calls ms/call ms/call name
------------------------------------------------------------
99.69 30.00 30.00 10 3000.10 3000.10 Rubinius::Channel#receive_timeout
0.13 0.04 0.04 2 19.82 19.82 IO.open_with_mode
0.11 0.03 0.03 1 33.05 33.05 IO::Buffer#fill
0.02 0.01 0.01 18 0.30 0.30 FFI::Platform::POSIX.stat


» rbx -Xprofile -Xprofiler.graph scratch/profile_sample.rb



0.00 30.00 10/60 Kernel#sleep [15]
[16] 99.9 30.00 0.00 10 Rubinius::Channel#receive_timeout [16]



0.00 30.00 10/60 Kernel#sleep [15]
[16] 99.9 30.00 0.00 10 Rubinius::Channel#receive_timeout [16]

0.00 30.00 10/20 CoworkersCode#superhero_factor [14]
[15] 99.9 0.00 30.00 10 Kernel#sleep [15]
30.00 0.00 10/10 Rubinius::Channel#receive_timeout [16]


def superhero_factor
sleep 3
rand(10)
end


Improving
Step 3
Fix and benchmark


user system total real
initial 0.000102 0.000047 0.000149 ( 0.000139)


0.000139


Sleep!
Invisible in all but real time


E D !
Problem:
O LV
S Improve an Algorithm


Problem:
Slow / hung process


» bin/rbx scratch/qa_sample.rb
1288125364.684678: Server started, pid 39331


Problem:
Slow / hung process
Use Query Agent to inspect


» bin/rbx -Xagent.start scratch/qa_sample.rb


» bin/rbx console
VM: bin/rbx -Xagent.start scratch/qa_sample.rb
Connecting to VM on port 58273
Connected to localhost:58273, host type: x86_64-apple-darwin10.4.0
console>


» bin/rbx console
console> pid
PID: 39331


» bin/rbx console
console> pid
PID: 39331
console> backtrace


» bin/rbx console
console> pid
PID: 39331
console> backtrace
Thread 0:
0x7fff5fbfc250: IO::Buffer#fill_from in kernel/common/io.rb:67 (+72)
0x7fff5fbfc690: IO#read in kernel/common/io.rb:1197 (+125)
0x7fff5fbfcaf0: ImportantServer#get_request in /Users/evan/git/rbx-
release/scratch/qa_sample.rb:10 (+7)
0x7fff5fbfced0: MAIN.__script__ in /Users/evan/git/rbx-release/
scratch/qa_sample.rb:17 (+91)
0x7fff5fbfd390: Rubinius::CodeLoader#load_script in kernel/delta/
codeloader.rb:67 (+44)
0x7fff5fbfd790: Rubinius::CodeLoader.load_script in kernel/delta/
0x7fff5fbfdbb0: Rubinius::Loader#script in kernel/loader.rb:467 (+125
0x7fff5fbfdfc0: Rubinius::Loader#main in kernel/loader.rb:578 (+64)
0x7fff5fbfe3e0: Rubinius::Loader.main in kernel/loader.rb:617 (+33)
0x7fff5fbfe800: Object#__script__ in kernel/loader.rb:628 (+60)


Thread 0:
0x7fff5fbfcaf0: ImportantServer#get_request in /Users/evan/git/rbx-
0x7fff5fbfced0: MAIN.__script__ in /Users/evan/git/rbx-release/
0x7fff5fbfdbb0: Rubinius::Loader#script in kernel/loader.rb:467 (+125
0x7fff5fbfdfc0: Rubinius::Loader#main in kernel/loader.rb:578 (+64)
0x7fff5fbfe3e0: Rubinius::Loader.main in kernel/loader.rb:617 (+33)
0x7fff5fbfe800: Object#__script__ in kernel/loader.rb:628 (+60)


Problem:
Slow / hung process
Sample process via CLI


» bin/rbx -Xagent.start -Xagent.verbose
scratch/qa_sample.rb
[QA: Bound to port 58407]


» bin/rbx console -p 58431 --bt
Thread 0:
0x7fff5fbfcaa0: ImportantServer#get_request in /Users/evan/git/rbx-
0x7fff5fbfce80: MAIN.__script__ in /Users/evan/git/rbx-release/
0x7fff5fbfdb60: Rubinius::Loader#script in kernel/loader.rb:467 (+125)
0x7fff5fbfdf70: Rubinius::Loader#main in kernel/loader.rb:578 (+64)
0x7fff5fbfe390: Rubinius::Loader.main in kernel/loader.rb:617 (+33)
0x7fff5fbfe7b0: Object#__script__ in kernel/loader.rb:628 (+60)


Problem:
Slow / hung process
Easy API to build monitoring tools


require 'socket'
require 'rubinius/agent'
port = 58431
agent = Rubinius::Agent.connect(
"localhost", port)
kind, bt = agent.get("system.backtrace")


Query Agent
Socket based VM API


Query Agent
Socket based VM API
Simple get/set variables


E D !
Problem:
O LV
S Slow / hung process


Problem:
Memory Footprint


Problem:
Memory Footprint
Suspect some kind of memory leak


Problem:
Memory Footprint
Use Heap Dump!


» bin/rbx -Xagent.start scratch/hd_demo.rb
Waiting...


» bin/rbx console
VM: bin/rbx -Xagent.start scratch/hd_demo.rb
Connected to localhost:58710, host type:
x86_64-apple-darwin10.4.0
console> set system.memory.dump heap.dump


» bin/rbx -Xagent.start scratch/hd_demo.rb
Waiting...
Heap dumped to heap.dump


» rbx -Ilib histo.rb ../rbx-release/heap.dump
19798 Rubinius::Tuple 3487912
4867 Rubinius::MethodTable::Bucket 272552
4218 String 303696
4193 Rubinius::CompiledMethod 805056
4193 Rubinius::InstructionSequence 134176
4110 Rubinius::ByteArray 100199256
1547 Rubinius::LookupTable::Bucket 74256
1053 Rubinius::LookupTable 50544
1010 Rubinius::MethodTable 48480
1000 BigCrazyClass 32000
966 Class 104592
783 Rubinius::StaticScope 37584
704 Rubinius::AccessVariable 56320


Heap Dump
Complete Heap Layout


Heap Dump
Stable format


Heap Dump
Reference Ruby Reader


Heap Dump
Gauge


Heap Dump
Gauge
Rails Application Explorer


Heap Dump
Future Feature
Tracking allocation sites


E D !
Problem:
O LV
S Memory Footprint


Dy)
Eostl !
Problem:
O LV(m
S Memory Footprint


Future


Future
1.9


Future
Windows


Future
Full Concurrency


Why Not?


Thanks!


Rubinius - What Have You Done For Me Lately

Recommended

Recommended

More Related Content

Similar to Rubinius - What Have You Done For Me Lately

Similar to Rubinius - What Have You Done For Me Lately (14)

More from evanphx

More from evanphx (9)

Recently uploaded

Recently uploaded (20)

Rubinius - What Have You Done For Me Lately