Crank Up Your Apps With TorqueBox

Crank Up Your Apps With Jim Crossley MagicRubyCreative Commons BY-SA 3.0 Feb 2011 1

Jim who?• “recovering java architect”• java since ’96, ruby since ’06• emacs and guitars since forever• Red Hat Senior Engineer • proud member of 2

Bob McWhirter 4

Agenda • High-level BS and Development Process • Web, Messaging, Scheduling, Services, Clustering 5

TorqueBoxthe power of JBoss with the expressiveness of Ruby 6

TorqueBox: what?• A “real” app server for Ruby• Founded in 2008• Bob’s “labor of love”• 100% open-source, LGPL license• Reflects a strong commitment to Ruby from Red Hat 7

TorqueBox: why?• “Native” support for Rack apps• Built-in background processing• Built-in scheduling• Built-in clustering• Easily scalable• Optionally enterprisey 8

JRubya good idea done well 9

JRuby: why?• Very fast runtime• Real threads• Java libraries• Java tools• Healthy community 10

JRuby: why not?• Slower start up• Native gems • FFI • C extension support• Some Ruby libs not thread-safe 11

JBoss ASbut before we get to that... 12

Enterprise Java misconceptions 13

Is itScary? 14

Acronymious? WAR JAXBEAR JSTL SLSB JSF JNLPJTA JPA JNI JCK JAX-RPC JDOM JAXP JAX-WS JSE JEE JMM JTS JWS NIO JDO AWT JMX JLS JAR JRE JCP JSR JNDI JSP SAF EJB JME POJOJMSJDBC JDK JVM JAX-RS JPQL NPE 15

Bloated? 16

Bewildering? 17

Enterprise Java is all that and more! but... 18

I promise...• No XML • No Java *• No war files *• Only Ruby, YAML and...* Unless you really want to 19

JBoss ASthe enterprisey good parts 20

JBoss AS6• Tomcat for web• Infinispan for caching• HornetQ for messaging• Quartz for scheduling• mod_cluster for clustering 21

AS = Application Server• Not just “web server + interpreter”• More like initd than httpd• Can host multiple, disparate apps simultaneously• Provides basic services to all the apps it hosts 22

Hot Deployment $JBOSS_HOME/server/default/deploy/• anything added to deploy/ will get deployed• anything removed from deploy/ will get undeployed• anything updated in deploy/ will get redeployed• TorqueBox deployers make JBoss grok YAML and ruby archives 23

Hot Deployment $JBOSS_HOME/server/default/deploy/• deployment anything added to deploy/ will get deployed descriptors• anything removed from deploy/ will get undeployed• anything updated in deploy/ will get redeployed• TorqueBox deployers make JBoss grok YAML and ruby archives 24

Hot Deployment $JBOSS_HOME/server/default/deploy/• anything added to deploy/ will get deployed• anything removed from deploy/ will get undeployed• anything updated in zip files deploy/ will get redeployed• (archives) TorqueBox deployers make JBoss grok YAML and ruby archives 25

Development Process how do they work? 26

easy install$ wget http://torquebox.org/torquebox-dev.zip$ unzip torquebox-dev.zip$ export TORQUEBOX_HOME=$PWD/torquebox-1*$ export JBOSS_HOME=$TORQUEBOX_HOME/jboss$ export JRUBY_HOME=$TORQUEBOX_HOME/jruby$ export PATH=$JRUBY_HOME/bin:$PATH 27

easy install$ wget http://torquebox.org/torquebox-dev.zip$ unzip torquebox-dev.zip Make sure the jruby found in your path is in $JRUBY_HOME/bin.$ export TORQUEBOX_HOME=$PWD/torquebox-1*$ export JBOSS_HOME=$TORQUEBOX_HOME/jboss$ export JRUBY_HOME=$TORQUEBOX_HOME/jruby$ export PATH=$JRUBY_HOME/bin:$PATH 30

easy install$ jruby -S gem install bundler$ jruby -S gem install rails$ jruby -S gem install sinatra 31

rake tasksRakefilerequire "org.torquebox.rake-support" 32

rake tasksrake torquebox:run Run TorqueBox serverrake torquebox:deploy[context_path] Deploy the app in the current directoryrake torquebox:undeploy Undeploy the app in the current directory 33

rake tasks Start torquebox:run in its own shell and leave it running. Instead of script/server or shotgun or thin or whatever else, use torquebox:deploy. 34

deployment descriptors torquebox:deploy creates a deployment descriptor in the JBoss deploy/ directory 35

deployment descriptorsdeploy/myapp-{rails,rack}.ymlapplication: root: /path/to/myapp env: developmentweb: context: myapp host: www.yourhost.com static: public rackup: config.ruenvironment: MAIL_HOST: mail.yourhost.com REPLY_TO: you@yourhost.com 36

deployment descriptorsdeploy/myapp-{rails,rack}.ymlapplication: root: /path/to/myapp env: developmentweb: context: myapp The fully-qualified host: www.yourhost.com path to the app. static: public This will be the value rackup: config.ruenvironment: of either RAILS_ROOT or MAIL_HOST: mail.yourhost.com REPLY_TO: you@yourhost.com RACK_ROOT 37

deployment descriptorsdeploy/myapp-{rails,rack}.ymlapplication: root: /path/to/myapp env: developmentweb: context: myapp host: www.yourhost.comThe runtime mode of static: public the app. This will be rackup: config.ruenvironment: either RAILS_ENV MAIL_HOST: mail.yourhost.comor RACK_ENV REPLY_TO: you@yourhost.com 38

deployment descriptors The app’s context path deploy/myapp-{rails,rack}.yml (or “sub URI”): http://localhost:8080/myappapplication: Can be set via rake: root: rake torquebox:deploy[myapp] /path/to/myapp env: development The default is root:web: http://localhost:8080/ context: myapp host: www.yourhost.com static: public rackup: config.ruenvironment: MAIL_HOST: mail.yourhost.com REPLY_TO: you@yourhost.com 39

deployment descriptorsdeploy/myapp-{rails,rack}.ymlapplication: root: /path/to/myapp A list of virtual env: development hostnames to which web: to bind the app. context: myapp host: www.yourhost.com static: public rackup: config.ruenvironment: MAIL_HOST: mail.yourhost.com REPLY_TO: you@yourhost.com 40

deployment descriptorsdeploy/myapp-{rails,rack}.ymlapplication: root: /path/to/myapp env: developmentweb: The location of the context: myapp app’s static host: www.yourhost.com content, either static: public absolute or relative rackup: config.ru to the app’s root.environment: MAIL_HOST: mail.yourhost.com REPLY_TO: you@yourhost.com 41

deployment descriptorsdeploy/myapp-{rails,rack}.ymlapplication: root: /path/to/myapp env: developmentweb: The name of the context: myapp rackup script used to host: www.yourhost.com boot your app static: public rackup: config.ruenvironment: MAIL_HOST: mail.yourhost.com REPLY_TO: you@yourhost.com 42

deployment descriptorsdeploy/myapp-{rails,rack}.ymlapplication: root: /path/to/myapp env: development Any environment web: variables required context: myapp by the app. host: www.yourhost.com static: public rackup: config.ruenvironment: MAIL_HOST: mail.yourhost.com REPLY_TO: you@yourhost.com 43

deployment descriptors• config/torquebox.yml • internal descriptors have the same structure as the external ones in deploy/• may be used to provide your own reasonable defaults 44

Webmake rack, not war 45

jruby-rack• All rack-based frameworks supported: rails, sinatra, etc• No packaging required: apps deploy from where they sit on disk• No redeploy necessary to see changes when using rack reloading or rails development mode 46

database connectivityGemfilegem "activerecord-jdbc-adapter"gem "jdbc-postgres"# gem "jdbc-sqlite3"# gem "jdbc-mysql" 47

rails template• Adds TorqueBox rake tasks• Adds the JDBC sqlite3 gems• Adds TorqueBox session_store• Adds Backgroundable module 48

my first rails app$ jruby -S rails new myapp -m $TORQUEBOX_HOME/share/rails/template.rb$ cd myapp$ jruby -S bundle install$ jruby -S rake torquebox:deploy 49

Messaging asynchronicity 50

lots of optionsRabbitMQ Resque cron BackgroundDRb workling CronEdit BackgroundJob Kestral rufus-scheduler JobFu Ap4rAmazon SQS async_observer Taskr Sparrow Background-Fu beanstalkd DelayedJob RailsCron Open4 Conveyor WorkerQueue daemons rake ActiveMQ starling Spawn ActiveMessaging 51

TorqueBox::Messaging• JMS (Java Message Service) is an API for messaging• implementation HornetQ is the JBoss JMS 52

TorqueBox::Messaging• Task• Backgroundable• MessageProcessor• Queue• Topic 53

TorqueBox::Messaging• No extra tables in your database• No external system to manage• Little to no config required at all• No redeploy necessary in dev mode• Efficient loading of rails environment• Automatic load balancing and retries• Works on Windows, if you care 54

Tasksapp/tasks/email_task.rbclass EmailTask < TorqueBox::Messaging::Task def welcome(payload) person = payload[:person] person ||= Person.find_by_id(payload[:id]) if person # send the email person.welcomed = true person.save! end endend 55

Tasksapp/controllers/people_controller.rbclass PeopleController < ApplicationController def create @person = Person.new(params[:person]) respond_to do |format| if @person.save EmailTask.async(:welcome, :id => person.id) # respond appropriately end end endend 60

Tasksapp/controllers/people_controller.rbclass PeopleController < ApplicationController def create @person = Person.new(params[:person]) respond_to do |format| if @person.save EmailTask.async(:welcome, :id => person.id) # respond appropriately end end endend 61

TasksCall them from your controllers, models, and observers, or even other tasks. Even in non-Rails apps! 62

BackgroundableInspired by DelayedJob’s handle_asynchronously, it’s trivial to create implicit background Tasks. 63

Backgroundablelib/something.rbinclude TorqueBox::Messaging class Something include Backgroundable always_background :foo def foo;; end def bar;; endend...@something.foo@something.background.bar 64

Backgroundableapp/models/slow_poke.rbclass SlowPoke < ActiveRecord::Base def takes_forever;; end def might_take_awhile;; endendSlowPoke.always_background :takes_forever@slowpoke.takes_forever@slowpoke.background.might_take_awhile 68

QueuesTasks are built on top of Queues. Of course, you may build your own “MOM” apps by defining your own Queues, Topics, and their message Processors yourself. 69

Queuesconfig/queues.yml/queues/questions:/queues/answers: durable: false 70

ProcessorsYou can create a processor class to receive messages from a Topic or Queue 71

Processorsconfig/messaging.yml/topics/print: PrintHandler/queues/popular: - PopularHandler - AdultObserver: filter: "age >= 18" concurrency: 5/queues/students: PrintHandler: config: color: true 72

Processorsapp/models/print_handler.rbinclude TorqueBox::Messagingclass PrintHandler < MessageProcessor def on_message(body) puts "Processing #{body} of #{message}" end def configure(opts) @color = opts[color] endend 76

Queues (again) But how do you send a message? 77

Queuesexampleinclude TorqueBoxreq = Messaging::Queue.new /queues/questionsres = Messaging::Queue.new /queues/answers Thread.new do req.publish "What time is it?" puts res.receive( :timeout => 1000 )end puts req.receiveres.publish Time.now 78

Queues“on the fly”include TorqueBoxqueue = Messaging::Queue.new /queues/fooqueue.create ... queue.destroy 82

Topics• behavior is different, but interface is the same.• all subscribers of a topic see each message, but only one subscriber will see any message from a queue • use topics.yml to define topics• use TorqueBox::Messaging::Topic 83

Schedulingget regular later 84

Jobsapp/jobs/newsletter_sender.rbclass NewsletterSender def run() subscriptions = Subscription.find(:all) subscriptions.each do |e| send_newsletter( e ) end end end 85

Jobsconfig/jobs.ymlmonthly_newsletter: description: first of month job: NewsletterSender cron: ‘0 0 0 1 * ?’sandbox: job: Sandbox cron: ‘*/5 * * * * ?’ 86

Jobs “Fire every half hour from 10am until 1pm on the third Friday of each month” 0 */30 10-13 ? * FRI#3Seconds Minutes Hours DOM Month DOW Year 1-7 1-12 1970- 1-31 SUN- 0-59 0-59 0-23 JAN- 2099 ?LW SAT DEC empty ?L# 87

Jobs• More portable. What is the first day of the week on BSD again? What’s cron on Windows?• Self contained within the app. No external systems to manage and keep in sync.• Full rails environment loaded and available. 88

Servicesrun along, lil’ daemon 89

ServicesLong-running, non-web “daemons” that share the runtime environment and deployment lifecycle of your app. 90

Services• Represented as a class with optional initialize(Hash), start() and stop() methods, which should each return quickly.• Typically will start a long-running loop in a thread and respond to external events.• Configured via services.yml 91

Servicesconfig/services.ymlIrcBot: server: freenode.net channel: #torquebox publish: /topics/ircMyMudServer:SomeOtherService: 92

Servicesapp/{models,etc}/my_service.rbclass MyService def initialize opts={} name = opts[:publish] @queue = Messaging::Queue.new(name) end def start Thread.new { run } end def stop @done = true endend 93

Servicesapp/{models,etc}/my_service.rbclass MyService def run until @done @queue.publish(Time.now) sleep(1) end endend 97

Servicesapp/{models,etc}/my_service.rbclass MyService def run until @done @queue.publish(Time.now) sleep(1) end endend 98

Servicesapp/services/evented_service.rbclass EventedService def initialize opts={} @opts = opts end def start Thread.new { EventMachine.run {...} } end def stop EventMachine.stop endend 99

Clusteringless failure faster 100

out-of-the-box• JBoss provides • session replication • load-balanced messaging• mod_cluster provides • session affinity • intelligent load-balanced web • failover 101

JBOSS_CONFTorqueBox ships with two JBoss server configurations: default (not clustered) and all (clustered). To enable clustering...$ export JBOSS_CONF=all 102

deploy and run$ export JBOSS_CONF=all$ jruby -S rake torquebox:deploy$ jruby -S rake torquebox:run 103

mod_clusterA reverse proxy implemented as an Apache module with JBoss awareness. Constantly gathers load statistics and deployment availability for intelligent request distribution. 104

mod_cluster 105

mod_cluster• Dynamic configuration• Server-side load factor calculation• Fine-grained web app lifecycle• AJP (Apache JServ Protocol) is optional. HTTP[S] is also supported. 106

Futurecoming soon 107

Future• Performance benchmarking and optimization• Infinispan for ActiveSupport::Cache and NoSQL persistence• JBoss SSO, HASingleton, logging• CDI injection of Java components into Ruby• More JavaEE bridged to Ruby where it makes sense, e.g. BPM, Drools, Transactions, etc. 108

Resources• http://torquebox.org• #torquebox on freenode• https://github.com/torquebox• http://twitter.com/torquebox• http://projectodd.org 109

Thanks!questions? 110

http://torquebox.org	150
http://staging.torquebox.org	2
http://planet.jboss.org	2
http://localhost:4242	1
http://static.slidesharecdn.com	1
http://twitter.com	1
http://a0.twimg.com	1

Crank Up Your Apps With TorqueBox

by Jim Crossley on Feb 06, 2011

Accessibility

Tags

Upload Details

Usage Rights

7 Embeds 158

Statistics

Crank Up Your Apps With TorqueBox — Presentation Transcript