SlideShare a Scribd company logo
1 of 38
Download to read offline
Friday, June 11, 2010
Scaling Rails on App Engine
             with JRuby and Duby
             Run your apps on Google Servers,
             with access to first-class Java APIs
             John Woodell
             David Masover
             Ryan Brown
             June 9, 2010



               2



Friday, June 11, 2010
Google App Engine
               3



Friday, June 11, 2010
Key Features
             • No need to install or maintain your own stack
             • Use Google scalable services via standard APIs
             • Built-in application management console
             • Pay-as-you-go, with free quota to get started




               4



Friday, June 11, 2010
Key Limitations
             • No native code
             • No threads or sockets
             • No writing to the filesystem
             • No more than 30 seconds per request




               5



Friday, June 11, 2010
Quotas and Billing
                        Resource      Provided Free      Additional Cost
                        CPU time      6.5 hours/day        $0.10/hour


                   Bandwidth In        1GByte/day         $0.10/GByte

                Bandwidth Out          1GByte/day         $0.12/GByte

                   Stored Data            1 GB           $0.005/GB-day

                    Emails sent     2000/day to users    $0.0001/email
                                   50000/day to admins

               6



Friday, June 11, 2010
App Engine Product Roadmap
             • SSL for third-party domains
             • Background servers capable of running for longer than 30s
             • Ability to reserve instances to reduce application loading overhead
             • Ability to select different availability vs. latency options for Datastore
             • Support for mapping operations across datasets
             • Datastore dump and restore facility
             • Raise request/response size limits for some APIs
             • Improved monitoring and alerting of application serving
             • Support for Browser Push (Comet) communication
             • Built-in support for OAuth & OpenID



               7



Friday, June 11, 2010
JRuby on App Engine
               8



Friday, June 11, 2010
Benefits of JRuby
             • Outperforms MRI in many cases... 2x to 10x
             • Gem extensions written in Java (no more segfaults)
             • A wealth of integration options and first-class Java APIs




               9



Friday, June 11, 2010
App Engine JRuby Milestones
             • 2009-04-08   @olabini publishes blog post on YARBL
             • 2009-04-09   @nicksieger publishes warbler demo
             • 2009-05-06   RailsConf (sinatra & merb)
             • 2009-11-02   0.0.5 bundler, precompilation & Duby preview
             • 2009-11-20   RubyConf (Rails 3.0.pre & Duby App)
             • 2009-12-27   @urekat publishes Rails 2.3.5 patches
             • 2010-01-11   @codingforrent published rails/dm gem
             • 2010-01-21   0.0.8 Rails 2.3.5 Primer for DM & TinyDS
             • 2010-01-26   0.0.9 Mechanize and Hpricot demos
             • 2010-02-27   0.0.10 ActionMailer, ImageService, jruby-openssl
             • 2010-04-08   @azazeal blog post on taxster.gr (OpenID)
             • 2010-06-09   0.0.14 JRuby 1.5.1 & app.yaml preview
              10



Friday, June 11, 2010
Current Issues with JRuby on App Engine
             • Several seconds to “spin-up” a new JRuby instance
             • Some gems may need their extensions ported to Java
             • Not officially supported , but you have all that you need




                                        +
              11



Friday, June 11, 2010
Install it Now

                        sudo gem install google-appengine



                          Everything you need installs as gems


              12



Friday, June 11, 2010
App Engine Gems
            • Development Gems
              – appengine-sdk
              – appengine-tools . . . dev_appserver.rb & appcfg.rb
            • Runtime Gems
                   – appengine-rack . . . . jruby-jars & jruby-rack
                   – appengine-apis
            • Related Gems
              – dm-appengine
                   – rails_appengine
                   – rails_dm_datastore
                   – rails_tiny_ds



              13



Friday, June 11, 2010
App Engine JRuby APIs
             • AppEngine::Users
             • AppEngine::Datastore
             • AppEngine::Memcache
             • AppEngine::Mail
             • AppEngine::URLFetch
             • AppEngine::Images
             • AppEngine::Logger
             • AppEngine::XMPP
             • AppEngine::Labs::TaskQueue
             • AppEngine::OAuth
             • AppEngine::Blobstore

              14



Friday, June 11, 2010
dm-appengine
                          David Masover




              15



Friday, June 11, 2010
DataMapper




              16



Friday, June 11, 2010
ActiveRecord contains SQL strings




              17



Friday, June 11, 2010
Use AppEngineResource




              18



Friday, June 11, 2010
Relationships




              19



Friday, June 11, 2010
Simple




              20



Friday, June 11, 2010
Transactions
             • Idempotence
               – "Why can't I click submit more than once?"
             • Transactions on datastore
               – Optimistic locking
               – Atomic
               – Only across entity-groups




              21



Friday, June 11, 2010
Simple case is Simple




              22



Friday, June 11, 2010
Entity-groups




              23



Friday, June 11, 2010
Global transactions
             • Don't do them!
             • Really, you don't need them!
             • They wouldn't scale anyway!
                but sometimes...




              24



Friday, June 11, 2010
Inventory tracking




              25



Friday, June 11, 2010
Shopping Cart




              26



Friday, June 11, 2010
Duby
                        Ryan Brown




Friday, June 11, 2010
Duby’s not Ruby
             • Statically typed
             • No Duby runtime
             • Uses Java’s type system




              28



Friday, June 11, 2010
Duby has Ruby-inspired Syntax

                        def fib(a:int)
                          if a < 2
                            a
                          else
                            fib(a - 1) + fib(a - 2)
                          end
                        end

                        puts fib 10


Friday, June 11, 2010
// Generated from examples/Test.duby

            public class Test extends java.lang.Object {

                   public static void main(String[] argv) {
                     System.out.println(Test.fib(10));
                   }

                   public static int fib(int a) {
                     return (a < 2) ?
                         (a) :
                         ((Test.fib((a - 1)) + Test.fib((a - 2))));
                   }

            }


Friday, June 11, 2010
A Simple Duby App
              import javax.servlet.http.HttpServlet
              import com.google.appengine.ext.duby.db.Model

              class Post < Model
                property title, String
                property body, Text
              end

              class DubyApp < HttpServlet
                def_edb(list, 'com/ribrdb/list.dhtml')

                   def doGet(request, response)
                     @posts = Post.all.run
                     response.getWriter.write(list)
                   end

                def doPost(request, response)
                  post = Post.new
                  post.title = request.getParameter('title')
                  post.body = Text.new(request.getParameter('body'))
                  post.save
                  doGet(request, response)
                end
              end




              31



Friday, June 11, 2010
A Simple Duby App
              import javax.servlet.http.HttpServlet
              import com.google.appengine.ext.duby.db.Model

              class Post < Model
                property title, String
                property body, Text
              end                                          Types
              class DubyApp < HttpServlet           inferred from parent
                def_edb(list, 'com/ribrdb/list.dhtml')
                                                            class
                   def doGet(request, response)
                     @posts = Post.all.run
                     response.getWriter.write(list)
                   end

                def doPost(request, response)
                  post = Post.new
                  post.title = request.getParameter('title')
                  post.body = Text.new(request.getParameter('body'))
                  post.save
                  doGet(request, response)
                end
              end




              32



Friday, June 11, 2010
A Simple Duby App
              import javax.servlet.http.HttpServlet
              import com.google.appengine.ext.duby.db.Model

              class Post < Model
                property title, String
                property body, Text
              end
                                                      Plugins
              class DubyApp < HttpServlet
                def_edb(list, 'com/ribrdb/list.dhtml')

                   def doGet(request, response)
                     @posts = Post.all.run
                     response.getWriter.write(list)
                   end

                def doPost(request, response)
                  post = Post.new
                  post.title = request.getParameter('title')
                  post.body = Text.new(request.getParameter('body'))
                  post.save
                  doGet(request, response)
                end
              end




              33



Friday, June 11, 2010
Duby Supports Plugins
                  Only form of metaprogramming (for now)


              require 'erb'

              Duby::AST.defmacro('def_edb') do |duby, fcall, p|
                name = fcall.args_node.get(0).name
                path = fcall.args_node.get(1).value
                erb = ERB::Compiler.new(nil)
              ...
                src = erb.compile(IO.read(path))
                duby.eval(src, p, “(edb)”)
              end




Friday, June 11, 2010
Duby Can Use erb Templates
                <title>Posts</title>
                <body>
                  <h1>All Posts:</h1>
                  <% for post in @posts %>
                    <h2><%= post.title %></h2>
                    <p><%= post.body.getValue %></p>
                  <% end %>
                  <hr>
                  <h1>New Post:</h1>
                  <form method=post>
                    Title: <input type=text name=title><br>
                    Body: <textarea name=body></textarea><br>
                    <input type=submit>
                  </form>
                </body>



Friday, June 11, 2010
More to Come
             • Open classes
             • Mix ins
             • Macros
             • More




              36



Friday, June 11, 2010
Resources
             • Blog
               – http://jruby-appengine.blogspot.com/
             • Code Site
               – http://code.google.com/p/appengine-jruby/
             • Google Group
                   – http://groups.google.com/group/appengine-jruby


             • Resources
                   – http://rails2010-dm.appspot.com/
                   – http://github.com/masover/rails2010
                   – http://github.com/masover/cart
                   – http://cart-demo.appspot.com/

              37



Friday, June 11, 2010
Friday, June 11, 2010

More Related Content

Similar to Railsconf 2010

Red Dirt Ruby Conference
Red Dirt Ruby ConferenceRed Dirt Ruby Conference
Red Dirt Ruby ConferenceJohn Woodell
 
Gaelyk - SpringOne2GX - 2010 - Guillaume Laforge
Gaelyk - SpringOne2GX - 2010 - Guillaume LaforgeGaelyk - SpringOne2GX - 2010 - Guillaume Laforge
Gaelyk - SpringOne2GX - 2010 - Guillaume LaforgeGuillaume Laforge
 
2011 June - Singapore GTUG presentation. App Engine program update + intro to Go
2011 June - Singapore GTUG presentation. App Engine program update + intro to Go2011 June - Singapore GTUG presentation. App Engine program update + intro to Go
2011 June - Singapore GTUG presentation. App Engine program update + intro to Goikailan
 
Jeff mc cune sf 2010
Jeff mc cune sf 2010Jeff mc cune sf 2010
Jeff mc cune sf 2010Puppet
 
Aloha on-rails-2009
Aloha on-rails-2009Aloha on-rails-2009
Aloha on-rails-2009John Woodell
 
"How Mozilla Uses Selenium"
"How Mozilla Uses Selenium""How Mozilla Uses Selenium"
"How Mozilla Uses Selenium"Stephen Donner
 
Odnoklassniki.ru Architecture
Odnoklassniki.ru ArchitectureOdnoklassniki.ru Architecture
Odnoklassniki.ru ArchitectureDmitry Buzdin
 
Flowdock's full-text search with MongoDB
Flowdock's full-text search with MongoDBFlowdock's full-text search with MongoDB
Flowdock's full-text search with MongoDBFlowdock
 
AppEngine Performance Tuning
AppEngine Performance TuningAppEngine Performance Tuning
AppEngine Performance TuningDavid Chen
 
Mirah & Dubious Talk Ruby|Web 2010
Mirah & Dubious Talk Ruby|Web 2010Mirah & Dubious Talk Ruby|Web 2010
Mirah & Dubious Talk Ruby|Web 2010baroquebobcat
 
Frozen Rails Slides
Frozen Rails SlidesFrozen Rails Slides
Frozen Rails Slidescarllerche
 
Jenkins (war)stories
Jenkins (war)storiesJenkins (war)stories
Jenkins (war)storiesToomas Römer
 

Similar to Railsconf 2010 (20)

Red Dirt Ruby Conference
Red Dirt Ruby ConferenceRed Dirt Ruby Conference
Red Dirt Ruby Conference
 
App Engine Meetup
App Engine MeetupApp Engine Meetup
App Engine Meetup
 
Oscon 2010
Oscon 2010Oscon 2010
Oscon 2010
 
Gaelyk - SpringOne2GX - 2010 - Guillaume Laforge
Gaelyk - SpringOne2GX - 2010 - Guillaume LaforgeGaelyk - SpringOne2GX - 2010 - Guillaume Laforge
Gaelyk - SpringOne2GX - 2010 - Guillaume Laforge
 
2011 June - Singapore GTUG presentation. App Engine program update + intro to Go
2011 June - Singapore GTUG presentation. App Engine program update + intro to Go2011 June - Singapore GTUG presentation. App Engine program update + intro to Go
2011 June - Singapore GTUG presentation. App Engine program update + intro to Go
 
Jeff mc cune sf 2010
Jeff mc cune sf 2010Jeff mc cune sf 2010
Jeff mc cune sf 2010
 
WSGI, Django, Gunicorn
WSGI, Django, GunicornWSGI, Django, Gunicorn
WSGI, Django, Gunicorn
 
RubyConf 2009
RubyConf 2009RubyConf 2009
RubyConf 2009
 
Aloha on-rails-2009
Aloha on-rails-2009Aloha on-rails-2009
Aloha on-rails-2009
 
"How Mozilla Uses Selenium"
"How Mozilla Uses Selenium""How Mozilla Uses Selenium"
"How Mozilla Uses Selenium"
 
Slideshare presentation
Slideshare presentationSlideshare presentation
Slideshare presentation
 
Odnoklassniki.ru Architecture
Odnoklassniki.ru ArchitectureOdnoklassniki.ru Architecture
Odnoklassniki.ru Architecture
 
Flowdock's full-text search with MongoDB
Flowdock's full-text search with MongoDBFlowdock's full-text search with MongoDB
Flowdock's full-text search with MongoDB
 
AppEngine Performance Tuning
AppEngine Performance TuningAppEngine Performance Tuning
AppEngine Performance Tuning
 
JRubyConf 2009
JRubyConf 2009JRubyConf 2009
JRubyConf 2009
 
RunDeck
RunDeckRunDeck
RunDeck
 
Mirah & Dubious Talk Ruby|Web 2010
Mirah & Dubious Talk Ruby|Web 2010Mirah & Dubious Talk Ruby|Web 2010
Mirah & Dubious Talk Ruby|Web 2010
 
Frozen Rails Slides
Frozen Rails SlidesFrozen Rails Slides
Frozen Rails Slides
 
Java to scala
Java to scalaJava to scala
Java to scala
 
Jenkins (war)stories
Jenkins (war)storiesJenkins (war)stories
Jenkins (war)stories
 

Recently uploaded

Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demoHarshalMandlekar2
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????blackmambaettijean
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESmohitsingh558521
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 

Recently uploaded (20)

Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demo
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 

Railsconf 2010

  • 2. Scaling Rails on App Engine with JRuby and Duby Run your apps on Google Servers, with access to first-class Java APIs John Woodell David Masover Ryan Brown June 9, 2010 2 Friday, June 11, 2010
  • 3. Google App Engine 3 Friday, June 11, 2010
  • 4. Key Features • No need to install or maintain your own stack • Use Google scalable services via standard APIs • Built-in application management console • Pay-as-you-go, with free quota to get started 4 Friday, June 11, 2010
  • 5. Key Limitations • No native code • No threads or sockets • No writing to the filesystem • No more than 30 seconds per request 5 Friday, June 11, 2010
  • 6. Quotas and Billing Resource Provided Free Additional Cost CPU time 6.5 hours/day $0.10/hour Bandwidth In 1GByte/day $0.10/GByte Bandwidth Out 1GByte/day $0.12/GByte Stored Data 1 GB $0.005/GB-day Emails sent 2000/day to users $0.0001/email 50000/day to admins 6 Friday, June 11, 2010
  • 7. App Engine Product Roadmap • SSL for third-party domains • Background servers capable of running for longer than 30s • Ability to reserve instances to reduce application loading overhead • Ability to select different availability vs. latency options for Datastore • Support for mapping operations across datasets • Datastore dump and restore facility • Raise request/response size limits for some APIs • Improved monitoring and alerting of application serving • Support for Browser Push (Comet) communication • Built-in support for OAuth & OpenID 7 Friday, June 11, 2010
  • 8. JRuby on App Engine 8 Friday, June 11, 2010
  • 9. Benefits of JRuby • Outperforms MRI in many cases... 2x to 10x • Gem extensions written in Java (no more segfaults) • A wealth of integration options and first-class Java APIs 9 Friday, June 11, 2010
  • 10. App Engine JRuby Milestones • 2009-04-08 @olabini publishes blog post on YARBL • 2009-04-09 @nicksieger publishes warbler demo • 2009-05-06 RailsConf (sinatra & merb) • 2009-11-02 0.0.5 bundler, precompilation & Duby preview • 2009-11-20 RubyConf (Rails 3.0.pre & Duby App) • 2009-12-27 @urekat publishes Rails 2.3.5 patches • 2010-01-11 @codingforrent published rails/dm gem • 2010-01-21 0.0.8 Rails 2.3.5 Primer for DM & TinyDS • 2010-01-26 0.0.9 Mechanize and Hpricot demos • 2010-02-27 0.0.10 ActionMailer, ImageService, jruby-openssl • 2010-04-08 @azazeal blog post on taxster.gr (OpenID) • 2010-06-09 0.0.14 JRuby 1.5.1 & app.yaml preview 10 Friday, June 11, 2010
  • 11. Current Issues with JRuby on App Engine • Several seconds to “spin-up” a new JRuby instance • Some gems may need their extensions ported to Java • Not officially supported , but you have all that you need + 11 Friday, June 11, 2010
  • 12. Install it Now sudo gem install google-appengine Everything you need installs as gems 12 Friday, June 11, 2010
  • 13. App Engine Gems • Development Gems – appengine-sdk – appengine-tools . . . dev_appserver.rb & appcfg.rb • Runtime Gems – appengine-rack . . . . jruby-jars & jruby-rack – appengine-apis • Related Gems – dm-appengine – rails_appengine – rails_dm_datastore – rails_tiny_ds 13 Friday, June 11, 2010
  • 14. App Engine JRuby APIs • AppEngine::Users • AppEngine::Datastore • AppEngine::Memcache • AppEngine::Mail • AppEngine::URLFetch • AppEngine::Images • AppEngine::Logger • AppEngine::XMPP • AppEngine::Labs::TaskQueue • AppEngine::OAuth • AppEngine::Blobstore 14 Friday, June 11, 2010
  • 15. dm-appengine David Masover 15 Friday, June 11, 2010
  • 16. DataMapper 16 Friday, June 11, 2010
  • 17. ActiveRecord contains SQL strings 17 Friday, June 11, 2010
  • 18. Use AppEngineResource 18 Friday, June 11, 2010
  • 19. Relationships 19 Friday, June 11, 2010
  • 20. Simple 20 Friday, June 11, 2010
  • 21. Transactions • Idempotence – "Why can't I click submit more than once?" • Transactions on datastore – Optimistic locking – Atomic – Only across entity-groups 21 Friday, June 11, 2010
  • 22. Simple case is Simple 22 Friday, June 11, 2010
  • 23. Entity-groups 23 Friday, June 11, 2010
  • 24. Global transactions • Don't do them! • Really, you don't need them! • They wouldn't scale anyway! but sometimes... 24 Friday, June 11, 2010
  • 25. Inventory tracking 25 Friday, June 11, 2010
  • 26. Shopping Cart 26 Friday, June 11, 2010
  • 27. Duby Ryan Brown Friday, June 11, 2010
  • 28. Duby’s not Ruby • Statically typed • No Duby runtime • Uses Java’s type system 28 Friday, June 11, 2010
  • 29. Duby has Ruby-inspired Syntax def fib(a:int) if a < 2 a else fib(a - 1) + fib(a - 2) end end puts fib 10 Friday, June 11, 2010
  • 30. // Generated from examples/Test.duby public class Test extends java.lang.Object { public static void main(String[] argv) { System.out.println(Test.fib(10)); } public static int fib(int a) { return (a < 2) ? (a) : ((Test.fib((a - 1)) + Test.fib((a - 2)))); } } Friday, June 11, 2010
  • 31. A Simple Duby App import javax.servlet.http.HttpServlet import com.google.appengine.ext.duby.db.Model class Post < Model property title, String property body, Text end class DubyApp < HttpServlet def_edb(list, 'com/ribrdb/list.dhtml') def doGet(request, response) @posts = Post.all.run response.getWriter.write(list) end def doPost(request, response) post = Post.new post.title = request.getParameter('title') post.body = Text.new(request.getParameter('body')) post.save doGet(request, response) end end 31 Friday, June 11, 2010
  • 32. A Simple Duby App import javax.servlet.http.HttpServlet import com.google.appengine.ext.duby.db.Model class Post < Model property title, String property body, Text end Types class DubyApp < HttpServlet inferred from parent def_edb(list, 'com/ribrdb/list.dhtml') class def doGet(request, response) @posts = Post.all.run response.getWriter.write(list) end def doPost(request, response) post = Post.new post.title = request.getParameter('title') post.body = Text.new(request.getParameter('body')) post.save doGet(request, response) end end 32 Friday, June 11, 2010
  • 33. A Simple Duby App import javax.servlet.http.HttpServlet import com.google.appengine.ext.duby.db.Model class Post < Model property title, String property body, Text end Plugins class DubyApp < HttpServlet def_edb(list, 'com/ribrdb/list.dhtml') def doGet(request, response) @posts = Post.all.run response.getWriter.write(list) end def doPost(request, response) post = Post.new post.title = request.getParameter('title') post.body = Text.new(request.getParameter('body')) post.save doGet(request, response) end end 33 Friday, June 11, 2010
  • 34. Duby Supports Plugins Only form of metaprogramming (for now) require 'erb' Duby::AST.defmacro('def_edb') do |duby, fcall, p| name = fcall.args_node.get(0).name path = fcall.args_node.get(1).value erb = ERB::Compiler.new(nil) ... src = erb.compile(IO.read(path)) duby.eval(src, p, “(edb)”) end Friday, June 11, 2010
  • 35. Duby Can Use erb Templates <title>Posts</title> <body> <h1>All Posts:</h1> <% for post in @posts %> <h2><%= post.title %></h2> <p><%= post.body.getValue %></p> <% end %> <hr> <h1>New Post:</h1> <form method=post> Title: <input type=text name=title><br> Body: <textarea name=body></textarea><br> <input type=submit> </form> </body> Friday, June 11, 2010
  • 36. More to Come • Open classes • Mix ins • Macros • More 36 Friday, June 11, 2010
  • 37. Resources • Blog – http://jruby-appengine.blogspot.com/ • Code Site – http://code.google.com/p/appengine-jruby/ • Google Group – http://groups.google.com/group/appengine-jruby • Resources – http://rails2010-dm.appspot.com/ – http://github.com/masover/rails2010 – http://github.com/masover/cart – http://cart-demo.appspot.com/ 37 Friday, June 11, 2010