Mumps the Internet scale database

19,726 views

Published on

Mumps - The Internet Scale Database

Published in: Business, Technology
5 Comments
18 Likes
Statistics
Notes
  • For recent thoughts and developments with the Mumps database technology, for example its integration with Javascript/Node.js, see http://robtweed.wordpress.com
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • wolf-Levetzow-hamburg/germany/2011
    I like M but..
    1)--has one ever seen a data-visualising-TOOL
    that works as a bidirectional EDITOR for the hirarchic M-globals ?
    On super Grafic-Tool is form GE , ( I help to distribute the new M--bidir-data-editor )
    see: http://www.graphviz.org/
    2) GTM on linux , Cache with MUMPS as his intern Language
    but M21
    has one referenzes to M21 and ther 'Mumps to every-dataformat ' possibility ?
    3) long live to MUMPS

    mail: visuellogic@hotmail.com
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Interesting that since we wrote this presentation, I've come across this blog from 2 years ago that supports the arguments we've made:

    http://www.25hoursaday.com/weblog/PermaLink.aspx?guid=576aecc0-607b-4f42-9cf5-fda2b42a74fa
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Interesting that since we wrote this presentation, I've come across this blog from a couple of years ago to serves to support the arguments we've made:



    http://www.25hoursaday.com/weblog/CommentView.aspx?guid=576aecc0-607b-4f42-9cf5-fda2b42a74fa
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Interesting that since we wrote this presentation, I've come across this blog from a couple of years ago to serves to support the arguments we've made:



    http://www.25hoursaday.com/weblog/CommentView.aspx?guid=576aecc0-607b-4f42-9cf5-fda2b42a74fa
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total views
19,726
On SlideShare
0
From Embeds
0
Number of Embeds
2,442
Actions
Shares
0
Downloads
0
Comments
5
Likes
18
Embeds 0
No embeds

No notes for slide

Mumps the Internet scale database

  1. Mumps The Internet-scale Database Rob Tweed M/Gateway Developments Ltd & George James George James Software
  2. Introduction <ul><li>What’s Mumps? </li></ul><ul><ul><li>A relatively little-known non-relational database technology </li></ul></ul><ul><ul><li>Available in both proprietary and free, open source versions </li></ul></ul><ul><li>Why is it becoming interesting? </li></ul><ul><ul><li>Its core features perfectly meet today’s needs for Internet-scale databases </li></ul></ul><ul><ul><li>It’s a tried and tested technology </li></ul></ul>
  3. Internet-scale database challenges <ul><li>Rapid growth and unpredictable demand </li></ul><ul><li>Low cost </li></ul><ul><li>Low maintenance </li></ul><ul><li>Ultra-high reliability and resilience </li></ul><ul><li>Flexibility </li></ul><ul><li>Simplicity </li></ul><ul><li>Ultra-high performance </li></ul>
  4. Internet-scale database challenges <ul><li>Rapid growth and unpredictable demand </li></ul><ul><ul><li>Scale from no activity to sudden huge demand (Slashdot, Digg, TechCrunch) </li></ul></ul><ul><ul><li>Disaster brought on by success </li></ul></ul><ul><ul><li>Daily/seasonal spikes </li></ul></ul>
  5. Internet-scale database challenges <ul><li>Low cost </li></ul><ul><ul><li>At startup: </li></ul></ul><ul><ul><ul><li>No traffic, no revenue </li></ul></ul></ul><ul><ul><ul><li>Uncertain future: </li></ul></ul></ul><ul><ul><ul><ul><li>Little traffic? </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Massive success? </li></ul></ul></ul></ul><ul><ul><ul><li>Proprietary databases are too expensive </li></ul></ul></ul><ul><ul><ul><li>mySQL and Postgres have become the default choices </li></ul></ul></ul><ul><ul><li>If successful: </li></ul></ul><ul><ul><ul><li>Must be able to scale, but at low incremental cost </li></ul></ul></ul><ul><ul><li>Budgets are tight </li></ul></ul><ul><ul><li>Ideally free and open source </li></ul></ul>
  6. Internet-scale database challenges <ul><li>Low maintenance </li></ul><ul><ul><li>Quick and simple to get started </li></ul></ul><ul><ul><li>DBA resources are expensive </li></ul></ul><ul><ul><li>Downtime for tuning: </li></ul></ul><ul><ul><ul><li>At best annoying </li></ul></ul></ul><ul><ul><ul><li>At worst highly disruptive and costly </li></ul></ul></ul><ul><ul><li>Ideally fire up and forget! </li></ul></ul>Photo: © Gerrit van Aaken CC-BY 2.0
  7. Internet-scale database challenges <ul><li>Ultra-high reliability and resilience </li></ul><ul><ul><li>The Net works 24 x 7 </li></ul></ul><ul><ul><ul><li>So must your applications! </li></ul></ul></ul><ul><ul><li>Redundancy and replication </li></ul></ul><ul><ul><li>Load balancing </li></ul></ul><ul><ul><li>Hardware hot-swapping </li></ul></ul>
  8. Internet-scale database challenges <ul><li>Flexibility </li></ul><ul><ul><li>Impossible to design everything </li></ul></ul><ul><ul><li>perfectly at the outset </li></ul></ul><ul><ul><li>Requirements evolve and expand </li></ul></ul><ul><ul><li>Database redesign: </li></ul></ul><ul><ul><ul><li>Must not be costly </li></ul></ul></ul><ul><ul><ul><li>Must not be time-consuming </li></ul></ul></ul><ul><ul><li>Cannot be “painted into a corner” </li></ul></ul><ul><ul><li>by your DBMS </li></ul></ul>
  9. Internet-scale database challenges <ul><li>Simplicity </li></ul><ul><ul><li>Less moving parts is always a better option </li></ul></ul><ul><ul><ul><li>Associated running costs </li></ul></ul></ul><ul><ul><ul><li>Maintenance implications </li></ul></ul></ul><ul><ul><ul><li>Reliability concerns </li></ul></ul></ul><ul><ul><li>Speed of development </li></ul></ul><ul><ul><ul><li>Initial (time to market) </li></ul></ul></ul><ul><ul><ul><li>Ongoing (reactivity to market) </li></ul></ul></ul>
  10. Internet-scale database challenges <ul><li>Ultra-high performance </li></ul><ul><ul><li>Massive potential concurrent users </li></ul></ul><ul><ul><li>Maximum throughput </li></ul></ul><ul><ul><li>Minimum hardware </li></ul></ul><ul><ul><ul><li>Capital/revenue costs </li></ul></ul></ul><ul><ul><ul><li>Energy costs </li></ul></ul></ul><ul><ul><ul><li>CO 2 emissions </li></ul></ul></ul><ul><ul><ul><li>Costs of physical space </li></ul></ul></ul>
  11. Does anything fit the bill?
  12. Relational? <ul><li>Rapid growth and unpredictable demand </li></ul><ul><ul><li>Scalability at high end is generally recognised as problematic </li></ul></ul><ul><li>Low cost </li></ul><ul><ul><li>Proprietary RDBMS too costly </li></ul></ul><ul><ul><li>Heavy hardware requirements </li></ul></ul><ul><li>Low maintenance </li></ul><ul><ul><li>DBA essential and retuning constantly required </li></ul></ul><ul><li>Ultra-high reliability and resilience </li></ul><ul><ul><li>At a cost! </li></ul></ul><ul><li>Flexibility </li></ul><ul><ul><li>RDBMS schemas are too rigid </li></ul></ul><ul><ul><li>Getting the initial design wrong could be expensive or fatal </li></ul></ul><ul><ul><li>Schema migration is impractical without downtime </li></ul></ul><ul><li>Simplicity </li></ul><ul><ul><li>Most RDBMS are complex beasts </li></ul></ul><ul><li>Ultra-high performance </li></ul><ul><ul><li>Perhaps, but only at eye-wateringly high cost </li></ul></ul><ul><li>The relational table model does not naturally fit much of the data on the Net </li></ul>
  13. Alternatives? <ul><li>These demands have stimulated the emergence of “new kids on the block”: </li></ul><ul><ul><li>Amazon simpleDB </li></ul></ul><ul><ul><li>couchDB </li></ul></ul><ul><ul><li>objectKitchen </li></ul></ul><ul><ul><li>strokeDB </li></ul></ul><ul><ul><li>dovetailDB </li></ul></ul><ul><ul><li>Poseidon </li></ul></ul><ul><ul><li>Google BigTable </li></ul></ul>
  14. Tried and tested? <ul><li>Will these scale? </li></ul><ul><li>Are they cost-effective at low and high scales? </li></ul><ul><li>Are they robust, resilient and reliable enough? </li></ul><ul><li>Will they allow automated recovery? </li></ul><ul><li>Will they protect against database corruption if the service is disrupted? </li></ul>
  15. Emerging features <ul><li>These alternatives all exhibit features that buck the established RDBMS trend: </li></ul><ul><ul><li>Schemaless and/or </li></ul></ul><ul><ul><li>Hierarchical </li></ul></ul>
  16. Schemaless database benefits <ul><li>High-speed development </li></ul><ul><li>No schema migration required </li></ul><ul><li>Flexibility </li></ul><ul><li>Agility = reactivity to market requirements </li></ul><ul><li>Dynamic extension of database structures </li></ul><ul><li>Reduced baggage = higher performance </li></ul>
  17. Hierarchical database benefits <ul><li>Natural mapping to XML and JSON </li></ul><ul><li>Easy to navigate </li></ul><ul><li>Easy to code against </li></ul><ul><li>Associated data is clustered naturally </li></ul><ul><ul><li>leading to high performance </li></ul></ul><ul><li>B-tree implementations </li></ul><ul><ul><li>derive extremely high performance </li></ul></ul><ul><li>Easy to partition across multiple devices </li></ul>
  18. Why re-invent the wheel?
  19. Mumps <ul><li>Tried and tested </li></ul><ul><ul><li>In production use for over 30 years across the world </li></ul></ul><ul><ul><li>Has quietly and reliably underpinned healthcare and financial services </li></ul></ul><ul><li>Schemaless </li></ul><ul><li>Hierarchical </li></ul><ul><li>Proven high performance </li></ul><ul><li>Proven reliabilty </li></ul><ul><li>Two main implementations: </li></ul><ul><ul><li>GT.M (open source) </li></ul></ul><ul><ul><li>Cach é (proprietary) </li></ul></ul>
  20. Mumps is Internet-scale <ul><li>Rapid growth and unpredictable demand </li></ul><ul><ul><li>Massively scalable </li></ul></ul><ul><ul><li>Already meeting the needs of huge user-bases </li></ul></ul><ul><li>Low cost </li></ul><ul><ul><li>GT.M is free </li></ul></ul><ul><ul><li>Exceptionally efficient use of hardware resources </li></ul></ul><ul><li>Low maintenance </li></ul><ul><ul><li>No DBA requirement and no need for constant tuning </li></ul></ul><ul><ul><li>Non-stop, lights-out operation </li></ul></ul><ul><li>Ultra-high reliability and resilience </li></ul><ul><ul><li>Tried and tested to meet the demands of large healthcare and financial services organisations </li></ul></ul><ul><li>Flexibility </li></ul><ul><ul><li>Schemaless model = dynamic ongoing change without disruptive redesign and rebuilding </li></ul></ul><ul><ul><li>Extremely fast development and maintenance </li></ul></ul><ul><li>Simplicity </li></ul><ul><ul><li>Hierarchical database model naturally fits the modern XML and JSON-oriented view of data </li></ul></ul><ul><li>Ultra-high performance </li></ul><ul><ul><li>Mumps systems are renowned for astonishing levels of performance and throughput </li></ul></ul><ul><ul><li>50% to 100% faster than many conventional databases </li></ul></ul><ul><ul><li>Much less hardware = less cost, less CO 2 </li></ul></ul>
  21. Mumps is freedom <ul><li>Dynamic free-form nature of the schemaless, hierarchical database </li></ul><ul><li>Raw, flexible palette on which you can build your own value-added layers </li></ul><ul><li>Unconstrained by the rigours of the relational model </li></ul><ul><li>A natural fit for the hierarchical structures in XML and JSON </li></ul>
  22. Mumps is open <ul><li>Interoperates and integrates with any other language </li></ul><ul><ul><li>Cach é </li></ul></ul><ul><ul><ul><li>Built-in connectors for Java, .Net and web services </li></ul></ul></ul><ul><ul><ul><li>Built-in XML support </li></ul></ul></ul><ul><ul><li>GT.M </li></ul></ul><ul><ul><ul><li>M/Gateway’s MGWSI gateway provides integration with: </li></ul></ul></ul><ul><ul><ul><ul><li>PHP, Java, .Net, Ruby, Python, Perl </li></ul></ul></ul></ul><ul><ul><ul><ul><li>web services and REST </li></ul></ul></ul></ul><ul><ul><ul><li>M/Gateway’s eXtc and EWD products provide XML and JSON support </li></ul></ul></ul><ul><li>Also has its own built-in scripting language </li></ul>
  23. Mumps is here <ul><li>GT.M </li></ul><ul><ul><li>http://www.fis-gtm.com </li></ul></ul><ul><li>Cach é </li></ul><ul><ul><li>http://www.intersystems.com </li></ul></ul><ul><li>Background information </li></ul><ul><ul><li>http://en.wikipedia.org/wiki/MUMPS </li></ul></ul><ul><ul><li>http://www.mgateway.com </li></ul></ul><ul><ul><li>http://gradvs1.mgateway.com/download/extreme1.pdf </li></ul></ul><ul><ul><li>http://www.georgejames.com </li></ul></ul>
  24. Mumps The tried-and-tested Internet-scale database

×