Triumph of Simplicity: How databases will be replaced by simple services.
•
1 like•336 views
Orchestrate CTO Ian Plosker talks about the future of Databases-as-a-Service. Fast-track development and save 50-90% off your database costs. Sign up for a free Orchestrate account today: http://nodb.co/1wzT7Xj
Recommended
More Related Content
Similar to Triumph of Simplicity: How databases will be replaced by simple services.
Similar to Triumph of Simplicity: How databases will be replaced by simple services. (20)
More from Orchestrate
Recently uploaded
Recently uploaded (20)
Triumph of Simplicity: How databases will be replaced by simple services.
- 1. The Triumph of Simplicity How database complexity will be replaced by simple services “Life is really simple, but we insist on making it complicated.” -Confucius
- 2. Who am I?
- 3. IAN PLOSKER
- 4. Co-founder & CTO @dstroyallmodels about.me/ian.plosker
- 5. Our goal is to make storing and querying so easy, you don’t need databases
- 6. E.W. Dijkstra “Simplicity is a great virtue but it requires hard work to achieve it and education to appreciate it. And to make matters worse: complexity sells better.” http://www.cs.utexas.edu/users/EWD/transcriptions/EWD08xx/EWD896.html
- 7. Some people believe that complexity is how value is added
- 8. We fetishize complexity http://www.cs.utexas.edu/users/EWD/transcriptions/EWD08xx/EWD898.html
- 9. SELECT SUM(offerTotal) as theOfferTotal, SUM(lienTotal) AS theLienTotal, SUM(CLVtotal) AS theCLVtotal, SUM(estGrossProfitTotal) AS theESTGPtotal FROM (( SELECT COALESCE(SUM(COALESCE(offerAmount, 0)), 0) AS offerTotal, COALESCE(SUM(COALESCE(amount, 0) + COALESCE(legalFees, 0) + COALESCE(costs, 0)), 0) AS lienTotal, COALESCE(SUM(((amount + legalFees + costs) * (1 + (rateOfInterest / 100) * (FLOOR((UNIX_TIMESTAMP(NOW()) - UNIX_TIMESTAMP(dateOfAttachment)) / 86400) / 365)))), 0) AS CLVtotal, COALESCE(SUM((((amount + legalFees + costs) * (1 + (rateOfInterest / 100) * (FLOOR((UNIX_TIMESTAMP(NOW()) - UNIX_TIMESTAMP(dateOfAttachment)) / 86400) / 365))) - COALESCE(offerAmount, 0))), 0) AS estGrossProfitTotal FROM lienTable AS theLienTable, propertyTable, property_lien, stateInterestTable, data, judgementLienTable WHERE theLienTable.lienID = property_lien.lienID AND propertyTable.propertyID = property_lien.propertyID AND propertyTable.state = stateInterestTable.state AND theLienTable.lienID = judgementLienTable.lienID AND theLienTable.lienStatusID IN (65, 70, 75) AND data.id = (SELECT data.id FROM lienTable, data, data_lien WHERE lienTable.lienID = data_lien.lienID AND data_lien.id = data.id AND category = 15 AND lienTable.lienID = theLienTable.lienID ORDER BY data.id DESC LIMIT 1) AND dateOfAttachment != 0 AND UNIX_TIMESTAMP(NOW()) > UNIX_TIMESTAMP(dateOfAttachment) AND FLOOR((UNIX_TIMESTAMP(NOW()) - UNIX_TIMESTAMP(dateOfAttachment)) / 86400) > 0 AND rateOfInterest > 0 ) UNION ( SELECT COALESCE(SUM(COALESCE(offerAmount, 0)), 0) AS offerTotal, COALESCE(SUM(COALESCE(amount, 0) + COALESCE(legalFees, 0) + COALESCE(costs, 0)), 0) AS lienTotal, COALESCE(SUM(((amount + legalFees + costs) * (1 + (rateOfInterest / 100) * (FLOOR((UNIX_TIMESTAMP(NOW()) - UNIX_TIMESTAMP(judgementDate)) / 86400) / 365)))), 0) AS CLVtotal, COALESCE(SUM((((amount + legalFees + costs) * (1 + (rateOfInterest / 100) * (FLOOR((UNIX_TIMESTAMP(NOW()) - UNIX_TIMESTAMP(dateOfAttachment)) / 86400) / 365))) - COALESCE(offerAmount, 0))), 0) AS estGrossProfitTotal FROM lienTable AS theLienTable, propertyTable, property_lien, stateInterestTable, data, judgementLienTable WHERE theLienTable.lienID = property_lien.lienID AND propertyTable.propertyID = property_lien.propertyID AND propertyTable.state = stateInterestTable.state AND theLienTable.lienID = judgementLienTable.lienID AND theLienTable.lienStatusID IN (65, 70, 75) AND data.id = (SELECT data.id FROM lienTable, data, data_lien WHERE lienTable.lienID = data_lien.lienID AND data_lien.id = data.id AND category = 15 AND lienTable.lienID = theLienTable.lienID ORDER BY data.id DESC LIMIT 1) AND COALESCE(dateOfAttachment, 0) = 0 AND judgementDate != 0 AND UNIX_TIMESTAMP(NOW()) > UNIX_TIMESTAMP(judgementDate) AND FLOOR((UNIX_TIMESTAMP(NOW()) - UNIX_TIMESTAMP(judgementDate)) / 86400) > 0 AND rateOfInterest > 0 ) ) AS theBigTable;
- 11. Simple Complex
- 12. Simple Complex
- 13. Simple Complex
- 14. Simple Complex aws ec2 run-instances --image-id ami-c3b8d6aa --count 2 --instance-type t1.micro -- key-name MyKeyPair --security-groups MySecurityGroup
- 15. Simple Complex
- 16. Simple Complex author:Dijkstra AND year:[1970 TO 1985]
- 19. MEMCACHE BERKLEY DB GENIEDB COUCHBASE Databases in 2013 REDIS SWIFT RIAK VOLDEMORT TOKYO CABINET HBASE TEMPODB ELASTIC SEARCH NEO4J HIBARI COUCHDB BIG COUCH MARKLOGIC SERVER ORIENTDB NOSQL DB DYNAMO COHERENCE AEROSPIKE INFINIGRAPH DEX DRAWN TO SCALE SIMPLEDB FLOCKDB MNESIA COHERENCE MONGODB CASSANDRA 25 databases in production today that didn’t exist 7 years ago
- 20. ONLINE QUERY TYPES Key-Value Search Geo Graph/ Relation Event Scale-up BerkleyDB CouchDB MongoDB MySQL SOLR Sphinx PostGIS MongoDB SOLR neo4j MySQL Scale-out Riak Cassandra elasticsearch elasticsearch titan HBase
- 21. The database paradox of choice: Choice has brought complexity
- 22. Klout’s Data Architecture 1. Hbase( 2. MySQL( 3. Elas2cSearch( 4. MongoDB( (
- 23. Imgur’s Data Architecture 1. Hbase(((2.(Elas,cSearch((3.(MySQL((4.(Memcache((5.(Redis((6.(HAproxy(
- 24. The Value of Simplicity Varies Across Domains design systems economics
- 25. design Simple or complex?
- 26. systems Simple or complex?
- 27. economics Simple or complex?
- 28. design systems economics API expose utility, hide complexity
- 30. Simple Complex Fulcrum (API)
- 31. Simple Complex
- 32. Simple Complex
- 33. Simple Complex author:Dijkstra AND year:[1970 TO 1985]
- 34. Simple Complex 1. Hbase( 2. MySQL( 3. Elas2cSearch( 4. MongoDB( (
- 35. API Growth
- 36. Where does your business provide value? Simple Complex Ease of use Leverage Economies of Scale
- 38. The API • HTTP REST • JSON in/JSON out • Hosted as a Service
- 39. Key Value GET /v0/$collection/$key # Retrieve a value PUT /v0/$collection/$key # Store a value POST /v0/$collection # Store a value (server-generated key) GET /v0/$collection # List the contents of a collection in key order
- 40. Search GET /v0/$collection?query=$query # Query a collection GET /v0/$collection?query=$query&sort=$field:$direction # Query and sort
- 41. Graph PUT /v0/$collectionA/$keyA/relation/$kind/$collectionB/$keyB # Create a relation GET /v0/$collection/$key/relations/$kind # List relations GET /v0/$collection/$key/relations/$kindA/$kindB # List relations
- 42. Events/Time-Ordered GET /v0/$collection/$key/events/$kind # Events POST /v0/$collection/$key/events/$kind # Store event POST /v0/$collection/$key/events/$kind/$timestamp # Store a value (server-generated key)
- 43. Advanced Features • Immutable data • Optimistic concurrency control • Historical Queries