Your SlideShare is downloading. ×
0
From Sectional to Sofa
NoSQL with .
J. Steven Young
Show Me the Cache
• 11 Clusters (4 mirrored)
– 100 nodes
• > 3 TB of data
• ~430m objects (146m in largest)
• Total ops/se...
In The Beginning
• Cache Scalability
• Drop in replace Memcached
• Database relief
• HA caching
From the Bottom Up
• Processors
• Memory
• Disk
• Virtualization
• “Bloat”-ware
Establish Standard Architecture
• LESSON: STANDARDIZE HARDWARE
–Sizing Environments Properly
–Testing Failures
–Performanc...
Expectations of Users
• LESSON: Know what is wanted
– Object Sizing and Number
– TTL, ops/sec, # Host Connections
– Bucket...
Cache Behaving Badly
• LESSON: PREPROD TESTING
– Rebalance Issues
– Swapping
– Memory Consumption
– Out Dated Libraries
Cache in the Couch
• LESSON: Know TCO
– Resources
– Administrative Costs / Time
– Usage / Consolidation
Balancing Act
• Consolidation
• Replication
• Fault Tolerant Applications
• Off-loading Processes
• Libraries
• Connections
Use Case #1
• Content
– HTML
– Image Links
– HA caches
– XDCR
Example of HA
DC 1 DC 2
VS.
Use Case #2
• Upselling
– Package Deals
– Ads Data
– Added Offers
Use Case #3
• Search History / Trends
– Previous Searches
– What Properties are Trending
– Stored Pricing
Image the Possibilities
• Alerting Management
• Configuration Management
• RDBS Caching
• Release Management
• Trending An...
Foundations for Success
• From the Ground Up
• Know Your Environment
• Know Your Limitations
• Monitor
@jstevenyoung
Upcoming SlideShare
Loading in...5
×

Orbitz_Couchbase_SF_2013

1,093

Published on

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,093
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
20
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • Introduce myself and what I do at OWW ( Who is OWW and who are our customers)
  • What are we storing in CouchbaseSide note ( this doubled after adopting CB)
  • What did we require when looking for a single caching / NoSQL solution
  • What works and what does not for OWW standardization efforts as we assumed without knowing our needs. How picking the right HW/SW combinations along with tweaking make all the difference.
  • From pre-prod to prod; why what you test on matters in production releases
  • Explores communicating with developers and understanding what they require from Couchbase as well as making sure the developers know all the capabilities available.
  • Examines what happens when systems are not properly configured for Couchbase operational requirements.
  • Which combinations of couchbase bucket and memcached buckets work well in a cluster.What can your hardware handleWhere is NoSQL appropriateHow to balance # of clusters with available admin resources ( alerting / failover etc)
  • How best to create a Highly available cache solution without wasting resources.Summarize lessons OWW learned.
  • Describing some of the applications in testing
  • The key to a successful implementation of Couchbase, is to begin from the ground up. Know the capabilities of the hardware you choose to work with as well as the operating system performance and benchmarks. Disk, memory, network and base operations, all require resources that will effect the performance of your cache. Know the limitations you face before over committing your system to caches it is unable to properly handle without proper configuration and design.
  • Transcript of "Orbitz_Couchbase_SF_2013"

    1. 1. From Sectional to Sofa NoSQL with . J. Steven Young
    2. 2. Show Me the Cache • 11 Clusters (4 mirrored) – 100 nodes • > 3 TB of data • ~430m objects (146m in largest) • Total ops/sec ~ 75k – *149k with HA
    3. 3. In The Beginning • Cache Scalability • Drop in replace Memcached • Database relief • HA caching
    4. 4. From the Bottom Up • Processors • Memory • Disk • Virtualization • “Bloat”-ware
    5. 5. Establish Standard Architecture • LESSON: STANDARDIZE HARDWARE –Sizing Environments Properly –Testing Failures –Performance Testing / Tuning –Documenting Failures and Successes
    6. 6. Expectations of Users • LESSON: Know what is wanted – Object Sizing and Number – TTL, ops/sec, # Host Connections – Bucket Type – Indexing and Queries and Replication – Binary vs. JSON
    7. 7. Cache Behaving Badly • LESSON: PREPROD TESTING – Rebalance Issues – Swapping – Memory Consumption – Out Dated Libraries
    8. 8. Cache in the Couch • LESSON: Know TCO – Resources – Administrative Costs / Time – Usage / Consolidation
    9. 9. Balancing Act • Consolidation • Replication • Fault Tolerant Applications • Off-loading Processes • Libraries • Connections
    10. 10. Use Case #1 • Content – HTML – Image Links – HA caches – XDCR
    11. 11. Example of HA DC 1 DC 2 VS.
    12. 12. Use Case #2 • Upselling – Package Deals – Ads Data – Added Offers
    13. 13. Use Case #3 • Search History / Trends – Previous Searches – What Properties are Trending – Stored Pricing
    14. 14. Image the Possibilities • Alerting Management • Configuration Management • RDBS Caching • Release Management • Trending Analysis If you build it… They will come!
    15. 15. Foundations for Success • From the Ground Up • Know Your Environment • Know Your Limitations • Monitor
    16. 16. @jstevenyoung
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×