BigMemory for BigProblems: Improving Performance of a Real World eCommerce Application Based on Hibernate & Broadleaf Commerce

BigMemory for BigProblems Taylor Gautier, Principal Architect, Grid Dynamics Jeff Fischer, Senior Architect, Credera November 18, 2010

Agenda
Case Study: The Container Store
Application use case
The Broadleaf Commerce Solution
Challenges faced
Solving the problem with Ehcache
Introduction to Terracotta BigMemory
What is it – architecture and use cases
Configuration and setup
POC – BigMemory with Broadleaf Commerce
Benchmark and results
Questions & Next Steps

Case Study: The Container Store

Application Use Case – The Container Store
Goal
Re-architect online retail store
Requirements
SEO friendly URLs
Optimized search engine indexing
Natural user browsing
Challenges
Translate category URLs into real catalog objects
Result
Selected Credera & Broadleaf Commerce eCommerce engine

The Broadleaf Commerce Solution
Open source, enterprise-class eCommerce solution using the widely adopted Spring Framework
A flexible, extensible, and easily customizable framework that provides catalog, checkout, purchasing, and tax workflows
Low cost of ownership for core commerce functionality
eCommerce solution selected by The Container Store and implemented by Credera

Broadleaf Commerce – How It Works
Cached map
Holds catalog object hierarchy
Transient map holds catalog objects
Lazy initialized upon request
Request URLs
Parsed into map keys
Presentation Layer
Data driven via cached map

Challenges Faced – The Container Store
Load testing
Discovered issues with original approach
Issues Found
Transient map not held in the level 2 cache
Map created and reclaimed on every request
Excessive Garbage Collection observed
Consequences
Max latency exceed The Container Store SLA
Bad impression for end users

The Trouble with Hibernate – Object Churn
Objects are loaded from RDBMS and 2 nd level cache
Request is computed and returned to user
Changes are flushed back to cache and RDBMS
Objects are thrown away to be GC’d

The Solution – Ehcache “Hydrated” cache
Create a “Hydrated” cache for reference data
Synchronize object life cycles using Ehcache listener for cache eviction events
Intercept Hibernate object creation to wire objects properly during creation (step 1a)
Eliminates the original GC problem

Ok, But What If…
The Ehcache “hydrated” cache was a lot bigger?
Ehcache “hydrated” cache would be forced to evict more quickly
We just moved the problem from Hibernate to Ehcache
We would be right back where we started…

Solving the BigProblem

Introduction – Terracotta BigMemory ENTERPRISE APPLICATIONS Solutions for Performance, Scale and Availability Enterprise Ehcache Quartz Scheduler Web Sessions Terracotta Enterprise Suite BigMemory

BigMemory – The Big Picture Tiered Storage In-Memory Local Disk Store (Re-Startable) Heap Store BigMemory Off-Heap Store 2,000,000+ 1,000,000 100,000 2 500 1,000+ Speed (TPS) 1,000s Size (GB) External Data Source (e.g., Database)

Configuration and Setup – Update ehcache.xml
Update maxMemoryOffHeap and overflowToOffHeap parameters:
<ehcache updateCheck="false" monitoring="off” dynamicConfig="false"> <defaultCache maxElementsInMemory="10000” eternal="true" memoryStoreEvictionPolicy="LRU" statistics="false" /> <cache name="sample-offheap-cache" maxElementsInMemory="10000" eternal="true" memoryStoreEvictionPolicy="LRU" overflowToOffHeap="true" maxMemoryOffHeap="1G" /> </ehcache>

Configuration and Setup – Update JVM params
Update MaxDirectMemorySize parameter
Update UseLargerPages parameter
> java -XX:MaxDirectMemorySize=2G ... > java -XX:MaxDirectMemorySize=2G –XX:+UseLargerPages ...

POC – Solving The BigProblem

POC – Add BigMemory
Use BigMemory for Hibernate “hot object” cache
Keep much more object data local to JVM in off-heap store
Reduce latency of going to RDBMS for data

POC – Solving The BigProblem

POC – Benchmark Configuration
Benchmark
40,000 samples
Sample period of 10 minutes
Cache timeouts
Eternal, 300s, 180s, 1s
Load tested against
In-heap hydrated custom cache
BigMemory enabled cache

POC – Benchmark Results

POC – Results
Eternal timeouts
Differences are negligible
Objects never reclaimed from the cache and no GC differentiation
Application throughput is approximately equal
300s, 180s
Garbage collection times more prominent as timeouts decrease
Application performs better with BigMemory as timeouts decrease
1s
Garbage collection times decreased using BigMemory
Throughput increased by about 7000 TPS (25%) using BigMemory

Summary
Credera Implemented Broadleaf Commerce
Open-source solution based on Spring Framework
Extensible and flexible solution for eCommerce
Chosen by The Container Store
Terracotta BigMemory
Simple to add to existing Ehcache solutions
Reduce impact of Java GC
Improve SLA and response times

Questions related to Credera and Broadleaf Commerce …
www.credera.com and www.broadleafcommerce.org
Contact Jeff Fischer, Senior Architect with Credera
Email: [email_address]
Phone: 972.692.0010
Questions related to BigMemory …
www.terracotta.org and www.ehcache.org
Facebook: Terracotta
Twitter: @terracottatech and @ehcache
Email Us: [email_address]

Appendix

About: Credera
Our Company
Full-service business and technology consulting firm
Provides business and technology solutions that offer measurable value to our clients
Delivers value by leveraging our people’s accumulated industry and management experience with their deep technical expertise
Established in 1999
Offices in Dallas, Austin, Denver
Our Services
Management Consulting
Technology Solutions
Business Intelligence
Our People
Credera’s professionals possess a unique combination of deep technical expertise with extensive business backgrounds
Backgrounds include business, technology, and strategy management consulting with some of the most well-known and respected consulting firms in the world (e.g., Accenture, Booz Allen, PWC, Andersen)
Have served many influential corporations in a variety of industries over the past 20 years
Sample Clients

About: Terracotta
Behind some of the most widely used software for application scalability and performance
Lead developers of Ehcache, Quartz and Terracotta for enterprise products and open source projects
A leader in The Forrester Wave™ Elastic Caching Platforms, Q2 2010
250,000 + Enterprise Deployments Including Majority of Global 2000

http://www.linkedin.com	4
http://www.techgig.com	3
http://solcomelec.blogspot.com.es	3
http://solcomelec.blogspot.com	2
http://a0.twimg.com	2
http://english2disussions.blogspot.com	2
http://www.slideshare.net	1

BigMemory for BigProblems: Improving Performance of a Real World eCommerce Application Based on Hibernate & Broadleaf Commerce

by Credera

Accessibility

Categories

Upload Details

Usage Rights

7 Embeds 17

Statistics