The BestBuy.com Cloud Architecture

  • 1,726 views
Uploaded on

A review of BestBuy.com's cloud architecture for its browse cloud. A description of what BestBuy.com has built to support a high scale, high availability ecommerce system.

A review of BestBuy.com's cloud architecture for its browse cloud. A description of what BestBuy.com has built to support a high scale, high availability ecommerce system.

More in: Technology , Business
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
1,726
On Slideshare
0
From Embeds
0
Number of Embeds
3

Actions

Shares
Downloads
36
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. 5/01/2013 BESTBUY.COM’S CLOUD ARCHITECTURE
  • 2. WHO WE ARE • Best Buy is the world’s largest multi-channel consumer electronics retailer with stores in the United States, Canada, China, Europe and Mexico. • 11th largest online retailer • More than 1.6 billion visitors to our stores and BestBuy.com each year • Reward Zone largest loyalty program in the U.S. – more than 40 million active members • Provide customers with outstanding choice, unbiased advice and unmatched support for the tech needs May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 3. A UNIQUE CUSTOMER PROMISE • THE LATEST DEVICES AND SERVICES, ALL IN ONE PLACE • IMPARTIAL & KNOWLEDGEABLE ADVICE • COMPETITIVE PRICES • THE ABILITY TO SHOP WHEN AND WHERE YOU WANT • SUPPORT FOR THE LIFE OF YOUR PRODUCTS May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 4. JOEL CRABB • Chief Architect, BestBuy.com • Building BestBuy.com’s Ecommerce Platform • B.S. EE – Washington University in St. Louis • M.S. NE – University of Wisconsin – Madison • MBA – University of Minnesota – Carlson School May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 5. ARCHITECTURE OVERVIEW • What’s included —Non-functional goals —Component system views —Real examples —Measurements and Volumes • What’s not included —Specific implementation details —Products and company names —Security information May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 6. TERMINOLOGY – HOME PAGE May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 7. TERMINOLOGY – PRODUCT DETAIL PAGE May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 8. WHAT WE INHERITED • Monolithic 10 year old architecture • Minor UI changes took months • 10,000 line JSPs was normal • Long standing defects • Chaotic build and deployment • Unsatisfied business customers May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 9. CLOUD EXPERIMENTS - 2010 • Created a browse-only site to cover outages —Always on cloud resident application —Elastically scaled and available in around 10 minutes • Smaller web properties in cloud (myrewardzone.bestbuy.com) • Test environments in cloud May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 10. CLOUD RE-ARCHITECTURE • In 2011 we began planning a new Ecommerce Platform • Our traffic profile features an approximately 7X peak around Thanksgiving • Majority of traffic is browse and search • Re-architect browse tier to cloud for elasticity, scalability and reliability • Served ~25% of traffic in 2012 May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 11. OVERARCHING CONCEPTS • Split Traffic —Browse is > 90% of traffic —Commerce is most important traffic • Cache everywhere • Increase use of Content Delivery Network • System Isolation May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 12. STAKEHOLDER REQUIREMENTS • Scalability • Flexibility • Reliability May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 13. SCALABILITY GOALS • Near-Infinite • 7X traffic spikes • Bursts • Bursts > 50,000 rps • #3 in eCommerce traffic during holiday May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 14. FLEXIBILITY GOALS Low cost of change Fast concepts to site Daily releases Multiple versions One day of work vs. 2 months
  • 15. RELIABILITY GOALS • 100% availability • Zero defects • Achieved 100% cloud uptime during Holiday • ~ 2s response times May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 16. CLOUD DOMAIN • Browse and Search traffic • Non-transactional • Non-persistent • Non-sensitive data May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 17. CLOUD ARCHITECTURE CONCEPTS • Clouds fail, plan for it —Multiple availability zones —Multiple regions —Multiple vendors • Datacenter connections fail, plan for it —Serve pages completely from cloud —Browse-only fallback mode May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 18. CLOUD ARCHITECTURE CONCEPTS CDN: Global Traffic Manager Browse Cloud Browse Cloud Vendor 1 Vendor 2 Best Buy Datacenter May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 19. CLOUD ARCHITECTURE Persistent Cache Cloud Load Balancer Web App Web App Service Aggregator Product Data Product Data Datacenter Legacy Services and Product Data May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 20. FRONT END APPLICATION • HTML • Javascript • CSS • Templating framework • JSON Data Contract with Service Layer • No Java/JSP in front end • No MVC framework May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 21. FRONT END FLEXIBILIT Y Decoupling from back end allows freedom to iterate and deploy independent of back end. Swapped in Hottest Deals carousel in December 2012 in one day.
  • 22. FRONT END ARCHITECTURE CDN: Global Traffic Manager Browse Traffic Web Application JSON Data Contract Commerce Traffic Service Aggregator Legacy Commerce Engine May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 23. FRONT END: CDN USAGE • CDN = Content Delivery Network • Base page caching • Edge Side Includes (ESI) • Image caching • Traffic routing to multiple clouds and DC • Overall ~ 80% of requests served by CDN May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 24. SERVICES TIER • Aggregation services —Specific to each page —Gathers data from 30-50 services —Asynchronous —Smart caching • Granular services —Specific related data —Reusable across views May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 25. SERVICES AGGREGATOR - PDP • Target of 1000ms for 99% of requests 99% 99% 95% Avg 95% AVG May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 26. DATA TIER • NoSQL Product Catalog —Schema flexibility —Simple REST API —Replication – Datacenter to Cloud —Pulled from legacy product catalog —Data available to all of Best Buy —Reliable and Scalable —~ 20 applications using data since inception May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 27. DATA FLOW Cloud Web Application Granular Service Aggregator Service NoSQL Product Data Replication Extraction Datacenter Legacy Product Data NoSQL Product Data May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 28. BEST PRACTICES • Use a distributed service framework —Netflix - Hystrix —LinkedIn – Rest.li • Understand velocity of change —Front end is high velocity • Lightweight • Disposable —Back end is low velocity • Heavyweight • Scalable May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 29. BEST PRACTICES • Staged Deployments —Started with Home Page —Ramped up traffic from 10 – 100% over weeks —Added Product Detail Pages in phases • Have a backup plan —Legacy system left intact —Occasional rollback to fix defects • Automate Everything —Consistently deploy 100s of cloud VMs —Easily create test environments May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 30. PROBLEMS ENCOUNTERED • Data replication is hard at scale • Scaling takes time —Getting from 95% to 99% of calls to our expected SLAs took months • Legacy data issues —Old data formats were difficult to use in redesigned UI May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 31. WHAT YOU SEE Old PDP ~ 4 - 20 seconds New PDP ~ 2.5 seconds May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.
  • 32. May 1, 2013 @Copyright 2013 – Best Buy, Inc. All rights reserved.