The eBay Architecture: Striking a Balance between Site Stability, Feature Velocity, Performance, and Cost
Report
Share
•24 likes•30,165 views
![What we ’re up against ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],>26 Billion SQL executions/day! An SUV is sold every 5 minutes A sporting good sells every 2 seconds Over ½ Million pounds of Kimchi are sold every year!](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-2-2048.jpg?cb=1666174540)
![Velocity of eBay -- Software Development Process ,[object Object],[object Object],[object Object],[object Object],6M LOC 100K LOC/Wk 99.94% 212M Users 300+ Features Per Quarter ,[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-5-2048.jpg?cb=1666174540)
![Architectural Lessons ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-7-2048.jpg?cb=1666174540)
![V1.0 1995-September 1997 ,[object Object],[object Object],[object Object],[object Object],This system maxed out at 50,000 active items](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-9-2048.jpg?cb=1666174540)
![V2.0 September 1997- February 1999 ,[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-10-2048.jpg?cb=1666174540)
![V2.1 February 1999-November 1999 ,[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-11-2048.jpg?cb=1666174540)
![V2.3 June 1999-November 1999 ,[object Object],[object Object],However … By November 1999, the database servers approached their limits of physical growth.](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-12-2048.jpg?cb=1666174540)
![V2.4 November 1999-April 2001 ,[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-13-2048.jpg?cb=1666174540)
![V2.5 April 2001 – December 2002 November, 1999 December, 2002 ,[object Object],[object Object],[object Object],Bear Bull](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-14-2048.jpg?cb=1666174540)
![Now that we have the Database taken care of…. ,[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-15-2048.jpg?cb=1666174540)
![V3 – Replace C++/ISAPI with Java 2002-present ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-16-2048.jpg?cb=1666174540)
![Scaling the Data Tier: Overview ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-18-2048.jpg?cb=1666174540)
![Scaling the Data Tier: Functional Segmentation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-19-2048.jpg?cb=1666174540)
![Scaling the Data Tier: Horizontal Split ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-20-2048.jpg?cb=1666174540)
![Scaling the Data Tier: Logical Database Hosts ,[object Object],[object Object],[object Object],DB2 DB3 DB1 Application Servers Attributes Catalogs Rules CATY 1..N User Account Feedback Misc API SCRATCH](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-21-2048.jpg?cb=1666174540)
![Scaling the Data Tier: Minimize DB Resources ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-22-2048.jpg?cb=1666174540)
![Scaling the Data Tier: Minimize DB Transactions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-23-2048.jpg?cb=1666174540)
![Scaling the Application Tier – Overview ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-25-2048.jpg?cb=1666174540)
![Scaling the Application Tier – Massively Scaling J2EE ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-26-2048.jpg?cb=1666174540)
![Scaling the Application Tier – Tiered Application Model BO/BOF AO/AOF (View) Business Logic XML Model Building Logic Command (View) DO/DAO XSL Business Tier Presentation Tier Integration Tier Data Access Layer (DAL) ,[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-27-2048.jpg?cb=1666174540)
![Scaling the Application Tier – Data Access Layer (DAL) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-28-2048.jpg?cb=1666174540)
![Scaling the Application Tier – Vertical Code Partitioning ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Core-Domain PersonalizationDomain LookupDomain UserValidationDomain SharedBillingDomain SharedSearchDomain API Domain SharedBuyingDomain myEbayDomain UserApplication BuyingDomain BillingDomain SearchDomain SellingDomain UserDomain SellingApplication BuyingApplication SearchApplication BillingApplication Applications Shared Domains](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-29-2048.jpg?cb=1666174540)
![Scaling the Application Tier – Functional Segmentation IIS IIS ViewItem Pool http://cgi.ebay.com … … … User Acct Caty20+ Caty1 AppServers … IIS IIS CGI0 CGI5 AS AS AS AS SYI Pool http://cgi5.ebay.com … IIS WebServers Load Balancing Load Balancing Load Balancing ,[object Object],[object Object],[object Object],AS AS](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-30-2048.jpg?cb=1666174540)
![Scaling the Application Tier – Platform Decoupling ,[object Object],[object Object],[object Object],[object Object],[object Object],Transaction Platform Billing Search Fraud EDA EDA SOA](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-31-2048.jpg?cb=1666174540)
![Scaling Search – Overview ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-33-2048.jpg?cb=1666174540)
![Scaling Search – Voyager ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-34-2048.jpg?cb=1666174540)
![Scaling Operations – Code Deployment ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-37-2048.jpg?cb=1666174540)
![Scaling Operations – Monitoring ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-38-2048.jpg?cb=1666174540)
![Recap ,[object Object],[object Object],[object Object],[object Object],[object Object],Maintainability Faster Product Delivery Architecting for the future 10X Growth Availability Reliability Massive Scalability Security](https://image.slidesharecdn.com/amazon-ebayscalability-110515182812-phpapp01/75/the-ebay-architecture-striking-a-balance-between-site-stability-feature-velocity-performance-and-cost-39-2048.jpg?cb=1666174540)
The eBay Architecture: Striking a Balance between Site Stability, Feature Velocity, Performance, and Cost
•24 likes•30,165 views
Report
Share
Download to read offline
eBay architects Randy Shoup and Dan Pritchett give a guided tour of the eBay architecture. They cover the evolution of the technology stack from Perl to C++ to Java. And they discuss scaling strategies for the data tier, application tier, search, and operations.
More Related Content
What's hot
What's hot(20)
Viewers also liked
Viewers also liked(20)
Similar to The eBay Architecture: Striking a Balance between Site Stability, Feature Velocity, Performance, and Cost
Similar to The eBay Architecture: Striking a Balance between Site Stability, Feature Velocity, Performance, and Cost(20)
More from Randy Shoup
More from Randy Shoup(20)
Recently uploaded
Recently uploaded(20)
The eBay Architecture: Striking a Balance between Site Stability, Feature Velocity, Performance, and Cost
- 1. The eBay Architecture Striking a balance between site stability, feature velocity, performance, and cost Presented By: Randy Shoup and Dan Pritchett Date: February 9, 2007 Amazon Friday Learning Series
- 3. Site Statistics: in a typical day … June 1999 Q3 2006 Growth Outbound Emails 1 M 35 M 35x Total Page Views 54 M 1 B 19x Peak Network Utilization 268 Mbps 16 Gbps 59x API Calls 0 100 M N/A Availability ~97% 99.94% 50x 43 mins/day 50 sec/day
- 4. eBay ’s Exponential Growth 212 Million Users 1999 2000 2001 2002 2003 1998 2004 2005 105 Million Listings 2006
- 6. Systemic Requirements Maintainability Faster Product Delivery Enable rapid business innovation Enable seamless growth Deliver quality functionality at accelerating rates Architect for the future 10X Growth Availability Reliability Massive Scalability Security
- 8. Ongoing Platform Evolution … V1 V2.0 V2.4 V3 V2.3 eBay architecture versions Registered Users 212M V4 V2.5
- 17. Scaling the Data Tier
- 24. Scaling the Application Tier
- 32. Scaling Search
- 35. Scaling Search – Voyager
Editor's Notes
- A few more statistics for you. In 1999, eBay was already a giant in the ecommerce space, but things were just really starting to pick up. <CLICK> Now, we are at a tremendous scale. <CLICK> The growth is just amazing. In only 5 years, we have seen 1600% growth in traffic. And because of all of the added functionality of the site, we have seen even higher growth rates in other areas: For instance, hosting pictures was a growing issue for our users. So we added eBay Picture Services. That ’ s one of the reasons that the Network Utilization has grown so quickly. Availability: You might be saying “ It only changed by roughly 3%, that ’ s not a 50x improvement ” You ’ re right, but let ’ s think about what that number really means. First, a loss of availability does not mean that the entire site is unreachable. It means that at least one of our customers might be impacted and unable to search, list, view or buy a product. 97% uptime = 43 minutes (interrupted service) per day. That ’ s a lot, and that ’ s what we were living with in 1999. Today… 99.94% availability = 50 seconds of interrupted service per day Remember that math the next time someone asks you why it ’ s so hard to improve availability. ;-)
- Exponential Growth. Business people just love graphs like that don ’ t they? But for us technologist, exponential growth means something very different. I ’ m trained as a nuclear engineer, so it means something even more interesting to me… But that ’ s what we ’ ve been building for over the last 10 years. The first 5 were pretty easy, we had a small group of collectors using the site to trade within a community of like-minded individuals. But after that, things started to become more challenging. We had people starting to quit their jobs and work full-time selling on eBay, we had businesses using us as a new sales channel, and we had our buyers that had found one of the most diverse sets of products every offered in one place. We needed a little process to make all of the changes that this growing community was asking us to produce.
- This sort of guaranteed delivery makes it possible for the business to reliably plan marketing campaigns and monitor the success of their initiatives. The velocity of code change, while maintaining reliability is unlike anything I had every seen before joining eBay.
- Registered Users: Almost 40,000/day Listings Approximately 100M/quarter or over 1MM/day GMS Approximately $10B/year; $30MMsold/day
- V1 was like any system you or I would build at home
- V2 moved to industry standard technology
- Then we added redundancy at the application tier and a real search engine
- We added redundancy at the database tier and more capacity
- We logically split to the databases and began to move the physical locations as well
- And we could now migrate the databases to separate, less expensive servers, without affecting the running system negatively.
- INTRODUCTION 3 -- Objectives List the specific skills or knowledge attendees should gain from this presentation. Write in terms of what the attendee will be able to do with the information when they leave the session – as opposed to all the features of the product. This is an important distinction. Effective Presentation TIPS The purpose of your presentation should be to provide information that will assist attendees in their work back on the job. This requires that you have some level of understanding of the type of work they do and the information they would need to carry out the job effectively and efficiently. So you should think in terms of what they will be doing back on the job. **see below ** The following is a list of topic categories Support Services, Professional Services, and Sales groups have indicated are critical in performing their jobs: SUPPORT SERVICES – Solution Center Engineers, Field and Support Engineers How to identify appropriate uses for the product The product's relative position within the product family How to recognize & identify the component(s) and sub-component(s) of the product How to install the product How to configure the product How to identify & correct common problems How to identify & correct problems arising from integration with other Sun (or non-Sun) products (continued) But everything wasn ’ t perfect. We were now hitting scaling limits of different types. - code maintenance - code complexity - search
- More than any specific technology, we needed to re-write the application for the realities of today.
- Maybe these all become individual slides?
- Most people don ’ t think of search when they think of eBay, but it ’ s one of the most challenging Information Retrieval projects in the world. We have 6M new items entering and exiting the site every day. And each item is updated on average 5 times during it ’ s lifetime. No off-the-shelf product today can handle the job.
- The architecture of Search is pretty interesting, and not just because I designed it. The system is built to function regardless of failures within the feeding stream, and every part of the system can be scaled horizontally.