Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
No, we’re not a travel agency<br />www.tripadvisor.com/careers<br />
Postgres at TripAdvisor<br />By<br />Don O’Neill & Boris Partensky<br />2<br />© 2011 TripAdvisor LLC All rights reserved....
TripAdvisor is the world’s largesttravel site<br />3<br />© 2011 TripAdvisor LLC All rights reserved.<br />
4<br />40M<br />monthly visitors<br />4M<br />visitors/day<br />20+M registered members<br />45+M<br />reviews & opinions<...
Business runs on Postgres<br />Large Mission critical deployment<br />Combination of 8.3 and 8.4<br />Site Technologies in...
33 Postgres Servers across 3 Data Centers<br />Not including Dev and QA servers<br />SSD’s instead of Spinning disks for s...
All Servers configured as Active/Passive Cluster<br />Not using Shared Disks or SAN’s<br />DRBD for Block level replicatio...
Replication based on DBmirror<br />Like Slonyonly deprecated <br />Community project once part of the core distribution<br...
20 TB Data Warehouse today<br />Expecting to grow significantly in 12 months<br />16 Node cluster expanding to 24<br />Bas...
Q&A<br />Questions?<br />Did I mention we’re hiring?<br />10<br />© 2011 TripAdvisor LLC All rights reserved.<br />
Upcoming SlideShare
Loading in …5
×

Postgres Sql at TripAdvisor

3,353 views

Published on

Slide Deck from my recent talk at the first New England PostgreSQL User group meeting.

Published in: Technology

Postgres Sql at TripAdvisor

  1. 1. No, we’re not a travel agency<br />www.tripadvisor.com/careers<br />
  2. 2. Postgres at TripAdvisor<br />By<br />Don O’Neill & Boris Partensky<br />2<br />© 2011 TripAdvisor LLC All rights reserved.<br />
  3. 3. TripAdvisor is the world’s largesttravel site<br />3<br />© 2011 TripAdvisor LLC All rights reserved.<br />
  4. 4. 4<br />40M<br />monthly visitors<br />4M<br />visitors/day<br />20+M registered members<br />45+M<br />reviews & opinions<br />© 2011 TripAdvisor LLC All rights reserved.<br />
  5. 5. Business runs on Postgres<br />Large Mission critical deployment<br />Combination of 8.3 and 8.4<br />Site Technologies include<br />Linux (CentOS), Apache<br />Java, Tomcat, Velocity, and Memcached<br />No commercial Software – All Open Source<br />Web Scale Deployment<br />Over 100 Frontend and Backend servers per Data Center<br />14 Postgres Database Servers per Data Center<br />DR Data Center with Replication between the two<br />Platform<br />5<br />© 2011 TripAdvisor LLC All rights reserved.<br />
  6. 6. 33 Postgres Servers across 3 Data Centers<br />Not including Dev and QA servers<br />SSD’s instead of Spinning disks for select servers<br />Multiple Read Only DB Servers <br />Load Balanced using BigIP<br />Sync’d using DB Mirror replication<br />Just under 1 TB of data in multiple databases<br />Sharded Pin Table <br />Over 1.5 billion rows<br />Sharded to improve read and write performance <br />Spread over 12 databases on 2 Servers<br />Scale out to multiple servers as needed<br />Routing logic built into our application layer<br />By the Numbers<br />6<br />© 2011 TripAdvisor LLC All rights reserved.<br />
  7. 7. All Servers configured as Active/Passive Cluster<br />Not using Shared Disks or SAN’s<br />DRBD for Block level replication between systems<br />Heartbeat for automatic failover between nodes<br />Data Replicated to DR Site<br />TripAdvisor has 2 Data centers (MA and VA)<br />One site “Live” at a time<br />Equal capacity at both sites<br />Routinely switch between sites<br />Data Replicated between data centers<br />Redundancy/Failover<br />7<br />© 2011 TripAdvisor LLC All rights reserved.<br />
  8. 8. Replication based on DBmirror<br />Like Slonyonly deprecated <br />Community project once part of the core distribution<br />Trigger based Master/Slave Replication<br />Written in C and Perl<br />All replicated tables must have primary keys<br />TripAdvisor Updates include<br />A Rewrite in Java!<br />Support for SQL Server<br />Lots of Hardening for large scale use<br />Replication<br />8<br />© 2011 TripAdvisor LLC All rights reserved.<br />
  9. 9. 20 TB Data Warehouse today<br />Expecting to grow significantly in 12 months<br />16 Node cluster expanding to 24<br />Based on Hadoop and Hive<br />Reporting and Cubes built with SQL Server<br />End users access the data via Excel and Reporting Services<br />Critical for the growth of the business<br />Long term data storage in Hadoop and not our SAN!<br />Mobile Applications<br />Award winning travel application<br />Supported in iPhone, iPad, Android, Nokia, Windows, Palm<br />http://www.tripadvisor.com/MobileApps<br />Facebook Integration<br />More and more users logging in via Facebook<br />Better social experience on the site<br />Major Initiatives<br />9<br />© 2011 TripAdvisor LLC All rights reserved.<br />
  10. 10. Q&A<br />Questions?<br />Did I mention we’re hiring?<br />10<br />© 2011 TripAdvisor LLC All rights reserved.<br />

×