No, we’re not a travel agency<br />www.tripadvisor.com/careers<br />
Postgres at TripAdvisor<br />By<br />Don O’Neill & Boris Partensky<br />2<br />© 2011 TripAdvisor LLC All rights reserved....
TripAdvisor is the world’s largesttravel site<br />3<br />© 2011 TripAdvisor LLC All rights reserved.<br />
4<br />40M<br />monthly visitors<br />4M<br />visitors/day<br />20+M registered members<br />45+M<br />reviews & opinions<...
Business runs on Postgres<br />Large Mission critical deployment<br />Combination of 8.3 and 8.4<br />Site Technologies in...
33 Postgres Servers across 3 Data Centers<br />Not including Dev and QA servers<br />SSD’s instead of Spinning disks for s...
All Servers configured as Active/Passive Cluster<br />Not using Shared Disks or SAN’s<br />DRBD for Block level replicatio...
Replication based on DBmirror<br />Like Slonyonly deprecated <br />Community project once part of the core distribution<br...
20 TB Data Warehouse today<br />Expecting to grow significantly in 12 months<br />16 Node cluster expanding to 24<br />Bas...
Q&A<br />Questions?<br />Did I mention we’re hiring?<br />10<br />© 2011 TripAdvisor LLC All rights reserved.<br />
Upcoming SlideShare
Loading in...5
×

Postgres Sql at TripAdvisor

2,802

Published on

Slide Deck from my recent talk at the first New England PostgreSQL User group meeting.

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
2,802
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
0
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Transcript of "Postgres Sql at TripAdvisor"

  1. 1. No, we’re not a travel agency<br />www.tripadvisor.com/careers<br />
  2. 2. Postgres at TripAdvisor<br />By<br />Don O’Neill & Boris Partensky<br />2<br />© 2011 TripAdvisor LLC All rights reserved.<br />
  3. 3. TripAdvisor is the world’s largesttravel site<br />3<br />© 2011 TripAdvisor LLC All rights reserved.<br />
  4. 4. 4<br />40M<br />monthly visitors<br />4M<br />visitors/day<br />20+M registered members<br />45+M<br />reviews & opinions<br />© 2011 TripAdvisor LLC All rights reserved.<br />
  5. 5. Business runs on Postgres<br />Large Mission critical deployment<br />Combination of 8.3 and 8.4<br />Site Technologies include<br />Linux (CentOS), Apache<br />Java, Tomcat, Velocity, and Memcached<br />No commercial Software – All Open Source<br />Web Scale Deployment<br />Over 100 Frontend and Backend servers per Data Center<br />14 Postgres Database Servers per Data Center<br />DR Data Center with Replication between the two<br />Platform<br />5<br />© 2011 TripAdvisor LLC All rights reserved.<br />
  6. 6. 33 Postgres Servers across 3 Data Centers<br />Not including Dev and QA servers<br />SSD’s instead of Spinning disks for select servers<br />Multiple Read Only DB Servers <br />Load Balanced using BigIP<br />Sync’d using DB Mirror replication<br />Just under 1 TB of data in multiple databases<br />Sharded Pin Table <br />Over 1.5 billion rows<br />Sharded to improve read and write performance <br />Spread over 12 databases on 2 Servers<br />Scale out to multiple servers as needed<br />Routing logic built into our application layer<br />By the Numbers<br />6<br />© 2011 TripAdvisor LLC All rights reserved.<br />
  7. 7. All Servers configured as Active/Passive Cluster<br />Not using Shared Disks or SAN’s<br />DRBD for Block level replication between systems<br />Heartbeat for automatic failover between nodes<br />Data Replicated to DR Site<br />TripAdvisor has 2 Data centers (MA and VA)<br />One site “Live” at a time<br />Equal capacity at both sites<br />Routinely switch between sites<br />Data Replicated between data centers<br />Redundancy/Failover<br />7<br />© 2011 TripAdvisor LLC All rights reserved.<br />
  8. 8. Replication based on DBmirror<br />Like Slonyonly deprecated <br />Community project once part of the core distribution<br />Trigger based Master/Slave Replication<br />Written in C and Perl<br />All replicated tables must have primary keys<br />TripAdvisor Updates include<br />A Rewrite in Java!<br />Support for SQL Server<br />Lots of Hardening for large scale use<br />Replication<br />8<br />© 2011 TripAdvisor LLC All rights reserved.<br />
  9. 9. 20 TB Data Warehouse today<br />Expecting to grow significantly in 12 months<br />16 Node cluster expanding to 24<br />Based on Hadoop and Hive<br />Reporting and Cubes built with SQL Server<br />End users access the data via Excel and Reporting Services<br />Critical for the growth of the business<br />Long term data storage in Hadoop and not our SAN!<br />Mobile Applications<br />Award winning travel application<br />Supported in iPhone, iPad, Android, Nokia, Windows, Palm<br />http://www.tripadvisor.com/MobileApps<br />Facebook Integration<br />More and more users logging in via Facebook<br />Better social experience on the site<br />Major Initiatives<br />9<br />© 2011 TripAdvisor LLC All rights reserved.<br />
  10. 10. Q&A<br />Questions?<br />Did I mention we’re hiring?<br />10<br />© 2011 TripAdvisor LLC All rights reserved.<br />

×