Propel to the Cloud with Open Source<br />or “How we re-engineered a social network” <br />by Gene Leybzon,  CTO, Trusted ...
Trusted Opinion Social Recommendation Network<br />2<br />Propel to the cloud by Gene Leybzon<br />
Trusted Opinion in Numbers<br />Over Million users<br />Over 100 Countries<br />Over 1.5 Million Bars and Restaurants with...
“Legacy” architecture<br />4<br />Propel to the cloud by Gene Leybzon<br />
How  J2EE architecture  became  a liability instead  of an asset<br />Business needs:<br />Almost “on-the fly” code change...
“Legacy” hosting<br />6<br />Propel to the cloud by Gene Leybzon<br />
Scalability and Performance  Problems<br />Too much work performed in Database (store procedures did a lot of math on the ...
Other Pain Points<br />Managing offshore development team<br />Significantof effort in system/database administration<br /...
Solution<br />Complete re-architecture from the top-to-bottom and from the bottom-up <br />Update to current Snapshot of t...
Wish list that became the Plan<br />Use latest and greatest technologies<br />Open source, and open source only!<br />Scal...
Why Cloud?<br />Scalability on demand <br />Dynamic load <br />Ease deployment/keeping configuration<br />Simplify IT<br /...
Why Amazon?<br />EC2<br />Cloud Front<br />MapReduce<br />Load balancer<br />Performance monitoring<br />12<br />Propel to...
Job Ahead<br />#lines of Java code<br />Migrating to the new database and with completely different database schema<br />A...
Challenges<br />Where to find right and motivated developers?<br />Where to rent the office <br />How to create a quality ...
Lessons<br />People first<br />Happy developers write good code<br />In-house recruiting<br />Focus on the core, borrow th...
New Architecture<br />16<br />Propel to the cloud presentation by Gene Leybzon<br />
New Database Architecture<br />17<br />Propel to the cloud by Gene Leybzon<br />
Analyzing log data<br />18<br />Propel to the cloud by Gene Leybzon<br />
Semantic Web and RDF<br />Used at Trusted Opinion to store information about Movies and Restaurants <br />Data stored acro...
You can do it too!<br />“Just do itRight”<br />“Right” developers (treat them with respect!)<br />“Right” technology (keep...
Upcoming SlideShare
Loading in …5
×

Propel to the cloud with open source

1,308 views

Published on

Trusted Opinion CTO shares the experience in re-engineering of a social network.

Major parts of the presentation:
- lessons learned during the re-engirding process
- open source frameworks used to implement a highly scalable web applications
- system architecture solutions used 5 years ago and today

Published in: Technology, Education
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,308
On SlideShare
0
From Embeds
0
Number of Embeds
26
Actions
Shares
0
Downloads
9
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Propel to the cloud with open source

  1. 1. Propel to the Cloud with Open Source<br />or “How we re-engineered a social network” <br />by Gene Leybzon, CTO, Trusted Opinion, Inc<br />
  2. 2. Trusted Opinion Social Recommendation Network<br />2<br />Propel to the cloud by Gene Leybzon<br />
  3. 3. Trusted Opinion in Numbers<br />Over Million users<br />Over 100 Countries<br />Over 1.5 Million Bars and Restaurants with reviews<br />Over 100,000 emails sent daily<br />3<br />Propel to the cloud by Gene Leybzon<br />
  4. 4. “Legacy” architecture<br />4<br />Propel to the cloud by Gene Leybzon<br />
  5. 5. How J2EE architecture became a liability instead of an asset<br />Business needs:<br />Almost “on-the fly” code changes with immediate deployments (daily releases)<br />Extreme scalability<br />Constant tuning based on A/B testing<br />Can not afford expensive DB licensing fee<br />Parallelism in code development with no bottlenecks in the develop-test-release cycles <br />5<br />Propel to the cloud by Gene Leybzon<br />
  6. 6. “Legacy” hosting<br />6<br />Propel to the cloud by Gene Leybzon<br />
  7. 7. Scalability and Performance Problems<br />Too much work performed in Database (store procedures did a lot of math on the data)<br />Way too expensive to go to database cluster while a single server (even 16 core) has it’s limits too<br />Overhead of J2EE+templates (slow performance)<br />7<br />Propel to the cloud by Gene Leybzon<br />
  8. 8. Other Pain Points<br />Managing offshore development team<br />Significantof effort in system/database administration<br />Too slow to implementchanges<br />Hard to implement detail user behavior analytics<br />Time to be multilingual and integrate with CDN to support international customers<br />8<br />Propel to the cloud by Gene Leybzon<br />
  9. 9. Solution<br />Complete re-architecture from the top-to-bottom and from the bottom-up <br />Update to current Snapshot of the best technologies<br />9<br />Propel to the cloud by Gene Leybzon<br />
  10. 10. Wish list that became the Plan<br />Use latest and greatest technologies<br />Open source, and open source only!<br />Scalability on demand<br />Local team for core software development<br />Best analytics with customized A/B testing framework<br />Good performance and with even better performance perception<br />10<br />Propel to the cloud by Gene Leybzon<br />
  11. 11. Why Cloud?<br />Scalability on demand <br />Dynamic load <br />Ease deployment/keeping configuration<br />Simplify IT<br />Cool factor<br />11<br />Propel to the cloud by Gene Leybzon<br />
  12. 12. Why Amazon?<br />EC2<br />Cloud Front<br />MapReduce<br />Load balancer<br />Performance monitoring<br />12<br />Propel to the cloud by Gene Leybzon<br />
  13. 13. Job Ahead<br />#lines of Java code<br />Migrating to the new database and with completely different database schema<br />Add language support (20 core languages)<br />Add on-demand image uploading to CDN and serving all static content from the CDN<br />13<br />Propel to the cloud by Gene Leybzon<br />
  14. 14. Challenges<br />Where to find right and motivated developers?<br />Where to rent the office <br />How to create a quality code development culture<br />How to have fun along the way<br />14<br />Propel to the cloud by Gene Leybzon<br />
  15. 15. Lessons<br />People first<br />Happy developers write good code<br />In-house recruiting<br />Focus on the core, borrow the rest<br />15<br />Propel to the cloud by Gene Leybzon<br />
  16. 16. New Architecture<br />16<br />Propel to the cloud presentation by Gene Leybzon<br />
  17. 17. New Database Architecture<br />17<br />Propel to the cloud by Gene Leybzon<br />
  18. 18. Analyzing log data<br />18<br />Propel to the cloud by Gene Leybzon<br />
  19. 19. Semantic Web and RDF<br />Used at Trusted Opinion to store information about Movies and Restaurants <br />Data stored across all items as “triplets”<br />Allows structured and semi-structured data to be mixed, exposed, and shared across different applications <br />Took a lot of load from relational DB<br />Easy to add new item categories<br />19<br />Propel to the cloud by Gene Leybzon<br />
  20. 20. You can do it too!<br />“Just do itRight”<br />“Right” developers (treat them with respect!)<br />“Right” technology (keep an eye on technology trends, use it fresh but ready)<br />“Right” design (NO new frameworks, focus on the product, not a framework)<br />“Right” management team<br />20<br />Propel to the cloud by Gene Leybzon<br />

×