Your SlideShare is downloading. ×
0
Propel to the cloud with open source
Propel to the cloud with open source
Propel to the cloud with open source
Propel to the cloud with open source
Propel to the cloud with open source
Propel to the cloud with open source
Propel to the cloud with open source
Propel to the cloud with open source
Propel to the cloud with open source
Propel to the cloud with open source
Propel to the cloud with open source
Propel to the cloud with open source
Propel to the cloud with open source
Propel to the cloud with open source
Propel to the cloud with open source
Propel to the cloud with open source
Propel to the cloud with open source
Propel to the cloud with open source
Propel to the cloud with open source
Propel to the cloud with open source
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Propel to the cloud with open source

1,153

Published on

Trusted Opinion CTO shares the experience in re-engineering of a social network. …

Trusted Opinion CTO shares the experience in re-engineering of a social network.

Major parts of the presentation:
- lessons learned during the re-engirding process
- open source frameworks used to implement a highly scalable web applications
- system architecture solutions used 5 years ago and today

Published in: Technology, Education
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,153
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
9
Comments
0
Likes
1
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Propel to the Cloud with Open Source<br />or “How we re-engineered a social network” <br />by Gene Leybzon, CTO, Trusted Opinion, Inc<br />
  • 2. Trusted Opinion Social Recommendation Network<br />2<br />Propel to the cloud by Gene Leybzon<br />
  • 3. Trusted Opinion in Numbers<br />Over Million users<br />Over 100 Countries<br />Over 1.5 Million Bars and Restaurants with reviews<br />Over 100,000 emails sent daily<br />3<br />Propel to the cloud by Gene Leybzon<br />
  • 4. “Legacy” architecture<br />4<br />Propel to the cloud by Gene Leybzon<br />
  • 5. How J2EE architecture became a liability instead of an asset<br />Business needs:<br />Almost “on-the fly” code changes with immediate deployments (daily releases)<br />Extreme scalability<br />Constant tuning based on A/B testing<br />Can not afford expensive DB licensing fee<br />Parallelism in code development with no bottlenecks in the develop-test-release cycles <br />5<br />Propel to the cloud by Gene Leybzon<br />
  • 6. “Legacy” hosting<br />6<br />Propel to the cloud by Gene Leybzon<br />
  • 7. Scalability and Performance Problems<br />Too much work performed in Database (store procedures did a lot of math on the data)<br />Way too expensive to go to database cluster while a single server (even 16 core) has it’s limits too<br />Overhead of J2EE+templates (slow performance)<br />7<br />Propel to the cloud by Gene Leybzon<br />
  • 8. Other Pain Points<br />Managing offshore development team<br />Significantof effort in system/database administration<br />Too slow to implementchanges<br />Hard to implement detail user behavior analytics<br />Time to be multilingual and integrate with CDN to support international customers<br />8<br />Propel to the cloud by Gene Leybzon<br />
  • 9. Solution<br />Complete re-architecture from the top-to-bottom and from the bottom-up <br />Update to current Snapshot of the best technologies<br />9<br />Propel to the cloud by Gene Leybzon<br />
  • 10. Wish list that became the Plan<br />Use latest and greatest technologies<br />Open source, and open source only!<br />Scalability on demand<br />Local team for core software development<br />Best analytics with customized A/B testing framework<br />Good performance and with even better performance perception<br />10<br />Propel to the cloud by Gene Leybzon<br />
  • 11. Why Cloud?<br />Scalability on demand <br />Dynamic load <br />Ease deployment/keeping configuration<br />Simplify IT<br />Cool factor<br />11<br />Propel to the cloud by Gene Leybzon<br />
  • 12. Why Amazon?<br />EC2<br />Cloud Front<br />MapReduce<br />Load balancer<br />Performance monitoring<br />12<br />Propel to the cloud by Gene Leybzon<br />
  • 13. Job Ahead<br />#lines of Java code<br />Migrating to the new database and with completely different database schema<br />Add language support (20 core languages)<br />Add on-demand image uploading to CDN and serving all static content from the CDN<br />13<br />Propel to the cloud by Gene Leybzon<br />
  • 14. Challenges<br />Where to find right and motivated developers?<br />Where to rent the office <br />How to create a quality code development culture<br />How to have fun along the way<br />14<br />Propel to the cloud by Gene Leybzon<br />
  • 15. Lessons<br />People first<br />Happy developers write good code<br />In-house recruiting<br />Focus on the core, borrow the rest<br />15<br />Propel to the cloud by Gene Leybzon<br />
  • 16. New Architecture<br />16<br />Propel to the cloud presentation by Gene Leybzon<br />
  • 17. New Database Architecture<br />17<br />Propel to the cloud by Gene Leybzon<br />
  • 18. Analyzing log data<br />18<br />Propel to the cloud by Gene Leybzon<br />
  • 19. Semantic Web and RDF<br />Used at Trusted Opinion to store information about Movies and Restaurants <br />Data stored across all items as “triplets”<br />Allows structured and semi-structured data to be mixed, exposed, and shared across different applications <br />Took a lot of load from relational DB<br />Easy to add new item categories<br />19<br />Propel to the cloud by Gene Leybzon<br />
  • 20. You can do it too!<br />“Just do itRight”<br />“Right” developers (treat them with respect!)<br />“Right” technology (keep an eye on technology trends, use it fresh but ready)<br />“Right” design (NO new frameworks, focus on the product, not a framework)<br />“Right” management team<br />20<br />Propel to the cloud by Gene Leybzon<br />

×