Mendeley Suggest: Engineering a Personalised Article Recommender System
Report
Kris JackFollow
Sep. 13, 2012•0 likes•6,260 views
18 likes
Be the first to like this
Show More
views
Total views
0
On Slideshare
0
From embeds
0
Number of embeds
0
Check these out next
Mendeley Suggest: Engineering a Personalised Article Recommender System
Sep. 13, 2012•0 likes•6,260 views
18 likes
Be the first to like this
Show More
views
Total views
0
On Slideshare
0
From embeds
0
Number of embeds
0
Download to read offline
Report
Technology
Business
I gave this presentation at the RecSysChallenge workshop (http://2012.recsyschallenge.com/) at Recommender Systems 2012 (http://recsys.acm.org/2012/) in Dublin on 13 September, 2012. This presentation describes how we have been making use of Mahout to power Mendeley Suggest. First, it includes some results from tuning Mahout's recommender on AWS and the cost vs. precision tradeoff. Then it concludes with details on how to make use of other big data technologies and AWS in order to put a serving layer in place. Acknowledgement to Daniel Jones for making the slides for the serving layer part of the presentation.
Kris JackFollow
Recommended
Cost Optimisation in the AWS Cloud, Ianni Vamvadelis, Solutions Architect, AWSAmazon Web Services
Cloud Economics: Optimising for CostAmazon Web Services
Cost Optimisation with Amazon Web ServicesAmazon Web Services
Le Top 10 des Best Practices pour SQL ServerMicrosoft Technet France
Best Practices for AWS Cloud Cost OptimizationCloudyn
2011 State of the Cloud: A Year's Worth of Innovation in 30 Minutes - Jinesh...Amazon Web Services
Mendeley Suggest: Engineering a Personalised Article Recommender System
- Mendeley Suggest: Engineering a Personalised Article Recommender System Kris Jack, PhD Chief Data Scientist https://twitter.com/_krisjack
- Overview ➔ What's Mendeley? ➔ What's Mendeley Suggest? ➔ Computation Layer ➔ Serving Layer ➔ Architecture ➔ Technologies ➔ Deployment ➔ Conclusions
- What's Mendeley?
- ➔ Mendeley is a platform that connects researchers, research data and apps Mendeley Open API
- ➔ Mendeley is a platform that connects researchers, research data and apps Mendeley Open API ➔ Startup company with ~20 R&D engineers
- What's Mendeley Suggest?
- Use Case ➔ Good researchers are on top of their game ➔ Difficult with the amount being produced ➔ There must be a technology that can help ➔ Help researchers by recommending relevant research
- Mendeley Suggest
- Computation Layer
- Mendeley Suggest
- Mendeley Suggest
- Mendeley Suggest
- Running on Amazon's Elastic Map Reduce On demand use and easy to cost
- Computation Layer 1.5M Users, 50M Articles Mahout's Normalised Amazon Hours Performance No. Good Recommendations/10
- Computation Layer 1.5M Users, 50M Articles Mahout's Costly & Bad Normalised Amazon Hours Performance Costly & Good Cheap & Bad No. Good Recommendations/10 Cheap & Good
- Computation Layer 1.5M Users, 50M Articles Mahout's Costly & Bad Normalised Amazon Hours Performance Costly & Good Cheap & Bad No. Good Recommendations/10 Cheap & Good
- Computation Layer 1.5M Users, 50M Articles Mahout's Costly & Bad Normalised Amazon Hours Performance Costly & Good Cheap & Bad No. Good Recommendations/10 Cheap & Good
- Computation Layer 1.5M Users, 50M Articles Mahout's Costly & Bad Performance Costly & Good 7K Normalised Amazon Hours 6K 5K 4K 3K 2K 1K 0 0.5 10 1.5 2 2.5 3 Cheap & Bad No. Good Recommendations/10 Cheap & Good
- Computation Layer 1.5M Users, 50M Articles Mahout's Costly & Bad Performance Costly & Good 7K 6.5K, 1.5 Normalised Amazon Hours 6K Orig. item-based 5K 4K 3K 2K 1K 0 0.5 10 1.5 2 2.5 3 Cheap & Bad No. Good Recommendations/10 Cheap & Good
- Computation Layer 1.5M Users, 50M Articles Mahout's Costly & Bad Performance Costly & Good 7K 6.5K, 1.5 Normalised Amazon Hours 6K Orig. item-based 5K 4K 3K Cust. item-based ➔ 2.4K, 1.5 2K 1K 0 0.5 10 1.5 2 2.5 3 Cheap & Bad No. Good Recommendations/10 Cheap & Good
- Computation Layer 1.5M Users, 50M Articles Mahout's Costly & Bad Performance Costly & Good 7K 6.5K, 1.5 Normalised Amazon Hours 6K Orig. item-based 5K -4.1K (63%) 4K Paritioners MR allocation 3K Cust. item-based ➔ 2.4K, 1.5 2K 1K 0 0.5 10 1.5 2 2.5 3 Cheap & Bad No. Good Recommendations/10 Cheap & Good
- Computation Layer 1.5M Users, 50M Articles Mahout's Costly & Bad Performance Costly & Good 7K 6.5K, 1.5 Normalised Amazon Hours 6K Orig. item-based 5K 4K 3K Cust. item-based ➔ 2.4K, 1.5 2K 1K 0 0.5 10 1.5 2 2.5 3 Cheap & Bad No. Good Recommendations/10 Cheap & Good
- Computation Layer 1.5M Users, 50M Articles Mahout's Costly & Bad Performance Costly & Good 7K 6.5K, 1.5 Normalised Amazon Hours 6K Orig. item-based 5K 4K 3K Cust. item-based ➔ 2.4K, 1.5 2K Orig. user-based 1K ➔ 1K, 2.5 0 0.5 10 1.5 2 2.5 3 Cheap & Bad No. Good Recommendations/10 Cheap & Good
- Computation Layer 1.5M Users, 50M Articles Mahout's Costly & Bad Performance Costly & Good 7K 6.5K, 1.5 Normalised Amazon Hours 6K Orig. item-based 5K 4K 3K Cust. item-based +1 (67%) ➔ 2.4K, 1.5 2K -1.4K Orig. user-based (58%) 1K ➔ 1K, 2.5 0 0.5 10 1.5 2 2.5 3 Cheap & Bad No. Good Recommendations/10 Cheap & Good
- Computation Layer 1.5M Users, 50M Articles Mahout's Costly & Bad Performance Costly & Good 7K 6.5K, 1.5 Normalised Amazon Hours 6K Orig. item-based 5K 4K 3K Cust. item-based ➔ 2.4K, 1.5 2K Orig. user-based 1K ➔ 1K, 2.5 Cust. user-based ➔ 0.3K, 2.5 0 0.5 10 1.5 2 2.5 3 Cheap & Bad No. Good Recommendations/10 Cheap & Good
- Computation Layer 1.5M Users, 50M Articles Mahout's Costly & Bad Performance Costly & Good 7K 6.5K, 1.5 Normalised Amazon Hours 6K Orig. item-based 5K -4.1K (63%) 4K 3K Cust. item-based ➔ 2.4K, 1.5 2K Orig. user-based 1K 1K, 2.5 ➔ -0.7K Cust. user-based (70%) ➔0.3K, 2.5 0 0.5 10 1.5 2 2.5 3 Cheap & Bad No. Good Recommendations/10 Cheap & Good
- Computation Layer 1.5M Users, 50M Articles Mahout's Costly & Bad Performance Costly & Good 7K +1 (67%) 6.5K, 1.5 Normalised Amazon Hours 6K Orig. item-based 5K 4K -6.2K (95%) 3K Cust. item-based ➔ 2.4K, 1.5 2K Orig. user-based 1K ➔ 1K, 2.5 Cust. user-based ➔ 0.3K, 2.5 0 0.5 10 1.5 2 2.5 3 Cheap & Bad No. Good Recommendations/10 Cheap & Good
- Mahout as the Computation Layer ➔ Out of the box, didn't work so well for us ➔ Needed to understand Hadoop better ➔ Contributed patch back to community (user-user) ➔ Next step, the serving layer...
- Serving Layer
- Architecture Mendeley Hadoop Cluster User Cascading Libraries Computation Layer
- Architecture AWS Elastic Elastic Beanstalk DynamoDB Elastic Beanstalk Beanstalk Serving Layer Mendeley Hadoop Cluster User Map Reduce Libraries Computation Layer
- Technologies ➔ Spring dependency injection framework ➔ Context-wide integration testing is easy, including pre-loading of test data ➔ Allows other Spring features (cache, security, messaging) ➔ Spring MVC 3.2.M1 ➔ Annotated controllers, type conversion 'for free' ➔ Asynchronous Servlet 3.0 supports thread 'parking' ➔ AlternatorDB ➔ In-memory DynamoDB implementation for testing
- Technologies Recommendation<K> LongRecommendation UuidRecommendation GroupRecommendation PersonRecommendation DocumentRecommendation ➔ Build once, employ in several use cases
- Deployment ➔ AWS ElasticBeanstalk ➔ Managed, auto-scaling, health-checking .war container ➔ Jenkins continuous integration (CI) server ➔ Maven build tool (useful dependency management) ➔ beanstalk-maven-plugin (push a button to deploy) ➔ Deploys to ElasticBeanstalk ➔ Replaces existing application version if required ➔ 'Zero downtime' updates (tested at ~300ms) ➔ Triggered by Jenkins
- Putting it all together... $$$ ➔ Real-time article recommendations for 2 million users ➔ 20 requests per second ➔ $65.84/month ➔ $34.24 ElasticBeanstalk ➔ $28.17 DynamoDB ➔ $2.76 bandwidth ➔ $30 to update the computation layer periodically
- Conclusions
- Conclusions ➔ Mendeley Suggest is a personalised article recommender ➔ Built by small team for big data ➔ Uses Mahout as computation layer ➔ Needs some love out of the box ➔ Serves from AWS ➔ Reduces maintenance costs and is reliable ➔ Intend to release Mendeley Suggest to all users this year
- We're Hiring! ➔ Data Scientist ➔ apply recommender technologies to Mendeley's data ➔ work on improving the quality of Mendeley's research catalogue ➔ starting in first quarter of 2013 ➔ 6 month secondment in KNOW Center, TU Graz, Austria as part of the EC FP7 TEAM project (http://team-project.tugraz.at/) ➔ http://www.mendeley.com/careers/
- www.mendeley.com