SlideShare a Scribd company logo
JOBANDTALENT AT
RECSYS CHALLENGE 2016
RECSYS CHALLENGE 2016
LEARNING TO RANK IN RECSYS 2016
▸ Learning to Rank Framework
▸ Listwise, Pairwise, Pointwise
▸ Relevance Judgements
▸ Training & Evaluation dataset
▸ LambdaMART
▸ Gradient tree boosting & NDCG loss function
RECSYS CHALLENGE 2016
DATA EXPLORATION
▸ Understanding data.
▸ Probability of Item being interacted "Popularity".
▸ Probability of Item being interacted by his terms titles
▸ Probability of recurring interactions.
▸ Probability of a user interacting Items and geographical
distance
RECSYS CHALLENGE 2016
RETRIEVERS
▸ Job title/Job tag match
▸ Relevant items per interaction
▸ Interactions made by user
▸ Impressions shown to user
▸ Collaborative filtering, Item to Item/User to User
▸ Clustered users.
RECSYS CHALLENGE 2016
COLLECTORS
▸ Freshness.
▸ Item popularity.
▸ User behavior.
RECSYS CHALLENGE 2016
LEARNING PROCESS
▸ Speed up the training process.
▸ Reducing the number of features applied.
▸ Reducing the number of elements used to train.
▸ Internal evaluation.
▸ NDCG@30 metric.
RECSYS CHALLENGE 2016
RESULTS & CONCLUSIONS
Run Internal Official Improved
Baseline 22849 30721
Baseline BM25 (b=0.2 / k1=1.2) 23591 36857 20 %
Interactions made by the user 162846 229949 523 %
Training process 176312 241422 5 %
Impressions with decay 400217 434433 79,94 %
Item popularity 435325 475940 10 %
Clustering 442049 488192 3 %
Collaborative filtering 457391 507022 4 %
Best effort @ 2000 480396 533232 5 %
Best effort @ 9000 482083 535899 1 %
SEE YOU THE NEXT YEAR!

More Related Content

Similar to Jobandtalent at recsys challenge 2016

Dataset creation best practices
Dataset creation best practicesDataset creation best practices
Dataset creation best practices
Sravya Tirukkovalur
 
The Cost of Microservices
The Cost of MicroservicesThe Cost of Microservices
The Cost of Microservices
Michael Nadel
 
The Value of Explicit Schema for Graph Use Cases
The Value of Explicit Schema for Graph Use CasesThe Value of Explicit Schema for Graph Use Cases
The Value of Explicit Schema for Graph Use Cases
InfiniteGraph
 
Designing an Effective Content Measurement Strategy
Designing an Effective Content Measurement StrategyDesigning an Effective Content Measurement Strategy
Designing an Effective Content Measurement Strategy
Michael Powers
 
Building Teams at Scale - MaGIC Academy Symposium 2017
Building Teams at Scale - MaGIC Academy Symposium 2017Building Teams at Scale - MaGIC Academy Symposium 2017
Building Teams at Scale - MaGIC Academy Symposium 2017
Larry Gordon
 
The Art and Science of Testing - Setting Scalable Optimisation Practices for ...
The Art and Science of Testing - Setting Scalable Optimisation Practices for ...The Art and Science of Testing - Setting Scalable Optimisation Practices for ...
The Art and Science of Testing - Setting Scalable Optimisation Practices for ...
Bench
 
Christina Silver Mindsets in qualitative analysis. opening to digital tools d...
Christina Silver Mindsets in qualitative analysis. opening to digital tools d...Christina Silver Mindsets in qualitative analysis. opening to digital tools d...
Christina Silver Mindsets in qualitative analysis. opening to digital tools d...
Christina Silver
 
Easy Analytics on AWS with Amazon Redshift, Amazon QuickSight, and Amazon Mac...
Easy Analytics on AWS with Amazon Redshift, Amazon QuickSight, and Amazon Mac...Easy Analytics on AWS with Amazon Redshift, Amazon QuickSight, and Amazon Mac...
Easy Analytics on AWS with Amazon Redshift, Amazon QuickSight, and Amazon Mac...
Amazon Web Services
 
Dataiku at SF DataMining Meetup - Kaggle Yandex Challenge
Dataiku at SF DataMining Meetup - Kaggle Yandex ChallengeDataiku at SF DataMining Meetup - Kaggle Yandex Challenge
Dataiku at SF DataMining Meetup - Kaggle Yandex Challenge
Dataiku
 
Madhu Raman - Contextual Lens: Driving Innovation with Consumer Interaction Data
Madhu Raman - Contextual Lens: Driving Innovation with Consumer Interaction DataMadhu Raman - Contextual Lens: Driving Innovation with Consumer Interaction Data
Madhu Raman - Contextual Lens: Driving Innovation with Consumer Interaction Data
Julia Grosman
 
BPM Cluster Meeting 2018
BPM Cluster Meeting 2018BPM Cluster Meeting 2018
BPM Cluster Meeting 2018
Jan Claes
 
Creating a Product Roadmap - Product Strategy Series
Creating a Product Roadmap - Product Strategy SeriesCreating a Product Roadmap - Product Strategy Series
Creating a Product Roadmap - Product Strategy Series
Mike Biggs GAICD
 
COOs and Rapid Business Adaptation
COOs and Rapid Business AdaptationCOOs and Rapid Business Adaptation
COOs and Rapid Business Adaptation
Malcolm Ryder
 
Ready, set, go! - Anna Royzman
Ready, set, go! - Anna RoyzmanReady, set, go! - Anna Royzman
Ready, set, go! - Anna Royzman
QA or the Highway
 
An Introduction to AAARRRP: A framework for Defining Your Developer Relations...
An Introduction to AAARRRP: A framework for Defining Your Developer Relations...An Introduction to AAARRRP: A framework for Defining Your Developer Relations...
An Introduction to AAARRRP: A framework for Defining Your Developer Relations...
Phil Leggetter
 
Google Think Mobile Event - Mobile Strategy
Google Think Mobile Event - Mobile Strategy Google Think Mobile Event - Mobile Strategy
Google Think Mobile Event - Mobile Strategy
Namics – A Merkle Company
 
Mobile Strategy @ Google Think Mobile - Namics-Vortrag
Mobile Strategy @ Google Think Mobile - Namics-VortragMobile Strategy @ Google Think Mobile - Namics-Vortrag
Mobile Strategy @ Google Think Mobile - Namics-Vortrag
Michael Rottmann
 
Impact-Driven Scrum Delivery at Scrum gathering Phoenix 2015
Impact-Driven Scrum Delivery at Scrum gathering Phoenix 2015Impact-Driven Scrum Delivery at Scrum gathering Phoenix 2015
Impact-Driven Scrum Delivery at Scrum gathering Phoenix 2015
inUse
 
Impact-driven Scrum Delivery at Scrum gathering Phoenix 2015
Impact-driven Scrum Delivery at Scrum gathering Phoenix 2015Impact-driven Scrum Delivery at Scrum gathering Phoenix 2015
Impact-driven Scrum Delivery at Scrum gathering Phoenix 2015
Sara Lerén
 
Microsoft Project Syllabus
Microsoft Project SyllabusMicrosoft Project Syllabus
Microsoft Project Syllabus
harshraj gajarlawar
 

Similar to Jobandtalent at recsys challenge 2016 (20)

Dataset creation best practices
Dataset creation best practicesDataset creation best practices
Dataset creation best practices
 
The Cost of Microservices
The Cost of MicroservicesThe Cost of Microservices
The Cost of Microservices
 
The Value of Explicit Schema for Graph Use Cases
The Value of Explicit Schema for Graph Use CasesThe Value of Explicit Schema for Graph Use Cases
The Value of Explicit Schema for Graph Use Cases
 
Designing an Effective Content Measurement Strategy
Designing an Effective Content Measurement StrategyDesigning an Effective Content Measurement Strategy
Designing an Effective Content Measurement Strategy
 
Building Teams at Scale - MaGIC Academy Symposium 2017
Building Teams at Scale - MaGIC Academy Symposium 2017Building Teams at Scale - MaGIC Academy Symposium 2017
Building Teams at Scale - MaGIC Academy Symposium 2017
 
The Art and Science of Testing - Setting Scalable Optimisation Practices for ...
The Art and Science of Testing - Setting Scalable Optimisation Practices for ...The Art and Science of Testing - Setting Scalable Optimisation Practices for ...
The Art and Science of Testing - Setting Scalable Optimisation Practices for ...
 
Christina Silver Mindsets in qualitative analysis. opening to digital tools d...
Christina Silver Mindsets in qualitative analysis. opening to digital tools d...Christina Silver Mindsets in qualitative analysis. opening to digital tools d...
Christina Silver Mindsets in qualitative analysis. opening to digital tools d...
 
Easy Analytics on AWS with Amazon Redshift, Amazon QuickSight, and Amazon Mac...
Easy Analytics on AWS with Amazon Redshift, Amazon QuickSight, and Amazon Mac...Easy Analytics on AWS with Amazon Redshift, Amazon QuickSight, and Amazon Mac...
Easy Analytics on AWS with Amazon Redshift, Amazon QuickSight, and Amazon Mac...
 
Dataiku at SF DataMining Meetup - Kaggle Yandex Challenge
Dataiku at SF DataMining Meetup - Kaggle Yandex ChallengeDataiku at SF DataMining Meetup - Kaggle Yandex Challenge
Dataiku at SF DataMining Meetup - Kaggle Yandex Challenge
 
Madhu Raman - Contextual Lens: Driving Innovation with Consumer Interaction Data
Madhu Raman - Contextual Lens: Driving Innovation with Consumer Interaction DataMadhu Raman - Contextual Lens: Driving Innovation with Consumer Interaction Data
Madhu Raman - Contextual Lens: Driving Innovation with Consumer Interaction Data
 
BPM Cluster Meeting 2018
BPM Cluster Meeting 2018BPM Cluster Meeting 2018
BPM Cluster Meeting 2018
 
Creating a Product Roadmap - Product Strategy Series
Creating a Product Roadmap - Product Strategy SeriesCreating a Product Roadmap - Product Strategy Series
Creating a Product Roadmap - Product Strategy Series
 
COOs and Rapid Business Adaptation
COOs and Rapid Business AdaptationCOOs and Rapid Business Adaptation
COOs and Rapid Business Adaptation
 
Ready, set, go! - Anna Royzman
Ready, set, go! - Anna RoyzmanReady, set, go! - Anna Royzman
Ready, set, go! - Anna Royzman
 
An Introduction to AAARRRP: A framework for Defining Your Developer Relations...
An Introduction to AAARRRP: A framework for Defining Your Developer Relations...An Introduction to AAARRRP: A framework for Defining Your Developer Relations...
An Introduction to AAARRRP: A framework for Defining Your Developer Relations...
 
Google Think Mobile Event - Mobile Strategy
Google Think Mobile Event - Mobile Strategy Google Think Mobile Event - Mobile Strategy
Google Think Mobile Event - Mobile Strategy
 
Mobile Strategy @ Google Think Mobile - Namics-Vortrag
Mobile Strategy @ Google Think Mobile - Namics-VortragMobile Strategy @ Google Think Mobile - Namics-Vortrag
Mobile Strategy @ Google Think Mobile - Namics-Vortrag
 
Impact-Driven Scrum Delivery at Scrum gathering Phoenix 2015
Impact-Driven Scrum Delivery at Scrum gathering Phoenix 2015Impact-Driven Scrum Delivery at Scrum gathering Phoenix 2015
Impact-Driven Scrum Delivery at Scrum gathering Phoenix 2015
 
Impact-driven Scrum Delivery at Scrum gathering Phoenix 2015
Impact-driven Scrum Delivery at Scrum gathering Phoenix 2015Impact-driven Scrum Delivery at Scrum gathering Phoenix 2015
Impact-driven Scrum Delivery at Scrum gathering Phoenix 2015
 
Microsoft Project Syllabus
Microsoft Project SyllabusMicrosoft Project Syllabus
Microsoft Project Syllabus
 

Recently uploaded

Applications of artificial Intelligence in Mechanical Engineering.pdf
Applications of artificial Intelligence in Mechanical Engineering.pdfApplications of artificial Intelligence in Mechanical Engineering.pdf
Applications of artificial Intelligence in Mechanical Engineering.pdf
Atif Razi
 
Welding Metallurgy Ferrous Materials.pdf
Welding Metallurgy Ferrous Materials.pdfWelding Metallurgy Ferrous Materials.pdf
Welding Metallurgy Ferrous Materials.pdf
AjmalKhan50578
 
An Introduction to the Compiler Designss
An Introduction to the Compiler DesignssAn Introduction to the Compiler Designss
An Introduction to the Compiler Designss
ElakkiaU
 
CompEx~Manual~1210 (2).pdf COMPEX GAS AND VAPOURS
CompEx~Manual~1210 (2).pdf COMPEX GAS AND VAPOURSCompEx~Manual~1210 (2).pdf COMPEX GAS AND VAPOURS
CompEx~Manual~1210 (2).pdf COMPEX GAS AND VAPOURS
RamonNovais6
 
Generative AI Use cases applications solutions and implementation.pdf
Generative AI Use cases applications solutions and implementation.pdfGenerative AI Use cases applications solutions and implementation.pdf
Generative AI Use cases applications solutions and implementation.pdf
mahaffeycheryld
 
Advanced control scheme of doubly fed induction generator for wind turbine us...
Advanced control scheme of doubly fed induction generator for wind turbine us...Advanced control scheme of doubly fed induction generator for wind turbine us...
Advanced control scheme of doubly fed induction generator for wind turbine us...
IJECEIAES
 
Digital Twins Computer Networking Paper Presentation.pptx
Digital Twins Computer Networking Paper Presentation.pptxDigital Twins Computer Networking Paper Presentation.pptx
Digital Twins Computer Networking Paper Presentation.pptx
aryanpankaj78
 
Properties Railway Sleepers and Test.pptx
Properties Railway Sleepers and Test.pptxProperties Railway Sleepers and Test.pptx
Properties Railway Sleepers and Test.pptx
MDSABBIROJJAMANPAYEL
 
22CYT12-Unit-V-E Waste and its Management.ppt
22CYT12-Unit-V-E Waste and its Management.ppt22CYT12-Unit-V-E Waste and its Management.ppt
22CYT12-Unit-V-E Waste and its Management.ppt
KrishnaveniKrishnara1
 
Gas agency management system project report.pdf
Gas agency management system project report.pdfGas agency management system project report.pdf
Gas agency management system project report.pdf
Kamal Acharya
 
一比一原版(uofo毕业证书)美国俄勒冈大学毕业证如何办理
一比一原版(uofo毕业证书)美国俄勒冈大学毕业证如何办理一比一原版(uofo毕业证书)美国俄勒冈大学毕业证如何办理
一比一原版(uofo毕业证书)美国俄勒冈大学毕业证如何办理
upoux
 
IEEE Aerospace and Electronic Systems Society as a Graduate Student Member
IEEE Aerospace and Electronic Systems Society as a Graduate Student MemberIEEE Aerospace and Electronic Systems Society as a Graduate Student Member
IEEE Aerospace and Electronic Systems Society as a Graduate Student Member
VICTOR MAESTRE RAMIREZ
 
SCALING OF MOS CIRCUITS m .pptx
SCALING OF MOS CIRCUITS m                 .pptxSCALING OF MOS CIRCUITS m                 .pptx
SCALING OF MOS CIRCUITS m .pptx
harshapolam10
 
Engineering Standards Wiring methods.pdf
Engineering Standards Wiring methods.pdfEngineering Standards Wiring methods.pdf
Engineering Standards Wiring methods.pdf
edwin408357
 
2008 BUILDING CONSTRUCTION Illustrated - Ching Chapter 08 Doors and Windows.pdf
2008 BUILDING CONSTRUCTION Illustrated - Ching Chapter 08 Doors and Windows.pdf2008 BUILDING CONSTRUCTION Illustrated - Ching Chapter 08 Doors and Windows.pdf
2008 BUILDING CONSTRUCTION Illustrated - Ching Chapter 08 Doors and Windows.pdf
Yasser Mahgoub
 
4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf
4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf
4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf
Gino153088
 
一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理
一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理
一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理
nedcocy
 
Comparative analysis between traditional aquaponics and reconstructed aquapon...
Comparative analysis between traditional aquaponics and reconstructed aquapon...Comparative analysis between traditional aquaponics and reconstructed aquapon...
Comparative analysis between traditional aquaponics and reconstructed aquapon...
bijceesjournal
 
Object Oriented Analysis and Design - OOAD
Object Oriented Analysis and Design - OOADObject Oriented Analysis and Design - OOAD
Object Oriented Analysis and Design - OOAD
PreethaV16
 
一比一原版(osu毕业证书)美国俄勒冈州立大学毕业证如何办理
一比一原版(osu毕业证书)美国俄勒冈州立大学毕业证如何办理一比一原版(osu毕业证书)美国俄勒冈州立大学毕业证如何办理
一比一原版(osu毕业证书)美国俄勒冈州立大学毕业证如何办理
upoux
 

Recently uploaded (20)

Applications of artificial Intelligence in Mechanical Engineering.pdf
Applications of artificial Intelligence in Mechanical Engineering.pdfApplications of artificial Intelligence in Mechanical Engineering.pdf
Applications of artificial Intelligence in Mechanical Engineering.pdf
 
Welding Metallurgy Ferrous Materials.pdf
Welding Metallurgy Ferrous Materials.pdfWelding Metallurgy Ferrous Materials.pdf
Welding Metallurgy Ferrous Materials.pdf
 
An Introduction to the Compiler Designss
An Introduction to the Compiler DesignssAn Introduction to the Compiler Designss
An Introduction to the Compiler Designss
 
CompEx~Manual~1210 (2).pdf COMPEX GAS AND VAPOURS
CompEx~Manual~1210 (2).pdf COMPEX GAS AND VAPOURSCompEx~Manual~1210 (2).pdf COMPEX GAS AND VAPOURS
CompEx~Manual~1210 (2).pdf COMPEX GAS AND VAPOURS
 
Generative AI Use cases applications solutions and implementation.pdf
Generative AI Use cases applications solutions and implementation.pdfGenerative AI Use cases applications solutions and implementation.pdf
Generative AI Use cases applications solutions and implementation.pdf
 
Advanced control scheme of doubly fed induction generator for wind turbine us...
Advanced control scheme of doubly fed induction generator for wind turbine us...Advanced control scheme of doubly fed induction generator for wind turbine us...
Advanced control scheme of doubly fed induction generator for wind turbine us...
 
Digital Twins Computer Networking Paper Presentation.pptx
Digital Twins Computer Networking Paper Presentation.pptxDigital Twins Computer Networking Paper Presentation.pptx
Digital Twins Computer Networking Paper Presentation.pptx
 
Properties Railway Sleepers and Test.pptx
Properties Railway Sleepers and Test.pptxProperties Railway Sleepers and Test.pptx
Properties Railway Sleepers and Test.pptx
 
22CYT12-Unit-V-E Waste and its Management.ppt
22CYT12-Unit-V-E Waste and its Management.ppt22CYT12-Unit-V-E Waste and its Management.ppt
22CYT12-Unit-V-E Waste and its Management.ppt
 
Gas agency management system project report.pdf
Gas agency management system project report.pdfGas agency management system project report.pdf
Gas agency management system project report.pdf
 
一比一原版(uofo毕业证书)美国俄勒冈大学毕业证如何办理
一比一原版(uofo毕业证书)美国俄勒冈大学毕业证如何办理一比一原版(uofo毕业证书)美国俄勒冈大学毕业证如何办理
一比一原版(uofo毕业证书)美国俄勒冈大学毕业证如何办理
 
IEEE Aerospace and Electronic Systems Society as a Graduate Student Member
IEEE Aerospace and Electronic Systems Society as a Graduate Student MemberIEEE Aerospace and Electronic Systems Society as a Graduate Student Member
IEEE Aerospace and Electronic Systems Society as a Graduate Student Member
 
SCALING OF MOS CIRCUITS m .pptx
SCALING OF MOS CIRCUITS m                 .pptxSCALING OF MOS CIRCUITS m                 .pptx
SCALING OF MOS CIRCUITS m .pptx
 
Engineering Standards Wiring methods.pdf
Engineering Standards Wiring methods.pdfEngineering Standards Wiring methods.pdf
Engineering Standards Wiring methods.pdf
 
2008 BUILDING CONSTRUCTION Illustrated - Ching Chapter 08 Doors and Windows.pdf
2008 BUILDING CONSTRUCTION Illustrated - Ching Chapter 08 Doors and Windows.pdf2008 BUILDING CONSTRUCTION Illustrated - Ching Chapter 08 Doors and Windows.pdf
2008 BUILDING CONSTRUCTION Illustrated - Ching Chapter 08 Doors and Windows.pdf
 
4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf
4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf
4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf
 
一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理
一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理
一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理
 
Comparative analysis between traditional aquaponics and reconstructed aquapon...
Comparative analysis between traditional aquaponics and reconstructed aquapon...Comparative analysis between traditional aquaponics and reconstructed aquapon...
Comparative analysis between traditional aquaponics and reconstructed aquapon...
 
Object Oriented Analysis and Design - OOAD
Object Oriented Analysis and Design - OOADObject Oriented Analysis and Design - OOAD
Object Oriented Analysis and Design - OOAD
 
一比一原版(osu毕业证书)美国俄勒冈州立大学毕业证如何办理
一比一原版(osu毕业证书)美国俄勒冈州立大学毕业证如何办理一比一原版(osu毕业证书)美国俄勒冈州立大学毕业证如何办理
一比一原版(osu毕业证书)美国俄勒冈州立大学毕业证如何办理
 

Jobandtalent at recsys challenge 2016

  • 2.
  • 3. RECSYS CHALLENGE 2016 LEARNING TO RANK IN RECSYS 2016 ▸ Learning to Rank Framework ▸ Listwise, Pairwise, Pointwise ▸ Relevance Judgements ▸ Training & Evaluation dataset ▸ LambdaMART ▸ Gradient tree boosting & NDCG loss function
  • 4. RECSYS CHALLENGE 2016 DATA EXPLORATION ▸ Understanding data. ▸ Probability of Item being interacted "Popularity". ▸ Probability of Item being interacted by his terms titles ▸ Probability of recurring interactions. ▸ Probability of a user interacting Items and geographical distance
  • 5. RECSYS CHALLENGE 2016 RETRIEVERS ▸ Job title/Job tag match ▸ Relevant items per interaction ▸ Interactions made by user ▸ Impressions shown to user ▸ Collaborative filtering, Item to Item/User to User ▸ Clustered users.
  • 6. RECSYS CHALLENGE 2016 COLLECTORS ▸ Freshness. ▸ Item popularity. ▸ User behavior.
  • 7. RECSYS CHALLENGE 2016 LEARNING PROCESS ▸ Speed up the training process. ▸ Reducing the number of features applied. ▸ Reducing the number of elements used to train. ▸ Internal evaluation. ▸ NDCG@30 metric.
  • 8. RECSYS CHALLENGE 2016 RESULTS & CONCLUSIONS Run Internal Official Improved Baseline 22849 30721 Baseline BM25 (b=0.2 / k1=1.2) 23591 36857 20 % Interactions made by the user 162846 229949 523 % Training process 176312 241422 5 % Impressions with decay 400217 434433 79,94 % Item popularity 435325 475940 10 % Clustering 442049 488192 3 % Collaborative filtering 457391 507022 4 % Best effort @ 2000 480396 533232 5 % Best effort @ 9000 482083 535899 1 %
  • 9. SEE YOU THE NEXT YEAR!