1. Challenge Recap
ACM RecSys 2013, Hong Kong
Torben Brodt
plista GmbH
International News Recommender
Systems Workshop and Challenge
October 13th, 2013

2. Dates
planned
● 6 month development
● 1 month offline dataset (2013/07)
● 3 weeks online evaluation (2013/08)

3. Dates
actual
● 6 month development
● 1 month offline dataset (2013/07)
● 3 weeks “online evaluation” (2013/08)
○ Registration Problems
○ Missing Leaderboard
● 3 weeks ranking period (2013/09)

4. Number Quiz
How many registrations?

5. Number Quiz
How many registrations?
23

6. Number Quiz
How many active teams?

7. Number Quiz
How many active teams?
11

8. Participants from
workshops and talks
real user
● SIGIR, RecSys
recs
API
researcher
teams from
●
●
●
●
●
●
●
●
●
TU Berlin
HPI Potsdam
CWI Amsterdam
NTNU Norway
NTU Singapore
CVUT Prag
UCSB California
Ben Gurion, Israel
etc

9. Number Quiz
How many active recommenders?

10. Number Quiz
How many active recommenders?
31

11. Number Quiz
How many recommendations being delivered?

12. Number Quiz
How many recommendations being delivered?
571,744,114

13. Number Quiz
How many clicks being delivered?

14. Number Quiz
How many clicks being delivered?
764,181

15. Next steps
● dataset license
○ original one: free for use in correlation with challenge
○ new one: tba
● reproducability
○ reference algorithms?
● questionlist / FAQ

16. Winners
1. recommenders.net
winner of an ipad
2. inbeat
winner of a nexus 7
3. i2r
winner of a raspberry pi

17. Questions