Challenge Recap

ACM RecSys 2013, Hong Kong

Torben Brodt
plista GmbH

International News Recommender
Systems Workshop and Challenge
October 13th, 2013
Dates
planned
● 6 month development
● 1 month offline dataset (2013/07)
● 3 weeks online evaluation (2013/08)
Dates
actual
● 6 month development
● 1 month offline dataset (2013/07)
● 3 weeks “online evaluation” (2013/08)
○ Registration Problems
○ Missing Leaderboard

● 3 weeks ranking period (2013/09)
Number Quiz
How many registrations?
Number Quiz
How many registrations?

23
Number Quiz
How many active teams?
Number Quiz
How many active teams?

11
Participants from
workshops and talks

real user

● SIGIR, RecSys
recs

API

researcher

teams from
●
●
●
●
●
●
●
●
●

TU Berlin
HPI Potsdam
CWI Amsterdam
NTNU Norway
NTU Singapore
CVUT Prag
UCSB California
Ben Gurion, Israel
etc
Number Quiz
How many active recommenders?
Number Quiz
How many active recommenders?

31
Number Quiz
How many recommendations being delivered?
Number Quiz
How many recommendations being delivered?

571,744,114
Number Quiz
How many clicks being delivered?
Number Quiz
How many clicks being delivered?

764,181
Next steps
● dataset license
○ original one: free for use in correlation with challenge
○ new one: tba

● reproducability
○ reference algorithms?

● questionlist / FAQ
Winners
1. recommenders.net
winner of an ipad

2. inbeat
winner of a nexus 7

3. i2r
winner of a raspberry pi
Questions

Nrs2013 recap