Claudia Perlich Keynotes the Data Science Hackathon held at Cornell Tech on March 7, 2015. To view the video, please visit: https://www.youtube.com/watch?v=X78zU_SBbDk start video at 19:06

4. Data Detective
Game

7. Mobile phone location data

8. Tale of Two Locations
40.712 N 40.71272632 N
74.005 W 74.00597649 W
Which one am I more likely close to?

9. In other words…
40.71200000 N 40.71272632 N
74.00500000 W 74.00597649 W
Which one am I more likely close to?

10. 30% smart phone users
travel faster than speed of
sound …

11. Catalan traditions
popping up
everywhere ….

12. Distribution of Patient Identifier
for breast cancer detection
100- Patients, 6% cancer10000 100000 1000000

13. Histogram of patient ID???

14. Building a classifier for
diagnosis?
245 Patients:
36% Cancer
414 Patients:
1% Cancer
1027 Patients
0% Cancer
18 Patients:
85% Cancer
Modelscore
Log of Patient ID
Every point
is a candidate

15. Predicting Pneumonia in
Hospitals

16. Tale of two linear models …

17. Relationship between
pneumonia and the number
of other things you have
wrong with you (number of
diagnosis codes)???

18. Count: real
AUC: 0.76
Count: {1,2,3,4}
AUC: 0.85
icd1x icd2x icd3x icd4x
786 285 459 -1
401 -1 -1 -1
401 780 -1 -1
599 -1 -1 -1
V22 650 -1 -1
V56 492 586 -1
786 493 285 459

19. Unreasonable Performance
2 weeks
PerformanceIndex
2x

21. 21
Web Site Percent Common Users
www.youtube.com 55%
www.weather.com 28%
www.foxnews.com 23%
www.imdb.com 22%
www.ehow.com 22%
www.latimes.com 20%
www.washingtonpost.com 19%
wiki.answers.com 18%
abcnews.go.com 18%
www.forbes.com 17%
www.dailymail.co.uk 14%
www.examiner.com 13%
premiumweathersite1.com 11%
www.politico.com 11%
www.nydailynews.com 11%
www.usatoday.com 11%
www.slate.com 10%
content.usatoday.com 10%
www.nypost.com 9%
www.npr.org 9%
What website am I?

22. 22
Answer: nytimes.com

23. What website am I?
23
Web Site Percent Common Users
www.filmannex.com 96%
www.ffog.net 93%
www.drugsnews.org 93%
menshealthbase.com 89%
www.womenshealthbase.com 85%
www.hark.com 85%
womenshealthbase.com 81%
www.articletrunk.com 81%
411answers.com 78%
www.dailyrx.com 74%
www.all-allergies.com 70%
knowvehicles.com 67%
modernbaby.com 63%
parentingnewsstories.com 59%
www.thefutoncritic.com 59%
www.gourmandia.com 59%
www.gossipcenter.com 59%
dailyfreshies.com 56%
www.greeting-cards.com 56%

24. 24
Answer: hiphophavoc.com

25. Unreasonable Performance
2 weeks
PerformanceIndex
2x

26. Oddly predictive websites?

27. Traffic patterns
website 1 website 2
50%
Data from Bid Requests in Ad-Exchanges

28. Node:
hostname
Edge:
50% co-visitation
WWW 2010

29. Boston Herald

30. Boston Herald

31. womenshealthbase?

35. WWW 2012

36. Unreasonable Performance?
2 weeks
PerformanceIndex
2x
Bots fake performance

37. Conversion Bot traffic
NYTimes home delivery subscription is in single digits …

38. Are you human or a bot???

39. Using the penalty box:
all back to normal
39
3 more weeks in spring 2012
PerformanceIndex

40. Know thy data and trust
your instincts!