PyData Seattle 2017

1. WorldRowing.com: an end
to end data analysis
Lou Harwood & Andrew Fisher, PhD

2. Who are we?
Lou Harwood
CTO/Co-Founder at
Skedaddle (use code
LOU for $5 off your first
ride!)
Andrew Fisher, PhD
Biomedical Engineering
Researcher at Boston
University
Disclaimer: Neither of us are
affiliated with WorldRowing.com

3. Outline
Project Creation
Terminology
Data Collection
Data Cleaning
Data Analysis

4. Project Creation
Several Olympic rowers were discussing the current state of USRowing, and
trends in athlete development
Several statements were made about the transition rate from the Under 23
national team to the Senior national team (Olympic team)

5. Outline
Project Creation
Terminology
Data Collection
Data Cleaning
Data Analysis

6. Rowing in Motion
Source: http://i.imgur.com/plWDubJ.gifv
http://i.imgur.com/plWDubJ.gifv

7. Competitions/Regattas
Multiple teams compete head-to-head
Heat, quarter-final, semi-final, final
scheme
National teams organized primarily by
age
under 18 (junior), under 23 (U23), and
senior (open) levels
2009 World Rowing Championships. Photo Credit: Ainunau, flickr

8. Terminology

9. Terminology

11. List of Boats Within Data
Sculling
1x Single
2x Double
4x Quad
Sweep
2- Pair
2+ Coxed Pair
4- Four
4+ Coxed Four
8+ Eight
Photo Credit: Dellavasca, Wikimedia Commons

12. Organization of Rankings/Performance
Regatta:
Junior,
U23,
Senior,
Olympic
Men,
Women
Lightweight,
Open-weight
1x Single
Heat
Repechage
Quarter-final
Semi-final
Final-A
Final-B
Countries,
Rower ID(s)
Finish
Rank
2x Double
2- Pair
2+ Coxed Pair
4x Quad
4- Four
4+ Coxed Four
8+ Eight

13. Outline
Project Creation
Terminology
Data Collection
Data Cleaning
Data Analysis

14. Libraries Used
matplotlib
numpy
pandas
csv
itertools
networkx
matplotlib_venn

15. Data Collection
http://www.worldrowing.com/athletes/athlete/8639/results/pinsent-matthew
http://www.worldrowing.com/athletes/athlete/8639/results

18. Regatta

19. Race

20. Boat
Class

21. Country

22. Race

23. Rank

24. Final
Time

26. Schema

27. Schema

28. Schema

29. Schema

34. Outline
Project Creation
Terminology
Data Collection
Data Cleaning
Data Analysis

44. Outline
Project Creation
Terminology
Data Collection
Data Cleaning
Data Analysis

45. Demographics of World Rowing Population

46. Demographics of World Rowing Population

47. Demographics of World Rowing Population

48. Demographics of World Rowing Population

49. Demographics of World Rowing Population
Junior athlete count: 18542
U23 athlete count: 8335
Worlds athlete count: 12452
Olympian athlete count: 5101
Count Junior & U23: 4029
Count U23 & Worlds: 3403
Count Worlds & Olympics: 3356
Count U23 & Olympics: 1059
Count Junior & Olympics: 1413
Ratio of Juniors who did U23: 0.217
Ratio of Juniors who became Olympians: 0.076
Ratio of U23 who became Olympians: 0.127
Ratio of Olympians who did Juniors: 0.277

50. Data Analysis - Junior Team Representation in
Olympic Boats
Top Nations for Olympians
with Junior Team Experience
USA 1158
GBR 668
AUS 581
CAN 531
NED 530
ITA 522
FRA 474
CHN 445
DEN 415
NZL 361
ITA 94
GBR 86
GER 79
FRA 78
ROU 61
AUS 55
USA 51
POL 49
NED 46
BUL 42
Top Nations for
Olympians

51. Same Trend in Male vs Female?
Male
['USA'] 701
['GBR'] 415
['AUS'] 369
['ITA'] 363
['NED'] 331
['GER'] 330
['FRA'] 316
['CAN'] 274
['DEN'] 253
['NZL'] 220
Female
['USA'] 457
['CAN'] 257
['GBR'] 253
['CHN'] 232
['AUS'] 212
['GER'] 200
['NED'] 191
['ROU'] 183
['FRA'] 129
['RUS'] 126
Male
['ITA'] 81
['GBR'] 67
['FRA'] 57
['GER'] 41
['POL'] 40
['ESP'] 32
['USA'] 32
['NED'] 32
['AUS'] 30
['SUI'] 30
Female
['GER'] 38
['ROU'] 37
['AUS'] 25
['BUL'] 24
['FRA'] 21
['USA'] 19
['GBR'] 19
['GER' 'GDR'] 15
['NED'] 14
['ITA'] 13
Top Nations for Olympians with
Junior Team Experience
Top Nations for
Olympians

52. Junior Team Composition of Top Olympic 8+ Boats
Junior Exp.
Yes
No
Junior Exp.
Yes
No
%ofBoatwithJuniorExperience

53. U23 Team Composition of Top Olympic 8+ Boats
U23 Exp.
Yes
No
U23 Exp.
Yes
No
%ofBoatwithU23Experience

55. All participants in the W8+ for USA

56. M8+, USA

57. M8+, GBR W8+, GBR

58. M8+, CAN W8+, CAN

59. Next Steps
Analyzing retention of athletes from Junior and U23 development
Comparing success (medals) at various regattas to team composition
Improve the scraping process, store data in a database
Feature Engineering
Network Analysis

60. Race as a Symphony
“He suggested that Joe think of a well-rowed race as a symphony, and himself as
just one player in the orchestra. If one fellow in an orchestra was playing out of
tune, or playing at a different tempo, the whole piece would naturally be ruined.
That’s the way it was with rowing. What mattered more than how hard a man
rowed was how well everything he did in the boat harmonized with what the other
fellows were doing.”
― Daniel James Brown, The Boys in the Boat: Nine
Americans and Their Epic Quest for Gold at the 1936
Berlin Olympics

61. Can we measure this?

62. Weighted Synergy Graphs
“In this work, we are interested in a model of team performance that goes beyond
the sum of single-agent capabilities. We understand that there is synergy among
the agents in the team, where team performance at a particular task depends not
only on the individual agents’ capabilities, but also on the composition of the team
itself”
S. Liemhetcharat and M. Veloso. Weighted synergy
graphs for effective team formation with heterogeneous
ad hoc agents. Artificial Intelligence. 208. (2014). 41-
65.
http://dx.doi.org/10.1016/j.artint.2013.12.002

63. Questions/Comments