SlideShare a Scribd company logo
1 of 39
Download to read offline
Observations on Typing
Vivek Dhakal, Anna Maria Feit, Per Ola Kristensson, Antti Oulasvirta
from 136 Million Keypresses
http://userinterfaces.aalto.fi/136Mkeystrokes/
Are you fast?
Do you use more than 6 fingers?
Observations on Typing from 136 Million Keypresses
V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018
What do we know about typing?
Professionally trained touch typists using
typewriters. Findings from 1920-80s:
Average speed 75 wpm
Error rates 1.0%-3.2%
[Grudin 1983]
Random letters very slow to type
[Shaffer 1968]
Hand alternation benefit 30-60 ms
[Salthouse 1984]
Insertion errors most common
[Salthouse 1984]
Observations on Typing from 136 Million Keypresses
V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018
Many factors have changed since 1970s
Key and keyboard design
Forces and travel distances
Entry tasks and corpora
Training
flickr.com/photos/
aemays/15818888836
The How-we-Type
Study (CHI2016)
Observations on Typing from 136 Million Keypresses
V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018
The How-we-Type Study [CHI’16] N=36
Motion
capture
Reference
video
Keylog data
Eye
tracking
The How-we-Type Study [CHI’16] N=36
Observations on Typing from 136 Million Keypresses
V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018
Entropy of the finger-to-key mapping
Entropy of key k
Probability that finger f presses key k
Observations on Typing from 136 Million Keypresses
V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018
1. Fast typist exhibit less entropy
Observations on Typing from 136 Million Keypresses
V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018
Preparation of the next key press
Average distance of finger
to key at previous keypress
2. Fast typists prepare more
Global movement
Average SD of location of the hand markers (left vs. right)
Observations on Typing from 136 Million Keypresses
V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018
3. Fast typists move less
Gaze deployment:
Looking at fingers vs. display
4. Fast typists keep gaze on display
Objectives for this study
Large dataset on keystroke patterns
• Assessment of earlier findings
• Statistical analysis of typing patterns
• Predictors of typing performance
• Descriptors of population tendencies
• Modeling
Text entry methods
Motor control research
General understanding
Training typing skills
Method
Software and services for typing tests
What is typing speed and
how to measure it?
Corpora?
Feedback?
Repetitions allowed?
Metrics?
Try it out: http://typingmaster.research.netlab.hut.fi/
Log keydown and
keyup events
15 phrases
randomly selected
from the Enron and
Gigaword Datasets
Summary page with
details on typing
performance
Method overview
Sampling and demographics
Advertised by an
online typing test
service
Demographics Result Remark
Females 52.7% Rest preferred not to specify
Males 41.5%
Age: mean 24.5 75% 11–30 yrs
SD 11.2
Countries 218 68.05% from US, 85% native
language English
Took a typing course 72%
Hours typing/day: mean 3.2 64% < 2 hrs, 14% > 6 hrs
SD 3.2
Qwerty layout 98.1% Rest local alternatives or oth-
ers
Physical keyboard 43.8% Rest on-screen (touch)
Laptop keyboard 54.15% or small physical keyboard
Table 1. Background statistics for the participants.
168,960 users
Observations on Typing from 136 Million Keypresses
V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018
Dataset and metrics
Over 400,000 users clicked the
link. Over 190,000 completed the
test
We excluded 12% of
participants:
• Users with error rate > 25%
• Users who did not finish all
phrases
Words per minute
Uncorrected error rate
Corrected error rate
Error corrections (%)
Keystrokes per char.
Interkey interval (IKI)
Keypress duration
Omission, substitution,
insertion errors
Selected results
All WPM corr Fast Slow Trained Untrained
Measure X s r X s X s Sign. d X s X s Sign. d
WPM 51.56 20.20 – 89.56 9.53 20.91 4.05 • 9.38 54.35 20.80 49.00 19.73 • 0.27
IKI (ms) 238.66 111.60 -0.84 121.70 11.96 481.03 123.36 • 4.10 223.55 107.78 245.34 112.60 • 0.20
Keypr. duration 116.25 23.88 -0.29 104.49 17.38 128.99 28.85 • 1.03 118.39 23.81 115.29 23.85 • 0.13
Unc. Error (%) 1.17 1.43 -0.21 0.71 0.92 1.78 1.94 • 0.70 1.02 1.31 1.23 1.48 • 0.10
Error Correct. (%) 6.31 4.48 -0.36 3.40 2.05 9.05 6.85 • 1.12 5.90 4.40 6.50 4.50 • 0.14
KSPC 1.17 0.09 -0.40 1.10 0.05 1.24 0.14 • 1.24 1.16 0.09 1.18 0.10 • 0.15
Substitutions* (%) 1.65 1.43 -0.45 0.84 0.64 3.72 2.69 • 1.57 1.49 1.37 1.75 1.46 • 0.19
Omissions* (%) 0.80 0.57 -0.33 0.49 0.41 1.29 0.75 • 1.36 0.75 0.58 0.83 0.57
Insertions* (%) 0.67 0.48 -0.15 0.50 0.33 0.80 0.46 • 0.76 0.64 0.49 0.69 0.47
Left IKI (ms) 215.23 96.80 -0.70 124.37 25.90 385.18 147.14 • 2.47 209.43 94.47 217.80 97.77 • 0.09
Right IKI (ms) 203.60 99.13 -0.68 117.24 25.03 379.81 162.40 • 2.26 195.90 97.21 207.02 99.78 • 0.11
Altern. IKI (ms) 198.26 103.95 -0.72 108.62 17.57 408.77 154.25 • 2.73 188.10 98.41 202.76 105.99 • 0.14
Repet. IKI (ms) 176.36 70.26 -0.32 144.79 27.46 230.76 126.21 • 0.94 175.64 66.20 176.68 71.98 • 0.02
Numb. fingers 6.95 2.95 0.34 8.40 2.20 5.30 3.20 • 1.16 8.00 2.46 6.50 3.00 • 0.54
Rollover ratio (%) 25.00 17.00 0.73 49.90 14.00 7.60 6.40 • 3.73 29.00 17.70 24.00 16.70 • 0.29
p>0.01 • p <0.01 • p⌧0.001 X : Mean value s : Standard deviation d: Cohen’s d value * Results based on 783 participants
Table 3. Overview of results. At the left are the mean and SD for each measure, correlation of each measure with WPM, and indication of significance.
The middle and right part compare fast with slow and trained with untrained typists, respectively. Unless otherwise denoted, statistical significance of
tabulated results has been tested at the 1% level via the Mann–Whitney signed rank test.
Words per minute
Avg. 51.6 wpm (SD 20, max 120)
Trained touchtypists 5 wpm faster
Slower than 30 years ago
Touchtyping training not very
predictive of fast typing
Error rates
Average error rate 1.16%
2.3 error corrections per sentence
Substitution, not insertion errors
Interkey interval vs. Keypress duration
Avg IKI 239 ms
(SD 111)
Avg KPD 116 ms
(SD 24)
KPD uniform, not predictive of wpm
IKI has high variance
Observations on Typing from 136 Million Keypresses
V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018
Error vs. speed
Correlation with wpm
r = - 0.36
Even a small decrease in
error rate improves speed
Hard to be fast if you
make errors
Observations on Typing from 136 Million Keypresses
V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018
Number of fingers used
Correlation with wpm r = 0.38
Fast users use more fingers
Observations on Typing from 136 Million Keypresses
V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018
Roll-over typing
Typing a consecutive
key before releasing the
earlier key
Known in eSports and by keyboard
manufacturers, but not in studies of typing
About 30 ms overlap
Rollover vs. typing speed
Correlation with wpm r = 0.73
Average 25%
Highly correlated with speed
Eight typing patterns identifiable
Unsupervised k-medoids clustering
Features: IKIs of 38 bigrams
Numb. of Rollover Left Right Alternation Error rate (%)
Cl. # particip. WPM ratio (%) IKI (ms) IKI (ms) IKI (ms) IKI (ms) Uncorrected
(%)
Omission Insertion Subst. KSPC
1 38,012 46.5 19.98 245.8 221.9 218.5 202.1 1.260 0.70 0.59 1.7 1.177
2 12,930 48.12 19.29 235.3 217.0 216.2 185.3 1.313 0.90 0.77 2.0 1.179
3 13,397 52.36 24.44 214.9 205.3 203.8 175.4 1.263 0.92 0.81 1.7 1.186
4 15,498 53.12 26.23 212.3 204.6 192.7 174.5 1.187 0.80 0.76 1.6 1.175
5 7,731 53.87 21.17 205.3 205.9 199.9 159.3 1.220 0.90 0.64 1.8 1.185
6 22,980 56.50 27.20 197.8 180.5 179.8 161.2 1.147 0.81 0.67 1.7 1.176
7 19,757 64.59 35.75 181.9 173.1 163.2 153.9 1.094 0.71 0.63 1.6 1.162
8 35,068 68.35 37.76 161.9 159.5 150.1 138.2 0.969 0.61 0.64 1.1 1.158
Table 4. Overview of the analysed measures differing between clusters, showing that differences in keystroke patterns affect typing performance.
that resulted in maximum isolation of clusters for further in- 3: AVERAGE-BUT-ERROR-PRONE Average typists (⇠52 WPM)
Figure 6. Distribution of rollover ratios across participants for fast and
slow typists. Slow typists use nearly no rollover, whereas the majority of
fast typists use rollover for 40–70% of keystrokes.
Results
The average rollover ratio is 25% (SD = 17%), with most
typists performing at least a small percentage of keystrokes
by means of rollover. Rollover ratio is found to have a high
correlation with performance (r = 0.73, p < 0.001). Figure 6
compares the distribution of rollover ratios across fast and
slow typists. While slow typists use almost no rollover, the
majority of fast typists use rollover for 40–70% of keypresses.
Trained typists average ⇠5% more rollover than untrained
typists. When rollover is used, keystrokes overlap by 30 ms,
on average, and up to 100 ms. The prevalence of this behaviour
was surprising. To further validate it, we looked at high-
Figure 7. Isolation values for different numbers of clusters obtained by
the PAM clustering method. N = 8 clusters yields the best value while
giving a low number of meaningful clusters.
but capturing the typing behaviour. For each user, we con-
structed 38 features representing the normalised IKI for the
most frequently typed bigrams, following two steps:
1. Bigram selection: Since participants typed different sen-
tences, the dataset did not contain observations for each user
and each bigram. Given the bigrams in Table 2 extended with
frequent bigrams ending with a spacebar press, we chose the
maximum set of bigrams and participants such that the data
contained observations from at least 90% of participants. This
resulted in 38 bigrams for 97.8% of participants (the rest were
excluded from clustering).
2. Normalisation: For each user and each of the 38 bigrams,
Typing styles (clusters)
1. Slow, careful typists
2. Slow, careless hand alternations
3. Average-but-error-prone
4. Average right-hand typists
5. Average hand alternations
6. Average typists
7. Fast, error-prone typists
8. Fast rollovers
Observations on Typing from 136 Million Keypresses
V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018
Limitations
The sample
• Self-selected typists
• Unrepresentative sample
- Most are young and 68% from the US
- 70% taken a typing course (cf. 43% in general population)
- Plenty of typing per day (> 3h/day)
Imprecision of keyevent measurements
• Javascript-based keylogging has a precision of about 15 ms
Conclusion
The 136M Keystrokes Dataset
Readme.txt 16 GB
Take-away: Non-uniformity of typing
Typing is changing
Typing styles emerge with use and are diverse
Typing performance is getting worse
Some statistical patterns identifiable
We should not assume uniformity of typing in motor
control research, design, modeling, nor training
How to become a faster typist
(without learning touch-typing)?
Observations on Typing
from 136 Million Keystrokes
Get the data:
• 136 Million keystrokes
from 169,000 users
• Demographics, typing
experience, etc.
• WPM, Errors, IKI, etc.
http://userinterfaces.aalto.fi/136Mkeystrokes/
New observations
• Average speed coming down
• Rollover associated with WPM
• Error corrections very costly to WPM
• Uniform keypress duration
• Substitution errors most common
• Few clusters describe typing styles

More Related Content

Similar to Observations on typing from 136 million keystrokes - Presentation by Antti Oulasvirta at CHI2018, April 2018, Montreal

Software Defect Repair Times: A Multiplicative Model
Software Defect Repair Times: A Multiplicative ModelSoftware Defect Repair Times: A Multiplicative Model
Software Defect Repair Times: A Multiplicative Modelgregoryg
 
Critical Checks for Pharmaceuticals and Healthcare: Validating Your Data Inte...
Critical Checks for Pharmaceuticals and Healthcare: Validating Your Data Inte...Critical Checks for Pharmaceuticals and Healthcare: Validating Your Data Inte...
Critical Checks for Pharmaceuticals and Healthcare: Validating Your Data Inte...Minitab, LLC
 
Benchmark 2014 | Global Results for Desktop Support | HDI 2015
Benchmark 2014 | Global Results for Desktop Support | HDI 2015Benchmark 2014 | Global Results for Desktop Support | HDI 2015
Benchmark 2014 | Global Results for Desktop Support | HDI 2015MetricNet
 
How we type: Movement Strategies and Performance in Everyday typing
How we type: Movement Strategies and Performance in Everyday typingHow we type: Movement Strategies and Performance in Everyday typing
How we type: Movement Strategies and Performance in Everyday typingAnna Maria Feit
 
OSMC 2023 | Know your data: The stats behind your alerts by Dave McAllister
OSMC 2023 | Know your data: The stats behind your alerts by Dave McAllisterOSMC 2023 | Know your data: The stats behind your alerts by Dave McAllister
OSMC 2023 | Know your data: The stats behind your alerts by Dave McAllisterNETWAYS
 
Need for Speed: How to Performance Test the right way by Annie Bhaumik
Need for Speed: How to Performance Test the right way by Annie BhaumikNeed for Speed: How to Performance Test the right way by Annie Bhaumik
Need for Speed: How to Performance Test the right way by Annie BhaumikQA or the Highway
 
Credit Card Fraudulent Transaction Detection Research Paper
Credit Card Fraudulent Transaction Detection Research PaperCredit Card Fraudulent Transaction Detection Research Paper
Credit Card Fraudulent Transaction Detection Research PaperGarvit Burad
 
APPLICATION OF STATISTICAL LEARNING TECHNIQUES AS PREDICTIVE TOOLS FOR MACHIN...
APPLICATION OF STATISTICAL LEARNING TECHNIQUES AS PREDICTIVE TOOLS FOR MACHIN...APPLICATION OF STATISTICAL LEARNING TECHNIQUES AS PREDICTIVE TOOLS FOR MACHIN...
APPLICATION OF STATISTICAL LEARNING TECHNIQUES AS PREDICTIVE TOOLS FOR MACHIN...Shibaprasad Bhattacharya
 
Six sigma-in-measurement-systems-evaluating-the-hidden-factory (2)
Six sigma-in-measurement-systems-evaluating-the-hidden-factory (2)Six sigma-in-measurement-systems-evaluating-the-hidden-factory (2)
Six sigma-in-measurement-systems-evaluating-the-hidden-factory (2)Bibhuti Prasad Nanda
 
Examples of working with streaming data
Examples of working with streaming dataExamples of working with streaming data
Examples of working with streaming dataYi-Shin Chen
 
Case Study - TapAssist
Case Study - TapAssistCase Study - TapAssist
Case Study - TapAssistGrace Chien
 
Finding the best Radio Network Planning and Radio Network Optimization software
Finding the best Radio Network Planning and Radio Network Optimization softwareFinding the best Radio Network Planning and Radio Network Optimization software
Finding the best Radio Network Planning and Radio Network Optimization softwareMuhammad Waqas Akram
 
Amaya_Presentation
Amaya_PresentationAmaya_Presentation
Amaya_PresentationIsaias Amaya
 
Scott MacKenzie at BayCHI: Evaluating Eye Tracking Systems for Computer Data ...
Scott MacKenzie at BayCHI: Evaluating Eye Tracking Systems for Computer Data ...Scott MacKenzie at BayCHI: Evaluating Eye Tracking Systems for Computer Data ...
Scott MacKenzie at BayCHI: Evaluating Eye Tracking Systems for Computer Data ...BayCHI
 
ePoster_Saunak.Amitangshu
ePoster_Saunak.AmitangshuePoster_Saunak.Amitangshu
ePoster_Saunak.AmitangshuSaunak Saha
 
Improving Two-Thumb Text Entry on Touchscreen Devices
Improving Two-Thumb Text Entry on Touchscreen DevicesImproving Two-Thumb Text Entry on Touchscreen Devices
Improving Two-Thumb Text Entry on Touchscreen DevicesAalto University
 

Similar to Observations on typing from 136 million keystrokes - Presentation by Antti Oulasvirta at CHI2018, April 2018, Montreal (20)

Software Defect Repair Times: A Multiplicative Model
Software Defect Repair Times: A Multiplicative ModelSoftware Defect Repair Times: A Multiplicative Model
Software Defect Repair Times: A Multiplicative Model
 
Critical Checks for Pharmaceuticals and Healthcare: Validating Your Data Inte...
Critical Checks for Pharmaceuticals and Healthcare: Validating Your Data Inte...Critical Checks for Pharmaceuticals and Healthcare: Validating Your Data Inte...
Critical Checks for Pharmaceuticals and Healthcare: Validating Your Data Inte...
 
Benchmark 2014 | Global Results for Desktop Support | HDI 2015
Benchmark 2014 | Global Results for Desktop Support | HDI 2015Benchmark 2014 | Global Results for Desktop Support | HDI 2015
Benchmark 2014 | Global Results for Desktop Support | HDI 2015
 
Rui Meng - 2017 - Deep Keyphrase Generation
Rui Meng - 2017 - Deep Keyphrase GenerationRui Meng - 2017 - Deep Keyphrase Generation
Rui Meng - 2017 - Deep Keyphrase Generation
 
How we type: Movement Strategies and Performance in Everyday typing
How we type: Movement Strategies and Performance in Everyday typingHow we type: Movement Strategies and Performance in Everyday typing
How we type: Movement Strategies and Performance in Everyday typing
 
OSMC 2023 | Know your data: The stats behind your alerts by Dave McAllister
OSMC 2023 | Know your data: The stats behind your alerts by Dave McAllisterOSMC 2023 | Know your data: The stats behind your alerts by Dave McAllister
OSMC 2023 | Know your data: The stats behind your alerts by Dave McAllister
 
Need for Speed: How to Performance Test the right way by Annie Bhaumik
Need for Speed: How to Performance Test the right way by Annie BhaumikNeed for Speed: How to Performance Test the right way by Annie Bhaumik
Need for Speed: How to Performance Test the right way by Annie Bhaumik
 
Credit Card Fraudulent Transaction Detection Research Paper
Credit Card Fraudulent Transaction Detection Research PaperCredit Card Fraudulent Transaction Detection Research Paper
Credit Card Fraudulent Transaction Detection Research Paper
 
APPLICATION OF STATISTICAL LEARNING TECHNIQUES AS PREDICTIVE TOOLS FOR MACHIN...
APPLICATION OF STATISTICAL LEARNING TECHNIQUES AS PREDICTIVE TOOLS FOR MACHIN...APPLICATION OF STATISTICAL LEARNING TECHNIQUES AS PREDICTIVE TOOLS FOR MACHIN...
APPLICATION OF STATISTICAL LEARNING TECHNIQUES AS PREDICTIVE TOOLS FOR MACHIN...
 
Quality tools
Quality toolsQuality tools
Quality tools
 
Six sigma-in-measurement-systems-evaluating-the-hidden-factory (2)
Six sigma-in-measurement-systems-evaluating-the-hidden-factory (2)Six sigma-in-measurement-systems-evaluating-the-hidden-factory (2)
Six sigma-in-measurement-systems-evaluating-the-hidden-factory (2)
 
Examples of working with streaming data
Examples of working with streaming dataExamples of working with streaming data
Examples of working with streaming data
 
Case Study - TapAssist
Case Study - TapAssistCase Study - TapAssist
Case Study - TapAssist
 
Finding the best Radio Network Planning and Radio Network Optimization software
Finding the best Radio Network Planning and Radio Network Optimization softwareFinding the best Radio Network Planning and Radio Network Optimization software
Finding the best Radio Network Planning and Radio Network Optimization software
 
(Spring 2012) IT 345 Posters
(Spring 2012) IT 345 Posters(Spring 2012) IT 345 Posters
(Spring 2012) IT 345 Posters
 
Amaya_Presentation
Amaya_PresentationAmaya_Presentation
Amaya_Presentation
 
Scott MacKenzie at BayCHI: Evaluating Eye Tracking Systems for Computer Data ...
Scott MacKenzie at BayCHI: Evaluating Eye Tracking Systems for Computer Data ...Scott MacKenzie at BayCHI: Evaluating Eye Tracking Systems for Computer Data ...
Scott MacKenzie at BayCHI: Evaluating Eye Tracking Systems for Computer Data ...
 
ePoster_Saunak.Amitangshu
ePoster_Saunak.AmitangshuePoster_Saunak.Amitangshu
ePoster_Saunak.Amitangshu
 
Travel_Time_Reliability
Travel_Time_ReliabilityTravel_Time_Reliability
Travel_Time_Reliability
 
Improving Two-Thumb Text Entry on Touchscreen Devices
Improving Two-Thumb Text Entry on Touchscreen DevicesImproving Two-Thumb Text Entry on Touchscreen Devices
Improving Two-Thumb Text Entry on Touchscreen Devices
 

More from Aalto University

"Computational rationality as a theory of interaction" - CHI'22 paper
"Computational rationality as a theory of interaction" - CHI'22 paper"Computational rationality as a theory of interaction" - CHI'22 paper
"Computational rationality as a theory of interaction" - CHI'22 paperAalto University
 
Neuromechanics of a Button Press: A talk at CHI 2018, April 2018
Neuromechanics of a Button Press: A talk at CHI 2018, April 2018Neuromechanics of a Button Press: A talk at CHI 2018, April 2018
Neuromechanics of a Button Press: A talk at CHI 2018, April 2018Aalto University
 
"Computational Support for Functionality Selection in Interaction Design" CHI...
"Computational Support for Functionality Selection in Interaction Design" CHI..."Computational Support for Functionality Selection in Interaction Design" CHI...
"Computational Support for Functionality Selection in Interaction Design" CHI...Aalto University
 
User Interfaces that Design Themselves: Talk given at Data-Driven Design Day ...
User Interfaces that Design Themselves: Talk given at Data-Driven Design Day ...User Interfaces that Design Themselves: Talk given at Data-Driven Design Day ...
User Interfaces that Design Themselves: Talk given at Data-Driven Design Day ...Aalto University
 
Inverse Modeling for Cognitive Science "in the Wild"
Inverse Modeling for Cognitive Science "in the Wild"Inverse Modeling for Cognitive Science "in the Wild"
Inverse Modeling for Cognitive Science "in the Wild"Aalto University
 
Computational Rationality I - a Lecture at Aalto University by Antti Oulasvirta
Computational Rationality I - a Lecture at Aalto University by Antti OulasvirtaComputational Rationality I - a Lecture at Aalto University by Antti Oulasvirta
Computational Rationality I - a Lecture at Aalto University by Antti OulasvirtaAalto University
 
HCI Research as Problem-Solving [CHI'16, presentation slides]
HCI Research as Problem-Solving [CHI'16, presentation slides] HCI Research as Problem-Solving [CHI'16, presentation slides]
HCI Research as Problem-Solving [CHI'16, presentation slides] Aalto University
 
Can Computers Design? Presented at interaction16, March 2, 2016, Helsinki by ...
Can Computers Design? Presented at interaction16, March 2, 2016, Helsinki by ...Can Computers Design? Presented at interaction16, March 2, 2016, Helsinki by ...
Can Computers Design? Presented at interaction16, March 2, 2016, Helsinki by ...Aalto University
 
Model-Based User Interface Optimization: Part V: DISCUSSION - At SICSA Summer...
Model-Based User Interface Optimization: Part V: DISCUSSION - At SICSA Summer...Model-Based User Interface Optimization: Part V: DISCUSSION - At SICSA Summer...
Model-Based User Interface Optimization: Part V: DISCUSSION - At SICSA Summer...Aalto University
 
Model-Based User Interface Optimization: Part IV: ADVANCED TOPICS - At SICSA ...
Model-Based User Interface Optimization: Part IV: ADVANCED TOPICS - At SICSA ...Model-Based User Interface Optimization: Part IV: ADVANCED TOPICS - At SICSA ...
Model-Based User Interface Optimization: Part IV: ADVANCED TOPICS - At SICSA ...Aalto University
 
Model-Based User Interface Optimization: Part III: SOLVING REAL PROBLEMS - At...
Model-Based User Interface Optimization: Part III: SOLVING REAL PROBLEMS - At...Model-Based User Interface Optimization: Part III: SOLVING REAL PROBLEMS - At...
Model-Based User Interface Optimization: Part III: SOLVING REAL PROBLEMS - At...Aalto University
 
Model-Based User Interface Optimization: Part II: LETTER ASSIGNMENT - At SICS...
Model-Based User Interface Optimization: Part II: LETTER ASSIGNMENT - At SICS...Model-Based User Interface Optimization: Part II: LETTER ASSIGNMENT - At SICS...
Model-Based User Interface Optimization: Part II: LETTER ASSIGNMENT - At SICS...Aalto University
 
Model-Based User Interface Optimization: Part I INTRODUCTION - At SICSA Summe...
Model-Based User Interface Optimization: Part I INTRODUCTION - At SICSA Summe...Model-Based User Interface Optimization: Part I INTRODUCTION - At SICSA Summe...
Model-Based User Interface Optimization: Part I INTRODUCTION - At SICSA Summe...Aalto University
 
CHI 2014 talk by Antti Oulasvirta: Automated Nonlinear Regression Modeling fo...
CHI 2014 talk by Antti Oulasvirta: Automated Nonlinear Regression Modeling fo...CHI 2014 talk by Antti Oulasvirta: Automated Nonlinear Regression Modeling fo...
CHI 2014 talk by Antti Oulasvirta: Automated Nonlinear Regression Modeling fo...Aalto University
 
Information Capacity of Full-body Movements (CHI'13)
Information Capacity of Full-body Movements (CHI'13)Information Capacity of Full-body Movements (CHI'13)
Information Capacity of Full-body Movements (CHI'13)Aalto University
 
Studying interaction with 3D mobile maps
Studying interaction with 3D mobile mapsStudying interaction with 3D mobile maps
Studying interaction with 3D mobile mapsAalto University
 

More from Aalto University (16)

"Computational rationality as a theory of interaction" - CHI'22 paper
"Computational rationality as a theory of interaction" - CHI'22 paper"Computational rationality as a theory of interaction" - CHI'22 paper
"Computational rationality as a theory of interaction" - CHI'22 paper
 
Neuromechanics of a Button Press: A talk at CHI 2018, April 2018
Neuromechanics of a Button Press: A talk at CHI 2018, April 2018Neuromechanics of a Button Press: A talk at CHI 2018, April 2018
Neuromechanics of a Button Press: A talk at CHI 2018, April 2018
 
"Computational Support for Functionality Selection in Interaction Design" CHI...
"Computational Support for Functionality Selection in Interaction Design" CHI..."Computational Support for Functionality Selection in Interaction Design" CHI...
"Computational Support for Functionality Selection in Interaction Design" CHI...
 
User Interfaces that Design Themselves: Talk given at Data-Driven Design Day ...
User Interfaces that Design Themselves: Talk given at Data-Driven Design Day ...User Interfaces that Design Themselves: Talk given at Data-Driven Design Day ...
User Interfaces that Design Themselves: Talk given at Data-Driven Design Day ...
 
Inverse Modeling for Cognitive Science "in the Wild"
Inverse Modeling for Cognitive Science "in the Wild"Inverse Modeling for Cognitive Science "in the Wild"
Inverse Modeling for Cognitive Science "in the Wild"
 
Computational Rationality I - a Lecture at Aalto University by Antti Oulasvirta
Computational Rationality I - a Lecture at Aalto University by Antti OulasvirtaComputational Rationality I - a Lecture at Aalto University by Antti Oulasvirta
Computational Rationality I - a Lecture at Aalto University by Antti Oulasvirta
 
HCI Research as Problem-Solving [CHI'16, presentation slides]
HCI Research as Problem-Solving [CHI'16, presentation slides] HCI Research as Problem-Solving [CHI'16, presentation slides]
HCI Research as Problem-Solving [CHI'16, presentation slides]
 
Can Computers Design? Presented at interaction16, March 2, 2016, Helsinki by ...
Can Computers Design? Presented at interaction16, March 2, 2016, Helsinki by ...Can Computers Design? Presented at interaction16, March 2, 2016, Helsinki by ...
Can Computers Design? Presented at interaction16, March 2, 2016, Helsinki by ...
 
Model-Based User Interface Optimization: Part V: DISCUSSION - At SICSA Summer...
Model-Based User Interface Optimization: Part V: DISCUSSION - At SICSA Summer...Model-Based User Interface Optimization: Part V: DISCUSSION - At SICSA Summer...
Model-Based User Interface Optimization: Part V: DISCUSSION - At SICSA Summer...
 
Model-Based User Interface Optimization: Part IV: ADVANCED TOPICS - At SICSA ...
Model-Based User Interface Optimization: Part IV: ADVANCED TOPICS - At SICSA ...Model-Based User Interface Optimization: Part IV: ADVANCED TOPICS - At SICSA ...
Model-Based User Interface Optimization: Part IV: ADVANCED TOPICS - At SICSA ...
 
Model-Based User Interface Optimization: Part III: SOLVING REAL PROBLEMS - At...
Model-Based User Interface Optimization: Part III: SOLVING REAL PROBLEMS - At...Model-Based User Interface Optimization: Part III: SOLVING REAL PROBLEMS - At...
Model-Based User Interface Optimization: Part III: SOLVING REAL PROBLEMS - At...
 
Model-Based User Interface Optimization: Part II: LETTER ASSIGNMENT - At SICS...
Model-Based User Interface Optimization: Part II: LETTER ASSIGNMENT - At SICS...Model-Based User Interface Optimization: Part II: LETTER ASSIGNMENT - At SICS...
Model-Based User Interface Optimization: Part II: LETTER ASSIGNMENT - At SICS...
 
Model-Based User Interface Optimization: Part I INTRODUCTION - At SICSA Summe...
Model-Based User Interface Optimization: Part I INTRODUCTION - At SICSA Summe...Model-Based User Interface Optimization: Part I INTRODUCTION - At SICSA Summe...
Model-Based User Interface Optimization: Part I INTRODUCTION - At SICSA Summe...
 
CHI 2014 talk by Antti Oulasvirta: Automated Nonlinear Regression Modeling fo...
CHI 2014 talk by Antti Oulasvirta: Automated Nonlinear Regression Modeling fo...CHI 2014 talk by Antti Oulasvirta: Automated Nonlinear Regression Modeling fo...
CHI 2014 talk by Antti Oulasvirta: Automated Nonlinear Regression Modeling fo...
 
Information Capacity of Full-body Movements (CHI'13)
Information Capacity of Full-body Movements (CHI'13)Information Capacity of Full-body Movements (CHI'13)
Information Capacity of Full-body Movements (CHI'13)
 
Studying interaction with 3D mobile maps
Studying interaction with 3D mobile mapsStudying interaction with 3D mobile maps
Studying interaction with 3D mobile maps
 

Recently uploaded

User Guide: Pulsar™ Weather Station (Columbia Weather Systems)
User Guide: Pulsar™ Weather Station (Columbia Weather Systems)User Guide: Pulsar™ Weather Station (Columbia Weather Systems)
User Guide: Pulsar™ Weather Station (Columbia Weather Systems)Columbia Weather Systems
 
Servosystem Theory / Cybernetic Theory by Petrovic
Servosystem Theory / Cybernetic Theory by PetrovicServosystem Theory / Cybernetic Theory by Petrovic
Servosystem Theory / Cybernetic Theory by PetrovicAditi Jain
 
User Guide: Magellan MX™ Weather Station
User Guide: Magellan MX™ Weather StationUser Guide: Magellan MX™ Weather Station
User Guide: Magellan MX™ Weather StationColumbia Weather Systems
 
GenAI talk for Young at Wageningen University & Research (WUR) March 2024
GenAI talk for Young at Wageningen University & Research (WUR) March 2024GenAI talk for Young at Wageningen University & Research (WUR) March 2024
GenAI talk for Young at Wageningen University & Research (WUR) March 2024Jene van der Heide
 
Thermodynamics ,types of system,formulae ,gibbs free energy .pptx
Thermodynamics ,types of system,formulae ,gibbs free energy .pptxThermodynamics ,types of system,formulae ,gibbs free energy .pptx
Thermodynamics ,types of system,formulae ,gibbs free energy .pptxuniversity
 
Base editing, prime editing, Cas13 & RNA editing and organelle base editing
Base editing, prime editing, Cas13 & RNA editing and organelle base editingBase editing, prime editing, Cas13 & RNA editing and organelle base editing
Base editing, prime editing, Cas13 & RNA editing and organelle base editingNetHelix
 
Citronella presentation SlideShare mani upadhyay
Citronella presentation SlideShare mani upadhyayCitronella presentation SlideShare mani upadhyay
Citronella presentation SlideShare mani upadhyayupadhyaymani499
 
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 GenuineCall Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuinethapagita
 
Microteaching on terms used in filtration .Pharmaceutical Engineering
Microteaching on terms used in filtration .Pharmaceutical EngineeringMicroteaching on terms used in filtration .Pharmaceutical Engineering
Microteaching on terms used in filtration .Pharmaceutical EngineeringPrajakta Shinde
 
GenBio2 - Lesson 1 - Introduction to Genetics.pptx
GenBio2 - Lesson 1 - Introduction to Genetics.pptxGenBio2 - Lesson 1 - Introduction to Genetics.pptx
GenBio2 - Lesson 1 - Introduction to Genetics.pptxBerniceCayabyab1
 
The dark energy paradox leads to a new structure of spacetime.pptx
The dark energy paradox leads to a new structure of spacetime.pptxThe dark energy paradox leads to a new structure of spacetime.pptx
The dark energy paradox leads to a new structure of spacetime.pptxEran Akiva Sinbar
 
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.PraveenaKalaiselvan1
 
Environmental Biotechnology Topic:- Microbial Biosensor
Environmental Biotechnology Topic:- Microbial BiosensorEnvironmental Biotechnology Topic:- Microbial Biosensor
Environmental Biotechnology Topic:- Microbial Biosensorsonawaneprad
 
FREE NURSING BUNDLE FOR NURSES.PDF by na
FREE NURSING BUNDLE FOR NURSES.PDF by naFREE NURSING BUNDLE FOR NURSES.PDF by na
FREE NURSING BUNDLE FOR NURSES.PDF by naJASISJULIANOELYNV
 
(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)
(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)
(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)riyaescorts54
 
OECD bibliometric indicators: Selected highlights, April 2024
OECD bibliometric indicators: Selected highlights, April 2024OECD bibliometric indicators: Selected highlights, April 2024
OECD bibliometric indicators: Selected highlights, April 2024innovationoecd
 
Best Call Girls In Sector 29 Gurgaon❤️8860477959 EscorTs Service In 24/7 Delh...
Best Call Girls In Sector 29 Gurgaon❤️8860477959 EscorTs Service In 24/7 Delh...Best Call Girls In Sector 29 Gurgaon❤️8860477959 EscorTs Service In 24/7 Delh...
Best Call Girls In Sector 29 Gurgaon❤️8860477959 EscorTs Service In 24/7 Delh...lizamodels9
 
basic entomology with insect anatomy and taxonomy
basic entomology with insect anatomy and taxonomybasic entomology with insect anatomy and taxonomy
basic entomology with insect anatomy and taxonomyDrAnita Sharma
 

Recently uploaded (20)

Volatile Oils Pharmacognosy And Phytochemistry -I
Volatile Oils Pharmacognosy And Phytochemistry -IVolatile Oils Pharmacognosy And Phytochemistry -I
Volatile Oils Pharmacognosy And Phytochemistry -I
 
Let’s Say Someone Did Drop the Bomb. Then What?
Let’s Say Someone Did Drop the Bomb. Then What?Let’s Say Someone Did Drop the Bomb. Then What?
Let’s Say Someone Did Drop the Bomb. Then What?
 
User Guide: Pulsar™ Weather Station (Columbia Weather Systems)
User Guide: Pulsar™ Weather Station (Columbia Weather Systems)User Guide: Pulsar™ Weather Station (Columbia Weather Systems)
User Guide: Pulsar™ Weather Station (Columbia Weather Systems)
 
Servosystem Theory / Cybernetic Theory by Petrovic
Servosystem Theory / Cybernetic Theory by PetrovicServosystem Theory / Cybernetic Theory by Petrovic
Servosystem Theory / Cybernetic Theory by Petrovic
 
User Guide: Magellan MX™ Weather Station
User Guide: Magellan MX™ Weather StationUser Guide: Magellan MX™ Weather Station
User Guide: Magellan MX™ Weather Station
 
GenAI talk for Young at Wageningen University & Research (WUR) March 2024
GenAI talk for Young at Wageningen University & Research (WUR) March 2024GenAI talk for Young at Wageningen University & Research (WUR) March 2024
GenAI talk for Young at Wageningen University & Research (WUR) March 2024
 
Thermodynamics ,types of system,formulae ,gibbs free energy .pptx
Thermodynamics ,types of system,formulae ,gibbs free energy .pptxThermodynamics ,types of system,formulae ,gibbs free energy .pptx
Thermodynamics ,types of system,formulae ,gibbs free energy .pptx
 
Base editing, prime editing, Cas13 & RNA editing and organelle base editing
Base editing, prime editing, Cas13 & RNA editing and organelle base editingBase editing, prime editing, Cas13 & RNA editing and organelle base editing
Base editing, prime editing, Cas13 & RNA editing and organelle base editing
 
Citronella presentation SlideShare mani upadhyay
Citronella presentation SlideShare mani upadhyayCitronella presentation SlideShare mani upadhyay
Citronella presentation SlideShare mani upadhyay
 
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 GenuineCall Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
 
Microteaching on terms used in filtration .Pharmaceutical Engineering
Microteaching on terms used in filtration .Pharmaceutical EngineeringMicroteaching on terms used in filtration .Pharmaceutical Engineering
Microteaching on terms used in filtration .Pharmaceutical Engineering
 
GenBio2 - Lesson 1 - Introduction to Genetics.pptx
GenBio2 - Lesson 1 - Introduction to Genetics.pptxGenBio2 - Lesson 1 - Introduction to Genetics.pptx
GenBio2 - Lesson 1 - Introduction to Genetics.pptx
 
The dark energy paradox leads to a new structure of spacetime.pptx
The dark energy paradox leads to a new structure of spacetime.pptxThe dark energy paradox leads to a new structure of spacetime.pptx
The dark energy paradox leads to a new structure of spacetime.pptx
 
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
 
Environmental Biotechnology Topic:- Microbial Biosensor
Environmental Biotechnology Topic:- Microbial BiosensorEnvironmental Biotechnology Topic:- Microbial Biosensor
Environmental Biotechnology Topic:- Microbial Biosensor
 
FREE NURSING BUNDLE FOR NURSES.PDF by na
FREE NURSING BUNDLE FOR NURSES.PDF by naFREE NURSING BUNDLE FOR NURSES.PDF by na
FREE NURSING BUNDLE FOR NURSES.PDF by na
 
(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)
(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)
(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)
 
OECD bibliometric indicators: Selected highlights, April 2024
OECD bibliometric indicators: Selected highlights, April 2024OECD bibliometric indicators: Selected highlights, April 2024
OECD bibliometric indicators: Selected highlights, April 2024
 
Best Call Girls In Sector 29 Gurgaon❤️8860477959 EscorTs Service In 24/7 Delh...
Best Call Girls In Sector 29 Gurgaon❤️8860477959 EscorTs Service In 24/7 Delh...Best Call Girls In Sector 29 Gurgaon❤️8860477959 EscorTs Service In 24/7 Delh...
Best Call Girls In Sector 29 Gurgaon❤️8860477959 EscorTs Service In 24/7 Delh...
 
basic entomology with insect anatomy and taxonomy
basic entomology with insect anatomy and taxonomybasic entomology with insect anatomy and taxonomy
basic entomology with insect anatomy and taxonomy
 

Observations on typing from 136 million keystrokes - Presentation by Antti Oulasvirta at CHI2018, April 2018, Montreal

  • 1. Observations on Typing Vivek Dhakal, Anna Maria Feit, Per Ola Kristensson, Antti Oulasvirta from 136 Million Keypresses http://userinterfaces.aalto.fi/136Mkeystrokes/
  • 2. Are you fast? Do you use more than 6 fingers?
  • 3. Observations on Typing from 136 Million Keypresses V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018 What do we know about typing? Professionally trained touch typists using typewriters. Findings from 1920-80s: Average speed 75 wpm Error rates 1.0%-3.2% [Grudin 1983] Random letters very slow to type [Shaffer 1968] Hand alternation benefit 30-60 ms [Salthouse 1984] Insertion errors most common [Salthouse 1984]
  • 4. Observations on Typing from 136 Million Keypresses V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018 Many factors have changed since 1970s Key and keyboard design Forces and travel distances Entry tasks and corpora Training
  • 7. Observations on Typing from 136 Million Keypresses V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018 The How-we-Type Study [CHI’16] N=36
  • 9.
  • 10. Observations on Typing from 136 Million Keypresses V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018 Entropy of the finger-to-key mapping Entropy of key k Probability that finger f presses key k
  • 11. Observations on Typing from 136 Million Keypresses V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018 1. Fast typist exhibit less entropy
  • 12. Observations on Typing from 136 Million Keypresses V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018 Preparation of the next key press Average distance of finger to key at previous keypress
  • 13. 2. Fast typists prepare more
  • 14. Global movement Average SD of location of the hand markers (left vs. right)
  • 15. Observations on Typing from 136 Million Keypresses V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018 3. Fast typists move less
  • 16. Gaze deployment: Looking at fingers vs. display
  • 17. 4. Fast typists keep gaze on display
  • 18. Objectives for this study Large dataset on keystroke patterns • Assessment of earlier findings • Statistical analysis of typing patterns • Predictors of typing performance • Descriptors of population tendencies • Modeling Text entry methods Motor control research General understanding Training typing skills
  • 20. Software and services for typing tests What is typing speed and how to measure it? Corpora? Feedback? Repetitions allowed? Metrics?
  • 21. Try it out: http://typingmaster.research.netlab.hut.fi/ Log keydown and keyup events 15 phrases randomly selected from the Enron and Gigaword Datasets Summary page with details on typing performance Method overview
  • 22. Sampling and demographics Advertised by an online typing test service Demographics Result Remark Females 52.7% Rest preferred not to specify Males 41.5% Age: mean 24.5 75% 11–30 yrs SD 11.2 Countries 218 68.05% from US, 85% native language English Took a typing course 72% Hours typing/day: mean 3.2 64% < 2 hrs, 14% > 6 hrs SD 3.2 Qwerty layout 98.1% Rest local alternatives or oth- ers Physical keyboard 43.8% Rest on-screen (touch) Laptop keyboard 54.15% or small physical keyboard Table 1. Background statistics for the participants. 168,960 users
  • 23. Observations on Typing from 136 Million Keypresses V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018 Dataset and metrics Over 400,000 users clicked the link. Over 190,000 completed the test We excluded 12% of participants: • Users with error rate > 25% • Users who did not finish all phrases Words per minute Uncorrected error rate Corrected error rate Error corrections (%) Keystrokes per char. Interkey interval (IKI) Keypress duration Omission, substitution, insertion errors
  • 24. Selected results All WPM corr Fast Slow Trained Untrained Measure X s r X s X s Sign. d X s X s Sign. d WPM 51.56 20.20 – 89.56 9.53 20.91 4.05 • 9.38 54.35 20.80 49.00 19.73 • 0.27 IKI (ms) 238.66 111.60 -0.84 121.70 11.96 481.03 123.36 • 4.10 223.55 107.78 245.34 112.60 • 0.20 Keypr. duration 116.25 23.88 -0.29 104.49 17.38 128.99 28.85 • 1.03 118.39 23.81 115.29 23.85 • 0.13 Unc. Error (%) 1.17 1.43 -0.21 0.71 0.92 1.78 1.94 • 0.70 1.02 1.31 1.23 1.48 • 0.10 Error Correct. (%) 6.31 4.48 -0.36 3.40 2.05 9.05 6.85 • 1.12 5.90 4.40 6.50 4.50 • 0.14 KSPC 1.17 0.09 -0.40 1.10 0.05 1.24 0.14 • 1.24 1.16 0.09 1.18 0.10 • 0.15 Substitutions* (%) 1.65 1.43 -0.45 0.84 0.64 3.72 2.69 • 1.57 1.49 1.37 1.75 1.46 • 0.19 Omissions* (%) 0.80 0.57 -0.33 0.49 0.41 1.29 0.75 • 1.36 0.75 0.58 0.83 0.57 Insertions* (%) 0.67 0.48 -0.15 0.50 0.33 0.80 0.46 • 0.76 0.64 0.49 0.69 0.47 Left IKI (ms) 215.23 96.80 -0.70 124.37 25.90 385.18 147.14 • 2.47 209.43 94.47 217.80 97.77 • 0.09 Right IKI (ms) 203.60 99.13 -0.68 117.24 25.03 379.81 162.40 • 2.26 195.90 97.21 207.02 99.78 • 0.11 Altern. IKI (ms) 198.26 103.95 -0.72 108.62 17.57 408.77 154.25 • 2.73 188.10 98.41 202.76 105.99 • 0.14 Repet. IKI (ms) 176.36 70.26 -0.32 144.79 27.46 230.76 126.21 • 0.94 175.64 66.20 176.68 71.98 • 0.02 Numb. fingers 6.95 2.95 0.34 8.40 2.20 5.30 3.20 • 1.16 8.00 2.46 6.50 3.00 • 0.54 Rollover ratio (%) 25.00 17.00 0.73 49.90 14.00 7.60 6.40 • 3.73 29.00 17.70 24.00 16.70 • 0.29 p>0.01 • p <0.01 • p⌧0.001 X : Mean value s : Standard deviation d: Cohen’s d value * Results based on 783 participants Table 3. Overview of results. At the left are the mean and SD for each measure, correlation of each measure with WPM, and indication of significance. The middle and right part compare fast with slow and trained with untrained typists, respectively. Unless otherwise denoted, statistical significance of tabulated results has been tested at the 1% level via the Mann–Whitney signed rank test.
  • 25. Words per minute Avg. 51.6 wpm (SD 20, max 120) Trained touchtypists 5 wpm faster Slower than 30 years ago Touchtyping training not very predictive of fast typing
  • 26. Error rates Average error rate 1.16% 2.3 error corrections per sentence Substitution, not insertion errors
  • 27. Interkey interval vs. Keypress duration Avg IKI 239 ms (SD 111) Avg KPD 116 ms (SD 24) KPD uniform, not predictive of wpm IKI has high variance
  • 28. Observations on Typing from 136 Million Keypresses V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018 Error vs. speed Correlation with wpm r = - 0.36 Even a small decrease in error rate improves speed Hard to be fast if you make errors
  • 29. Observations on Typing from 136 Million Keypresses V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018 Number of fingers used Correlation with wpm r = 0.38 Fast users use more fingers
  • 30. Observations on Typing from 136 Million Keypresses V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018 Roll-over typing Typing a consecutive key before releasing the earlier key Known in eSports and by keyboard manufacturers, but not in studies of typing About 30 ms overlap
  • 31. Rollover vs. typing speed Correlation with wpm r = 0.73 Average 25% Highly correlated with speed
  • 32. Eight typing patterns identifiable Unsupervised k-medoids clustering Features: IKIs of 38 bigrams Numb. of Rollover Left Right Alternation Error rate (%) Cl. # particip. WPM ratio (%) IKI (ms) IKI (ms) IKI (ms) IKI (ms) Uncorrected (%) Omission Insertion Subst. KSPC 1 38,012 46.5 19.98 245.8 221.9 218.5 202.1 1.260 0.70 0.59 1.7 1.177 2 12,930 48.12 19.29 235.3 217.0 216.2 185.3 1.313 0.90 0.77 2.0 1.179 3 13,397 52.36 24.44 214.9 205.3 203.8 175.4 1.263 0.92 0.81 1.7 1.186 4 15,498 53.12 26.23 212.3 204.6 192.7 174.5 1.187 0.80 0.76 1.6 1.175 5 7,731 53.87 21.17 205.3 205.9 199.9 159.3 1.220 0.90 0.64 1.8 1.185 6 22,980 56.50 27.20 197.8 180.5 179.8 161.2 1.147 0.81 0.67 1.7 1.176 7 19,757 64.59 35.75 181.9 173.1 163.2 153.9 1.094 0.71 0.63 1.6 1.162 8 35,068 68.35 37.76 161.9 159.5 150.1 138.2 0.969 0.61 0.64 1.1 1.158 Table 4. Overview of the analysed measures differing between clusters, showing that differences in keystroke patterns affect typing performance. that resulted in maximum isolation of clusters for further in- 3: AVERAGE-BUT-ERROR-PRONE Average typists (⇠52 WPM) Figure 6. Distribution of rollover ratios across participants for fast and slow typists. Slow typists use nearly no rollover, whereas the majority of fast typists use rollover for 40–70% of keystrokes. Results The average rollover ratio is 25% (SD = 17%), with most typists performing at least a small percentage of keystrokes by means of rollover. Rollover ratio is found to have a high correlation with performance (r = 0.73, p < 0.001). Figure 6 compares the distribution of rollover ratios across fast and slow typists. While slow typists use almost no rollover, the majority of fast typists use rollover for 40–70% of keypresses. Trained typists average ⇠5% more rollover than untrained typists. When rollover is used, keystrokes overlap by 30 ms, on average, and up to 100 ms. The prevalence of this behaviour was surprising. To further validate it, we looked at high- Figure 7. Isolation values for different numbers of clusters obtained by the PAM clustering method. N = 8 clusters yields the best value while giving a low number of meaningful clusters. but capturing the typing behaviour. For each user, we con- structed 38 features representing the normalised IKI for the most frequently typed bigrams, following two steps: 1. Bigram selection: Since participants typed different sen- tences, the dataset did not contain observations for each user and each bigram. Given the bigrams in Table 2 extended with frequent bigrams ending with a spacebar press, we chose the maximum set of bigrams and participants such that the data contained observations from at least 90% of participants. This resulted in 38 bigrams for 97.8% of participants (the rest were excluded from clustering). 2. Normalisation: For each user and each of the 38 bigrams,
  • 33. Typing styles (clusters) 1. Slow, careful typists 2. Slow, careless hand alternations 3. Average-but-error-prone 4. Average right-hand typists 5. Average hand alternations 6. Average typists 7. Fast, error-prone typists 8. Fast rollovers
  • 34. Observations on Typing from 136 Million Keypresses V. Dhakal, A.M. Feit, P-O. Kristensson, A. Oulasvirta Proc. CHI 2018 Limitations The sample • Self-selected typists • Unrepresentative sample - Most are young and 68% from the US - 70% taken a typing course (cf. 43% in general population) - Plenty of typing per day (> 3h/day) Imprecision of keyevent measurements • Javascript-based keylogging has a precision of about 15 ms
  • 36. The 136M Keystrokes Dataset Readme.txt 16 GB
  • 37. Take-away: Non-uniformity of typing Typing is changing Typing styles emerge with use and are diverse Typing performance is getting worse Some statistical patterns identifiable We should not assume uniformity of typing in motor control research, design, modeling, nor training
  • 38. How to become a faster typist (without learning touch-typing)?
  • 39. Observations on Typing from 136 Million Keystrokes Get the data: • 136 Million keystrokes from 169,000 users • Demographics, typing experience, etc. • WPM, Errors, IKI, etc. http://userinterfaces.aalto.fi/136Mkeystrokes/ New observations • Average speed coming down • Rollover associated with WPM • Error corrections very costly to WPM • Uniform keypress duration • Substitution errors most common • Few clusters describe typing styles