Prediction of Impulsive Input on
Gamepad Using Force-Sensitive
Resistor
Atsuya Munakata
Keio University
Yuta Sugiura
Keio University
01 STORY
02 THEORY
Predicting Input from Changes in Pressure
on Button Surface
- Just before the button state change, there is a steep pressure change on
a button.
- Put a force-sensitive resistor (FSR) on a tactile switch.
- Apply edge extraction to time series data of pressure change.
- Regard extracted edges as the signs of future button input.
Cloud gaming suffers from latency
in terms of game response in
communicating with remote servers.
Background
It is difficult to predict impulsive input,
e.g. firing gun, by the probability
model that learns user inputs.
Problem
We install a force-sensitive resistor on
a button to detect the initial movement
of a finger pressing the button.
Approach
03 PREDICTING ON EVENT
- Adopt gradient filter in
which The original data is
processed by erosion and
then subtracted from the
original data.
- Set appropriate threshold
to detect the edge.
04 PREDICTING OFF EVENT
- Regard the pressure
change around button OFF
event as cosine wave and
convert it to sin wave in
phase.
- The same edge extraction
process can be applied.
05 EVALUATION
- Experiment on eight people.
- ON: 30.82ms in advance on
average
- OFF: 29.30ms in advance on
average
- Accuracy: 87.88% on harmonic
average
06 FUTURE WORK
- Confirm that our method can be applied to the
controllers on the market.
- Cancel differences between the individual way in
pressing button by ingenuity of mechanism.
- Implement dynamic setting of parameters that suit
each user.
Contact: info-lcl-group@keio.jp
0
10
20
30
40
50
60
70
80
A B C D E F G H
Predictiontime[ms]
Participants
ON
OFF
0
10
20
30
40
50
60
70
80
90
100
Accuracy for
button press
Accuracy for
button release
Harmonic mean
of both
accuracies
Predictionaccuracy[%]
A
B
C
D
E
F
G
H
0
1
2
3
4
5
6
Voltage[V]
Sample
FSR Button
0
1
2
3
4
5
6
Voltage[V]
Sample
Button Detected edge (ON)
0
1
2
3
4
5
6
Voltage[V]
Sample
Cos-to-sin transformation Button
0
1
2
3
4
5
6
Voltage[V]
Sample
Button Detected edge (OFF)

Prediction of Impulsive Input on Gamepad Using Force-Sensitive Resistor (TEI2020)

  • 1.
    Prediction of ImpulsiveInput on Gamepad Using Force-Sensitive Resistor Atsuya Munakata Keio University Yuta Sugiura Keio University 01 STORY 02 THEORY Predicting Input from Changes in Pressure on Button Surface - Just before the button state change, there is a steep pressure change on a button. - Put a force-sensitive resistor (FSR) on a tactile switch. - Apply edge extraction to time series data of pressure change. - Regard extracted edges as the signs of future button input. Cloud gaming suffers from latency in terms of game response in communicating with remote servers. Background It is difficult to predict impulsive input, e.g. firing gun, by the probability model that learns user inputs. Problem We install a force-sensitive resistor on a button to detect the initial movement of a finger pressing the button. Approach 03 PREDICTING ON EVENT - Adopt gradient filter in which The original data is processed by erosion and then subtracted from the original data. - Set appropriate threshold to detect the edge. 04 PREDICTING OFF EVENT - Regard the pressure change around button OFF event as cosine wave and convert it to sin wave in phase. - The same edge extraction process can be applied. 05 EVALUATION - Experiment on eight people. - ON: 30.82ms in advance on average - OFF: 29.30ms in advance on average - Accuracy: 87.88% on harmonic average 06 FUTURE WORK - Confirm that our method can be applied to the controllers on the market. - Cancel differences between the individual way in pressing button by ingenuity of mechanism. - Implement dynamic setting of parameters that suit each user. Contact: info-lcl-group@keio.jp 0 10 20 30 40 50 60 70 80 A B C D E F G H Predictiontime[ms] Participants ON OFF 0 10 20 30 40 50 60 70 80 90 100 Accuracy for button press Accuracy for button release Harmonic mean of both accuracies Predictionaccuracy[%] A B C D E F G H 0 1 2 3 4 5 6 Voltage[V] Sample FSR Button 0 1 2 3 4 5 6 Voltage[V] Sample Button Detected edge (ON) 0 1 2 3 4 5 6 Voltage[V] Sample Cos-to-sin transformation Button 0 1 2 3 4 5 6 Voltage[V] Sample Button Detected edge (OFF)