SlideShare a Scribd company logo
1 of 1
Download to read offline
107 - Music Synchronizer with Runner's Pace for Supporting Steady Pace Jogging
Tetsuro Kitahara, Shunsuke Hokari, and Tatsuya Nagayasu (Nihon University, Japan)
Contact: Tetsuro Kitahara <e-mail: kitahara@chs.nihon-u.ac.jp, Twitter: @tetsurokitahara>
http://www.kthrlab.jp/
Core Time: 10:00-11:00 & 15:30-16:30 on every day
You can try our system! Let's try it!!
Our Goal: To allow everyone enjoy jogging
● Issue in jogging: To keep a steady pace
(In particular, to avoid a pace decrease due to tiredness)
→ Automatically alert the pace decrease
● Our idea: Auditory feedback of the pace decrease based on
synchronization of music playback speed with the pace
● Why music synchronization?
- No interference with vision
- Many people jog while listening to music
● Related works:
- Rubisch et al.(2010)
- Sakata et al.(2006)
Only proposal and prototype implementation (no experiments)
System Overview
START
Load waveforms with different
playback speeds
Choose a musical piece
Start music playback
Measure user's standard pace
Measure jogging pace
Switch waveform
Pace changed?
for 10 secs
After 5 sec passes...
Yes
No
Music is repeatedly played back
● Run on an Android device
● User wears the device on
his/her hip using a belt
How to measure pace
● Using the acceleration
sensor built in the device
● Acceleration value:
α(t) = |ax
(t) – ax
(t-1)|
+ |ay
(t) – ay
(t-1)|
+ |az
(t) – az
(t-1)|
is calculated every 80ms
● When α(t) > θ (threshold),
the step is counted
● # of steps for last 4 secs
is regarded as the pace
Every sec...
Preparation of waveforms
● Waveforms with speeds of
0.5, 0.6, …, 2.0 need to be
prepared in advance on PC
Experiment
Condition
● Participants: 10 people (8 male / 2 female, age: 22—23)
● Participants E & H often exercise, the others usually do not
Procedure
Jog
2 min
Jog Jog30s
2 min
30s
2 min
Jog
2 min
Jog Jog30s
2 min
30s
2 min
Rest
enoughWith normal playback With our system
Jog
2 min
Jog Jog30s
2 min
30s
2 min
Jog
2 min
Jog Jog30s
2 min
30s
2 min
Rest
enoughWith our system With normal playback
Results
Partic
ipant
With normal
playback
With our system
1st 2nd 3rd 1st 2nd 3rd
A 29.5 22.5 15.5 28.0 21.0 21.0
B 10.4 20.9 24.2 21.5 23.8 22.4
C 26.4 23.2 23.3 27.5 30.0 29.6
D 26.2 26.3 25.7 27.5 30.0 29.6
E 27.2 26.1 27.4 30.2 27.7 28.8
F 10.8 12.5 12.7 11.1 12.0 11.2
G 19.3 19.4 18.6 27.0 22.8 19.4
H 8.2 21.8 24.6 24.7 29.5 30.1
Average pace in each trial
Pace
down
Participants I & J: data loss
Steady
pace
or
Standard deviation of temporal pace variation
Partic
ipant
With normal
playback
With our system
1st 2nd 3rd 1st 2nd 3rd
A 0.5 10.5 3.5 2.0 2.0 3.0
B 2.8 5.3 3.6 4.0 3.9 3.0
C 4.3 4.3 4.2 4.0 3.6 3.4
D 3.5 3.7 3.5 3.4 3.7 3.4
E 5.1 4.1 4.2 5.1 3.9 5.0
F 1.6 3.7 2.3 2.0 2.3 1.8
G 3.9 4.1 3.1 4.1 3.5 3.3
H 2.1 4.0 4.9 3.8 5.1 4.6
Fairly
low
Steady
pace
Example of temporal pace variation
With normal playback With our system
Pace decreased at turning back
Please write your comments here!

More Related Content

More from kthrlab

盛り上がり度に基づくループシーケンサにおけるユーザ適応の試み
盛り上がり度に基づくループシーケンサにおけるユーザ適応の試み盛り上がり度に基づくループシーケンサにおけるユーザ適応の試み
盛り上がり度に基づくループシーケンサにおけるユーザ適応の試み
kthrlab
 
卒研発表
卒研発表卒研発表
卒研発表
kthrlab
 
盛り上がり度に基づくループシーケンサにおけるユーザ適応の試み
盛り上がり度に基づくループシーケンサにおけるユーザ適応の試み盛り上がり度に基づくループシーケンサにおけるユーザ適応の試み
盛り上がり度に基づくループシーケンサにおけるユーザ適応の試み
kthrlab
 
卒論発表_oshita
卒論発表_oshita卒論発表_oshita
卒論発表_oshita
kthrlab
 
多人数演奏楽譜から連弾譜への自動編曲
多人数演奏楽譜から連弾譜への自動編曲多人数演奏楽譜から連弾譜への自動編曲
多人数演奏楽譜から連弾譜への自動編曲
kthrlab
 
振りのタイミングを評価するダンス練習システム
振りのタイミングを評価するダンス練習システム振りのタイミングを評価するダンス練習システム
振りのタイミングを評価するダンス練習システム
kthrlab
 

More from kthrlab (20)

盛り上がり度に基づくループシーケンサにおけるユーザ適応の試み
盛り上がり度に基づくループシーケンサにおけるユーザ適応の試み盛り上がり度に基づくループシーケンサにおけるユーザ適応の試み
盛り上がり度に基づくループシーケンサにおけるユーザ適応の試み
 
卒研発表
卒研発表卒研発表
卒研発表
 
GTTM分析器「PyGTTM」の試作,及び,ディープラーニングを用いた精度向上の試み
GTTM分析器「PyGTTM」の試作,及び,ディープラーニングを用いた精度向上の試みGTTM分析器「PyGTTM」の試作,及び,ディープラーニングを用いた精度向上の試み
GTTM分析器「PyGTTM」の試作,及び,ディープラーニングを用いた精度向上の試み
 
盛り上がり度に基づくループシーケンサにおけるユーザ適応の試み
盛り上がり度に基づくループシーケンサにおけるユーザ適応の試み盛り上がり度に基づくループシーケンサにおけるユーザ適応の試み
盛り上がり度に基づくループシーケンサにおけるユーザ適応の試み
 
卒論発表_oshita
卒論発表_oshita卒論発表_oshita
卒論発表_oshita
 
多人数演奏楽譜から連弾譜への自動編曲
多人数演奏楽譜から連弾譜への自動編曲多人数演奏楽譜から連弾譜への自動編曲
多人数演奏楽譜から連弾譜への自動編曲
 
振りのタイミングを評価するダンス練習システム
振りのタイミングを評価するダンス練習システム振りのタイミングを評価するダンス練習システム
振りのタイミングを評価するダンス練習システム
 
北原研究室の研究事例紹介:ベーシストの旋律分析とイコライザーの印象分析(Music×Analytics Meetup vol.5 ロングトーク)
北原研究室の研究事例紹介:ベーシストの旋律分析とイコライザーの印象分析(Music×Analytics Meetup vol.5 ロングトーク)北原研究室の研究事例紹介:ベーシストの旋律分析とイコライザーの印象分析(Music×Analytics Meetup vol.5 ロングトーク)
北原研究室の研究事例紹介:ベーシストの旋律分析とイコライザーの印象分析(Music×Analytics Meetup vol.5 ロングトーク)
 
誰もが創作を通じて音楽を楽しめる世界を目指して(音学シンポジウム2021 招待講演)
誰もが創作を通じて音楽を楽しめる世界を目指して(音学シンポジウム2021 招待講演)誰もが創作を通じて音楽を楽しめる世界を目指して(音学シンポジウム2021 招待講演)
誰もが創作を通じて音楽を楽しめる世界を目指して(音学シンポジウム2021 招待講演)
 
音楽と情報科学
音楽と情報科学音楽と情報科学
音楽と情報科学
 
土浦日大高校向け模擬授業「音楽と情報科学」(日本大学文理学部)
土浦日大高校向け模擬授業「音楽と情報科学」(日本大学文理学部)土浦日大高校向け模擬授業「音楽と情報科学」(日本大学文理学部)
土浦日大高校向け模擬授業「音楽と情報科学」(日本大学文理学部)
 
音楽の知識表現:自動作編曲への応用
音楽の知識表現:自動作編曲への応用音楽の知識表現:自動作編曲への応用
音楽の知識表現:自動作編曲への応用
 
平成30年度 日本大学文理学部オープンキャンパス 「人工知能ってどんな仕組み?
平成30年度 日本大学文理学部オープンキャンパス 「人工知能ってどんな仕組み?平成30年度 日本大学文理学部オープンキャンパス 「人工知能ってどんな仕組み?
平成30年度 日本大学文理学部オープンキャンパス 「人工知能ってどんな仕組み?
 
平成29年度 日本大学文理学部オープンキャンパス 「人工知能ってどんな仕組み?」
平成29年度 日本大学文理学部オープンキャンパス 「人工知能ってどんな仕組み?」平成29年度 日本大学文理学部オープンキャンパス 「人工知能ってどんな仕組み?」
平成29年度 日本大学文理学部オープンキャンパス 「人工知能ってどんな仕組み?」
 
バルセロナ在外研究報告「統計モデルによるメロディのモデル化とその自動作曲・自動編曲への応用」
バルセロナ在外研究報告「統計モデルによるメロディのモデル化とその自動作曲・自動編曲への応用」バルセロナ在外研究報告「統計モデルによるメロディのモデル化とその自動作曲・自動編曲への応用」
バルセロナ在外研究報告「統計モデルによるメロディのモデル化とその自動作曲・自動編曲への応用」
 
音楽と情報科学
音楽と情報科学音楽と情報科学
音楽と情報科学
 
音楽の非専門家が演奏・創作を通じて音楽を楽しめる世界を目指して
音楽の非専門家が演奏・創作を通じて音楽を楽しめる世界を目指して音楽の非専門家が演奏・創作を通じて音楽を楽しめる世界を目指して
音楽の非専門家が演奏・創作を通じて音楽を楽しめる世界を目指して
 
音声認識の仕組みを知ろう
音声認識の仕組みを知ろう音声認識の仕組みを知ろう
音声認識の仕組みを知ろう
 
Introduction of my research histroy: From instrument recognition to support o...
Introduction of my research histroy: From instrument recognition to support o...Introduction of my research histroy: From instrument recognition to support o...
Introduction of my research histroy: From instrument recognition to support o...
 
音楽で理解する情報科学のいろは
音楽で理解する情報科学のいろは音楽で理解する情報科学のいろは
音楽で理解する情報科学のいろは
 

Recently uploaded

Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Sérgio Sacani
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdf
PirithiRaju
 
Seismic Method Estimate velocity from seismic data.pptx
Seismic Method Estimate velocity from seismic  data.pptxSeismic Method Estimate velocity from seismic  data.pptx
Seismic Method Estimate velocity from seismic data.pptx
AlMamun560346
 
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptxSCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
RizalinePalanog2
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
gindu3009
 
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
PirithiRaju
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Sérgio Sacani
 
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
ssuser79fe74
 

Recently uploaded (20)

Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
 
CELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdfCELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdf
 
Site Acceptance Test .
Site Acceptance Test                    .Site Acceptance Test                    .
Site Acceptance Test .
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdf
 
Seismic Method Estimate velocity from seismic data.pptx
Seismic Method Estimate velocity from seismic  data.pptxSeismic Method Estimate velocity from seismic  data.pptx
Seismic Method Estimate velocity from seismic data.pptx
 
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptxSCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
 
American Type Culture Collection (ATCC).pptx
American Type Culture Collection (ATCC).pptxAmerican Type Culture Collection (ATCC).pptx
American Type Culture Collection (ATCC).pptx
 
Zoology 4th semester series (krishna).pdf
Zoology 4th semester series (krishna).pdfZoology 4th semester series (krishna).pdf
Zoology 4th semester series (krishna).pdf
 
Kochi ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Kochi ESCORT SERVICE❤CALL GIRL
Kochi ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Kochi ESCORT SERVICE❤CALL GIRLKochi ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Kochi ESCORT SERVICE❤CALL GIRL
Kochi ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Kochi ESCORT SERVICE❤CALL GIRL
 
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
 
Hire 💕 9907093804 Hooghly Call Girls Service Call Girls Agency
Hire 💕 9907093804 Hooghly Call Girls Service Call Girls AgencyHire 💕 9907093804 Hooghly Call Girls Service Call Girls Agency
Hire 💕 9907093804 Hooghly Call Girls Service Call Girls Agency
 
Call Girls Alandi Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Alandi Call Me 7737669865 Budget Friendly No Advance BookingCall Girls Alandi Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Alandi Call Me 7737669865 Budget Friendly No Advance Booking
 
Proteomics: types, protein profiling steps etc.
Proteomics: types, protein profiling steps etc.Proteomics: types, protein profiling steps etc.
Proteomics: types, protein profiling steps etc.
 
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
 
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verifiedConnaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
 
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
 
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
 
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
 

Music Synchronizer with Runner's Pace for Supporting Steady Pace Jogging

  • 1. 107 - Music Synchronizer with Runner's Pace for Supporting Steady Pace Jogging Tetsuro Kitahara, Shunsuke Hokari, and Tatsuya Nagayasu (Nihon University, Japan) Contact: Tetsuro Kitahara <e-mail: kitahara@chs.nihon-u.ac.jp, Twitter: @tetsurokitahara> http://www.kthrlab.jp/ Core Time: 10:00-11:00 & 15:30-16:30 on every day You can try our system! Let's try it!! Our Goal: To allow everyone enjoy jogging ● Issue in jogging: To keep a steady pace (In particular, to avoid a pace decrease due to tiredness) → Automatically alert the pace decrease ● Our idea: Auditory feedback of the pace decrease based on synchronization of music playback speed with the pace ● Why music synchronization? - No interference with vision - Many people jog while listening to music ● Related works: - Rubisch et al.(2010) - Sakata et al.(2006) Only proposal and prototype implementation (no experiments) System Overview START Load waveforms with different playback speeds Choose a musical piece Start music playback Measure user's standard pace Measure jogging pace Switch waveform Pace changed? for 10 secs After 5 sec passes... Yes No Music is repeatedly played back ● Run on an Android device ● User wears the device on his/her hip using a belt How to measure pace ● Using the acceleration sensor built in the device ● Acceleration value: α(t) = |ax (t) – ax (t-1)| + |ay (t) – ay (t-1)| + |az (t) – az (t-1)| is calculated every 80ms ● When α(t) > θ (threshold), the step is counted ● # of steps for last 4 secs is regarded as the pace Every sec... Preparation of waveforms ● Waveforms with speeds of 0.5, 0.6, …, 2.0 need to be prepared in advance on PC Experiment Condition ● Participants: 10 people (8 male / 2 female, age: 22—23) ● Participants E & H often exercise, the others usually do not Procedure Jog 2 min Jog Jog30s 2 min 30s 2 min Jog 2 min Jog Jog30s 2 min 30s 2 min Rest enoughWith normal playback With our system Jog 2 min Jog Jog30s 2 min 30s 2 min Jog 2 min Jog Jog30s 2 min 30s 2 min Rest enoughWith our system With normal playback Results Partic ipant With normal playback With our system 1st 2nd 3rd 1st 2nd 3rd A 29.5 22.5 15.5 28.0 21.0 21.0 B 10.4 20.9 24.2 21.5 23.8 22.4 C 26.4 23.2 23.3 27.5 30.0 29.6 D 26.2 26.3 25.7 27.5 30.0 29.6 E 27.2 26.1 27.4 30.2 27.7 28.8 F 10.8 12.5 12.7 11.1 12.0 11.2 G 19.3 19.4 18.6 27.0 22.8 19.4 H 8.2 21.8 24.6 24.7 29.5 30.1 Average pace in each trial Pace down Participants I & J: data loss Steady pace or Standard deviation of temporal pace variation Partic ipant With normal playback With our system 1st 2nd 3rd 1st 2nd 3rd A 0.5 10.5 3.5 2.0 2.0 3.0 B 2.8 5.3 3.6 4.0 3.9 3.0 C 4.3 4.3 4.2 4.0 3.6 3.4 D 3.5 3.7 3.5 3.4 3.7 3.4 E 5.1 4.1 4.2 5.1 3.9 5.0 F 1.6 3.7 2.3 2.0 2.3 1.8 G 3.9 4.1 3.1 4.1 3.5 3.3 H 2.1 4.0 4.9 3.8 5.1 4.6 Fairly low Steady pace Example of temporal pace variation With normal playback With our system Pace decreased at turning back Please write your comments here!