SlideShare a Scribd company logo
A Dance Performance Environment
in which Performers Dance with
Multiple Robotic Balls
Shuhei Tsuchida†1, Tsutomu Terada†1†2, Masahiko Tsukamoto†1
†1 Kobe University
†2 JST PRESTO
Demo Movie (ACE2015 in Malaysia) 2
Tod Machover: Death and the Powers
https://www.youtube.com/watch?v=mPp9juefl2Y
elevenplay:Dance with Drones
https://www.youtube.com/watch?v=HQLORg5COiU
In recent years, as robotics technology progresses,
various robots have been developed to dance with humans.
Background 3
Tod Machover: Death and the Powers
https://www.youtube.com/watch?v=mPp9juefl2Y
elevenplay:Dance with Drones
https://www.youtube.com/watch?v=HQLORg5COiU
In recent years, as robotics technology progresses,
various robots have been developed to dance with humans.
Background 3
Tod Machover: Death and the Powers
https://www.youtube.com/watch?v=mPp9juefl2Y
elevenplay:Dance with Drones
https://www.youtube.com/watch?v=HQLORg5COiU
In recent years, as robotics technology progresses,
various robots have been developed to dance with humans.
Background 3
Tod Machover: Death and the Powers
https://www.youtube.com/watch?v=mPp9juefl2Y
elevenplay:Dance with Drones
https://www.youtube.com/watch?v=HQLORg5COiU
In recent years, as robotics technology progresses,
various robots have been developed to dance with humans.
Background 3
However, it is difficult for the performer
to create the performance using the mobile robots.
①Image
Engineer
Performer
System
③Creating
Result
Problem 7
②Input
&
Output
①Image
Engineer
Performer
System
③Creating
Result
Problem 7
Image
②Input
&
Output
①Image
Engineer
Performer
System
③Creating
Result
②Input
&
Output
Problem 7
Image Creating Result
①Image
Engineer
Performer
System
③Creating
Result
②Input
&
Output
Problem 7
Image Creating Result
The performer cannot interactively
create a performance using the system.
We construct a mechanism by which a performer
can interactively create a performance
while he/she considers the correspondence
between his/her motion and
the mobile robots' movement and light.
Purpose 8
General Method
Proposed System (1/2) 9
①Image
Engineer
Performer
System
③Creating
Result
②Input
&
Output
Image Creating Result
Proposed System (1/2) 9
General Method
①Image
Engineer
Performer
System
③Creating
Result
②Input
&
Output
Image Creating Result
Proposed Method
Proposed System (2/2) 10
①Input
&
Output
System
Performer
Image Creating Result
・A performer with no knowledge of programming
can create patterns of the movement and
light of robotic balls to certain music and choreography
by mouse operation.
・A performer can easily confirm
the choreography of dancing with
robotic balls on a simulator.
Simulator
Motion Input
System Design 11
Size︓ diameter 74 [mm]
Weight︓ 168 [g]
Maximum speed︓ 2 [m/s]
Communication distance︓ max 30 [m]
Hardware (1/2) 12
Hardware (2/2) 13
LiPo battery
Driving part
of Sphero
Infrared LED
ABS rein Plastic
Hardware (2/2) 13
LiPo battery
Driving part
of Sphero
Infrared LED
1. Creating movements and lights 2. Confirming on the simulator
3. Saving the pattern 4. Confirming with robotic balls
PC
Mobile phone
Moving pattern
Light pattern
System Configuration 14
1. Creating movements and lights 2. Confirming on the simulator
3. Saving the pattern 4. Confirming with robotic balls
PC
Mobile phone
Moving pattern
Light pattern
System Configuration 14
Application for Creating
the Movement and the Light of Robotic Balls
Control System for Robotic Balls
1. Creating movements and lights 2. Confirming on the simulator
3. Saving the pattern 4. Confirming with robotic balls
PC
Mobile phone
Moving pattern
Light pattern
System Configuration 14
Application for Creating
the Movement and the Light of Robotic Balls
Control System for Robotic Balls
Application for Creating
the Movement and the Light of Robotic Balls 15
1. Creating movements and lights 2. Confirming on the simulator
3. Saving the pattern 4. Confirming with robotic balls
PC
Mobile phone
Moving pattern
Light pattern
System Configuration 14
Application for Creating
the Movement and the Light of Robotic Balls
Control System for Robotic Balls
The user saves the pattern of the moving and light of
robotic balls to the mobile phone and PC for control.
moving
pattern
light
pattern
Control System for Robotic Balls (1/2) 16
moving
pattern
light
pattern
infrared
Control System for Robotic Balls (1/2) 17
The user performs fitting the moving and the light of robotic
balls that synchronize a music.
・The system cannot detect the position when the dancer was
between the camera and the robotic ball.
・The speed of robotic balls is limited.
・It cannot move to draw a curve.
System Restriction 18
Survey items
・Performance creation time
・System usability
Participant
Males 4,Average age 22.3
・Performer who had been dancing for more than four years.
(4/4)
・Performer who had some experience in performance creation
using robotic balls. (1/4)
19
Evaluation Experiment (1/3)
Evaluation Experiment (2/3) 20
Experiment Procedure
(1) The participant receives a 20-minute explanation about
how to use the application.
(2) The participant uses the application to create
choreography based on a song about 1 minutes,
10 seconds long at 120 BPM.
(3) The participant confirms the choreography
on the application.
(4) The participant carries out a performance
using robotic balls.
Experiment Procedure
(1) The participant receives a 20-minute explanation about
how to use the application.
(2) The participant uses the application to create
choreography based on a song about 1 minutes,
10 seconds long at 120 BPM.
(3) The participant confirms the choreography
on the application.
(4) The participant carries out a performance
using robotic balls.
Evaluation Experiment (2/3) 20
20-minute explanation
①
Evaluation Experiment (2/3) 20
Experiment Procedure
(1) The participant receives a 20-minute explanation about
how to use the application.
(2) The participant uses the application to create
choreography based on a song about 1 minutes,
10 seconds long at 120 BPM.
(3) The participant confirms the choreography
on the application.
(4) The participant carries out a performance
using robotic balls.
Creating a choreography
②
01m10s
Experiment Procedure
(1) The participant receives a 20-minute explanation about
how to use the application.
(2) The participant uses the application to create
choreography based on a song about 1 minutes,
10 seconds long at 120 BPM.
(3) The participant confirms the choreography
on the application.
(4) The participant carries out a performance
using robotic balls.
Evaluation Experiment (2/3) 20
Confirming a choreography
on the simulator
③
Experiment Procedure
(1) The participant receives a 20-minute explanation about
how to use the application.
(2) The participant uses the application to create
choreography based on a song about 1 minutes,
10 seconds long at 120 BPM.
(3) The participant confirms the choreography
on the application.
(4) The participant carries out a performance
using robotic balls.
Evaluation Experiment (2/3) 20
Kinect
Projetor
Images
Evaluation Experiment (2/3) 20
Experiment Procedure
(1) The participant receives a 20-minute explanation about
how to use the application.
(2) The participant uses the application to create
choreography based on a song about 1 minutes,
10 seconds long at 120 BPM.
(3) The participant confirms the choreography
on the application.
(4) The participant carries out a performance
using robotic balls.
Performance
④
Experiment Procedure
(1) The participant receives a 20-minute explanation about
how to use the application.
(2) The participant uses the application to create
choreography based on a song about 1 minute,
10 seconds long at 120 BPM.
(3) The participant confirms the choreography
on the application.
(4) The participant carries out a performance
using robotic balls.
Evaluation Experiment (2/3) 20
Recording Time
for creating
・One B5 paper and a pen were also used
when creating the choreography.
・The experimenter received the question about
how to operate the application during the experiment.
・The time taken for the experimental procedures 2 and 3 was
noted and a 10-minute break was scheduled every hour.
At the end of the experiment
・Participants provided feedback on the application.
Evaluation Experiment (3/3) 21
Results (1/3) 22
Results of questionnaire
・The application was that its movements were
immediately clear at a glance.
・It was hard to determine the sense of distance
with the robotic balls while confirming the choreography
via simulator display.
・The setting to take color gradient between keyframes
made it hard to operate when participant was
deciding on the lighting
Results (2/3) 23
Participant Performance creation time
1 2hour, 38minutes
2 3hour, 29minutes
3 2hour, 17minutes
4※ 1hour, 4minutes
※Participant 4 has
the experience using
the system
Time taken by participants for performance creation.
Results (3/3) 24
Participant Performance creation time
1 2hour, 38minutes
2 3hour, 29minutes
3 2hour, 17minutes
4※ 1hour, 4minutes
※Participant 4 has
the experience using
the system
Time taken by participants for performance creation.
Results (3/3) 25
It is then easier to imagine the expression one wants to convey,
and the ease of coming up with ways to achieve the expression
contributed greatly to reducing the time.
Performer who has rich experiences
using the system created the performance
Performer System
Consideration 26
Image
Consideration 26
Performer System
Image
Libraries
Automatic
Generation
Consideration 26
Performer System
Image
Libraries
Automatic
Generation
Consideration 26
Various expression libraries will not only reduce the creation time
but also widen the range of expression the performer creates.
Performer System
Image
Libraries
We investigated how participants took
both their own body expression and that of the robot
into consideration to create the performance.
→Those who frequently used the movement should be
in the library program.
Libraries
Enclose
Link a dancer
Emphasis
Gather
Into the space
….
Preview 1
Preview 2
Preview 3
Preview 4
…
System Image
Evaluation Experiment 27
Participant 1 Participant 2 Participant 3 Participant 4
Evaluation Experiment 28
Memo of the participants
Participant 1 Participant 2 Participant 3 Participant 4
Evaluation experiment 28
Memo of the participants
Participant 1 Participant 2 Participant 3 Participant 4
Evaluation experiment 28
The participants commented on how they considered
the movement and the light of the robot each eight beats.
Memo of the participants
Ways to show what the performer wants to express: participant 1.
Results (1/2) 29
Ways to show what the performer wants to express: participant 1.
Results (1/2) 29
We extract and list the ways to show what the performer wants
to express on the basis of responses to how the expression
was shown.
Results (2/2) 30
・The extracted expression
Enter a space(4 persons),
Link a dancer(4) ,Emphasize(4) ,
Gather(3) ,Make a space(3) ,
Enclose,Spread,
Rotate the entire formation,
Move a border.
・The extacted movement
Slide,Line up in sequence,
Fix a point,One by one action.
Results (2/2) 30
・The extracted expression
Enter a space(4 persons),
Link a dancer(4) ,Emphasize(4) ,
Gather(3) ,Make a space(3) ,
Enclose,Spread,
Rotate the entire formation,
Move a border.
・The extacted movement
Slide,Line up in sequence,
Fix a point,One by one action.
・The extracted expression
Enter a space(4 persons),
Link a dancer(4) ,Emphasize(4) ,
Gather(3) ,Make a space(3) ,
Enclose,Spread,
Rotate the entire formation,
Move a border.
・The extacted movement
Slide,Line up in sequence,
Fix a point,One by one action.
Results (2/2) 30
Results (2/2) 30
Our challenge for the future is to create a list of what we wish to
express and turn the corresponding robot movement and lighting
into a library that can be implemented in such a way that the
movements can be previewed on the application.
・The extracted expression
Enter a space(4 persons),
Link a dancer(4) ,Emphasize(4) ,
Gather(3) ,Make a space(3) ,
Enclose,Spread,
Rotate the entire formation,
Move a border.
・The extacted movement
Slide,Line up in sequence,
Fix a point,One by one action.
・We constructed a system by which a performer can interactively
create patterns of the movement and light of robotic balls.
・To evaluate the effectiveness of the system,
we had four performers use the system to create and
demonstrate performances.
・We proposed the method to speed up the creation of performance
and to widen the range of expression the performer creates.
・We confirmed that the system performed reliably
in real environment.
Conclusion 31
Future Work 31
Appendix 57
58

More Related Content

Similar to A Dance Performance Environment in which Performers Dance with Multiple Robotic Balls (AH2016 presentation tsuchida)

Single camera depth control in micro class ROV
Single camera depth control in micro class ROVSingle camera depth control in micro class ROV
Single camera depth control in micro class ROV
TELKOMNIKA JOURNAL
 
Final report of 2014-15 microgrant project-rev2
Final report of 2014-15 microgrant project-rev2Final report of 2014-15 microgrant project-rev2
Final report of 2014-15 microgrant project-rev2
Ruthie Muqatach
 
Sweet Home Project
Sweet Home ProjectSweet Home Project
Sweet Home Project
CMRR de Nice
 
Efficient Route Discovery In Mobile Ad Hoc Network
Efficient  Route  Discovery In  Mobile  Ad  Hoc  NetworkEfficient  Route  Discovery In  Mobile  Ad  Hoc  Network
Efficient Route Discovery In Mobile Ad Hoc Network
somarka
 
HW-2 What is engineering_F15 CE 1120 Introduction to Eng.docx
HW-2  What is engineering_F15 CE 1120 Introduction to Eng.docxHW-2  What is engineering_F15 CE 1120 Introduction to Eng.docx
HW-2 What is engineering_F15 CE 1120 Introduction to Eng.docx
adampcarr67227
 
Rock Blasting Seismograph Application for Hydroelectric Structural Safety, Bl...
Rock Blasting Seismograph Application for Hydroelectric Structural Safety, Bl...Rock Blasting Seismograph Application for Hydroelectric Structural Safety, Bl...
Rock Blasting Seismograph Application for Hydroelectric Structural Safety, Bl...
srikanth2vangara
 
Computer Vision based Dance Visualisation
Computer   Vision   based Dance  VisualisationComputer   Vision   based Dance  Visualisation
Computer Vision based Dance Visualisation
Sanjay Goel
 
Land survey by robot
Land survey by robotLand survey by robot
Land survey by robot
IAEME Publication
 
P1130940886 Outline
P1130940886 OutlineP1130940886 Outline
P1130940886 Outline
Ashraf Aboshosha
 
Robot Hexapod - Terfinal2.pptx
Robot Hexapod - Terfinal2.pptxRobot Hexapod - Terfinal2.pptx
Robot Hexapod - Terfinal2.pptx
Lilies DLiestyowati
 
A vision-based uncut crop edge detection method for automated guidance of hea...
A vision-based uncut crop edge detection method for automated guidance of hea...A vision-based uncut crop edge detection method for automated guidance of hea...
A vision-based uncut crop edge detection method for automated guidance of hea...
Institute of Agricultural Machinery, NARO
 
Mob Programming: the State of the Art and 3 Case Studies of Open Source Software
Mob Programming: the State of the Art and 3 Case Studies of Open Source SoftwareMob Programming: the State of the Art and 3 Case Studies of Open Source Software
Mob Programming: the State of the Art and 3 Case Studies of Open Source Software
Herez Moise Kattan
 
Modelling of walking humanoid robot with capability of floor detection and dy...
Modelling of walking humanoid robot with capability of floor detection and dy...Modelling of walking humanoid robot with capability of floor detection and dy...
Modelling of walking humanoid robot with capability of floor detection and dy...
ijfcstjournal
 
Special Gadget Report: Video Camera
Special Gadget Report: Video CameraSpecial Gadget Report: Video Camera
Special Gadget Report: Video Camera
kleigh113
 
[Ubicomp'15]SakuraSensor: Quasi-Realtime Cherry-Lined Roads Detection throug...
[Ubicomp'15]SakuraSensor: Quasi-Realtime Cherry-Lined Roads Detection throug...[Ubicomp'15]SakuraSensor: Quasi-Realtime Cherry-Lined Roads Detection throug...
[Ubicomp'15]SakuraSensor: Quasi-Realtime Cherry-Lined Roads Detection throug...
Ubi NAIST
 
Smart bore well child rescue system
Smart bore well child rescue systemSmart bore well child rescue system
Smart bore well child rescue system
IRJET Journal
 
A presentation on obstacle avoiding robot
A presentation on obstacle avoiding robotA presentation on obstacle avoiding robot
A presentation on obstacle avoiding robot
kantankit4
 
Project_Report_433
Project_Report_433Project_Report_433
Project_Report_433
Muhammad Umer Syed
 
dQ12 dancing across_oceans_feb13_2012-v5.1
dQ12 dancing across_oceans_feb13_2012-v5.1dQ12 dancing across_oceans_feb13_2012-v5.1
dQ12 dancing across_oceans_feb13_2012-v5.1
DaeYoung (DY) KIM
 
Dq12 dancing across_oceans_feb13_2012-v5.1
Dq12 dancing across_oceans_feb13_2012-v5.1Dq12 dancing across_oceans_feb13_2012-v5.1
Dq12 dancing across_oceans_feb13_2012-v5.1
DaeYoung (DY) KIM
 

Similar to A Dance Performance Environment in which Performers Dance with Multiple Robotic Balls (AH2016 presentation tsuchida) (20)

Single camera depth control in micro class ROV
Single camera depth control in micro class ROVSingle camera depth control in micro class ROV
Single camera depth control in micro class ROV
 
Final report of 2014-15 microgrant project-rev2
Final report of 2014-15 microgrant project-rev2Final report of 2014-15 microgrant project-rev2
Final report of 2014-15 microgrant project-rev2
 
Sweet Home Project
Sweet Home ProjectSweet Home Project
Sweet Home Project
 
Efficient Route Discovery In Mobile Ad Hoc Network
Efficient  Route  Discovery In  Mobile  Ad  Hoc  NetworkEfficient  Route  Discovery In  Mobile  Ad  Hoc  Network
Efficient Route Discovery In Mobile Ad Hoc Network
 
HW-2 What is engineering_F15 CE 1120 Introduction to Eng.docx
HW-2  What is engineering_F15 CE 1120 Introduction to Eng.docxHW-2  What is engineering_F15 CE 1120 Introduction to Eng.docx
HW-2 What is engineering_F15 CE 1120 Introduction to Eng.docx
 
Rock Blasting Seismograph Application for Hydroelectric Structural Safety, Bl...
Rock Blasting Seismograph Application for Hydroelectric Structural Safety, Bl...Rock Blasting Seismograph Application for Hydroelectric Structural Safety, Bl...
Rock Blasting Seismograph Application for Hydroelectric Structural Safety, Bl...
 
Computer Vision based Dance Visualisation
Computer   Vision   based Dance  VisualisationComputer   Vision   based Dance  Visualisation
Computer Vision based Dance Visualisation
 
Land survey by robot
Land survey by robotLand survey by robot
Land survey by robot
 
P1130940886 Outline
P1130940886 OutlineP1130940886 Outline
P1130940886 Outline
 
Robot Hexapod - Terfinal2.pptx
Robot Hexapod - Terfinal2.pptxRobot Hexapod - Terfinal2.pptx
Robot Hexapod - Terfinal2.pptx
 
A vision-based uncut crop edge detection method for automated guidance of hea...
A vision-based uncut crop edge detection method for automated guidance of hea...A vision-based uncut crop edge detection method for automated guidance of hea...
A vision-based uncut crop edge detection method for automated guidance of hea...
 
Mob Programming: the State of the Art and 3 Case Studies of Open Source Software
Mob Programming: the State of the Art and 3 Case Studies of Open Source SoftwareMob Programming: the State of the Art and 3 Case Studies of Open Source Software
Mob Programming: the State of the Art and 3 Case Studies of Open Source Software
 
Modelling of walking humanoid robot with capability of floor detection and dy...
Modelling of walking humanoid robot with capability of floor detection and dy...Modelling of walking humanoid robot with capability of floor detection and dy...
Modelling of walking humanoid robot with capability of floor detection and dy...
 
Special Gadget Report: Video Camera
Special Gadget Report: Video CameraSpecial Gadget Report: Video Camera
Special Gadget Report: Video Camera
 
[Ubicomp'15]SakuraSensor: Quasi-Realtime Cherry-Lined Roads Detection throug...
[Ubicomp'15]SakuraSensor: Quasi-Realtime Cherry-Lined Roads Detection throug...[Ubicomp'15]SakuraSensor: Quasi-Realtime Cherry-Lined Roads Detection throug...
[Ubicomp'15]SakuraSensor: Quasi-Realtime Cherry-Lined Roads Detection throug...
 
Smart bore well child rescue system
Smart bore well child rescue systemSmart bore well child rescue system
Smart bore well child rescue system
 
A presentation on obstacle avoiding robot
A presentation on obstacle avoiding robotA presentation on obstacle avoiding robot
A presentation on obstacle avoiding robot
 
Project_Report_433
Project_Report_433Project_Report_433
Project_Report_433
 
dQ12 dancing across_oceans_feb13_2012-v5.1
dQ12 dancing across_oceans_feb13_2012-v5.1dQ12 dancing across_oceans_feb13_2012-v5.1
dQ12 dancing across_oceans_feb13_2012-v5.1
 
Dq12 dancing across_oceans_feb13_2012-v5.1
Dq12 dancing across_oceans_feb13_2012-v5.1Dq12 dancing across_oceans_feb13_2012-v5.1
Dq12 dancing across_oceans_feb13_2012-v5.1
 

More from Shuhei Tsuchida

パフォーマンスを拡張する研究
パフォーマンスを拡張する研究パフォーマンスを拡張する研究
パフォーマンスを拡張する研究
Shuhei Tsuchida
 
ダンスステップ学習における分離学習の適用
ダンスステップ学習における分離学習の適用 ダンスステップ学習における分離学習の適用
ダンスステップ学習における分離学習の適用
Shuhei Tsuchida
 
神戸大学男女共同参画推進室主催「2021年度神戸大学ダイバーシティフォーラム ~男性の育児休業から考えるワーク・ライフ・バランス~」
神戸大学男女共同参画推進室主催「2021年度神戸大学ダイバーシティフォーラム ~男性の育児休業から考えるワーク・ライフ・バランス~」神戸大学男女共同参画推進室主催「2021年度神戸大学ダイバーシティフォーラム ~男性の育児休業から考えるワーク・ライフ・バランス~」
神戸大学男女共同参画推進室主催「2021年度神戸大学ダイバーシティフォーラム ~男性の育児休業から考えるワーク・ライフ・バランス~」
Shuhei Tsuchida
 
ダンスをマスターした自身の映像を先に見ることによるダンス学習支援
ダンスをマスターした自身の映像を先に見ることによるダンス学習支援ダンスをマスターした自身の映像を先に見ることによるダンス学習支援
ダンスをマスターした自身の映像を先に見ることによるダンス学習支援
Shuhei Tsuchida
 
ダンス情報処理
ダンス情報処理ダンス情報処理
ダンス情報処理
Shuhei Tsuchida
 
Exit20151212
Exit20151212Exit20151212
Exit20151212
Shuhei Tsuchida
 
複数の移動ロボットを用いた身体パフォーマンスの印象評価(EC2016)
複数の移動ロボットを用いた身体パフォーマンスの印象評価(EC2016)複数の移動ロボットを用いた身体パフォーマンスの印象評価(EC2016)
複数の移動ロボットを用いた身体パフォーマンスの印象評価(EC2016)
Shuhei Tsuchida
 
球体型自走ロボットを用いた ダンスパフォーマンス環境の構築(WISS2015 presen)
球体型自走ロボットを用いた ダンスパフォーマンス環境の構築(WISS2015 presen)球体型自走ロボットを用いた ダンスパフォーマンス環境の構築(WISS2015 presen)
球体型自走ロボットを用いた ダンスパフォーマンス環境の構築(WISS2015 presen)
Shuhei Tsuchida
 
ダンスパフォーマンスにおける自走型スクリーンを用いた 隊形練習支援 (WISS 2012 tsuchida)
ダンスパフォーマンスにおける自走型スクリーンを用いた隊形練習支援 (WISS 2012 tsuchida)ダンスパフォーマンスにおける自走型スクリーンを用いた隊形練習支援 (WISS 2012 tsuchida)
ダンスパフォーマンスにおける自走型スクリーンを用いた 隊形練習支援 (WISS 2012 tsuchida)
Shuhei Tsuchida
 
A System for Practicing Formations in Dance Performance Supported by Self-Pro...
A System for Practicing Formations in Dance Performance Supported by Self-Pro...A System for Practicing Formations in Dance Performance Supported by Self-Pro...
A System for Practicing Formations in Dance Performance Supported by Self-Pro...
Shuhei Tsuchida
 
移動ロボットを用いたダンスパフォーマンス環境の構築 (20161006 CEATEC 未踏ブース ストリートプレゼン 土田)
移動ロボットを用いたダンスパフォーマンス環境の構築 (20161006 CEATEC 未踏ブース ストリートプレゼン 土田)移動ロボットを用いたダンスパフォーマンス環境の構築 (20161006 CEATEC 未踏ブース ストリートプレゼン 土田)
移動ロボットを用いたダンスパフォーマンス環境の構築 (20161006 CEATEC 未踏ブース ストリートプレゼン 土田)
Shuhei Tsuchida
 
人と球体自律走行ロボット群の協調パフォーマンスシステムの開発 (20160706 jst start presen tsuchida)
人と球体自律走行ロボット群の協調パフォーマンスシステムの開発 (20160706 jst start presen tsuchida)人と球体自律走行ロボット群の協調パフォーマンスシステムの開発 (20160706 jst start presen tsuchida)
人と球体自律走行ロボット群の協調パフォーマンスシステムの開発 (20160706 jst start presen tsuchida)
Shuhei Tsuchida
 
回転移動を模したテクスチャ表示機能をもつ球体型移動ロボット (インタラクション 2016)
回転移動を模したテクスチャ表示機能をもつ球体型移動ロボット (インタラクション 2016)回転移動を模したテクスチャ表示機能をもつ球体型移動ロボット (インタラクション 2016)
回転移動を模したテクスチャ表示機能をもつ球体型移動ロボット (インタラクション 2016)
Shuhei Tsuchida
 
Automatic System for Editing Dance Videos Recorded Using Multiple Cameras
Automatic System for Editing Dance Videos Recorded Using Multiple CamerasAutomatic System for Editing Dance Videos Recorded Using Multiple Cameras
Automatic System for Editing Dance Videos Recorded Using Multiple Cameras
Shuhei Tsuchida
 
多視点ダンス映像のインタラクティブ編集システム
多視点ダンス映像のインタラクティブ編集システム多視点ダンス映像のインタラクティブ編集システム
多視点ダンス映像のインタラクティブ編集システム
Shuhei Tsuchida
 
Query-by-Dancing: 身体動作の類似性に基づくダンス楽曲検索システム
Query-by-Dancing: 身体動作の類似性に基づくダンス楽曲検索システムQuery-by-Dancing: 身体動作の類似性に基づくダンス楽曲検索システム
Query-by-Dancing: 身体動作の類似性に基づくダンス楽曲検索システム
Shuhei Tsuchida
 
AIST Dance Video Database: Multi-Genre, Multi-Dancer, and Multi-Camera Databa...
AIST Dance Video Database: Multi-Genre, Multi-Dancer, and Multi-Camera Databa...AIST Dance Video Database: Multi-Genre, Multi-Dancer, and Multi-Camera Databa...
AIST Dance Video Database: Multi-Genre, Multi-Dancer, and Multi-Camera Databa...
Shuhei Tsuchida
 
AIST Dance Video Database:  ダンス情報処理研究のためのストリートダンス動画データベース
AIST Dance Video Database:  ダンス情報処理研究のためのストリートダンス動画データベースAIST Dance Video Database:  ダンス情報処理研究のためのストリートダンス動画データベース
AIST Dance Video Database:  ダンス情報処理研究のためのストリートダンス動画データベース
Shuhei Tsuchida
 
DanceUnisoner: グループダンスパフォーマンス動画作成インタフェース
DanceUnisoner: グループダンスパフォーマンス動画作成インタフェースDanceUnisoner: グループダンスパフォーマンス動画作成インタフェース
DanceUnisoner: グループダンスパフォーマンス動画作成インタフェース
Shuhei Tsuchida
 
ダンスレッスンの可能性を拡張する講師ー生徒サポートAIシステムの開発
ダンスレッスンの可能性を拡張する講師ー生徒サポートAIシステムの開発ダンスレッスンの可能性を拡張する講師ー生徒サポートAIシステムの開発
ダンスレッスンの可能性を拡張する講師ー生徒サポートAIシステムの開発
Shuhei Tsuchida
 

More from Shuhei Tsuchida (20)

パフォーマンスを拡張する研究
パフォーマンスを拡張する研究パフォーマンスを拡張する研究
パフォーマンスを拡張する研究
 
ダンスステップ学習における分離学習の適用
ダンスステップ学習における分離学習の適用 ダンスステップ学習における分離学習の適用
ダンスステップ学習における分離学習の適用
 
神戸大学男女共同参画推進室主催「2021年度神戸大学ダイバーシティフォーラム ~男性の育児休業から考えるワーク・ライフ・バランス~」
神戸大学男女共同参画推進室主催「2021年度神戸大学ダイバーシティフォーラム ~男性の育児休業から考えるワーク・ライフ・バランス~」神戸大学男女共同参画推進室主催「2021年度神戸大学ダイバーシティフォーラム ~男性の育児休業から考えるワーク・ライフ・バランス~」
神戸大学男女共同参画推進室主催「2021年度神戸大学ダイバーシティフォーラム ~男性の育児休業から考えるワーク・ライフ・バランス~」
 
ダンスをマスターした自身の映像を先に見ることによるダンス学習支援
ダンスをマスターした自身の映像を先に見ることによるダンス学習支援ダンスをマスターした自身の映像を先に見ることによるダンス学習支援
ダンスをマスターした自身の映像を先に見ることによるダンス学習支援
 
ダンス情報処理
ダンス情報処理ダンス情報処理
ダンス情報処理
 
Exit20151212
Exit20151212Exit20151212
Exit20151212
 
複数の移動ロボットを用いた身体パフォーマンスの印象評価(EC2016)
複数の移動ロボットを用いた身体パフォーマンスの印象評価(EC2016)複数の移動ロボットを用いた身体パフォーマンスの印象評価(EC2016)
複数の移動ロボットを用いた身体パフォーマンスの印象評価(EC2016)
 
球体型自走ロボットを用いた ダンスパフォーマンス環境の構築(WISS2015 presen)
球体型自走ロボットを用いた ダンスパフォーマンス環境の構築(WISS2015 presen)球体型自走ロボットを用いた ダンスパフォーマンス環境の構築(WISS2015 presen)
球体型自走ロボットを用いた ダンスパフォーマンス環境の構築(WISS2015 presen)
 
ダンスパフォーマンスにおける自走型スクリーンを用いた 隊形練習支援 (WISS 2012 tsuchida)
ダンスパフォーマンスにおける自走型スクリーンを用いた隊形練習支援 (WISS 2012 tsuchida)ダンスパフォーマンスにおける自走型スクリーンを用いた隊形練習支援 (WISS 2012 tsuchida)
ダンスパフォーマンスにおける自走型スクリーンを用いた 隊形練習支援 (WISS 2012 tsuchida)
 
A System for Practicing Formations in Dance Performance Supported by Self-Pro...
A System for Practicing Formations in Dance Performance Supported by Self-Pro...A System for Practicing Formations in Dance Performance Supported by Self-Pro...
A System for Practicing Formations in Dance Performance Supported by Self-Pro...
 
移動ロボットを用いたダンスパフォーマンス環境の構築 (20161006 CEATEC 未踏ブース ストリートプレゼン 土田)
移動ロボットを用いたダンスパフォーマンス環境の構築 (20161006 CEATEC 未踏ブース ストリートプレゼン 土田)移動ロボットを用いたダンスパフォーマンス環境の構築 (20161006 CEATEC 未踏ブース ストリートプレゼン 土田)
移動ロボットを用いたダンスパフォーマンス環境の構築 (20161006 CEATEC 未踏ブース ストリートプレゼン 土田)
 
人と球体自律走行ロボット群の協調パフォーマンスシステムの開発 (20160706 jst start presen tsuchida)
人と球体自律走行ロボット群の協調パフォーマンスシステムの開発 (20160706 jst start presen tsuchida)人と球体自律走行ロボット群の協調パフォーマンスシステムの開発 (20160706 jst start presen tsuchida)
人と球体自律走行ロボット群の協調パフォーマンスシステムの開発 (20160706 jst start presen tsuchida)
 
回転移動を模したテクスチャ表示機能をもつ球体型移動ロボット (インタラクション 2016)
回転移動を模したテクスチャ表示機能をもつ球体型移動ロボット (インタラクション 2016)回転移動を模したテクスチャ表示機能をもつ球体型移動ロボット (インタラクション 2016)
回転移動を模したテクスチャ表示機能をもつ球体型移動ロボット (インタラクション 2016)
 
Automatic System for Editing Dance Videos Recorded Using Multiple Cameras
Automatic System for Editing Dance Videos Recorded Using Multiple CamerasAutomatic System for Editing Dance Videos Recorded Using Multiple Cameras
Automatic System for Editing Dance Videos Recorded Using Multiple Cameras
 
多視点ダンス映像のインタラクティブ編集システム
多視点ダンス映像のインタラクティブ編集システム多視点ダンス映像のインタラクティブ編集システム
多視点ダンス映像のインタラクティブ編集システム
 
Query-by-Dancing: 身体動作の類似性に基づくダンス楽曲検索システム
Query-by-Dancing: 身体動作の類似性に基づくダンス楽曲検索システムQuery-by-Dancing: 身体動作の類似性に基づくダンス楽曲検索システム
Query-by-Dancing: 身体動作の類似性に基づくダンス楽曲検索システム
 
AIST Dance Video Database: Multi-Genre, Multi-Dancer, and Multi-Camera Databa...
AIST Dance Video Database: Multi-Genre, Multi-Dancer, and Multi-Camera Databa...AIST Dance Video Database: Multi-Genre, Multi-Dancer, and Multi-Camera Databa...
AIST Dance Video Database: Multi-Genre, Multi-Dancer, and Multi-Camera Databa...
 
AIST Dance Video Database:  ダンス情報処理研究のためのストリートダンス動画データベース
AIST Dance Video Database:  ダンス情報処理研究のためのストリートダンス動画データベースAIST Dance Video Database:  ダンス情報処理研究のためのストリートダンス動画データベース
AIST Dance Video Database:  ダンス情報処理研究のためのストリートダンス動画データベース
 
DanceUnisoner: グループダンスパフォーマンス動画作成インタフェース
DanceUnisoner: グループダンスパフォーマンス動画作成インタフェースDanceUnisoner: グループダンスパフォーマンス動画作成インタフェース
DanceUnisoner: グループダンスパフォーマンス動画作成インタフェース
 
ダンスレッスンの可能性を拡張する講師ー生徒サポートAIシステムの開発
ダンスレッスンの可能性を拡張する講師ー生徒サポートAIシステムの開発ダンスレッスンの可能性を拡張する講師ー生徒サポートAIシステムの開発
ダンスレッスンの可能性を拡張する講師ー生徒サポートAIシステムの開発
 

Recently uploaded

Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Tosin Akinosho
 
Recommendation System using RAG Architecture
Recommendation System using RAG ArchitectureRecommendation System using RAG Architecture
Recommendation System using RAG Architecture
fredae14
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptxOcean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
SitimaJohn
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
Project Management Semester Long Project - Acuity
Project Management Semester Long Project - AcuityProject Management Semester Long Project - Acuity
Project Management Semester Long Project - Acuity
jpupo2018
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
Tatiana Kojar
 
OpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - AuthorizationOpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - Authorization
David Brossard
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Jeffrey Haguewood
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
Postman
 
Mariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceXMariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceX
Mariano Tinti
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Wask
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Speck&Tech
 

Recently uploaded (20)

Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
 
Recommendation System using RAG Architecture
Recommendation System using RAG ArchitectureRecommendation System using RAG Architecture
Recommendation System using RAG Architecture
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptxOcean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
Project Management Semester Long Project - Acuity
Project Management Semester Long Project - AcuityProject Management Semester Long Project - Acuity
Project Management Semester Long Project - Acuity
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
 
OpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - AuthorizationOpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - Authorization
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
 
Mariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceXMariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceX
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
 

A Dance Performance Environment in which Performers Dance with Multiple Robotic Balls (AH2016 presentation tsuchida)

  • 1. A Dance Performance Environment in which Performers Dance with Multiple Robotic Balls Shuhei Tsuchida†1, Tsutomu Terada†1†2, Masahiko Tsukamoto†1 †1 Kobe University †2 JST PRESTO
  • 2. Demo Movie (ACE2015 in Malaysia) 2
  • 3. Tod Machover: Death and the Powers https://www.youtube.com/watch?v=mPp9juefl2Y elevenplay:Dance with Drones https://www.youtube.com/watch?v=HQLORg5COiU In recent years, as robotics technology progresses, various robots have been developed to dance with humans. Background 3
  • 4. Tod Machover: Death and the Powers https://www.youtube.com/watch?v=mPp9juefl2Y elevenplay:Dance with Drones https://www.youtube.com/watch?v=HQLORg5COiU In recent years, as robotics technology progresses, various robots have been developed to dance with humans. Background 3
  • 5. Tod Machover: Death and the Powers https://www.youtube.com/watch?v=mPp9juefl2Y elevenplay:Dance with Drones https://www.youtube.com/watch?v=HQLORg5COiU In recent years, as robotics technology progresses, various robots have been developed to dance with humans. Background 3
  • 6. Tod Machover: Death and the Powers https://www.youtube.com/watch?v=mPp9juefl2Y elevenplay:Dance with Drones https://www.youtube.com/watch?v=HQLORg5COiU In recent years, as robotics technology progresses, various robots have been developed to dance with humans. Background 3 However, it is difficult for the performer to create the performance using the mobile robots.
  • 10. ①Image Engineer Performer System ③Creating Result ②Input & Output Problem 7 Image Creating Result The performer cannot interactively create a performance using the system.
  • 11. We construct a mechanism by which a performer can interactively create a performance while he/she considers the correspondence between his/her motion and the mobile robots' movement and light. Purpose 8
  • 12. General Method Proposed System (1/2) 9 ①Image Engineer Performer System ③Creating Result ②Input & Output Image Creating Result
  • 13. Proposed System (1/2) 9 General Method ①Image Engineer Performer System ③Creating Result ②Input & Output Image Creating Result
  • 14. Proposed Method Proposed System (2/2) 10 ①Input & Output System Performer Image Creating Result
  • 15. ・A performer with no knowledge of programming can create patterns of the movement and light of robotic balls to certain music and choreography by mouse operation. ・A performer can easily confirm the choreography of dancing with robotic balls on a simulator. Simulator Motion Input System Design 11
  • 16. Size︓ diameter 74 [mm] Weight︓ 168 [g] Maximum speed︓ 2 [m/s] Communication distance︓ max 30 [m] Hardware (1/2) 12
  • 17. Hardware (2/2) 13 LiPo battery Driving part of Sphero Infrared LED
  • 18. ABS rein Plastic Hardware (2/2) 13 LiPo battery Driving part of Sphero Infrared LED
  • 19. 1. Creating movements and lights 2. Confirming on the simulator 3. Saving the pattern 4. Confirming with robotic balls PC Mobile phone Moving pattern Light pattern System Configuration 14
  • 20. 1. Creating movements and lights 2. Confirming on the simulator 3. Saving the pattern 4. Confirming with robotic balls PC Mobile phone Moving pattern Light pattern System Configuration 14 Application for Creating the Movement and the Light of Robotic Balls Control System for Robotic Balls
  • 21. 1. Creating movements and lights 2. Confirming on the simulator 3. Saving the pattern 4. Confirming with robotic balls PC Mobile phone Moving pattern Light pattern System Configuration 14 Application for Creating the Movement and the Light of Robotic Balls Control System for Robotic Balls
  • 22. Application for Creating the Movement and the Light of Robotic Balls 15
  • 23. 1. Creating movements and lights 2. Confirming on the simulator 3. Saving the pattern 4. Confirming with robotic balls PC Mobile phone Moving pattern Light pattern System Configuration 14 Application for Creating the Movement and the Light of Robotic Balls Control System for Robotic Balls
  • 24. The user saves the pattern of the moving and light of robotic balls to the mobile phone and PC for control. moving pattern light pattern Control System for Robotic Balls (1/2) 16
  • 25. moving pattern light pattern infrared Control System for Robotic Balls (1/2) 17 The user performs fitting the moving and the light of robotic balls that synchronize a music.
  • 26. ・The system cannot detect the position when the dancer was between the camera and the robotic ball. ・The speed of robotic balls is limited. ・It cannot move to draw a curve. System Restriction 18
  • 27. Survey items ・Performance creation time ・System usability Participant Males 4,Average age 22.3 ・Performer who had been dancing for more than four years. (4/4) ・Performer who had some experience in performance creation using robotic balls. (1/4) 19 Evaluation Experiment (1/3)
  • 28. Evaluation Experiment (2/3) 20 Experiment Procedure (1) The participant receives a 20-minute explanation about how to use the application. (2) The participant uses the application to create choreography based on a song about 1 minutes, 10 seconds long at 120 BPM. (3) The participant confirms the choreography on the application. (4) The participant carries out a performance using robotic balls.
  • 29. Experiment Procedure (1) The participant receives a 20-minute explanation about how to use the application. (2) The participant uses the application to create choreography based on a song about 1 minutes, 10 seconds long at 120 BPM. (3) The participant confirms the choreography on the application. (4) The participant carries out a performance using robotic balls. Evaluation Experiment (2/3) 20 20-minute explanation ①
  • 30. Evaluation Experiment (2/3) 20 Experiment Procedure (1) The participant receives a 20-minute explanation about how to use the application. (2) The participant uses the application to create choreography based on a song about 1 minutes, 10 seconds long at 120 BPM. (3) The participant confirms the choreography on the application. (4) The participant carries out a performance using robotic balls. Creating a choreography ② 01m10s
  • 31. Experiment Procedure (1) The participant receives a 20-minute explanation about how to use the application. (2) The participant uses the application to create choreography based on a song about 1 minutes, 10 seconds long at 120 BPM. (3) The participant confirms the choreography on the application. (4) The participant carries out a performance using robotic balls. Evaluation Experiment (2/3) 20 Confirming a choreography on the simulator ③
  • 32. Experiment Procedure (1) The participant receives a 20-minute explanation about how to use the application. (2) The participant uses the application to create choreography based on a song about 1 minutes, 10 seconds long at 120 BPM. (3) The participant confirms the choreography on the application. (4) The participant carries out a performance using robotic balls. Evaluation Experiment (2/3) 20 Kinect Projetor Images
  • 33. Evaluation Experiment (2/3) 20 Experiment Procedure (1) The participant receives a 20-minute explanation about how to use the application. (2) The participant uses the application to create choreography based on a song about 1 minutes, 10 seconds long at 120 BPM. (3) The participant confirms the choreography on the application. (4) The participant carries out a performance using robotic balls. Performance ④
  • 34. Experiment Procedure (1) The participant receives a 20-minute explanation about how to use the application. (2) The participant uses the application to create choreography based on a song about 1 minute, 10 seconds long at 120 BPM. (3) The participant confirms the choreography on the application. (4) The participant carries out a performance using robotic balls. Evaluation Experiment (2/3) 20 Recording Time for creating
  • 35. ・One B5 paper and a pen were also used when creating the choreography. ・The experimenter received the question about how to operate the application during the experiment. ・The time taken for the experimental procedures 2 and 3 was noted and a 10-minute break was scheduled every hour. At the end of the experiment ・Participants provided feedback on the application. Evaluation Experiment (3/3) 21
  • 37. Results of questionnaire ・The application was that its movements were immediately clear at a glance. ・It was hard to determine the sense of distance with the robotic balls while confirming the choreography via simulator display. ・The setting to take color gradient between keyframes made it hard to operate when participant was deciding on the lighting Results (2/3) 23
  • 38. Participant Performance creation time 1 2hour, 38minutes 2 3hour, 29minutes 3 2hour, 17minutes 4※ 1hour, 4minutes ※Participant 4 has the experience using the system Time taken by participants for performance creation. Results (3/3) 24
  • 39. Participant Performance creation time 1 2hour, 38minutes 2 3hour, 29minutes 3 2hour, 17minutes 4※ 1hour, 4minutes ※Participant 4 has the experience using the system Time taken by participants for performance creation. Results (3/3) 25 It is then easier to imagine the expression one wants to convey, and the ease of coming up with ways to achieve the expression contributed greatly to reducing the time. Performer who has rich experiences using the system created the performance
  • 43. Automatic Generation Consideration 26 Various expression libraries will not only reduce the creation time but also widen the range of expression the performer creates. Performer System Image Libraries
  • 44. We investigated how participants took both their own body expression and that of the robot into consideration to create the performance. →Those who frequently used the movement should be in the library program. Libraries Enclose Link a dancer Emphasis Gather Into the space …. Preview 1 Preview 2 Preview 3 Preview 4 … System Image Evaluation Experiment 27
  • 45. Participant 1 Participant 2 Participant 3 Participant 4 Evaluation Experiment 28 Memo of the participants
  • 46. Participant 1 Participant 2 Participant 3 Participant 4 Evaluation experiment 28 Memo of the participants
  • 47. Participant 1 Participant 2 Participant 3 Participant 4 Evaluation experiment 28 The participants commented on how they considered the movement and the light of the robot each eight beats. Memo of the participants
  • 48. Ways to show what the performer wants to express: participant 1. Results (1/2) 29
  • 49. Ways to show what the performer wants to express: participant 1. Results (1/2) 29 We extract and list the ways to show what the performer wants to express on the basis of responses to how the expression was shown.
  • 50. Results (2/2) 30 ・The extracted expression Enter a space(4 persons), Link a dancer(4) ,Emphasize(4) , Gather(3) ,Make a space(3) , Enclose,Spread, Rotate the entire formation, Move a border. ・The extacted movement Slide,Line up in sequence, Fix a point,One by one action.
  • 51. Results (2/2) 30 ・The extracted expression Enter a space(4 persons), Link a dancer(4) ,Emphasize(4) , Gather(3) ,Make a space(3) , Enclose,Spread, Rotate the entire formation, Move a border. ・The extacted movement Slide,Line up in sequence, Fix a point,One by one action.
  • 52. ・The extracted expression Enter a space(4 persons), Link a dancer(4) ,Emphasize(4) , Gather(3) ,Make a space(3) , Enclose,Spread, Rotate the entire formation, Move a border. ・The extacted movement Slide,Line up in sequence, Fix a point,One by one action. Results (2/2) 30
  • 53. Results (2/2) 30 Our challenge for the future is to create a list of what we wish to express and turn the corresponding robot movement and lighting into a library that can be implemented in such a way that the movements can be previewed on the application. ・The extracted expression Enter a space(4 persons), Link a dancer(4) ,Emphasize(4) , Gather(3) ,Make a space(3) , Enclose,Spread, Rotate the entire formation, Move a border. ・The extacted movement Slide,Line up in sequence, Fix a point,One by one action.
  • 54. ・We constructed a system by which a performer can interactively create patterns of the movement and light of robotic balls. ・To evaluate the effectiveness of the system, we had four performers use the system to create and demonstrate performances. ・We proposed the method to speed up the creation of performance and to widen the range of expression the performer creates. ・We confirmed that the system performed reliably in real environment. Conclusion 31
  • 57. 58