CHI 2021Student Research Competitionにて使用したポスター

1. Instrumeteor
Yui Atarashi, University of Tsukuba, yuiatarashi0315@gmail.com
Authoring Tool for Guitar Performance Video
Eight types of video effects (I: No effects)
Guitar Performance Video
- - - - - - - - - - - - - - - - - - - - - - - - - -
Characteristics of Guitar Performance Videos
Problems of Guitar Performance Video Authoring
1. INTRODUCTION
2. QUANTITATIVE SURVEY
5. CONTRIBUTIONS
- - - - - - - - - - - - - - - - - - - - - - - - - -
4. PROPOSED SYSTEM
3. PROBLEMS
(D)
(A)
Quantitative survey of the top 100 most viewed
japanese performance videos on YouTube
Finding out typical characteristics of guitar perfor-
mance videos thorugh quantitative survey.
(A): Lyrics animation, (B): Transition effects,
(C): Multi-view switching,
(D): Display of multiple videos,
(E): Saturation changes,
(F): Animation effects such as stamps and shakes,
(G): Display of music video, (H): Display of score
Effect image (B omitted)
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Musicians
Streaming services
Recording
Authoring video Publish
Editing tool
In Japan,
With various effects
the culture of
derivative works
is advancing
A lot of performance videos covering
original song have been published
Instrumeteor : Authoring Tool for Guitar Performance Video
To create (A)-(H) effects,
Lots of manual work
Problems
Existing tools
do not specialize on
performance videos
e.g., Lyrics and videos shot from multiple angles
Need to combine multi-
ple video tracks into a
single track
automatically analyzes the musical
structure in the tracks to align them on
a single timeline to reduce manual labor.
Second, it implements typical video ef-
fects informed by the survey to unleash
Need to synchronize all
tracks with the musical
elements
Difficult to trial and
error of authoring
performance videos
Proposal of Instrumeteor, authoring tool for guitar
performance video.
The system reduces user manual work and
makes it easier to create attractive videos.
①
①
Problems
②
②
TextAlive app API, Songle API
It automatically analyzes the musical struc-
ture in the tracks to align them on a single
timeline to reduce manual work.
It implements typical video effects informed by
the survey to unleash the musicians' creativity.
Instrumeteor soloves the problems
Instrumeteor inplements (A)-(G) effects
(B:transition effects omitted)
(E)Saturation changes
Example videos made with Instrumeteor
(C)Mult-view switching
(F)Animation effects
(A)Lyrics animation
(D)Display of multiple videos
(G) Display of music video
(C)
(F) (G) (H)
(E)
Revealing key problems of creating typical effects
with existing tools.