SlideShare a Scribd company logo
Holographic Whisper:
Rendering audible sound spots in
three-dimensional space by focusing ultrasonic waves
Yoichi Ochiai*13, Takayuki Hoshi*23, Ippei Suzuki*1
*1 University of Tsukuba, Digital Nature Group *2 University of Tokyo, *3 Pixie Dust Technologies, inc.
*joint first authorship, Contact: wizard@slis.tsukuba.ac.jp
Assistant Professor at University of Tsukuba, Head of Digital Nature Group
CEO of Pixie Dust Technologies, inc
Motivation and Introduction
“Render the Aerial Sound Sources separated from Machines”
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
We envision the post-pixel world
Release data from material existence
and regenerate Material Properties
by using out of range frequencies of our sensory organs.
P i x e l s P i x i e s
2D to 2.5D
Physical Device
3 D
C o m p u t a t i o n a l W a v e D e s i g n
M a g i c a l E x p e r i e n c e
w i t h N o C o n t a c t D e v i c e
T o w a r d s
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Pixel Image
Haptic
Haptic
Sound
Manipulation
2.5D
Voxel
Human
How can we update
the pixel world (2.5D)
towards pixie world (3D)?
Scenery of 2000s to 2020
2.5D device
Physical Laptops
Traditional Scenery
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Post-Pixel Alternatives By Computational Wave Synthesis
Manipulation of Object
Aerial HapticsAerial Image
and Haptics
Voxel Graphics
holographic laser plasma
Holographic
laser plasma and ultrasonic
holographic ultrasonic levitation
holographic ultrasonic levitation
We have studied to envision the alternatives
by computational wave synthesis.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Post-Pixel Alternatives By Computational Wave Synthesis
Manipulation of Object
Aerial HapticsAerial Image
and Haptics
Voxel Graphics
holographic laser plasma
Holographic
laser plasma and ultrasonic
holographic ultrasonic levitation
holographic ultrasonic levitation
Next! Holographic Audio
We have studied to envision the alternatives
by computational wave synthesis.
U n i v e r s i t y o f Ts u k u b a , Yo i c h i O c h i a i L a b r a t o r y
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Towards three dimensional audio communication
19c-20c 1990-
Broad Ultrasonic Beam
Mass-Communication Towards Individual Communication
ABC.com, Ponpei,et,al.
2017-
Holographic Points
and Steerable Beams
Towards Personalized Communication
with Ubiquitous Environment
Our Study
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Overview
Designing narrow audio distribution for individual communication
Our Study
Conventional
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Contribution
The method enables production of aerial sound point sources
with an ultrasonic phased array for three-dimensional (3D)
audio interaction which includes:
Principles
Theory
Simulated Result
Implementation
User Study
Evaluation
Application
Discussion
Related Works
“How to design the Acoustic Environment”
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
The Audio Communication
Audible Communication has been separated since Edisons Era.
Individual Broad
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Efforts towards Holographic Individual Audio
[3]BOSE. F1 flexible array loudspeaker system. from http://www.bose.com/prc.jsp?url=/promotions/entry_pages/f1/index_en.jsp
[4]JBL. IntelliDisc-DS90. from http://www.jblpro.com/www/products/installed-sound/intellidisc-ds90
[5]M. Yoneyama, J. Fujimoto, Y. Kawamo, and S. Sasabe. 1983. The audio spotlight: An application of nonlinear interaction of sound waves to a new type of loudspeaker design. The Journal of the Acoustical Society of
America 73, 5, 1532-1536.
[6]K. Aoki, T. Kamakura, and Y. Kumamoto. 1991. Parametric loudspeaker - Characteristics of acoustic field and suitable modulation of carrier ultrasound, Electronics and Communications in Japan 74, 9, 76-82.
[7]F.J. Pompei. 1999. The use of airborne ultrasonics for generating audible sound beams, Journal of the Audio Engineering Society 47, 9, 726-731.
[9]K. Shinagawa, Y. Amemiya, H. Takemura, S. Kagami, and H. Mizoguchi. 2007. Three dimensional simulation and measurement of sound pressure distribution generated by 120 ch plane loudspeaker array. In Proceedings of
IEEE International Conference on Systems, Man and Cybernetics, 278-283.
[10]T. Matsui, D. Ikefuji, M. Nakayama, and T. Nishiura. 2014. Multiple audio spots design based on separating emission of carrier and sideband waves. In Proceedings of International Congress and Exposition on Noise
Control Engineering, 6313-6317.
[12]C. Shi, Y. Kajikawa, and W.-S. Gan. 2014. An overview of directivity control methods of the parametric array loudspeaker. APSIPA Transactions on Signal and Information Processing 3, e20.
ABC.com, Ponpei,et,al.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Efforts towards Holographic Individual Audio
[3]BOSE. F1 flexible array loudspeaker system. from http://www.bose.com/prc.jsp?url=/promotions/entry_pages/f1/index_en.jsp
[4]JBL. IntelliDisc-DS90. from http://www.jblpro.com/www/products/installed-sound/intellidisc-ds90
[5]M. Yoneyama, J. Fujimoto, Y. Kawamo, and S. Sasabe. 1983. The audio spotlight: An application of nonlinear interaction of sound waves to a new type of loudspeaker design. The Journal of the Acoustical Society of
America 73, 5, 1532-1536.
[6]K. Aoki, T. Kamakura, and Y. Kumamoto. 1991. Parametric loudspeaker - Characteristics of acoustic field and suitable modulation of carrier ultrasound, Electronics and Communications in Japan 74, 9, 76-82.
[7]F.J. Pompei. 1999. The use of airborne ultrasonics for generating audible sound beams, Journal of the Audio Engineering Society 47, 9, 726-731.
[9]K. Shinagawa, Y. Amemiya, H. Takemura, S. Kagami, and H. Mizoguchi. 2007. Three dimensional simulation and measurement of sound pressure distribution generated by 120 ch plane loudspeaker array. In Proceedings of
IEEE International Conference on Systems, Man and Cybernetics, 278-283.
[10]T. Matsui, D. Ikefuji, M. Nakayama, and T. Nishiura. 2014. Multiple audio spots design based on separating emission of carrier and sideband waves. In Proceedings of International Congress and Exposition on Noise
Control Engineering, 6313-6317.
[12]C. Shi, Y. Kajikawa, and W.-S. Gan. 2014. An overview of directivity control methods of the parametric array loudspeaker. APSIPA Transactions on Signal and Information Processing 3, e20.
ABC.com, Ponpei,et,al.
Pickup
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
How the ultrasonic directional audio works?
Why???
How did it achieved?
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Beam Forming
[5]M. Yoneyama, J. Fujimoto, Y. Kawamo, and S. Sasabe. 1983. The audio spotlight: An application of nonlinear interaction of sound waves to a new type of loudspeaker design. The Journal of the Acoustical Society of America
73, 5, 1532-1536.
[6]K. Aoki, T. Kamakura, and Y. Kumamoto. 1991. Parametric loudspeaker - Characteristics of acoustic field and suitable modulation of carrier ultrasound, Electronics and Communications in Japan 74, 9, 76-82.
[7]F.J. Pompei. 1999. The use of airborne ultrasonics for generating audible sound beams, Journal of the Audio Engineering Society 47, 9, 726-731.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Beam Forming
[5]M. Yoneyama, J. Fujimoto, Y. Kawamo, and S. Sasabe. 1983. The audio spotlight: An application of nonlinear interaction of sound waves to a new type of loudspeaker design. The Journal of the Acoustical Society of America
73, 5, 1532-1536.
[6]K. Aoki, T. Kamakura, and Y. Kumamoto. 1991. Parametric loudspeaker - Characteristics of acoustic field and suitable modulation of carrier ultrasound, Electronics and Communications in Japan 74, 9, 76-82.
[7]F.J. Pompei. 1999. The use of airborne ultrasonics for generating audible sound beams, Journal of the Audio Engineering Society 47, 9, 726-731.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Beam Forming
WaveFront = Plane Wave = Sound Beam
[5]M. Yoneyama, J. Fujimoto, Y. Kawamo, and S. Sasabe. 1983. The audio spotlight: An application of nonlinear interaction of sound waves to a new type of loudspeaker design. The Journal of the Acoustical Society of America
73, 5, 1532-1536.
[6]K. Aoki, T. Kamakura, and Y. Kumamoto. 1991. Parametric loudspeaker - Characteristics of acoustic field and suitable modulation of carrier ultrasound, Electronics and Communications in Japan 74, 9, 76-82.
[7]F.J. Pompei. 1999. The use of airborne ultrasonics for generating audible sound beams, Journal of the Audio Engineering Society 47, 9, 726-731.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Beam Forming
WaveFront = Plane Wave = Sound Beam
[5]M. Yoneyama, J. Fujimoto, Y. Kawamo, and S. Sasabe. 1983. The audio spotlight: An application of nonlinear interaction of sound waves to a new type of loudspeaker design. The Journal of the Acoustical Society of America
73, 5, 1532-1536.
[6]K. Aoki, T. Kamakura, and Y. Kumamoto. 1991. Parametric loudspeaker - Characteristics of acoustic field and suitable modulation of carrier ultrasound, Electronics and Communications in Japan 74, 9, 76-82.
[7]F.J. Pompei. 1999. The use of airborne ultrasonics for generating audible sound beams, Journal of the Audio Engineering Society 47, 9, 726-731.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Beam Forming
WaveFront = Plane Wave = Sound Beam
ex. LASER
Coherent Plane Wave
[5]M. Yoneyama, J. Fujimoto, Y. Kawamo, and S. Sasabe. 1983. The audio spotlight: An application of nonlinear interaction of sound waves to a new type of loudspeaker design. The Journal of the Acoustical Society of America
73, 5, 1532-1536.
[6]K. Aoki, T. Kamakura, and Y. Kumamoto. 1991. Parametric loudspeaker - Characteristics of acoustic field and suitable modulation of carrier ultrasound, Electronics and Communications in Japan 74, 9, 76-82.
[7]F.J. Pompei. 1999. The use of airborne ultrasonics for generating audible sound beams, Journal of the Audio Engineering Society 47, 9, 726-731.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Ultrasonic Self-demodulation generates audible sound
temporal change of ultrasonic (primary) waves
the radiation of audible sound (secondary) waves
where c [m/s] is the speed of sound in air, β is the
nonlinear parameter, and ρ [kg/m3] is the mass
density of air
Audible
Ultrasonic
→In the beam you can hear the audible sound
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Ultrasonic Self-demodulation generates audible sound
temporal change of ultrasonic (primary) waves
the radiation of audible sound (secondary) waves
where c [m/s] is the speed of sound in air, β is the
nonlinear parameter, and ρ [kg/m3] is the mass
density of air
Audible
Ultrasonic
→In the beam you can hear the audible sound
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Beam Forming to the point audio
[10]T. Matsui, D. Ikefuji, M. Nakayama, and T. Nishiura. 2014.
Multiple audio spots design based on separating emission of
carrier and sideband waves. In Proceedings of International
Congress and Exposition on Noise Control Engineering,
6313-6317.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Beam Forming to the point audio
[10]T. Matsui, D. Ikefuji, M. Nakayama, and T. Nishiura. 2014.
Multiple audio spots design based on separating emission of
carrier and sideband waves. In Proceedings of International
Congress and Exposition on Noise Control Engineering,
6313-6317.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Beam Forming to the point audio
Audible
Area
[10]T. Matsui, D. Ikefuji, M. Nakayama, and T. Nishiura. 2014.
Multiple audio spots design based on separating emission of
carrier and sideband waves. In Proceedings of International
Congress and Exposition on Noise Control Engineering,
6313-6317.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Steering Beam
[12]C. Shi, Y. Kajikawa, and W.-S. Gan. 2014. An overview of directivity control methods of the parametric array loudspeaker. APSIPA Transactions on Signal and Information Processing 3, e20.
θ [rad]: When the spacing
between the transducers is d [m] in the case of a 1D
transducer array,
the phase delay of the i-th transducer, ∆φi [rad]
where k [rad/m] is the wavenumber of the ultrasound.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Steering Beam
[12]C. Shi, Y. Kajikawa, and W.-S. Gan. 2014. An overview of directivity control methods of the parametric array loudspeaker. APSIPA Transactions on Signal and Information Processing 3, e20.
θ [rad]: When the spacing
between the transducers is d [m] in the case of a 1D
transducer array,
the phase delay of the i-th transducer, ∆φi [rad]
where k [rad/m] is the wavenumber of the ultrasound.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Steering Beam
WaveFront = Plane wave = Beam
[12]C. Shi, Y. Kajikawa, and W.-S. Gan. 2014. An overview of directivity control methods of the parametric array loudspeaker. APSIPA Transactions on Signal and Information Processing 3, e20.
θ [rad]: When the spacing
between the transducers is d [m] in the case of a 1D
transducer array,
the phase delay of the i-th transducer, ∆φi [rad]
where k [rad/m] is the wavenumber of the ultrasound.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Steering Beam
WaveFront = Plane wave = Beam
[12]C. Shi, Y. Kajikawa, and W.-S. Gan. 2014. An overview of directivity control methods of the parametric array loudspeaker. APSIPA Transactions on Signal and Information Processing 3, e20.
θ [rad]: When the spacing
between the transducers is d [m] in the case of a 1D
transducer array,
the phase delay of the i-th transducer, ∆φi [rad]
where k [rad/m] is the wavenumber of the ultrasound.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Sound Focus
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Sound Focus
WaveFront
= Spherical Wave
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Sound Focus
WaveFront
= Spherical Wave
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Sound Focus
WaveFront
= Spherical Wave
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Sound Focus
Focal Point
WaveFront
= Spherical Wave
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Sound Focus
Focal Point
Objective Lens
Plasma
ex. LASER
Coherent
Spherical
Wave
Focal
Point
Hoshi et al, 2008
PTH:
Audible-sound radiation threshold,
self-demodulation effect becomes
obvious when Pu is effectively
high and its square value is not
negligible.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Make it narrow area: Threshold of self-demodulation
temporal change of ultrasonic (primary) waves
the radiation of audible sound (secondary) waves
where c [m/s] is the speed of sound in air, β is the
nonlinear parameter, and ρ [kg/m3] is the mass
density of air
Audible
Area
Pu > PTH
*notice: recording mic is more sensitive than human auditory
& reflection of mic itself recorded
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Recorded Sound
*notice: recording mic is more sensitive than human auditory
& reflection of mic itself recorded
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Recorded Sound
Implementation
“Designing Holographic Loudspeaker”
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Electrical Circuit Design
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Phase Modulation
Evaluation
“How to design the Acoustic Environment”
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Audio Distribution
targetnoise by interference
Ex, Ultrasonic
Super-directional Speaker
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Audio Distribution
targetnoise by interference
Ex, Ultrasonic
Super-directional Speaker
Minimum Focal Area: 20mm x 20mm
Focal Area: 1600mm x 1600mm
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Simulated Results of the Shape of Sound Source
The size of speaker decides fundamental limitation of beam forming.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
User Study1
Direction and Location
for x-y plane
is understandable for users.
x
y
Z
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
User Study2
User can distinguish
these three points (Z axis)
x
y
Z
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
User Study3
Precise audible height
perception is not easy
for users (for Z axis)
x
y
Z
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Results and User Study2&3
Make Larger Difference (Z).
or Change the x-y Direction
x
y
Z
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Sound Quality
*notice: recording mic is more sensitive than human auditory & reflection of mic itself recorded
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Sound Quality
*notice: recording mic is more sensitive than human auditory & reflection of mic itself recorded
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Sound Quality
conventional conventional This studyoriginalwave shape
FFT spectrums
Application
“I can hear Holographic Whisper”
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Application for Interaction
Interactive Sound Distribution
Features for Novel Applications
Narrow and Broad
Trace and Focus
Haptic and Push
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Place the sound spot, more precise and interactive
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Application for Interaction (Focusing inner music instruments)
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Application for Interaction (Whispered Voxels)
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Place the sound spot for pick up target
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Super Narrow Distribution for spotting captions
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Super Narrow Distribution (active design of sound field)
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Super Narrow and Wide Distribution Switchable
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Super Narrow and Wide Distribution Switchable
training and instruction
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
3D manipulation of Object with Audible Annotations
Audible Information
can be recognized
separately.
Audible Information
can not be delivered
separately.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
This technique will expand audio recognitions
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Possible Scenario Super Narrow Distribution
Make Sound Difference
navigation play
shopping
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Super Narrow Distribution (combine with large monitor)
User A
User B
User C
Individual Audio Interaction for voice control
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Super Narrow Distribution (Multi-language conference)
Discussion and Conclusion
“Summery of Holographic Whisper”
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Discussions
Ultrasound exposure
Multiple Sound Points by CGH
It cannot say no effect. Lower than conventional ones
(because this methods generate radiation point
Lower intensity than haptic device
Available by generating multiple focus by multiple modulation.
but it limited spatiotemporal resolution.
Lower intensity(eg.haptic)
Direct Exposure is not
necessary
Available
Advantage
Advantage
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Discussions
Amplitude of Audio Signals
Grating Lobes
Audible
Ultrasonic
Amplitude of Audio signal decides the characteristics
of sound focus, it is typical trade off of this methods.
it generates grating lobes around the focus (40 degree).
This is typical limitation of this methods.
It affects both amplitude
and audio distribution
It generated around the
focal point
limitation and tradeoff
limitation and tradeoff
Discussions
The size of speaker decides fundamental limitation of beam forming.
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Discussions
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Overview
Designing narrow audio distribution for individual communication
Our Study
Conventional
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Conclusion
Production of aerial sound point sources with an ultrasonic phased
array for three-dimensional (3D) audio interaction
includes:
Principles
Theory
Simulated Result
Implementation
User Study
Evaluation
Application
Discussion
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
We envision the post-pixel world
Release data from material existence
and regenerate Material Properties
by using our of range of our sensory organs.
P i x e l s P i x i e s
2D to 2.5D 3 D
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Team
Dr. Yoichi Ochiai
Assistant Prof, Advisor to President
Head of Digital Nature Group,
University of Tsukuba
CEO and coFounder
of Pixie Dust Technologies, inc.
Dr. Takayuki Hoshi
Assistant Prof, University of Tokyo
co Founder
of Pixie Dust Technologies, inc.
Ippei Suzuki
Undergrad Student,
Digital Nature Group,
University of Tsukuba
U n i v e r s i t y o f Ts u k u b a , Yo i c h i O c h i a i L a b r a t o r y
Holographic Whisper:
Rendering audible sound spots in
three-dimensional space by focusing ultrasonic waves
Yoichi Ochiai*13, Takayuki Hoshi*23, Ippei Suzuki*1
*1 University of Tsukuba, Digital Nature Group *2 University of Tokyo, *3 Pixie Dust Technologies, inc.
*joint first authorship, Contact: wizard@slis.tsukuba.ac.jp
Assistant Professor at University of Tsukuba, Head of Digital Nature Group
CEO of Pixie Dust Technologies, inc
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
FAQ
Oh what amazing! Can I buy?
Yes, you can buy soon ( this year)
We provide this technique for B to B for now.
Is it safe???
Our auditory is sensible and
it quite lower intensity than
Ultrasonic Haptic Applications
call or mail
Oh, complex!! Just Use Headphones! Easy!
Nice idea,
it can suppress others voice to concentrate.
What is the next Challenge
towards Post Multimedia?
(Post Pixels interaction)
Visual:
HD(1080p) in Space
60Hz in Time
Audio:
22.1kHz in Time
U n i v e r s i t y o f Ts u k u b a , Yo i c h i O c h i a i L a b r a t o r y
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Go out of the range
What is the next Challenge
towards Post Multimedia?
(Post Pixels interaction)
Visual:
HD(1080p) in Space
60Hz in Time
Audio:
22.1kHz in Time
Multimedia systems are restricted
from limitation and imitation of
the spec of human sensory organs
U n i v e r s i t y o f Ts u k u b a , Yo i c h i O c h i a i L a b r a t o r y
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Go out of the range
What is the next Challenge
towards Post Multimedia?
(Post Pixels interaction)
Visual:
HD(1080p) in Space
60Hz in Time
Audio:
22.1kHz in Time
Multimedia systems are restricted
from limitation and imitation of
the spec of human sensory organs
1.High Intensity
2.High Resolution
3.True Holography
U n i v e r s i t y o f Ts u k u b a , Yo i c h i O c h i a i L a b r a t o r y
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
Go out of the range
U n i v e r s i t y o f Ts u k u b a , Yo i c h i O c h i a i L a b r a t o r y
“Focused Ultrasound and Lasers by Field Generators” U n i v e r s i t y o f Ts u k u b a , Yo i c h i O c h i a i L a b r a t o r y
Spatial light modulator
(SLM)
CGH
Laser
Lens
Focal Points
Acoustic
Optic
Modulation on Reflection
Time delay generation
Acoustic Pressure and Standing Waves
Laser Induced Plasma
Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
We envision the post-pixel world
Release data from material existence
and regenerate Material Properties
by using out of range frequencies of our sensory organs.
P i x e l s P i x i e s
2D to 2.5D
Physical Device
3 D
C o m p u t a t i o n a l W a v e D e s i g n
M a g i c a l E x p e r i e n c e
w i t h N o C o n t a c t D e v i c e
T o w a r d s

More Related Content

What's hot

落合陽一 筑波大 講演資料 10月17日
落合陽一 筑波大 講演資料 10月17日落合陽一 筑波大 講演資料 10月17日
落合陽一 筑波大 講演資料 10月17日
Yoichi Ochiai
 
SSII2020TS: Event-Based Camera の基礎と ニューラルネットワークによる信号処理 〜 生き物のように「変化」を捉えるビジョンセ...
SSII2020TS: Event-Based Camera の基礎と ニューラルネットワークによる信号処理 〜 生き物のように「変化」を捉えるビジョンセ...SSII2020TS: Event-Based Camera の基礎と ニューラルネットワークによる信号処理 〜 生き物のように「変化」を捉えるビジョンセ...
SSII2020TS: Event-Based Camera の基礎と ニューラルネットワークによる信号処理 〜 生き物のように「変化」を捉えるビジョンセ...
SSII
 
先端技術とメディア表現1 #FTMA15
先端技術とメディア表現1 #FTMA15先端技術とメディア表現1 #FTMA15
先端技術とメディア表現1 #FTMA15
Yoichi Ochiai
 
研究室における研究・実装ノウハウの共有
研究室における研究・実装ノウハウの共有研究室における研究・実装ノウハウの共有
研究室における研究・実装ノウハウの共有
Naoaki Okazaki
 
3次元レジストレーション(PCLデモとコード付き)
3次元レジストレーション(PCLデモとコード付き)3次元レジストレーション(PCLデモとコード付き)
3次元レジストレーション(PCLデモとコード付き)
Toru Tamaki
 
#FTMA15 先端技術とメディア表現#2 
#FTMA15 先端技術とメディア表現#2 #FTMA15 先端技術とメディア表現#2 
#FTMA15 先端技術とメディア表現#2 
Yoichi Ochiai
 
SSII2018TS: 3D物体検出とロボットビジョンへの応用
SSII2018TS: 3D物体検出とロボットビジョンへの応用SSII2018TS: 3D物体検出とロボットビジョンへの応用
SSII2018TS: 3D物体検出とロボットビジョンへの応用
SSII
 
研究発表のためのプレゼンテーション技術
研究発表のためのプレゼンテーション技術研究発表のためのプレゼンテーション技術
研究発表のためのプレゼンテーション技術
Shinnosuke Takamichi
 
SIGGRAPH 2017 Theater: SIGGRAPH in Japanese and Japan CG Showcase by Yoichi O...
SIGGRAPH 2017 Theater: SIGGRAPH in Japanese and Japan CG Showcase by Yoichi O...SIGGRAPH 2017 Theater: SIGGRAPH in Japanese and Japan CG Showcase by Yoichi O...
SIGGRAPH 2017 Theater: SIGGRAPH in Japanese and Japan CG Showcase by Yoichi O...
Yoichi Ochiai
 
研究分野をサーベイする
研究分野をサーベイする研究分野をサーベイする
研究分野をサーベイする
Takayuki Itoh
 
工学系大学4年生のための論文の読み方
工学系大学4年生のための論文の読み方工学系大学4年生のための論文の読み方
工学系大学4年生のための論文の読み方
ychtanaka
 
#FTMA15 第一回 仏・人間コース全PDF
#FTMA15 第一回 仏・人間コース全PDF#FTMA15 第一回 仏・人間コース全PDF
#FTMA15 第一回 仏・人間コース全PDF
Yoichi Ochiai
 
NDTスキャンマッチング 第1回3D勉強会@PFN 2018年5月27日
NDTスキャンマッチング 第1回3D勉強会@PFN 2018年5月27日NDTスキャンマッチング 第1回3D勉強会@PFN 2018年5月27日
NDTスキャンマッチング 第1回3D勉強会@PFN 2018年5月27日
Kitsukawa Yuki
 
20160417dlibによる顔器官検出
20160417dlibによる顔器官検出20160417dlibによる顔器官検出
20160417dlibによる顔器官検出
Takuya Minagawa
 
Surveyから始まる研究者への道 - Stand on the shoulders of giants -
Surveyから始まる研究者への道 - Stand on the shoulders of giants -Surveyから始まる研究者への道 - Stand on the shoulders of giants -
Surveyから始まる研究者への道 - Stand on the shoulders of giants -
諒介 荒木
 
Structure from Motion
Structure from MotionStructure from Motion
Structure from Motion
Ryutaro Yamauchi
 
Popcntによるハミング距離計算
Popcntによるハミング距離計算Popcntによるハミング距離計算
Popcntによるハミング距離計算
Norishige Fukushima
 
Pixie Dust - SIGGGRAPH 2014
Pixie Dust - SIGGGRAPH 2014Pixie Dust - SIGGGRAPH 2014
Pixie Dust - SIGGGRAPH 2014
Yoichi Ochiai
 
深層学習と音響信号処理
深層学習と音響信号処理深層学習と音響信号処理
深層学習と音響信号処理
Yuma Koizumi
 
見やすいプレゼン資料の作り方 - リニューアル増量版
見やすいプレゼン資料の作り方 - リニューアル増量版見やすいプレゼン資料の作り方 - リニューアル増量版
見やすいプレゼン資料の作り方 - リニューアル増量版
MOCKS | Yuta Morishige
 

What's hot (20)

落合陽一 筑波大 講演資料 10月17日
落合陽一 筑波大 講演資料 10月17日落合陽一 筑波大 講演資料 10月17日
落合陽一 筑波大 講演資料 10月17日
 
SSII2020TS: Event-Based Camera の基礎と ニューラルネットワークによる信号処理 〜 生き物のように「変化」を捉えるビジョンセ...
SSII2020TS: Event-Based Camera の基礎と ニューラルネットワークによる信号処理 〜 生き物のように「変化」を捉えるビジョンセ...SSII2020TS: Event-Based Camera の基礎と ニューラルネットワークによる信号処理 〜 生き物のように「変化」を捉えるビジョンセ...
SSII2020TS: Event-Based Camera の基礎と ニューラルネットワークによる信号処理 〜 生き物のように「変化」を捉えるビジョンセ...
 
先端技術とメディア表現1 #FTMA15
先端技術とメディア表現1 #FTMA15先端技術とメディア表現1 #FTMA15
先端技術とメディア表現1 #FTMA15
 
研究室における研究・実装ノウハウの共有
研究室における研究・実装ノウハウの共有研究室における研究・実装ノウハウの共有
研究室における研究・実装ノウハウの共有
 
3次元レジストレーション(PCLデモとコード付き)
3次元レジストレーション(PCLデモとコード付き)3次元レジストレーション(PCLデモとコード付き)
3次元レジストレーション(PCLデモとコード付き)
 
#FTMA15 先端技術とメディア表現#2 
#FTMA15 先端技術とメディア表現#2 #FTMA15 先端技術とメディア表現#2 
#FTMA15 先端技術とメディア表現#2 
 
SSII2018TS: 3D物体検出とロボットビジョンへの応用
SSII2018TS: 3D物体検出とロボットビジョンへの応用SSII2018TS: 3D物体検出とロボットビジョンへの応用
SSII2018TS: 3D物体検出とロボットビジョンへの応用
 
研究発表のためのプレゼンテーション技術
研究発表のためのプレゼンテーション技術研究発表のためのプレゼンテーション技術
研究発表のためのプレゼンテーション技術
 
SIGGRAPH 2017 Theater: SIGGRAPH in Japanese and Japan CG Showcase by Yoichi O...
SIGGRAPH 2017 Theater: SIGGRAPH in Japanese and Japan CG Showcase by Yoichi O...SIGGRAPH 2017 Theater: SIGGRAPH in Japanese and Japan CG Showcase by Yoichi O...
SIGGRAPH 2017 Theater: SIGGRAPH in Japanese and Japan CG Showcase by Yoichi O...
 
研究分野をサーベイする
研究分野をサーベイする研究分野をサーベイする
研究分野をサーベイする
 
工学系大学4年生のための論文の読み方
工学系大学4年生のための論文の読み方工学系大学4年生のための論文の読み方
工学系大学4年生のための論文の読み方
 
#FTMA15 第一回 仏・人間コース全PDF
#FTMA15 第一回 仏・人間コース全PDF#FTMA15 第一回 仏・人間コース全PDF
#FTMA15 第一回 仏・人間コース全PDF
 
NDTスキャンマッチング 第1回3D勉強会@PFN 2018年5月27日
NDTスキャンマッチング 第1回3D勉強会@PFN 2018年5月27日NDTスキャンマッチング 第1回3D勉強会@PFN 2018年5月27日
NDTスキャンマッチング 第1回3D勉強会@PFN 2018年5月27日
 
20160417dlibによる顔器官検出
20160417dlibによる顔器官検出20160417dlibによる顔器官検出
20160417dlibによる顔器官検出
 
Surveyから始まる研究者への道 - Stand on the shoulders of giants -
Surveyから始まる研究者への道 - Stand on the shoulders of giants -Surveyから始まる研究者への道 - Stand on the shoulders of giants -
Surveyから始まる研究者への道 - Stand on the shoulders of giants -
 
Structure from Motion
Structure from MotionStructure from Motion
Structure from Motion
 
Popcntによるハミング距離計算
Popcntによるハミング距離計算Popcntによるハミング距離計算
Popcntによるハミング距離計算
 
Pixie Dust - SIGGGRAPH 2014
Pixie Dust - SIGGGRAPH 2014Pixie Dust - SIGGGRAPH 2014
Pixie Dust - SIGGGRAPH 2014
 
深層学習と音響信号処理
深層学習と音響信号処理深層学習と音響信号処理
深層学習と音響信号処理
 
見やすいプレゼン資料の作り方 - リニューアル増量版
見やすいプレゼン資料の作り方 - リニューアル増量版見やすいプレゼン資料の作り方 - リニューアル増量版
見やすいプレゼン資料の作り方 - リニューアル増量版
 

Viewers also liked

Digital Nature Group at Ars Electronica Summit
Digital Nature Group at Ars Electronica SummitDigital Nature Group at Ars Electronica Summit
Digital Nature Group at Ars Electronica Summit
Yoichi Ochiai
 
#FTMA15 第七回課題 全コースサーベイ
#FTMA15 第七回課題 全コースサーベイ#FTMA15 第七回課題 全コースサーベイ
#FTMA15 第七回課題 全コースサーベイ
Yoichi Ochiai
 
#FTMA15 第六回課題 全コースサーベイ
#FTMA15 第六回課題 全コースサーベイ#FTMA15 第六回課題 全コースサーベイ
#FTMA15 第六回課題 全コースサーベイ
Yoichi Ochiai
 
#FTMA15 第三回課題 仏・人間コース サーベイ
#FTMA15 第三回課題 仏・人間コース サーベイ#FTMA15 第三回課題 仏・人間コース サーベイ
#FTMA15 第三回課題 仏・人間コース サーベイ
Yoichi Ochiai
 
Possibility of Pixie Dust Technology
Possibility of Pixie Dust TechnologyPossibility of Pixie Dust Technology
Possibility of Pixie Dust Technology
Yoichi Ochiai
 
#FTMA15 先端技術とメディア表現3
#FTMA15 先端技術とメディア表現3#FTMA15 先端技術とメディア表現3
#FTMA15 先端技術とメディア表現3
Yoichi Ochiai
 
#FTMA15 第四回課題 全コースサーベイ
#FTMA15 第四回課題 全コースサーベイ#FTMA15 第四回課題 全コースサーベイ
#FTMA15 第四回課題 全コースサーベイ
Yoichi Ochiai
 
#FTMA15 第五回課題 全コースサーベイ
#FTMA15 第五回課題 全コースサーベイ#FTMA15 第五回課題 全コースサーベイ
#FTMA15 第五回課題 全コースサーベイ
Yoichi Ochiai
 
#FTMA15 第二回課題 仏・人間コース サーベイ
#FTMA15 第二回課題 仏・人間コース サーベイ#FTMA15 第二回課題 仏・人間コース サーベイ
#FTMA15 第二回課題 仏・人間コース サーベイ
Yoichi Ochiai
 

Viewers also liked (10)

Digital Nature Group at Ars Electronica Summit
Digital Nature Group at Ars Electronica SummitDigital Nature Group at Ars Electronica Summit
Digital Nature Group at Ars Electronica Summit
 
#FTMA15 第七回課題 全コースサーベイ
#FTMA15 第七回課題 全コースサーベイ#FTMA15 第七回課題 全コースサーベイ
#FTMA15 第七回課題 全コースサーベイ
 
#FTMA15 第六回課題 全コースサーベイ
#FTMA15 第六回課題 全コースサーベイ#FTMA15 第六回課題 全コースサーベイ
#FTMA15 第六回課題 全コースサーベイ
 
#FTMA15 第三回課題 仏・人間コース サーベイ
#FTMA15 第三回課題 仏・人間コース サーベイ#FTMA15 第三回課題 仏・人間コース サーベイ
#FTMA15 第三回課題 仏・人間コース サーベイ
 
Ftma15 04 all
Ftma15 04 allFtma15 04 all
Ftma15 04 all
 
Possibility of Pixie Dust Technology
Possibility of Pixie Dust TechnologyPossibility of Pixie Dust Technology
Possibility of Pixie Dust Technology
 
#FTMA15 先端技術とメディア表現3
#FTMA15 先端技術とメディア表現3#FTMA15 先端技術とメディア表現3
#FTMA15 先端技術とメディア表現3
 
#FTMA15 第四回課題 全コースサーベイ
#FTMA15 第四回課題 全コースサーベイ#FTMA15 第四回課題 全コースサーベイ
#FTMA15 第四回課題 全コースサーベイ
 
#FTMA15 第五回課題 全コースサーベイ
#FTMA15 第五回課題 全コースサーベイ#FTMA15 第五回課題 全コースサーベイ
#FTMA15 第五回課題 全コースサーベイ
 
#FTMA15 第二回課題 仏・人間コース サーベイ
#FTMA15 第二回課題 仏・人間コース サーベイ#FTMA15 第二回課題 仏・人間コース サーベイ
#FTMA15 第二回課題 仏・人間コース サーベイ
 

Similar to Holographic Whisper - CHI2017 oral presentation by Yoichi Ochiai

October 2021: Top Read Articles in Soft Computing
October 2021: Top Read Articles in Soft ComputingOctober 2021: Top Read Articles in Soft Computing
October 2021: Top Read Articles in Soft Computing
ijsc
 
March 2021: Top Read Articles in Soft Computing
March 2021: Top Read Articles in Soft ComputingMarch 2021: Top Read Articles in Soft Computing
March 2021: Top Read Articles in Soft Computing
ijsc
 
Doubly-Massive MIMO Systems at mmWave Frequencies: Opportunities and Research...
Doubly-Massive MIMO Systems at mmWave Frequencies: Opportunities and Research...Doubly-Massive MIMO Systems at mmWave Frequencies: Opportunities and Research...
Doubly-Massive MIMO Systems at mmWave Frequencies: Opportunities and Research...
Stefano Buzzi
 
Complete Book_merged.pdf.mmmmmmmmmmmmmmm
Complete Book_merged.pdf.mmmmmmmmmmmmmmmComplete Book_merged.pdf.mmmmmmmmmmmmmmm
Complete Book_merged.pdf.mmmmmmmmmmmmmmm
MaherAbedElAziz1
 
Rion ebook vol1
Rion ebook vol1Rion ebook vol1
Rion ebook vol1
NIHON DENKEI SINGAPORE
 
International Journal of Engineering (IJE) Volume (4) Issue (3)
International Journal of Engineering (IJE) Volume (4)  Issue (3)International Journal of Engineering (IJE) Volume (4)  Issue (3)
International Journal of Engineering (IJE) Volume (4) Issue (3)
CSCJournals
 
Towards User-friendly Audio Creation
Towards User-friendly Audio CreationTowards User-friendly Audio Creation
Towards User-friendly Audio Creation
Jean Vanderdonckt
 
CV_Wilberth_Herrera_2016
CV_Wilberth_Herrera_2016CV_Wilberth_Herrera_2016
CV_Wilberth_Herrera_2016
Wilberth Herrera
 
Two_approaches_for_ultrafast_random_bit_generation.pdf
Two_approaches_for_ultrafast_random_bit_generation.pdfTwo_approaches_for_ultrafast_random_bit_generation.pdf
Two_approaches_for_ultrafast_random_bit_generation.pdf
KienBuiXuan3
 
New research articles 2020 june issue- international journal of computer sc...
New research articles   2020 june issue- international journal of computer sc...New research articles   2020 june issue- international journal of computer sc...
New research articles 2020 june issue- international journal of computer sc...
AIRCC Publishing Corporation
 
Acoustic-The Way of Utilizing the Resource for Research and Technology Implem...
Acoustic-The Way of Utilizing the Resource for Research and Technology Implem...Acoustic-The Way of Utilizing the Resource for Research and Technology Implem...
Acoustic-The Way of Utilizing the Resource for Research and Technology Implem...
ijtsrd
 
CCV (13)
CCV (13)CCV (13)
CCV (13)
Eldad Tsabary
 
Noise-jkkniu-Mozakkir.pdf
Noise-jkkniu-Mozakkir.pdfNoise-jkkniu-Mozakkir.pdf
Noise-jkkniu-Mozakkir.pdf
Mozakkir Azad
 
Acoustic Materials & Specifications
Acoustic Materials & SpecificationsAcoustic Materials & Specifications
Acoustic Materials & Specifications
Siniša Prvanov
 
20129-22318-1-PB
20129-22318-1-PB20129-22318-1-PB
20129-22318-1-PB
Shatha Ibrahim
 
ITIICCCS_2016_paper
ITIICCCS_2016_paperITIICCCS_2016_paper
ITIICCCS_2016_paper
Richard Plaatjes
 
Communication.pptx
Communication.pptxCommunication.pptx
Communication.pptx
RahulBosu2
 
20110415 Scattering in CG and CV
20110415 Scattering in CG and CV20110415 Scattering in CG and CV
20110415 Scattering in CG and CV
Toru Tamaki
 
paper presentation on fss 19 feb
paper presentation on fss 19 febpaper presentation on fss 19 feb
paper presentation on fss 19 feb
ANKUSH PRAJAPAT
 
Identification and Authentication Using Clavicles
Identification and Authentication Using ClaviclesIdentification and Authentication Using Clavicles
Identification and Authentication Using Clavicles
sugiuralab
 

Similar to Holographic Whisper - CHI2017 oral presentation by Yoichi Ochiai (20)

October 2021: Top Read Articles in Soft Computing
October 2021: Top Read Articles in Soft ComputingOctober 2021: Top Read Articles in Soft Computing
October 2021: Top Read Articles in Soft Computing
 
March 2021: Top Read Articles in Soft Computing
March 2021: Top Read Articles in Soft ComputingMarch 2021: Top Read Articles in Soft Computing
March 2021: Top Read Articles in Soft Computing
 
Doubly-Massive MIMO Systems at mmWave Frequencies: Opportunities and Research...
Doubly-Massive MIMO Systems at mmWave Frequencies: Opportunities and Research...Doubly-Massive MIMO Systems at mmWave Frequencies: Opportunities and Research...
Doubly-Massive MIMO Systems at mmWave Frequencies: Opportunities and Research...
 
Complete Book_merged.pdf.mmmmmmmmmmmmmmm
Complete Book_merged.pdf.mmmmmmmmmmmmmmmComplete Book_merged.pdf.mmmmmmmmmmmmmmm
Complete Book_merged.pdf.mmmmmmmmmmmmmmm
 
Rion ebook vol1
Rion ebook vol1Rion ebook vol1
Rion ebook vol1
 
International Journal of Engineering (IJE) Volume (4) Issue (3)
International Journal of Engineering (IJE) Volume (4)  Issue (3)International Journal of Engineering (IJE) Volume (4)  Issue (3)
International Journal of Engineering (IJE) Volume (4) Issue (3)
 
Towards User-friendly Audio Creation
Towards User-friendly Audio CreationTowards User-friendly Audio Creation
Towards User-friendly Audio Creation
 
CV_Wilberth_Herrera_2016
CV_Wilberth_Herrera_2016CV_Wilberth_Herrera_2016
CV_Wilberth_Herrera_2016
 
Two_approaches_for_ultrafast_random_bit_generation.pdf
Two_approaches_for_ultrafast_random_bit_generation.pdfTwo_approaches_for_ultrafast_random_bit_generation.pdf
Two_approaches_for_ultrafast_random_bit_generation.pdf
 
New research articles 2020 june issue- international journal of computer sc...
New research articles   2020 june issue- international journal of computer sc...New research articles   2020 june issue- international journal of computer sc...
New research articles 2020 june issue- international journal of computer sc...
 
Acoustic-The Way of Utilizing the Resource for Research and Technology Implem...
Acoustic-The Way of Utilizing the Resource for Research and Technology Implem...Acoustic-The Way of Utilizing the Resource for Research and Technology Implem...
Acoustic-The Way of Utilizing the Resource for Research and Technology Implem...
 
CCV (13)
CCV (13)CCV (13)
CCV (13)
 
Noise-jkkniu-Mozakkir.pdf
Noise-jkkniu-Mozakkir.pdfNoise-jkkniu-Mozakkir.pdf
Noise-jkkniu-Mozakkir.pdf
 
Acoustic Materials & Specifications
Acoustic Materials & SpecificationsAcoustic Materials & Specifications
Acoustic Materials & Specifications
 
20129-22318-1-PB
20129-22318-1-PB20129-22318-1-PB
20129-22318-1-PB
 
ITIICCCS_2016_paper
ITIICCCS_2016_paperITIICCCS_2016_paper
ITIICCCS_2016_paper
 
Communication.pptx
Communication.pptxCommunication.pptx
Communication.pptx
 
20110415 Scattering in CG and CV
20110415 Scattering in CG and CV20110415 Scattering in CG and CV
20110415 Scattering in CG and CV
 
paper presentation on fss 19 feb
paper presentation on fss 19 febpaper presentation on fss 19 feb
paper presentation on fss 19 feb
 
Identification and Authentication Using Clavicles
Identification and Authentication Using ClaviclesIdentification and Authentication Using Clavicles
Identification and Authentication Using Clavicles
 

Recently uploaded

Introduction to Computer Networks & OSI MODEL.ppt
Introduction to Computer Networks & OSI MODEL.pptIntroduction to Computer Networks & OSI MODEL.ppt
Introduction to Computer Networks & OSI MODEL.ppt
Dwarkadas J Sanghvi College of Engineering
 
ITSM Integration with MuleSoft.pptx
ITSM  Integration with MuleSoft.pptxITSM  Integration with MuleSoft.pptx
ITSM Integration with MuleSoft.pptx
VANDANAMOHANGOUDA
 
4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf
4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf
4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf
Gino153088
 
Computational Engineering IITH Presentation
Computational Engineering IITH PresentationComputational Engineering IITH Presentation
Computational Engineering IITH Presentation
co23btech11018
 
DEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODEL
DEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODELDEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODEL
DEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODEL
ijaia
 
Transformers design and coooling methods
Transformers design and coooling methodsTransformers design and coooling methods
Transformers design and coooling methods
Roger Rozario
 
一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理
一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理
一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理
nedcocy
 
AI + Data Community Tour - Build the Next Generation of Apps with the Einstei...
AI + Data Community Tour - Build the Next Generation of Apps with the Einstei...AI + Data Community Tour - Build the Next Generation of Apps with the Einstei...
AI + Data Community Tour - Build the Next Generation of Apps with the Einstei...
Paris Salesforce Developer Group
 
SCALING OF MOS CIRCUITS m .pptx
SCALING OF MOS CIRCUITS m                 .pptxSCALING OF MOS CIRCUITS m                 .pptx
SCALING OF MOS CIRCUITS m .pptx
harshapolam10
 
Object Oriented Analysis and Design - OOAD
Object Oriented Analysis and Design - OOADObject Oriented Analysis and Design - OOAD
Object Oriented Analysis and Design - OOAD
PreethaV16
 
Digital Twins Computer Networking Paper Presentation.pptx
Digital Twins Computer Networking Paper Presentation.pptxDigital Twins Computer Networking Paper Presentation.pptx
Digital Twins Computer Networking Paper Presentation.pptx
aryanpankaj78
 
VARIABLE FREQUENCY DRIVE. VFDs are widely used in industrial applications for...
VARIABLE FREQUENCY DRIVE. VFDs are widely used in industrial applications for...VARIABLE FREQUENCY DRIVE. VFDs are widely used in industrial applications for...
VARIABLE FREQUENCY DRIVE. VFDs are widely used in industrial applications for...
PIMR BHOPAL
 
一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理
一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理
一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理
ecqow
 
5G Radio Network Througput Problem Analysis HCIA.pdf
5G Radio Network Througput Problem Analysis HCIA.pdf5G Radio Network Througput Problem Analysis HCIA.pdf
5G Radio Network Througput Problem Analysis HCIA.pdf
AlvianRamadhani5
 
Call For Paper -3rd International Conference on Artificial Intelligence Advan...
Call For Paper -3rd International Conference on Artificial Intelligence Advan...Call For Paper -3rd International Conference on Artificial Intelligence Advan...
Call For Paper -3rd International Conference on Artificial Intelligence Advan...
ijseajournal
 
原版制作(Humboldt毕业证书)柏林大学毕业证学位证一模一样
原版制作(Humboldt毕业证书)柏林大学毕业证学位证一模一样原版制作(Humboldt毕业证书)柏林大学毕业证学位证一模一样
原版制作(Humboldt毕业证书)柏林大学毕业证学位证一模一样
ydzowc
 
UNIT 4 LINEAR INTEGRATED CIRCUITS-DIGITAL ICS
UNIT 4 LINEAR INTEGRATED CIRCUITS-DIGITAL ICSUNIT 4 LINEAR INTEGRATED CIRCUITS-DIGITAL ICS
UNIT 4 LINEAR INTEGRATED CIRCUITS-DIGITAL ICS
vmspraneeth
 
Data Driven Maintenance | UReason Webinar
Data Driven Maintenance | UReason WebinarData Driven Maintenance | UReason Webinar
Data Driven Maintenance | UReason Webinar
UReason
 
Introduction to verilog basic modeling .ppt
Introduction to verilog basic modeling   .pptIntroduction to verilog basic modeling   .ppt
Introduction to verilog basic modeling .ppt
AmitKumar730022
 
TIME TABLE MANAGEMENT SYSTEM testing.pptx
TIME TABLE MANAGEMENT SYSTEM testing.pptxTIME TABLE MANAGEMENT SYSTEM testing.pptx
TIME TABLE MANAGEMENT SYSTEM testing.pptx
CVCSOfficial
 

Recently uploaded (20)

Introduction to Computer Networks & OSI MODEL.ppt
Introduction to Computer Networks & OSI MODEL.pptIntroduction to Computer Networks & OSI MODEL.ppt
Introduction to Computer Networks & OSI MODEL.ppt
 
ITSM Integration with MuleSoft.pptx
ITSM  Integration with MuleSoft.pptxITSM  Integration with MuleSoft.pptx
ITSM Integration with MuleSoft.pptx
 
4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf
4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf
4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf
 
Computational Engineering IITH Presentation
Computational Engineering IITH PresentationComputational Engineering IITH Presentation
Computational Engineering IITH Presentation
 
DEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODEL
DEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODELDEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODEL
DEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODEL
 
Transformers design and coooling methods
Transformers design and coooling methodsTransformers design and coooling methods
Transformers design and coooling methods
 
一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理
一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理
一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理
 
AI + Data Community Tour - Build the Next Generation of Apps with the Einstei...
AI + Data Community Tour - Build the Next Generation of Apps with the Einstei...AI + Data Community Tour - Build the Next Generation of Apps with the Einstei...
AI + Data Community Tour - Build the Next Generation of Apps with the Einstei...
 
SCALING OF MOS CIRCUITS m .pptx
SCALING OF MOS CIRCUITS m                 .pptxSCALING OF MOS CIRCUITS m                 .pptx
SCALING OF MOS CIRCUITS m .pptx
 
Object Oriented Analysis and Design - OOAD
Object Oriented Analysis and Design - OOADObject Oriented Analysis and Design - OOAD
Object Oriented Analysis and Design - OOAD
 
Digital Twins Computer Networking Paper Presentation.pptx
Digital Twins Computer Networking Paper Presentation.pptxDigital Twins Computer Networking Paper Presentation.pptx
Digital Twins Computer Networking Paper Presentation.pptx
 
VARIABLE FREQUENCY DRIVE. VFDs are widely used in industrial applications for...
VARIABLE FREQUENCY DRIVE. VFDs are widely used in industrial applications for...VARIABLE FREQUENCY DRIVE. VFDs are widely used in industrial applications for...
VARIABLE FREQUENCY DRIVE. VFDs are widely used in industrial applications for...
 
一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理
一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理
一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理
 
5G Radio Network Througput Problem Analysis HCIA.pdf
5G Radio Network Througput Problem Analysis HCIA.pdf5G Radio Network Througput Problem Analysis HCIA.pdf
5G Radio Network Througput Problem Analysis HCIA.pdf
 
Call For Paper -3rd International Conference on Artificial Intelligence Advan...
Call For Paper -3rd International Conference on Artificial Intelligence Advan...Call For Paper -3rd International Conference on Artificial Intelligence Advan...
Call For Paper -3rd International Conference on Artificial Intelligence Advan...
 
原版制作(Humboldt毕业证书)柏林大学毕业证学位证一模一样
原版制作(Humboldt毕业证书)柏林大学毕业证学位证一模一样原版制作(Humboldt毕业证书)柏林大学毕业证学位证一模一样
原版制作(Humboldt毕业证书)柏林大学毕业证学位证一模一样
 
UNIT 4 LINEAR INTEGRATED CIRCUITS-DIGITAL ICS
UNIT 4 LINEAR INTEGRATED CIRCUITS-DIGITAL ICSUNIT 4 LINEAR INTEGRATED CIRCUITS-DIGITAL ICS
UNIT 4 LINEAR INTEGRATED CIRCUITS-DIGITAL ICS
 
Data Driven Maintenance | UReason Webinar
Data Driven Maintenance | UReason WebinarData Driven Maintenance | UReason Webinar
Data Driven Maintenance | UReason Webinar
 
Introduction to verilog basic modeling .ppt
Introduction to verilog basic modeling   .pptIntroduction to verilog basic modeling   .ppt
Introduction to verilog basic modeling .ppt
 
TIME TABLE MANAGEMENT SYSTEM testing.pptx
TIME TABLE MANAGEMENT SYSTEM testing.pptxTIME TABLE MANAGEMENT SYSTEM testing.pptx
TIME TABLE MANAGEMENT SYSTEM testing.pptx
 

Holographic Whisper - CHI2017 oral presentation by Yoichi Ochiai

  • 1. Holographic Whisper: Rendering audible sound spots in three-dimensional space by focusing ultrasonic waves Yoichi Ochiai*13, Takayuki Hoshi*23, Ippei Suzuki*1 *1 University of Tsukuba, Digital Nature Group *2 University of Tokyo, *3 Pixie Dust Technologies, inc. *joint first authorship, Contact: wizard@slis.tsukuba.ac.jp Assistant Professor at University of Tsukuba, Head of Digital Nature Group CEO of Pixie Dust Technologies, inc
  • 2. Motivation and Introduction “Render the Aerial Sound Sources separated from Machines” Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
  • 3. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. We envision the post-pixel world Release data from material existence and regenerate Material Properties by using out of range frequencies of our sensory organs. P i x e l s P i x i e s 2D to 2.5D Physical Device 3 D C o m p u t a t i o n a l W a v e D e s i g n M a g i c a l E x p e r i e n c e w i t h N o C o n t a c t D e v i c e T o w a r d s
  • 4. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Pixel Image Haptic Haptic Sound Manipulation 2.5D Voxel Human How can we update the pixel world (2.5D) towards pixie world (3D)? Scenery of 2000s to 2020 2.5D device Physical Laptops Traditional Scenery
  • 5. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Post-Pixel Alternatives By Computational Wave Synthesis Manipulation of Object Aerial HapticsAerial Image and Haptics Voxel Graphics holographic laser plasma Holographic laser plasma and ultrasonic holographic ultrasonic levitation holographic ultrasonic levitation We have studied to envision the alternatives by computational wave synthesis.
  • 6. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Post-Pixel Alternatives By Computational Wave Synthesis Manipulation of Object Aerial HapticsAerial Image and Haptics Voxel Graphics holographic laser plasma Holographic laser plasma and ultrasonic holographic ultrasonic levitation holographic ultrasonic levitation Next! Holographic Audio We have studied to envision the alternatives by computational wave synthesis.
  • 7. U n i v e r s i t y o f Ts u k u b a , Yo i c h i O c h i a i L a b r a t o r y
  • 8. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Towards three dimensional audio communication 19c-20c 1990- Broad Ultrasonic Beam Mass-Communication Towards Individual Communication ABC.com, Ponpei,et,al. 2017- Holographic Points and Steerable Beams Towards Personalized Communication with Ubiquitous Environment Our Study
  • 9. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Overview Designing narrow audio distribution for individual communication Our Study Conventional
  • 10. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Contribution The method enables production of aerial sound point sources with an ultrasonic phased array for three-dimensional (3D) audio interaction which includes: Principles Theory Simulated Result Implementation User Study Evaluation Application Discussion
  • 11. Related Works “How to design the Acoustic Environment” Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
  • 12. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. The Audio Communication Audible Communication has been separated since Edisons Era. Individual Broad
  • 13.
  • 14. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Efforts towards Holographic Individual Audio [3]BOSE. F1 flexible array loudspeaker system. from http://www.bose.com/prc.jsp?url=/promotions/entry_pages/f1/index_en.jsp [4]JBL. IntelliDisc-DS90. from http://www.jblpro.com/www/products/installed-sound/intellidisc-ds90 [5]M. Yoneyama, J. Fujimoto, Y. Kawamo, and S. Sasabe. 1983. The audio spotlight: An application of nonlinear interaction of sound waves to a new type of loudspeaker design. The Journal of the Acoustical Society of America 73, 5, 1532-1536. [6]K. Aoki, T. Kamakura, and Y. Kumamoto. 1991. Parametric loudspeaker - Characteristics of acoustic field and suitable modulation of carrier ultrasound, Electronics and Communications in Japan 74, 9, 76-82. [7]F.J. Pompei. 1999. The use of airborne ultrasonics for generating audible sound beams, Journal of the Audio Engineering Society 47, 9, 726-731. [9]K. Shinagawa, Y. Amemiya, H. Takemura, S. Kagami, and H. Mizoguchi. 2007. Three dimensional simulation and measurement of sound pressure distribution generated by 120 ch plane loudspeaker array. In Proceedings of IEEE International Conference on Systems, Man and Cybernetics, 278-283. [10]T. Matsui, D. Ikefuji, M. Nakayama, and T. Nishiura. 2014. Multiple audio spots design based on separating emission of carrier and sideband waves. In Proceedings of International Congress and Exposition on Noise Control Engineering, 6313-6317. [12]C. Shi, Y. Kajikawa, and W.-S. Gan. 2014. An overview of directivity control methods of the parametric array loudspeaker. APSIPA Transactions on Signal and Information Processing 3, e20. ABC.com, Ponpei,et,al.
  • 15. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Efforts towards Holographic Individual Audio [3]BOSE. F1 flexible array loudspeaker system. from http://www.bose.com/prc.jsp?url=/promotions/entry_pages/f1/index_en.jsp [4]JBL. IntelliDisc-DS90. from http://www.jblpro.com/www/products/installed-sound/intellidisc-ds90 [5]M. Yoneyama, J. Fujimoto, Y. Kawamo, and S. Sasabe. 1983. The audio spotlight: An application of nonlinear interaction of sound waves to a new type of loudspeaker design. The Journal of the Acoustical Society of America 73, 5, 1532-1536. [6]K. Aoki, T. Kamakura, and Y. Kumamoto. 1991. Parametric loudspeaker - Characteristics of acoustic field and suitable modulation of carrier ultrasound, Electronics and Communications in Japan 74, 9, 76-82. [7]F.J. Pompei. 1999. The use of airborne ultrasonics for generating audible sound beams, Journal of the Audio Engineering Society 47, 9, 726-731. [9]K. Shinagawa, Y. Amemiya, H. Takemura, S. Kagami, and H. Mizoguchi. 2007. Three dimensional simulation and measurement of sound pressure distribution generated by 120 ch plane loudspeaker array. In Proceedings of IEEE International Conference on Systems, Man and Cybernetics, 278-283. [10]T. Matsui, D. Ikefuji, M. Nakayama, and T. Nishiura. 2014. Multiple audio spots design based on separating emission of carrier and sideband waves. In Proceedings of International Congress and Exposition on Noise Control Engineering, 6313-6317. [12]C. Shi, Y. Kajikawa, and W.-S. Gan. 2014. An overview of directivity control methods of the parametric array loudspeaker. APSIPA Transactions on Signal and Information Processing 3, e20. ABC.com, Ponpei,et,al. Pickup
  • 16. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. How the ultrasonic directional audio works? Why??? How did it achieved?
  • 17. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Beam Forming [5]M. Yoneyama, J. Fujimoto, Y. Kawamo, and S. Sasabe. 1983. The audio spotlight: An application of nonlinear interaction of sound waves to a new type of loudspeaker design. The Journal of the Acoustical Society of America 73, 5, 1532-1536. [6]K. Aoki, T. Kamakura, and Y. Kumamoto. 1991. Parametric loudspeaker - Characteristics of acoustic field and suitable modulation of carrier ultrasound, Electronics and Communications in Japan 74, 9, 76-82. [7]F.J. Pompei. 1999. The use of airborne ultrasonics for generating audible sound beams, Journal of the Audio Engineering Society 47, 9, 726-731.
  • 18. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Beam Forming [5]M. Yoneyama, J. Fujimoto, Y. Kawamo, and S. Sasabe. 1983. The audio spotlight: An application of nonlinear interaction of sound waves to a new type of loudspeaker design. The Journal of the Acoustical Society of America 73, 5, 1532-1536. [6]K. Aoki, T. Kamakura, and Y. Kumamoto. 1991. Parametric loudspeaker - Characteristics of acoustic field and suitable modulation of carrier ultrasound, Electronics and Communications in Japan 74, 9, 76-82. [7]F.J. Pompei. 1999. The use of airborne ultrasonics for generating audible sound beams, Journal of the Audio Engineering Society 47, 9, 726-731.
  • 19. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Beam Forming WaveFront = Plane Wave = Sound Beam [5]M. Yoneyama, J. Fujimoto, Y. Kawamo, and S. Sasabe. 1983. The audio spotlight: An application of nonlinear interaction of sound waves to a new type of loudspeaker design. The Journal of the Acoustical Society of America 73, 5, 1532-1536. [6]K. Aoki, T. Kamakura, and Y. Kumamoto. 1991. Parametric loudspeaker - Characteristics of acoustic field and suitable modulation of carrier ultrasound, Electronics and Communications in Japan 74, 9, 76-82. [7]F.J. Pompei. 1999. The use of airborne ultrasonics for generating audible sound beams, Journal of the Audio Engineering Society 47, 9, 726-731.
  • 20. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Beam Forming WaveFront = Plane Wave = Sound Beam [5]M. Yoneyama, J. Fujimoto, Y. Kawamo, and S. Sasabe. 1983. The audio spotlight: An application of nonlinear interaction of sound waves to a new type of loudspeaker design. The Journal of the Acoustical Society of America 73, 5, 1532-1536. [6]K. Aoki, T. Kamakura, and Y. Kumamoto. 1991. Parametric loudspeaker - Characteristics of acoustic field and suitable modulation of carrier ultrasound, Electronics and Communications in Japan 74, 9, 76-82. [7]F.J. Pompei. 1999. The use of airborne ultrasonics for generating audible sound beams, Journal of the Audio Engineering Society 47, 9, 726-731.
  • 21. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Beam Forming WaveFront = Plane Wave = Sound Beam ex. LASER Coherent Plane Wave [5]M. Yoneyama, J. Fujimoto, Y. Kawamo, and S. Sasabe. 1983. The audio spotlight: An application of nonlinear interaction of sound waves to a new type of loudspeaker design. The Journal of the Acoustical Society of America 73, 5, 1532-1536. [6]K. Aoki, T. Kamakura, and Y. Kumamoto. 1991. Parametric loudspeaker - Characteristics of acoustic field and suitable modulation of carrier ultrasound, Electronics and Communications in Japan 74, 9, 76-82. [7]F.J. Pompei. 1999. The use of airborne ultrasonics for generating audible sound beams, Journal of the Audio Engineering Society 47, 9, 726-731.
  • 22. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Ultrasonic Self-demodulation generates audible sound temporal change of ultrasonic (primary) waves the radiation of audible sound (secondary) waves where c [m/s] is the speed of sound in air, β is the nonlinear parameter, and ρ [kg/m3] is the mass density of air Audible Ultrasonic →In the beam you can hear the audible sound
  • 23. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Ultrasonic Self-demodulation generates audible sound temporal change of ultrasonic (primary) waves the radiation of audible sound (secondary) waves where c [m/s] is the speed of sound in air, β is the nonlinear parameter, and ρ [kg/m3] is the mass density of air Audible Ultrasonic →In the beam you can hear the audible sound
  • 24. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Beam Forming to the point audio [10]T. Matsui, D. Ikefuji, M. Nakayama, and T. Nishiura. 2014. Multiple audio spots design based on separating emission of carrier and sideband waves. In Proceedings of International Congress and Exposition on Noise Control Engineering, 6313-6317.
  • 25. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Beam Forming to the point audio [10]T. Matsui, D. Ikefuji, M. Nakayama, and T. Nishiura. 2014. Multiple audio spots design based on separating emission of carrier and sideband waves. In Proceedings of International Congress and Exposition on Noise Control Engineering, 6313-6317.
  • 26. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Beam Forming to the point audio Audible Area [10]T. Matsui, D. Ikefuji, M. Nakayama, and T. Nishiura. 2014. Multiple audio spots design based on separating emission of carrier and sideband waves. In Proceedings of International Congress and Exposition on Noise Control Engineering, 6313-6317.
  • 27. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Steering Beam [12]C. Shi, Y. Kajikawa, and W.-S. Gan. 2014. An overview of directivity control methods of the parametric array loudspeaker. APSIPA Transactions on Signal and Information Processing 3, e20. θ [rad]: When the spacing between the transducers is d [m] in the case of a 1D transducer array, the phase delay of the i-th transducer, ∆φi [rad] where k [rad/m] is the wavenumber of the ultrasound.
  • 28. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Steering Beam [12]C. Shi, Y. Kajikawa, and W.-S. Gan. 2014. An overview of directivity control methods of the parametric array loudspeaker. APSIPA Transactions on Signal and Information Processing 3, e20. θ [rad]: When the spacing between the transducers is d [m] in the case of a 1D transducer array, the phase delay of the i-th transducer, ∆φi [rad] where k [rad/m] is the wavenumber of the ultrasound.
  • 29. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Steering Beam WaveFront = Plane wave = Beam [12]C. Shi, Y. Kajikawa, and W.-S. Gan. 2014. An overview of directivity control methods of the parametric array loudspeaker. APSIPA Transactions on Signal and Information Processing 3, e20. θ [rad]: When the spacing between the transducers is d [m] in the case of a 1D transducer array, the phase delay of the i-th transducer, ∆φi [rad] where k [rad/m] is the wavenumber of the ultrasound.
  • 30. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Steering Beam WaveFront = Plane wave = Beam [12]C. Shi, Y. Kajikawa, and W.-S. Gan. 2014. An overview of directivity control methods of the parametric array loudspeaker. APSIPA Transactions on Signal and Information Processing 3, e20. θ [rad]: When the spacing between the transducers is d [m] in the case of a 1D transducer array, the phase delay of the i-th transducer, ∆φi [rad] where k [rad/m] is the wavenumber of the ultrasound.
  • 31. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Sound Focus
  • 32. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Sound Focus
  • 33. WaveFront = Spherical Wave Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Sound Focus
  • 34. WaveFront = Spherical Wave Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Sound Focus
  • 35. WaveFront = Spherical Wave Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Sound Focus Focal Point
  • 36. WaveFront = Spherical Wave Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Sound Focus Focal Point Objective Lens Plasma ex. LASER Coherent Spherical Wave Focal Point Hoshi et al, 2008
  • 37.
  • 38. PTH: Audible-sound radiation threshold, self-demodulation effect becomes obvious when Pu is effectively high and its square value is not negligible. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Make it narrow area: Threshold of self-demodulation temporal change of ultrasonic (primary) waves the radiation of audible sound (secondary) waves where c [m/s] is the speed of sound in air, β is the nonlinear parameter, and ρ [kg/m3] is the mass density of air Audible Area Pu > PTH
  • 39. *notice: recording mic is more sensitive than human auditory & reflection of mic itself recorded Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Recorded Sound
  • 40. *notice: recording mic is more sensitive than human auditory & reflection of mic itself recorded Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Recorded Sound
  • 41. Implementation “Designing Holographic Loudspeaker” Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
  • 42. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Electrical Circuit Design
  • 43. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Phase Modulation
  • 44. Evaluation “How to design the Acoustic Environment” Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
  • 45. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Audio Distribution targetnoise by interference Ex, Ultrasonic Super-directional Speaker
  • 46. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Audio Distribution targetnoise by interference Ex, Ultrasonic Super-directional Speaker Minimum Focal Area: 20mm x 20mm Focal Area: 1600mm x 1600mm
  • 47. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Simulated Results of the Shape of Sound Source The size of speaker decides fundamental limitation of beam forming.
  • 48. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. User Study1 Direction and Location for x-y plane is understandable for users. x y Z
  • 49. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. User Study2 User can distinguish these three points (Z axis) x y Z
  • 50. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. User Study3 Precise audible height perception is not easy for users (for Z axis) x y Z
  • 51. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Results and User Study2&3 Make Larger Difference (Z). or Change the x-y Direction x y Z
  • 52. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Sound Quality *notice: recording mic is more sensitive than human auditory & reflection of mic itself recorded
  • 53. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Sound Quality *notice: recording mic is more sensitive than human auditory & reflection of mic itself recorded
  • 54. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Sound Quality conventional conventional This studyoriginalwave shape FFT spectrums
  • 55. Application “I can hear Holographic Whisper” Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
  • 56. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Application for Interaction Interactive Sound Distribution Features for Novel Applications Narrow and Broad Trace and Focus Haptic and Push
  • 57. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Place the sound spot, more precise and interactive
  • 58. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Application for Interaction (Focusing inner music instruments)
  • 59. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Application for Interaction (Whispered Voxels)
  • 60. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Place the sound spot for pick up target
  • 61. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Super Narrow Distribution for spotting captions
  • 62. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Super Narrow Distribution (active design of sound field)
  • 63. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Super Narrow and Wide Distribution Switchable
  • 64. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Super Narrow and Wide Distribution Switchable training and instruction
  • 65. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. 3D manipulation of Object with Audible Annotations
  • 66. Audible Information can be recognized separately. Audible Information can not be delivered separately. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. This technique will expand audio recognitions
  • 67.
  • 68. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Possible Scenario Super Narrow Distribution Make Sound Difference navigation play shopping
  • 69. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Super Narrow Distribution (combine with large monitor) User A User B User C Individual Audio Interaction for voice control
  • 70. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Super Narrow Distribution (Multi-language conference)
  • 71. Discussion and Conclusion “Summery of Holographic Whisper” Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.
  • 72. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Discussions Ultrasound exposure Multiple Sound Points by CGH It cannot say no effect. Lower than conventional ones (because this methods generate radiation point Lower intensity than haptic device Available by generating multiple focus by multiple modulation. but it limited spatiotemporal resolution. Lower intensity(eg.haptic) Direct Exposure is not necessary Available Advantage Advantage
  • 73. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Discussions Amplitude of Audio Signals Grating Lobes Audible Ultrasonic Amplitude of Audio signal decides the characteristics of sound focus, it is typical trade off of this methods. it generates grating lobes around the focus (40 degree). This is typical limitation of this methods. It affects both amplitude and audio distribution It generated around the focal point limitation and tradeoff limitation and tradeoff
  • 74. Discussions The size of speaker decides fundamental limitation of beam forming. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Discussions
  • 75. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Overview Designing narrow audio distribution for individual communication Our Study Conventional
  • 76. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Conclusion Production of aerial sound point sources with an ultrasonic phased array for three-dimensional (3D) audio interaction includes: Principles Theory Simulated Result Implementation User Study Evaluation Application Discussion
  • 77. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. We envision the post-pixel world Release data from material existence and regenerate Material Properties by using our of range of our sensory organs. P i x e l s P i x i e s 2D to 2.5D 3 D
  • 78. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Team Dr. Yoichi Ochiai Assistant Prof, Advisor to President Head of Digital Nature Group, University of Tsukuba CEO and coFounder of Pixie Dust Technologies, inc. Dr. Takayuki Hoshi Assistant Prof, University of Tokyo co Founder of Pixie Dust Technologies, inc. Ippei Suzuki Undergrad Student, Digital Nature Group, University of Tsukuba U n i v e r s i t y o f Ts u k u b a , Yo i c h i O c h i a i L a b r a t o r y
  • 79. Holographic Whisper: Rendering audible sound spots in three-dimensional space by focusing ultrasonic waves Yoichi Ochiai*13, Takayuki Hoshi*23, Ippei Suzuki*1 *1 University of Tsukuba, Digital Nature Group *2 University of Tokyo, *3 Pixie Dust Technologies, inc. *joint first authorship, Contact: wizard@slis.tsukuba.ac.jp Assistant Professor at University of Tsukuba, Head of Digital Nature Group CEO of Pixie Dust Technologies, inc
  • 80. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. FAQ Oh what amazing! Can I buy? Yes, you can buy soon ( this year) We provide this technique for B to B for now. Is it safe??? Our auditory is sensible and it quite lower intensity than Ultrasonic Haptic Applications call or mail Oh, complex!! Just Use Headphones! Easy! Nice idea, it can suppress others voice to concentrate.
  • 81. What is the next Challenge towards Post Multimedia? (Post Pixels interaction) Visual: HD(1080p) in Space 60Hz in Time Audio: 22.1kHz in Time U n i v e r s i t y o f Ts u k u b a , Yo i c h i O c h i a i L a b r a t o r y Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Go out of the range
  • 82. What is the next Challenge towards Post Multimedia? (Post Pixels interaction) Visual: HD(1080p) in Space 60Hz in Time Audio: 22.1kHz in Time Multimedia systems are restricted from limitation and imitation of the spec of human sensory organs U n i v e r s i t y o f Ts u k u b a , Yo i c h i O c h i a i L a b r a t o r y Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Go out of the range
  • 83. What is the next Challenge towards Post Multimedia? (Post Pixels interaction) Visual: HD(1080p) in Space 60Hz in Time Audio: 22.1kHz in Time Multimedia systems are restricted from limitation and imitation of the spec of human sensory organs 1.High Intensity 2.High Resolution 3.True Holography U n i v e r s i t y o f Ts u k u b a , Yo i c h i O c h i a i L a b r a t o r y Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc.Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. Go out of the range
  • 84.
  • 85. U n i v e r s i t y o f Ts u k u b a , Yo i c h i O c h i a i L a b r a t o r y
  • 86. “Focused Ultrasound and Lasers by Field Generators” U n i v e r s i t y o f Ts u k u b a , Yo i c h i O c h i a i L a b r a t o r y Spatial light modulator (SLM) CGH Laser Lens Focal Points Acoustic Optic Modulation on Reflection Time delay generation Acoustic Pressure and Standing Waves Laser Induced Plasma
  • 87.
  • 88.
  • 89. Copyright Yoichi Ochiai, University of Tsukuba, Digital Nature Group, Pixie Dust Technologies, inc. We envision the post-pixel world Release data from material existence and regenerate Material Properties by using out of range frequencies of our sensory organs. P i x e l s P i x i e s 2D to 2.5D Physical Device 3 D C o m p u t a t i o n a l W a v e D e s i g n M a g i c a l E x p e r i e n c e w i t h N o C o n t a c t D e v i c e T o w a r d s