Takuya Yamauchi is a freelance programmer and software engineer who works on information visualization and sonification projects. As digital devices and the Internet have advanced, huge amounts of data are now generated. Visualization and sonification techniques can represent this data in abstract and concrete ways. For example, annual passenger numbers on two train lines in Japan from 1995 to 2015 were visualized using graphs and charts. A responsive sound installation was also created where recorded environmental sounds would play from mobile devices and change based on audience movements, analyzed by the system, creating an immersive ambient sound experience.

1. Information Visualization and
Sonification for Smart City
Takuya Yamauchi

2. Self-introduction
• Takuya Yamauchi (Dr)
• Self employed (Freelance Programmer)
• Software Engineering ( Software Architecture )
• Server side programming ( ERP System, User
interface, Recommendation system, Social
Networking Games etc.. PHP,Java, Data Mining)
• Front ERP system Javascript
• Computer Simulation for Satelite System
(Numerical calculation C language)
• Signal Processing (Sound, Audio Watermark)
• Statistical Calculation MATLAB
書籍 “音とコンピューター“https://nextpublishing.jp/book/8130.html

3. The Internet of Things
https://www.i-scoop.eu/internet-of-things-guide/

4. An Explosion of Connected Possibility
https://www.i-scoop.eu/internet-of-things-guide/

5. The current situation in our life
• Development of personal computers, software,
and hardware
• Spread of the Internet
• Miniaturized digital devices

6. Development of personal computers, software,
and hardware
• Electrical devices enable the
recording of huge amounts of
data to generate and
synthesize novel sounds by
algorithms in real time.

7. Spread of the Internet
• The Internet has grown
since 1960.
Computers enable users to
obtain data from distant
locations in real time.
Tree of routing paths through
a portion of the Internet as visualized
by the Opte Project
Ref Wikipedia

8. Miniaturized digital devices
• Computers have continued to
be improved, for example, in
terms of weight and
processing speed.

9. Thus…
• We can easily obtain a high spec computer,
smart phone, and so on.
• We can communicate with many people by
the Internet.
• We can share information with each other, for
example, through social networks.

10. Technology
• The Web, PDAs,
smart phones and
so on.
Internet and
computer

11. How ?
• A mass of data information from devices is
extracted by IoT .
• How should the data be used or represented
by visual information or sound?
Visual Representation => Visualization
Auditory Display => Sonification

12. Visualization
• Visualization through visual imagery is any
technique to design or represent information.
• We can represent abstract ideas in concrete
ideas through visualization such as graph or
tree.

13. Sonification
• Sonification is the use of nonspeech audio to
convey information. ※1
• The Geiger counter is an instrument used for
measuring ionizing radiation. Intensity of the
radiation is notified by noise sound.
※1 Sonification Report
http://www.icad.org/websiteV2.0/References/nsf.html

14. Data Visualization and Sonification
Abstract and Concrete

15. Visualization
• The Seishin-Yamate Line and the Kaigan Line
• Annual passenger number

16. 1995 (Annual passenger number)

17. 2015 (Annual passenger number)

18. Annual passenger number (The Seishin-Yamate Line)

19. Annual passenger number (The Kaigan Line )

20. Annual passenger number (The Seishin-Yamate Line)

21. Annual passenger number (The Kaigan Line )

22. Sonification
Annual passenger number (The Seishin-Yamate Line)

23. Responsive Environments
• At this time, we demonstrate a sound installation referred to as "Responsive
Environments”. We have been thinking about the relationship between sound and
embedded electric devices, and can easily apply the technology of electric devices
and networks for design or art work. We designed a spatial and responsive
environment that uses sound and image processing. Environmental sounds that
had been recorded near a highway, in an open square and in a temple were
assigned to eight mobile devices playing in an indoor space.

24. Responsive Environments 2
• Urban and suburban sounds from the mobile devices were repeated to generate a
tempo, then mixed by granular synthesis and gradually changed in real time. The
audience's movements were recorded using cameras, analyzed by the system, and
used to generate signal tones. Thus, environmental noise from urban spaces and
sinusoidal tones were mixed in the indoor space to produce ambient sound that
could be listened to in a responsive environment.
• https://vimeo.com/105726784
• http://www.yinteraction-design.com/event2