1. Nina
Valkanova
SEMINAR:
LLENGUATGES
AUDIOVISUALS
I
NARRATIVA
INTERACTIVA
Llenguatges
Audiovisuals
i
Narra2va
Interac2va
‘2010

2. ABOUT
ME
• Some
projects
hJp://90.146.8.18/en/personen_page.asp?iPersonID=8948
hJp://specs.upf.edu/media/1564
hJp://thinktank.upf.edu/ambientnews/
hJp://vimeo.com/10689317
• Contact:
nina.valkanova@upf.edu
Llenguatges
Audiovisuals
i
Narra2va
Interac2va
‘2010

3. ROADMAP
Simple
Impor2ng
Crea2ng
a
Sensors
Final
Project
User
Communica2on
Libraries
GUI
Camera
Prototype
Interac2on
Sound
TwiJer
Arduino
Seminar
1
Seminar
2
Seminar
3
Llenguatges
Audiovisuals
i
Narra2va
Interac2va
‘2010

4. CAPTURING
SIMPLE
USER
INTERACTION
• The
mouseX
and
mouseY
Variables
• The
mousePressed()
Method
• The
mouseReleased()
and
mouseDragged()
Methods
• The
keyPressed
and
key
Variables
Llenguatges
Audiovisuals
i
Narra2va
Interac2va
‘2010

5. EXERCISE
• Make
your
processing
video
player
react
to
the
mouse:
– Set
the
playback
speed
depending
on
the
velocity
of
the
mouse
movement
using
speed()
– Make
your
movie
play
also
in
reverse
depending
on
the
mouse
direc2on
Llenguatges
Audiovisuals
i
Narra2va
Interac2va
‘2010

6. IMPORTING
LIBRARIES
• Most
processing
libraries
are
contained
within
.jar
files
• Libraries
for
– 3D
rendering
– Bluetooth
communica2on
– Gesture
recogni2on;
Wii
• Available
at
www.processing.org/reference/
libraries/index.html
Llenguatges
Audiovisuals
i
Narra2va
Interac2va
‘2010

7. COMMON
LIBRARIES
• Minim
–
based
on
JavaSound
API
to
provide
an
easy-­‐to-­‐use
audio
library
• The
Obsessive
Camera
Direc2on
(OCD)
-­‐
control
and
crea2on
of
Processing
3D
camera
views
• surfaceLib
-­‐
create
different
3D
surfaces
• Physics
-­‐
par2cle
system
physics
engine
• AI
Libraries
–
AI
programming
• bluetoothDesktop
-­‐
send
and
receive
data
via
Bluetooth
wireless
networks
• proMidi
-­‐
send
and
receive
MIDI
informa2on
• oscP5
-­‐
communica2on
among
computers,
sound
synthesizers,
and
other
mul2media
devices
• controlP5
-­‐
graphical
user
interface
library
Llenguatges
Audiovisuals
i
Narra2va
Interac2va
‘2010

8. EXERCISE
• Download
the
ControlP5
library
hJp://
www.sojamo.de/libraries/controlP5/
• Unzip
the
library
and
copy
the
”controlP5"
folder
into
the
"libraries"
sub-­‐folder
of
your
Processing
Sketchbook
• Modify
your
movie
player
(play,stop,pause)
using
the
ControlP5
buJon
• Use
the
ControlP5
slider
to
set
the
speed
of
the
playback
Llenguatges
Audiovisuals
i
Narra2va
Interac2va
‘2010

9. THE
REAL
EXERCISE

• Design
and
implement
a
nice
VJ
tool
with
which
you
can
control
the
reproduc2on
of
the
playlist
of
videos
you
have
grabbed
with
Marco
– Sketch
a
graphical
grid
for
the
video
output
(placeholders)
– Sketch
the
layout
of
your
controls
and
make
sure
you
have
a
good
balance
between
a
good
design
and
usability
– AJen2on:
make
sure
your
VJ
tool
has
all
the
features
you
have
implemented
in
the
previous
exercises
– Bonus
*:
integrate
an
image
processing
effect
(i.e.
blur
–its
one
of
the
processing
examples)
which
can
be
interac2vely
selected
and
modified
from
your
VJ
tool
(we
will
con2nue
with
the
image
processing
topic
next
2me)
Llenguatges
Audiovisuals
i
Narra2va
Interac2va
‘2010

10. HOMEWORK
• Why
do
we
need
communica2on
over
networks?
– Send
and
receive
data
over
the
internet
– Read
wireless
signals
– Communicate
between
applica2ons
• Warm
up:
use
your
VJ
tool
for
the
remote
control
of
a
visual
output
(your
video
sequence
for
example):
– You
need
two
applica2ons:
one
which
sends
the
control
signal
and
another
which
receives
it
and
behaves
accordingly
(plays
a
video,
draws
sth.
etc)
– Hint:
As
a
beginning
have
a
look
at
the
SharedCanvasServer
and
SharedCanvasClient
examples.
Which
one
is
the
server
in
our
case?
– A:en;on:
Make
sure
you
use
2
different
physical
machines,
not
a
localhost
communica2on!
– As
always:
hand-­‐in
a
document
describing
the
purpose
of
the
exercise
and
the
more
important
decisions
taken.
Llenguatges
Audiovisuals
i
Narra2va
Interac2va
‘2010