Module in master course. Tangible Interaction. Interaction Design

1. sensorial and
musical interaction
Birgitta Cappelen, AHO, 2. November 2012

2. Overview
Sensorial and musical interaction
the context – the RHYME-project
the design challenge
the assignments
Group presentations
Exhibition 16.30 – 19.00

3. the context

4. module in master course
Tangible Interaction
Interaction Design

5. 3 RHYME courses
2010 e-textile (with KhiO-textile)
2011 Musical interaction and e-textile (KhiO)
2012 Sensorial and musical interaction

6. the
RHYME
project
(2010-2015)

7. VERDIKT – The future of Internet

11. RHYME
co-creation through
tangible interaction
and music

12. co-creation with tangible,
spatial, cross-media
by communicative, musical and
narrative principles
to improve health and well-being
for people with severe disabilities

13. RHYME
project background

15. music effects
health and wellbeing

16. family musiking in Vinings 16

17. multisensory room- Snoezelen

18. a white Snoezelen Room

19. the Internet of Things
Ubiquitous Computing

21. multidisiplinary:
tangible interaction
universal design
music therapy
interactive Art

22. RHYME
project goal

23. improve health through

24. playing in ORFI 24

25. reduction of
isolation and passivity

26. family playing in Wave Carpet

27. evoke positive feelings
increase ability to master
develop and strengthen
social relations

28. RHYME
development so far

29. 2 new generations of
interactive musicking “things”
(tangibles)
5 new hardware platforms
to sketch up new concepts

30. iDevice, jDevice, kDevice (bluetooth)
(iPhone/iPod,
RHYME mobile breakout card, sensors,LEDs)
RHYME wireless
(Android, Google I/O ADK)
RHYME wired
(Arduino Mega, Shield, MiniMac)

31. iPod Touch inside Wave Orange

32. tactile textile touch sensors

33. Current music technology 33

34. Wave Carpet’s bubble field

35. Reflect’s ligt field

36. playing in Wave Carpet people with dementia remember with music

37. details of light and sound fiels in Wave Orange

38. the design challenge

39. the design challenge
motivate musicking for diverse users
sensorial embodied interaction
cross-media possibilities
e-textile and soft interaction
mobile technology
resource orientation
empowering
design for diversity

40. Musicking
40

41. musicking
from Music as a work of art (object)
to Music as a meaning making and relation building
equal activity (verb)
play, listen, sing, dance, hum, move, rug, shake,
stroke, sleep, clapping, running, step...
It is about expressing ones identity in and with music
and music related activities in everyday situations
41

42. friends playing in ORFI 42

43. cross-media explorations

44. build cross-media consistent expectations over time

45. offer many ways of self-expression and cross-media interaction

46. Cross-media possibilities in Wave Carpet

47. so far...
limited smart textile
available possibilities

48. Current smart textile possibilities
(X-labs, Worbin, Diffus)

49. too slow
too fragile and
unsatisfactory surface qualities

50. current smart textile possibilities, Philips, Diffus

51. transparency and tactility

52. Girl interacting with Wave Carpets bubble field

53. Anima ligt bubbles

54. Resource and Empowerment
orientation
Focus on the persons strengths and abilities, not their
special needs, weaknesses and diagnosis
offer:
positive experiences, no wrongs or failing
ways to vitality and self-expression
ability to act and build competence (mastering)
ways to strengthen mutual social relations
diverse ways to share and participate
54

55. Boy musicking in ORFI 55

56. Accessibility
Design for Diversity

57. the assignments

58. 4 Weeks
1. Sensorial Interaction . Create 4 input sensors each.
Focus on Shape, Structure, Material, Surface, Interaction, Accessibility.
2. Create 3 Concepts for Sensorial and Musicking Tangibles.
Focus on motivation, musicking and co-creation over long time.
Use iPod Touch, kDevice, mobile battery, Speaker,
3. 4. Designing and build one concept .
Focus on making it work, interaction, sensorial stimulation and
musicking.

59. Group presentation
Stump Drum - Valeria, Martin, Sven-Håkon
Rolling Rock - Amra, Anders
Cove - Berit, Lucien
Chilli Net - Ron, Mariko
Ebbe - Sara, Bai Daniel
Whispering willow - Hans Jakob, Rosita

60. www.RHYME.no