SlideShare a Scribd company logo
1 of 8
Download to read offline
Crossmodal correspondences:                             Traditional Approach
              Looking for links between
                  sound symbolism &
            synaesthesia & their application
                 to sensory marketing

                Charles Spence
            Crossmodal Research Lab.
            Department of Psychology
               Oxford University




„…there is no animal in which there is
known to be a complete segregation of
sensory processing‟ (Stein et al., 1996)




Holt-Hansen          Carlsberg‟s Elephant beer has
                      a frequency of 640-670 Hz
  (1968)             while, for regular Carlsberg, it
                             is 510-520 Hz




                                                                               1
Cross-cultural colour-flavour associations
                                                               Cheese &              Salt &



                     Levitan, Shankar,
                     & Spence (2010)
                                                                onion                vinegar




Cranberry     Cherry                     Mint   Raspberry
            Strawberry




                                                             Piqueras-Fiszman & Spence (submitted)




                                                            Sapir (1929) the success of the Mini?
                                                             Mil, Mal, &




      “Buba”
“Buba”        “Kiki”
 “Kiki”“Kiki” “Buba”                                         Not to mention Lidl, Aldi, & Londis!




                                                                                                     2
“Maluma”
                                         “Takete”                                                                     “Maluma”
       “Takete”?



                                     Maluma
                                  300
                                      Lula
                                  200

                                  100

                                    0

                                  -100




                                                                                                                                             Lime jam
                                                                                                                      Blueb jam
                                                              Salt+Vin.
                                          Brie


                                                  Mint choc




                                                                                                                                                                      mousse

                                                                                                                                                                               Cranb
                                                                                                            Reg Cr.




                                                                                                                                   Reg yog




                                                                                                                                                                               sauce
                                                                                                  Cheddar
                                                                                       Reg choc




                                                                                                                                                        Cranberries
                                                                          Strawb yog




                                                                                                                                                                       Choc
                                                                 Cr.




                                  -200

                                  -300

                                  -400

                                         Takete
“Maluma”       “Takete”                   Ruki
                                                                                                                                  Gallace, Boschin,
                                                                                                                                  & Spence (2011)




   What‟s in a name?                             Tasting shapes

  „Frisch‟ or „Frosch‟                                                                                                                       Richard
                                                                                                                                             Cytowic




                 Klink (2000)       Circle the shape above that best matches the
                 Spence (subm.)       flavour of the food/drink you just tried.




                                                                                                                                                                                       3
Still water
                                  -3.74 1.85

                                        Sparkling water
                                                                                    Spence & Gallace (2011)




                                                               3.51 1.94
                                                    Brie
                 Maluma                                                    Takete
                                    -3.02 2.22

                                      Cranberry juice
                 Maluma                                                    Takete
                                                           2.45 2.26


                                                 Malteser
                           Tuki            -1.54 3.49
                                                                           Lula

                           Tuki        Caramel Nibble
                                                                           Lula
                                                             2.69 2.73
“Sensation transference”




                                                                                                              ?
                                                                                                                  4
Ben & Jerry‟s Ice Cream

                              99%
                            pleasure.
                           The rest is
                           the carton!



    Ngo, Misra, & Spence (2011)

                                                                          Sumptuously
                                                                          smooth truffle
                                                                           encased in
                                                                          milk chocolate




Schifferstein (2001)   Yeomans et al. (2008)     Sound/shape symbolism
                                               • Reliable crossmodal correspondences
                                                 between flavour & oral-somatosensory
                                                 attributes of food/drink (bitterness, acidity,
  Figure showing                                 & carbonation), & sharpness/angularity
  disconfirmed
  expectations                                 • Might these correspondences emerge from
                                                 our innate oral responses to basic tastes?
                                               • Findings have implications for product &
                                                 brand naming/packaging design (sensory
                                                 marketing), just don‟t call em synaesthetic!




                                                                                                  5
Crossmodal Correspondences?
                                                                                                                              “Taking a sip of wine, at least a wine
                                                                                                                               worth talking about, is like hearing
                                                                                                                                the sound of a sustained, musical
                                                                                                                                chord.” (Kent Bach, 2007, p. 27)
                                                                                                                                “Red wines need either minor
                                                                                                                               key or they need music that has
                                                                                                                                 negative emotion. They don’t
                                                                                                                                 like happy music…Cabernets
                                                                                                                               like angry music.” (Gray, 2007)




                       “As bitter as a trombone?”                                                                                  Methods: Choice of sounds

             • 13 different notes (C2-C6)




                                              Middle C


             • 4 different types of instrument: piano, strings,
               woodwinds, brass




     13
            Note that tastes appear at extremes, while flavours appear in middle
                           low                      middle                                         high
     11

                                             Crisinel & Spence
                                                   (2010)
       9
Frequency




       7




       5




       3




       1
            caffeine   coffee   MSG   salt     orange    rose   almond   vanilla   lemon   peppermint citric acid   sucrose
                                                flower




                                                                                                                                                                       6
Ngo, Piqueras-Fiszman,
R U WEIRD?                     & Spence (submitted)
      Western,
      Educated,
      Industrialized,
      Rich, &
      Democratic

(Henrich et al., 2010, BBS)




                                                       7
Are lemons
Prof. Charles Spence
Crossmodal Research Lab.
                                   fast or slow?
   Oxford University

 http://www.psy.ox.ac.uk/xmodal/




                                                   8

More Related Content

More from Marco Ajovalasit

Future of looking back - Prof. Richard Banks at HCDI seminar 2 October 2012
Future of looking back - Prof. Richard Banks at HCDI seminar 2 October 2012Future of looking back - Prof. Richard Banks at HCDI seminar 2 October 2012
Future of looking back - Prof. Richard Banks at HCDI seminar 2 October 2012Marco Ajovalasit
 
Packaging Design and Communication Accessibility - Erik Ciravegna at HCDI se...
Packaging Design and Communication Accessibility - Erik Ciravegna  at HCDI se...Packaging Design and Communication Accessibility - Erik Ciravegna  at HCDI se...
Packaging Design and Communication Accessibility - Erik Ciravegna at HCDI se...Marco Ajovalasit
 
Design_and_competitive_advantage - Claudio Dell'Era at HCDI seminar 30 April ...
Design_and_competitive_advantage - Claudio Dell'Era at HCDI seminar 30 April ...Design_and_competitive_advantage - Claudio Dell'Era at HCDI seminar 30 April ...
Design_and_competitive_advantage - Claudio Dell'Era at HCDI seminar 30 April ...Marco Ajovalasit
 
Exploring the ethics of human centred design - Marc Steen at HCDI seminar 27...
Exploring the ethics of human centred design - Marc Steen at HCDI seminar  27...Exploring the ethics of human centred design - Marc Steen at HCDI seminar  27...
Exploring the ethics of human centred design - Marc Steen at HCDI seminar 27...Marco Ajovalasit
 
Tablet seat - Peter Vink at HCDI seminar 18 april 2012
Tablet seat - Peter Vink at HCDI seminar 18 april 2012Tablet seat - Peter Vink at HCDI seminar 18 april 2012
Tablet seat - Peter Vink at HCDI seminar 18 april 2012Marco Ajovalasit
 
Design4 services HCDI Seminar Sangiorgi
Design4 services HCDI Seminar SangiorgiDesign4 services HCDI Seminar Sangiorgi
Design4 services HCDI Seminar SangiorgiMarco Ajovalasit
 
Human Centred Design HCDI seminar Giacomin
Human Centred Design HCDI seminar Giacomin Human Centred Design HCDI seminar Giacomin
Human Centred Design HCDI seminar Giacomin Marco Ajovalasit
 
HCDI seminar: Patrick Jordan - DESIGN FOR A BETTER LIFE - What Should We Do?
HCDI seminar: Patrick Jordan - DESIGN FOR A BETTER LIFE - What Should We Do?HCDI seminar: Patrick Jordan - DESIGN FOR A BETTER LIFE - What Should We Do?
HCDI seminar: Patrick Jordan - DESIGN FOR A BETTER LIFE - What Should We Do?Marco Ajovalasit
 
HCDI Seminar: Fashion and technology evolution and the design of consumer pro...
HCDI Seminar: Fashion and technology evolution and the design of consumer pro...HCDI Seminar: Fashion and technology evolution and the design of consumer pro...
HCDI Seminar: Fashion and technology evolution and the design of consumer pro...Marco Ajovalasit
 
HCDI seminar Dan Lockton June 2011
HCDI seminar Dan Lockton  June 2011HCDI seminar Dan Lockton  June 2011
HCDI seminar Dan Lockton June 2011Marco Ajovalasit
 
Theoretically guided HMI development for a driver assistance system
Theoretically guided HMI development for a driver assistance systemTheoretically guided HMI development for a driver assistance system
Theoretically guided HMI development for a driver assistance systemMarco Ajovalasit
 
Understanding touch screen mobile phone users by Taxonomy of Experience (ToE)
Understanding touch screen mobile phone users by Taxonomy of Experience (ToE)Understanding touch screen mobile phone users by Taxonomy of Experience (ToE)
Understanding touch screen mobile phone users by Taxonomy of Experience (ToE)Marco Ajovalasit
 
Exploring human constructions of existential meaning in interactions with d...
Exploring human constructions of existential meaning  in interactions with  d...Exploring human constructions of existential meaning  in interactions with  d...
Exploring human constructions of existential meaning in interactions with d...Marco Ajovalasit
 
Human-centred HCDI Seminar: Approach in Scientific Research
Human-centred HCDI Seminar: Approach in Scientific ResearchHuman-centred HCDI Seminar: Approach in Scientific Research
Human-centred HCDI Seminar: Approach in Scientific ResearchMarco Ajovalasit
 
HCDI Motivation by Fergus Bisset
HCDI Motivation by Fergus BissetHCDI Motivation by Fergus Bisset
HCDI Motivation by Fergus BissetMarco Ajovalasit
 
Human-Motorcycle Interaction (HMI): Research issues in motorcycle ergonomics ...
Human-Motorcycle Interaction (HMI): Research issues in motorcycle ergonomics ...Human-Motorcycle Interaction (HMI): Research issues in motorcycle ergonomics ...
Human-Motorcycle Interaction (HMI): Research issues in motorcycle ergonomics ...Marco Ajovalasit
 
“The ethics of transport planning” - Prof Stephen Potter talks at the HCDI se...
“The ethics of transport planning” - Prof Stephen Potter talks at the HCDI se...“The ethics of transport planning” - Prof Stephen Potter talks at the HCDI se...
“The ethics of transport planning” - Prof Stephen Potter talks at the HCDI se...Marco Ajovalasit
 

More from Marco Ajovalasit (17)

Future of looking back - Prof. Richard Banks at HCDI seminar 2 October 2012
Future of looking back - Prof. Richard Banks at HCDI seminar 2 October 2012Future of looking back - Prof. Richard Banks at HCDI seminar 2 October 2012
Future of looking back - Prof. Richard Banks at HCDI seminar 2 October 2012
 
Packaging Design and Communication Accessibility - Erik Ciravegna at HCDI se...
Packaging Design and Communication Accessibility - Erik Ciravegna  at HCDI se...Packaging Design and Communication Accessibility - Erik Ciravegna  at HCDI se...
Packaging Design and Communication Accessibility - Erik Ciravegna at HCDI se...
 
Design_and_competitive_advantage - Claudio Dell'Era at HCDI seminar 30 April ...
Design_and_competitive_advantage - Claudio Dell'Era at HCDI seminar 30 April ...Design_and_competitive_advantage - Claudio Dell'Era at HCDI seminar 30 April ...
Design_and_competitive_advantage - Claudio Dell'Era at HCDI seminar 30 April ...
 
Exploring the ethics of human centred design - Marc Steen at HCDI seminar 27...
Exploring the ethics of human centred design - Marc Steen at HCDI seminar  27...Exploring the ethics of human centred design - Marc Steen at HCDI seminar  27...
Exploring the ethics of human centred design - Marc Steen at HCDI seminar 27...
 
Tablet seat - Peter Vink at HCDI seminar 18 april 2012
Tablet seat - Peter Vink at HCDI seminar 18 april 2012Tablet seat - Peter Vink at HCDI seminar 18 april 2012
Tablet seat - Peter Vink at HCDI seminar 18 april 2012
 
Design4 services HCDI Seminar Sangiorgi
Design4 services HCDI Seminar SangiorgiDesign4 services HCDI Seminar Sangiorgi
Design4 services HCDI Seminar Sangiorgi
 
Human Centred Design HCDI seminar Giacomin
Human Centred Design HCDI seminar Giacomin Human Centred Design HCDI seminar Giacomin
Human Centred Design HCDI seminar Giacomin
 
HCDI seminar: Patrick Jordan - DESIGN FOR A BETTER LIFE - What Should We Do?
HCDI seminar: Patrick Jordan - DESIGN FOR A BETTER LIFE - What Should We Do?HCDI seminar: Patrick Jordan - DESIGN FOR A BETTER LIFE - What Should We Do?
HCDI seminar: Patrick Jordan - DESIGN FOR A BETTER LIFE - What Should We Do?
 
HCDI Seminar: Fashion and technology evolution and the design of consumer pro...
HCDI Seminar: Fashion and technology evolution and the design of consumer pro...HCDI Seminar: Fashion and technology evolution and the design of consumer pro...
HCDI Seminar: Fashion and technology evolution and the design of consumer pro...
 
HCDI seminar Dan Lockton June 2011
HCDI seminar Dan Lockton  June 2011HCDI seminar Dan Lockton  June 2011
HCDI seminar Dan Lockton June 2011
 
Theoretically guided HMI development for a driver assistance system
Theoretically guided HMI development for a driver assistance systemTheoretically guided HMI development for a driver assistance system
Theoretically guided HMI development for a driver assistance system
 
Understanding touch screen mobile phone users by Taxonomy of Experience (ToE)
Understanding touch screen mobile phone users by Taxonomy of Experience (ToE)Understanding touch screen mobile phone users by Taxonomy of Experience (ToE)
Understanding touch screen mobile phone users by Taxonomy of Experience (ToE)
 
Exploring human constructions of existential meaning in interactions with d...
Exploring human constructions of existential meaning  in interactions with  d...Exploring human constructions of existential meaning  in interactions with  d...
Exploring human constructions of existential meaning in interactions with d...
 
Human-centred HCDI Seminar: Approach in Scientific Research
Human-centred HCDI Seminar: Approach in Scientific ResearchHuman-centred HCDI Seminar: Approach in Scientific Research
Human-centred HCDI Seminar: Approach in Scientific Research
 
HCDI Motivation by Fergus Bisset
HCDI Motivation by Fergus BissetHCDI Motivation by Fergus Bisset
HCDI Motivation by Fergus Bisset
 
Human-Motorcycle Interaction (HMI): Research issues in motorcycle ergonomics ...
Human-Motorcycle Interaction (HMI): Research issues in motorcycle ergonomics ...Human-Motorcycle Interaction (HMI): Research issues in motorcycle ergonomics ...
Human-Motorcycle Interaction (HMI): Research issues in motorcycle ergonomics ...
 
“The ethics of transport planning” - Prof Stephen Potter talks at the HCDI se...
“The ethics of transport planning” - Prof Stephen Potter talks at the HCDI se...“The ethics of transport planning” - Prof Stephen Potter talks at the HCDI se...
“The ethics of transport planning” - Prof Stephen Potter talks at the HCDI se...
 

Crossmodal correspondences: Looking for links between sound symbolism & synaesthesia & their application to sensory marketing

  • 1. Crossmodal correspondences: Traditional Approach Looking for links between sound symbolism & synaesthesia & their application to sensory marketing Charles Spence Crossmodal Research Lab. Department of Psychology Oxford University „…there is no animal in which there is known to be a complete segregation of sensory processing‟ (Stein et al., 1996) Holt-Hansen Carlsberg‟s Elephant beer has a frequency of 640-670 Hz (1968) while, for regular Carlsberg, it is 510-520 Hz 1
  • 2. Cross-cultural colour-flavour associations Cheese & Salt & Levitan, Shankar, & Spence (2010) onion vinegar Cranberry Cherry Mint Raspberry Strawberry Piqueras-Fiszman & Spence (submitted) Sapir (1929) the success of the Mini? Mil, Mal, & “Buba” “Buba” “Kiki” “Kiki”“Kiki” “Buba” Not to mention Lidl, Aldi, & Londis! 2
  • 3. “Maluma” “Takete” “Maluma” “Takete”? Maluma 300 Lula 200 100 0 -100 Lime jam Blueb jam Salt+Vin. Brie Mint choc mousse Cranb Reg Cr. Reg yog sauce Cheddar Reg choc Cranberries Strawb yog Choc Cr. -200 -300 -400 Takete “Maluma” “Takete” Ruki Gallace, Boschin, & Spence (2011) What‟s in a name? Tasting shapes „Frisch‟ or „Frosch‟ Richard Cytowic Klink (2000) Circle the shape above that best matches the Spence (subm.) flavour of the food/drink you just tried. 3
  • 4. Still water -3.74 1.85 Sparkling water Spence & Gallace (2011) 3.51 1.94 Brie Maluma Takete -3.02 2.22 Cranberry juice Maluma Takete 2.45 2.26 Malteser Tuki -1.54 3.49 Lula Tuki Caramel Nibble Lula 2.69 2.73 “Sensation transference” ? 4
  • 5. Ben & Jerry‟s Ice Cream 99% pleasure. The rest is the carton! Ngo, Misra, & Spence (2011) Sumptuously smooth truffle encased in milk chocolate Schifferstein (2001) Yeomans et al. (2008) Sound/shape symbolism • Reliable crossmodal correspondences between flavour & oral-somatosensory attributes of food/drink (bitterness, acidity, Figure showing & carbonation), & sharpness/angularity disconfirmed expectations • Might these correspondences emerge from our innate oral responses to basic tastes? • Findings have implications for product & brand naming/packaging design (sensory marketing), just don‟t call em synaesthetic! 5
  • 6. Crossmodal Correspondences? “Taking a sip of wine, at least a wine worth talking about, is like hearing the sound of a sustained, musical chord.” (Kent Bach, 2007, p. 27) “Red wines need either minor key or they need music that has negative emotion. They don’t like happy music…Cabernets like angry music.” (Gray, 2007) “As bitter as a trombone?” Methods: Choice of sounds • 13 different notes (C2-C6) Middle C • 4 different types of instrument: piano, strings, woodwinds, brass 13 Note that tastes appear at extremes, while flavours appear in middle low middle high 11 Crisinel & Spence (2010) 9 Frequency 7 5 3 1 caffeine coffee MSG salt orange rose almond vanilla lemon peppermint citric acid sucrose flower 6
  • 7. Ngo, Piqueras-Fiszman, R U WEIRD? & Spence (submitted) Western, Educated, Industrialized, Rich, & Democratic (Henrich et al., 2010, BBS) 7
  • 8. Are lemons Prof. Charles Spence Crossmodal Research Lab. fast or slow? Oxford University http://www.psy.ox.ac.uk/xmodal/ 8