Trumpets and orange-coloured days — Inferences, associations and synaesthesia in filmic text
TRUMPETS AND ORANGE-COLOURED DAYSInferences, associations and synaesthesia in filmic textJanina WildfeuerFaculty of Linguistics and Literary SciencesBremen University, Germany
2Starting point• how is meaning constructed crossmodally?• how do we interpret/infer the intersemiotic interplay ofthe modalities?
3Starting point„Cinema can give us much more than Rimbaudiancorrespondences […], it can create a veritable intersensoryreciprocity.“Chion 1994: 134„In der Bewältigung der polyphonie informationelle – wieBarthes dieses Zusammenspiel sehr anschaulich genannt hat –bringt der Zuschauer sich selbst ins Spiel, sein Gefühldafür, wie die verschiedenartigen Reizezusammenhängen, die über Auge und Ohr in ihn einziehen.“Flückiger 2001: 137
4Intersensory perception – synchretism – synaesthesia„The perception of films, like natural perception, is bothsynesthetic and synoptic […].“Plantinga 2009: 141„Alternatively, one might argue that all cinema issynaesthetic, because in lived experience the senses have away of skirting the hierarchies and divisions we use todefine and explain them.“Barker 2008: 236f.
6Analysing Filmic Textuality:Segmented Film Discourse Representation StructuresTHEORIE DES FILMVERSTEHENSLOGIC OF FILM DISCOURSE INTERPRETATION1. level of identification and arrangement of themeaning-making entities2. level of coherence and structure1. logic2. logicconstructing logical forms of discourserelating the logical forms via discourse relationsWildfeuer 2013
9"Dear Mrs. Wells, we recently recovered a mailbag that was lost in a plane crash on October12th 1969 on Mont Blanc. We are forwarding the enclosed letter to your address. Pleaseaccept our apologies for the uncustomary delay. Jacques Grosjean, Customer Services.”Constructing logical forms of discourse
11Relating the logical forms via discourserelations
12Relating the logical forms via discourse relations
13Relating the logical forms via discourse relations"Darling Mado, Im in exile. I cant sleep, cant eat. I think of you endlessly. I know Ive madethe biggest mistake of my life. I turned down that womans money. If all goes well, Ill soonbe able to afford a house. I dream of better times ahead when youll forgive me and join mehere one orange-coloured day. Your ever-loving Adrien.
14Relating the logical forms via discourse relations
15Relating the logicalforms via discourserelations
16Synaesthesia and audiovisual perceptionexperiencing sensorydata=synaesthesiasensory interpretationattributing semanticcontentcognitive interpretationsemantic networking!
17Synaesthesia and audiovisual perception„Object recognition and identification are goal directedtasks in which perceptual systems parse sensory inputs intosalient cues, group these cues together into perceptualobjects, and assign them to categories.“Seeley 2012: 501f.„The results of this study suggests that sound affectsprocessing at the level of the „visual“ cortex.“Shams et al. 2004: 30
18Where to go from here…?constructing logical forms of discourserelating the logical forms via discourse relationsneuroscientific research ?filmic (sensory)datanarrative patternssymbolicmeanings, etc.