Communication in MULTIMODAL mode purposive communication
1. Communication in
Multimodal Mode
• Objectives:
• Define what is Multimodal text
• Recognize the five modes of making a multimodal text
• Evaluate a multimodal text
• Appreciate the impact of communication through
multimodal texts in the society and the world.
2. Multimodal Text
• It uses a combination of two or more communication
modes.
• It combines two or more semiotic systems.
• It can be delivered via different media or technologies.
They may be live, paper, or digital electronic (Anstey
& Bull, 2006).
3. Semiotics
It is the study of signs, and
symbols, in particular, as
they communicate things
spoken and unspoken.
Examples: emojis (a Japanese word that
translates in English as “e” for picture and “moji”
for character), emoticons (digital icons thar
convey human expression)
4. Five major
modes in
semiotic
systems
1. Linguistic paradigm - Vocabulary,
structure, grammar of oral/written
language, word choice, delivery of
spoken or written text (tone),
organization into sentences, phrases
and paragraphs
2. Visual – Color, vectors, and viewpoint in
still and moving images, layout, style,
size, perspective.
3. Auditory – Volume, pitch, and rhythm of
music and sound effects.
5. Five
Communicatio
n Modes
4. Gestural – Movement, facial
expression, and body language,
hand gestures, interactions between
people.
5. Spatial - Proximity, direction,
position of layout, organization of
objects in space arrangement
6. Multimodal Texts
• Include picture books, text books, graphic novels,
comics and posters.
• Dance, performance, and oral storytelling, convey
meaning through combinations of various modes
such as gestural, spatial, audio, and oral language.
Multimodal texts include media advocacy campaigns, short films, and documentaries,
infomercials, infographics, and even ballet or interpretive dance.
7. • Identifying the links among the modes aids the reader in the
interpretation of meaning.
• It is via this interplay of modes that social and cultural value is
generated. (Leeuwen et al., 1999).
• People of different culture or races perceive their world through
their language, and interpret their reality through the culture
contained in the language.
