2. WHAT ARE MULTIMODAL TEXTS?
A text may be defined as multimodal
when it combines two or more semiotic
systems. There are five semiotic systems in
total:
1. Linguistic: comprising aspects such
as vocabulary, generic structure, and the
grammar of oral and written language.
2. Visual: comprising aspects such as
color, vectors and viewpoint in still and
3. 3. Audio: comprising aspects such as
volume, pitch and rhythm of music and
sound effects.
4. Gestural: comprising aspects such
as movement, speed and stillness in
facial expression and body language.
5. Spatial: comprising aspects such as
proximity, direction, position of layout
and organisation of objects in space.
4. MULTIMODAL TEXTS CAN BE
DELIVERED VIA DIFFERENT MEDIA OR
TECHNOLOGIES. THEY MAY BE PAPER,
DIGITAL OR LIVE.
1. Paper multimodal texts include
picture books, textbooks, graphic
novels, comics, and posters, where
meaning is conveyed to the reader
through varying combinations of
visual (still image or not moving)
written language, and spatial modes.
5. 2. Digital multimodal texts, such as
film, animation, slide shows, e-
posters, digital stories, and web
pages, convey meaning through
combinations of written and spoken
language, visual (still and moving
image), audio, gestural and special
modes.
6. 3. Live multimodal texts, for
example, dance, performance,
and oral storytelling, convey
meaning through combinations
of modes such as gestural,
spatial, spoken language, and
audio.
