April 2014
Multimodality in
Oral Discourse
Professor Reinildes Dias
FALE - UFMG
Rethinking literacy education in new
times: multimodality, multiliteracies, &
new literacies.
3
Gadgets
http://tinyurl.com/wesley-fryer
Adaptado de FRYER, W. (2006)
Just for fun!
A merge of linguistics with social semiotics
(Kress, 2003)
Emphasis not on language alone (the
verbal code) but on a combination of
different semiotic codes.
Features of present Applied
Linguistics studies
Semiotic codes
or modes
Linguistic - oral and written
language: use of vocabulary
& grammar
Visual - still & moving
images, colors.
Auditory – music & sound
effects: use of volume, pitch
& rhythm.
Gestural – facial
expressions
& body language.
Spatial – layout &
organization of objects &
space.
Handwriting on paper is becoming less common.
The concept of writing includes sending:
(1) text messages (e-mails – texting)
(2) speaking messages (www.voki.com)
(3) video messages (www.mailvu.com)
http://www.save-money-
with-alternative-
energy.com/lets-all-go-
green.html
The concept of literacy:
Not only about words on paper and oral speech.
Also includes digital technology, sound, music,
words, still and moving images.
From literacy to multiliteracy
From monomodal to multimodal texts
Multimodality
Influenced by digital
technologies and how they have
transformed our
communicational landscape.
“The world told is a
different world from
the world shown.”
Kress, 2003
Multimodal texts
Express meaning through
different semiotic modes.
Invite multiple interpretations.
 communication occurs through different but
synchronous modes: language, print, images,
graphics, movement, gesture, texture, music,
sound.
Theory of Multimodality
(Multi)Literacy
involves students’ capacity to function
appropriately in a (multi) literate
environment.
This (multi)literate environment
includes reading, writing, viewing. It
also includes the creation of
multimodal texts.
Reception:
LISTENING
Production:
SPEAKING
Create movies in English with
WINDOWS MOVIE MAKER Video production
http://iteslj.org/links/ESL/Listening/Podcasts/
http://www.eslpod.com/website/index_new.html
Reception:
LISTENING to podcasts
Production:
Creating podcasts
Less downloads, more uploads!
Let’s encourage our student to
learn online.
Digital learning: Going beyond
the walls of English classrooms.
Web tools that can
be used in your
classes. PodCast
http://www.learnenglishfeelgood.com/eslvideo/index.html
www.prezi.com
www.voki.com
www.wall.com
21
HIGH UP is an example of a set of textbooks for Ensino Médio that deals with issues of
multimodality and literacies.
Approved by PNLD (Programa Nacional do Livro Didático, Brazil Ministry of Education,
2015). It can be adopted for high-school students by ENGLISH TEACHERS all over
Brazil.
Publisher: Macmillan do Brazil.
Thank you very much
reinildes@gmail.com
Also at: www.reinildes.com.br
Also on the Portal for the English
Teacher, created by me, at:
http://tinyurl.com/reinildesdias

Multimodality