SlideShare a Scribd company logo
Children's Literaturein Education, Vol. 29, No. 2, 1998
Lawrence R. Sipe is an
assistant professor in
thereading/writing/
literacy program at the
University of
Pennsylvania's Graduate
School of education,
where he teaches
courses in literaturefor
children and
adolescents. After
working for nineteen
years in schools and
school systemsin both
the United Statesand
Canada, he completed a
Ph.D. in children's
literature, emergent
literacy, and literary
criticism at the Ohio
State University. His
research focuses on
children's responses to
literature, the
development of literary
understanding, and the
ways in whichliterature
both reinscribes and
challengesexisting
sociocultural practices.
Lawrence R. Sipe
How Picture Books Work: A
Semiotically Framed Theory of
Text-Picture Relationships
In this article, I provide an overview of the various ways in which the
relationship between the words and pictures in a picture book has
been conceptualized; I draw on several theoretical traditions and dis-
ciplines to describe this relationship. Although theorists have ad-
vanced many different conceptualizations of the text-picture relation-
ship, they have not adequately explained what goes on in our heads
as we relate words and pictures. Therefore, in order to describe more
precisely what happens internally as we relate verbal and visual signs,
I present a theory of text-picture relations that is based on the semio-
tic concept of "transmediation." By way of making the theory more
clear, it is applied to the text-picture relationship in one double-page
spread of Where the Wild Things Are.
J. Cech, "Remembering
Caldecott: 'The Three
Jovial Huntsmen' and
the art of the
picturebook," p. 118
P.Pullman, "Invisible
pictures," p. 167
Conceptualizing the Text-Picture Relationship
According to many writers, the essence of the picture book is the
way the text and the illustrations relate to each other; this relationship
between the two kinds of text—the verbal and the visual texts—is
complicated and subtle. A variety of metaphors have been used to
describe it. In several cases, the metaphor is drawn from music. Cech
writes of the "duet" between text and pictures. Pullman utilizes the
term "counterpoint," while Ward and Fox refer to the "contra-
punctual" relationship. Ahlberg talks about the "antiphonal" effect of
words and pictures. On the other hand, using scientific metaphor in
writing about illustration, Miller uses the idea of "interference" from
wave theory, describing how two different wave patterns may com-
97
0045-6713/98/0600-097$15.00/0 © 1998 Human Sciences Press, Inc.
98 Children's Literature in Education
J. Ward and M. Fox, "A
look at some
outstanding illustrated
books for children," p.
21
A. Ahlberg in E. Moss,
"A certain particularity:
An interview with Janet
and Allan Ahlberg," p.
21
J. H. Miller, Illustration,
p. 95
W. Moebius,
"Introduction to
picturebook codes," p.
143
D. Lewis, "Going along
with Mr. Gumpy:
Polysystemy and play in
the modern picture
book," p. 105
P Nodelman, Words
About Pictures: The
Narrative Art of
Children's
Picturebooks, p. 223
P. Nodelman, Words
About Pictures: The
Narrative Art of
Children's
Picturebooks, p. 221
J. Schwarcz, Ways of
the Illustrator: Visual
Communication in
Children's Literature, p.
15
J. Golden, The
Narrative Symbol in
Children's Literature
P. Nodelman, Words
About Pictures: The
Narrative Art of
Children's
Picturebooks, p. 220
bine to form a complex new pattern. Moebius utilizes geological im-
agery to speak of the "plate tectonics" of text and illustrations.
Various alternative words and concepts seem to be pivotal in other
theorists' description of the text-picture relationship. Lewis uses the
idea of "polysystemy": "the piecing together of text out of different
kinds of signifying systems." Perry Nodelman describes how the text
and pictures "limit" each other, and uses literary terminology to de-
scribe the relationship of text and pictures as one of "irony": The
words and pictures comment ironically on each other, as it were.
Nodelman also discusses Barthes's metaphor of "relaying," writing
that, "Bylimiting each other, words and pictures take on a meaning
that neither possesses without the other—perform the completion of
each other that Barthes calls 'relaying.'" Schwarcz conceives of two
general categories of relationshipsbetween text and pictures: what he
calls "congruency" and "deviation." In the category of congruency,
the text and pictures are in a harmonious relationship. Sometimes the
illustrations complement the text by "running ahead of the text and
pushing the action forward." The text and the illustrations may also
take turns in telling the story; this is what Schwarcz calls "alternate
progress." In deviation, Schwarcz's second category of relationships,
the illustrations "veer away" from the text by opposing it in some
way. Another example of deviation is what Schwarcz calls "counter-
point"—the musical metaphor, again—when the illustrations tell a
different story from the text. Part of the enjoyment of this story lies in
the reader-viewer's perception of both stories at once.
Golden describes five types of relationships between text and pic-
tures: The categories seem to be differentiated by how much "work"
the illustrations or the text do in conveying meaning. One limitation
of this scheme is that, since it depends mainly on the relative amounts
of power the text and the illustrations have, there is less attention to
the dynamic way in which, as Nodelman puts it, "the words change
the pictures and the pictures change the words." The text-picture re-
lationship is not so much a matter of a balance of power as it is the
way in which the text and pictures transact with each other, and
transform each other.
The Synergy of Words and Pictures
My own descriptive term is "synergy," defined by the Shorter Oxford
English Dictionary as "the production of two or more agents, sub-
stances, etc., of a combined effect greater than the sum of their sepa-
rate effects." In a picture book, both the text and the illustration
sequence would be incomplete without the other. They have a syner-
gistic relationship in which the total effect depends not only on the
How Picture Books Work 99
W: Iser, The Act of
Reading: A Theory of
Aesthetic Response
P. Nodelman, Words
About Pictures: The
Narrative Art of
Children's Picturebooks
G. E. Lessing, Laocoon:
An Essay on the Limits
of Painting and Poetry
union of the text and illustrations but also on the perceived interac-
tions or transactions between these two parts.
In adding to what these theorists have written about the relationship
of words and pictures in picture books, I will focus on the phenome-
nological dynamics of the synergistic relationship itself. In other
words, I want to try to explain more fully what happens in our
heads: the process we engage in when we relate the verbal and visual
texts of the picture book to each other. In order to do this, I will draw
from literary theories of the type commonly referred to as "reader
response" criticism (Wolfgang Iser), aesthetic criticism (G. E. Lessing
and Wendy Steiner), linguistics and semiotics (Roman Jakobsen and
Charles Peirce), and theories of literacy (Marjorie Siegel, Mark Sa-
doski, and Alan Paivio).
What Wolfgang Iser sees as he examines the reader-text relationship is
a reader participating in the production of textual meaning. The ac-
tual literary work is realized through a convergence of reader and
text. For Iser, the reader acts as co-creator of the work by supplying
that portion of it that is not written but only implied. Each reader fills
in the unwritten work or the "gaps" in his or her own way, thereby
acknowledging the inexhaustibility of the text. Iser's concept of gap-
filling suggests that we can think of readers filling in some of the gaps
in the verbal text of a picture book with information from the illustra-
tions and of readers using information from the verbal text to fill in
some of the gaps in the illustrations.
Nodelman observes that words have a greater potential for conveying
temporal information, whereas pictures have a greater potential for
conveying spatial information. Does this mean that we might process
verbal and visual information in different ways? There is a long tradi-
tion for this idea, beginning with the classic distinction, made by the
German Romantic philosopher G. E. Lessing, between arts that are
based on simultaneity of perception (painting, sculpture) and arts
that are based on time sequence or successivity of perception (music,
literature). Lessing argued that, since our experience of the world has
two components or modes (space and time), all of the arts could be
classified on the basis of which of these two modes were experienced
while the viewer or listener was engaged in a work of art. We see a
painting all at once; but in order to experience literature or music, we
have to read or listen in a linear succession of moments through time.
This raises the question of whether there could be arts that are based
on both time and space—onsimultaneity as well as successivity. Even
in Lessing's time, the opera was an example of such an art form; and
it was because opera combined spatial arts and temporal arts that
Wagner called his operas Gesamtkunstwerke ("assembled" or "put-to-
100 Children's Literature in Education
W. Steiner, The Colors
of Rhetoric, p. 144
gether" works of art). Drama and film are also examples of art forms
that we experience simultaneously in time and space. The picture
book, of course, is another of these hybrid art forms. WendySteiner, a
literary and aesthetic theorist, argues that "the illustrated text is a
Gesamtkunstwerk, a mixture of artistic media epitomized in Wag-
nerian opera," and, like opera, is a "gesture toward semiotic replete-
ness, combining several kinds of sign types and having them com-
ment on each other."
W. Steiner, Pictures of
Romance
R. Jakobsen, "On the
relation between visual
and auditory signs," p.
340
W. Steiner, The Colors
of Rhetoric, p. 37
Wendy Steiner follows Lessing's basic distinction by observing that
the visual arts present us with a diffuse network, whereas temporal
art leads us along a line or chain. The linguist and semiotician Roman
Jakobsen makes a similar point: "Every complex visual sign, for exam-
ple every painting, presents a simultaneity of various components,
whereas the time sequence appears to be the fundamental axis of
speech." Jakobsen goes on to say that speech is not purely temporally
linear, but that the "predominantly sequential character of speech is
beyond doubt, and this primacy of successivity must be analyzed."
Written language is not purely linear, either; when we read, we are
processing ever-greater sequences of letters, words, and sentences as
meaningful wholes, until, finally, we may arrive at an understanding of
the total structure of a poem or story. Nevertheless, to paraphrase
Jakobsen, the predominantly sequential character of written language
is beyond doubt.
Just as written language is not purely linear, painting and the visual
arts are not purely spatial, either. When we look at a painting (or an
illustration in a picture book), we look in a series of temporal mo-
ments at various parts of it. But, as Steiner comments, visual art is
designed "to enlarge our ability to turn sequence into simultaneity, to
allow us to form ever larger temporal flows into unified, atemporal
structures." So, it's not the case that our perception of the image is
static. We do look at the image in a series of temporal moments, but
as we look our minds are forming "ever larger temporal flows into
unified atemporal structures"; thus, to paraphrase Jakobsen once
again, the predominantly simultaneous character of visual art is be-
yond doubt.
The different ways in which we experience written language and vi-
sual art have important implications for the ways in which we try to
relate the words and the pictures in a picture book. Because of the
primarily spatial nature of the pictures and our drive to form "unified
atemporal structures," our tendency is to gaze on, dwell upon, or
contemplate them. In contrast, the primarily temporal nature of the
verbal narrative creates in us a tendency to keep on reading, to keep
How Picture Books Work 101
C. S. Lewis, On Stories
and Other Essays on
Literature, p. 17
J. Doonan, Looking at
Pictures in
Picturebooks
P. Pullman, "Invisible
pictures," p. 171
J. L.Lemke,
"Multiplying meaning:
Literacy in a multimedia
world"
M. Meek, "What counts
as evidence in theories
of children's literature,"
p. 174
J. J. Gibson, The Senses
Considered as
Perceptual Systems, p.
285
I. Massey, "Words and
images: Harmony and
dissonance," p. 388
M. Sadoski and A.
Paivio, "A dual coding
view of imagery and
verbal process in
reading
comprehension."
C. Suhor, "Towards a
semiotic-based
curriculum," p. 250
going ahead in what C. S. Lewis termed "narrative lust." There is thus
a tension between our impulse to gaze at the pictures—to forget
about time in creating an "atemporal structure"—andto not interrupt
the temporal narrative flow. The verbal text drives us to read on in a
linear way, where the illustrations seduce us into stopping to look.
This tension results in the impulse to be recursive and reflexive in our
reading of a picture book: to go backward and forward in order to
relate an illustration to the one before or after it, and to relate the text
on one page to an illustration on a previous or successive page; or to
understand new ways in which the combination of the text and pic-
ture on one page relate to preceding or succeeding pages. Picture
books have the effect of "loosening the tyranny of the one-way flow"
of the purely verbal text. Therefore, picture books seem to demand
rereading; we can never quite perceive all the possible meanings of
the text, or all the possible meanings of the pictures, or all the possi-
ble meanings of the text-picture relationships. Lemke observes that, in
illustrated informationaltexts and hypertext, there are "many possible
pathways through the textworld"; this is equally true of the picture
book. Margaret Meek argues that, "Apicture book invites all kinds of
reading and allows the invention of a set of stories rather than a single
story."
The reader/viewer's construction of the relationship of text and pic-
tures is one of the "affordances" of picture books. But how does this
construction proceed? It is an intriguing idea that the interrelation-
ship of words and pictures mirrors the thought process itself. Irving
Massey's assertion that, "Thinking consists of a constant alternation
between image-makingand word-making" is given support in reading
theory by the "dual coding" hypothesis of Mark Sadoski and Alan
Paivio, which suggests that cognition has two separate (though re-
lated) structures: one for processing verbal information (either in
speech or written language) and one for processing nonverbal infor-
mation (such as visual stimuli). Aswe alternate our attention between
words and pictures in a picture book, then, we may be representing
the verbal and nonverbal information in separate cognitive structures;
following this, through the complex referential connections between
these two cognitive structures, we construct an integrated meaning.
A Theory of Transmediation
There is another theory from the field of literacy that may also prove
helpful in understanding how we construct the conversation between
words and pictures. Charles Suhor uses the concept of "transmedia-
tion" or "the translation of content from one sign system into an-
other." This concept of transmediation may be heuristic for under-
102 Children's Literature in Education
M. Siegel, "More than
words: The generative
power of
transmediation for
learning"
C. Peirce, "Logic as
semiotic: The theory of
signs"
standing the process we use in relating words to pictures in picture
books. For in picture books, we must oscillate, as it were, from the
sign system of the verbal text to the sign system of the illustrations;
and also in the opposite direction from the illustration sign system to
the verbal sign system. Whenever we move across sign systems, "new
meanings are produced," because we interpret the text in terms of
the pictures and the pictures in terms of the texts in a potentially
never-ending sequence. Siegel draws from semiotic theory (and partic-
ularly the work of Charles Peirce) to explain the way in which we
move across sign systems. For Peirce, a process of using signs consists
of three parts: the sign itself, or representamen; the equivalent sign
(called the interpretant) in the receiver of the sign; and the object for
which the sign stands. The relationship among these three parts is
usually represented visually by a triangle, called a semiotic triad:
M. Siegel, "More than
words: The generative
power of
transmediation for
learning," p. 10
M. Siegel, "More than
words: The generative
power of
transmediation for
learning," p. 12
Thus, the sign or representamen "does not simply stand for an object,
but tells something about the meaning of that relationship and this
requires a third component, which he called an interpretant. The in-
terpretant is another sign that represents the same object as the repre-
sentamen, as its position in the semiotic triad indicates." According to
Siegel, what happens in transmediation, when we move from one sign
system to another, is that "an entire semiotic triad serves as the object
of another triad and the interpretant for this new triad must be repre-
sented in the new sign system." In terms of what happens in picture
books, we have two sign systems, and therefore two sets of triads:
When we interpret the words in terms of the pictures, or move from
the sign system of the words to the sign system of the pictures, the
semiotic triad with the words as representamen becomes the object
of a new triad, and the interpretant for this new triad changes accord-
ingly:
How PictureBooks Work
Conversely, when we interpret the pictures in terms of the words, or
move from the sign system of the pictures to the sign system of the
words, the semiotic triad with the pictures as representamen be-
comes the object of a new triad, and the interpretant for this new
triad changes as well:
The resulting process is a type of oscillation, as we adjust our inter-
pretation of the pictures in terms of the words, and our interpretation
of the-words in terms of the pictures. And, because the meanings of
the signs are always shifting (due to their adjustment and readjust-
ment as each triad becomes the object in a new triad), this oscillation
is never-ending. The possibilities of meaning in the word-picture rela-
tionship are inexhaustible.
Words and Pictures in Where the Wild Things Are
To concretize all these abstractions and to elucidate the theory more
completely, I will analyze a few of the possible semiotic triads in the
text and pictures of the ninth opening of Where the Wild Things Are.
The analysis is necessarily distorting and artificial, because it renders
in laborious slow motion a process that in practice happens very
quickly. It does, however, allow us to tease out an explanation of the
steps in our meaning making. The text of this double-page spread
reads,
103
M. Sendak, Where the
Wild Things Are
Children's Literature in Education
And when he came to the place where the wild things are/they roared
their terrible roars and gnashed their terrible teeth/and rolled their ter-
rible eyes and showed their terrible claws.
Let us first consider the text alone, without reference to the illustra-
tion.
As we come to this point in the text, Sendak has carefully built our
anticipation during the eight previous double-page spreads. Before we
even opened the book, the title and the cover incited us to predict
some encounters with "wild things," and the vagueness of that phrase
may have triggered all sorts of speculation about what these "things"
will look like and how they will behave. The growth of the magical
forest, which "grew/and grew—/and grew" has been stretched out
over three openings, an ocean has "tumbled by" with a "private boat,"
and Max has sailed "in and out of weeks and almost over a year." Now
the text tells us that Max has finally "c[o]me to the place." The four
phrases
—roared their terrible roars
—and gnashed their terrible teeth
—and rolled their terrible eyes
—and showed their terrible claws
are representamens of objects for which our overall interpretant, if
put into words, might be "horrific, savage monsters," with razor-sharp
teeth and claws, and wickedly cruel eyes. The representamens (Sen-
dak's words) allow us to construct this overall interpretant through
their communication of sound (roars and gnashing), sight (teeth,
eyes, and claws), and motion (eye-rolling and gesture), as well as our
interpretation of the word "terrible." The fourfold repetition of this
word accentuates the monsters' frightfulness. Our interpretant of
these representamens may also include the inference that Max must
be very frightened.
Now we uncover the illustration and attempt to disregard the text.
The illustration contains many representamens of many objects. What
is our interpretant of some of them? Max and his boat are on the
extreme left, and we would normally look at him first, since our pro-
pensity is to "read" illustrations from left to right. In this case, how-
ever, it is probably the four wild things that first catch our eye. They
are constructed primarily of curves and rounded shapes. Their claws
(which resemble those on Max's outfit), their horns, and even their
teeth are slightly curved. Their bodies are the round shapes of stuffed
animals. One of the wild things wears a child's striped T-shirt and has
a tail like the one on Max's wolf suit. Another has chicken-like legs
and feet. The pads on the other wild things' feet and paws are puffy
104
How Picture Books Work
and soft brown. The colors of their fur and faces are pastel and
muted. The strongest color is the yellow of their eyes, which is only a
bit more intense than the color of the rest of their faces and bodies.
The wild things' hair looks soft and strokable, and they stand on soft
green grass. The two wild things on the right-hand page can only be
described as chubby. Their faces are humanoid (with broad, pudgy
noses) and they stand upright. The wild thing nearest Max is perhaps
the most formidableof the four: It is the most animal-likein its stance,
and its face is more beastlike. It has an open mouth, red and lined
with teeth. It has the longest claws, three horns, and a lion-like mane.
Yet if it is so fierce, why has it allowed the smaller, goat-like wild
thing to sit on its back? Why is its tail dragging on the ground, instead
of quivering upright?If we turn our attention to Max,a glance assures
us that he is not at all cowed by these beasts, even by the one closest
to him. The expression on his face is one of disdain or exasperation,
not fear. His hand is rebelliously on his hip, reminding us of his atti-
tude in the third opening, where he was angry at his mother. The
overall interpretant for this visual image, then, might be "mild men-
ace, but nothing Max can't handle."
Having constructed interpretants for the two semiotic triads, we are
now ready to move between the visual and the verbal sign systems.
According to the theory of transmediation, in the movement from one
sign system to another, "an entire semiotic triad serves as the object
of another triad and the interpretant for this new triad must be repre-
sented in the new sign system." Let us take the picture triad as the
object of the new triad we will build:
In this new triad, the new object to which the text refers is the entire
picture triad we have previously constructed. The text is the repre-
sentamen for this new object (or set of objects). We must therefore
construct a new interpretant of the representamen (the text) since
the representamen is now the referent for a new object. A "think-
aloud" for this process of constructing a new interpretant for the text
in light of the pictures might go something like this:
105
Children's Literature in Education
The text reads, "they roared their terrible roars"; but the mouths of
two of the wild things are tightly closed, and the other two don't have
their mouths open wide enough to make a terribly loud roar. The
wild things are supposed to gnash their terrible teeth and show their
terrible claws; but their teeth, being curved, are not so terrible. Nei-
ther are their claws, and I don't see any teeth being gnashed together.
The wild things' eyes are almost circular, more like the glass orbs of
stuffed toys than the eyes of fierce beasts. So I'll have to modify my
interpretation of the words in the light of the pictures. There's menace
here, especially in the creature closest to Max, but Max doesn't seem
to befrightened out of his wits.
To complete this analysis, let us consider going in the other direction:
constructing a new interpretant for the pictures when the object they
represent is the textual triad:
106
A think-aloud in this case might be as follows:
Max doesn't seem frightened and the wild things (for many reasons)
don't seem all that threatening. But the text says that they roared and
gnashed their teeth and showed their claws. Those claws and teeth
might not be needle-sharp, but they could probably still inflict some
pretty terrible damage. And just because the beasts' mouths are either
closed or only slightly open doesn't mean that they can't open them
wide and let out a terrible roar. I wouldn't want to be caught in a
dark alley with any of them, especially with the one who's closest to
Max; that guy's paws are bigger than Max's whole head, and that
rhinoceros horn looks dangerously sharp. Those horns look like
devil's horns, so maybe they are terrible after all, and maybe Max is
just too dumb to know the trouble he's in.
So this transmediation goes back and forth—oscillates—in a poten-
tially endless process. Each new page opening presents us with a new
set of words and new illustrations to factor into our construction of
meaning. Reviewing and rereading will produce ever-new insights as
we construct new connections and make modifications of our pre-
vious interpretations, in a Piagetian process of assimilation and accom-
modation. In other words, we assimilate new information and in the
process we change our cognitive structures, accommodating them to
the new information.
How Picture Books Work
In this article, I have attempted to use the semiotic theory of trans-
mediation to unfold the text-picture relationship; and I have used
Where the Wild Things Are as an example to explicate the theory. I
have argued that transmediation is a more precise way of looking at
the text-picture relationship because it allows us to analyze the phe-
nomenological process of relating words and pictures. Transmediation
also makes it clear that visual texts are on an equal footing with verbal
texts. It seems necessary, in the logocentric society that we live in
today, to make this point and emphasize the significance of picture
books in children's learning. Picture books, through transmediation,
give children the opportunity to engage in an unending process of
meaning making as every rereading brings about new ways of looking
at words and pictures. In other words, picture books allow children
to have multiple experiences as they engage in creating new mean-
ings and constructing new worlds.
References
Cech, J., "Remembering Caldecott: 'The Three Jovial Huntsmen' and the art of
the picturebook," The Lion and the Unicorn, 1983-84, 7/8, 110-119.
Doonan, J., Looking at Pictures in Picturebooks. Stroud., Glos: The Thimble
Press, 1993.
Gibson, J., The Senses Considered as Perceptual Systems. Boston: Houghton
Mifflin, 1966.
Golden, J., The Narrative Symbol in Children's Literature. New York:
Mouton de Gruyter, 1990.
Iser, W.,A Theory of Aesthetic Response. Baltimore, MD:Johns Hopkins Uni-
versity Press.
Jakobsen, R., "On the relation between visual and auditory signs," Selected
Writings II: Word and Language. The Hague: Mouton, 1971.
Lemke, J. L., "Multiplying meaning: Literacy in a multimedia world," National
Reading Conference, Charleston, SC, December 1993.
Lessing, G. E., Laocoon:An Essay on the Limits of Painting and Poetry, E.A.
McCormick, trans. Baltimore, MD: Johns Hopkins University Press.
Lewis, C. S., On Stories: And Other Essays on Literature, New York: Harcourt
Brace Jovanovich, 1982.
Lewis, D., "Going along with Mr.Gumpy: Polysystemy and play in the modern
picture book," Signal, 1996, 80, 105-119.
Massey I., "Words and images: Harmony and dissonance," Georgia Review,
1980, 34, 375-395.
Meek, M., "What counts as evidence in theories of children's literature," in
Children's Literature: The Development of Criticism, P. Hunt, ed. New
York: Routledge, 1992.
Miller, J. H., Illustration. Cambridge, MA:Harvard University Press, 1992.
Moebius, W, "Introduction to picturebook codes," Word & Image, 1986, 2
(2), 141-158.
Moss, E., "Acertain particularity: An interview with Janet and Allen Ahlberg,"
Signal, 1990, 61.
107
Children's Literature in Education
Nodelman, P., Words About Pictures: The Narrative Art of Children's Picture
Books. Athens: University of Georgia Press, 1988.
Peirce, C. S., "Logic as semiotic: The theory of signs," in Philosophical Writ-
ings of Pierce,J. Buchler, ed., pp. 98-119. New York: Dover Press.
Pullman, P., "Invisible pictures," Signal, 1989, 60, 160-186.
Sadoski, M., and Paivio, A., "A dual coding view of imagery and verbal process
in reading comprehension," in Theoretical Models and Processes of Read-
ing, 4th ed., R. Ruddell, M. Ruddell, and H. Singer, eds. Newark, DE: Inter-
national Reading Association, 1994.
Steiner, W., The Colors of Rhetoric. Chicago: The University of Chicago Press,
1982.
Steiner, W., Pictures of Romance. Chicago: The University of Chicago Press,
1988.
Schwarcz, J., Ways of the Illustrator. Visual Communication in Children's
Literature. Chicago: American Library Association, 1982.
Siegel, M., "More than words: The generative power of transmediation for
learning," Canadian Journal of Education, 1995, 20(4), 455-475.
Suhor, C., "Towards a semiotics-based curriculum," Journal of Curriculum
Studies, 1984, 16, 247-257.
Ward, J., and Fox, M., "A look at some outstanding illustrated books for chil-
dren," Children's Literature Association Quarterly, 1984, 9 (1), 19-21.
108

More Related Content

What's hot

What is the relationship between the mind and body and does it have a big imp...
What is the relationship between the mind and body and does it have a big imp...What is the relationship between the mind and body and does it have a big imp...
What is the relationship between the mind and body and does it have a big imp...Sonia Naqvi
 
A case study of the novel siddhartha from the perspective of intertextuality
A case study of the novel siddhartha from the perspective of intertextualityA case study of the novel siddhartha from the perspective of intertextuality
A case study of the novel siddhartha from the perspective of intertextuality
Alexander Decker
 
The Art of Fiction Writing
The Art of Fiction WritingThe Art of Fiction Writing
The Art of Fiction Writing
Scribendi.com
 
art&culture assigment
art&culture assigmentart&culture assigment
art&culture assigment
suzain ali
 
Sem 2 ppt 3
Sem 2 ppt 3Sem 2 ppt 3
Sem 2 ppt 3
AvniDave1
 
comparative poem study
comparative poem studycomparative poem study
comparative poem study
fery seftiawan
 
Cw poetry spring12
Cw poetry spring12Cw poetry spring12
Cw poetry spring12hmfowler
 

What's hot (9)

What is the relationship between the mind and body and does it have a big imp...
What is the relationship between the mind and body and does it have a big imp...What is the relationship between the mind and body and does it have a big imp...
What is the relationship between the mind and body and does it have a big imp...
 
A case study of the novel siddhartha from the perspective of intertextuality
A case study of the novel siddhartha from the perspective of intertextualityA case study of the novel siddhartha from the perspective of intertextuality
A case study of the novel siddhartha from the perspective of intertextuality
 
The Art of Fiction Writing
The Art of Fiction WritingThe Art of Fiction Writing
The Art of Fiction Writing
 
14
1414
14
 
The Death of the Author
The Death of the AuthorThe Death of the Author
The Death of the Author
 
art&culture assigment
art&culture assigmentart&culture assigment
art&culture assigment
 
Sem 2 ppt 3
Sem 2 ppt 3Sem 2 ppt 3
Sem 2 ppt 3
 
comparative poem study
comparative poem studycomparative poem study
comparative poem study
 
Cw poetry spring12
Cw poetry spring12Cw poetry spring12
Cw poetry spring12
 

Viewers also liked

FINAL FINAL EVALUATION
FINAL FINAL EVALUATIONFINAL FINAL EVALUATION
FINAL FINAL EVALUATIONchurchillmedia
 
Close Reading Images Sample Discussion
Close Reading Images Sample DiscussionClose Reading Images Sample Discussion
Close Reading Images Sample Discussion
Ian Sherman
 
Finalised allocated speaking parts
Finalised allocated speaking partsFinalised allocated speaking parts
Finalised allocated speaking partschurchillmedia
 
Norwegian Winter
Norwegian WinterNorwegian Winter
Norwegian Winter
Elmira College
 
Reading Images
Reading ImagesReading Images
Reading Images
Elmira College
 
The leveson inquiry full investigation
The leveson inquiry full investigationThe leveson inquiry full investigation
The leveson inquiry full investigationchurchillmedia
 
Image Reading
Image Reading Image Reading
Image Reading
IanWilliams92
 
Principles of design
Principles of designPrinciples of design
Principles of design
Mau Palm
 
06 images - reading images
06   images - reading images06   images - reading images
06 images - reading imagesaszar
 
visual analysis
visual analysisvisual analysis
Visual analysis for composition
Visual analysis for compositionVisual analysis for composition
Visual analysis for composition
lmharaway
 
imágenes para analizar
imágenes para analizarimágenes para analizar
imágenes para analizar
Gabriela Mistral
 
Visual Literacy and Advertising Techniques Glossary of Terms
Visual Literacy and Advertising Techniques Glossary of TermsVisual Literacy and Advertising Techniques Glossary of Terms
Visual Literacy and Advertising Techniques Glossary of Terms
Rachel Witheridge
 
Theories of Composition
Theories of CompositionTheories of Composition
Theories of Compositionmrsbauerart
 
PRINCIPLES OF COMPOSITION
PRINCIPLES OF COMPOSITIONPRINCIPLES OF COMPOSITION
PRINCIPLES OF COMPOSITIONswetha karlmarx
 

Viewers also liked (20)

Lp10 genre2
Lp10 genre2Lp10 genre2
Lp10 genre2
 
FINAL FINAL EVALUATION
FINAL FINAL EVALUATIONFINAL FINAL EVALUATION
FINAL FINAL EVALUATION
 
Close Reading Images Sample Discussion
Close Reading Images Sample DiscussionClose Reading Images Sample Discussion
Close Reading Images Sample Discussion
 
Finalised allocated speaking parts
Finalised allocated speaking partsFinalised allocated speaking parts
Finalised allocated speaking parts
 
Norwegian Winter
Norwegian WinterNorwegian Winter
Norwegian Winter
 
Lp11 analysing images
Lp11 analysing imagesLp11 analysing images
Lp11 analysing images
 
Reading Images
Reading ImagesReading Images
Reading Images
 
Evaluation
EvaluationEvaluation
Evaluation
 
The leveson inquiry full investigation
The leveson inquiry full investigationThe leveson inquiry full investigation
The leveson inquiry full investigation
 
Image Reading
Image Reading Image Reading
Image Reading
 
Evaluation final
Evaluation finalEvaluation final
Evaluation final
 
Principles of design
Principles of designPrinciples of design
Principles of design
 
06 images - reading images
06   images - reading images06   images - reading images
06 images - reading images
 
visual analysis
visual analysisvisual analysis
visual analysis
 
Visual analysis for composition
Visual analysis for compositionVisual analysis for composition
Visual analysis for composition
 
imágenes para analizar
imágenes para analizarimágenes para analizar
imágenes para analizar
 
Visual Literacy and Advertising Techniques Glossary of Terms
Visual Literacy and Advertising Techniques Glossary of TermsVisual Literacy and Advertising Techniques Glossary of Terms
Visual Literacy and Advertising Techniques Glossary of Terms
 
Mise en scene
Mise en sceneMise en scene
Mise en scene
 
Theories of Composition
Theories of CompositionTheories of Composition
Theories of Composition
 
PRINCIPLES OF COMPOSITION
PRINCIPLES OF COMPOSITIONPRINCIPLES OF COMPOSITION
PRINCIPLES OF COMPOSITION
 

Similar to 1998 how picture books work a semiotically framed theory of text-picture relationships_sipe

A Poem Is Like A Picture. Creative Writing Through Paintings
A Poem Is Like A Picture. Creative Writing Through PaintingsA Poem Is Like A Picture. Creative Writing Through Paintings
A Poem Is Like A Picture. Creative Writing Through Paintings
Tye Rausch
 
Resumen viktor shklovsky
Resumen viktor shklovskyResumen viktor shklovsky
Resumen viktor shklovskyorlando_vivas
 
10.pdf
10.pdf10.pdf
Literary Text As Poetic Structure
Literary Text As Poetic StructureLiterary Text As Poetic Structure
Literary Text As Poetic StructureIlyaVachaev
 
Literary theories and criticism
Literary theories and criticismLiterary theories and criticism
Literary theories and criticism
ssuseraf5e55
 
literarytextaspoeticstructure-140122121518-phpapp02.pptx
literarytextaspoeticstructure-140122121518-phpapp02.pptxliterarytextaspoeticstructure-140122121518-phpapp02.pptx
literarytextaspoeticstructure-140122121518-phpapp02.pptx
JaloladdinYoqubov
 
Context of art
Context of artContext of art
Context of art
arminda villamin
 
Art And Pornography Essay Review Of Jerrold Levinson S Contemplating Art
Art And Pornography  Essay Review Of Jerrold Levinson S Contemplating ArtArt And Pornography  Essay Review Of Jerrold Levinson S Contemplating Art
Art And Pornography Essay Review Of Jerrold Levinson S Contemplating Art
Amy Roman
 
Formalism-New-Criticism-Approach.pptx
Formalism-New-Criticism-Approach.pptxFormalism-New-Criticism-Approach.pptx
Formalism-New-Criticism-Approach.pptx
jeannmontejo1
 
WEEKLY OBJECTIVESAfter this week, you should be able to...· De.docx
WEEKLY OBJECTIVESAfter this week, you should be able to...· De.docxWEEKLY OBJECTIVESAfter this week, you should be able to...· De.docx
WEEKLY OBJECTIVESAfter this week, you should be able to...· De.docx
alanfhall8953
 
Wallace and Visual Art Text
Wallace and Visual Art TextWallace and Visual Art Text
Wallace and Visual Art TextKatherine Clover
 
Convergence of styles
Convergence of stylesConvergence of styles
Convergence of styles
drdd333
 
ingles Literatura e arte
ingles Literatura e arteingles Literatura e arte
ingles Literatura e arteytallo2010
 
Coleridge
Coleridge Coleridge
Coleridge
MalathiKaanishk
 
Metafiction
MetafictionMetafiction
Metafiction
Angelito Pera
 
Formalism
FormalismFormalism
Formalism
MannJanbazam
 
Summers 1Buffy SummersProfessor BakerEnglish 130215 Dece.docx
Summers 1Buffy SummersProfessor BakerEnglish 130215 Dece.docxSummers 1Buffy SummersProfessor BakerEnglish 130215 Dece.docx
Summers 1Buffy SummersProfessor BakerEnglish 130215 Dece.docx
picklesvalery
 
Study of Influence- Part II.pptx
Study of Influence- Part II.pptxStudy of Influence- Part II.pptx
Study of Influence- Part II.pptx
BKanagalakshmi
 
Reader response theory
Reader response theoryReader response theory
Reader response theory
AMohanraj2
 

Similar to 1998 how picture books work a semiotically framed theory of text-picture relationships_sipe (20)

A Poem Is Like A Picture. Creative Writing Through Paintings
A Poem Is Like A Picture. Creative Writing Through PaintingsA Poem Is Like A Picture. Creative Writing Through Paintings
A Poem Is Like A Picture. Creative Writing Through Paintings
 
Resumen viktor shklovsky
Resumen viktor shklovskyResumen viktor shklovsky
Resumen viktor shklovsky
 
10.pdf
10.pdf10.pdf
10.pdf
 
Literary Text As Poetic Structure
Literary Text As Poetic StructureLiterary Text As Poetic Structure
Literary Text As Poetic Structure
 
Literary theories and criticism
Literary theories and criticismLiterary theories and criticism
Literary theories and criticism
 
literarytextaspoeticstructure-140122121518-phpapp02.pptx
literarytextaspoeticstructure-140122121518-phpapp02.pptxliterarytextaspoeticstructure-140122121518-phpapp02.pptx
literarytextaspoeticstructure-140122121518-phpapp02.pptx
 
Structuralism By Riaz
Structuralism By RiazStructuralism By Riaz
Structuralism By Riaz
 
Context of art
Context of artContext of art
Context of art
 
Art And Pornography Essay Review Of Jerrold Levinson S Contemplating Art
Art And Pornography  Essay Review Of Jerrold Levinson S Contemplating ArtArt And Pornography  Essay Review Of Jerrold Levinson S Contemplating Art
Art And Pornography Essay Review Of Jerrold Levinson S Contemplating Art
 
Formalism-New-Criticism-Approach.pptx
Formalism-New-Criticism-Approach.pptxFormalism-New-Criticism-Approach.pptx
Formalism-New-Criticism-Approach.pptx
 
WEEKLY OBJECTIVESAfter this week, you should be able to...· De.docx
WEEKLY OBJECTIVESAfter this week, you should be able to...· De.docxWEEKLY OBJECTIVESAfter this week, you should be able to...· De.docx
WEEKLY OBJECTIVESAfter this week, you should be able to...· De.docx
 
Wallace and Visual Art Text
Wallace and Visual Art TextWallace and Visual Art Text
Wallace and Visual Art Text
 
Convergence of styles
Convergence of stylesConvergence of styles
Convergence of styles
 
ingles Literatura e arte
ingles Literatura e arteingles Literatura e arte
ingles Literatura e arte
 
Coleridge
Coleridge Coleridge
Coleridge
 
Metafiction
MetafictionMetafiction
Metafiction
 
Formalism
FormalismFormalism
Formalism
 
Summers 1Buffy SummersProfessor BakerEnglish 130215 Dece.docx
Summers 1Buffy SummersProfessor BakerEnglish 130215 Dece.docxSummers 1Buffy SummersProfessor BakerEnglish 130215 Dece.docx
Summers 1Buffy SummersProfessor BakerEnglish 130215 Dece.docx
 
Study of Influence- Part II.pptx
Study of Influence- Part II.pptxStudy of Influence- Part II.pptx
Study of Influence- Part II.pptx
 
Reader response theory
Reader response theoryReader response theory
Reader response theory
 

More from Samia Carvalho Alves

Coletando dados qualitativos
Coletando dados qualitativosColetando dados qualitativos
Coletando dados qualitativos
Samia Carvalho Alves
 
introduction to qualitative research texto 06
introduction to qualitative research texto 06introduction to qualitative research texto 06
introduction to qualitative research texto 06
Samia Carvalho Alves
 
Discussão e aplicação do método do protocolo verbal
Discussão e aplicação do método do protocolo verbalDiscussão e aplicação do método do protocolo verbal
Discussão e aplicação do método do protocolo verbal
Samia Carvalho Alves
 
Approach method_and_technique_in_english_teaching_2014
Approach  method_and_technique_in_english_teaching_2014Approach  method_and_technique_in_english_teaching_2014
Approach method_and_technique_in_english_teaching_2014
Samia Carvalho Alves
 
Carry visual literacy
Carry visual literacyCarry visual literacy
Carry visual literacy
Samia Carvalho Alves
 
2012 entrada 2 multimodality and english foreign language image_text interact...
2012 entrada 2 multimodality and english foreign language image_text interact...2012 entrada 2 multimodality and english foreign language image_text interact...
2012 entrada 2 multimodality and english foreign language image_text interact...
Samia Carvalho Alves
 
2011 expanding perspectives for comprehending visual images in multimodal tex...
2011 expanding perspectives for comprehending visual images in multimodal tex...2011 expanding perspectives for comprehending visual images in multimodal tex...
2011 expanding perspectives for comprehending visual images in multimodal tex...
Samia Carvalho Alves
 
2008 understanding visual images in picture books serafini
2008 understanding visual images in picture books serafini2008 understanding visual images in picture books serafini
2008 understanding visual images in picture books serafini
Samia Carvalho Alves
 
2008 the pedagogical possibilities for postmodern picture books serafini
2008 the pedagogical possibilities for postmodern picture books serafini2008 the pedagogical possibilities for postmodern picture books serafini
2008 the pedagogical possibilities for postmodern picture books serafini
Samia Carvalho Alves
 
2004 the role_of_images_and_image_text relations in group basic skills tests...
2004 the role_of_images_and_image_text  relations in group basic skills tests...2004 the role_of_images_and_image_text  relations in group basic skills tests...
2004 the role_of_images_and_image_text relations in group basic skills tests...
Samia Carvalho Alves
 
Cap10 relacoes logico-semanticas
Cap10 relacoes logico-semanticasCap10 relacoes logico-semanticas
Cap10 relacoes logico-semanticas
Samia Carvalho Alves
 
Cohesion types
Cohesion typesCohesion types
Cohesion types
Samia Carvalho Alves
 

More from Samia Carvalho Alves (13)

Coletando dados qualitativos
Coletando dados qualitativosColetando dados qualitativos
Coletando dados qualitativos
 
introduction to qualitative research texto 06
introduction to qualitative research texto 06introduction to qualitative research texto 06
introduction to qualitative research texto 06
 
Discussão e aplicação do método do protocolo verbal
Discussão e aplicação do método do protocolo verbalDiscussão e aplicação do método do protocolo verbal
Discussão e aplicação do método do protocolo verbal
 
Approach method_and_technique_in_english_teaching_2014
Approach  method_and_technique_in_english_teaching_2014Approach  method_and_technique_in_english_teaching_2014
Approach method_and_technique_in_english_teaching_2014
 
Carry visual literacy
Carry visual literacyCarry visual literacy
Carry visual literacy
 
2012 entrada 2 multimodality and english foreign language image_text interact...
2012 entrada 2 multimodality and english foreign language image_text interact...2012 entrada 2 multimodality and english foreign language image_text interact...
2012 entrada 2 multimodality and english foreign language image_text interact...
 
2011 expanding perspectives for comprehending visual images in multimodal tex...
2011 expanding perspectives for comprehending visual images in multimodal tex...2011 expanding perspectives for comprehending visual images in multimodal tex...
2011 expanding perspectives for comprehending visual images in multimodal tex...
 
2008 understanding visual images in picture books serafini
2008 understanding visual images in picture books serafini2008 understanding visual images in picture books serafini
2008 understanding visual images in picture books serafini
 
2008 the pedagogical possibilities for postmodern picture books serafini
2008 the pedagogical possibilities for postmodern picture books serafini2008 the pedagogical possibilities for postmodern picture books serafini
2008 the pedagogical possibilities for postmodern picture books serafini
 
2004 the role_of_images_and_image_text relations in group basic skills tests...
2004 the role_of_images_and_image_text  relations in group basic skills tests...2004 the role_of_images_and_image_text  relations in group basic skills tests...
2004 the role_of_images_and_image_text relations in group basic skills tests...
 
1908 the function of images winch
1908 the function of images winch1908 the function of images winch
1908 the function of images winch
 
Cap10 relacoes logico-semanticas
Cap10 relacoes logico-semanticasCap10 relacoes logico-semanticas
Cap10 relacoes logico-semanticas
 
Cohesion types
Cohesion typesCohesion types
Cohesion types
 

Recently uploaded

A Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in EducationA Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in Education
Peter Windle
 
A Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptxA Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptx
thanhdowork
 
Digital Artifact 1 - 10VCD Environments Unit
Digital Artifact 1 - 10VCD Environments UnitDigital Artifact 1 - 10VCD Environments Unit
Digital Artifact 1 - 10VCD Environments Unit
chanes7
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
Thiyagu K
 
The Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collectionThe Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collection
Israel Genealogy Research Association
 
World environment day ppt For 5 June 2024
World environment day ppt For 5 June 2024World environment day ppt For 5 June 2024
World environment day ppt For 5 June 2024
ak6969907
 
Delivering Micro-Credentials in Technical and Vocational Education and Training
Delivering Micro-Credentials in Technical and Vocational Education and TrainingDelivering Micro-Credentials in Technical and Vocational Education and Training
Delivering Micro-Credentials in Technical and Vocational Education and Training
AG2 Design
 
MASS MEDIA STUDIES-835-CLASS XI Resource Material.pdf
MASS MEDIA STUDIES-835-CLASS XI Resource Material.pdfMASS MEDIA STUDIES-835-CLASS XI Resource Material.pdf
MASS MEDIA STUDIES-835-CLASS XI Resource Material.pdf
goswamiyash170123
 
Azure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHatAzure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHat
Scholarhat
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Thiyagu K
 
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptxChapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 
The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
Delapenabediema
 
Introduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp NetworkIntroduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp Network
TechSoup
 
Digital Artifact 2 - Investigating Pavilion Designs
Digital Artifact 2 - Investigating Pavilion DesignsDigital Artifact 2 - Investigating Pavilion Designs
Digital Artifact 2 - Investigating Pavilion Designs
chanes7
 
DRUGS AND ITS classification slide share
DRUGS AND ITS classification slide shareDRUGS AND ITS classification slide share
DRUGS AND ITS classification slide share
taiba qazi
 
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Dr. Vinod Kumar Kanvaria
 
Normal Labour/ Stages of Labour/ Mechanism of Labour
Normal Labour/ Stages of Labour/ Mechanism of LabourNormal Labour/ Stages of Labour/ Mechanism of Labour
Normal Labour/ Stages of Labour/ Mechanism of Labour
Wasim Ak
 
Digital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental DesignDigital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental Design
amberjdewit93
 
PIMS Job Advertisement 2024.pdf Islamabad
PIMS Job Advertisement 2024.pdf IslamabadPIMS Job Advertisement 2024.pdf Islamabad
PIMS Job Advertisement 2024.pdf Islamabad
AyyanKhan40
 
PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.
Dr. Shivangi Singh Parihar
 

Recently uploaded (20)

A Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in EducationA Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in Education
 
A Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptxA Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptx
 
Digital Artifact 1 - 10VCD Environments Unit
Digital Artifact 1 - 10VCD Environments UnitDigital Artifact 1 - 10VCD Environments Unit
Digital Artifact 1 - 10VCD Environments Unit
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
 
The Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collectionThe Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collection
 
World environment day ppt For 5 June 2024
World environment day ppt For 5 June 2024World environment day ppt For 5 June 2024
World environment day ppt For 5 June 2024
 
Delivering Micro-Credentials in Technical and Vocational Education and Training
Delivering Micro-Credentials in Technical and Vocational Education and TrainingDelivering Micro-Credentials in Technical and Vocational Education and Training
Delivering Micro-Credentials in Technical and Vocational Education and Training
 
MASS MEDIA STUDIES-835-CLASS XI Resource Material.pdf
MASS MEDIA STUDIES-835-CLASS XI Resource Material.pdfMASS MEDIA STUDIES-835-CLASS XI Resource Material.pdf
MASS MEDIA STUDIES-835-CLASS XI Resource Material.pdf
 
Azure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHatAzure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHat
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
 
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptxChapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
 
The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
 
Introduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp NetworkIntroduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp Network
 
Digital Artifact 2 - Investigating Pavilion Designs
Digital Artifact 2 - Investigating Pavilion DesignsDigital Artifact 2 - Investigating Pavilion Designs
Digital Artifact 2 - Investigating Pavilion Designs
 
DRUGS AND ITS classification slide share
DRUGS AND ITS classification slide shareDRUGS AND ITS classification slide share
DRUGS AND ITS classification slide share
 
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
 
Normal Labour/ Stages of Labour/ Mechanism of Labour
Normal Labour/ Stages of Labour/ Mechanism of LabourNormal Labour/ Stages of Labour/ Mechanism of Labour
Normal Labour/ Stages of Labour/ Mechanism of Labour
 
Digital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental DesignDigital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental Design
 
PIMS Job Advertisement 2024.pdf Islamabad
PIMS Job Advertisement 2024.pdf IslamabadPIMS Job Advertisement 2024.pdf Islamabad
PIMS Job Advertisement 2024.pdf Islamabad
 
PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.
 

1998 how picture books work a semiotically framed theory of text-picture relationships_sipe

  • 1. Children's Literaturein Education, Vol. 29, No. 2, 1998 Lawrence R. Sipe is an assistant professor in thereading/writing/ literacy program at the University of Pennsylvania's Graduate School of education, where he teaches courses in literaturefor children and adolescents. After working for nineteen years in schools and school systemsin both the United Statesand Canada, he completed a Ph.D. in children's literature, emergent literacy, and literary criticism at the Ohio State University. His research focuses on children's responses to literature, the development of literary understanding, and the ways in whichliterature both reinscribes and challengesexisting sociocultural practices. Lawrence R. Sipe How Picture Books Work: A Semiotically Framed Theory of Text-Picture Relationships In this article, I provide an overview of the various ways in which the relationship between the words and pictures in a picture book has been conceptualized; I draw on several theoretical traditions and dis- ciplines to describe this relationship. Although theorists have ad- vanced many different conceptualizations of the text-picture relation- ship, they have not adequately explained what goes on in our heads as we relate words and pictures. Therefore, in order to describe more precisely what happens internally as we relate verbal and visual signs, I present a theory of text-picture relations that is based on the semio- tic concept of "transmediation." By way of making the theory more clear, it is applied to the text-picture relationship in one double-page spread of Where the Wild Things Are. J. Cech, "Remembering Caldecott: 'The Three Jovial Huntsmen' and the art of the picturebook," p. 118 P.Pullman, "Invisible pictures," p. 167 Conceptualizing the Text-Picture Relationship According to many writers, the essence of the picture book is the way the text and the illustrations relate to each other; this relationship between the two kinds of text—the verbal and the visual texts—is complicated and subtle. A variety of metaphors have been used to describe it. In several cases, the metaphor is drawn from music. Cech writes of the "duet" between text and pictures. Pullman utilizes the term "counterpoint," while Ward and Fox refer to the "contra- punctual" relationship. Ahlberg talks about the "antiphonal" effect of words and pictures. On the other hand, using scientific metaphor in writing about illustration, Miller uses the idea of "interference" from wave theory, describing how two different wave patterns may com- 97 0045-6713/98/0600-097$15.00/0 © 1998 Human Sciences Press, Inc.
  • 2. 98 Children's Literature in Education J. Ward and M. Fox, "A look at some outstanding illustrated books for children," p. 21 A. Ahlberg in E. Moss, "A certain particularity: An interview with Janet and Allan Ahlberg," p. 21 J. H. Miller, Illustration, p. 95 W. Moebius, "Introduction to picturebook codes," p. 143 D. Lewis, "Going along with Mr. Gumpy: Polysystemy and play in the modern picture book," p. 105 P Nodelman, Words About Pictures: The Narrative Art of Children's Picturebooks, p. 223 P. Nodelman, Words About Pictures: The Narrative Art of Children's Picturebooks, p. 221 J. Schwarcz, Ways of the Illustrator: Visual Communication in Children's Literature, p. 15 J. Golden, The Narrative Symbol in Children's Literature P. Nodelman, Words About Pictures: The Narrative Art of Children's Picturebooks, p. 220 bine to form a complex new pattern. Moebius utilizes geological im- agery to speak of the "plate tectonics" of text and illustrations. Various alternative words and concepts seem to be pivotal in other theorists' description of the text-picture relationship. Lewis uses the idea of "polysystemy": "the piecing together of text out of different kinds of signifying systems." Perry Nodelman describes how the text and pictures "limit" each other, and uses literary terminology to de- scribe the relationship of text and pictures as one of "irony": The words and pictures comment ironically on each other, as it were. Nodelman also discusses Barthes's metaphor of "relaying," writing that, "Bylimiting each other, words and pictures take on a meaning that neither possesses without the other—perform the completion of each other that Barthes calls 'relaying.'" Schwarcz conceives of two general categories of relationshipsbetween text and pictures: what he calls "congruency" and "deviation." In the category of congruency, the text and pictures are in a harmonious relationship. Sometimes the illustrations complement the text by "running ahead of the text and pushing the action forward." The text and the illustrations may also take turns in telling the story; this is what Schwarcz calls "alternate progress." In deviation, Schwarcz's second category of relationships, the illustrations "veer away" from the text by opposing it in some way. Another example of deviation is what Schwarcz calls "counter- point"—the musical metaphor, again—when the illustrations tell a different story from the text. Part of the enjoyment of this story lies in the reader-viewer's perception of both stories at once. Golden describes five types of relationships between text and pic- tures: The categories seem to be differentiated by how much "work" the illustrations or the text do in conveying meaning. One limitation of this scheme is that, since it depends mainly on the relative amounts of power the text and the illustrations have, there is less attention to the dynamic way in which, as Nodelman puts it, "the words change the pictures and the pictures change the words." The text-picture re- lationship is not so much a matter of a balance of power as it is the way in which the text and pictures transact with each other, and transform each other. The Synergy of Words and Pictures My own descriptive term is "synergy," defined by the Shorter Oxford English Dictionary as "the production of two or more agents, sub- stances, etc., of a combined effect greater than the sum of their sepa- rate effects." In a picture book, both the text and the illustration sequence would be incomplete without the other. They have a syner- gistic relationship in which the total effect depends not only on the
  • 3. How Picture Books Work 99 W: Iser, The Act of Reading: A Theory of Aesthetic Response P. Nodelman, Words About Pictures: The Narrative Art of Children's Picturebooks G. E. Lessing, Laocoon: An Essay on the Limits of Painting and Poetry union of the text and illustrations but also on the perceived interac- tions or transactions between these two parts. In adding to what these theorists have written about the relationship of words and pictures in picture books, I will focus on the phenome- nological dynamics of the synergistic relationship itself. In other words, I want to try to explain more fully what happens in our heads: the process we engage in when we relate the verbal and visual texts of the picture book to each other. In order to do this, I will draw from literary theories of the type commonly referred to as "reader response" criticism (Wolfgang Iser), aesthetic criticism (G. E. Lessing and Wendy Steiner), linguistics and semiotics (Roman Jakobsen and Charles Peirce), and theories of literacy (Marjorie Siegel, Mark Sa- doski, and Alan Paivio). What Wolfgang Iser sees as he examines the reader-text relationship is a reader participating in the production of textual meaning. The ac- tual literary work is realized through a convergence of reader and text. For Iser, the reader acts as co-creator of the work by supplying that portion of it that is not written but only implied. Each reader fills in the unwritten work or the "gaps" in his or her own way, thereby acknowledging the inexhaustibility of the text. Iser's concept of gap- filling suggests that we can think of readers filling in some of the gaps in the verbal text of a picture book with information from the illustra- tions and of readers using information from the verbal text to fill in some of the gaps in the illustrations. Nodelman observes that words have a greater potential for conveying temporal information, whereas pictures have a greater potential for conveying spatial information. Does this mean that we might process verbal and visual information in different ways? There is a long tradi- tion for this idea, beginning with the classic distinction, made by the German Romantic philosopher G. E. Lessing, between arts that are based on simultaneity of perception (painting, sculpture) and arts that are based on time sequence or successivity of perception (music, literature). Lessing argued that, since our experience of the world has two components or modes (space and time), all of the arts could be classified on the basis of which of these two modes were experienced while the viewer or listener was engaged in a work of art. We see a painting all at once; but in order to experience literature or music, we have to read or listen in a linear succession of moments through time. This raises the question of whether there could be arts that are based on both time and space—onsimultaneity as well as successivity. Even in Lessing's time, the opera was an example of such an art form; and it was because opera combined spatial arts and temporal arts that Wagner called his operas Gesamtkunstwerke ("assembled" or "put-to-
  • 4. 100 Children's Literature in Education W. Steiner, The Colors of Rhetoric, p. 144 gether" works of art). Drama and film are also examples of art forms that we experience simultaneously in time and space. The picture book, of course, is another of these hybrid art forms. WendySteiner, a literary and aesthetic theorist, argues that "the illustrated text is a Gesamtkunstwerk, a mixture of artistic media epitomized in Wag- nerian opera," and, like opera, is a "gesture toward semiotic replete- ness, combining several kinds of sign types and having them com- ment on each other." W. Steiner, Pictures of Romance R. Jakobsen, "On the relation between visual and auditory signs," p. 340 W. Steiner, The Colors of Rhetoric, p. 37 Wendy Steiner follows Lessing's basic distinction by observing that the visual arts present us with a diffuse network, whereas temporal art leads us along a line or chain. The linguist and semiotician Roman Jakobsen makes a similar point: "Every complex visual sign, for exam- ple every painting, presents a simultaneity of various components, whereas the time sequence appears to be the fundamental axis of speech." Jakobsen goes on to say that speech is not purely temporally linear, but that the "predominantly sequential character of speech is beyond doubt, and this primacy of successivity must be analyzed." Written language is not purely linear, either; when we read, we are processing ever-greater sequences of letters, words, and sentences as meaningful wholes, until, finally, we may arrive at an understanding of the total structure of a poem or story. Nevertheless, to paraphrase Jakobsen, the predominantly sequential character of written language is beyond doubt. Just as written language is not purely linear, painting and the visual arts are not purely spatial, either. When we look at a painting (or an illustration in a picture book), we look in a series of temporal mo- ments at various parts of it. But, as Steiner comments, visual art is designed "to enlarge our ability to turn sequence into simultaneity, to allow us to form ever larger temporal flows into unified, atemporal structures." So, it's not the case that our perception of the image is static. We do look at the image in a series of temporal moments, but as we look our minds are forming "ever larger temporal flows into unified atemporal structures"; thus, to paraphrase Jakobsen once again, the predominantly simultaneous character of visual art is be- yond doubt. The different ways in which we experience written language and vi- sual art have important implications for the ways in which we try to relate the words and the pictures in a picture book. Because of the primarily spatial nature of the pictures and our drive to form "unified atemporal structures," our tendency is to gaze on, dwell upon, or contemplate them. In contrast, the primarily temporal nature of the verbal narrative creates in us a tendency to keep on reading, to keep
  • 5. How Picture Books Work 101 C. S. Lewis, On Stories and Other Essays on Literature, p. 17 J. Doonan, Looking at Pictures in Picturebooks P. Pullman, "Invisible pictures," p. 171 J. L.Lemke, "Multiplying meaning: Literacy in a multimedia world" M. Meek, "What counts as evidence in theories of children's literature," p. 174 J. J. Gibson, The Senses Considered as Perceptual Systems, p. 285 I. Massey, "Words and images: Harmony and dissonance," p. 388 M. Sadoski and A. Paivio, "A dual coding view of imagery and verbal process in reading comprehension." C. Suhor, "Towards a semiotic-based curriculum," p. 250 going ahead in what C. S. Lewis termed "narrative lust." There is thus a tension between our impulse to gaze at the pictures—to forget about time in creating an "atemporal structure"—andto not interrupt the temporal narrative flow. The verbal text drives us to read on in a linear way, where the illustrations seduce us into stopping to look. This tension results in the impulse to be recursive and reflexive in our reading of a picture book: to go backward and forward in order to relate an illustration to the one before or after it, and to relate the text on one page to an illustration on a previous or successive page; or to understand new ways in which the combination of the text and pic- ture on one page relate to preceding or succeeding pages. Picture books have the effect of "loosening the tyranny of the one-way flow" of the purely verbal text. Therefore, picture books seem to demand rereading; we can never quite perceive all the possible meanings of the text, or all the possible meanings of the pictures, or all the possi- ble meanings of the text-picture relationships. Lemke observes that, in illustrated informationaltexts and hypertext, there are "many possible pathways through the textworld"; this is equally true of the picture book. Margaret Meek argues that, "Apicture book invites all kinds of reading and allows the invention of a set of stories rather than a single story." The reader/viewer's construction of the relationship of text and pic- tures is one of the "affordances" of picture books. But how does this construction proceed? It is an intriguing idea that the interrelation- ship of words and pictures mirrors the thought process itself. Irving Massey's assertion that, "Thinking consists of a constant alternation between image-makingand word-making" is given support in reading theory by the "dual coding" hypothesis of Mark Sadoski and Alan Paivio, which suggests that cognition has two separate (though re- lated) structures: one for processing verbal information (either in speech or written language) and one for processing nonverbal infor- mation (such as visual stimuli). Aswe alternate our attention between words and pictures in a picture book, then, we may be representing the verbal and nonverbal information in separate cognitive structures; following this, through the complex referential connections between these two cognitive structures, we construct an integrated meaning. A Theory of Transmediation There is another theory from the field of literacy that may also prove helpful in understanding how we construct the conversation between words and pictures. Charles Suhor uses the concept of "transmedia- tion" or "the translation of content from one sign system into an- other." This concept of transmediation may be heuristic for under-
  • 6. 102 Children's Literature in Education M. Siegel, "More than words: The generative power of transmediation for learning" C. Peirce, "Logic as semiotic: The theory of signs" standing the process we use in relating words to pictures in picture books. For in picture books, we must oscillate, as it were, from the sign system of the verbal text to the sign system of the illustrations; and also in the opposite direction from the illustration sign system to the verbal sign system. Whenever we move across sign systems, "new meanings are produced," because we interpret the text in terms of the pictures and the pictures in terms of the texts in a potentially never-ending sequence. Siegel draws from semiotic theory (and partic- ularly the work of Charles Peirce) to explain the way in which we move across sign systems. For Peirce, a process of using signs consists of three parts: the sign itself, or representamen; the equivalent sign (called the interpretant) in the receiver of the sign; and the object for which the sign stands. The relationship among these three parts is usually represented visually by a triangle, called a semiotic triad: M. Siegel, "More than words: The generative power of transmediation for learning," p. 10 M. Siegel, "More than words: The generative power of transmediation for learning," p. 12 Thus, the sign or representamen "does not simply stand for an object, but tells something about the meaning of that relationship and this requires a third component, which he called an interpretant. The in- terpretant is another sign that represents the same object as the repre- sentamen, as its position in the semiotic triad indicates." According to Siegel, what happens in transmediation, when we move from one sign system to another, is that "an entire semiotic triad serves as the object of another triad and the interpretant for this new triad must be repre- sented in the new sign system." In terms of what happens in picture books, we have two sign systems, and therefore two sets of triads: When we interpret the words in terms of the pictures, or move from the sign system of the words to the sign system of the pictures, the semiotic triad with the words as representamen becomes the object of a new triad, and the interpretant for this new triad changes accord- ingly:
  • 7. How PictureBooks Work Conversely, when we interpret the pictures in terms of the words, or move from the sign system of the pictures to the sign system of the words, the semiotic triad with the pictures as representamen be- comes the object of a new triad, and the interpretant for this new triad changes as well: The resulting process is a type of oscillation, as we adjust our inter- pretation of the pictures in terms of the words, and our interpretation of the-words in terms of the pictures. And, because the meanings of the signs are always shifting (due to their adjustment and readjust- ment as each triad becomes the object in a new triad), this oscillation is never-ending. The possibilities of meaning in the word-picture rela- tionship are inexhaustible. Words and Pictures in Where the Wild Things Are To concretize all these abstractions and to elucidate the theory more completely, I will analyze a few of the possible semiotic triads in the text and pictures of the ninth opening of Where the Wild Things Are. The analysis is necessarily distorting and artificial, because it renders in laborious slow motion a process that in practice happens very quickly. It does, however, allow us to tease out an explanation of the steps in our meaning making. The text of this double-page spread reads, 103 M. Sendak, Where the Wild Things Are
  • 8. Children's Literature in Education And when he came to the place where the wild things are/they roared their terrible roars and gnashed their terrible teeth/and rolled their ter- rible eyes and showed their terrible claws. Let us first consider the text alone, without reference to the illustra- tion. As we come to this point in the text, Sendak has carefully built our anticipation during the eight previous double-page spreads. Before we even opened the book, the title and the cover incited us to predict some encounters with "wild things," and the vagueness of that phrase may have triggered all sorts of speculation about what these "things" will look like and how they will behave. The growth of the magical forest, which "grew/and grew—/and grew" has been stretched out over three openings, an ocean has "tumbled by" with a "private boat," and Max has sailed "in and out of weeks and almost over a year." Now the text tells us that Max has finally "c[o]me to the place." The four phrases —roared their terrible roars —and gnashed their terrible teeth —and rolled their terrible eyes —and showed their terrible claws are representamens of objects for which our overall interpretant, if put into words, might be "horrific, savage monsters," with razor-sharp teeth and claws, and wickedly cruel eyes. The representamens (Sen- dak's words) allow us to construct this overall interpretant through their communication of sound (roars and gnashing), sight (teeth, eyes, and claws), and motion (eye-rolling and gesture), as well as our interpretation of the word "terrible." The fourfold repetition of this word accentuates the monsters' frightfulness. Our interpretant of these representamens may also include the inference that Max must be very frightened. Now we uncover the illustration and attempt to disregard the text. The illustration contains many representamens of many objects. What is our interpretant of some of them? Max and his boat are on the extreme left, and we would normally look at him first, since our pro- pensity is to "read" illustrations from left to right. In this case, how- ever, it is probably the four wild things that first catch our eye. They are constructed primarily of curves and rounded shapes. Their claws (which resemble those on Max's outfit), their horns, and even their teeth are slightly curved. Their bodies are the round shapes of stuffed animals. One of the wild things wears a child's striped T-shirt and has a tail like the one on Max's wolf suit. Another has chicken-like legs and feet. The pads on the other wild things' feet and paws are puffy 104
  • 9. How Picture Books Work and soft brown. The colors of their fur and faces are pastel and muted. The strongest color is the yellow of their eyes, which is only a bit more intense than the color of the rest of their faces and bodies. The wild things' hair looks soft and strokable, and they stand on soft green grass. The two wild things on the right-hand page can only be described as chubby. Their faces are humanoid (with broad, pudgy noses) and they stand upright. The wild thing nearest Max is perhaps the most formidableof the four: It is the most animal-likein its stance, and its face is more beastlike. It has an open mouth, red and lined with teeth. It has the longest claws, three horns, and a lion-like mane. Yet if it is so fierce, why has it allowed the smaller, goat-like wild thing to sit on its back? Why is its tail dragging on the ground, instead of quivering upright?If we turn our attention to Max,a glance assures us that he is not at all cowed by these beasts, even by the one closest to him. The expression on his face is one of disdain or exasperation, not fear. His hand is rebelliously on his hip, reminding us of his atti- tude in the third opening, where he was angry at his mother. The overall interpretant for this visual image, then, might be "mild men- ace, but nothing Max can't handle." Having constructed interpretants for the two semiotic triads, we are now ready to move between the visual and the verbal sign systems. According to the theory of transmediation, in the movement from one sign system to another, "an entire semiotic triad serves as the object of another triad and the interpretant for this new triad must be repre- sented in the new sign system." Let us take the picture triad as the object of the new triad we will build: In this new triad, the new object to which the text refers is the entire picture triad we have previously constructed. The text is the repre- sentamen for this new object (or set of objects). We must therefore construct a new interpretant of the representamen (the text) since the representamen is now the referent for a new object. A "think- aloud" for this process of constructing a new interpretant for the text in light of the pictures might go something like this: 105
  • 10. Children's Literature in Education The text reads, "they roared their terrible roars"; but the mouths of two of the wild things are tightly closed, and the other two don't have their mouths open wide enough to make a terribly loud roar. The wild things are supposed to gnash their terrible teeth and show their terrible claws; but their teeth, being curved, are not so terrible. Nei- ther are their claws, and I don't see any teeth being gnashed together. The wild things' eyes are almost circular, more like the glass orbs of stuffed toys than the eyes of fierce beasts. So I'll have to modify my interpretation of the words in the light of the pictures. There's menace here, especially in the creature closest to Max, but Max doesn't seem to befrightened out of his wits. To complete this analysis, let us consider going in the other direction: constructing a new interpretant for the pictures when the object they represent is the textual triad: 106 A think-aloud in this case might be as follows: Max doesn't seem frightened and the wild things (for many reasons) don't seem all that threatening. But the text says that they roared and gnashed their teeth and showed their claws. Those claws and teeth might not be needle-sharp, but they could probably still inflict some pretty terrible damage. And just because the beasts' mouths are either closed or only slightly open doesn't mean that they can't open them wide and let out a terrible roar. I wouldn't want to be caught in a dark alley with any of them, especially with the one who's closest to Max; that guy's paws are bigger than Max's whole head, and that rhinoceros horn looks dangerously sharp. Those horns look like devil's horns, so maybe they are terrible after all, and maybe Max is just too dumb to know the trouble he's in. So this transmediation goes back and forth—oscillates—in a poten- tially endless process. Each new page opening presents us with a new set of words and new illustrations to factor into our construction of meaning. Reviewing and rereading will produce ever-new insights as we construct new connections and make modifications of our pre- vious interpretations, in a Piagetian process of assimilation and accom- modation. In other words, we assimilate new information and in the process we change our cognitive structures, accommodating them to the new information.
  • 11. How Picture Books Work In this article, I have attempted to use the semiotic theory of trans- mediation to unfold the text-picture relationship; and I have used Where the Wild Things Are as an example to explicate the theory. I have argued that transmediation is a more precise way of looking at the text-picture relationship because it allows us to analyze the phe- nomenological process of relating words and pictures. Transmediation also makes it clear that visual texts are on an equal footing with verbal texts. It seems necessary, in the logocentric society that we live in today, to make this point and emphasize the significance of picture books in children's learning. Picture books, through transmediation, give children the opportunity to engage in an unending process of meaning making as every rereading brings about new ways of looking at words and pictures. In other words, picture books allow children to have multiple experiences as they engage in creating new mean- ings and constructing new worlds. References Cech, J., "Remembering Caldecott: 'The Three Jovial Huntsmen' and the art of the picturebook," The Lion and the Unicorn, 1983-84, 7/8, 110-119. Doonan, J., Looking at Pictures in Picturebooks. Stroud., Glos: The Thimble Press, 1993. Gibson, J., The Senses Considered as Perceptual Systems. Boston: Houghton Mifflin, 1966. Golden, J., The Narrative Symbol in Children's Literature. New York: Mouton de Gruyter, 1990. Iser, W.,A Theory of Aesthetic Response. Baltimore, MD:Johns Hopkins Uni- versity Press. Jakobsen, R., "On the relation between visual and auditory signs," Selected Writings II: Word and Language. The Hague: Mouton, 1971. Lemke, J. L., "Multiplying meaning: Literacy in a multimedia world," National Reading Conference, Charleston, SC, December 1993. Lessing, G. E., Laocoon:An Essay on the Limits of Painting and Poetry, E.A. McCormick, trans. Baltimore, MD: Johns Hopkins University Press. Lewis, C. S., On Stories: And Other Essays on Literature, New York: Harcourt Brace Jovanovich, 1982. Lewis, D., "Going along with Mr.Gumpy: Polysystemy and play in the modern picture book," Signal, 1996, 80, 105-119. Massey I., "Words and images: Harmony and dissonance," Georgia Review, 1980, 34, 375-395. Meek, M., "What counts as evidence in theories of children's literature," in Children's Literature: The Development of Criticism, P. Hunt, ed. New York: Routledge, 1992. Miller, J. H., Illustration. Cambridge, MA:Harvard University Press, 1992. Moebius, W, "Introduction to picturebook codes," Word & Image, 1986, 2 (2), 141-158. Moss, E., "Acertain particularity: An interview with Janet and Allen Ahlberg," Signal, 1990, 61. 107
  • 12. Children's Literature in Education Nodelman, P., Words About Pictures: The Narrative Art of Children's Picture Books. Athens: University of Georgia Press, 1988. Peirce, C. S., "Logic as semiotic: The theory of signs," in Philosophical Writ- ings of Pierce,J. Buchler, ed., pp. 98-119. New York: Dover Press. Pullman, P., "Invisible pictures," Signal, 1989, 60, 160-186. Sadoski, M., and Paivio, A., "A dual coding view of imagery and verbal process in reading comprehension," in Theoretical Models and Processes of Read- ing, 4th ed., R. Ruddell, M. Ruddell, and H. Singer, eds. Newark, DE: Inter- national Reading Association, 1994. Steiner, W., The Colors of Rhetoric. Chicago: The University of Chicago Press, 1982. Steiner, W., Pictures of Romance. Chicago: The University of Chicago Press, 1988. Schwarcz, J., Ways of the Illustrator. Visual Communication in Children's Literature. Chicago: American Library Association, 1982. Siegel, M., "More than words: The generative power of transmediation for learning," Canadian Journal of Education, 1995, 20(4), 455-475. Suhor, C., "Towards a semiotics-based curriculum," Journal of Curriculum Studies, 1984, 16, 247-257. Ward, J., and Fox, M., "A look at some outstanding illustrated books for chil- dren," Children's Literature Association Quarterly, 1984, 9 (1), 19-21. 108