Lawrence Sipe provides an overview of theories on the relationship between text and pictures in picture books. He draws on semiotic and literacy theories to propose a theory of "transmediation" - that readers relate words and pictures by translating information between the different sign systems. The process involves oscillating attention between the verbal text and illustrations to construct an integrated meaning. Prior theories viewed the relationship as musical (counterpoint), scientific (interference), or geological (tectonics). Sipe argues pictures have greater spatial potential while text has greater temporal potential, creating tension as readers alternate between them.
The focus of this study is on an employment of images in poetry to describe objects and situations with precision, force and vividness. Images are used for more factual
reflection of the scene and object. They become descriptive when manifested in various forms for comparisons, resemblances, contrasts and differences as well as for
associated ideas. The appreciation of literature and the development of the literary taste are advanced by images. Figures of speech are used as words, phrases or
expressions in other than their plain or literal meaning in order to produce a special effect They deliberately interfere with language usage to transfer the meaning of
one object into another object. The interference takes the form of transference or 'carrying over' with the aim of achieving a new meaning. Figurative language plays a
vital role in selected poetry due to an employment of various images. Various words, phrases or ideas are ambiguously employed for specific effect. Conjunctive
ambiguity underlies metaphor and allegory. All types of ambiguities suggest meanings in various contexts. Most poetic words or phrases in this work reflect separate
meanings that are projected, added, conjoined or disjoined. The theoretical and interpretive approaches serve as a point of departure in this discourse.
The focus of this study is on an employment of images in poetry to describe objects and situations with precision, force and vividness. Images are used for more factual
reflection of the scene and object. They become descriptive when manifested in various forms for comparisons, resemblances, contrasts and differences as well as for
associated ideas. The appreciation of literature and the development of the literary taste are advanced by images. Figures of speech are used as words, phrases or
expressions in other than their plain or literal meaning in order to produce a special effect They deliberately interfere with language usage to transfer the meaning of
one object into another object. The interference takes the form of transference or 'carrying over' with the aim of achieving a new meaning. Figurative language plays a
vital role in selected poetry due to an employment of various images. Various words, phrases or ideas are ambiguously employed for specific effect. Conjunctive
ambiguity underlies metaphor and allegory. All types of ambiguities suggest meanings in various contexts. Most poetic words or phrases in this work reflect separate
meanings that are projected, added, conjoined or disjoined. The theoretical and interpretive approaches serve as a point of departure in this discourse.
Four case studies in close reading images, using some of the ideas from class: "Afghan Girl," the recent image of Kyle Hockenberry's tattoo from Battleland, the Iwo Jima/Twin Towers connection, and a
Image Reading is a 21st century skill. In this PowerPoint, we are introducing basic image reading skills, using a variety of images that have similarities in their content, but
Four case studies in close reading images, using some of the ideas from class: "Afghan Girl," the recent image of Kyle Hockenberry's tattoo from Battleland, the Iwo Jima/Twin Towers connection, and a
Image Reading is a 21st century skill. In this PowerPoint, we are introducing basic image reading skills, using a variety of images that have similarities in their content, but
WEEKLY OBJECTIVESAfter this week, you should be able to...· De.docxalanfhall8953
WEEKLY OBJECTIVES
After this week, you should be able to...
· Define imagery as it relates to literature
· Recognize imagery in poetry
· Explain symbolism in poetry
· Differentiate between natural and conventional symbolism
· Practice college-level writing with appropriate focus, development, organization, and mechanics
· Practice college-level research & citation
What is imagery?
–
When you consider the term imagery, you might only think of images that you perceive with your eyes. However, the literary term refers to words and phrases (often figurative language) that appeal to the five senses:
–
1. Taste
2. Smell
3. Touch
4. Sight
5. Hearing
An Example in Poetry Let us consider for a moment how powerful sensory detail can be in a poem… how imagery can convey much more than physical sensations, but can reveal a flood of emotional associations. Consider this example, where a comb initially conveys a sense of touch:
THE PIERCING CHILL I FEELBy Taniguchi Buson
The piercing chill I feel:
my dead wife's comb, in our bedroom,
under my heel. . .
Buson could have made the entire poem more ghostly and abstract in order to to convey a sense of loss. In fact, the piercing chill in the first line and title are quite generic. We know what cold feels like and we have experienced pain, so we understand this chill to be a cold that pierces (not literally), but one that goes beyond the surface and perhaps wounds him internally. It is familiar: there are many instances in the human effort to communicate negative emotion when cold and pain are used together.
These last lines,
my dead wife's comb, in our bedroom,
under my heel. . .
are what really make this poem worthy of being called a poem. They take the familiar ambiguity of the first lines and transport us to a unique image that amplifies the emotion being expressed in these words. The reader’s journey through the poem’s familiar language is disrupted by a more concrete object: the “dead wife’s comb,” much in the same way that speaker’s journey through the bedroom is disrupted when he encounters the object under his foot. We almost experience the same type of surprise that the speaker experiences by stepping on the comb!
Furthermore, the comb is loaded with potential associations that help us identify what the speaker is feeling or precisely how he is “chilled.” This is an object that once passed through his living wife’s hair. It is a reminder of the life that is now gone-- of the movement of his wife’s hand as it guided the comb.
The “heel” is of course the other part of the image. The speaker doesn’t merely see or pick up the comb, but he steps on it before he otherwise notices it. This might say something about the speaker’s disposition. He is perhaps either numb or beginning to distance himself from the loss. If nothing else, this object takes him by surprise, the way the full comprehension of loss is surprising. The comb also has the effect of “piercing” him in a more literal sense. .
Summers 1
Buffy Summers
Professor Baker
English 1302
15 December 2015
Preaching to Their Respective Choirs: Political and Religious Divides in YA Literature
In a 1989 special issue of Children’s Literature Association Quarterly, editors Craig Werner and Frank P. Riga identify a shift regarding how authors of novels for young readers address religious matters. Several narratives are indeed full-blown declarations of their beliefs, but they have also been politicized in more obvious ways. The formula associated with these narratives is relatively simple: a rebellious protagonist who is “smart, sensitive, and perceptive” defies the “flagpole Christian majority,” which results in the protagonist being harassed and bullied. Darwin’s theories of evolution are frequently at the center of the conflict, possibly a reflection of the dramatization of the Scopes monkey trial, Inherit the Wind. Eventually, the protagonist’s actions are proven justified; the Christian majority is clearly wrongheaded and narrow-minded, particularly when it comes to evolution’s place in the school curriculum.
The contemporary political and ideological landscape and distance between conservative (including the “religious right”) and liberal thought make the sensibilities and models of which Cadden speaks nearly impossible to define or reconcile. Further, the once “partial answers” offered in the narratives to which Werner and Riga refer have been replaced by certainty. The protagonists offer “full blown declarations of faith” or non-faith, but the declarations are clearly a result of the political environment and meant for a specific audience thus leaving the protagonists preaching to their respective choirs, an unproductive and uncritical endeavor.
Summers 1
Buffy Summers
Professor Baker
ENG 1302
12 June 2015
Identity, Music, and Gestalt Theory in V for Vendetta: Projections of Discontent
Traditionally a mask is used to conceal the identity of the person wearing it, yet its very existence draws even more attention to the person under the mask. But what if there is nothing under the mask? What if the masked man is merely a projection of the inner turmoil of the protagonist? Bruce Kawin notes that when dealing with a projection of the protagonist or audience, “the health is achieved by taking the projection back into oneself, in other words by deeply acknowledging the connection between the monster and the official self” (Kawin loc. 7433). In the film V for Vendetta (2006), directed by the Wachowski siblings, the terrorist V functions as a personified projection of Evey Hammond’s disdain for the corrupt dystopian England. The key to his terrorist activity is the use of music, specifically Tchaikovsky's “1812 Overture.”
Film can utilize sound, specifically music, to drive the plot and shape characterization. Sound in film can be diagetic (sound that the characters interact with) and non-diagetic (such as the film score). Both can be used in tandem to create an ad ...
A Strategic Approach: GenAI in EducationPeter Windle
Artificial Intelligence (AI) technologies such as Generative AI, Image Generators and Large Language Models have had a dramatic impact on teaching, learning and assessment over the past 18 months. The most immediate threat AI posed was to Academic Integrity with Higher Education Institutes (HEIs) focusing their efforts on combating the use of GenAI in assessment. Guidelines were developed for staff and students, policies put in place too. Innovative educators have forged paths in the use of Generative AI for teaching, learning and assessments leading to pockets of transformation springing up across HEIs, often with little or no top-down guidance, support or direction.
This Gasta posits a strategic approach to integrating AI into HEIs to prepare staff, students and the curriculum for an evolving world and workplace. We will highlight the advantages of working with these technologies beyond the realm of teaching, learning and assessment by considering prompt engineering skills, industry impact, curriculum changes, and the need for staff upskilling. In contrast, not engaging strategically with Generative AI poses risks, including falling behind peers, missed opportunities and failing to ensure our graduates remain employable. The rapid evolution of AI technologies necessitates a proactive and strategic approach if we are to remain relevant.
Unit 8 - Information and Communication Technology (Paper I).pdfThiyagu K
This slides describes the basic concepts of ICT, basics of Email, Emerging Technology and Digital Initiatives in Education. This presentations aligns with the UGC Paper I syllabus.
A review of the growth of the Israel Genealogy Research Association Database Collection for the last 12 months. Our collection is now passed the 3 million mark and still growing. See which archives have contributed the most. See the different types of records we have, and which years have had records added. You can also see what we have for the future.
Delivering Micro-Credentials in Technical and Vocational Education and TrainingAG2 Design
Explore how micro-credentials are transforming Technical and Vocational Education and Training (TVET) with this comprehensive slide deck. Discover what micro-credentials are, their importance in TVET, the advantages they offer, and the insights from industry experts. Additionally, learn about the top software applications available for creating and managing micro-credentials. This presentation also includes valuable resources and a discussion on the future of these specialised certifications.
For more detailed information on delivering micro-credentials in TVET, visit this https://tvettrainer.com/delivering-micro-credentials-in-tvet/
This slide is special for master students (MIBS & MIFB) in UUM. Also useful for readers who are interested in the topic of contemporary Islamic banking.
Read| The latest issue of The Challenger is here! We are thrilled to announce that our school paper has qualified for the NATIONAL SCHOOLS PRESS CONFERENCE (NSPC) 2024. Thank you for your unwavering support and trust. Dive into the stories that made us stand out!
Introduction to AI for Nonprofits with Tapp NetworkTechSoup
Dive into the world of AI! Experts Jon Hill and Tareq Monaur will guide you through AI's role in enhancing nonprofit websites and basic marketing strategies, making it easy to understand and apply.
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...Dr. Vinod Kumar Kanvaria
Exploiting Artificial Intelligence for Empowering Researchers and Faculty,
International FDP on Fundamentals of Research in Social Sciences
at Integral University, Lucknow, 06.06.2024
By Dr. Vinod Kumar Kanvaria
Normal Labour/ Stages of Labour/ Mechanism of LabourWasim Ak
Normal labor is also termed spontaneous labor, defined as the natural physiological process through which the fetus, placenta, and membranes are expelled from the uterus through the birth canal at term (37 to 42 weeks
This presentation includes basic of PCOS their pathology and treatment and also Ayurveda correlation of PCOS and Ayurvedic line of treatment mentioned in classics.
2. 98 Children's Literature in Education
J. Ward and M. Fox, "A
look at some
outstanding illustrated
books for children," p.
21
A. Ahlberg in E. Moss,
"A certain particularity:
An interview with Janet
and Allan Ahlberg," p.
21
J. H. Miller, Illustration,
p. 95
W. Moebius,
"Introduction to
picturebook codes," p.
143
D. Lewis, "Going along
with Mr. Gumpy:
Polysystemy and play in
the modern picture
book," p. 105
P Nodelman, Words
About Pictures: The
Narrative Art of
Children's
Picturebooks, p. 223
P. Nodelman, Words
About Pictures: The
Narrative Art of
Children's
Picturebooks, p. 221
J. Schwarcz, Ways of
the Illustrator: Visual
Communication in
Children's Literature, p.
15
J. Golden, The
Narrative Symbol in
Children's Literature
P. Nodelman, Words
About Pictures: The
Narrative Art of
Children's
Picturebooks, p. 220
bine to form a complex new pattern. Moebius utilizes geological im-
agery to speak of the "plate tectonics" of text and illustrations.
Various alternative words and concepts seem to be pivotal in other
theorists' description of the text-picture relationship. Lewis uses the
idea of "polysystemy": "the piecing together of text out of different
kinds of signifying systems." Perry Nodelman describes how the text
and pictures "limit" each other, and uses literary terminology to de-
scribe the relationship of text and pictures as one of "irony": The
words and pictures comment ironically on each other, as it were.
Nodelman also discusses Barthes's metaphor of "relaying," writing
that, "Bylimiting each other, words and pictures take on a meaning
that neither possesses without the other—perform the completion of
each other that Barthes calls 'relaying.'" Schwarcz conceives of two
general categories of relationshipsbetween text and pictures: what he
calls "congruency" and "deviation." In the category of congruency,
the text and pictures are in a harmonious relationship. Sometimes the
illustrations complement the text by "running ahead of the text and
pushing the action forward." The text and the illustrations may also
take turns in telling the story; this is what Schwarcz calls "alternate
progress." In deviation, Schwarcz's second category of relationships,
the illustrations "veer away" from the text by opposing it in some
way. Another example of deviation is what Schwarcz calls "counter-
point"—the musical metaphor, again—when the illustrations tell a
different story from the text. Part of the enjoyment of this story lies in
the reader-viewer's perception of both stories at once.
Golden describes five types of relationships between text and pic-
tures: The categories seem to be differentiated by how much "work"
the illustrations or the text do in conveying meaning. One limitation
of this scheme is that, since it depends mainly on the relative amounts
of power the text and the illustrations have, there is less attention to
the dynamic way in which, as Nodelman puts it, "the words change
the pictures and the pictures change the words." The text-picture re-
lationship is not so much a matter of a balance of power as it is the
way in which the text and pictures transact with each other, and
transform each other.
The Synergy of Words and Pictures
My own descriptive term is "synergy," defined by the Shorter Oxford
English Dictionary as "the production of two or more agents, sub-
stances, etc., of a combined effect greater than the sum of their sepa-
rate effects." In a picture book, both the text and the illustration
sequence would be incomplete without the other. They have a syner-
gistic relationship in which the total effect depends not only on the
3. How Picture Books Work 99
W: Iser, The Act of
Reading: A Theory of
Aesthetic Response
P. Nodelman, Words
About Pictures: The
Narrative Art of
Children's Picturebooks
G. E. Lessing, Laocoon:
An Essay on the Limits
of Painting and Poetry
union of the text and illustrations but also on the perceived interac-
tions or transactions between these two parts.
In adding to what these theorists have written about the relationship
of words and pictures in picture books, I will focus on the phenome-
nological dynamics of the synergistic relationship itself. In other
words, I want to try to explain more fully what happens in our
heads: the process we engage in when we relate the verbal and visual
texts of the picture book to each other. In order to do this, I will draw
from literary theories of the type commonly referred to as "reader
response" criticism (Wolfgang Iser), aesthetic criticism (G. E. Lessing
and Wendy Steiner), linguistics and semiotics (Roman Jakobsen and
Charles Peirce), and theories of literacy (Marjorie Siegel, Mark Sa-
doski, and Alan Paivio).
What Wolfgang Iser sees as he examines the reader-text relationship is
a reader participating in the production of textual meaning. The ac-
tual literary work is realized through a convergence of reader and
text. For Iser, the reader acts as co-creator of the work by supplying
that portion of it that is not written but only implied. Each reader fills
in the unwritten work or the "gaps" in his or her own way, thereby
acknowledging the inexhaustibility of the text. Iser's concept of gap-
filling suggests that we can think of readers filling in some of the gaps
in the verbal text of a picture book with information from the illustra-
tions and of readers using information from the verbal text to fill in
some of the gaps in the illustrations.
Nodelman observes that words have a greater potential for conveying
temporal information, whereas pictures have a greater potential for
conveying spatial information. Does this mean that we might process
verbal and visual information in different ways? There is a long tradi-
tion for this idea, beginning with the classic distinction, made by the
German Romantic philosopher G. E. Lessing, between arts that are
based on simultaneity of perception (painting, sculpture) and arts
that are based on time sequence or successivity of perception (music,
literature). Lessing argued that, since our experience of the world has
two components or modes (space and time), all of the arts could be
classified on the basis of which of these two modes were experienced
while the viewer or listener was engaged in a work of art. We see a
painting all at once; but in order to experience literature or music, we
have to read or listen in a linear succession of moments through time.
This raises the question of whether there could be arts that are based
on both time and space—onsimultaneity as well as successivity. Even
in Lessing's time, the opera was an example of such an art form; and
it was because opera combined spatial arts and temporal arts that
Wagner called his operas Gesamtkunstwerke ("assembled" or "put-to-
4. 100 Children's Literature in Education
W. Steiner, The Colors
of Rhetoric, p. 144
gether" works of art). Drama and film are also examples of art forms
that we experience simultaneously in time and space. The picture
book, of course, is another of these hybrid art forms. WendySteiner, a
literary and aesthetic theorist, argues that "the illustrated text is a
Gesamtkunstwerk, a mixture of artistic media epitomized in Wag-
nerian opera," and, like opera, is a "gesture toward semiotic replete-
ness, combining several kinds of sign types and having them com-
ment on each other."
W. Steiner, Pictures of
Romance
R. Jakobsen, "On the
relation between visual
and auditory signs," p.
340
W. Steiner, The Colors
of Rhetoric, p. 37
Wendy Steiner follows Lessing's basic distinction by observing that
the visual arts present us with a diffuse network, whereas temporal
art leads us along a line or chain. The linguist and semiotician Roman
Jakobsen makes a similar point: "Every complex visual sign, for exam-
ple every painting, presents a simultaneity of various components,
whereas the time sequence appears to be the fundamental axis of
speech." Jakobsen goes on to say that speech is not purely temporally
linear, but that the "predominantly sequential character of speech is
beyond doubt, and this primacy of successivity must be analyzed."
Written language is not purely linear, either; when we read, we are
processing ever-greater sequences of letters, words, and sentences as
meaningful wholes, until, finally, we may arrive at an understanding of
the total structure of a poem or story. Nevertheless, to paraphrase
Jakobsen, the predominantly sequential character of written language
is beyond doubt.
Just as written language is not purely linear, painting and the visual
arts are not purely spatial, either. When we look at a painting (or an
illustration in a picture book), we look in a series of temporal mo-
ments at various parts of it. But, as Steiner comments, visual art is
designed "to enlarge our ability to turn sequence into simultaneity, to
allow us to form ever larger temporal flows into unified, atemporal
structures." So, it's not the case that our perception of the image is
static. We do look at the image in a series of temporal moments, but
as we look our minds are forming "ever larger temporal flows into
unified atemporal structures"; thus, to paraphrase Jakobsen once
again, the predominantly simultaneous character of visual art is be-
yond doubt.
The different ways in which we experience written language and vi-
sual art have important implications for the ways in which we try to
relate the words and the pictures in a picture book. Because of the
primarily spatial nature of the pictures and our drive to form "unified
atemporal structures," our tendency is to gaze on, dwell upon, or
contemplate them. In contrast, the primarily temporal nature of the
verbal narrative creates in us a tendency to keep on reading, to keep
5. How Picture Books Work 101
C. S. Lewis, On Stories
and Other Essays on
Literature, p. 17
J. Doonan, Looking at
Pictures in
Picturebooks
P. Pullman, "Invisible
pictures," p. 171
J. L.Lemke,
"Multiplying meaning:
Literacy in a multimedia
world"
M. Meek, "What counts
as evidence in theories
of children's literature,"
p. 174
J. J. Gibson, The Senses
Considered as
Perceptual Systems, p.
285
I. Massey, "Words and
images: Harmony and
dissonance," p. 388
M. Sadoski and A.
Paivio, "A dual coding
view of imagery and
verbal process in
reading
comprehension."
C. Suhor, "Towards a
semiotic-based
curriculum," p. 250
going ahead in what C. S. Lewis termed "narrative lust." There is thus
a tension between our impulse to gaze at the pictures—to forget
about time in creating an "atemporal structure"—andto not interrupt
the temporal narrative flow. The verbal text drives us to read on in a
linear way, where the illustrations seduce us into stopping to look.
This tension results in the impulse to be recursive and reflexive in our
reading of a picture book: to go backward and forward in order to
relate an illustration to the one before or after it, and to relate the text
on one page to an illustration on a previous or successive page; or to
understand new ways in which the combination of the text and pic-
ture on one page relate to preceding or succeeding pages. Picture
books have the effect of "loosening the tyranny of the one-way flow"
of the purely verbal text. Therefore, picture books seem to demand
rereading; we can never quite perceive all the possible meanings of
the text, or all the possible meanings of the pictures, or all the possi-
ble meanings of the text-picture relationships. Lemke observes that, in
illustrated informationaltexts and hypertext, there are "many possible
pathways through the textworld"; this is equally true of the picture
book. Margaret Meek argues that, "Apicture book invites all kinds of
reading and allows the invention of a set of stories rather than a single
story."
The reader/viewer's construction of the relationship of text and pic-
tures is one of the "affordances" of picture books. But how does this
construction proceed? It is an intriguing idea that the interrelation-
ship of words and pictures mirrors the thought process itself. Irving
Massey's assertion that, "Thinking consists of a constant alternation
between image-makingand word-making" is given support in reading
theory by the "dual coding" hypothesis of Mark Sadoski and Alan
Paivio, which suggests that cognition has two separate (though re-
lated) structures: one for processing verbal information (either in
speech or written language) and one for processing nonverbal infor-
mation (such as visual stimuli). Aswe alternate our attention between
words and pictures in a picture book, then, we may be representing
the verbal and nonverbal information in separate cognitive structures;
following this, through the complex referential connections between
these two cognitive structures, we construct an integrated meaning.
A Theory of Transmediation
There is another theory from the field of literacy that may also prove
helpful in understanding how we construct the conversation between
words and pictures. Charles Suhor uses the concept of "transmedia-
tion" or "the translation of content from one sign system into an-
other." This concept of transmediation may be heuristic for under-
6. 102 Children's Literature in Education
M. Siegel, "More than
words: The generative
power of
transmediation for
learning"
C. Peirce, "Logic as
semiotic: The theory of
signs"
standing the process we use in relating words to pictures in picture
books. For in picture books, we must oscillate, as it were, from the
sign system of the verbal text to the sign system of the illustrations;
and also in the opposite direction from the illustration sign system to
the verbal sign system. Whenever we move across sign systems, "new
meanings are produced," because we interpret the text in terms of
the pictures and the pictures in terms of the texts in a potentially
never-ending sequence. Siegel draws from semiotic theory (and partic-
ularly the work of Charles Peirce) to explain the way in which we
move across sign systems. For Peirce, a process of using signs consists
of three parts: the sign itself, or representamen; the equivalent sign
(called the interpretant) in the receiver of the sign; and the object for
which the sign stands. The relationship among these three parts is
usually represented visually by a triangle, called a semiotic triad:
M. Siegel, "More than
words: The generative
power of
transmediation for
learning," p. 10
M. Siegel, "More than
words: The generative
power of
transmediation for
learning," p. 12
Thus, the sign or representamen "does not simply stand for an object,
but tells something about the meaning of that relationship and this
requires a third component, which he called an interpretant. The in-
terpretant is another sign that represents the same object as the repre-
sentamen, as its position in the semiotic triad indicates." According to
Siegel, what happens in transmediation, when we move from one sign
system to another, is that "an entire semiotic triad serves as the object
of another triad and the interpretant for this new triad must be repre-
sented in the new sign system." In terms of what happens in picture
books, we have two sign systems, and therefore two sets of triads:
When we interpret the words in terms of the pictures, or move from
the sign system of the words to the sign system of the pictures, the
semiotic triad with the words as representamen becomes the object
of a new triad, and the interpretant for this new triad changes accord-
ingly:
7. How PictureBooks Work
Conversely, when we interpret the pictures in terms of the words, or
move from the sign system of the pictures to the sign system of the
words, the semiotic triad with the pictures as representamen be-
comes the object of a new triad, and the interpretant for this new
triad changes as well:
The resulting process is a type of oscillation, as we adjust our inter-
pretation of the pictures in terms of the words, and our interpretation
of the-words in terms of the pictures. And, because the meanings of
the signs are always shifting (due to their adjustment and readjust-
ment as each triad becomes the object in a new triad), this oscillation
is never-ending. The possibilities of meaning in the word-picture rela-
tionship are inexhaustible.
Words and Pictures in Where the Wild Things Are
To concretize all these abstractions and to elucidate the theory more
completely, I will analyze a few of the possible semiotic triads in the
text and pictures of the ninth opening of Where the Wild Things Are.
The analysis is necessarily distorting and artificial, because it renders
in laborious slow motion a process that in practice happens very
quickly. It does, however, allow us to tease out an explanation of the
steps in our meaning making. The text of this double-page spread
reads,
103
M. Sendak, Where the
Wild Things Are
8. Children's Literature in Education
And when he came to the place where the wild things are/they roared
their terrible roars and gnashed their terrible teeth/and rolled their ter-
rible eyes and showed their terrible claws.
Let us first consider the text alone, without reference to the illustra-
tion.
As we come to this point in the text, Sendak has carefully built our
anticipation during the eight previous double-page spreads. Before we
even opened the book, the title and the cover incited us to predict
some encounters with "wild things," and the vagueness of that phrase
may have triggered all sorts of speculation about what these "things"
will look like and how they will behave. The growth of the magical
forest, which "grew/and grew—/and grew" has been stretched out
over three openings, an ocean has "tumbled by" with a "private boat,"
and Max has sailed "in and out of weeks and almost over a year." Now
the text tells us that Max has finally "c[o]me to the place." The four
phrases
—roared their terrible roars
—and gnashed their terrible teeth
—and rolled their terrible eyes
—and showed their terrible claws
are representamens of objects for which our overall interpretant, if
put into words, might be "horrific, savage monsters," with razor-sharp
teeth and claws, and wickedly cruel eyes. The representamens (Sen-
dak's words) allow us to construct this overall interpretant through
their communication of sound (roars and gnashing), sight (teeth,
eyes, and claws), and motion (eye-rolling and gesture), as well as our
interpretation of the word "terrible." The fourfold repetition of this
word accentuates the monsters' frightfulness. Our interpretant of
these representamens may also include the inference that Max must
be very frightened.
Now we uncover the illustration and attempt to disregard the text.
The illustration contains many representamens of many objects. What
is our interpretant of some of them? Max and his boat are on the
extreme left, and we would normally look at him first, since our pro-
pensity is to "read" illustrations from left to right. In this case, how-
ever, it is probably the four wild things that first catch our eye. They
are constructed primarily of curves and rounded shapes. Their claws
(which resemble those on Max's outfit), their horns, and even their
teeth are slightly curved. Their bodies are the round shapes of stuffed
animals. One of the wild things wears a child's striped T-shirt and has
a tail like the one on Max's wolf suit. Another has chicken-like legs
and feet. The pads on the other wild things' feet and paws are puffy
104
9. How Picture Books Work
and soft brown. The colors of their fur and faces are pastel and
muted. The strongest color is the yellow of their eyes, which is only a
bit more intense than the color of the rest of their faces and bodies.
The wild things' hair looks soft and strokable, and they stand on soft
green grass. The two wild things on the right-hand page can only be
described as chubby. Their faces are humanoid (with broad, pudgy
noses) and they stand upright. The wild thing nearest Max is perhaps
the most formidableof the four: It is the most animal-likein its stance,
and its face is more beastlike. It has an open mouth, red and lined
with teeth. It has the longest claws, three horns, and a lion-like mane.
Yet if it is so fierce, why has it allowed the smaller, goat-like wild
thing to sit on its back? Why is its tail dragging on the ground, instead
of quivering upright?If we turn our attention to Max,a glance assures
us that he is not at all cowed by these beasts, even by the one closest
to him. The expression on his face is one of disdain or exasperation,
not fear. His hand is rebelliously on his hip, reminding us of his atti-
tude in the third opening, where he was angry at his mother. The
overall interpretant for this visual image, then, might be "mild men-
ace, but nothing Max can't handle."
Having constructed interpretants for the two semiotic triads, we are
now ready to move between the visual and the verbal sign systems.
According to the theory of transmediation, in the movement from one
sign system to another, "an entire semiotic triad serves as the object
of another triad and the interpretant for this new triad must be repre-
sented in the new sign system." Let us take the picture triad as the
object of the new triad we will build:
In this new triad, the new object to which the text refers is the entire
picture triad we have previously constructed. The text is the repre-
sentamen for this new object (or set of objects). We must therefore
construct a new interpretant of the representamen (the text) since
the representamen is now the referent for a new object. A "think-
aloud" for this process of constructing a new interpretant for the text
in light of the pictures might go something like this:
105
10. Children's Literature in Education
The text reads, "they roared their terrible roars"; but the mouths of
two of the wild things are tightly closed, and the other two don't have
their mouths open wide enough to make a terribly loud roar. The
wild things are supposed to gnash their terrible teeth and show their
terrible claws; but their teeth, being curved, are not so terrible. Nei-
ther are their claws, and I don't see any teeth being gnashed together.
The wild things' eyes are almost circular, more like the glass orbs of
stuffed toys than the eyes of fierce beasts. So I'll have to modify my
interpretation of the words in the light of the pictures. There's menace
here, especially in the creature closest to Max, but Max doesn't seem
to befrightened out of his wits.
To complete this analysis, let us consider going in the other direction:
constructing a new interpretant for the pictures when the object they
represent is the textual triad:
106
A think-aloud in this case might be as follows:
Max doesn't seem frightened and the wild things (for many reasons)
don't seem all that threatening. But the text says that they roared and
gnashed their teeth and showed their claws. Those claws and teeth
might not be needle-sharp, but they could probably still inflict some
pretty terrible damage. And just because the beasts' mouths are either
closed or only slightly open doesn't mean that they can't open them
wide and let out a terrible roar. I wouldn't want to be caught in a
dark alley with any of them, especially with the one who's closest to
Max; that guy's paws are bigger than Max's whole head, and that
rhinoceros horn looks dangerously sharp. Those horns look like
devil's horns, so maybe they are terrible after all, and maybe Max is
just too dumb to know the trouble he's in.
So this transmediation goes back and forth—oscillates—in a poten-
tially endless process. Each new page opening presents us with a new
set of words and new illustrations to factor into our construction of
meaning. Reviewing and rereading will produce ever-new insights as
we construct new connections and make modifications of our pre-
vious interpretations, in a Piagetian process of assimilation and accom-
modation. In other words, we assimilate new information and in the
process we change our cognitive structures, accommodating them to
the new information.
11. How Picture Books Work
In this article, I have attempted to use the semiotic theory of trans-
mediation to unfold the text-picture relationship; and I have used
Where the Wild Things Are as an example to explicate the theory. I
have argued that transmediation is a more precise way of looking at
the text-picture relationship because it allows us to analyze the phe-
nomenological process of relating words and pictures. Transmediation
also makes it clear that visual texts are on an equal footing with verbal
texts. It seems necessary, in the logocentric society that we live in
today, to make this point and emphasize the significance of picture
books in children's learning. Picture books, through transmediation,
give children the opportunity to engage in an unending process of
meaning making as every rereading brings about new ways of looking
at words and pictures. In other words, picture books allow children
to have multiple experiences as they engage in creating new mean-
ings and constructing new worlds.
References
Cech, J., "Remembering Caldecott: 'The Three Jovial Huntsmen' and the art of
the picturebook," The Lion and the Unicorn, 1983-84, 7/8, 110-119.
Doonan, J., Looking at Pictures in Picturebooks. Stroud., Glos: The Thimble
Press, 1993.
Gibson, J., The Senses Considered as Perceptual Systems. Boston: Houghton
Mifflin, 1966.
Golden, J., The Narrative Symbol in Children's Literature. New York:
Mouton de Gruyter, 1990.
Iser, W.,A Theory of Aesthetic Response. Baltimore, MD:Johns Hopkins Uni-
versity Press.
Jakobsen, R., "On the relation between visual and auditory signs," Selected
Writings II: Word and Language. The Hague: Mouton, 1971.
Lemke, J. L., "Multiplying meaning: Literacy in a multimedia world," National
Reading Conference, Charleston, SC, December 1993.
Lessing, G. E., Laocoon:An Essay on the Limits of Painting and Poetry, E.A.
McCormick, trans. Baltimore, MD: Johns Hopkins University Press.
Lewis, C. S., On Stories: And Other Essays on Literature, New York: Harcourt
Brace Jovanovich, 1982.
Lewis, D., "Going along with Mr.Gumpy: Polysystemy and play in the modern
picture book," Signal, 1996, 80, 105-119.
Massey I., "Words and images: Harmony and dissonance," Georgia Review,
1980, 34, 375-395.
Meek, M., "What counts as evidence in theories of children's literature," in
Children's Literature: The Development of Criticism, P. Hunt, ed. New
York: Routledge, 1992.
Miller, J. H., Illustration. Cambridge, MA:Harvard University Press, 1992.
Moebius, W, "Introduction to picturebook codes," Word & Image, 1986, 2
(2), 141-158.
Moss, E., "Acertain particularity: An interview with Janet and Allen Ahlberg,"
Signal, 1990, 61.
107
12. Children's Literature in Education
Nodelman, P., Words About Pictures: The Narrative Art of Children's Picture
Books. Athens: University of Georgia Press, 1988.
Peirce, C. S., "Logic as semiotic: The theory of signs," in Philosophical Writ-
ings of Pierce,J. Buchler, ed., pp. 98-119. New York: Dover Press.
Pullman, P., "Invisible pictures," Signal, 1989, 60, 160-186.
Sadoski, M., and Paivio, A., "A dual coding view of imagery and verbal process
in reading comprehension," in Theoretical Models and Processes of Read-
ing, 4th ed., R. Ruddell, M. Ruddell, and H. Singer, eds. Newark, DE: Inter-
national Reading Association, 1994.
Steiner, W., The Colors of Rhetoric. Chicago: The University of Chicago Press,
1982.
Steiner, W., Pictures of Romance. Chicago: The University of Chicago Press,
1988.
Schwarcz, J., Ways of the Illustrator. Visual Communication in Children's
Literature. Chicago: American Library Association, 1982.
Siegel, M., "More than words: The generative power of transmediation for
learning," Canadian Journal of Education, 1995, 20(4), 455-475.
Suhor, C., "Towards a semiotics-based curriculum," Journal of Curriculum
Studies, 1984, 16, 247-257.
Ward, J., and Fox, M., "A look at some outstanding illustrated books for chil-
dren," Children's Literature Association Quarterly, 1984, 9 (1), 19-21.
108