Jobtalk 2014 - multimodality, DH

M
Multimodal scholarship 
walk-in books 
& the digital humanities 
Helen J Burgess 
polyrhetor@gmail.com
“Cyborg politics is the 
struggle for language and 
the struggle against perfect 
communication, against the 
one code that translates all 
meaning perfectly.” 
-- Donna Haraway
Small tent: TEI, working with manuscripts and 
archives, digitizing 
Big tent: data and text mining, visualization, 
electronic scholarship and editorial work 
Circus tent: e-lit, art installations, critical making, 
experiments with electronics
Editorial work 
Technical & advisory editor, Rhizomes: Cultural Studies in Emerging 
Knowledge. [ rhizomes.net ] 
Editor, Hyperrhiz: New Media Cultures. [ hyperrhiz.net ] 
Multimedia Work 
Red Planet: Scientific & Cultural Encounters with Mars. 2000, DVD-Rom. 
Biofutures: Owning Body Parts & Information. 2008, DVD-Rom. 
Highways of the Mind. 2014, interactive iBook.
Medium: (nonneutral) transportation mechanism for 
conveyance of information. Concerned with technological 
underpinnings of expression. 
Modality: mode of expression (what senses are you engaging? 
Touch? Vision? Aural?). Utilizing multiple media but also 
concerned with process & composing choices.
Jobtalk 2014 - multimodality, DH
“… we’re entering a time when sound, light and 
movement are equally important parts of the 
creative palette. Everyday objects whose 
expressive elements have long been static will 
now glow, sing, vibrate and change position at 
the drop of a hat.” 
(NYT, Carla Diana, “Talking, Walking Objects,” Jan. 26 2013.)
Small tent - how can it be preserved? 
Big tent - how can it be interrogated? 
Circus tent - how can it be other?
 How can scholarship be “other,” using 
multimodal techniques? 
 How can a text be “other” than what it is?
Jobtalk 2014 - multimodality, DH
Jobtalk 2014 - multimodality, DH
Jobtalk 2014 - multimodality, DH
Jobtalk 2014 - multimodality, DH
Jobtalk 2014 - multimodality, DH
(Edgar Barrier of 
Mercury Theater, the 
voice of the Polyrhetor. 
Who wouldn’t trust a 
voice that looked like 
that?)
Jobtalk 2014 - multimodality, DH
Artist’s model of a “Turing machine,” Mike Davey
 “Presumably the child brain is something like 
a notebook as one buys it from the 
stationer's. Rather little mechanism, and lots 
of blank sheets. (Mechanism and writing are 
from our point of view almost synonymous.)” 
[Turing, A.M. (1950). Computing 
machinery and intelligence. Mind, 59, 433- 
460.]
Jobtalk 2014 - multimodality, DH
 Enhanced iBook 
 Each chapter contains 
four threads: 
 Context 
 Chronotope 
 Specters 
 Machines 
 Read by chapter or 
by individual thread
Context 
-- documents and film showing the 
world’s fair and futurama exhibits 
-- 3D printable model cars from the 
exhibit 
Specters 
-- model of the Polyrhetor, sound 
recordings 
-- chair and speaker to simulate the oral 
experience 
Chronotope 
-- maps and diorama models of the 
spaces of the fair 
-- Google API maps of the interstate 
system over time 
Machine 
-- electronic workbench for assembling 
different interactive devices
Jobtalk 2014 - multimodality, DH
Jobtalk 2014 - multimodality, DH
“Significantly, what artists say and write about their 
own work remains an area of considerable 
controversy, especially among practicing artists: the 
modernist proposition of art speaking for itself lingers 
as a deeply-held, shared assumption for many, even 
those working within a postmodern aesthetic.” 
--W.F. Garrett-Petts and Rachel Nash
Jobtalk 2014 - multimodality, DH
Search online for information about yourself 
and your demographic; create a meaningful 
biography from that information. 
Skills: 
1) Content analysis 
2) Narrative & metaphor 
3) Distal (far) and proximal (near) sources
Jobtalk 2014 - multimodality, DH
Jobtalk 2014 - multimodality, DH
Jobtalk 2014 - multimodality, DH
The assignment: create a biography of a 
famous person using no words. 
Key concept: “dimensionality” (Edward Tufte). 
Skill: layering and separation of information 
into different dimensions in the project. 
Genre of writing: ekphrasis.
Jobtalk 2014 - multimodality, DH
Jobtalk 2014 - multimodality, DH
Jobtalk 2014 - multimodality, DH
Jobtalk 2014 - multimodality, DH
Jobtalk 2014 - multimodality, DH
A four-part assignment sequence in which a 
Shakespearean sonnet is reinterpreted in 
various forms according to the prompt: 
1) Visual imagery 
2) Sonnet structure & scansion 
3) Encoding and decoding with a key 
4) A “kit” for assembling a version of the 
sonnet with a program, recipe or other kind 
of instructional document.
Not from the stars do I my judgment pluck, 
And yet methinks I have astronomy; 
But not to tell of good or evil luck, 
Of plagues, of dearths, or seasons' quality; 
Nor can I fortune to brief minutes tell, 
Pointing to each his thunder, rain, and wind, 
Or say with princes if it shall go well 
By oft predict that I in heaven find. 
But from thine eyes my knowledge I derive, 
And, constant stars, in them I read such art 
As truth and beauty shall together thrive 
If from thyself to store thou wouldst convert: 
Or else of thee this I prognosticate, 
Thy end is truth's and beauty's doom and date.
Jobtalk 2014 - multimodality, DH
Jobtalk 2014 - multimodality, DH
Jobtalk 2014 - multimodality, DH
Jobtalk 2014 - multimodality, DH
Jobtalk 2014 - multimodality, DH
Jobtalk 2014 - multimodality, DH
Jobtalk 2014 - multimodality, DH
Jobtalk 2014 - multimodality, DH
 Installation project on cryptography and 
secret writing: “The Numbers Stations.” 
 Hyperrhiz 13: Special Issue: “Objects.” 
 Teaching: implementing “kits for culture” in 
the classroom.
Jobtalk 2014 - multimodality, DH
1 of 47

Recommended

M A R K E T I N G I L P O P O L O D E L L A N O T T E by
M A R K E T I N G    I L  P O P O L O  D E L L A  N O T T EM A R K E T I N G    I L  P O P O L O  D E L L A  N O T T E
M A R K E T I N G I L P O P O L O D E L L A N O T T EFrancesco Lamacchia
880 views44 slides
Students From Edremit, Turkey by
Students From Edremit, TurkeyStudents From Edremit, Turkey
Students From Edremit, Turkey5elizabeth
335 views13 slides
Sonnet by
SonnetSonnet
Sonnetmediagrrl
2.1K views28 slides
Projeto Forte by
Projeto ForteProjeto Forte
Projeto ForteCarlos Tesore
349 views6 slides
Understanding Near-Duplicate Videos: A User-Centric Approach by
Understanding Near-Duplicate Videos: A User-Centric ApproachUnderstanding Near-Duplicate Videos: A User-Centric Approach
Understanding Near-Duplicate Videos: A User-Centric ApproachMauro Cherubini
906 views27 slides
Text versus Speech: A Comparison of Tagging Input Modalities for Camera Phones by
Text versus Speech: A Comparison of Tagging Input Modalities for Camera PhonesText versus Speech: A Comparison of Tagging Input Modalities for Camera Phones
Text versus Speech: A Comparison of Tagging Input Modalities for Camera PhonesMauro Cherubini
561 views27 slides

More Related Content

Similar to Jobtalk 2014 - multimodality, DH

ARIN2600 2009 L6 Space by
ARIN2600 2009  L6  SpaceARIN2600 2009  L6  Space
ARIN2600 2009 L6 SpaceChris Chesher
792 views23 slides
New Media New Technology 2011 - Back to the future by
New Media New Technology 2011 - Back to the futureNew Media New Technology 2011 - Back to the future
New Media New Technology 2011 - Back to the futurePeter Van Der Putten
8 views33 slides
Digital Pretext: DramaPlayshop by
Digital Pretext: DramaPlayshopDigital Pretext: DramaPlayshop
Digital Pretext: DramaPlayshopKim Flintoff
799 views46 slides
Tm keynote by
Tm keynoteTm keynote
Tm keynoteJack Park
131 views54 slides
The Virtual Memory Palace by
The Virtual Memory PalaceThe Virtual Memory Palace
The Virtual Memory PalaceRichard Smyth
598 views21 slides
Jyväskylä 15/04/2013 talk: the body and the brain… by
Jyväskylä 15/04/2013 talk: the body and the brain…Jyväskylä 15/04/2013 talk: the body and the brain…
Jyväskylä 15/04/2013 talk: the body and the brain…University of South Australlia
517 views45 slides

Similar to Jobtalk 2014 - multimodality, DH(20)

Digital Pretext: DramaPlayshop by Kim Flintoff
Digital Pretext: DramaPlayshopDigital Pretext: DramaPlayshop
Digital Pretext: DramaPlayshop
Kim Flintoff799 views
Tm keynote by Jack Park
Tm keynoteTm keynote
Tm keynote
Jack Park131 views
The Virtual Memory Palace by Richard Smyth
The Virtual Memory PalaceThe Virtual Memory Palace
The Virtual Memory Palace
Richard Smyth598 views
ELO Sonnet by mediagrrl
ELO SonnetELO Sonnet
ELO Sonnet
mediagrrl785 views
From digital to physical and back by Mirko Daneluzzo
From digital to physical and backFrom digital to physical and back
From digital to physical and back
Mirko Daneluzzo419 views
Improvising The Internet: The epistemic cultures of Hackers, Snowboarders and... by Trond Arne Undheim
Improvising The Internet: The epistemic cultures of Hackers, Snowboarders and...Improvising The Internet: The epistemic cultures of Hackers, Snowboarders and...
Improvising The Internet: The epistemic cultures of Hackers, Snowboarders and...
Trond Arne Undheim883 views
Narrative structures for new media by Asli Budak
Narrative structures for new mediaNarrative structures for new media
Narrative structures for new media
Asli Budak598 views
Cyberspace før og nå (8390 KB) by Videoguy
Cyberspace før og nå (8390 KB)Cyberspace før og nå (8390 KB)
Cyberspace før og nå (8390 KB)
Videoguy242 views
Data Harmonisation for Ethical Collaborative Research: The ResearchSpace Project by Dominic Oldman
Data Harmonisation for Ethical Collaborative Research:The ResearchSpace ProjectData Harmonisation for Ethical Collaborative Research:The ResearchSpace Project
Data Harmonisation for Ethical Collaborative Research: The ResearchSpace Project
Dominic Oldman594 views
Electronic literature and its place in digital library by Alexandr Belov
Electronic literature and its place in digital libraryElectronic literature and its place in digital library
Electronic literature and its place in digital library
Alexandr Belov629 views
The World of Digital Humanities : Digital Humanities in the World by Edward Vanhoutte
The World of Digital Humanities : Digital Humanities in the WorldThe World of Digital Humanities : Digital Humanities in the World
The World of Digital Humanities : Digital Humanities in the World
Edward Vanhoutte4.1K views
Armchair Astronauts: The PDXDMC Bootcamp by Neologic
Armchair Astronauts: The PDXDMC BootcampArmchair Astronauts: The PDXDMC Bootcamp
Armchair Astronauts: The PDXDMC Bootcamp
Neologic770 views
Tech2002lecweekseven0809 by The_Joker
Tech2002lecweekseven0809Tech2002lecweekseven0809
Tech2002lecweekseven0809
The_Joker690 views

Recently uploaded

Jibachha publishing Textbook.docx by
Jibachha publishing Textbook.docxJibachha publishing Textbook.docx
Jibachha publishing Textbook.docxDrJibachhaSahVetphys
51 views14 slides
STRATEGIC MANAGEMENT MODULE 1_UNIT1 _UNIT2.pdf by
STRATEGIC MANAGEMENT MODULE 1_UNIT1 _UNIT2.pdfSTRATEGIC MANAGEMENT MODULE 1_UNIT1 _UNIT2.pdf
STRATEGIC MANAGEMENT MODULE 1_UNIT1 _UNIT2.pdfDr Vijay Vishwakarma
70 views68 slides
Pharmaceutical Inorganic chemistry UNIT-V Radiopharmaceutical.pptx by
Pharmaceutical Inorganic chemistry UNIT-V Radiopharmaceutical.pptxPharmaceutical Inorganic chemistry UNIT-V Radiopharmaceutical.pptx
Pharmaceutical Inorganic chemistry UNIT-V Radiopharmaceutical.pptxMs. Pooja Bhandare
113 views51 slides
GCSE Geography by
GCSE GeographyGCSE Geography
GCSE GeographyWestHatch
45 views32 slides
Recap of our Class by
Recap of our ClassRecap of our Class
Recap of our ClassCorinne Weisgerber
88 views15 slides
Relationship of psychology with other subjects. by
Relationship of psychology with other subjects.Relationship of psychology with other subjects.
Relationship of psychology with other subjects.palswagata2003
52 views16 slides

Recently uploaded(20)

Pharmaceutical Inorganic chemistry UNIT-V Radiopharmaceutical.pptx by Ms. Pooja Bhandare
Pharmaceutical Inorganic chemistry UNIT-V Radiopharmaceutical.pptxPharmaceutical Inorganic chemistry UNIT-V Radiopharmaceutical.pptx
Pharmaceutical Inorganic chemistry UNIT-V Radiopharmaceutical.pptx
Ms. Pooja Bhandare113 views
GCSE Geography by WestHatch
GCSE GeographyGCSE Geography
GCSE Geography
WestHatch45 views
Relationship of psychology with other subjects. by palswagata2003
Relationship of psychology with other subjects.Relationship of psychology with other subjects.
Relationship of psychology with other subjects.
palswagata200352 views
A-Level Art by WestHatch
A-Level ArtA-Level Art
A-Level Art
WestHatch46 views
REPRESENTATION - GAUNTLET.pptx by iammrhaywood
REPRESENTATION - GAUNTLET.pptxREPRESENTATION - GAUNTLET.pptx
REPRESENTATION - GAUNTLET.pptx
iammrhaywood138 views
Narration lesson plan by TARIQ KHAN
Narration lesson planNarration lesson plan
Narration lesson plan
TARIQ KHAN61 views
Classification of crude drugs.pptx by GayatriPatra14
Classification of crude drugs.pptxClassification of crude drugs.pptx
Classification of crude drugs.pptx
GayatriPatra14101 views
Retail Store Scavenger Hunt.pptx by jmurphy154
Retail Store Scavenger Hunt.pptxRetail Store Scavenger Hunt.pptx
Retail Store Scavenger Hunt.pptx
jmurphy15446 views

Jobtalk 2014 - multimodality, DH

  • 1. Multimodal scholarship walk-in books & the digital humanities Helen J Burgess polyrhetor@gmail.com
  • 2. “Cyborg politics is the struggle for language and the struggle against perfect communication, against the one code that translates all meaning perfectly.” -- Donna Haraway
  • 3. Small tent: TEI, working with manuscripts and archives, digitizing Big tent: data and text mining, visualization, electronic scholarship and editorial work Circus tent: e-lit, art installations, critical making, experiments with electronics
  • 4. Editorial work Technical & advisory editor, Rhizomes: Cultural Studies in Emerging Knowledge. [ rhizomes.net ] Editor, Hyperrhiz: New Media Cultures. [ hyperrhiz.net ] Multimedia Work Red Planet: Scientific & Cultural Encounters with Mars. 2000, DVD-Rom. Biofutures: Owning Body Parts & Information. 2008, DVD-Rom. Highways of the Mind. 2014, interactive iBook.
  • 5. Medium: (nonneutral) transportation mechanism for conveyance of information. Concerned with technological underpinnings of expression. Modality: mode of expression (what senses are you engaging? Touch? Vision? Aural?). Utilizing multiple media but also concerned with process & composing choices.
  • 7. “… we’re entering a time when sound, light and movement are equally important parts of the creative palette. Everyday objects whose expressive elements have long been static will now glow, sing, vibrate and change position at the drop of a hat.” (NYT, Carla Diana, “Talking, Walking Objects,” Jan. 26 2013.)
  • 8. Small tent - how can it be preserved? Big tent - how can it be interrogated? Circus tent - how can it be other?
  • 9.  How can scholarship be “other,” using multimodal techniques?  How can a text be “other” than what it is?
  • 15. (Edgar Barrier of Mercury Theater, the voice of the Polyrhetor. Who wouldn’t trust a voice that looked like that?)
  • 17. Artist’s model of a “Turing machine,” Mike Davey
  • 18.  “Presumably the child brain is something like a notebook as one buys it from the stationer's. Rather little mechanism, and lots of blank sheets. (Mechanism and writing are from our point of view almost synonymous.)” [Turing, A.M. (1950). Computing machinery and intelligence. Mind, 59, 433- 460.]
  • 20.  Enhanced iBook  Each chapter contains four threads:  Context  Chronotope  Specters  Machines  Read by chapter or by individual thread
  • 21. Context -- documents and film showing the world’s fair and futurama exhibits -- 3D printable model cars from the exhibit Specters -- model of the Polyrhetor, sound recordings -- chair and speaker to simulate the oral experience Chronotope -- maps and diorama models of the spaces of the fair -- Google API maps of the interstate system over time Machine -- electronic workbench for assembling different interactive devices
  • 24. “Significantly, what artists say and write about their own work remains an area of considerable controversy, especially among practicing artists: the modernist proposition of art speaking for itself lingers as a deeply-held, shared assumption for many, even those working within a postmodern aesthetic.” --W.F. Garrett-Petts and Rachel Nash
  • 26. Search online for information about yourself and your demographic; create a meaningful biography from that information. Skills: 1) Content analysis 2) Narrative & metaphor 3) Distal (far) and proximal (near) sources
  • 30. The assignment: create a biography of a famous person using no words. Key concept: “dimensionality” (Edward Tufte). Skill: layering and separation of information into different dimensions in the project. Genre of writing: ekphrasis.
  • 36. A four-part assignment sequence in which a Shakespearean sonnet is reinterpreted in various forms according to the prompt: 1) Visual imagery 2) Sonnet structure & scansion 3) Encoding and decoding with a key 4) A “kit” for assembling a version of the sonnet with a program, recipe or other kind of instructional document.
  • 37. Not from the stars do I my judgment pluck, And yet methinks I have astronomy; But not to tell of good or evil luck, Of plagues, of dearths, or seasons' quality; Nor can I fortune to brief minutes tell, Pointing to each his thunder, rain, and wind, Or say with princes if it shall go well By oft predict that I in heaven find. But from thine eyes my knowledge I derive, And, constant stars, in them I read such art As truth and beauty shall together thrive If from thyself to store thou wouldst convert: Or else of thee this I prognosticate, Thy end is truth's and beauty's doom and date.
  • 46.  Installation project on cryptography and secret writing: “The Numbers Stations.”  Hyperrhiz 13: Special Issue: “Objects.”  Teaching: implementing “kits for culture” in the classroom.

Editor's Notes

  1. While “multimedia” is used more frequently in public/industry contexts, “multimodal” is preferred in the field of composition and rhetoric. This preference for terms can be best explained by understanding the differences in how texts are valued and evaluated in these contexts. “Multimodal” is a term valued by instructors because of its emphasis on design and process, whereas “multimedia” is valued in the public sphere because of its emphasis on the production of a deliverable text. (Claire Lauer)