SlideShare a Scribd company logo
1 of 26
BOUTIQUE BIG DATA
Reintegrating Close and Distant Reading of 19th-Century Newspapers
M. H. Beals (ORCID: 0000-0002-2907-3313)
Loughborough University
@MHBEALS
THE HISTORICAL PROBLEM
Image Courtesy of Mike Licht (CC BY) at https://www.flickr.com/photos/notionscapital/2313507405
• Culture of Reprinting in 18th and 19th Centuries
• Inconsistent Attribution
• Inconsistent Survival of Network Components
• Limited Historiographical Resources
SEARCH AND TRANSCRIBE
Left Image Courtesy of Dan Tantrum (CC BY NC ND) at https://www.flickr.com/photos/tantrum_dan/2344581860
COPYFIND REPRINT DETECTION
• Freeware Programme Developed by Lou Bloomfield
http://plagiarism.bloomfieldmedia.com/z-wordpress/software/copyfind/
• Highly Customisable Search As Well as Open Source
• Measures Left, Right and Overall Matches
• Displays Left-Right Comparisons of Text
Image Courtesy of the Lou Bloomfield at http://rabi.phys.virginia.edu/lab3e/
COPYFIND IN OCR CORPORA
• Freeware Programme Developed by Lou Bloomfield (University of Virginia)
• Highly Customisable Search Parameters
• Measures Left, Right and Overall Matches
• Displays Left-Right Comparisons of Text
• Extremely Effective at Discovering OCR-Transcribed Matches
1810 1811 1812 1813
1814 1815 1816 1817
ESTABLISHING LIKELY CANDIDATES
• Single Year (1810) Contained over 200,000 Possible Matches
• Removed Internal (Same Title) Reprints
• Restricted Match Size (90 Right, 90 Left or 160 Overall)
• Restricted Date Separation (200 Days)
COMPARING DATABASES
• Historical Networks Bear Little
Resemblance to Digitsed Corpora
• Undigitised Collections Require
Manual Discovery and Transcription
• Paywalled Collections (Currently)
Require Search-and-Transcribe Inclusion
• Overcoming Political and
Linguistic Divisions
ADVERTISEMENTS
• Reprinted in Same Title
• Reprinted in Other Titles
• Reprinted with Minor Variations
• Reprinted after Long Periods
• Similar Wording in Different Adverts
• Own Networks Ripe for Analysis!
DIRECTIONALITY
• Reprint Maps are Non-Linear, Similar
to Phytogenic Trees
• Paths of Specific Branches Dictated
by Date, Content, Errors
• Similar Method to Meme-Tracking
(Adamic et al, 2014)
• Attributions Are Often Red Herrings
ANOTHER DREADFUL MASSACRE…
Times Courier
Star
St. James Chronicle
Sydney Gazette
Morning Chronicle
Caledonian Mercury
Aberdeen Journal
AN AFFECTING INSTANCE OF SELF-MURDER
Coroner’s Inquest.–At half past two o’clock yesterday, an
Inquest was held at the Nag’s Head, Orange-court,
Leicester-fields, before Anthony Gell, Esq. Coroner for
Westminster, on the body of Madamoiselle Ann Paris, then
lying dead at No. 4, St. Martin’s-street, Leicester-fields.
Morning Chronicle (London, England, United Kingdom), 06 January 1810, p. 3,
available at the Scissors and Paste Database,
http://www.scissorsandpaste.net/381.
Trewman’s Exeter Flying Post (Exeter, England, United Kingdom), 11 January 1810,
p. 2, available at the Scissors and Paste Database,
http://www.scissorsandpaste.net/379.
Examiner (London, England, United Kingdom), 17 January 1810, p. 15, 16, available
at the Scissors and Paste Database, http://www.scissorsandpaste.net/380.
DIRECTIONALITY
Perfect Match Overall Match Copy Original Reprint ID
559 (82% L, 31% R) 559 (82%) L; 559 (31%) R 1810-01-11_Trewman's Exeter Flying Post_379.txt 1810-01-06_Morning Chronicle_381.txt
381379
992 (96% L, 56% R) 992 (96%) L; 992 (56%) R 1810-01-17_Examiner_380.txt 1810-01-06_Morning Chronicle_381.txt
381380
Perfect Match Overall Match View Both Files File L File R
559 (82% L, 31% R) 559 (82%) L; 559 (31%) R Side-by-Side 1810-01-11_Trewman's Exeter Flying Post_379.txt 1810-01-06_Morning Chronicle_381.txt
992 (96% L, 56% R) 992 (96%) L; 992 (56%) R Side-by-Side 1810-01-17_Examiner_380.txt 1810-01-06_Morning Chronicle_381.txt
533 (51% L, 78% R) 533 (51%) L; 533 (78%) R Side-by-Side 1810-01-17_Examiner_380.txt 1810-01-11_Trewman's Exeter Flying Post_379.txt
559 (82% L, 31% R) 559 (82%) L; 559 (31%) R 1810-01-06_Morning Chronicle_381 1810-01-11_Trewman's Exeter Flying Post_379 381379
9923 3854
Type Subtype Text Copy Text Original Characters Removed Characters Added % Original % Copy
Style Capitalisation CORONER'S INQUEST Coroner's Inquest 17 17 0.34% 0.44%
Truncation Text At half past two o'clock yesterday 6919 0 69.73% 0.02%
Addition Text An inquest was held yesterday evening 0 853 8.60% 22.14%
Style Punctuation . .-- 3 1 0.04% 0.03%
Style Punctuation ; , 1 1 0.02% 0.03%
Style Punctuation , 0 1 0.01% 0.03%
Style Spelling te ea 2 2 0.04% 0.05%
Style Punctuation , 1 0 0.01% 0.00%
Style Punctuation , 1 0 0.01% 0.00%
Style Punctuation , : 1 1 0.02% 0.03%
Style Punctuation , 1 0 0.01% 0.00%
Style Punctuation , : 1 1 0.02% 0.03%
Style Punctuation , 0 1 0.01% 0.03%
78.86% 22.80%
DIRECTIONALITY
992 (96% L, 56% R) 992 (96%) L; 992 (56%) R 1810-01-17_Examiner_380.txt 1810-01-06_Morning Chronicle_381.txt 381380
5749 9923
Type Subtype Text Original Text Copy Characters Removed Characters Added % Original % Copy
Truncation Text Coroner's Inquest.--At half past two 55 0 0.55% 0.96%
Addition Text On Friday, 0 10 0.10% 0.17%
Truncation Text Orange-court, 13 0 0.13% 0.23%
Truncation Text before Anthony Gell, Esq 50 0 0.50% 0.87%
Style Punctuation ; . 1 1 0.02% 0.03%
Truncation Text that the deceased had lodged 174 0 1.75% 3.03%
Style Punctuation , 0 1 0.01% 0.02%
Truncation Text She was also extremely incoherent 432 0 4.35% 7.51%
Truncation Text told the witness that some one had 69 0 0.70% 1.20%
Style Capitalisation M m 1 1 0.02% 0.03%
Truncation Text At other times, the poor young lady 466 0 4.70% 8.11%
Style Punctuation , 0 1 0.01% 0.02%
Truncation Text Immediately on the unfortunate 54 0 0.54% 0.94%
Style Capitalisation m M 1 1 0.02% 0.03%
Addition Text 0 1 0.01% 0.02%
Truncation Text Mr. Emanuel Gristock, of Wardour-street 2840 0 28.62% 49.40%
Truncation Text without a moment's hesitation, 31 0 0.31% 0.54%
Editorial Vocabulary their the 5 3 0.08% 0.14%
Style Capitalisation - 1 1 0.02% 0.03%
Style Punctuation , 0 1 0.01% 0.02%
Style Spelling at te 2 2 0.04% 0.07%
Style Punctuation ; , 1 1 0.02% 0.03%
Style Punctuation , 0 1 0.01% 0.02%
Style Capitalisation m M 1 1 0.02% 0.03%
Style Punctuation ; , 1 1 0.02% 0.03%
Style Punctuation ; , 1 1 0.02% 0.03%
Style Punctuation , 0 1 0.01% 0.02%
Truncation Text completely 10 0 0.10% 0.17%
Style Punctuation , 1 0 0.01% 0.02%
Style Capitalisation P p 1 1 0.02% 0.03%
Style Capitalisation a disordered intellect A DISORDERED INTELLECT 22 22 0.44% 0.77%
Style Punctuation . ! 1 1 0.02% 0.03%
43.20% 74.57%
DIRECTIONALITY
Examiner Trewman's Exeter Flying Post
Morning Chronicle
A MATTER OF SCALE
• Case-Study Search and Transcribe Limited by:
• Time
• Access to Relevant Collections
• Creative Search Methods and Hidden Biases
• OCR-Reprint Matching Limited by:
• OCR Quality
• Reprint Matching Resolution (Article, Page, nGram)
RE-ANALYSING THE DATABASE
• Manual-to-OCR Matches
Much More Accurate
• Finds a Small
but Sometimes Crucial
Set of New Matches
• Can Remap the
Entire Reprint Network
BOUTIQUE BIG DATA?
• Shared Transcription Standards
• Collegial Sharing of Data and Results
• Reuse in New and Unexpected Ways
• Case Study Discoveries Refining
Big Data Search Parameters
Image Courtesy of Mike Licht (CC BY) at https://www.flickr.com/photos/notionscapital/14032020799/
WWW.SCISSORSANDPASTE.NET
WWW.GITHUB.COM/MHBEALS/SCISSORSANDPASTE
THANK YOU
M. H. Beals (ORCID: 0000-0002-2907-3313)
Loughborough University
@MHBEALS

More Related Content

More from M. H Beals

Georgian Pingbacks: Mapping Attribution Networks in a 19th-Century Newspaper ...
Georgian Pingbacks: Mapping Attribution Networks in a 19th-Century Newspaper ...Georgian Pingbacks: Mapping Attribution Networks in a 19th-Century Newspaper ...
Georgian Pingbacks: Mapping Attribution Networks in a 19th-Century Newspaper ...M. H Beals
 
Boutique Big Data: Understanding 19th-Century Reprint Culture With Plagiarism...
Boutique Big Data: Understanding 19th-Century Reprint Culture With Plagiarism...Boutique Big Data: Understanding 19th-Century Reprint Culture With Plagiarism...
Boutique Big Data: Understanding 19th-Century Reprint Culture With Plagiarism...M. H Beals
 
Imagining Communities: The Glasgow Advertiser and the Kentucky Frontier, 1790...
Imagining Communities: The Glasgow Advertiser and the Kentucky Frontier, 1790...Imagining Communities: The Glasgow Advertiser and the Kentucky Frontier, 1790...
Imagining Communities: The Glasgow Advertiser and the Kentucky Frontier, 1790...M. H Beals
 
BSECS Panel on Publishing
BSECS Panel on PublishingBSECS Panel on Publishing
BSECS Panel on PublishingM. H Beals
 
Lies, Damned Lies and Statistics: History and the Impact Agenda
Lies, Damned Lies and Statistics: History and the Impact AgendaLies, Damned Lies and Statistics: History and the Impact Agenda
Lies, Damned Lies and Statistics: History and the Impact AgendaM. H Beals
 
Promoting Peer-to-Peer Teaching, On and Offline
Promoting Peer-to-Peer Teaching, On and OfflinePromoting Peer-to-Peer Teaching, On and Offline
Promoting Peer-to-Peer Teaching, On and OfflineM. H Beals
 
Evolutionary Plagiarism: Tracing Dissemination Pathways in 19th-Century Reprints
Evolutionary Plagiarism: Tracing Dissemination Pathways in 19th-Century ReprintsEvolutionary Plagiarism: Tracing Dissemination Pathways in 19th-Century Reprints
Evolutionary Plagiarism: Tracing Dissemination Pathways in 19th-Century ReprintsM. H Beals
 
Mennons and MacGillivray: Scotland and the North American Frontier, 1790-1795
Mennons and MacGillivray: Scotland and the North American Frontier, 1790-1795Mennons and MacGillivray: Scotland and the North American Frontier, 1790-1795
Mennons and MacGillivray: Scotland and the North American Frontier, 1790-1795M. H Beals
 
Help Them Try Harder: Integrating the Digital into Historical Thinking
Help Them Try Harder: Integrating the Digital into Historical ThinkingHelp Them Try Harder: Integrating the Digital into Historical Thinking
Help Them Try Harder: Integrating the Digital into Historical ThinkingM. H Beals
 
Hunt or Gather, Share or Steal: Scottish News Networks, 1790-1840
Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840
Hunt or Gather, Share or Steal: Scottish News Networks, 1790-1840M. H Beals
 
Mapping Implicit Processes: Extracting Social Networks from Digital Corpora
Mapping Implicit Processes: Extracting Social Networks from Digital CorporaMapping Implicit Processes: Extracting Social Networks from Digital Corpora
Mapping Implicit Processes: Extracting Social Networks from Digital CorporaM. H Beals
 
Try Harder: Archival Research in the Digital Age
Try Harder: Archival Research in the Digital AgeTry Harder: Archival Research in the Digital Age
Try Harder: Archival Research in the Digital AgeM. H Beals
 
Teaching and Learning in History: A 20-Minute Survival Guide
Teaching and Learning in History: A 20-Minute Survival GuideTeaching and Learning in History: A 20-Minute Survival Guide
Teaching and Learning in History: A 20-Minute Survival GuideM. H Beals
 

More from M. H Beals (14)

Georgian Pingbacks: Mapping Attribution Networks in a 19th-Century Newspaper ...
Georgian Pingbacks: Mapping Attribution Networks in a 19th-Century Newspaper ...Georgian Pingbacks: Mapping Attribution Networks in a 19th-Century Newspaper ...
Georgian Pingbacks: Mapping Attribution Networks in a 19th-Century Newspaper ...
 
Boutique Big Data: Understanding 19th-Century Reprint Culture With Plagiarism...
Boutique Big Data: Understanding 19th-Century Reprint Culture With Plagiarism...Boutique Big Data: Understanding 19th-Century Reprint Culture With Plagiarism...
Boutique Big Data: Understanding 19th-Century Reprint Culture With Plagiarism...
 
Imagining Communities: The Glasgow Advertiser and the Kentucky Frontier, 1790...
Imagining Communities: The Glasgow Advertiser and the Kentucky Frontier, 1790...Imagining Communities: The Glasgow Advertiser and the Kentucky Frontier, 1790...
Imagining Communities: The Glasgow Advertiser and the Kentucky Frontier, 1790...
 
BSECS Panel on Publishing
BSECS Panel on PublishingBSECS Panel on Publishing
BSECS Panel on Publishing
 
Lies, Damned Lies and Statistics: History and the Impact Agenda
Lies, Damned Lies and Statistics: History and the Impact AgendaLies, Damned Lies and Statistics: History and the Impact Agenda
Lies, Damned Lies and Statistics: History and the Impact Agenda
 
Promoting Peer-to-Peer Teaching, On and Offline
Promoting Peer-to-Peer Teaching, On and OfflinePromoting Peer-to-Peer Teaching, On and Offline
Promoting Peer-to-Peer Teaching, On and Offline
 
Evolutionary Plagiarism: Tracing Dissemination Pathways in 19th-Century Reprints
Evolutionary Plagiarism: Tracing Dissemination Pathways in 19th-Century ReprintsEvolutionary Plagiarism: Tracing Dissemination Pathways in 19th-Century Reprints
Evolutionary Plagiarism: Tracing Dissemination Pathways in 19th-Century Reprints
 
Mennons and MacGillivray: Scotland and the North American Frontier, 1790-1795
Mennons and MacGillivray: Scotland and the North American Frontier, 1790-1795Mennons and MacGillivray: Scotland and the North American Frontier, 1790-1795
Mennons and MacGillivray: Scotland and the North American Frontier, 1790-1795
 
Help Them Try Harder: Integrating the Digital into Historical Thinking
Help Them Try Harder: Integrating the Digital into Historical ThinkingHelp Them Try Harder: Integrating the Digital into Historical Thinking
Help Them Try Harder: Integrating the Digital into Historical Thinking
 
Crisitunity!
Crisitunity!Crisitunity!
Crisitunity!
 
Hunt or Gather, Share or Steal: Scottish News Networks, 1790-1840
Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840
Hunt or Gather, Share or Steal: Scottish News Networks, 1790-1840
 
Mapping Implicit Processes: Extracting Social Networks from Digital Corpora
Mapping Implicit Processes: Extracting Social Networks from Digital CorporaMapping Implicit Processes: Extracting Social Networks from Digital Corpora
Mapping Implicit Processes: Extracting Social Networks from Digital Corpora
 
Try Harder: Archival Research in the Digital Age
Try Harder: Archival Research in the Digital AgeTry Harder: Archival Research in the Digital Age
Try Harder: Archival Research in the Digital Age
 
Teaching and Learning in History: A 20-Minute Survival Guide
Teaching and Learning in History: A 20-Minute Survival GuideTeaching and Learning in History: A 20-Minute Survival Guide
Teaching and Learning in History: A 20-Minute Survival Guide
 

Recently uploaded

ClimART Action | eTwinning Project
ClimART Action    |    eTwinning ProjectClimART Action    |    eTwinning Project
ClimART Action | eTwinning Projectjordimapav
 
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...Postal Advocate Inc.
 
Integumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptIntegumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptshraddhaparab530
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptxmary850239
 
Concurrency Control in Database Management system
Concurrency Control in Database Management systemConcurrency Control in Database Management system
Concurrency Control in Database Management systemChristalin Nelson
 
Activity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translationActivity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translationRosabel UA
 
Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Celine George
 
Measures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped dataMeasures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped dataBabyAnnMotar
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONHumphrey A Beña
 
Oppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmOppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmStan Meyer
 
Dust Of Snow By Robert Frost Class-X English CBSE
Dust Of Snow By Robert Frost Class-X English CBSEDust Of Snow By Robert Frost Class-X English CBSE
Dust Of Snow By Robert Frost Class-X English CBSEaurabinda banchhor
 
4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptxmary850239
 
Millenials and Fillennials (Ethical Challenge and Responses).pptx
Millenials and Fillennials (Ethical Challenge and Responses).pptxMillenials and Fillennials (Ethical Challenge and Responses).pptx
Millenials and Fillennials (Ethical Challenge and Responses).pptxJanEmmanBrigoli
 
4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptxmary850239
 
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptxAUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptxiammrhaywood
 
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...JojoEDelaCruz
 
Active Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfActive Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfPatidar M
 

Recently uploaded (20)

INCLUSIVE EDUCATION PRACTICES FOR TEACHERS AND TRAINERS.pptx
INCLUSIVE EDUCATION PRACTICES FOR TEACHERS AND TRAINERS.pptxINCLUSIVE EDUCATION PRACTICES FOR TEACHERS AND TRAINERS.pptx
INCLUSIVE EDUCATION PRACTICES FOR TEACHERS AND TRAINERS.pptx
 
ClimART Action | eTwinning Project
ClimART Action    |    eTwinning ProjectClimART Action    |    eTwinning Project
ClimART Action | eTwinning Project
 
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
 
Integumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptIntegumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.ppt
 
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptxLEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx
 
Concurrency Control in Database Management system
Concurrency Control in Database Management systemConcurrency Control in Database Management system
Concurrency Control in Database Management system
 
Activity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translationActivity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translation
 
Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17
 
Measures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped dataMeasures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped data
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
 
Oppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmOppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and Film
 
Dust Of Snow By Robert Frost Class-X English CBSE
Dust Of Snow By Robert Frost Class-X English CBSEDust Of Snow By Robert Frost Class-X English CBSE
Dust Of Snow By Robert Frost Class-X English CBSE
 
4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx
 
Millenials and Fillennials (Ethical Challenge and Responses).pptx
Millenials and Fillennials (Ethical Challenge and Responses).pptxMillenials and Fillennials (Ethical Challenge and Responses).pptx
Millenials and Fillennials (Ethical Challenge and Responses).pptx
 
4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx
 
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptxAUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
 
Paradigm shift in nursing research by RS MEHTA
Paradigm shift in nursing research by RS MEHTAParadigm shift in nursing research by RS MEHTA
Paradigm shift in nursing research by RS MEHTA
 
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
 
Active Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfActive Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdf
 

Boutique Big Data: Reintegrating Close and Distant Reading of 19th-Century Newspapers

  • 1. BOUTIQUE BIG DATA Reintegrating Close and Distant Reading of 19th-Century Newspapers M. H. Beals (ORCID: 0000-0002-2907-3313) Loughborough University @MHBEALS
  • 2. THE HISTORICAL PROBLEM Image Courtesy of Mike Licht (CC BY) at https://www.flickr.com/photos/notionscapital/2313507405 • Culture of Reprinting in 18th and 19th Centuries • Inconsistent Attribution • Inconsistent Survival of Network Components • Limited Historiographical Resources
  • 3.
  • 4. SEARCH AND TRANSCRIBE Left Image Courtesy of Dan Tantrum (CC BY NC ND) at https://www.flickr.com/photos/tantrum_dan/2344581860
  • 5. COPYFIND REPRINT DETECTION • Freeware Programme Developed by Lou Bloomfield http://plagiarism.bloomfieldmedia.com/z-wordpress/software/copyfind/ • Highly Customisable Search As Well as Open Source • Measures Left, Right and Overall Matches • Displays Left-Right Comparisons of Text Image Courtesy of the Lou Bloomfield at http://rabi.phys.virginia.edu/lab3e/
  • 6.
  • 7. COPYFIND IN OCR CORPORA • Freeware Programme Developed by Lou Bloomfield (University of Virginia) • Highly Customisable Search Parameters • Measures Left, Right and Overall Matches • Displays Left-Right Comparisons of Text • Extremely Effective at Discovering OCR-Transcribed Matches
  • 8.
  • 9.
  • 10. 1810 1811 1812 1813 1814 1815 1816 1817
  • 11. ESTABLISHING LIKELY CANDIDATES • Single Year (1810) Contained over 200,000 Possible Matches • Removed Internal (Same Title) Reprints • Restricted Match Size (90 Right, 90 Left or 160 Overall) • Restricted Date Separation (200 Days)
  • 12. COMPARING DATABASES • Historical Networks Bear Little Resemblance to Digitsed Corpora • Undigitised Collections Require Manual Discovery and Transcription • Paywalled Collections (Currently) Require Search-and-Transcribe Inclusion • Overcoming Political and Linguistic Divisions
  • 13. ADVERTISEMENTS • Reprinted in Same Title • Reprinted in Other Titles • Reprinted with Minor Variations • Reprinted after Long Periods • Similar Wording in Different Adverts • Own Networks Ripe for Analysis!
  • 14.
  • 15. DIRECTIONALITY • Reprint Maps are Non-Linear, Similar to Phytogenic Trees • Paths of Specific Branches Dictated by Date, Content, Errors • Similar Method to Meme-Tracking (Adamic et al, 2014) • Attributions Are Often Red Herrings
  • 16. ANOTHER DREADFUL MASSACRE… Times Courier Star St. James Chronicle Sydney Gazette Morning Chronicle Caledonian Mercury Aberdeen Journal
  • 17. AN AFFECTING INSTANCE OF SELF-MURDER Coroner’s Inquest.–At half past two o’clock yesterday, an Inquest was held at the Nag’s Head, Orange-court, Leicester-fields, before Anthony Gell, Esq. Coroner for Westminster, on the body of Madamoiselle Ann Paris, then lying dead at No. 4, St. Martin’s-street, Leicester-fields. Morning Chronicle (London, England, United Kingdom), 06 January 1810, p. 3, available at the Scissors and Paste Database, http://www.scissorsandpaste.net/381. Trewman’s Exeter Flying Post (Exeter, England, United Kingdom), 11 January 1810, p. 2, available at the Scissors and Paste Database, http://www.scissorsandpaste.net/379. Examiner (London, England, United Kingdom), 17 January 1810, p. 15, 16, available at the Scissors and Paste Database, http://www.scissorsandpaste.net/380.
  • 18. DIRECTIONALITY Perfect Match Overall Match Copy Original Reprint ID 559 (82% L, 31% R) 559 (82%) L; 559 (31%) R 1810-01-11_Trewman's Exeter Flying Post_379.txt 1810-01-06_Morning Chronicle_381.txt 381379 992 (96% L, 56% R) 992 (96%) L; 992 (56%) R 1810-01-17_Examiner_380.txt 1810-01-06_Morning Chronicle_381.txt 381380 Perfect Match Overall Match View Both Files File L File R 559 (82% L, 31% R) 559 (82%) L; 559 (31%) R Side-by-Side 1810-01-11_Trewman's Exeter Flying Post_379.txt 1810-01-06_Morning Chronicle_381.txt 992 (96% L, 56% R) 992 (96%) L; 992 (56%) R Side-by-Side 1810-01-17_Examiner_380.txt 1810-01-06_Morning Chronicle_381.txt 533 (51% L, 78% R) 533 (51%) L; 533 (78%) R Side-by-Side 1810-01-17_Examiner_380.txt 1810-01-11_Trewman's Exeter Flying Post_379.txt 559 (82% L, 31% R) 559 (82%) L; 559 (31%) R 1810-01-06_Morning Chronicle_381 1810-01-11_Trewman's Exeter Flying Post_379 381379 9923 3854 Type Subtype Text Copy Text Original Characters Removed Characters Added % Original % Copy Style Capitalisation CORONER'S INQUEST Coroner's Inquest 17 17 0.34% 0.44% Truncation Text At half past two o'clock yesterday 6919 0 69.73% 0.02% Addition Text An inquest was held yesterday evening 0 853 8.60% 22.14% Style Punctuation . .-- 3 1 0.04% 0.03% Style Punctuation ; , 1 1 0.02% 0.03% Style Punctuation , 0 1 0.01% 0.03% Style Spelling te ea 2 2 0.04% 0.05% Style Punctuation , 1 0 0.01% 0.00% Style Punctuation , 1 0 0.01% 0.00% Style Punctuation , : 1 1 0.02% 0.03% Style Punctuation , 1 0 0.01% 0.00% Style Punctuation , : 1 1 0.02% 0.03% Style Punctuation , 0 1 0.01% 0.03% 78.86% 22.80%
  • 19. DIRECTIONALITY 992 (96% L, 56% R) 992 (96%) L; 992 (56%) R 1810-01-17_Examiner_380.txt 1810-01-06_Morning Chronicle_381.txt 381380 5749 9923 Type Subtype Text Original Text Copy Characters Removed Characters Added % Original % Copy Truncation Text Coroner's Inquest.--At half past two 55 0 0.55% 0.96% Addition Text On Friday, 0 10 0.10% 0.17% Truncation Text Orange-court, 13 0 0.13% 0.23% Truncation Text before Anthony Gell, Esq 50 0 0.50% 0.87% Style Punctuation ; . 1 1 0.02% 0.03% Truncation Text that the deceased had lodged 174 0 1.75% 3.03% Style Punctuation , 0 1 0.01% 0.02% Truncation Text She was also extremely incoherent 432 0 4.35% 7.51% Truncation Text told the witness that some one had 69 0 0.70% 1.20% Style Capitalisation M m 1 1 0.02% 0.03% Truncation Text At other times, the poor young lady 466 0 4.70% 8.11% Style Punctuation , 0 1 0.01% 0.02% Truncation Text Immediately on the unfortunate 54 0 0.54% 0.94% Style Capitalisation m M 1 1 0.02% 0.03% Addition Text 0 1 0.01% 0.02% Truncation Text Mr. Emanuel Gristock, of Wardour-street 2840 0 28.62% 49.40% Truncation Text without a moment's hesitation, 31 0 0.31% 0.54% Editorial Vocabulary their the 5 3 0.08% 0.14% Style Capitalisation - 1 1 0.02% 0.03% Style Punctuation , 0 1 0.01% 0.02% Style Spelling at te 2 2 0.04% 0.07% Style Punctuation ; , 1 1 0.02% 0.03% Style Punctuation , 0 1 0.01% 0.02% Style Capitalisation m M 1 1 0.02% 0.03% Style Punctuation ; , 1 1 0.02% 0.03% Style Punctuation ; , 1 1 0.02% 0.03% Style Punctuation , 0 1 0.01% 0.02% Truncation Text completely 10 0 0.10% 0.17% Style Punctuation , 1 0 0.01% 0.02% Style Capitalisation P p 1 1 0.02% 0.03% Style Capitalisation a disordered intellect A DISORDERED INTELLECT 22 22 0.44% 0.77% Style Punctuation . ! 1 1 0.02% 0.03% 43.20% 74.57%
  • 20. DIRECTIONALITY Examiner Trewman's Exeter Flying Post Morning Chronicle
  • 21. A MATTER OF SCALE • Case-Study Search and Transcribe Limited by: • Time • Access to Relevant Collections • Creative Search Methods and Hidden Biases • OCR-Reprint Matching Limited by: • OCR Quality • Reprint Matching Resolution (Article, Page, nGram)
  • 22. RE-ANALYSING THE DATABASE • Manual-to-OCR Matches Much More Accurate • Finds a Small but Sometimes Crucial Set of New Matches • Can Remap the Entire Reprint Network
  • 23. BOUTIQUE BIG DATA? • Shared Transcription Standards • Collegial Sharing of Data and Results • Reuse in New and Unexpected Ways • Case Study Discoveries Refining Big Data Search Parameters Image Courtesy of Mike Licht (CC BY) at https://www.flickr.com/photos/notionscapital/14032020799/
  • 26. THANK YOU M. H. Beals (ORCID: 0000-0002-2907-3313) Loughborough University @MHBEALS