Submit Search
Upload
Scraping the Olympics
•
3 likes
•
14,975 views
Paul Bradshaw
Follow
Presentation for a workshop at the BBC Data Journalism Day, July 2012
Read less
Read more
Education
News & Politics
Technology
Report
Share
Report
Share
1 of 32
Download now
Download to read offline
Recommended
Making data journalism work
Making data journalism work
Paul Bradshaw
Data validation in the Digital Age
Data validation in the Digital Age
J T "Tom" Johnson
Open Data in the Newsroom: What's the story? (Talk from OK Con 2011 in Berlin)
Open Data in the Newsroom: What's the story? (Talk from OK Con 2011 in Berlin)
Mirko Lorenz
Data Journalism
Data Journalism
pilhofer
Data journalism's future: new sources, new opportunities
Data journalism's future: new sources, new opportunities
Paul Bradshaw
Olympic Pages
Olympic Pages
Society for News Design
Brief introduction to data visualization
Brief introduction to data visualization
Zach Gemignani
How to work with a bullshitting robot
How to work with a bullshitting robot
Paul Bradshaw
Recommended
Making data journalism work
Making data journalism work
Paul Bradshaw
Data validation in the Digital Age
Data validation in the Digital Age
J T "Tom" Johnson
Open Data in the Newsroom: What's the story? (Talk from OK Con 2011 in Berlin)
Open Data in the Newsroom: What's the story? (Talk from OK Con 2011 in Berlin)
Mirko Lorenz
Data Journalism
Data Journalism
pilhofer
Data journalism's future: new sources, new opportunities
Data journalism's future: new sources, new opportunities
Paul Bradshaw
Olympic Pages
Olympic Pages
Society for News Design
Brief introduction to data visualization
Brief introduction to data visualization
Zach Gemignani
How to work with a bullshitting robot
How to work with a bullshitting robot
Paul Bradshaw
How to generate a 100+ page website using parameterisation in R
How to generate a 100+ page website using parameterisation in R
Paul Bradshaw
ChatGPT (and generative AI) in journalism
ChatGPT (and generative AI) in journalism
Paul Bradshaw
Data journalism: history and roles
Data journalism: history and roles
Paul Bradshaw
Working on data stories: different approaches
Working on data stories: different approaches
Paul Bradshaw
Visual journalism: gifs, emoji, memes and other techniques
Visual journalism: gifs, emoji, memes and other techniques
Paul Bradshaw
Using narrative structures in shortform and longform journalism
Using narrative structures in shortform and longform journalism
Paul Bradshaw
Narrative and multiplatform journalism (part 1)
Narrative and multiplatform journalism (part 1)
Paul Bradshaw
Teaching data journalism (Abraji 2021)
Teaching data journalism (Abraji 2021)
Paul Bradshaw
Data journalism on the air: 3 tips
Data journalism on the air: 3 tips
Paul Bradshaw
7 angles for data stories
7 angles for data stories
Paul Bradshaw
Uncertain times, stories of uncertainty
Uncertain times, stories of uncertainty
Paul Bradshaw
Ergodic education (online teaching and interactivity)
Ergodic education (online teaching and interactivity)
Paul Bradshaw
Storytelling in the database era: uncertainty and science reporting
Storytelling in the database era: uncertainty and science reporting
Paul Bradshaw
Cognitive bias: a quick guide for journalists
Cognitive bias: a quick guide for journalists
Paul Bradshaw
The 3 chords of data journalism
The 3 chords of data journalism
Paul Bradshaw
Data journalism: what it is, how to use data for stories
Data journalism: what it is, how to use data for stories
Paul Bradshaw
Teaching AI in data journalism
Teaching AI in data journalism
Paul Bradshaw
10 ways AI can be used for investigations
10 ways AI can be used for investigations
Paul Bradshaw
Open Data Utopia? (SciCAR 19)
Open Data Utopia? (SciCAR 19)
Paul Bradshaw
Scraping for journalists - ideas, concepts and tips (CIJ Summer School 2019)
Scraping for journalists - ideas, concepts and tips (CIJ Summer School 2019)
Paul Bradshaw
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...
Seán Kennedy
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
Postal Advocate Inc.
More Related Content
More from Paul Bradshaw
How to generate a 100+ page website using parameterisation in R
How to generate a 100+ page website using parameterisation in R
Paul Bradshaw
ChatGPT (and generative AI) in journalism
ChatGPT (and generative AI) in journalism
Paul Bradshaw
Data journalism: history and roles
Data journalism: history and roles
Paul Bradshaw
Working on data stories: different approaches
Working on data stories: different approaches
Paul Bradshaw
Visual journalism: gifs, emoji, memes and other techniques
Visual journalism: gifs, emoji, memes and other techniques
Paul Bradshaw
Using narrative structures in shortform and longform journalism
Using narrative structures in shortform and longform journalism
Paul Bradshaw
Narrative and multiplatform journalism (part 1)
Narrative and multiplatform journalism (part 1)
Paul Bradshaw
Teaching data journalism (Abraji 2021)
Teaching data journalism (Abraji 2021)
Paul Bradshaw
Data journalism on the air: 3 tips
Data journalism on the air: 3 tips
Paul Bradshaw
7 angles for data stories
7 angles for data stories
Paul Bradshaw
Uncertain times, stories of uncertainty
Uncertain times, stories of uncertainty
Paul Bradshaw
Ergodic education (online teaching and interactivity)
Ergodic education (online teaching and interactivity)
Paul Bradshaw
Storytelling in the database era: uncertainty and science reporting
Storytelling in the database era: uncertainty and science reporting
Paul Bradshaw
Cognitive bias: a quick guide for journalists
Cognitive bias: a quick guide for journalists
Paul Bradshaw
The 3 chords of data journalism
The 3 chords of data journalism
Paul Bradshaw
Data journalism: what it is, how to use data for stories
Data journalism: what it is, how to use data for stories
Paul Bradshaw
Teaching AI in data journalism
Teaching AI in data journalism
Paul Bradshaw
10 ways AI can be used for investigations
10 ways AI can be used for investigations
Paul Bradshaw
Open Data Utopia? (SciCAR 19)
Open Data Utopia? (SciCAR 19)
Paul Bradshaw
Scraping for journalists - ideas, concepts and tips (CIJ Summer School 2019)
Scraping for journalists - ideas, concepts and tips (CIJ Summer School 2019)
Paul Bradshaw
More from Paul Bradshaw
(20)
How to generate a 100+ page website using parameterisation in R
How to generate a 100+ page website using parameterisation in R
ChatGPT (and generative AI) in journalism
ChatGPT (and generative AI) in journalism
Data journalism: history and roles
Data journalism: history and roles
Working on data stories: different approaches
Working on data stories: different approaches
Visual journalism: gifs, emoji, memes and other techniques
Visual journalism: gifs, emoji, memes and other techniques
Using narrative structures in shortform and longform journalism
Using narrative structures in shortform and longform journalism
Narrative and multiplatform journalism (part 1)
Narrative and multiplatform journalism (part 1)
Teaching data journalism (Abraji 2021)
Teaching data journalism (Abraji 2021)
Data journalism on the air: 3 tips
Data journalism on the air: 3 tips
7 angles for data stories
7 angles for data stories
Uncertain times, stories of uncertainty
Uncertain times, stories of uncertainty
Ergodic education (online teaching and interactivity)
Ergodic education (online teaching and interactivity)
Storytelling in the database era: uncertainty and science reporting
Storytelling in the database era: uncertainty and science reporting
Cognitive bias: a quick guide for journalists
Cognitive bias: a quick guide for journalists
The 3 chords of data journalism
The 3 chords of data journalism
Data journalism: what it is, how to use data for stories
Data journalism: what it is, how to use data for stories
Teaching AI in data journalism
Teaching AI in data journalism
10 ways AI can be used for investigations
10 ways AI can be used for investigations
Open Data Utopia? (SciCAR 19)
Open Data Utopia? (SciCAR 19)
Scraping for journalists - ideas, concepts and tips (CIJ Summer School 2019)
Scraping for journalists - ideas, concepts and tips (CIJ Summer School 2019)
Recently uploaded
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...
Seán Kennedy
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
Postal Advocate Inc.
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
JhezDiaz1
FILIPINO PSYCHology sikolohiyang pilipino
FILIPINO PSYCHology sikolohiyang pilipino
johnmickonozaleda
Science 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptx
MaryGraceBautista27
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx
mary850239
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptx
thorishapillay1
Judging the Relevance and worth of ideas part 2.pptx
Judging the Relevance and worth of ideas part 2.pptx
SherlyMaeNeri
Transaction Management in Database Management System
Transaction Management in Database Management System
Christalin Nelson
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17
Celine George
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
TechSoup
Visit to a blind student's school🧑🦯🧑🦯(community medicine)
Visit to a blind student's school🧑🦯🧑🦯(community medicine)
lakshayb543
Global Lehigh Strategic Initiatives (without descriptions)
Global Lehigh Strategic Initiatives (without descriptions)
cama23
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
Conquiztadors- the Quiz Society of Sri Venkateswara College
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
iammrhaywood
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
9953056974 Low Rate Call Girls In Saket, Delhi NCR
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4
MiaBumagat1
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERP
Celine George
Barangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptx
Carlos105
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
Nguyen Thanh Tu Collection
Recently uploaded
(20)
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
FILIPINO PSYCHology sikolohiyang pilipino
FILIPINO PSYCHology sikolohiyang pilipino
Science 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptx
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptx
Judging the Relevance and worth of ideas part 2.pptx
Judging the Relevance and worth of ideas part 2.pptx
Transaction Management in Database Management System
Transaction Management in Database Management System
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Visit to a blind student's school🧑🦯🧑🦯(community medicine)
Visit to a blind student's school🧑🦯🧑🦯(community medicine)
Global Lehigh Strategic Initiatives (without descriptions)
Global Lehigh Strategic Initiatives (without descriptions)
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERP
Barangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptx
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
Scraping the Olympics
1.
Scraping the
Olympics Paul Bradshaw, author: Scraping for Journalists * Leanpub.com/scrapingforjournalists
2.
? Scraping basics Combining data Finding
stories in data *
3.
*
4.
Function (Parameters)
*
5.
Function (Parameters) =SUM(A2:A50) =AVERAGE(B2:B300) =COUNTIF(A10:A3000,”Smith”)
*
6.
(“string”, index)
*
7.
Tip: search for documentation
*
8.
Tip: search for
structure around data *
9.
*
10.
//div[starts-with(@ class, ‘jobWrap’)]*
11.
*
12.
Combining data
*
13.
? Question: Which torchbearers are from
Dorset? *
14.
*
15.
*
16.
*
17.
*
18.
*
19.
*
20.
*
21.
*
22.
? Finding leads: Corporate torchbearers?
*
23.
*
24.
*
25.
*
26.
*
27.
New entries -
or disappearing ones *
28.
*
29.
*
30.
*
31.
*
32.
Leanpub.com/scrapingforjournalists
@paulbradshaw onlinejournalismblog.com helpmeinvestigate.com slideshare.net/onlinejournalist * linkedin.com/in/onlinejournalist
Download now