Harvesting and semantically tagging media releases from political websites using web services

P
Peter NeishSystems Officer / Web developer
Harvesting and semantically tagging media releases from political websites using web services   Peter Neish, Systems Officer Victorian Parliamentary Library @peterneish
What will be covered ,[object Object],[object Object],[object Object],[object Object],[object Object]
About the library ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Media Releases ,[object Object],[object Object],[object Object],[object Object]
Number of Media Releases per year 0 1000 2000 3000 4000 5000 6000 7000 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010
Media releases by party 0 500 1000 1500 2000 2500 3000 3500 4000 4500 5000 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 ALP Coalition Green Independent
Project aims ,[object Object],[object Object],[object Object]
Part 1: Automation ,[object Object],[object Object],[object Object],[object Object]
What we built Polls RSS feed for links DB Textworks wkhtml2pdf Servlet Metadata
Technologies used ,[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Part 2: Semantic Tagging ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Open Calais ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Example Open Calais ,[object Object]
Number of Tags assigned by OpenCalais 0 500 1000 1500 2000 2500 3000 3500 4000 4500 0 20 40 60 80 100 120 Tags per item Total number
User interface
Tag Quality 85% 4% 6% 5% Correct Tags Incorrect Tags Repeated Tags Redundant Tags
Problems - disambiguation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Photo by  http://www.flickr.com/photos/meckimac/2971992/   Photo by  http://www.flickr.com/photos/eclogite/257560117/
Linked Data ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Conclusion ,[object Object],[object Object],[object Object],[object Object]
1 of 20

Recommended

Inmagic user group meeting Melbourne june 2011 by
Inmagic user group meeting Melbourne june 2011Inmagic user group meeting Melbourne june 2011
Inmagic user group meeting Melbourne june 2011Peter Neish
965 views10 slides
Linked Data: thinking big, starting small by
Linked Data: thinking big, starting smallLinked Data: thinking big, starting small
Linked Data: thinking big, starting smallPeter Neish
3.1K views23 slides
Open Source Reference Desk Software at the Victorian Parliamentary Library by
Open Source Reference Desk Software at the Victorian Parliamentary LibraryOpen Source Reference Desk Software at the Victorian Parliamentary Library
Open Source Reference Desk Software at the Victorian Parliamentary LibraryPeter Neish
2K views16 slides
Uk discovery-jisc-project-showcase by
Uk discovery-jisc-project-showcaseUk discovery-jisc-project-showcase
Uk discovery-jisc-project-showcaseRDTF-Discovery
1.1K views17 slides
OpenAIRE: Science. Set Free, Iryna Kuchma, EIFL by
OpenAIRE: Science. Set Free, Iryna Kuchma, EIFLOpenAIRE: Science. Set Free, Iryna Kuchma, EIFL
OpenAIRE: Science. Set Free, Iryna Kuchma, EIFLPlatforma Otwartej Nauki
481 views45 slides
Advancing the National Digital Platform: Survey Findings by
Advancing the National Digital Platform: Survey FindingsAdvancing the National Digital Platform: Survey Findings
Advancing the National Digital Platform: Survey FindingsOCLC
261 views23 slides

More Related Content

What's hot

Socialising in the Sun 245$a / Fred Guy, Suncat Service Manager, EDINA by
Socialising in the Sun 245$a / Fred Guy, Suncat Service Manager, EDINASocialising in the Sun 245$a / Fred Guy, Suncat Service Manager, EDINA
Socialising in the Sun 245$a / Fred Guy, Suncat Service Manager, EDINACIGScotland
1.5K views40 slides
Reframing Public Housing: Visualization and Data Analytics in History by
Reframing Public Housing: Visualization and Data Analytics in History Reframing Public Housing: Visualization and Data Analytics in History
Reframing Public Housing: Visualization and Data Analytics in History Terry Reese
398 views14 slides
New ways to communicate in science: perspectives from biodiversity research by
New ways to communicate in science: perspectives from biodiversity researchNew ways to communicate in science: perspectives from biodiversity research
New ways to communicate in science: perspectives from biodiversity researchVince Smith
907 views15 slides
VALA 2016 L-Plate session on Linked Open Data by
VALA 2016 L-Plate session on Linked Open DataVALA 2016 L-Plate session on Linked Open Data
VALA 2016 L-Plate session on Linked Open DataPeter Neish
271 views9 slides
Deployment of rd_fa_microdata_microformats_on_the_web by
Deployment of rd_fa_microdata_microformats_on_the_webDeployment of rd_fa_microdata_microformats_on_the_web
Deployment of rd_fa_microdata_microformats_on_the_webSTIinnsbruck
280 views17 slides
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 1) by
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 1)Open Research Gateway for the ELIXIR-GR Infrastructure (Part 1)
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 1)OpenAIRE
452 views12 slides

What's hot(20)

Socialising in the Sun 245$a / Fred Guy, Suncat Service Manager, EDINA by CIGScotland
Socialising in the Sun 245$a / Fred Guy, Suncat Service Manager, EDINASocialising in the Sun 245$a / Fred Guy, Suncat Service Manager, EDINA
Socialising in the Sun 245$a / Fred Guy, Suncat Service Manager, EDINA
CIGScotland1.5K views
Reframing Public Housing: Visualization and Data Analytics in History by Terry Reese
Reframing Public Housing: Visualization and Data Analytics in History Reframing Public Housing: Visualization and Data Analytics in History
Reframing Public Housing: Visualization and Data Analytics in History
Terry Reese398 views
New ways to communicate in science: perspectives from biodiversity research by Vince Smith
New ways to communicate in science: perspectives from biodiversity researchNew ways to communicate in science: perspectives from biodiversity research
New ways to communicate in science: perspectives from biodiversity research
Vince Smith907 views
VALA 2016 L-Plate session on Linked Open Data by Peter Neish
VALA 2016 L-Plate session on Linked Open DataVALA 2016 L-Plate session on Linked Open Data
VALA 2016 L-Plate session on Linked Open Data
Peter Neish271 views
Deployment of rd_fa_microdata_microformats_on_the_web by STIinnsbruck
Deployment of rd_fa_microdata_microformats_on_the_webDeployment of rd_fa_microdata_microformats_on_the_web
Deployment of rd_fa_microdata_microformats_on_the_web
STIinnsbruck280 views
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 1) by OpenAIRE
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 1)Open Research Gateway for the ELIXIR-GR Infrastructure (Part 1)
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 1)
OpenAIRE452 views
A distributed network of digital heritage information - Semantics Amsterdam by Enno Meijers
A distributed network of digital heritage information - Semantics AmsterdamA distributed network of digital heritage information - Semantics Amsterdam
A distributed network of digital heritage information - Semantics Amsterdam
Enno Meijers517 views
EOSC-hub and OpenAIRE-Advance collaboration (Presentation at RDA 11th plenary) by OpenAIRE
EOSC-hub and OpenAIRE-Advance collaboration (Presentation at RDA 11th plenary)EOSC-hub and OpenAIRE-Advance collaboration (Presentation at RDA 11th plenary)
EOSC-hub and OpenAIRE-Advance collaboration (Presentation at RDA 11th plenary)
OpenAIRE207 views
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 3) by OpenAIRE
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 3)Open Research Gateway for the ELIXIR-GR Infrastructure (Part 3)
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 3)
OpenAIRE479 views
THOR Workshop - Services EBI by Maaike Duine
THOR Workshop - Services EBITHOR Workshop - Services EBI
THOR Workshop - Services EBI
Maaike Duine425 views
Better together: building services for public good on top of content from the... by petrknoth
Better together: building services for public good on top of content from the...Better together: building services for public good on top of content from the...
Better together: building services for public good on top of content from the...
petrknoth748 views
Better together: building services for public good on top of content from the... by petrknoth
Better together: building services for public good on top of content from the...Better together: building services for public good on top of content from the...
Better together: building services for public good on top of content from the...
petrknoth257 views
Integration - the heart of researcher centric research data management system... by Repository Fringe
Integration - the heart of researcher centric research data management system...Integration - the heart of researcher centric research data management system...
Integration - the heart of researcher centric research data management system...
ALUMNI 2015_Hypermedia APIs, Andreas Harth by STI Innsbruck
ALUMNI 2015_Hypermedia APIs, Andreas HarthALUMNI 2015_Hypermedia APIs, Andreas Harth
ALUMNI 2015_Hypermedia APIs, Andreas Harth
STI Innsbruck1.4K views
ALUMNI 2015_Semantic Weg in the Plateau of Productivity, Ioannis Stavrakanton... by STI Innsbruck
ALUMNI 2015_Semantic Weg in the Plateau of Productivity, Ioannis Stavrakanton...ALUMNI 2015_Semantic Weg in the Plateau of Productivity, Ioannis Stavrakanton...
ALUMNI 2015_Semantic Weg in the Plateau of Productivity, Ioannis Stavrakanton...
STI Innsbruck905 views

Similar to Harvesting and semantically tagging media releases from political websites using web services

Exploring the Use of Linked Data to Bridge State and Federal Archives by
Exploring the Use of Linked Data to Bridge State and Federal ArchivesExploring the Use of Linked Data to Bridge State and Federal Archives
Exploring the Use of Linked Data to Bridge State and Federal ArchivesJon Voss
5.3K views26 slides
“Library 2.0: Balancing the Risks and Benefits to Maximise the Dividends” by
“Library 2.0: Balancing the Risks and Benefits to Maximise the Dividends”“Library 2.0: Balancing the Risks and Benefits to Maximise the Dividends”
“Library 2.0: Balancing the Risks and Benefits to Maximise the Dividends”bridgingworlds2008
1.1K views51 slides
Power to the People- Enabling Ever US Citizen to Participate in Federal Rule ... by
Power to the People- Enabling Ever US Citizen to Participate in Federal Rule ...Power to the People- Enabling Ever US Citizen to Participate in Federal Rule ...
Power to the People- Enabling Ever US Citizen to Participate in Federal Rule ...BlueFish
449 views25 slides
Library 2.0: A New Version for the Future by
Library 2.0: A New Version for the FutureLibrary 2.0: A New Version for the Future
Library 2.0: A New Version for the Futurepddsnn
1.3K views135 slides
Realising Potential Of Web 2 0 by
Realising Potential Of Web 2 0Realising Potential Of Web 2 0
Realising Potential Of Web 2 0lisbk
950 views62 slides
data.ac.uk briefing paper by
data.ac.uk briefing paperdata.ac.uk briefing paper
data.ac.uk briefing paperDavid F. Flanders
698 views11 slides

Similar to Harvesting and semantically tagging media releases from political websites using web services(20)

Exploring the Use of Linked Data to Bridge State and Federal Archives by Jon Voss
Exploring the Use of Linked Data to Bridge State and Federal ArchivesExploring the Use of Linked Data to Bridge State and Federal Archives
Exploring the Use of Linked Data to Bridge State and Federal Archives
Jon Voss5.3K views
“Library 2.0: Balancing the Risks and Benefits to Maximise the Dividends” by bridgingworlds2008
“Library 2.0: Balancing the Risks and Benefits to Maximise the Dividends”“Library 2.0: Balancing the Risks and Benefits to Maximise the Dividends”
“Library 2.0: Balancing the Risks and Benefits to Maximise the Dividends”
bridgingworlds20081.1K views
Power to the People- Enabling Ever US Citizen to Participate in Federal Rule ... by BlueFish
Power to the People- Enabling Ever US Citizen to Participate in Federal Rule ...Power to the People- Enabling Ever US Citizen to Participate in Federal Rule ...
Power to the People- Enabling Ever US Citizen to Participate in Federal Rule ...
BlueFish449 views
Library 2.0: A New Version for the Future by pddsnn
Library 2.0: A New Version for the FutureLibrary 2.0: A New Version for the Future
Library 2.0: A New Version for the Future
pddsnn1.3K views
Realising Potential Of Web 2 0 by lisbk
Realising Potential Of Web 2 0Realising Potential Of Web 2 0
Realising Potential Of Web 2 0
lisbk950 views
Little Falls Library Digitization Project by Kevin Andreano
Little Falls Library Digitization ProjectLittle Falls Library Digitization Project
Little Falls Library Digitization Project
Kevin Andreano249 views
Revolutionising Library Management by Michelle McLean
Revolutionising Library ManagementRevolutionising Library Management
Revolutionising Library Management
Michelle McLean1.2K views
Biocatalogue, FileQuirks, MyExperiment by Jerzy
Biocatalogue, FileQuirks, MyExperimentBiocatalogue, FileQuirks, MyExperiment
Biocatalogue, FileQuirks, MyExperiment
Jerzy469 views
Web2 UKOLN MLA Workshop by UKOLN_MLA
Web2 UKOLN MLA WorkshopWeb2 UKOLN MLA Workshop
Web2 UKOLN MLA Workshop
UKOLN_MLA422 views
Mashups & Data Visualizations: The New Breed of Web Applications by Darlene Fichter
Mashups & Data Visualizations: The New Breed of Web ApplicationsMashups & Data Visualizations: The New Breed of Web Applications
Mashups & Data Visualizations: The New Breed of Web Applications
Darlene Fichter1.6K views
Defining Web 2.0 and RIA by Arielladog
Defining Web 2.0 and RIADefining Web 2.0 and RIA
Defining Web 2.0 and RIA
Arielladog1.2K views
Semanticommunity.net: Community Infrastructure Sandbox for 2008 by webhostingguy
Semanticommunity.net: Community Infrastructure Sandbox for 2008 Semanticommunity.net: Community Infrastructure Sandbox for 2008
Semanticommunity.net: Community Infrastructure Sandbox for 2008
webhostingguy451 views
JISC Access and Identity Management: Future Directions by JISC.AM
JISC Access and Identity Management: Future DirectionsJISC Access and Identity Management: Future Directions
JISC Access and Identity Management: Future Directions
JISC.AM642 views
Acs Presentation Thinking Outside Of Inbox V2 by Johnny Teoh
Acs Presentation   Thinking Outside Of Inbox V2Acs Presentation   Thinking Outside Of Inbox V2
Acs Presentation Thinking Outside Of Inbox V2
Johnny Teoh6.6K views
Web 2.0 - principles and implications by Martin Weller
Web 2.0 - principles and implicationsWeb 2.0 - principles and implications
Web 2.0 - principles and implications
Martin Weller3.6K views
Dissmark Ii Social Software by davidroethler
Dissmark Ii Social SoftwareDissmark Ii Social Software
Dissmark Ii Social Software
davidroethler645 views
Mattsslides by mgallon
MattsslidesMattsslides
Mattsslides
mgallon383 views

Recently uploaded

Zero to Automated in Under a Year by
Zero to Automated in Under a YearZero to Automated in Under a Year
Zero to Automated in Under a YearNetwork Automation Forum
15 views23 slides
SUPPLIER SOURCING.pptx by
SUPPLIER SOURCING.pptxSUPPLIER SOURCING.pptx
SUPPLIER SOURCING.pptxangelicacueva6
15 views1 slide
AMAZON PRODUCT RESEARCH.pdf by
AMAZON PRODUCT RESEARCH.pdfAMAZON PRODUCT RESEARCH.pdf
AMAZON PRODUCT RESEARCH.pdfJerikkLaureta
26 views13 slides
Business Analyst Series 2023 - Week 3 Session 5 by
Business Analyst Series 2023 -  Week 3 Session 5Business Analyst Series 2023 -  Week 3 Session 5
Business Analyst Series 2023 - Week 3 Session 5DianaGray10
248 views20 slides
SAP Automation Using Bar Code and FIORI.pdf by
SAP Automation Using Bar Code and FIORI.pdfSAP Automation Using Bar Code and FIORI.pdf
SAP Automation Using Bar Code and FIORI.pdfVirendra Rai, PMP
23 views38 slides
Network Source of Truth and Infrastructure as Code revisited by
Network Source of Truth and Infrastructure as Code revisitedNetwork Source of Truth and Infrastructure as Code revisited
Network Source of Truth and Infrastructure as Code revisitedNetwork Automation Forum
26 views45 slides

Recently uploaded(20)

AMAZON PRODUCT RESEARCH.pdf by JerikkLaureta
AMAZON PRODUCT RESEARCH.pdfAMAZON PRODUCT RESEARCH.pdf
AMAZON PRODUCT RESEARCH.pdf
JerikkLaureta26 views
Business Analyst Series 2023 - Week 3 Session 5 by DianaGray10
Business Analyst Series 2023 -  Week 3 Session 5Business Analyst Series 2023 -  Week 3 Session 5
Business Analyst Series 2023 - Week 3 Session 5
DianaGray10248 views
SAP Automation Using Bar Code and FIORI.pdf by Virendra Rai, PMP
SAP Automation Using Bar Code and FIORI.pdfSAP Automation Using Bar Code and FIORI.pdf
SAP Automation Using Bar Code and FIORI.pdf
Igniting Next Level Productivity with AI-Infused Data Integration Workflows by Safe Software
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Safe Software263 views
Empathic Computing: Delivering the Potential of the Metaverse by Mark Billinghurst
Empathic Computing: Delivering  the Potential of the MetaverseEmpathic Computing: Delivering  the Potential of the Metaverse
Empathic Computing: Delivering the Potential of the Metaverse
Mark Billinghurst478 views
STKI Israeli Market Study 2023 corrected forecast 2023_24 v3.pdf by Dr. Jimmy Schwarzkopf
STKI Israeli Market Study 2023   corrected forecast 2023_24 v3.pdfSTKI Israeli Market Study 2023   corrected forecast 2023_24 v3.pdf
STKI Israeli Market Study 2023 corrected forecast 2023_24 v3.pdf
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors by sugiuralab
TouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective SensorsTouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective Sensors
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors
sugiuralab19 views
ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ... by Jasper Oosterveld
ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ...ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ...
ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ...
Special_edition_innovator_2023.pdf by WillDavies22
Special_edition_innovator_2023.pdfSpecial_edition_innovator_2023.pdf
Special_edition_innovator_2023.pdf
WillDavies2217 views
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N... by James Anderson
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
James Anderson85 views
handbook for web 3 adoption.pdf by Liveplex
handbook for web 3 adoption.pdfhandbook for web 3 adoption.pdf
handbook for web 3 adoption.pdf
Liveplex22 views

Harvesting and semantically tagging media releases from political websites using web services

  • 1. Harvesting and semantically tagging media releases from political websites using web services Peter Neish, Systems Officer Victorian Parliamentary Library @peterneish
  • 2.
  • 3.
  • 4.
  • 5. Number of Media Releases per year 0 1000 2000 3000 4000 5000 6000 7000 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010
  • 6. Media releases by party 0 500 1000 1500 2000 2500 3000 3500 4000 4500 5000 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 ALP Coalition Green Independent
  • 7.
  • 8.
  • 9. What we built Polls RSS feed for links DB Textworks wkhtml2pdf Servlet Metadata
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15. Number of Tags assigned by OpenCalais 0 500 1000 1500 2000 2500 3000 3500 4000 4500 0 20 40 60 80 100 120 Tags per item Total number
  • 17. Tag Quality 85% 4% 6% 5% Correct Tags Incorrect Tags Repeated Tags Redundant Tags
  • 18.
  • 19.
  • 20.

Editor's Notes

  1. Talk about the Parliamentary Library: Established in 1851, building itself 1858–60
  2. What will be covered in today’s talk