Developing a webarchiving strategy for national movements in Flanders

Tom Cobbaert
Tom CobbaertArchivist at ADVN / NISE / ArchivA
Developing a web archiving strategy for
national movements in Flanders (and Europe)
Developing a web archiving
strategy for national
movements in Flanders (and
Europe)
Tom Cobbaert (ADVN)
ICA/SPP conference
Berlin, 28-30 October 2015
Developing a web archiving strategy for
national movements in Flanders (and Europe)
ADVN: organisation
Developing a web archiving strategy for
national movements in Flanders (and Europe)
• founded in 1984
– by historians and representatives of the Flemish
movement
• non-profit organisation (vzw/asbl)
– 15 FTE’s
• private archives
– archives of persons, organisations, political parties
• funding by the Flemish government
– as a cultural archive, a “collection-managing cultural-
heritage organisation of nationwide importance”
• local, national and international collaboration
ADVN: organisation
Developing a web archiving strategy for
national movements in Flanders (and Europe)
ADVN: collections
Developing a web archiving strategy for
national movements in Flanders (and Europe)
ADVN: archives and research centre for
Flemish-nationalism
[°WW1 / nationbuilding / radical, anti-Belgian, separatist /
specific political parties]
Flemish movement
[°19th c. / emancipation (language, culture, socio-ec.) /
general and pragmatic / broad movement]
National movements in Europe
+ theory on nationalism, national identity, nation building
ADVN: collections > profile
Developing a web archiving strategy for
national movements in Flanders (and Europe)
ADVN: collections > numbers
[at 31/12/2014]
• transfers: 11842 in total (1984-2014)
• archives (paper): approx. 6350 m
• archives (digital): approx. 6 TB
• audiovisual archives: 67616 items
• books & brochures: 51486 titles
• periodicals: 11417 titles
Developing a web archiving strategy for
national movements in Flanders (and Europe)
ADVN: core functions
Developing a web archiving strategy for
national movements in Flanders (and Europe)
ADVN: core functions
• acquisition
– based on archival provenance
• management
– storage, processing, preservation and conservation
• facilitating research
– projects (in collaboration with other archives, research
institutions and universities)
– hosting scientific journal Wetenschappelijke tijdingen
• public services
– reading room and website access to collections
– conferences, lectures, exhibitions, guided tours,
ADVN-Mededelingen magazine
Developing a web archiving strategy for
national movements in Flanders (and Europe)
ADVN: core functions
• coordination centre of NISE (www.nise.eu)
“National movements and Intermediary
Structures in Europe” (°2009)
– international platform for transnational and
comparative research on nationalism, national and
regional movements in Europe
– network of 40+ research and heritage institutions
– developing DIANE: digital research infrastructure
– organising conferences, lectures, seminars, workshops
– publications: Studies on National Movements (open
access journal), Proceedings, Monographs
– services: archival consultancy, data management
Developing a web archiving strategy for
national movements in Flanders (and Europe)
ADVN & web archiving
Developing a web archiving strategy for
national movements in Flanders (and Europe)
ADVN & web archiving (2005-2015)
• 2005-2006: experimental project
– archiving a random selection of nationalist party and
politician websites
– harvest using (Win)HTTRack
• 2007-today: collection of digital periodicals
– newsletters via e-mail or websites
– active acquisition + retroactive harvesting
– 300+ titles
• 2011: EFA social media project
– mapping social media of EFA member parties
– training on archiving tools for social media
Developing a web archiving strategy for
national movements in Flanders (and Europe)
ADVN & web archiving (2005-2015)
• 2014: need for a (new) digital collection strategy
– internal reorganisation of ADVN + decreased funding
– foundation of VIAA (2013) and start of mass-
digitisation projects (AV-archives and WW1-press)
– increasing demand for digital access to collections
• 2015: developing 5-point action plan
– digital document management training
– active digital acquisition (incl. web and social
media)
– 2-track digitisation: collaborative + on-demand
– (shared) digital preservation infrastructure
– digital collection tools
Developing a web archiving strategy for
national movements in Flanders (and Europe)
web archiving strategy
Developing a web archiving strategy for
national movements in Flanders (and Europe)
web archiving strategy
• developing a strategy for web archiving:
– Approach: what?
– Collaboration: who?
– Tools: how?
– Issues:
• permission by author, creator and provider
• authenticy, integrity and quality control
• providing access and the law
• preservation
Developing a web archiving strategy for
national movements in Flanders (and Europe)
web archiving strategy: approach
Developing a web archiving strategy for
national movements in Flanders (and Europe)
web archiving strategy: approach
• selective harvesting:
– “representative selection of organisations and
persons (considered) belonging to the broad Flemish
movement and acting on a nationwide level”
– associations: political parties (N-VA, VB),
organisations and action groups
– persons: members of parliament (VL, BE, EU) + other
– on regular basis (quarterly+ elections)
• from Flanders to Europe:
– consolidate harvest for Flemish movement
– ambition to expand to other national movements
Developing a web archiving strategy for
national movements in Flanders (and Europe)
web archiving strategy: approach
• technical:
– client-side harvest
– server-side harvest: (limited) fallback option. Focuses
on html for static sites and database exports for
dynamic sites
• services:
– websites (incl. blogs)
– Twitter (public accounts)
– Facebook (pages)
Developing a web archiving strategy for
national movements in Flanders (and Europe)
web archiving strategy: collaboration
Developing a web archiving strategy for
national movements in Flanders (and Europe)
web archiving strategy: collaboration
• no (known) national/domain archiving in
Flanders or Belgium:
– formal collaboration between national library (KBR)
and state archives (ARA) remains inactive/undercover
– research project on legal deposit of Flemish electronic
publications, incl. websites (2015-2016)
– most known webarchiving initiatives are limited:
• FelixArchief: websites & social media managed by the City of
Antwerp and its agencies
• University Library Ghent: websites & social media of UGent
• Flemish Government: websites of government agencies
Developing a web archiving strategy for
national movements in Flanders (and Europe)
web archiving strategy: collaboration
• international initiatives (relevant to ADVN):
– Internet Archive:
• best known worldwide webarchiving initiative (1996-today)
• most extensive resource for Belgian websites
• only crawl the surface of the web (random test against ADVN
selection showed ca. 40% of sites were not archived)
– ArchiveTeam:
• “a loose collective of rogue archivists, programmers, writers
and loudmouths dedicated to saving our digital heritage”
• first emerged in 2009 when Yahoo! decided to terminate
GeoCities and continued since archiving user-generated
content hosted at ‘doomed’ internet services
• collaborate with the Internet Archive (upload/backup)
Developing a web archiving strategy for
national movements in Flanders (and Europe)
web archiving strategy: tools
Developing a web archiving strategy for
national movements in Flanders (and Europe)
web archiving strategy: tools
• 2005-2006 project used HTTrack
– user-friendly, open source crawler and browser
– does not support WARC (Web ARChive) file format
• currently testing (keeping options open):
– Web Curator Tool (workflow + Heritrix + Wayback)
– Wget (with WARC output) + Wayback
– HTTrack + HTTrack2ARC + Wayback (for existing
harvests)
Developing a web archiving strategy for
national movements in Flanders (and Europe)
web archiving strategy: issues
Developing a web archiving strategy for
national movements in Flanders (and Europe)
web archiving strategy: issues
• permission of author?
– permission-based or “online information is public”
– right to be forgotten vs right on information
• permission of creator?
– e.g. copyrighted design or proprietary CMS
• permission of service provider?
– e.g. Twitter blocking API in Politwoops case
need to keep balance between
position of author and researcher
Developing a web archiving strategy for
national movements in Flanders (and Europe)
web archiving strategy: issues
• shifting authenticity?
– as many browers/technologies, as many possible
representations of content
• maintaining integrity?
– broken links + links to external content (images,
video)
• managing quality control?
– time consuming evaluation
need for pragmatic policies
Developing a web archiving strategy for
national movements in Flanders (and Europe)
web archiving strategy: issues
• providing (online) access and the (Belgian)
law:
– copyright: permission author is needed (until 70
years after death)
• permission-based harvest = solution?
• what about: multiple editors, webdesigners, media (used
with/out permission), illegal content
– privacy: any re-use of personal data is prohibited
• broad definition of personal data > almost every website
• legal solution: acces limited to intra-muros
need for a better legislative context
Developing a web archiving strategy for
national movements in Flanders (and Europe)
web archiving strategy: issues
• preservation problems?
– server dependency of dynamic sites
– wide range of file formats
– persistence of link structure (names!)
– durability of WARC as an archiving standard
need for nationwide action
& international collaboration
on long-term preservation
Developing a web archiving strategy for
national movements in Flanders (and Europe)
web archiving strategy: issues
• selection!
– specialist thematic curation vs holistic harvest
(flemish-nationalist or far-right parties and
organisations generally don’t use .be-domain or clear
findable websites, rather .org, .eu or general services)
Developing a web archiving strategy for
national movements in Flanders (and Europe)
Questions?
Tom Cobbaert
Archivist | Head of Collections
ADVN vzw
Lange Leemstraat 26
2018 Antwerp
www.advn.be
[Email] tom.cobbaert@advn.be
[Twitter] @tomcobbaert
1 of 29

Recommended

Investigating the PROMISE of a Belgian web archive by
Investigating the PROMISE of a Belgian web archive Investigating the PROMISE of a Belgian web archive
Investigating the PROMISE of a Belgian web archive Sally Chambers
304 views43 slides
Europeana Network Association Members Council Meeting 2019, The Hague by Emil... by
Europeana Network Association Members Council Meeting 2019, The Hague by Emil...Europeana Network Association Members Council Meeting 2019, The Hague by Emil...
Europeana Network Association Members Council Meeting 2019, The Hague by Emil...Europeana
175 views22 slides
Luis Ferraro - DG CONNECT - culture and creativity in the digital realm 062013 by
Luis Ferraro - DG CONNECT - culture and creativity in the digital realm 062013Luis Ferraro - DG CONNECT - culture and creativity in the digital realm 062013
Luis Ferraro - DG CONNECT - culture and creativity in the digital realm 062013Europeana Licensing
1.1K views24 slides
Consolidating Openness : Developing Rijksmuseum Research Services by
Consolidating Openness : Developing Rijksmuseum Research ServicesConsolidating Openness : Developing Rijksmuseum Research Services
Consolidating Openness : Developing Rijksmuseum Research ServicesSaskia Scheltjens
1K views42 slides
Promoting Austrian Cultural and Scientific Heritage via EUROPEANA by
Promoting Austrian Cultural and Scientific Heritage via EUROPEANAPromoting Austrian Cultural and Scientific Heritage via EUROPEANA
Promoting Austrian Cultural and Scientific Heritage via EUROPEANAEuropeanaConnect
1.4K views38 slides
Europeana 2019 - Connect Communities - 29 November 2019 - Auditorium by
Europeana 2019 - Connect Communities - 29 November 2019 - AuditoriumEuropeana 2019 - Connect Communities - 29 November 2019 - Auditorium
Europeana 2019 - Connect Communities - 29 November 2019 - AuditoriumEuropeana
418 views114 slides

More Related Content

What's hot

Automatic publication of library and museum data into the semantic web: the d... by
Automatic publication of library and museum data into the semantic web: the d...Automatic publication of library and museum data into the semantic web: the d...
Automatic publication of library and museum data into the semantic web: the d...horvadam
369 views42 slides
Why join Europeana? by
Why join Europeana?Why join Europeana?
Why join Europeana?Europeana
11.6K views22 slides
Geographic Information in the Carare and Athena Projects by
Geographic Information in the Carare and Athena ProjectsGeographic Information in the Carare and Athena Projects
Geographic Information in the Carare and Athena ProjectsCARARE
432 views40 slides
From Research Library to Research Services by
From Research Library to Research ServicesFrom Research Library to Research Services
From Research Library to Research ServicesSaskia Scheltjens
825 views51 slides
Digital Cultural Heritage and the new EU Framework Programme by
Digital Cultural Heritage and the new EU Framework ProgrammeDigital Cultural Heritage and the new EU Framework Programme
Digital Cultural Heritage and the new EU Framework Programmelocloud
1.5K views38 slides
From Catalogue 2.0 to the digital humanities: exploring the future of librari... by
From Catalogue 2.0 to the digital humanities: exploring the future of librari...From Catalogue 2.0 to the digital humanities: exploring the future of librari...
From Catalogue 2.0 to the digital humanities: exploring the future of librari...Sally Chambers
948 views94 slides

What's hot(20)

Automatic publication of library and museum data into the semantic web: the d... by horvadam
Automatic publication of library and museum data into the semantic web: the d...Automatic publication of library and museum data into the semantic web: the d...
Automatic publication of library and museum data into the semantic web: the d...
horvadam369 views
Why join Europeana? by Europeana
Why join Europeana?Why join Europeana?
Why join Europeana?
Europeana11.6K views
Geographic Information in the Carare and Athena Projects by CARARE
Geographic Information in the Carare and Athena ProjectsGeographic Information in the Carare and Athena Projects
Geographic Information in the Carare and Athena Projects
CARARE432 views
From Research Library to Research Services by Saskia Scheltjens
From Research Library to Research ServicesFrom Research Library to Research Services
From Research Library to Research Services
Saskia Scheltjens825 views
Digital Cultural Heritage and the new EU Framework Programme by locloud
Digital Cultural Heritage and the new EU Framework ProgrammeDigital Cultural Heritage and the new EU Framework Programme
Digital Cultural Heritage and the new EU Framework Programme
locloud1.5K views
From Catalogue 2.0 to the digital humanities: exploring the future of librari... by Sally Chambers
From Catalogue 2.0 to the digital humanities: exploring the future of librari...From Catalogue 2.0 to the digital humanities: exploring the future of librari...
From Catalogue 2.0 to the digital humanities: exploring the future of librari...
Sally Chambers948 views
EdReNe Presentation May 2010 by UNI-C
EdReNe Presentation May 2010EdReNe Presentation May 2010
EdReNe Presentation May 2010
UNI-C341 views
Clare Lanigan - Presentation to IES Students by dri_ireland
Clare Lanigan - Presentation to IES StudentsClare Lanigan - Presentation to IES Students
Clare Lanigan - Presentation to IES Students
dri_ireland241 views
2017 IIIF Conference - The Vatican - SACHA by Georg Petz
2017 IIIF Conference - The Vatican - SACHA2017 IIIF Conference - The Vatican - SACHA
2017 IIIF Conference - The Vatican - SACHA
Georg Petz246 views
French Presidency - 1 march 2022 by Europeana
French Presidency - 1 march 2022French Presidency - 1 march 2022
French Presidency - 1 march 2022
Europeana274 views
Cultural Heritage & H2020 by locloud
Cultural Heritage & H2020Cultural Heritage & H2020
Cultural Heritage & H2020
locloud844 views
Europeana Network Association AGM 2017 - 6 December - Highlights 2017 by Europeana
Europeana Network Association AGM 2017 - 6 December - Highlights 2017Europeana Network Association AGM 2017 - 6 December - Highlights 2017
Europeana Network Association AGM 2017 - 6 December - Highlights 2017
Europeana98 views

Viewers also liked

Digitale Encyclopedie van de Vlaamse Beweging by
Digitale Encyclopedie van de Vlaamse BewegingDigitale Encyclopedie van de Vlaamse Beweging
Digitale Encyclopedie van de Vlaamse BewegingTom Cobbaert
516 views3 slides
EFA 2.0 - How minorities, autonomists and independentists use social media an... by
EFA 2.0 - How minorities, autonomists and independentists use social media an...EFA 2.0 - How minorities, autonomists and independentists use social media an...
EFA 2.0 - How minorities, autonomists and independentists use social media an...Tom Cobbaert
509 views54 slides
State of the Archives: questionnaire on the archives and heritage of UNPO by
State of the Archives: questionnaire on the archives and heritage of UNPOState of the Archives: questionnaire on the archives and heritage of UNPO
State of the Archives: questionnaire on the archives and heritage of UNPOTom Cobbaert
617 views39 slides
De ontsluiting van het archief Maarten Van Severen | AtoM: out-of-the-box, in... by
De ontsluiting van het archief Maarten Van Severen | AtoM: out-of-the-box, in...De ontsluiting van het archief Maarten Van Severen | AtoM: out-of-the-box, in...
De ontsluiting van het archief Maarten Van Severen | AtoM: out-of-the-box, in...Tom Cobbaert
451 views19 slides
ADVN - archief en onderzoekscentrum by
ADVN - archief en onderzoekscentrumADVN - archief en onderzoekscentrum
ADVN - archief en onderzoekscentrumTom Cobbaert
746 views21 slides
Bekegems erfgoed by
Bekegems erfgoedBekegems erfgoed
Bekegems erfgoedTom Cobbaert
1.3K views8 slides

Viewers also liked(19)

Digitale Encyclopedie van de Vlaamse Beweging by Tom Cobbaert
Digitale Encyclopedie van de Vlaamse BewegingDigitale Encyclopedie van de Vlaamse Beweging
Digitale Encyclopedie van de Vlaamse Beweging
Tom Cobbaert516 views
EFA 2.0 - How minorities, autonomists and independentists use social media an... by Tom Cobbaert
EFA 2.0 - How minorities, autonomists and independentists use social media an...EFA 2.0 - How minorities, autonomists and independentists use social media an...
EFA 2.0 - How minorities, autonomists and independentists use social media an...
Tom Cobbaert509 views
State of the Archives: questionnaire on the archives and heritage of UNPO by Tom Cobbaert
State of the Archives: questionnaire on the archives and heritage of UNPOState of the Archives: questionnaire on the archives and heritage of UNPO
State of the Archives: questionnaire on the archives and heritage of UNPO
Tom Cobbaert617 views
De ontsluiting van het archief Maarten Van Severen | AtoM: out-of-the-box, in... by Tom Cobbaert
De ontsluiting van het archief Maarten Van Severen | AtoM: out-of-the-box, in...De ontsluiting van het archief Maarten Van Severen | AtoM: out-of-the-box, in...
De ontsluiting van het archief Maarten Van Severen | AtoM: out-of-the-box, in...
Tom Cobbaert451 views
ADVN - archief en onderzoekscentrum by Tom Cobbaert
ADVN - archief en onderzoekscentrumADVN - archief en onderzoekscentrum
ADVN - archief en onderzoekscentrum
Tom Cobbaert746 views
ArchiefWiki: share & conquer. Collaborative success of independent knowledge ... by Tom Cobbaert
ArchiefWiki: share & conquer. Collaborative success of independent knowledge ...ArchiefWiki: share & conquer. Collaborative success of independent knowledge ...
ArchiefWiki: share & conquer. Collaborative success of independent knowledge ...
Tom Cobbaert660 views
The Cornfield Maze: 15 years of digitisation and digital archiving in Flanders by Tom Cobbaert
The Cornfield Maze: 15 years of digitisation and digital archiving in FlandersThe Cornfield Maze: 15 years of digitisation and digital archiving in Flanders
The Cornfield Maze: 15 years of digitisation and digital archiving in Flanders
Tom Cobbaert482 views
A Wiki for Archivists? ArchiefWiki.org by Tom Cobbaert
A Wiki for Archivists? ArchiefWiki.orgA Wiki for Archivists? ArchiefWiki.org
A Wiki for Archivists? ArchiefWiki.org
Tom Cobbaert502 views
The Need for and Needs of Archives. Guide to the archives and documentation ... by Tom Cobbaert
The Need for and Needs of Archives. Guide to the archives and documentation  ...The Need for and Needs of Archives. Guide to the archives and documentation  ...
The Need for and Needs of Archives. Guide to the archives and documentation ...
Tom Cobbaert668 views
The Needs of Archives: 16 (simple) rules for a better archival management by Tom Cobbaert
The Needs of Archives: 16 (simple) rules for a better archival managementThe Needs of Archives: 16 (simple) rules for a better archival management
The Needs of Archives: 16 (simple) rules for a better archival management
Tom Cobbaert897 views
ArchiefWiki: Ik weet het beter! by Tom Cobbaert
ArchiefWiki: Ik weet het beter!ArchiefWiki: Ik weet het beter!
ArchiefWiki: Ik weet het beter!
Tom Cobbaert409 views
ArchiefWiki en de eerste stappen op het semantische web by Tom Cobbaert
ArchiefWiki en de eerste stappen op het semantische webArchiefWiki en de eerste stappen op het semantische web
ArchiefWiki en de eerste stappen op het semantische web
Tom Cobbaert580 views
Vroeger was het simpel... Digitaal archiveren by Tom Cobbaert
Vroeger was het simpel... Digitaal archiverenVroeger was het simpel... Digitaal archiveren
Vroeger was het simpel... Digitaal archiveren
Tom Cobbaert1.9K views
To Tweet or not to Tweet... of het nut en onnut van web 2.0 voor archivarissen. by Tom Cobbaert
To Tweet or not to Tweet... of het nut en onnut van web 2.0 voor archivarissen.To Tweet or not to Tweet... of het nut en onnut van web 2.0 voor archivarissen.
To Tweet or not to Tweet... of het nut en onnut van web 2.0 voor archivarissen.
Tom Cobbaert1.2K views
Archief 2.0 in de praktijk: de ArchiefWiki by Tom Cobbaert
Archief 2.0 in de praktijk: de ArchiefWikiArchief 2.0 in de praktijk: de ArchiefWiki
Archief 2.0 in de praktijk: de ArchiefWiki
Tom Cobbaert494 views
Hoezo gratis? Mythes en misverstanden over open source software by Tom Cobbaert
Hoezo gratis? Mythes en misverstanden over open source softwareHoezo gratis? Mythes en misverstanden over open source software
Hoezo gratis? Mythes en misverstanden over open source software
Tom Cobbaert455 views

Similar to Developing a webarchiving strategy for national movements in Flanders

Developing a national digital library stapel - meijers 20160302 by
Developing a national digital library   stapel - meijers 20160302Developing a national digital library   stapel - meijers 20160302
Developing a national digital library stapel - meijers 20160302Enno Meijers
1.1K views28 slides
20190304_shifting_minds_open_belgium_2019 by
20190304_shifting_minds_open_belgium_201920190304_shifting_minds_open_belgium_2019
20190304_shifting_minds_open_belgium_2019Samuel Donvil
46 views66 slides
20190304 shifting minds_open_belgium_2019 by
20190304 shifting minds_open_belgium_201920190304 shifting minds_open_belgium_2019
20190304 shifting minds_open_belgium_2019PACKED vzw
397 views66 slides
Shifting minds open belgium 2019 by
Shifting minds open belgium 2019Shifting minds open belgium 2019
Shifting minds open belgium 2019meemoo, Vlaams instituut voor het archief
139 views66 slides
20190304 shifting minds open belgium 2019 by
20190304 shifting minds open belgium 201920190304 shifting minds open belgium 2019
20190304 shifting minds open belgium 2019meemoo, Vlaams instituut voor het archief
22 views66 slides
Copyright challenges and policy choices in European heritage projects Tools, ... by
Copyright challenges and policy choices in European heritage projects Tools, ...Copyright challenges and policy choices in European heritage projects Tools, ...
Copyright challenges and policy choices in European heritage projects Tools, ...Phonothèque MMSH
5.6K views56 slides

Similar to Developing a webarchiving strategy for national movements in Flanders(20)

Developing a national digital library stapel - meijers 20160302 by Enno Meijers
Developing a national digital library   stapel - meijers 20160302Developing a national digital library   stapel - meijers 20160302
Developing a national digital library stapel - meijers 20160302
Enno Meijers1.1K views
20190304_shifting_minds_open_belgium_2019 by Samuel Donvil
20190304_shifting_minds_open_belgium_201920190304_shifting_minds_open_belgium_2019
20190304_shifting_minds_open_belgium_2019
Samuel Donvil46 views
20190304 shifting minds_open_belgium_2019 by PACKED vzw
20190304 shifting minds_open_belgium_201920190304 shifting minds_open_belgium_2019
20190304 shifting minds_open_belgium_2019
PACKED vzw397 views
Copyright challenges and policy choices in European heritage projects Tools, ... by Phonothèque MMSH
Copyright challenges and policy choices in European heritage projects Tools, ...Copyright challenges and policy choices in European heritage projects Tools, ...
Copyright challenges and policy choices in European heritage projects Tools, ...
Phonothèque MMSH5.6K views
Ocd impact analysis presentation gla mwiki 2015 by Jesse de Vos
Ocd impact analysis presentation gla mwiki 2015Ocd impact analysis presentation gla mwiki 2015
Ocd impact analysis presentation gla mwiki 2015
Jesse de Vos1K views
The Effect of ARIADNE: A Success Story Why ARIADNE Counts by ariadnenetwork
The Effect of ARIADNE: A Success Story Why ARIADNE Counts The Effect of ARIADNE: A Success Story Why ARIADNE Counts
The Effect of ARIADNE: A Success Story Why ARIADNE Counts
ariadnenetwork649 views
Europeana Essentials (updated June 2014) by Europeana
Europeana Essentials (updated June 2014)Europeana Essentials (updated June 2014)
Europeana Essentials (updated June 2014)
Europeana2.2K views
Europeana essentials June 2013 by Europeana
Europeana essentials June 2013Europeana essentials June 2013
Europeana essentials June 2013
Europeana639 views
Europeana essentials August 2013 by Europeana
Europeana essentials August 2013Europeana essentials August 2013
Europeana essentials August 2013
Europeana1K views
Everything you need to know about Europeana by Douglas McCarthy
Everything you need to know about EuropeanaEverything you need to know about Europeana
Everything you need to know about Europeana
Douglas McCarthy81 views
Europeana Fashion presentation @eurfashion14 by Marco Rendina
Europeana Fashion presentation @eurfashion14Europeana Fashion presentation @eurfashion14
Europeana Fashion presentation @eurfashion14
Marco Rendina843 views
Europeana Creative - What is this Europeana thing? by Europeana
Europeana Creative - What is this Europeana thing?Europeana Creative - What is this Europeana thing?
Europeana Creative - What is this Europeana thing?
Europeana447 views

Recently uploaded

Web Dev - 1 PPT.pdf by
Web Dev - 1 PPT.pdfWeb Dev - 1 PPT.pdf
Web Dev - 1 PPT.pdfgdsczhcet
52 views45 slides
Tunable Laser (1).pptx by
Tunable Laser (1).pptxTunable Laser (1).pptx
Tunable Laser (1).pptxHajira Mahmood
21 views37 slides
Architecting CX Measurement Frameworks and Ensuring CX Metrics are fit for Pu... by
Architecting CX Measurement Frameworks and Ensuring CX Metrics are fit for Pu...Architecting CX Measurement Frameworks and Ensuring CX Metrics are fit for Pu...
Architecting CX Measurement Frameworks and Ensuring CX Metrics are fit for Pu...NUS-ISS
32 views54 slides
Roadmap to Become Experts.pptx by
Roadmap to Become Experts.pptxRoadmap to Become Experts.pptx
Roadmap to Become Experts.pptxdscwidyatamanew
11 views45 slides
AMAZON PRODUCT RESEARCH.pdf by
AMAZON PRODUCT RESEARCH.pdfAMAZON PRODUCT RESEARCH.pdf
AMAZON PRODUCT RESEARCH.pdfJerikkLaureta
14 views13 slides
Igniting Next Level Productivity with AI-Infused Data Integration Workflows by
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Safe Software
91 views86 slides

Recently uploaded(20)

Web Dev - 1 PPT.pdf by gdsczhcet
Web Dev - 1 PPT.pdfWeb Dev - 1 PPT.pdf
Web Dev - 1 PPT.pdf
gdsczhcet52 views
Architecting CX Measurement Frameworks and Ensuring CX Metrics are fit for Pu... by NUS-ISS
Architecting CX Measurement Frameworks and Ensuring CX Metrics are fit for Pu...Architecting CX Measurement Frameworks and Ensuring CX Metrics are fit for Pu...
Architecting CX Measurement Frameworks and Ensuring CX Metrics are fit for Pu...
NUS-ISS32 views
AMAZON PRODUCT RESEARCH.pdf by JerikkLaureta
AMAZON PRODUCT RESEARCH.pdfAMAZON PRODUCT RESEARCH.pdf
AMAZON PRODUCT RESEARCH.pdf
JerikkLaureta14 views
Igniting Next Level Productivity with AI-Infused Data Integration Workflows by Safe Software
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Safe Software91 views
DALI Basics Course 2023 by Ivory Egg
DALI Basics Course  2023DALI Basics Course  2023
DALI Basics Course 2023
Ivory Egg14 views
Empathic Computing: Delivering the Potential of the Metaverse by Mark Billinghurst
Empathic Computing: Delivering  the Potential of the MetaverseEmpathic Computing: Delivering  the Potential of the Metaverse
Empathic Computing: Delivering the Potential of the Metaverse
Mark Billinghurst449 views
Special_edition_innovator_2023.pdf by WillDavies22
Special_edition_innovator_2023.pdfSpecial_edition_innovator_2023.pdf
Special_edition_innovator_2023.pdf
WillDavies2214 views
Transcript: The Details of Description Techniques tips and tangents on altern... by BookNet Canada
Transcript: The Details of Description Techniques tips and tangents on altern...Transcript: The Details of Description Techniques tips and tangents on altern...
Transcript: The Details of Description Techniques tips and tangents on altern...
BookNet Canada119 views
Black and White Modern Science Presentation.pptx by maryamkhalid2916
Black and White Modern Science Presentation.pptxBlack and White Modern Science Presentation.pptx
Black and White Modern Science Presentation.pptx
maryamkhalid291614 views
Attacking IoT Devices from a Web Perspective - Linux Day by Simone Onofri
Attacking IoT Devices from a Web Perspective - Linux Day Attacking IoT Devices from a Web Perspective - Linux Day
Attacking IoT Devices from a Web Perspective - Linux Day
Simone Onofri15 views
.conf Go 2023 - Data analysis as a routine by Splunk
.conf Go 2023 - Data analysis as a routine.conf Go 2023 - Data analysis as a routine
.conf Go 2023 - Data analysis as a routine
Splunk90 views
[2023] Putting the R! in R&D.pdf by Eleanor McHugh
[2023] Putting the R! in R&D.pdf[2023] Putting the R! in R&D.pdf
[2023] Putting the R! in R&D.pdf
Eleanor McHugh38 views
Upskilling the Evolving Workforce with Digital Fluency for Tomorrow's Challen... by NUS-ISS
Upskilling the Evolving Workforce with Digital Fluency for Tomorrow's Challen...Upskilling the Evolving Workforce with Digital Fluency for Tomorrow's Challen...
Upskilling the Evolving Workforce with Digital Fluency for Tomorrow's Challen...
NUS-ISS23 views
The Importance of Cybersecurity for Digital Transformation by NUS-ISS
The Importance of Cybersecurity for Digital TransformationThe Importance of Cybersecurity for Digital Transformation
The Importance of Cybersecurity for Digital Transformation
NUS-ISS25 views
The details of description: Techniques, tips, and tangents on alternative tex... by BookNet Canada
The details of description: Techniques, tips, and tangents on alternative tex...The details of description: Techniques, tips, and tangents on alternative tex...
The details of description: Techniques, tips, and tangents on alternative tex...
BookNet Canada110 views

Developing a webarchiving strategy for national movements in Flanders

  • 1. Developing a web archiving strategy for national movements in Flanders (and Europe) Developing a web archiving strategy for national movements in Flanders (and Europe) Tom Cobbaert (ADVN) ICA/SPP conference Berlin, 28-30 October 2015
  • 2. Developing a web archiving strategy for national movements in Flanders (and Europe) ADVN: organisation
  • 3. Developing a web archiving strategy for national movements in Flanders (and Europe) • founded in 1984 – by historians and representatives of the Flemish movement • non-profit organisation (vzw/asbl) – 15 FTE’s • private archives – archives of persons, organisations, political parties • funding by the Flemish government – as a cultural archive, a “collection-managing cultural- heritage organisation of nationwide importance” • local, national and international collaboration ADVN: organisation
  • 4. Developing a web archiving strategy for national movements in Flanders (and Europe) ADVN: collections
  • 5. Developing a web archiving strategy for national movements in Flanders (and Europe) ADVN: archives and research centre for Flemish-nationalism [°WW1 / nationbuilding / radical, anti-Belgian, separatist / specific political parties] Flemish movement [°19th c. / emancipation (language, culture, socio-ec.) / general and pragmatic / broad movement] National movements in Europe + theory on nationalism, national identity, nation building ADVN: collections > profile
  • 6. Developing a web archiving strategy for national movements in Flanders (and Europe) ADVN: collections > numbers [at 31/12/2014] • transfers: 11842 in total (1984-2014) • archives (paper): approx. 6350 m • archives (digital): approx. 6 TB • audiovisual archives: 67616 items • books & brochures: 51486 titles • periodicals: 11417 titles
  • 7. Developing a web archiving strategy for national movements in Flanders (and Europe) ADVN: core functions
  • 8. Developing a web archiving strategy for national movements in Flanders (and Europe) ADVN: core functions • acquisition – based on archival provenance • management – storage, processing, preservation and conservation • facilitating research – projects (in collaboration with other archives, research institutions and universities) – hosting scientific journal Wetenschappelijke tijdingen • public services – reading room and website access to collections – conferences, lectures, exhibitions, guided tours, ADVN-Mededelingen magazine
  • 9. Developing a web archiving strategy for national movements in Flanders (and Europe) ADVN: core functions • coordination centre of NISE (www.nise.eu) “National movements and Intermediary Structures in Europe” (°2009) – international platform for transnational and comparative research on nationalism, national and regional movements in Europe – network of 40+ research and heritage institutions – developing DIANE: digital research infrastructure – organising conferences, lectures, seminars, workshops – publications: Studies on National Movements (open access journal), Proceedings, Monographs – services: archival consultancy, data management
  • 10. Developing a web archiving strategy for national movements in Flanders (and Europe) ADVN & web archiving
  • 11. Developing a web archiving strategy for national movements in Flanders (and Europe) ADVN & web archiving (2005-2015) • 2005-2006: experimental project – archiving a random selection of nationalist party and politician websites – harvest using (Win)HTTRack • 2007-today: collection of digital periodicals – newsletters via e-mail or websites – active acquisition + retroactive harvesting – 300+ titles • 2011: EFA social media project – mapping social media of EFA member parties – training on archiving tools for social media
  • 12. Developing a web archiving strategy for national movements in Flanders (and Europe) ADVN & web archiving (2005-2015) • 2014: need for a (new) digital collection strategy – internal reorganisation of ADVN + decreased funding – foundation of VIAA (2013) and start of mass- digitisation projects (AV-archives and WW1-press) – increasing demand for digital access to collections • 2015: developing 5-point action plan – digital document management training – active digital acquisition (incl. web and social media) – 2-track digitisation: collaborative + on-demand – (shared) digital preservation infrastructure – digital collection tools
  • 13. Developing a web archiving strategy for national movements in Flanders (and Europe) web archiving strategy
  • 14. Developing a web archiving strategy for national movements in Flanders (and Europe) web archiving strategy • developing a strategy for web archiving: – Approach: what? – Collaboration: who? – Tools: how? – Issues: • permission by author, creator and provider • authenticy, integrity and quality control • providing access and the law • preservation
  • 15. Developing a web archiving strategy for national movements in Flanders (and Europe) web archiving strategy: approach
  • 16. Developing a web archiving strategy for national movements in Flanders (and Europe) web archiving strategy: approach • selective harvesting: – “representative selection of organisations and persons (considered) belonging to the broad Flemish movement and acting on a nationwide level” – associations: political parties (N-VA, VB), organisations and action groups – persons: members of parliament (VL, BE, EU) + other – on regular basis (quarterly+ elections) • from Flanders to Europe: – consolidate harvest for Flemish movement – ambition to expand to other national movements
  • 17. Developing a web archiving strategy for national movements in Flanders (and Europe) web archiving strategy: approach • technical: – client-side harvest – server-side harvest: (limited) fallback option. Focuses on html for static sites and database exports for dynamic sites • services: – websites (incl. blogs) – Twitter (public accounts) – Facebook (pages)
  • 18. Developing a web archiving strategy for national movements in Flanders (and Europe) web archiving strategy: collaboration
  • 19. Developing a web archiving strategy for national movements in Flanders (and Europe) web archiving strategy: collaboration • no (known) national/domain archiving in Flanders or Belgium: – formal collaboration between national library (KBR) and state archives (ARA) remains inactive/undercover – research project on legal deposit of Flemish electronic publications, incl. websites (2015-2016) – most known webarchiving initiatives are limited: • FelixArchief: websites & social media managed by the City of Antwerp and its agencies • University Library Ghent: websites & social media of UGent • Flemish Government: websites of government agencies
  • 20. Developing a web archiving strategy for national movements in Flanders (and Europe) web archiving strategy: collaboration • international initiatives (relevant to ADVN): – Internet Archive: • best known worldwide webarchiving initiative (1996-today) • most extensive resource for Belgian websites • only crawl the surface of the web (random test against ADVN selection showed ca. 40% of sites were not archived) – ArchiveTeam: • “a loose collective of rogue archivists, programmers, writers and loudmouths dedicated to saving our digital heritage” • first emerged in 2009 when Yahoo! decided to terminate GeoCities and continued since archiving user-generated content hosted at ‘doomed’ internet services • collaborate with the Internet Archive (upload/backup)
  • 21. Developing a web archiving strategy for national movements in Flanders (and Europe) web archiving strategy: tools
  • 22. Developing a web archiving strategy for national movements in Flanders (and Europe) web archiving strategy: tools • 2005-2006 project used HTTrack – user-friendly, open source crawler and browser – does not support WARC (Web ARChive) file format • currently testing (keeping options open): – Web Curator Tool (workflow + Heritrix + Wayback) – Wget (with WARC output) + Wayback – HTTrack + HTTrack2ARC + Wayback (for existing harvests)
  • 23. Developing a web archiving strategy for national movements in Flanders (and Europe) web archiving strategy: issues
  • 24. Developing a web archiving strategy for national movements in Flanders (and Europe) web archiving strategy: issues • permission of author? – permission-based or “online information is public” – right to be forgotten vs right on information • permission of creator? – e.g. copyrighted design or proprietary CMS • permission of service provider? – e.g. Twitter blocking API in Politwoops case need to keep balance between position of author and researcher
  • 25. Developing a web archiving strategy for national movements in Flanders (and Europe) web archiving strategy: issues • shifting authenticity? – as many browers/technologies, as many possible representations of content • maintaining integrity? – broken links + links to external content (images, video) • managing quality control? – time consuming evaluation need for pragmatic policies
  • 26. Developing a web archiving strategy for national movements in Flanders (and Europe) web archiving strategy: issues • providing (online) access and the (Belgian) law: – copyright: permission author is needed (until 70 years after death) • permission-based harvest = solution? • what about: multiple editors, webdesigners, media (used with/out permission), illegal content – privacy: any re-use of personal data is prohibited • broad definition of personal data > almost every website • legal solution: acces limited to intra-muros need for a better legislative context
  • 27. Developing a web archiving strategy for national movements in Flanders (and Europe) web archiving strategy: issues • preservation problems? – server dependency of dynamic sites – wide range of file formats – persistence of link structure (names!) – durability of WARC as an archiving standard need for nationwide action & international collaboration on long-term preservation
  • 28. Developing a web archiving strategy for national movements in Flanders (and Europe) web archiving strategy: issues • selection! – specialist thematic curation vs holistic harvest (flemish-nationalist or far-right parties and organisations generally don’t use .be-domain or clear findable websites, rather .org, .eu or general services)
  • 29. Developing a web archiving strategy for national movements in Flanders (and Europe) Questions? Tom Cobbaert Archivist | Head of Collections ADVN vzw Lange Leemstraat 26 2018 Antwerp www.advn.be [Email] tom.cobbaert@advn.be [Twitter] @tomcobbaert