Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Dan Gillean and Justin Simpson
Higher Education Archive Programme Network Meeting
London, UK– December 2, 2016
An Introduc...
Who are we?
Justin Simpson
Director, Archivematica Technical Services
Dan Gillean, MAS, MLIS
AtoM Program Manager
Who is Artefactual?
Artefactual Systems is dedicated to producing
standards-based open source web applications
for digital...
We are archivists, librarians, system administrators,
and developers that are passionate about open-
source and standards-...
Our Development Priorities
Open Source
Standards-based
Generalized for broad use
Our Development Approach
• Standards-based / follows best practices
• Open source / Creative Commons
• Multilingual suppor...
Our Business Model
The “Bounty Model”
of Open Source Business
• Maintain our applications under A-GPLv3
licenses
• Provide...
Our Services
• Hosting
• Remote technical
maintenance
• Consultation
• Data migration
• Training
• Application theming
• S...
Our Applications
https://www.accesstomemory.org
Web based application for
standards-based description and
access in a mult...
Our Applications
https://www.accesstomemory.org
Web based application for
standards-based description and
access in a mult...
Meet AtoM (hello world!)
Web based: Once installed, you only need a
modern web browser and an internet
connection to connect to the application fro...
Web-based:
platform independent
Browser-based user interface.
• Anyone with access to a browser (e.g., Chrome,
Internet Ex...
Open source:
free as in freedom
AtoM is built with open source tools
(NGINX, MySQL, Symfony,
Elasticsearch), rather than p...
Documentation is freely available
Public User Forum for troubleshooting
and community-building
Wiki with community resourc...
Standards-based description
User-friendly content standard edit templates
Templates: ISAD(G), DACS, RAD, DC, MODS, ISAAR-C...
Multi-lingual support
Translate
Content and user interface elements
Multi-repository support
per-institution theming
Upload logos and banners, change
background colors via user interface
Archivematica Integration
DIP upload to AtoM
Maintain link between Archivematica AIP
and uploaded DIP objects in AtoM
2009 2010 2011 2012 2013
0.X-BETA 1.0-BETA
FIRST
NON-BETA
RELEASE
1.1 2.01.31.2
TRILLIUM THEME
AtoM’S DEVELOPMENT
2016 2017 2018
1.x 2.22.0 2.42.3
JOB SCHEDULER
2.0.1 2.1.1
20152014
2.1
2.2.1
2012
1.3.1
CLIPBOARD
AtoM 2.4
• Full bulk im...
AtoMinstallations
1 pin per locale; only up to v2.1
You can find many more examples of AtoM sites from around the world on our wiki Users page. If
you don’t see your institut...
Meet Archivematica (hello world!)
What is Archivematica?
Archivematica is a web-
and standards-based,
open-source application
which allows your
institution ...
2009 2010 2011 2012 2013
2007: UNESCO REPORT 0.1-ALPHA
DASHBOARD
INTRODUCED
0.7
1.0
RELEASED!0.9
0.8
Bradley, K., Lei, J.,...
Standards-based
ISO 14721 (OAIS) PREMIS METS BagIT
PREMIS in METS XML
Packaged according to BagIt specifications
Virus scan, normalization report, extraction log, etc
For br...
<mets:amdSec>
<mets:techMD>
PREMIS: OBJECT
<mets:rightsMD>
PREMIS: RIGHTS
<mets:digiprovMD>
PREMIS: EVENT
<mets:digiprovMD...
Micro-services Handshakes Partnerships
Gears – Joe DeSousa.
https://www.flickr.com/photos/mustangjoe/22711070429
Metal Han...
Micro-services Architecture
Micro-services Architecture
Bulk_extractor
Clam AV
Elasticsearch
ExifTool
Ffmpeg
Fido
FITS
Gearman
gzip
Imagemagick
Inkscape
JHOVE
md5deep
MediaInfo
N...
Handshakes:
Integration not duplication
Handshakes:
AtoM
ArchivesSpace
Archivist’s Toolkit
Arkivum
Binder
CONTENTdm
Dataverse
DSpace
DuraCloud
Fedora
HPTrim
Hydra...
Partnerships
Building Community Services Together
archivesDIRECT
• Partnership with DuraSpace
• U.S. Based
• Launched August 2014
• Secure storage and
monitoring via DuraCl...
Perpetua
• Partnership with Arkivum
• U.K. Based
• Launched July 2016
• Secure storage and
monitoring via Arkivum
• Artefa...
ArchivesCANADA
Digital Preservation Service
• Partnership with The
Canadian Council of
Archives (CCA)
• Canada Based
• Lau...
Some examples of how AtoM and Archivematica are used by our global communities
AtoM and Archivematica
Use Cases
AtoM Use Cases
Medium to Large Deployment
Model (Artefactual):
• ES and MySQL deployed on separate
server
• Internal read/...
AtoM Use Cases
http://search-bcarchives.royalbcmuseum.bc.ca/
BC Archives – Royal BC Museum
AtoM Use Cases
https://archivescanada.accesstomemory.ca/
ArchivesCanada – Canadian Portal
AtoM Use Cases
https://beatoninstitute.com/
Beaton Institute
AtoM Use Cases
https://beatoninstitute.com/
Beaton Institute
https://beatoninstitute.com/
AtoM Use Cases Beaton Institute
https://beatoninstitute.com/
Archivematica Use Cases
http://atom.archives.sfu.ca/
Simon Fraser University
Building a Digital Repository with Archivemat...
Archivematica Use Cases
http://www.sfu.ca/archives/digital-repository.html
Simon Fraser University
Building a Digital Repo...
Archivematica Use Cases
http://www.sfu.ca/archives/digital-repository/dr-overview.html
Simon Fraser University
Building a ...
Archivematica Use Cases
http://www.sfu.ca/content/dam/sfu/archives/DigitalPreservation/DRArchitecture.png
Simon Fraser Uni...
Archivematica Use Cases
http://www.sfu.ca/content/dam/sfu/archives/DigitalPreservation/DRArchitecture.png
Simon Fraser Uni...
Archivematica Use Cases Simon Fraser University
Building a Digital Repository with Archivematica and AtoM
Archivematica Use Cases Simon Fraser University
Building a Digital Repository with Archivematica and AtoM
http://www.sfu.c...
Questions?
info@artefactual.com
RESOURCES
AtoM homepage: https://www.accesstomemory.org
AtoM demo: http://demo.accesstomemory.org
Roadmap: https://wiki.ac...
RESOURCES
AM homepage: https://www.archivematica.org
AM demo: http://sandbox.archivematica.org
Wiki: https://wiki.archivem...
An Introduction to AtoM, Archivematica, and Artefactual Systems
Upcoming SlideShare
Loading in …5
×

An Introduction to AtoM, Archivematica, and Artefactual Systems

1,218 views

Published on

Slides accompanying a day-long introduction to AtoM and Archivematica, presented by Dan Gillean and Justin Simpson at the UK National Archives as part of an AIM25 and Higher Education Archive Programme Network Meeting, December 2, 2016.

Published in: Technology
  • Be the first to comment

An Introduction to AtoM, Archivematica, and Artefactual Systems

  1. 1. Dan Gillean and Justin Simpson Higher Education Archive Programme Network Meeting London, UK– December 2, 2016 An Introduction to AtoM, Archivematica, and Artefactual Systems
  2. 2. Who are we? Justin Simpson Director, Archivematica Technical Services Dan Gillean, MAS, MLIS AtoM Program Manager
  3. 3. Who is Artefactual? Artefactual Systems is dedicated to producing standards-based open source web applications for digital preservation, description, and access. We are the lead developers of AtoM (for archival description and access) and Archivematica (for managing digital preservation workflows).
  4. 4. We are archivists, librarians, system administrators, and developers that are passionate about open- source and standards-based systems. We are also one of the most hard-working and respected technical crews in the archives and library community. We put out and support several Archivematica and AtoM releases a year and deliver technical services to a growing list of satisfied clients. Our Team_
  5. 5. Our Development Priorities Open Source Standards-based Generalized for broad use
  6. 6. Our Development Approach • Standards-based / follows best practices • Open source / Creative Commons • Multilingual support whenever possible • Generalize specific use cases • Include all features in public release • Iterative development via multiple contributions over subsequent releases Community-based Development
  7. 7. Our Business Model The “Bounty Model” of Open Source Business • Maintain our applications under A-GPLv3 licenses • Provide and maintain the documentation under CC-BY-SA licenses • Produce additional resources (e.g. videos, presentations, webinars) whenever possible • Participate actively in the user forums • Offer additional paid services • Always include development in public project
  8. 8. Our Services • Hosting • Remote technical maintenance • Consultation • Data migration • Training • Application theming • Software development https://www.artefactual.com/services/
  9. 9. Our Applications https://www.accesstomemory.org Web based application for standards-based description and access in a multilingual, multi- repository environment Web based application to support digital preservation workflows based on the OAIS reference model https://www.archivematica.org
  10. 10. Our Applications https://www.accesstomemory.org Web based application for standards-based description and access in a multilingual, multi- repository environment Web based application to support digital preservation workflows based on the OAIS reference model https://www.archivematica.org
  11. 11. Meet AtoM (hello world!)
  12. 12. Web based: Once installed, you only need a modern web browser and an internet connection to connect to the application from anywhere Standards-based: AtoM implements existing national and international archival content and metadata transmission standards and best practices, so your data is standards compliant and interoperable Multilingual: Supports translations of both content and user interface elements, can be used as a multilingual catalogue Multi-repository: Can be used as a portal site, content aggregator, or union catalogue to provide access to content from multiple institutions What is AtoM?AtoM stands for Access to Memory It is a web-based, open source application for standards-based archival description and access in a multilingual, multi- repository environment.
  13. 13. Web-based: platform independent Browser-based user interface. • Anyone with access to a browser (e.g., Chrome, Internet Explorer, Firefox, Safari etc.) has access to all the features and functionality of the AtoM application. Platform independent application. • The application runs on a web server that can be installed and run on many platforms.
  14. 14. Open source: free as in freedom AtoM is built with open source tools (NGINX, MySQL, Symfony, Elasticsearch), rather than proprietary (i.e., closed-source) ones. The underlying software code of AtoM is open source. Free to use Free to modify Free to share
  15. 15. Documentation is freely available Public User Forum for troubleshooting and community-building Wiki with community resources, example users, etc. YouTube video tutorials and webinar recordings Open source: free as in freedom
  16. 16. Standards-based description User-friendly content standard edit templates Templates: ISAD(G), DACS, RAD, DC, MODS, ISAAR-CPF, ISDIAH, ISDF 
  17. 17. Multi-lingual support Translate Content and user interface elements
  18. 18. Multi-repository support per-institution theming Upload logos and banners, change background colors via user interface
  19. 19. Archivematica Integration DIP upload to AtoM Maintain link between Archivematica AIP and uploaded DIP objects in AtoM
  20. 20. 2009 2010 2011 2012 2013 0.X-BETA 1.0-BETA FIRST NON-BETA RELEASE 1.1 2.01.31.2 TRILLIUM THEME AtoM’S DEVELOPMENT
  21. 21. 2016 2017 2018 1.x 2.22.0 2.42.3 JOB SCHEDULER 2.0.1 2.1.1 20152014 2.1 2.2.1 2012 1.3.1 CLIPBOARD AtoM 2.4 • Full bulk import / export via the user interface • Search index improvements • Authority records and repositories on the Clipboard AtoM’S DEVELOPMENT
  22. 22. AtoMinstallations 1 pin per locale; only up to v2.1
  23. 23. You can find many more examples of AtoM sites from around the world on our wiki Users page. If you don’t see your institution’s AtoM installation listed here and would like to, please send us an email and we will be happy to add it! https://wiki.accesstomemory.org/Community/Users
  24. 24. Meet Archivematica (hello world!)
  25. 25. What is Archivematica? Archivematica is a web- and standards-based, open-source application which allows your institution to preserve long-term access to trustworthy, authentic and reliable digital content. Standards based Open source Customizable Integrated w 3rd party systems Active community
  26. 26. 2009 2010 2011 2012 2013 2007: UNESCO REPORT 0.1-ALPHA DASHBOARD INTRODUCED 0.7 1.0 RELEASED!0.9 0.8 Bradley, K., Lei, J., Blackall, C. Towards An Open Source Archival Repository and Preservation System (2007) Planning and development begin. Initial Funding via UNESCO MotW Subcommittee, IMF Archives, City of Vancouver Archives 0.6-ALPHA February 2010 May 2010 February 2011 February 2012 PREMIS in METS 0.10 April 2013 August 2012 STORAGE SERVICE 0.2 January 2014 Archivematica’s development
  27. 27. Standards-based ISO 14721 (OAIS) PREMIS METS BagIT
  28. 28. PREMIS in METS XML Packaged according to BagIt specifications Virus scan, normalization report, extraction log, etc For browsing in Archivematica Original + normalized objects, submission docs, original metadata included at SIP creation Archivematica AIP structure
  29. 29. <mets:amdSec> <mets:techMD> PREMIS: OBJECT <mets:rightsMD> PREMIS: RIGHTS <mets:digiprovMD> PREMIS: EVENT <mets:digiprovMD> PREMIS: AGENT METS SECTIONS <metsHdr> METS header <dmdSec> Descriptive metadata <amdSec> Administrative metadata <fileSec> File section <structMap> Structural Map PREMIS in METS
  30. 30. Micro-services Handshakes Partnerships Gears – Joe DeSousa. https://www.flickr.com/photos/mustangjoe/22711070429 Metal Handshake – Grey Geezer. https://commons.wikimedia.org/wiki/File:Metal_Handshake.jpg Hands Passing Baton - tableatny, https://www.flickr.com/photos/53370644@N06/4976497160 Do one thing well…Inside and Out
  31. 31. Micro-services Architecture
  32. 32. Micro-services Architecture
  33. 33. Bulk_extractor Clam AV Elasticsearch ExifTool Ffmpeg Fido FITS Gearman gzip Imagemagick Inkscape JHOVE md5deep MediaInfo NFS-common Python-lxml Siegfried unar …and more… Micro-services: Tools Used
  34. 34. Handshakes: Integration not duplication
  35. 35. Handshakes: AtoM ArchivesSpace Archivist’s Toolkit Arkivum Binder CONTENTdm Dataverse DSpace DuraCloud Fedora HPTrim Hydra Islandora LOCKSS OpenStack Still from the film Color Blind - Photograph by Pui Shan Chan February 2009. https://en.wikipedia.org/wiki/File:Black_%26_White_Handshake_-_Still_from_the_film_Colour_Blind_(2009).JPG
  36. 36. Partnerships Building Community Services Together
  37. 37. archivesDIRECT • Partnership with DuraSpace • U.S. Based • Launched August 2014 • Secure storage and monitoring via DuraCloud • Artefactual provides AM technical support http://archivesdirect.org/
  38. 38. Perpetua • Partnership with Arkivum • U.K. Based • Launched July 2016 • Secure storage and monitoring via Arkivum • Artefactual provides AM technical support http://arkivum.com/perpetua/
  39. 39. ArchivesCANADA Digital Preservation Service • Partnership with The Canadian Council of Archives (CCA) • Canada Based • Launched September 2016 • Artefactual provides AM technical support, storage, monitoring http://archivescanada.ca/ACDPS
  40. 40. Some examples of how AtoM and Archivematica are used by our global communities AtoM and Archivematica Use Cases
  41. 41. AtoM Use Cases Medium to Large Deployment Model (Artefactual): • ES and MySQL deployed on separate server • Internal read/write and testing webservers • Separate public read-only front-end web server – content proxied via firewall and replication script
  42. 42. AtoM Use Cases http://search-bcarchives.royalbcmuseum.bc.ca/ BC Archives – Royal BC Museum
  43. 43. AtoM Use Cases https://archivescanada.accesstomemory.ca/ ArchivesCanada – Canadian Portal
  44. 44. AtoM Use Cases https://beatoninstitute.com/ Beaton Institute
  45. 45. AtoM Use Cases https://beatoninstitute.com/ Beaton Institute https://beatoninstitute.com/
  46. 46. AtoM Use Cases Beaton Institute https://beatoninstitute.com/
  47. 47. Archivematica Use Cases http://atom.archives.sfu.ca/ Simon Fraser University Building a Digital Repository with Archivematica and AtoM
  48. 48. Archivematica Use Cases http://www.sfu.ca/archives/digital-repository.html Simon Fraser University Building a Digital Repository with Archivematica and AtoM
  49. 49. Archivematica Use Cases http://www.sfu.ca/archives/digital-repository/dr-overview.html Simon Fraser University Building a Digital Repository with Archivematica and AtoM
  50. 50. Archivematica Use Cases http://www.sfu.ca/content/dam/sfu/archives/DigitalPreservation/DRArchitecture.png Simon Fraser University Building a Digital Repository with Archivematica and AtoM
  51. 51. Archivematica Use Cases http://www.sfu.ca/content/dam/sfu/archives/DigitalPreservation/DRArchitecture.png Simon Fraser University Building a Digital Repository with Archivematica and AtoM = Archivematica pipelines = AM Storage Service = SFU AtoM
  52. 52. Archivematica Use Cases Simon Fraser University Building a Digital Repository with Archivematica and AtoM
  53. 53. Archivematica Use Cases Simon Fraser University Building a Digital Repository with Archivematica and AtoM http://www.sfu.ca/content/dam/sfu/archives/DigitalPreservation/FormatPolicyRegistry.pdf
  54. 54. Questions? info@artefactual.com
  55. 55. RESOURCES AtoM homepage: https://www.accesstomemory.org AtoM demo: http://demo.accesstomemory.org Roadmap: https://wiki.accesstomemory.org/Releases/Roadmap Documentation: https://www.accesstomemory.org/docs/latest/ User forum: https://groups.google.com/forum/#!forum/ica-atom-users
  56. 56. RESOURCES AM homepage: https://www.archivematica.org AM demo: http://sandbox.archivematica.org Wiki: https://wiki.archivematica.org Documentation: https://www.archivematica.org/docs/ User Forum: https://groups.google.com/forum/#!forum/archivematica

×