Recommended
More Related Content
What's hot
What's hot (9)
Viewers also liked
Similar to British LIbrary Labs Presentation to Bodelian Interns
Similar to British LIbrary Labs Presentation to Bodelian Interns (20)
More from labsbl
More from labsbl (20)
Recently uploaded
Recently uploaded (20)
British LIbrary Labs Presentation to Bodelian Interns
- 1. British Library Labs Mahendra Mahey Manager of British Library Labs Bodleian, Oxford e-research centre, Bader International Study Centre Monday 28 July, 2014, 1400 - 1430 Panizzi Room, British Library, St Pancras, London
- 2. http://labs.bl.uk #bl_labFusnded by the Andrew Mellolna bFso@unbdl.uaktion 2
- 3. How Labs works… 1 2 3 4 5 BL Labs Case Studies Open Software Publications Tools & services to support Digital Scholarship Researchers Developers Audience idea idea http://labs.bl.uk/Digital+Collections Research question / idea Competition Contact Events Meetings and visits Projects Experimenting with our BL Digital Collections / Data Data Driven Other Digital Collection / Data Data engagement digital collections Outputs from http://labs.bl.uk #bl_labs labs@bl.uk 3
- 4. Example Digital research methods Corpus analysis tools Text Mining Location based searching Using Application Programming Interfaces for datasets e.g. Metadata, Images Visualisations Geotagging Annotation Crowdsourcing / Human Computation Natural Language Processing Transcribing http://labs.bl.uk/Launch+Event (has some examples from researchers) http://labs.bl.uk #bl_labs labs@bl.uk 4
- 5. The winners of the Labs 2013 competition Two entries chosen in June 2013 They both worked in residence from July to October 2013 with Labs to complete their projects Pieter Francois (left) and Dan Norton (right) and each received a cheque for £2000 in November 2013 as winners of the first British Library Lab Competition 2013 http://labs.bl.uk #bl_labs labs@bl.uk 5
- 6. Mixing the Library: The Disc Jockey & the Digital Collection http://www.tompro.co.uk http://www.ablab.org/pd/di/ http://www.ablab.org/shetland Annotation Collection ‘stalks’ made of ‘items’. Each ‘item’ is a URL. The order of the ‘items’ can be ‘shuffled’ and sent to the ‘left’ or ‘right’ channels Prototype design Preview ‘item’ ‘Play back’ of ‘items’ (Blue) and annotations (Yellow) Selected ‘right’ channel ‘item’ Selected ‘left’ channel ‘item’ http://212.71.253.54:8000/a Basic functioning prototype: Living Lab: Library of the Future, see: http://alturl.com/284zw http://labs.bl.uk #bl_labs labs@bl.uk 6
- 7. Pieter Francois https://www.youtube.com/watch?v=xK80Jy0ijkA http://labs.bl.uk #bl_labs labs@bl.uk 7
- 8. Winners of 2014 Competition Text to Image Linking Tool (TILT) Blog: http://goo.gl/ofpNosl YouTube: http://goo.gl/iseHTE Anna Gerber and Desmond Schmidt from Queensland University Victorian Meme Machine Blog posting http://goo.gl/iJy0aT YouTube: http://goo.gl/mBTlk2 Bob Nicholson of Edge Hill University http://labs.bl.uk #bl_labs labs@bl.uk 8
- 9. Bob Nicholson https://www.youtube.com/watch?v=zK95lzaPNp0 http://labs.bl.uk #bl_labs labs@bl.uk 9
- 10. The story of one digital collection… The story of 68,000 books and 1 million images and Flickr Image: Artwork by Alicia Martin http://mechanicalcurator.tumblr.com http://www.flickr.com/photos/britishlibrary/ http://labs.bl.uk #bl_labs labs@bl.uk 10
- 11. Extracting Images from OCR Image snipped out ALTO XML http://labs.bl.uk #bl_labs 11 11 Digitisation <?xml version="1.0" encoding="UTF-8" ?> - <mets:mets xmlns:xsi="http://ww w.w3.org/2001/XML Schema-instance" xmlns:mets="http://w ww.loc.gov/METS/" xsi:schemaLocation= "http://www.loc.gov/ METS/ http://www.loc.gov/ standards/mets/ver sion18/mets.xsd info:lc/xmlns/premi s-v2 Optical Character Recognition Image snipped out Algorithmically From ALTO XML Image taken from page 207 of 'London and its Environs. A picturesque survey of the metropolis and the suburbs ... Translated by Henry Frith. With ... illustrations'
- 12. Face Recognition of 19th Century Faces The face-recognition algorithm worked better for female faces than men’s http://labs.bl.uk #bl_labs labs@bl.uk 12
- 13. The Mechanical Curator http://mechanicalcurator.tumblr.com • #similar_to_77576796197_published_date • #similar_to_77576796197_slantyness • #similar_to_77576796197_bubblyness_x • #similar_to_77576796197_bubblyness_y • #new_train_of_thought Image from ‘A Lost Estate, by Mary E.Mann,Volume: 02, Page: 91, 1889, London, Bentley & Son http://labs.bl.uk #bl_labs labs@bl.uk 13
- 14. Flickr Commons – 1,020,418 images! 1,020,418 images! http://www.flickr.com/photos/britishlibrary/ Each image has a URL Some metadata, but you can add tags! Flickr has an API so researchers and developers can build apps And query the data http://labs.bl.uk #bl_labs labs@bl.uk 14
- 15. Flickr in numbers 176,026,465 !!! image views since launch December 13th, 2013 to July 28th 2014 Almost all images seen at least 5 times 90933 tags added Labs involved a number of funded research projects & 4 grassroots crowdsourcing efforts. http://labs.bl.uk #bl_labs labs@bl.uk 15
- 16. Tagging a million images - Metadata games and other projects http://www.metadatagames.org/ http://goo.gl/j6fxac Cardiff University’s - Lost Visions Project Games will probably be developed using Flickr sets http://labs.bl.uk #bl_labs labs@bl.uk 16
- 17. Risks of releasing the images Funny Books for Boys and Girls. Struwelpeter. Good-for-nothing Boys and Girls. Troublesome Children. King Nutcracker and Poor Reinhold. http://labs.bl.uk #bl_labs labs@bl.uk 17
- 18. Opportunities – increasing traffic to Library services Grouping for image You can purchase a ‘High Res’ Copy Download .pdf User generated View the item in the Library Catalogue Tags auto generated View in the Library Item Viewer All illustrations in book Other illustrations in books Published in same year Tag http://labs.bl.uk #bl_labs labs@bl.uk 18
- 19. Flickr coverage in the media! http://labs.bl.uk #bl_labs labs@bl.uk 19
- 20. Creative Uses http://goo.gl/qPPgxX Jura’s Sound Skateboard http://goo.gl/OH6FSn http://labs.bl.uk #bl_labs labs@bl.uk 20
- 21. Burning Man http://goo.gl/Htg4XS David Normal, creating light boxes around the Burning man, using the British Library’s Flickr Images http://labs.bl.uk #bl_labs labs@bl.uk 21
- 22. Thanks • Mahendra Mahey • mahendra.mahey@bl.uk • labs@bl.uk http://labs.bl.uk #bl_labs labs@bl.uk 22
Editor's Notes
- 46 seconds Hello everyone, &lt;click&gt;my name’s Mahendra Mahey. I have been working at the British Library for over a year and I manage a Digital Lab which is responsible for opening up the British Library’s digital content and data and getting researchers to use it for their research, my colleague Ben O’Steen is responsible for providing a technical lead for the project and supporting researchers who want to use our content and data by providing advice and practical technical support and help. I will talk give an introduction to British Library Labs a brief overview of the surprising things that happened when we worked with one of our digital collections.
- 1 min 34 The Labs project’s is trying to ‘open up’ the digital content and data (such as digitised books, images and maps) &lt;click&gt; the British Library has and encourage researchers, particularly in the Arts and Humanities area to ‘Experiment with our digital collections’ &lt;click&gt; to use it for their scholarly work and ideas and consider research questions that only become possible to ask when you are providing access to large amounts of digital content and data. Our website is available at labs.bl.uk. The project is kindly funded by the Andrew Mellon Foundation. We work closely with our colleagues in the Digital Research Team (Stella Wisdom, Nora McGregor, James Baker, Aquiles Alencar Brayner and Rossizta Atanassova) colleagues in the Digital Scholarship Department, around the Library and researchers and other colleagues around the UK and world wide.
- 1min 58 seconds &lt;click&gt;We adopt a ‘Data Driven’ approach to encourage scholars to do research and development with and across British Library digital collections and data, i.e. here is our stuff… come with some interesting research ideas and questions of what to do with it and we will work with you and try and support you &lt;click&gt;A researcher will have domain knowledge about a subject but not necessarily the technical skills to be provide answers to the questions they are posing. A developer / computer scientist may have the technical skills to deal with large amounts of data but may not have enough domain knowledge to ask the right questions. Sometimes these people exist in the same body and sometimes they need to work together. We want them to come up with an idea and engage with Labs through various mechanisms &lt;click&gt;such as competitions, events (Hack events, workshops, ideas labs and projects). The kinds of methods that are being considered will be looked at in a bit more detail on the next slide Libraries. Through this process the Library is learning how better to support scholars and to build on existing processes or create new ones, as well as make &lt;click&gt;tools (e.g. APIs etc.) and services. The &lt;click&gt;case studies are some of the outputs we hope to create that will help other research libraries around the world wanting to build Labs for their digital content, &lt;click&gt; others include open software and publications.
- 180 seconds So what kinds digital research methods are these digital scholars using especially in the area of Digital Humanities? &lt;click&gt;For example, searching for items based on and time location can reveal very interesting patterns, e.g. when and where works were published. For example one researcher is looking at the evidence of copy and paste in newspapers in the 19th Century which was a common practice back then. Knowing where and when items might include text from a source can reveal patterns of how the text travelled over time. &lt;click&gt;Geotagging objects, putting them in space can add new dimensions to the kinds of research questions we might want to ask. &lt;click&gt;Corpus analysis is the analysis of text in Language and Text mining is about finding patterns in text through computational analysis for example number crunching (a lot of it based on counting words). &lt;click&gt;Tasks that require humans fall under the area of Crowdsourcing and Human Computation for example e.g. recaptcha is used as a way to get users to contribute to better text from scanned books but typing in the word they think they see in order to get access to a service. Amazon’s Mechanical Turk is a form of human computation, where tasks are outsourced to humans that computers would find very hard to do. &lt;click&gt;Annotation involves augmenting an item with additional information, usually text, but not necessarily, e.g. highlighting an area, a drawing etc. &lt;click&gt;Natural Language processing is used in the analysis of speech, for example. &lt;click&gt;Similarly transcribing can be the conversion of speech into text through human or computing power to then be used for further analysis. &lt;click&gt;Providing Application Programming Interfaces or APIs to data can be very powerful ways to access datasets, and can be used by software developers to build software applications on top of them, the term the API economy is now very popular and is fuelling the development of lots of apps for mobile phones &lt;click&gt;Many researchers want to see the patterns that are emerging in large amounts of data and are now using a number of very powerful tools to visualise data to see patterns. What is clear is that digital research methods are much more that searching for an individual item in a catalogue and Libraries, publishers, service and content providers have to change to support that.
- 1 min 20 seconds A major part of Labs activity is to run an annual competition. We encourage researchers to look at our data, talk to us, and more importantly to talk to each other and submit ideas and project plans of what they could do in a 4-6 month residency at the British Library. This ‘residency model ‘enables researchers to get access to pretty much all the digital content they require without any license restrictions and we get to engage with them deeply to learn about what they want to do and importantly what we need to learn as a library to support digital scholars better. We work in an agile way with the researchers. &lt;click&gt;We worked with two researchers who won last year’s competition, &lt;click&gt;Pieter Francois and Dan Norton over a &lt;click&gt;4 month period to work on their research questions and ideas. Let’s now look briefly at their ideas and what was achieved.
- 65 seconds Dr Dan Norton was researcher at the University of Dundee and artist in residence at Hangar, Centre for Art and Research, Barcelona. His idea was “Mixing the Library: The Disc Jockey and the Digital Collection” which brought a DJ’s approach to interacting with multi-format digital collections &lt;click&gt;. Dan’s interactive approach helps build aesthetic, experimental, or logical links between resources. This project focused on ideas around creating a prototype&lt;click&gt; and what would be the basic building blocks needed to create a simple demonstrator &lt;click&gt;. Dan is now building on the work he did at Labs and is the resident researcher and artist at the &lt;click&gt;Living Labs: Library of the Future in Barcelona, where he will be working with software developers to continue his work.
- Let’s look at a brief video of about Pieter and his entry. 1 min 30
- 1 min 31 seconds We have announced our winners for our 2014 competition in June and are currently working with them, the results will be showcased at a large event on the 3 November 2014 in London. They are: Anna Gerber and Desmond Schmidt from Queensland University in Australia. In order to make old printed books and manuscripts accessible to a Web audience, it is essential to display the page image / facsimile of the original document next to its transcription. This allows the user to comment on the text, and to read it clearly, but because original documents are often hard to read, or have different line-breaks than text on a computer screen, it is easy to get lost trying to match up words in the document with words in the transcription. To overcome this, the team are developing semi-automatic methods to generate links that highlight corresponding parts of the page image and the text. Bob Nicholson, lecturer at Edge Hill University. The ‘Victorian Meme Machine’ [VMM] will create an extensive database of Victorian jokes that will be available for use by other scholars. Let’s have a look at a video explaining his entry.
- 1 min 30 seconds
- 75 seconds The work of Labs is really about a number of stories, stories about digital collections and about researchers wanting to ask fascinating research questions about them. Let’s now tell you a story about one collection and the intended and unintended consequences of working with it. The Library digitised 68,000 17th to 19th century books from our collections a few years ago (around 2.7 % of the physical total in that period. We also captured 22 million individual page images, along with full text scans of these images all of which contain untold quantity of useful data such as names of people, places, historical events, dates. So the question became then, what next? What can 68,000 books tell us?
- 60 seconds As the books were scanned for text, this had a fortunate ‘side effect’ the software not only tries to detect the text on the page &lt;click&gt;but also where the images might be. &lt;click&gt;There had already been some interest as part of the competition, Matt Prior attended one of our hack events and when examining our book data and was very interested in the images from the books.
- 50 seconds Ben O’Steen, Labs Technical lead, wrote an algorithm to begin to extract all the images that were picked up in the scanning process from the 68,000 books. He did this initially because he had an interest in face recognition algorithms, and wanted to know if algorithms that had been trained on passport photos could be used to detect faces in the images in this collection, many of which were illustrations&lt;click&gt;. He found that it was good at detecting &lt;click&gt;female faces but not men, as men tended to have beards and glasses!
- 130 seconds Labs and other members of Digital Research team decided to post an image every hour on a tumblr blog &lt;click&gt;This was the first image that was published. The service was christened with the somewhat controversial name &lt;click&gt;Mechanical Curator (we like to be a little controversial) and said that it was a ‘she’. Our newest staff member churned away day and night posting an image every hour. It posted previously unseen illustrations taken almost at random. The Mechanical curator uses algorithms to chose other similar images based on a number of algorithms it has at hand, for example &lt;click&gt;e.g. published date, &lt;click&gt;slantyness, &lt;click&gt;bubblyness on the x or &lt;click&gt;y axis, or a&lt;click&gt; ‘new train of thought’ if it get’s bored. However, little was known about the actual image, apart from the analytic work of the Mechanical curator. Meanwhile the algorithm that Ben had written to snip the images from the OCR scans was still churning away, how many were there going to be? The Mechanical Curator could publish them every hour, but was there somewhere we could put them all for people to browse when they wanted. Importantly if we did put them somewhere, could we get people to help us add descriptions to the individual images making them infinitely more discoverable.
- 65 seconds How many images do you think we found? &lt;click&gt;Over 1 million images were then put onto &lt;click&gt;Flickr commons. Why? Because each image would have a &lt;click&gt;URL. Each image had some &lt;click&gt;metadata, i.e. the book and page number it came from. However the image itself didn’t have any metadata, i.e. was it a picture of a dog? By releasing the images onto Flickr, we could begin to see if people might start adding tags to the images. &lt;click&gt;Flickr has a well known and used API which developers and researchers could start using to build applications on top of or for examining large amounts of them at the same time. People have already started putting images into sets as you can see from the picture, portraits and ships are very popular.
- 35 seconds The site was launched on Friday, December 13, 2013. How many views do you think there have been? &lt;click&gt;There are have been a staggering 176,026,465 views of the images since December 13th, 2013, figures correct July 28. So Friday the 13th wasn’t so unlucky for us after all!
- 50 seconds We are working with &lt;click&gt;Metadata Games to develop branded British Library games rapidly increase the amount metadata that is being added, 3 games have been launched, portrait tag was launched on the 18th of June&lt;click&gt;, e.g. we have lots of ships, maps and portraits to name a few. There is also an Arts and Humanities Research Council Big Data project called Lost Visions, &lt;click&gt;which will be answering detailed research questions about the images and doing some tagging too.
- 35 seconds There are risks in this of course, surely lurking in the 1 million are images are sordid and of an offensive nature, especially given some of the views that were around at that time? &lt;click&gt;In the end we decided to not interfere, and take any issues as they may arise on a case-by-case basis. To date we’ve had very few.
- 50 seconds Here is the anatomy of a Flickr record, importantly we have created links to many of the Library’s services &lt;click&gt;some of this lovely traffic is going back to the Library and hopefully generating more interest in our services, from downloading a pdf of the book to purchasing a high res scan of the image. &lt;click&gt;Tags are added from the original book record, including the approximate page number the image came from&lt;click&gt;users of Flickr can add their own tags, and I have mentioned they have already started doing it.
- 18 seconds There has been considerable news coverage about the million images released on Flickr commons. &lt;click&gt;The Independent, &lt;click&gt;Wired magazine, &lt;click&gt;The Guardian, &lt;click&gt;Popular Science and the &lt;click&gt;Mail online to name a very few.
- 15 seconds There have been several creative uses of the images and can be found at the website above. The creation of a skateboard which you can buy for $64. A colouring book! http://www.playingbythebook.net/2014/03/18/barbapapas-new-house-a-book-so-good-im-featuring-it-for-a-second-time/ A youtube video showing off the pictures. https://www.youtube.com/watch?v=uiS1cx38rKk&feature=youtu.be
- Burning man is a surprising use of the images we put onto Flickr. Once a year, tens of thousands of participants gather in Nevada&apos;s Black Rock Desert to create Black Rock City, dedicated to community, art, self-expression, and self-reliance. They depart one week later, having left no trace whatsoever. This year it is taking place between August 25 to September 1, Nevada, USA, the show ends by burning an effigy of wooden man! &lt;click&gt; David Normal is using images from your Flickr Commons collection and is working on a set of collages called &quot;Crossroads of Curiosity&quot;. The finished images will be paintings based on these collages that will be presented in full colour as &apos; lightboxes at this year&apos;s Burning Man Festival. These works are part of the festival&apos;s &quot;Caravansary&quot; theme for 2014, and will be presented around the base of the effigy of the Burning Man in the heart of the festival.