JLeRN Paradata Challenge at Dev8D 2012
Upcoming SlideShare
Loading in...5

JLeRN Paradata Challenge at Dev8D 2012






Total Views
Views on SlideShare
Embed Views



3 Embeds 584

http://jlernexperiment.wordpress.com 582
http://www.linkedin.com 1
https://jlernexperiment.wordpress.com 1



Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
Post Comment
Edit your comment

JLeRN Paradata Challenge at Dev8D 2012 JLeRN Paradata Challenge at Dev8D 2012 Presentation Transcript

  • The JLeRN ExperimentParadata Challenge 2012 Bharti Gupta Applications Developer Mimas, University of Manchester bharti.gupta@manchester.ac.uk #jlern #learningreg @dulcet_bg
  • Mimas – Centre of Excellence»  Nationally designated data centre based at the University of Manchester»  Hosts significant number of UK’s information assets»  Key role is to support advancement of knowledge, powering world-class research and teaching»  Main partners, collaborators and sponsors ›  JISC ›  Economic and Social Research Council (ESRC) ›  The University of Manchester
  • The JLeRN Experiment Project»  JLeRN aka JISC Learning Registry Node»  Innovative collaboration project funded by JISC to develop a Learning Registry test node at Mimas, with input and support from JISC CETIS.»  Focus is on content from the higher education and cultural sectors.»  Test node successfully setup on Ubuntu server called alpha.mimas.ac.uk»  Work is in progress to set up another test node on Windows 2008 server.
  • Background – Learning Registry Project»  Open technology framework, developed as a joint effort of the US Department of Education and the Department of Defense»  Open community of learning resource creators, publishers, curators and consumers collaborating to share resources»  Defines a learning resource distribution network model, open APIs and open standards.»  Lightweight mechanism to publish learning resources.»  Ability to consume published data and publish additional feedback.»  High-latency, loosely connected network distributing resources, metadata and paradata
  • Learning Registry Stack
  • Learning Registry Community - Locations
  • Learning Registry Community - Names
  • Learning Registry APIs»  Publish (push from user) ›  Publish ›  SWORD (1.3, 2.0) ›  3rd party OAI-PMH Utility»  Access (pull to get data) ›  Obtain (by ID, record, by URL) ›  Harvest (JSON or OAI-PMH) ›  Slice (by identity, date range, keyword tags) <-- the primary means of retrieving data»  Distribute (node to node, with regex “filtering”)»  Admin (status, discovery, etc.)»  Documentation ›  https://docs.google.com/document/d/1Bq_69wnnQJ56O6jyLK2C_fcp-Ovb7MYxXUXD0Rl1Mag/edit? hl=en&authkey=CK7k5r8F&pli=1 (Quick reference) ›  https://docs.google.com/document/d/191BTary350To_4JokBUFZLFRMOEfGYrl_EHE6QZxUr8/edit? hl=en (Technical Specification)
  • Demo Learning Registry Browser h"p://demolearningregistry.sri.com/browse/index.html?search=nsdl    
  • Publish API»  Publish the JSON formatted file named "fileName.json” using cURLFormatcurl -X POST -H "Content-Type:application/json" "<<url>>" -d@fileName.jsonExamplecurl -X POST -H "Content-Type:application/json” "http://testnode.org/publish -d @my_basicpublish_formatted.json"Return
  • Obtain API»  Obtain a single document by its document ID ›  Specify that the request is for a document by setting by_doc_ID to "true”.Formatcurl -X GET "<<url>>/obtain ?by_doc_ID=true &request_ID=some_Document_ID"Examplecurl -X GET "http://testnode.org/obtain?by_doc_ID=true&request_ID=klm174s08n05f031961td15sep011fad"Returns(Document Found)(Document Not Found)
  • Harvest API»  Get a single document by its document IDFormatcurl -X GET "<<url>>/harvest/getrecord &by_doc_ID=true&request_ID=<<Document_ID>>"Examplecurl -X GET "http://testnode.org/harvest/getrecord &by_doc_ID=true?request_ID=klm174s08n05f031961td15sep011fad"Returns(continued…)
  • Returns – Harvest APIDocument Found{ "status": "active","OK": "true", "identifier":"responseDate": "2011-09-28T14:27:08.598835Z","klm174s08n05f031961td15sep011fad""error": "" },"request": { "resource_data": {"by_doc_ID": "true", etc..."HTTP_request": "", etc..."verb": "getrecord", }"by_resource_ID": "false", }]"identifier": }"klm174s08n05f031961td15sep011fad" }},"getrecord": {"record": [{"header":{"datestamp": "2011-09-28T14:27:08.607941Z",
  • Returns – Harvest APIDocument Not Found{"OK": "false","responseDate": "2011-09-28T19:58:17.240463Z","error": "idDoesNotExist","request": { "by_doc_ID": "true", "HTTP_request": "", "verb": "getrecord", "by_resource_ID": "false", "identifier": "the_invalid_request_ID_you_submitted" }, "getrecord": { "record": [] } }}
  • Paradata»  Particular kind of metadata – mainly usage data»  Say things about activities»  Includes usage data, feedback, rankings, likes, etc.»  Provides a metadata timeline—a stream of activity data about a learning resource.»  The paradata format is basically an extended and altered version of the Activity Stream JSON»  Three main parts to a basic paradata statement: ACTOR, VERB, and OBJECT»  Cookbook - https://docs.google.com/document/d/1lggCnowWsDgQxrNjYRAgh2KNwKfq- MV8vLJzRXbAaos/edit
  • Example 1- Matching standards
  • Example 2 – Use resource in curriculum
  • Example 3 - Ratings
  • Signing Documents»  Public Learning Registry network requires that submitted documents be digitally signed»  Validation of authenticity of the submitter’s identity and integrity of signed document»  Steps to use digital signatures ›  Create a key value pair (OpenPGP Certificate) ›  Publish your public key ›  Sign and validate documents»  Documentation ›  https://docs.google.com/document/d/ 1UO6bdIfBlnSDYRwLejOrRO05XzNbyxQDwvebDofbXpw/edit?hl=en ›  https://docs.google.com/document/d/1vK66RY4S6AVtMJXB7jSqwl30J6NVBj6Gs8UWBcP- IPY/edit?hl=en_US#heading=h.2eu5kpj7khu7
  • Alpha Node»  Node URL – alpha.mimas.ac.uk»  Supports publish and retrieval services»  Authentication – open ›  Username: fred ›  Password: flintstone»  Note – JSONview extension for Firefox browser»  Examples ›  http://alpha.mimas.ac.uk/status ›  http://alpha.mimas.ac.uk/description ›  http://alpha.mimas.ac.uk/obtain ›  [all documents in node, one batch at a time] ›  http://alpha.mimas.ac.uk/slice?any_tags=apple ›  http://alpha.mimas.ac.uk/slice?identity=nick%40mimas
  • cURL Examples»  curl -v http://alpha.mimas.ac.uk/obtain? request_ID=”http://www.flickr.com/photos/ 41639353@N08/4369788825″»  curl -Xv POST -H “Content-Type:application/ json” “http://alpha.mimas.ac.uk/publish” -d @test_data.json -u fred
  • JORUM OAI-PMH Data in JLeRN»  Installed Python OAI-PMH third party module to work with LR team’s Python script»  Installed the Python ElementTree third party module to parse»  Harvested all JORUM OAI-PMH data and published on JLeRN node»  Blog post - http://jlernexperiment.wordpress.com/2012/02/14/jorum-oai-pmh-data- published/»  Example queries ›  http://alpha.mimas.ac.uk/obtain?request_ID=http://dspace.jorum.ac.uk/xmlui/handle/ 123456789/1000 ›  http://alpha.mimas.ac.uk/slice?any_tags=curve ›  http://alpha.mimas.ac.uk/slice?any_tags=magnetism
  • Windows Node»  Windows 2008 Server 64 bit OS at Mimas»  Installation Guide - https://github.com/LearningRegistry/LearningRegistry/ wiki/Windows-Installation-Guide»  Related blog posts - http://jlernexperiment.wordpress.com/2012/01/12/some- more-exploring/»  LR team fixed some errors, merge pending - https://github.com/LearningRegistry/LearningRegistry/ pull/167#issuecomment-3905263
  • Learning Registry Java Library»  Used to publish and harvest data»  Library name - LRJavaLib ›  Code on Github - https://github.com/navnorth/LRJavaLib»  Required bencode - http://code.google.com/p/bee-encode/downloads/ detail?name=bee-encode-0.2.tar.gz&can=2&q Untar and install jar using maven»  Code in progress using JAX-RS in Eclipse IDE
  • The Challenge – what to do??»  Capture, use, share or mash-up paradata»  Do you wish to explore ›  where and how learning resources are used? ›  how they are shared by social media? ›  what is being talked about those resources?»  Create applications which interact with existing tools, services, or repositories in the OER domain.
  • The Challenge Criteria»  Create something with paradata ›  demonstrate how to capture or mash-up paradata using your own content or shared in JLeRN node or the Learning Registry node in US, or ›  share an idea for a service that JLeRN might offer for publish, retrieve or mashing-up of paradata, or ›  create a mock-up of a tool or an add-on to work with a tool used currently to capture social media sharing or learning context paradata
  • The Project Documentation»  The US Learning Registry ›  Beta Release - http://www.learningregistry.org ›  Technical guides - http://www.learningregistry.org/documents ›  Useful presentations - https://docs.google.com/viewer? a=v&pid=explorer&chrome=true&srcid=0B3g0HwhfaPvPNTUxZWViNzYtZDlhNS00ZDM3LTllODQtNzZh ZjIzOTgzMjE3&hl=en_US&pli=1 (Daniel Rehak, Learning Registry Technical Architect)»  The JLeRN Experiment ›  Project Blog URL - http://jlernexperiment.wordpress.com/ ›  Twitter tags - #jlern, #learningreg ›  Other blogs - http://blogs.cetis.ac.uk/othervoices/2011/03/22/thelearningregistry/ http://blogs.cetis.ac.uk/lmc/2012/01/13/the-jlern-experiment/ http://blogs.cetis.ac.uk/lmc/2012/02/01/jlern-hackday-issues-identified/
  • The Team»  Sarah Currier ›  Project Lead ›  sarah.currier@manchester.ac.uk ›  @morageyrie»  Nick Syrotiuk ›  Developer ›  syrotiuk@manchester.ac.uk»  Bharti Gupta ›  Developer ›  bharti.gupta@manchester.ac.uk ›  @dulcet_bg