Ariadne harvester and validator - technical overview

1,031 views

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,031
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
13
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • Ariadne harvester and validator - technical overview

    1. 1. Validation Framework
    2. 2. APIMethod name : validateMetadata() Return type : void Parameters : Name Datatype metadata String validationScheme String Fault : validationException
    3. 3. empty attribute core schematron Legend fields vocabulary bank IMS ILOX rules uses recommended extendsschematron rules MACEv1.0 validationScheme vcard validator validation component ASPECTv1.0/ ASPECTv1.0/ recommended core - empty attribute fields rules - empty fields MELTv1.0/ minimal LOM loose lomloose.xsd classification vocab servicemelt.xsd MACEv1.0/ vcard validator MACEv1.0/strict loose MELTv1.0/full maceLoose maceStrict mace.xsd Schematron.xml Schematron.xml conditional LRE taxon field fields check numerical - empty attribute fields - add. mandatory fields - empty fields - conditional fields - mandatory fields - mace namespace fields
    4. 4. empty attribute core schematron Legend fields vocabulary bank IMS ILOX rules uses recommended extendsschematron rules MACEv1.0 validationScheme vcard validator validation component ASPECTv1.0/ ASPECTv1.0/ recommended core - empty attribute fields rules - empty fields MELTv1.0/ minimal LOM loose lomloose.xsd classification vocab servicemelt.xsd MACEv1.0/ vcard validator MACEv1.0/strict loose MELTv1.0/full maceLoose maceStrict mace.xsd Schematron.xml Schematron.xml conditional LRE taxon field fields check numerical - empty attribute fields - add. mandatory fields - empty fields - conditional fields - mandatory fields - mace namespace fields
    5. 5. Integration• Java library (see integration with harvester)• REST web-service• web application
    6. 6. Maintenance• Adding a new schema • configuration• Adding a new custom component • implementation • configuration• Deploying
    7. 7. • New Validation Schema : • add id • properties : URI, components, (type) • component • properties• Create the schemas • structure • vocabulary • additional rules
    8. 8. • New custom component • Extend ValidationComponent void validate(String metadata) throws ValidationException; void init(String name, Hashtable<String,String> table) throwsInitialisationException; • config : • componentType • schemaLocation
    9. 9. ARIADNE Harvester
    10. 10. MetadataProvider Harvester OAI-PMH LOM LOM Validation XML Mapping Storage SPI Target File System Lucene ...
    11. 11. Installation• Java 5 or higher• Tomcat 5 or higher• build using apache ant• drop in tomcat and done
    12. 12. Configuration• http://ariadne.cs.kuleuven.be/nateur- harvester/• Init• OAI Targets• Scheduling
    13. 13. Mapping• Extend GenericMapper• public abstract Element map(Record record);• config :• mapper.mapperClassName.<identifier> = org.ariadne.mapping.BSOMapper
    14. 14. Mapping
    15. 15. Validation• Integrated ARIADNE validator• Default scheme• Target specific scheme• Validation Reports
    16. 16. Maintenance• Checking if • Installations : harvesting still • GLOBE running • MACE• Follow up validation • MELT reports • ASPECT• Contact content • Organic Edunet providers if target is • Natural Europe down • ICOPER• Assist in solving • ARIADNE validation errors • ...• ...
    17. 17. Information• http://ariadne.cs.kuleuven.be/lomi/ index.php/Harvesting_Metadata• http://ariadne.cs.kuleuven.be/lomi/ index.php/Setting_Up_OAI-PMH

    ×