SlideShare a Scribd company logo
1 of 17
Validation Framework
API

Method name :    validateMetadata()

 Return type :          void
 Parameters :          Name            Datatype
                     metadata           String
                 validationScheme       String

       Fault :   validationException
empty attribute                                                       core schematron                         Legend
     fields                    vocabulary bank        IMS ILOX
                                                                             rules                                            uses
 recommended                                                                                                                 extends
schematron rules
                                                                                                   MACEv1.0             validationScheme

                                                                                                vcard validator        validation component
 ASPECTv1.0/                             ASPECTv1.0/
 recommended                                core                                             - empty attribute fields          rules
                                                                                             - empty fields




            MELTv1.0/
             minimal                                                 LOM loose            lomloose.xsd

                                                                                                     classification
                                                                                                     vocab service
melt.xsd



                                                                     MACEv1.0/
                                        vcard validator                                              MACEv1.0/strict
                                                                       loose
           MELTv1.0/full




                                                                    maceLoose                         maceStrict
                                                mace.xsd
                                                                  Schematron.xml                    Schematron.xml
 conditional       LRE taxon field
 fields check         numerical                                  - empty attribute fields       - add. mandatory fields
                                                                - empty fields                 - conditional fields
                                                                - mandatory fields             - mace namespace fields
empty attribute                                                       core schematron                         Legend
     fields                    vocabulary bank        IMS ILOX
                                                                             rules                                            uses
 recommended                                                                                                                 extends
schematron rules
                                                                                                   MACEv1.0             validationScheme

                                                                                                vcard validator        validation component
 ASPECTv1.0/                             ASPECTv1.0/
 recommended                                core                                             - empty attribute fields          rules
                                                                                             - empty fields




            MELTv1.0/
             minimal                                                 LOM loose            lomloose.xsd

                                                                                                     classification
                                                                                                     vocab service
melt.xsd



                                                                     MACEv1.0/
                                        vcard validator                                              MACEv1.0/strict
                                                                       loose
           MELTv1.0/full




                                                                    maceLoose                         maceStrict
                                                mace.xsd
                                                                  Schematron.xml                    Schematron.xml
 conditional       LRE taxon field
 fields check         numerical                                  - empty attribute fields       - add. mandatory fields
                                                                - empty fields                 - conditional fields
                                                                - mandatory fields             - mace namespace fields
Integration

• Java library (see integration with harvester)
• REST web-service
• web application
Maintenance

• Adding a new schema
   • configuration
• Adding a new custom component
   • implementation
   • configuration
• Deploying
• New Validation Schema :
     • add id
     • properties : URI, components, (type)
     • component
        • properties
• Create the schemas
     • structure
     • vocabulary
     • additional rules
• New custom component
     • Extend ValidationComponent
	   void validate(String metadata) throws ValidationException;

	 void init(String name, Hashtable<String,String> table) throws
InitialisationException;


    •   config :

        •   componentType

        •   schemaLocation
ARIADNE Harvester
Metadata
Provider                        Harvester
    OAI-PMH



    LOM
     LOM                               Validation
      XML

                             Mapping




              Storage
               SPI Target
               File System
               Lucene
               ...
Installation

• Java 5 or higher
• Tomcat 5 or higher
• build using apache ant
• drop in tomcat and done
Configuration

• http://ariadne.cs.kuleuven.be/nateur-
  harvester/
• Init
• OAI Targets
• Scheduling
Mapping

• Extend GenericMapper
•   public abstract Element map(Record record);

•   config :

•   mapper.mapperClassName.<identifier> =
    org.ariadne.mapping.BSOMapper
Mapping
Validation

• Integrated ARIADNE validator
• Default scheme
• Target specific scheme
• Validation Reports
Maintenance
•   Checking if              •   Installations :
    harvesting still             •  GLOBE
    running                      •  MACE
•   Follow up validation         •  MELT
    reports                      •  ASPECT
•   Contact content              •  Organic Edunet
    providers if target is       •  Natural Europe
    down
                                 •  ICOPER
•   Assist in solving            •  ARIADNE
    validation errors            •  ...
•   ...
Information

• http://ariadne.cs.kuleuven.be/lomi/
  index.php/Harvesting_Metadata
• http://ariadne.cs.kuleuven.be/lomi/
  index.php/Setting_Up_OAI-PMH

More Related Content

More from Bram Vandeputte

More from Bram Vandeputte (15)

Android presentation 2011
Android presentation 2011Android presentation 2011
Android presentation 2011
 
Icoper webinar
Icoper webinar Icoper webinar
Icoper webinar
 
Multi-touch introduction
Multi-touch introductionMulti-touch introduction
Multi-touch introduction
 
Android intro 2010
Android intro 2010Android intro 2010
Android intro 2010
 
Exploring the research world
Exploring the research worldExploring the research world
Exploring the research world
 
Research20
Research20Research20
Research20
 
Metadata Harvesting And Validationv2
Metadata Harvesting And Validationv2Metadata Harvesting And Validationv2
Metadata Harvesting And Validationv2
 
Ariadne Overview
Ariadne OverviewAriadne Overview
Ariadne Overview
 
Multi Touch Introduction
Multi Touch IntroductionMulti Touch Introduction
Multi Touch Introduction
 
Multi Touch Hands On
Multi Touch Hands OnMulti Touch Hands On
Multi Touch Hands On
 
Oai Workshop Extended
Oai Workshop ExtendedOai Workshop Extended
Oai Workshop Extended
 
Metadata Harvesting And Validation
Metadata Harvesting And ValidationMetadata Harvesting And Validation
Metadata Harvesting And Validation
 
IEEE LOM
IEEE LOMIEEE LOM
IEEE LOM
 
Android Presentation
Android PresentationAndroid Presentation
Android Presentation
 
Ariadne Harvesting
Ariadne HarvestingAriadne Harvesting
Ariadne Harvesting
 

Recently uploaded

[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessPixlogix Infotech
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 

Recently uploaded (20)

[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 

Ariadne harvester and validator - technical overview

  • 2. API Method name : validateMetadata() Return type : void Parameters : Name Datatype metadata String validationScheme String Fault : validationException
  • 3. empty attribute core schematron Legend fields vocabulary bank IMS ILOX rules uses recommended extends schematron rules MACEv1.0 validationScheme vcard validator validation component ASPECTv1.0/ ASPECTv1.0/ recommended core - empty attribute fields rules - empty fields MELTv1.0/ minimal LOM loose lomloose.xsd classification vocab service melt.xsd MACEv1.0/ vcard validator MACEv1.0/strict loose MELTv1.0/full maceLoose maceStrict mace.xsd Schematron.xml Schematron.xml conditional LRE taxon field fields check numerical - empty attribute fields - add. mandatory fields - empty fields - conditional fields - mandatory fields - mace namespace fields
  • 4. empty attribute core schematron Legend fields vocabulary bank IMS ILOX rules uses recommended extends schematron rules MACEv1.0 validationScheme vcard validator validation component ASPECTv1.0/ ASPECTv1.0/ recommended core - empty attribute fields rules - empty fields MELTv1.0/ minimal LOM loose lomloose.xsd classification vocab service melt.xsd MACEv1.0/ vcard validator MACEv1.0/strict loose MELTv1.0/full maceLoose maceStrict mace.xsd Schematron.xml Schematron.xml conditional LRE taxon field fields check numerical - empty attribute fields - add. mandatory fields - empty fields - conditional fields - mandatory fields - mace namespace fields
  • 5. Integration • Java library (see integration with harvester) • REST web-service • web application
  • 6. Maintenance • Adding a new schema • configuration • Adding a new custom component • implementation • configuration • Deploying
  • 7. • New Validation Schema : • add id • properties : URI, components, (type) • component • properties • Create the schemas • structure • vocabulary • additional rules
  • 8. • New custom component • Extend ValidationComponent void validate(String metadata) throws ValidationException; void init(String name, Hashtable<String,String> table) throws InitialisationException; • config : • componentType • schemaLocation
  • 10. Metadata Provider Harvester OAI-PMH LOM LOM Validation XML Mapping Storage SPI Target File System Lucene ...
  • 11. Installation • Java 5 or higher • Tomcat 5 or higher • build using apache ant • drop in tomcat and done
  • 12. Configuration • http://ariadne.cs.kuleuven.be/nateur- harvester/ • Init • OAI Targets • Scheduling
  • 13. Mapping • Extend GenericMapper • public abstract Element map(Record record); • config : • mapper.mapperClassName.<identifier> = org.ariadne.mapping.BSOMapper
  • 15. Validation • Integrated ARIADNE validator • Default scheme • Target specific scheme • Validation Reports
  • 16. Maintenance • Checking if • Installations : harvesting still • GLOBE running • MACE • Follow up validation • MELT reports • ASPECT • Contact content • Organic Edunet providers if target is • Natural Europe down • ICOPER • Assist in solving • ARIADNE validation errors • ... • ...
  • 17. Information • http://ariadne.cs.kuleuven.be/lomi/ index.php/Harvesting_Metadata • http://ariadne.cs.kuleuven.be/lomi/ index.php/Setting_Up_OAI-PMH

Editor's Notes

  1. \n
  2. \n
  3. \n
  4. \n
  5. \n
  6. \n
  7. \n
  8. \n
  9. \n
  10. \n
  11. \n
  12. \n
  13. \n
  14. \n
  15. \n
  16. \n
  17. \n
  18. \n
  19. \n
  20. \n
  21. \n
  22. \n