Metadata Harvesting And Validationv2

•

0 likes•497 views

This document discusses metadata harvesting and validation. It describes a validation service that checks metadata against an application profile using XML schema and Schematron rules. The validation service is modular and reusable. Metadata can be validated during harvesting or mapping. An online validation service demo is also presented. The harvesting component harvests metadata from external repositories using OAI-PMH, validates the metadata, and stores valid metadata in a repository while logging invalid records. Validation reports are generated after harvesting.

Technology Design

Metadata Harvesting and
Validation

Bram Vandeputte
K.U.Leuven

1

slideshare

• http://www.slideshare.net/bramvandeputte

2

Overview

• Validation Service
• Integration
• Online Validation Service
• Harvesting Component

3

Validation Service

• Interoperability : Application Proﬁle (AP)
• Manual check : very time consuming
• Need a tool for enforcing an AP =>
validation scheme
Best practices derived
from previous projects
• A set of validation rules such as MELT and MACE

Reusable : modular +
• Reusable & extendable inheritance possible

4

Validation Service

• Components :
• XML schema : structure
• schematron :
• mandatory/conditional elements
• empty ﬁelds
• vocabularies (auto generated)
• ...

• Vcard component

5

Validation Service
component : atomic
block which does specific
validation checking

scheme : collection of
components that
• Terminology : ensures validity against
a whole AP

• Validation Component URI : unique identifier of
a scheme

• Validation Scheme
• Validation Scheme URI :
• http://aspect-project.org/validation/ASPECTv1.0/core

6

Validation Service
ASPECTv1.0/ ASPECTv1.0/
LOM loose
recommended core

recommended lomloose.xsd
vocabulary bank
schematron rules

core schematron vcard validator
Legend
rules
uses empty attribute
ﬁelds
extends IMS ILOX
ASPECT validationScheme

vcard validator validation component

8

Integration

• When do we validate ?
• Possible integration points :
• Mapping
• Harvesting
• Enriching

10

validation to lre AP
refer to lre ap document

13

invalid : discarded or
identifier recorded for
next harvesting

14

The Harvest component

invalid : discarded or
identifier recorded for
next harvesting

14

ARIADNE Harvester

invalid : discarded or
identifier recorded for
harvester log
next harvesting

14

ARIADNE Harvester
ASPECT Repository

SPI SQI

invalid : discarded or
identifier recorded for
harvester log
validation service
next harvesting

14

ARIADNE Harvester
ASPECT Repository

SPI SQI
External Repository

OAI

OAI-PMH

LOM
LOM
LOM

invalid : discarded or
identifier recorded for
harvester log
validation service
next harvesting

14

ARIADNE Harvester
ASPECT Repository
OAI-PMH
SPI SQI
External Repository
LOM
LOM
LOM
OAI

OAI-PMH

LOM
LOM
LOM

invalid : discarded or
identifier recorded for
harvester log
validation service
next harvesting

14

ARIADNE Harvester
ASPECT Repository
OAI-PMH
SPI SQI
External Repository
LOM
LOM

OAI

OAI-PMH

LOM
LOM
LOM
LOM

invalid : discarded or
identifier recorded for
harvester log
validation service
next harvesting

14

ARIADNE Harvester
ASPECT Repository
OAI-PMH
SPI SQI
External Repository
LOM
LOM

OAI

OAI-PMH

LOM
LOM
LOM
LOM

LOM

invalid : discarded or
identifier recorded for
harvester log
validation service
next harvesting

14

ARIADNE Harvester
ASPECT Repository
OAI-PMH
SPI SQI
External Repository
LOM
LOM

OAI

OAI-PMH

LOM
LOM
LOM
LOM

Validation
Msg

invalid : discarded or
identifier recorded for
harvester log
validation service
next harvesting

14

ARIADNE Harvester
ASPECT Repository
OAI-PMH
SPI SQI
External Repository
LOM
LOM

OAI

OAI-PMH

Validation
LOM
Msg
LOM
LOM
LOM

invalid : discarded or
identifier recorded for
harvester log
validation service
next harvesting

14

ARIADNE Harvester
ASPECT Repository
OAI-PMH
SPI SQI
External Repository
LOM
LOM

OAI
LOM

OAI-PMH

LOM
LOM
LOM

Validation
Msg

invalid : discarded or
identifier recorded for
harvester log
validation service
next harvesting

14

ARIADNE Harvester
ASPECT Repository

OAI-PMH
SPI SQI
External Repository
LOM
LOM
LOM
OAI
2 6 LOM

OAI-PMH 1
Validation
LOM
Msg
LOM
LOM
LOM

4
5 3
Validation Validation
LOM
Msg Msg

harvester log
validation service

15

Validation Reports
• After harvesting -> report generated and put
online
• report has 4 “levels” :
• full log (incl. metadata)
• reporting log
• Grouped Errors
• Error Summary

16

References

• SPI : http://ariadne.cs.kuleuven.be/lomi/index.php/
SimplePublishingInterface

• IEEE LOM : http://ltsc.ieee.org/wg12/
• OAI-PMH : http://www.openarchives.org/
• Online Validation :
http://ariadne.cs.kuleuven.be/validationService/

18

The document discusses metadata harvesting and validation. It describes a validation service that checks metadata against an application profile using XML schema and Schematron rules. An online validation demo is also presented. The harvesting infrastructure uses the OAI-PMH protocol and includes components for harvesting from multiple targets, validating metadata, and generating validation reports. An ARIADNE Harvester manages the harvesting process and interfaces with repositories, validation services, and other systems.

Migrating from HP QuickTest Pro QTP to TestMaker Object Designer

Clever Moe

TestMaker is the leading open source alternative to HP Mercury tools (Load Runner, QuickTest Professional, Quality Center.) TestMaker provides immediate compatibility with thousands of new Web objects in Rich Internet Applications (RIA, using Ajax, Flex, Flash) without any test coding. In this live workshop, Frank Cohen, CEO and Founder at PushToTest, will discuss what to expect and What is missing in Open Source Test (OST) Tools

Ariadne Harvesting

Bram Vandeputte

This document discusses metadata harvesting in repository networks. It provides an overview of the Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) and the ARIADNE validation service. It then describes the ARIADNE harvesting infrastructure and projects that use it like MACE, MELT, and GLOBE. These harvest metadata from multiple repositories and enrich it. The document concludes with information on implementing an OAI-PMH target to expose a repository's metadata.

Icoper webinar

Bram Vandeputte

This document discusses strategies for aggregating educational content including key technologies like metadata standards, harvesting protocols, federated search, and publishing interfaces. It describes technologies like IEEE LOM for metadata, OAI-PMH for harvesting metadata, SQI for federated search across repositories, and SPI for publishing content. Examples are given of implementing these standards and protocols in systems like the ARIADNE harvester and registry.

Multi-touch introduction

Bram Vandeputte

Android presentation 2011

Bram Vandeputte

Android intro 2010

Bram Vandeputte

Android is an open source software stack for mobile devices that includes an operating system, middleware and key applications. It allows developers to write managed code in Java and offers tools for application development including an emulator, SDK and Eclipse plugin. The Android framework supports components like activities, services and content providers that communicate via intents. It uses the Dalvik VM, supports common media formats and hardware like the camera and GPS.

Ariadne harvester and validator - technical overview

Bram Vandeputte

The document describes a metadata validation framework that includes a validateMetadata() method that validates metadata using different validation schemes. It supports adding new validation schemas by configuring components and schemas. Validation components extend an interface and are configured by name and properties. The framework can be integrated as a Java library or REST service. It has been implemented and configured in the ARIADNE metadata harvesting system to validate harvested metadata against different standards.

The document describes the ARIADNE experience in sharing and reusing learning resources. It discusses key technologies like metadata, harvesting, federated search, and publishing that allow learning resources to be described, collected, searched across repositories, and added to repositories. The ARIADNE infrastructure provides services like validation, transformation, harvesting, and access tools to facilitate open sharing of over 1 million learning objects among various projects and repositories around the world using open standards.

OSGi Service Platform 4.2

Ilya Katsov

OSGi is a module system and service platform for Java that aims to overcome limitations of Java like poor support for logical partitioning, dynamic updates, and versioning at runtime. The OSGi Service Platform Architecture consists of bundles that execute within an OSGi framework and register services. The framework manages the bundles' lifecycle and provides a service layer for bundles to discover and use services. OSGi specifications have evolved over multiple releases to define the core framework and provide standardized services.

Self-Service in EPAM Private Cloud

Alex Tregubov

This document discusses Epam's plans to implement a private cloud structure to improve their development and provisioning processes. The private cloud will utilize an orchestrator and API to allow self-service provisioning of compute resources. This is intended to unify infrastructure, implement DevOps practices, and enable smart resource provisioning. It will transition away from the current time-consuming manual process, and allow developers to provision their own resources through quotas and templates. This is expected to improve delivery times while increasing infrastructure utilization and savings.

44rd CEN WS/LT meeting PT interoperability of registries

Joris Klerkx

How to Share and Reuse Learning Resources: the ARIADNE Experience

Joris Klerkx

This document discusses the ARIADNE experience in sharing and reusing learning resources. It describes the key technologies used in ARIADNE including metadata standards, harvesting protocols, federated search, and publishing interfaces. It provides examples of metadata validation, transformation, and harvesting workflows. ARIADNE services including repository software, validation tools, harvesting, and federated search are presented. Software quality attributes and performance results are evaluated. The conclusion discusses the open, standards-based architecture and its ability to integrate and manage learning objects across applications.

IdM in Smart Applications on Virtual Infrastructure

Mohammad Faraji

This document summarizes an identity management presentation. It discusses SAVI's use of Keystone as its identity manager, including integrating Keystone with the SAVI control framework, deploying a centralized Keystone, implementing fine-grained access control, and enabling federation with other testbeds. The goals are to improve authentication, authorization, and extend resources between SAVI and other systems.

Harvesting metadata - ASPECT webinar

Joris Klerkx

This document summarizes Dr. Joris Klerkx's work on harvesting metadata from learning object repositories. It discusses key technologies like metadata standards, harvesting metadata using OAI-PMH, and federated search. It provides examples of learning object repositories and registry data models. It describes the ARIADNE harvesting infrastructure and tools for validation, transformation, and accessing learning objects. The overall workflow of harvesting metadata from multiple repositories and aggregating it is depicted.

WF and WCF with AppFabric – Application Infrastructure for OnPremise Services

Saltmarch Media

.NET Framework 4.0 facilitates creation of Workflow services – with WCF acts as the communications scaffolding and WF4 used to implement service as long running, durable business process with coordinated interactions.. Can Developers then spend more time on business logic and less building infrastructure? This requirement is met by Windows Server AppFabric. This session explains the key features of AppFabric in providing infrastructure to improve the hosting, persistence, performance, scalability, and manageability of Workflow Services.

Exploring the research world

Bram Vandeputte

In this short talk I will give an overview on ideas for using new technologies such as multi touch, tabletops and more to assist researchers in various tasks. We think of it as a research suite, where we go from very small devices and displays, such as a research pod and research pad, to extremely large displays, such as research on a tabletop, wall projections or even a projection dome. Specifically in this talk I will give an example of a researchpod app and a tabletop app. More! is a mobile application that has been developed for getting more information of a researcher during a presentation at a conference. This information includes all the papers, various contact information and even the slides of the presentation currently going on. Science table, a tabletop vizualisation, is a first attempt of providing easy access to publication data in a research field by showing connections between papers and its authors in various ways.

Research20

Bram Vandeputte

This document summarizes and discusses several research projects focused on openness, sharing, and collaboration in scientific research using web 2.0 technologies. It describes projects that aim to make scientific literature and data more openly accessible and connect researchers. This includes tools for finding additional information about researchers and conference presentations, visually browsing and clustering related research papers, and a proposed open collaborative platform for sharing research data, services, and applications. The document discusses challenges and opportunities for further developing these Research 2.0 ideas.

Ariadne Overview

Bram Vandeputte

This document provides information about ARIADNE, a federation of online learning repositories. It discusses ARIADNE's centers located in various countries, its new members, and its relationship to other projects like GLOBE and MACE. Diagrams show how ARIADNE harvests and indexes content using open standards and interfaces with other systems through its federated search engine. The document outlines technologies used for communication, collaboration, content delivery, and more that enable online and blended learning applications.

Multi Touch Introduction

Bram Vandeputte

This document discusses large multi-touch displays and their technical details. It covers various touch input technologies like touchscreens, touchpads, and Wacom tablets. It also discusses multi-touch technologies like FTIR, DI, LLP, and DSI. Examples of multi-touch displays are given, including The Box, The Tabletop, and MTMini. Common multi-touch gestures like tap, drag, rotate, scale, and zoom are also listed. The document provides information on software protocols, trackers, and libraries for processing multi-touch input.

Multi Touch Hands On

Bram Vandeputte

Processing is an open-source programming language and integrated development environment (IDE) that is used for multimedia and graphical applications like animation, visual art, and interactive design. It supports multitouch input through the TUIO protocol, which allows for tracking objects on a multitouch surface. Examples are provided to demonstrate how to use TUIO for multitouch input in Processing code and in Java code that interfaces with Processing.

Oai Workshop Extended

Bram Vandeputte

IEEE LOM

Bram Vandeputte

The document provides an overview of the IEEE Learning Object Metadata standard (LOM) in three sections. It introduces LOM as a conceptual schema for describing digital and non-digital learning resources to enable interoperability across systems. The general overview section describes the standard's structure, data types, and vocabularies. The detailed structure section lists and explains the 9 categories and associated metadata elements that make up the LOM schema.

Android Presentation

Bram Vandeputte

Android is a software stack for mobile devices that includes an operating system, middleware and key applications. It allows developers to write managed code in Java for the Dalvik virtual machine. The Android SDK provides tools and APIs to develop applications that use features like its application framework, SQLite database, media support and hardware integration. Developers can create Android applications by defining activities, services and content providers and connecting them with intents in the AndroidManifest file.

“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...

Edge AI and Vision Alliance

For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/building-and-scaling-ai-applications-with-the-nx-ai-manager-a-presentation-from-network-optix/ Robin van Emden, Senior Director of Data Science at Network Optix, presents the “Building and Scaling AI Applications with the Nx AI Manager,” tutorial at the May 2024 Embedded Vision Summit. In this presentation, van Emden covers the basics of scaling edge AI solutions using the Nx tool kit. He emphasizes the process of developing AI models and deploying them globally. He also showcases the conversion of AI models and the creation of effective edge AI pipelines, with a focus on pre-processing, model conversion, selecting the appropriate inference engine for the target hardware and post-processing. van Emden shows how Nx can simplify the developer’s life and facilitate a rapid transition from concept to production-ready applications.He provides valuable insights into developing scalable and efficient edge AI solutions, with a strong focus on practical implementation.

HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU

panagenda

Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-und-domino-lizenzkostenreduzierung-in-der-welt-von-dlau/ DLAU und die Lizenzen nach dem CCB- und CCX-Modell sind für viele in der HCL-Community seit letztem Jahr ein heißes Thema. Als Notes- oder Domino-Kunde haben Sie vielleicht mit unerwartet hohen Benutzerzahlen und Lizenzgebühren zu kämpfen. Sie fragen sich vielleicht, wie diese neue Art der Lizenzierung funktioniert und welchen Nutzen sie Ihnen bringt. Vor allem wollen Sie sicherlich Ihr Budget einhalten und Kosten sparen, wo immer möglich. Das verstehen wir und wir möchten Ihnen dabei helfen! Wir erklären Ihnen, wie Sie häufige Konfigurationsprobleme lösen können, die dazu führen können, dass mehr Benutzer gezählt werden als nötig, und wie Sie überflüssige oder ungenutzte Konten identifizieren und entfernen können, um Geld zu sparen. Es gibt auch einige Ansätze, die zu unnötigen Ausgaben führen können, z. B. wenn ein Personendokument anstelle eines Mail-Ins für geteilte Mailboxen verwendet wird. Wir zeigen Ihnen solche Fälle und deren Lösungen. Und natürlich erklären wir Ihnen das neue Lizenzmodell. Nehmen Sie an diesem Webinar teil, bei dem HCL-Ambassador Marc Thomas und Gastredner Franz Walder Ihnen diese neue Welt näherbringen. Es vermittelt Ihnen die Tools und das Know-how, um den Überblick zu bewahren. Sie werden in der Lage sein, Ihre Kosten durch eine optimierte Domino-Konfiguration zu reduzieren und auch in Zukunft gering zu halten. Diese Themen werden behandelt - Reduzierung der Lizenzkosten durch Auffinden und Beheben von Fehlkonfigurationen und überflüssigen Konten - Wie funktionieren CCB- und CCX-Lizenzen wirklich? - Verstehen des DLAU-Tools und wie man es am besten nutzt - Tipps für häufige Problembereiche, wie z. B. Team-Postfächer, Funktions-/Testbenutzer usw. - Praxisbeispiele und Best Practices zum sofortigen Umsetzen

Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...

SOFTTECHHUB

The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing. One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.

Building Production Ready Search Pipelines with Spark and Milvus

Zilliz

UiPath Test Automation using UiPath Test Suite series, part 6

DianaGray10

Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI. UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities. Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes. What will you get from this session? 1. Insights into integrating generative AI. 2. Understanding how this integration enhances test automation within the UiPath platform 3. Practical demonstrations 4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath Topics covered: What is generative AI Test Automation with generative AI and Open AI. UiPath integration with generative AI Speaker: Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP

Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf

Paige Cruz

Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack. While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack. I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:

Similar to Metadata Harvesting And Validationv2

ARIADNE overview

Joris Klerkx

OSGi Service Platform 4.2

Ilya Katsov

Self-Service in EPAM Private Cloud

Alex Tregubov

44rd CEN WS/LT meeting PT interoperability of registries

Joris Klerkx

How to Share and Reuse Learning Resources: the ARIADNE Experience

Joris Klerkx

IdM in Smart Applications on Virtual Infrastructure

Mohammad Faraji

Harvesting metadata - ASPECT webinar

Joris Klerkx

WF and WCF with AppFabric – Application Infrastructure for OnPremise Services

Saltmarch Media

Similar to Metadata Harvesting And Validationv2 (8)

ARIADNE overview

OSGi Service Platform 4.2

Self-Service in EPAM Private Cloud

44rd CEN WS/LT meeting PT interoperability of registries

How to Share and Reuse Learning Resources: the ARIADNE Experience

IdM in Smart Applications on Virtual Infrastructure

Harvesting metadata - ASPECT webinar

WF and WCF with AppFabric – Application Infrastructure for OnPremise Services

Recently uploaded

“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...

Edge AI and Vision Alliance

HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU

panagenda

Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...

SOFTTECHHUB

Building Production Ready Search Pipelines with Spark and Milvus

Zilliz

UiPath Test Automation using UiPath Test Suite series, part 6

DianaGray10

Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf

Paige Cruz

How to Get CNIC Information System with Paksim Ga.pptx

danishmna97

Introduction to CHERI technology - Cybersecurity

mikeeftimakis1

Programming Foundation Models with DSPy - Meetup Slides

Zilliz

“I’m still / I’m still / Chaining from the Block”

Claudio Di Ciccio

GenAI Pilot Implementation in the organizations

kumardaparthi1024

Essentials of Automations: The Art of Triggers and Actions in FME

Safe Software

In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation. We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios. Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!

みなさんこんにちはこれ何文字まで入るの？40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの？えこ...

名前です男

GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024

Neo4j

20240607 QFM018 Elixir Reading List May 2024

Matthew Sinclair

UiPath Test Automation using UiPath Test Suite series, part 5

DianaGray10

Cosa hanno in comune un mattoncino Lego e la backdoor XZ?

Speck&Tech

ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune. Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile. BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).

GraphRAG for Life Science to increase LLM accuracy

Tomaz Bratanic

Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf

Malak Abu Hammad

Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers: * What is Vector Search? * Importance and benefits of vector search * Practical use cases across various industries * Step-by-step implementation guide * Live demos with code snippets * Enhancing LLM capabilities with vector search * Best practices and optimization strategies Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications. #MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology

Presentation of the OECD Artificial Intelligence Review of Germany

innovationoecd

Recently uploaded (20)

“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...

HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU

Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...

Building Production Ready Search Pipelines with Spark and Milvus

UiPath Test Automation using UiPath Test Suite series, part 6

Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf

How to Get CNIC Information System with Paksim Ga.pptx

Introduction to CHERI technology - Cybersecurity

Programming Foundation Models with DSPy - Meetup Slides

“I’m still / I’m still / Chaining from the Block”

GenAI Pilot Implementation in the organizations

Essentials of Automations: The Art of Triggers and Actions in FME

GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024

20240607 QFM018 Elixir Reading List May 2024

UiPath Test Automation using UiPath Test Suite series, part 5

Cosa hanno in comune un mattoncino Lego e la backdoor XZ?

GraphRAG for Life Science to increase LLM accuracy

Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf

Presentation of the OECD Artificial Intelligence Review of Germany

Metadata Harvesting And Validationv2

1. Metadata Harvesting and Validation Bram Vandeputte K.U.Leuven 1

2. slideshare • http://www.slideshare.net/bramvandeputte 2

3. Overview • Validation Service • Integration • Online Validation Service • Harvesting Component 3

4. Validation Service • Interoperability : Application Proﬁle (AP) • Manual check : very time consuming • Need a tool for enforcing an AP => validation scheme Best practices derived from previous projects • A set of validation rules such as MELT and MACE Reusable : modular + • Reusable & extendable inheritance possible 4

5. Validation Service • Components : • XML schema : structure • schematron : • mandatory/conditional elements • empty ﬁelds • vocabularies (auto generated) • ... • Vcard component 5

6. Validation Service component : atomic block which does specific validation checking scheme : collection of components that • Terminology : ensures validity against a whole AP • Validation Component URI : unique identifier of a scheme • Validation Scheme • Validation Scheme URI : • http://aspect-project.org/validation/ASPECTv1.0/core 6

7. Validation Service 7

8. Validation Service ASPECTv1.0/ ASPECTv1.0/ LOM loose recommended core recommended lomloose.xsd vocabulary bank schematron rules core schematron vcard validator Legend rules uses empty attribute ﬁelds extends IMS ILOX ASPECT validationScheme vcard validator validation component 8

9. Validation Service 9

10. Integration • When do we validate ? • Possible integration points : • Mapping • Harvesting • Enriching 10

11. Online Validation Service demo 11

12. 12

13. validation to lre AP refer to lre ap document 13

14. invalid : discarded or identifier recorded for next harvesting 14

15. The Harvest component invalid : discarded or identifier recorded for next harvesting 14

16. ARIADNE Harvester invalid : discarded or identifier recorded for harvester log next harvesting 14

17. ARIADNE Harvester ASPECT Repository SPI SQI invalid : discarded or identifier recorded for harvester log validation service next harvesting 14

18. ARIADNE Harvester ASPECT Repository SPI SQI External Repository OAI OAI-PMH LOM LOM LOM invalid : discarded or identifier recorded for harvester log validation service next harvesting 14

19. ARIADNE Harvester ASPECT Repository OAI-PMH SPI SQI External Repository LOM LOM LOM OAI OAI-PMH LOM LOM LOM invalid : discarded or identifier recorded for harvester log validation service next harvesting 14

20. ARIADNE Harvester ASPECT Repository OAI-PMH SPI SQI External Repository LOM LOM OAI OAI-PMH LOM LOM LOM LOM invalid : discarded or identifier recorded for harvester log validation service next harvesting 14

21. ARIADNE Harvester ASPECT Repository OAI-PMH SPI SQI External Repository LOM LOM OAI OAI-PMH LOM LOM LOM LOM LOM invalid : discarded or identifier recorded for harvester log validation service next harvesting 14

22. ARIADNE Harvester ASPECT Repository OAI-PMH SPI SQI External Repository LOM LOM OAI OAI-PMH LOM LOM LOM LOM Validation Msg invalid : discarded or identifier recorded for harvester log validation service next harvesting 14

23. ARIADNE Harvester ASPECT Repository OAI-PMH SPI SQI External Repository LOM LOM OAI OAI-PMH Validation LOM Msg LOM LOM LOM invalid : discarded or identifier recorded for harvester log validation service next harvesting 14

24. ARIADNE Harvester ASPECT Repository OAI-PMH SPI SQI External Repository LOM LOM OAI OAI-PMH LOM LOM LOM LOM Validation Msg invalid : discarded or identifier recorded for harvester log validation service next harvesting 14

25. ARIADNE Harvester ASPECT Repository OAI-PMH SPI SQI External Repository LOM LOM OAI LOM OAI-PMH LOM LOM LOM Validation Msg invalid : discarded or identifier recorded for harvester log validation service next harvesting 14

26. ARIADNE Harvester ASPECT Repository OAI-PMH SPI SQI External Repository LOM LOM LOM OAI 2 6 LOM OAI-PMH 1 Validation LOM Msg LOM LOM LOM 4 5 3 Validation Validation LOM Msg Msg harvester log validation service 15

27. Validation Reports • After harvesting -> report generated and put online • report has 4 “levels” : • full log (incl. metadata) • reporting log • Grouped Errors • Error Summary 16

28. • Questions ? 17

29. References • SPI : http://ariadne.cs.kuleuven.be/lomi/index.php/ SimplePublishingInterface • IEEE LOM : http://ltsc.ieee.org/wg12/ • OAI-PMH : http://www.openarchives.org/ • Online Validation : http://ariadne.cs.kuleuven.be/validationService/ 18

Metadata Harvesting And Validationv2

Recommended

Recommended

More Related Content

Similar to Metadata Harvesting And Validationv2

Similar to Metadata Harvesting And Validationv2 (8)

More from Bram Vandeputte

More from Bram Vandeputte (8)

Recently uploaded

Recently uploaded (20)

Metadata Harvesting And Validationv2