SlideShare a Scribd company logo
Results of the first worldwide evaluation campaign for semantic tools Dr Lyndon Nixon, STI International On behalf of the SEALS Project http://www.seals-project.eu 06.09.11
Overview ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],06.09.11
SEALS  (Semantic Evaluation At Large Scale) Universidad Politécnica de Madrid, Spain (Coordinator) University of Sheffield, UK Forschungszentrum Informatik, Germany University of Innsbruck, Austria Institut National de Recherche en  Informatique et en Automatique,  France University of Mannheim, Germany University of Zurich, Switzerland STI International, Austria Open University, UK Oxford University, UK Contact person:  Asunción Gómez Pérez <asun@fi.upm.es> http://www.seals-project.eu/ EC  contribution:  3.500.000 € Duration:  June 2009-May 2012 1 3 1 2 1 2
SEALS Objectives ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Service  Activities Research  Activities Networking  Activities
The SEALS Platform ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Overall SEALS Platform Architecture SEALS  Service Manager Runtime   Evaluation Service SEALS Portal Test Data  Repository Service Tools  Repository Service Results  Repository Service Evaluation Descriptions Repository Service SEALS Repositories Technology Providers Evaluation Organisers Technology Adopters Software agents, i.e.,  technology evaluators Entity  management  requests Evaluation requests
The SEALS Evaluation Campaigns 2010 Next evaluation campaigns during 2011 - 2012 Ontology Engineering Tools Reasoning Tools Ontology Matching Tools Semantic Search Tools Semantic Web Service Tools OET Conformance 2010 Conformance OET Interoperability 2010 Interoperability OET Scalability 2010 Efficiency Scalability DLBS Classification 2010 DLBS Class satisfiability 2010 DLBS Ontology satisfiability 2010 DLBS Logical entailment 2010 MT Benchmark 2010  Conformance  Efficiency  Interoperability MT Anatomy 2010  Conformance Efficiency  Interoperability MT Conference 2010  Conformance  Efficiency  Interoperability Alignment coherence SST Automated Search Performance 2010 Search quality SST Automated Performance and Scalability 2010  Resource consumption SST Automated Query Expressiveness 2010 Query expressiveness SST Automated Quality of Documentation 2010 Usability SST User Usability 2010  Usability SST User Query Expressiveness 2010 Query expressiveness SWS Tool Discovery Evaluation 2010 : Performance
Ontology Engineering Tools ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],06.09.11
Ontology Engineering Results ,[object Object],Full results at  http://www.seals-project.eu
Storage and Reasoning Systems  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],06.09.11
Storage and Reasoning Results ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],06.09.11
Matching Tools ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Matching Tools Results ,[object Object],[object Object],[object Object]
Semantic Search ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],06.09.11
Semantic Search Results ,[object Object],06.09.11 Tool  Description  UITL  Auto  K-Search  K-Search allows flexible searching of semantic concepts in ontologies and documents using a form-based interface.   x  x Ginseng Guided Input Natural Language Search Engine (Ginseng) is a natural language interface question answering system. x  x  NLP-Reduce NLP-Reduce is a natural language query interface that allows its users to enter full English questions, sentence fragments, and keywords. x  x  Jena Arq ARQ is a query engine for Jena that supports the SPARQL RDF Query language. This tool has been used as a `baseline' for the automated phase.   x  PowerAqua PowerAqua is an open multi-ontology Question Answering (QA) system for the Semantic Web (SW) using a Natural Language (NL) user interface. x  x 
Semantic Web Services ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Semantic Web Services Results ,[object Object],[object Object],[object Object],[object Object],06.09.11
Coming soon: white paper ,[object Object],[object Object],[object Object],06.09.11
Coming next: 2nd campaign ,[object Object],[object Object],[object Object],[object Object],06.09.11
Thank you for your attention ,[object Object],[object Object],[object Object],[object Object],06.09.11

More Related Content

Similar to 1st SEALS evaluation campaign results: a worldwide evaluation of semantic technologies

SEALS @ I-Semantics 2011
SEALS @ I-Semantics 2011SEALS @ I-Semantics 2011
QUALGEN: Modeling and Analysing the Quality of Evolving Software Systems
QUALGEN: Modeling and Analysing the Quality of Evolving Software SystemsQUALGEN: Modeling and Analysing the Quality of Evolving Software Systems
QUALGEN: Modeling and Analysing the Quality of Evolving Software SystemsTom Mens
 
e-Framework Tools
e-Framework Toolse-Framework Tools
e-Framework Tools
Adrian Stevenson
 
Replicating FLOSS Research as eResearch
Replicating FLOSS Research as eResearchReplicating FLOSS Research as eResearch
Replicating FLOSS Research as eResearch
Andrea Wiggins
 
UCIAD overview
UCIAD overviewUCIAD overview
UCIAD overview
Mathieu d'Aquin
 
Defining an Open Source Software Trustworthiness Model
Defining an Open Source Software Trustworthiness Model Defining an Open Source Software Trustworthiness Model
Defining an Open Source Software Trustworthiness Model
Davide Taibi
 
PATHS state of the art monitoring report
PATHS state of the art monitoring reportPATHS state of the art monitoring report
PATHS state of the art monitoring report
pathsproject
 
The Planets Testbed
The Planets TestbedThe Planets Testbed
The Planets TestbedMax Kaiser
 
Education Data Standards Overview
Education Data Standards OverviewEducation Data Standards Overview
Education Data Standards OverviewFrank Walsh
 
Openess and Portfolio Technology
Openess and Portfolio TechnologyOpeness and Portfolio Technology
Openess and Portfolio Technology
dcambrid
 
Semantic Web: Technolgies and Applications for Real-World
Semantic Web: Technolgies and Applications for Real-WorldSemantic Web: Technolgies and Applications for Real-World
Semantic Web: Technolgies and Applications for Real-World
Amit Sheth
 
PlanetData: Consuming Structured Data at Web Scale
PlanetData: Consuming Structured Data at Web ScalePlanetData: Consuming Structured Data at Web Scale
PlanetData: Consuming Structured Data at Web Scale
PlanetData Network of Excellence
 
Open Data Infrastructures Evaluation Framework using Value Modelling
Open Data Infrastructures Evaluation Framework using Value Modelling Open Data Infrastructures Evaluation Framework using Value Modelling
Open Data Infrastructures Evaluation Framework using Value Modelling
Yannis Charalabidis
 
Epic2011 Assessement Portfolios
Epic2011 Assessement PortfoliosEpic2011 Assessement Portfolios
Epic2011 Assessement Portfolios
Raynauld Jacques
 
HSSP-SOA_Forum-HL7IntParisWGM-MLettere_LMaesano-MIDAS-Testing HSSP Services-M...
HSSP-SOA_Forum-HL7IntParisWGM-MLettere_LMaesano-MIDAS-Testing HSSP Services-M...HSSP-SOA_Forum-HL7IntParisWGM-MLettere_LMaesano-MIDAS-Testing HSSP Services-M...
HSSP-SOA_Forum-HL7IntParisWGM-MLettere_LMaesano-MIDAS-Testing HSSP Services-M...Libero Maesano
 
WDES 2015 paper: A Systematic Mapping on the Relations between Systems-of-Sys...
WDES 2015 paper: A Systematic Mapping on the Relations between Systems-of-Sys...WDES 2015 paper: A Systematic Mapping on the Relations between Systems-of-Sys...
WDES 2015 paper: A Systematic Mapping on the Relations between Systems-of-Sys...
Workshop on Distributed Software Development, Software Ecosystems and Systems-of-Systems
 
Open lw reference architecture project
Open lw reference architecture projectOpen lw reference architecture project
Open lw reference architecture project
Eric Kluijfhout
 

Similar to 1st SEALS evaluation campaign results: a worldwide evaluation of semantic technologies (20)

SEALS @ I-Semantics 2011
SEALS @ I-Semantics 2011SEALS @ I-Semantics 2011
SEALS @ I-Semantics 2011
 
QUALGEN: Modeling and Analysing the Quality of Evolving Software Systems
QUALGEN: Modeling and Analysing the Quality of Evolving Software SystemsQUALGEN: Modeling and Analysing the Quality of Evolving Software Systems
QUALGEN: Modeling and Analysing the Quality of Evolving Software Systems
 
e-Framework Tools
e-Framework Toolse-Framework Tools
e-Framework Tools
 
Replicating FLOSS Research as eResearch
Replicating FLOSS Research as eResearchReplicating FLOSS Research as eResearch
Replicating FLOSS Research as eResearch
 
UCIAD overview
UCIAD overviewUCIAD overview
UCIAD overview
 
Defining an Open Source Software Trustworthiness Model
Defining an Open Source Software Trustworthiness Model Defining an Open Source Software Trustworthiness Model
Defining an Open Source Software Trustworthiness Model
 
PATHS state of the art monitoring report
PATHS state of the art monitoring reportPATHS state of the art monitoring report
PATHS state of the art monitoring report
 
The Planets Testbed
The Planets TestbedThe Planets Testbed
The Planets Testbed
 
Presentation ECSA
Presentation ECSAPresentation ECSA
Presentation ECSA
 
Education Data Standards Overview
Education Data Standards OverviewEducation Data Standards Overview
Education Data Standards Overview
 
Openess and Portfolio Technology
Openess and Portfolio TechnologyOpeness and Portfolio Technology
Openess and Portfolio Technology
 
ACCESSIBLE project concept and achievements
ACCESSIBLE project concept and achievementsACCESSIBLE project concept and achievements
ACCESSIBLE project concept and achievements
 
Semantic Web: Technolgies and Applications for Real-World
Semantic Web: Technolgies and Applications for Real-WorldSemantic Web: Technolgies and Applications for Real-World
Semantic Web: Technolgies and Applications for Real-World
 
PlanetData: Consuming Structured Data at Web Scale
PlanetData: Consuming Structured Data at Web ScalePlanetData: Consuming Structured Data at Web Scale
PlanetData: Consuming Structured Data at Web Scale
 
Planetdata simpda
Planetdata simpdaPlanetdata simpda
Planetdata simpda
 
Open Data Infrastructures Evaluation Framework using Value Modelling
Open Data Infrastructures Evaluation Framework using Value Modelling Open Data Infrastructures Evaluation Framework using Value Modelling
Open Data Infrastructures Evaluation Framework using Value Modelling
 
Epic2011 Assessement Portfolios
Epic2011 Assessement PortfoliosEpic2011 Assessement Portfolios
Epic2011 Assessement Portfolios
 
HSSP-SOA_Forum-HL7IntParisWGM-MLettere_LMaesano-MIDAS-Testing HSSP Services-M...
HSSP-SOA_Forum-HL7IntParisWGM-MLettere_LMaesano-MIDAS-Testing HSSP Services-M...HSSP-SOA_Forum-HL7IntParisWGM-MLettere_LMaesano-MIDAS-Testing HSSP Services-M...
HSSP-SOA_Forum-HL7IntParisWGM-MLettere_LMaesano-MIDAS-Testing HSSP Services-M...
 
WDES 2015 paper: A Systematic Mapping on the Relations between Systems-of-Sys...
WDES 2015 paper: A Systematic Mapping on the Relations between Systems-of-Sys...WDES 2015 paper: A Systematic Mapping on the Relations between Systems-of-Sys...
WDES 2015 paper: A Systematic Mapping on the Relations between Systems-of-Sys...
 
Open lw reference architecture project
Open lw reference architecture projectOpen lw reference architecture project
Open lw reference architecture project
 

Recently uploaded

Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
RinaMondal9
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
Adtran
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex ProofszkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
Alex Pruden
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
UiPathCommunity
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 

Recently uploaded (20)

Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex ProofszkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 

1st SEALS evaluation campaign results: a worldwide evaluation of semantic technologies

  • 1. Results of the first worldwide evaluation campaign for semantic tools Dr Lyndon Nixon, STI International On behalf of the SEALS Project http://www.seals-project.eu 06.09.11
  • 2.
  • 3. SEALS (Semantic Evaluation At Large Scale) Universidad Politécnica de Madrid, Spain (Coordinator) University of Sheffield, UK Forschungszentrum Informatik, Germany University of Innsbruck, Austria Institut National de Recherche en Informatique et en Automatique, France University of Mannheim, Germany University of Zurich, Switzerland STI International, Austria Open University, UK Oxford University, UK Contact person: Asunción Gómez Pérez <asun@fi.upm.es> http://www.seals-project.eu/ EC contribution: 3.500.000 € Duration: June 2009-May 2012 1 3 1 2 1 2
  • 4.
  • 5.
  • 6. Overall SEALS Platform Architecture SEALS Service Manager Runtime Evaluation Service SEALS Portal Test Data Repository Service Tools Repository Service Results Repository Service Evaluation Descriptions Repository Service SEALS Repositories Technology Providers Evaluation Organisers Technology Adopters Software agents, i.e., technology evaluators Entity management requests Evaluation requests
  • 7. The SEALS Evaluation Campaigns 2010 Next evaluation campaigns during 2011 - 2012 Ontology Engineering Tools Reasoning Tools Ontology Matching Tools Semantic Search Tools Semantic Web Service Tools OET Conformance 2010 Conformance OET Interoperability 2010 Interoperability OET Scalability 2010 Efficiency Scalability DLBS Classification 2010 DLBS Class satisfiability 2010 DLBS Ontology satisfiability 2010 DLBS Logical entailment 2010 MT Benchmark 2010 Conformance Efficiency Interoperability MT Anatomy 2010 Conformance Efficiency Interoperability MT Conference 2010 Conformance Efficiency Interoperability Alignment coherence SST Automated Search Performance 2010 Search quality SST Automated Performance and Scalability 2010 Resource consumption SST Automated Query Expressiveness 2010 Query expressiveness SST Automated Quality of Documentation 2010 Usability SST User Usability 2010 Usability SST User Query Expressiveness 2010 Query expressiveness SWS Tool Discovery Evaluation 2010 : Performance
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.

Editor's Notes

  1. The SEALS platform is composed of seven components, four vertical components each one devoted to deal with the management of a SEALS entitiy, and two horizontal components, the first one devoted to the integration and coordination of the rest of the components, and the other devoted to the execution of the evaluations. The las t one is the SEALS portal that will be the UI of the platform. And this is how the different components are meant to be related to each other. The users will use the SEALS portal to submit entitiy management requests to the SEALS service manager, which will redirect to the appropriate entity management component. The user will also use the portal to submit evaluation requests to the SEALS service manager, which will forward the request to the Runtime Evaluation Service.