Slides presenting our recent work at the 2014 UK ontology meeting: design recommendations for the next generation of ontology authoring tools, Protégé4US (Protégé for user studies) and some incipient authoring patterns we found.
Markel VigoLecturer at The University of Manchester
Identifying ontology authoring strategies and patterns
1. Identifying ontology authoring
strategies and patterns
Markel Vigo★, Caroline Jay, Robert Stevens
University of Manchester (UK)
WhatIf: Answering “What if...” questions for Ontology Authoring.
EPSRC reference EP/J014176/1
@markelvigo
markel.vigo@manchester.ac.uk
www.markelvigo.info
★
UK Ontology Meeting, UKON 2014
April 24, Birmingham
2. Identifying ontology authoring strategies and patterns UKON 2014
Goals
• Find authoring patterns
• Identify the challenges of the authoring process
• Inform authoring tools
• Support for whatif questions
3. Exploratory study
• Interview with 15 ontology authors
• Strategies inform a set of design recommendations
- Sensemaking, exploration, searching
- Building
- Debugging and evaluation
More info:
M. Vigo, C. Jay, R. Stevens (2014) Design insights for the next wave ontology authoring tools.
Proceedings of ACM SIGCHI Conference on Human Factors, CHI‟ 14
Identifying ontology authoring strategies and patterns UKON 2014
4. Confirmatory study
• Protégé4US: modified Protégé to generate log data
of authoring and interaction events
More info:
M. Vigo, C. Jay, R. Stevens (2014) Protégé4US: Harvesting Ontology Authoring Data with Protégé.
Workshop on Human-Semantic Web Interaction, HSWI‟ 14
1389972276585,Classes,Element edited,Juliette subclass of: Potato and hasCroppingTime some „Main cropping‟
1389972277786,Classes,Save ontology,http://owl.cs.manchester.ac.uk/ontology/start-here.owl
1389972280204,Classes,Reasoner invoked,HermiT 1.3.8
1389972280647,Classes,Mouse entered,Class hierarchy (inferred)
1389972282910,Classes,Element hovered,Early_cropping_potato
1389972283049,Classes,Element selected,Early_cropping_potato
1389972283661,Classes,Hierarchy expanded,Early_cropping_potato
• 15 users, 3 authoring tasks with Protégé4US
- Correlations bw usability metrics and authoring events
- Profiling users by their use of Protégé tab
Identifying ontology authoring strategies and patterns UKON 2014
6. Confirmatory study II
• Data analysis shows emerging patternsP15 log
Back
Check property
Class addition
Convert into
defined class:finished
Convert into
defined class:start
Entity renamed
Explanation invoked
Entity deleted
Entity dragged
Entity edited:finishEntity edited:start
Entity selected
Link clicked
Property addition
Reasoner finished
Reasoner invoked
Save
Set active ontology
Hierarchy collapsed
Hierarchy expanded Undo
P9 log
Back
Check property
Class addition
Convert into
defined class:finished
Convert into
defined class:start
Entity renamed
Explanation invoked
Entity deleted
Entity dragged
Entity edited:finishEntity edited:start
Entity selected
Link clicked
Property addition
Reasoner finished
Reasoner invoked
Save
Set active ontology
Hierarchy collapsed
Hierarchy expanded Undo
Identifying ontology authoring strategies and patterns UKON 2014
7. Confirmatory study II
• Mantel test to compute correlation between matrices (test
used for measuring the genetic distance bw organisms)
p value
P1
P2
P3
P4
P5
P6
P7
P8
P9
P10
P11
P12
P13
P14
P15
P1 P2 P3 P4 P5 P6 P7 P8 P9 P10P11P12P13P14P15
0.00
0.02
0.04
0.06
0.08
0.10
Correlation
P1
P2
P3
P4
P5
P6
P7
P8
P9
P10
P11
P12
P13
P14
P15
P1 P2 P3 P4 P5 P6 P7 P8 P9 P10P11P12P13P14P15
0.0
0.2
0.4
0.6
0.8
1.0
Identifying ontology authoring strategies and patterns UKON 2014
8. Identifying ontology authoring
strategies and patterns
Markel Vigo★, Caroline Jay, Robert Stevens
University of Manchester (UK)
Datasets and Protégé4US
http://owl.cs.manchester.ac.uk/whatif/
Papers
Design insights for the next wave ontology authoring tools
www.manchester.ac.uk/escholar/uk-ac-man-scw:217528
Protégé4US: Harvesting Ontology Authoring Data with Protégé
www.manchester.ac.uk/escholar/uk-ac-man-scw:223543
@markelvigo
markel.vigo@manchester.ac.uk
www.markelvigo.info
★