Semantic Technologies  in Learning Environments  Dragan Ga šević Athabasca University Email: dgasevic@acm.org
 
The Social Web is here! What now?
Topics to discuss – morning Semantics as a big promise Learning ecosystems Examples of semantics in-use Authoring and reuse of learning content Learning analytics Open challenges
Part I Semantics as a Big Promise
Semantic Web To create a universal medium for the exchange of data.  …  to smoothly interconnect  personal information management,  enterprise application integration and  the global sharing of  commercial, scientific and cultural data.     Semantic Web Activity Statement http://www.w3.org/2001/sw/Activity
Semantic Web Key characteristics Anyone can say anything about anything Explicit definition of the meaning
What is an ontology?  Definition (Swartout and Tate, 1999) the basic structure or armature  around which a knowledge base can be built
RDF
The Semantic Web  is NOT opposite to  the Social Web!
Semantic Web Ontologies: Interconnecting applications Shared domain conceptualizations
Linked Data
Linked Data SPARLQ end points They enable data mash-ups
Part III Promises for  Learning Environments
Learning Ecosystems http://www.w3.org/2006/Talks/1023-sb-W3CTechSemWeb/DataServicesWebAppMetro2.jpg
Learning Ecosystems Authoring Reusability Packaging Educators Reusability Adaptivity Evolution Collaboration with educators and students
Learning Ecosystems Authoring Reusability Packaging Educators Feedback Learning and Collaborating Personalization Adaptivity Context-awareness Social interaction … Learners
Learning Ecosystems Authoring Reusability Packaging Learning and Collaborating Community Peer-Review Presenting Administration Mobile Educators Learners
Important considerations Julita Vassileva (U of Saskatchewan) “ Rule: hard/impossible to impose hard rules” Gord McCalla (U of Saskatchewan) Ecological approach – sharing experience
Personal  Learning Information Management  Connect presently isolated islands -  not ecological! Students/Educators Content LORs Libraries Multimedia Reuse Pedagogy User models Adaptivity Educational models Collaboration Chat Discussion Services Community Course, University, … Portfolio Evidence Competencies Peer-review Courses Publishing Platforms Mobile Desktop  Domain tools Mashed up with education tools Desktop Email Firefox… Authoring Word Frontpage Reload… Privacy Policy Identity
Part IIIa Authoring and Reuse How to reduce  the number of clicks, improve precision and shorten the effort time?
Semantic Documents Resources composed of data units Uniquely identified by URIs Annotated by concepts from ontologies Linked to other data units via explicit links
Semantic Document Management Semantic Document Authoring RDFizing Annotation Indexing Linking Semantic Document Search & Retrieval Semantic Document  Navigation Nešić Saša ,  Mehdi Jazyeri, Dragan Gasevic  "Semantic Document Architecture for Desktop Document Integration and Management, “ the 22nd International Conference on Software Engineering and Knowledge Engineering (SEKE), San Francisco, USA, 2010, In Press.
Semantic Documents Sharing  Social Networks around shared semantic documents  Nešić Saša, Jazayeri Mehdi, Lelli Francesco, and Gasevic Dragan,  "Towards Efficient Document Content Sharing in Social Networks,”   2 nd   International Workshop on Social Software Engineering and Applications, co-located with ESEC/FSE 2009.
SemanticDoc – MS Office Tools Nešić Saša, Jazayeri Mehdi, Gašević Dragan,  "Extending MS Office for sharing Document Content Units over the Semantic Web,"  –  8 th  IEEE International Conference on Web Engineering (ICWE), Yorktown Heights, New York, USA, 2008.
SemanticDoc – MS Office Tools Nešić Saša, Jazayeri Mehdi, Gašević Dragan,  "Extending MS Office for sharing Document Content Units over the Semantic Web,"  –  8 th  IEEE International Conference on Web Engineering (ICWE), Yorktown Heights, New York, USA, 2008.
SemanticDoc – MS Office Tools Nešić Saša, Jazayeri Mehdi, Gašević Dragan,  "Extending MS Office for sharing Document Content Units over the Semantic Web,"  –  8 th  IEEE International Conference on Web Engineering (ICWE), Yorktown Heights, New York, USA, 2008.
SemanticDoc – MS Office Tools Nešić Saša, Jazayeri Mehdi, Gašević Dragan,  "Extending MS Office for sharing Document Content Units over the Semantic Web,"  –  8 th  IEEE International Conference on Web Engineering (ICWE), Yorktown Heights, New York, USA, 2008.
SemanticDoc – MS Office Tools Nešić Saša, Jazayeri Mehdi, Gašević Dragan,  "Extending MS Office for sharing Document Content Units over the Semantic Web,"  –  8 th  IEEE International Conference on Web Engineering (ICWE), Yorktown Heights, New York, USA, 2008.
SemanticDoc – MS Office Tools Nešić Saša, Jazayeri Mehdi, Gašević Dragan,  "Extending MS Office for sharing Document Content Units over the Semantic Web,"  –  8 th  IEEE International Conference on Web Engineering (ICWE), Yorktown Heights, New York, USA, 2008.
Semantic Search Matters
Usability Evaluation User effectiveness and efficiency Nešić Saša, Gašević Dragan, Jazayeri Mehdi, Monica Landoni,  " Using Semantic Documents and Social Networking in Authoring Course Material: An Empirical Study,"  10th IEEE International Conference on Advanced Learning Technologies (ICALT), Tunisia, 2010  (Best paper award) .
Usability Evaluation User effectiveness and efficiency Nešić Saša, Gašević Dragan, Jazayeri Mehdi, Monica Landoni,  " Using Semantic Documents and Social Networking in Authoring Course Material: An Empirical Study,"  10th IEEE International Conference on Advanced Learning Technologies (ICALT), Tunisia, 2010  (Best paper award) .
Usability Evaluation User effectiveness and efficiency Number of mouse clicks  Nešić Saša, Gašević Dragan, Jazayeri Mehdi, Monica Landoni,  " Using Semantic Documents and Social Networking in Authoring Course Material: An Empirical Study,"  10th IEEE International Conference on Advanced Learning Technologies (ICALT), Tunisia, 2010  (Best paper award) .
Usability Evaluation User effectiveness and efficiency Number of windows switches Nešić Saša, Gašević Dragan, Jazayeri Mehdi, Monica Landoni,  " Using Semantic Documents and Social Networking in Authoring Course Material: An Empirical Study,"  10th IEEE International Conference on Advanced Learning Technologies (ICALT), Tunisia, 2010  (Best paper award) .
Semantic Documents Open-source project  Project website: http://www.semanticdoc.org Source code: http://sourceforge.net/projects/sdarch/
Part IIIb Content Evolution Feedback about effectiveness of  used content and pedagogies
Context is Missing! http://www.w3.org/2006/Talks/1023-sb-W3CTechSemWeb/DataServicesWebAppMetro2.jpg
“ A crazy problem requires  a crazy solution!” (Griff Richards, 2005)
Learning Object  Context Ontology: LOCO Learning context Learner(s) Learner characteristics Learning activity Prerequisites, learning objectives, available time, …  Learning object used/produced Parts of objects and their pedagogical role Domain concepts Jovanović, J., Knight, C., Gašević, D., Richards, G., "Learning Object Context on the Semantic Web,"  In Proc. 6th IEEE International Conference on Advanced Learning Technologies , Kerkrade, The Netherlands, 2006 pp. 669-673 ( Best paper award ).
Learning Object  Context Ontology: LOCO Learning context Learner(s) Learner characteristics Learning activity Prerequisites, learning objectives, available time, …  Learning object used/produced Parts of objects and their pedagogical role Domain concepts Jovanović, J., Knight, C., Gašević, D., Richards, G., "Learning Object Context on the Semantic Web,"  6th IEEE International Conference on Advanced Learning Technologies , Kerkrade, The Netherlands, 2006 pp. 669-673 ( Best paper award ).
LOCO-Analyst LOCO-Analyst and iHelp Courses  http://www.jelenajovanovic.net/LOCO-Analyst/
LOCO-Analyst
LOCO-Analyst
LOCO-Analyst
LOCO-Analyst
OATS: Open Annotation & Tagging System  OATS with Moodle
Education Social Semantic Web Combining Social and Semantic Web aspects OAST and LOCO-Analyst
Student comprehension in  LOCO-Analyst
Evaluation of LOCO-Analyst Two evaluations In 2006  Instructions provided and asked to try the tool Participants: 18 (14 male, 4 female) Experience: 3.09 (SD=2.2) In 2009 Video clips demonstrating the tool Participants: 22 (17 male, 5 female) Experience: 6.45 (SD=5.58)
Evaluation of LOCO-Analyst Insights into the activities No statistical improvement over the previous version => Better feedback about interactions between students is needed 4.57, 0.68, 21 NA Help me identify the domain topics the students were having difficulties with. 3.54, 1.01, 22 3.17, 1.09, 18 The information helps me determine how to improve the students’ online interactions.  †   4.41, 0.80, 22 3.72, 0.46, 18 Relevant information regarding the students’ interactions within the online learning environment  † 4.27, 0.70, 22 3.50, 0.70, 18 The information helps me identify what needs to be improved in the learning content  † 4.45, 0.67, 22 3.71, 0.47, 17 Enables me to get an insight into the students’ interactions with the learning content  †
Evaluation of LOCO-Analyst User interface  Significant preference for the improved tool version (t(38)=2.20, p < 0.05) No statistically significant increase of intuitiveness and information overload 4.5, 0.60, 22 4.00, 0.84, 18 General opinion about the GUI 2.5, 1.34, 22 1.72, 0.58, 18 LOCO-Analyst’s GUI is overburdened with information  ‡ 4.5, 0.80, 22 4.22, 0.73,18 LOCO-Analyst’s GUI (Graphical User Interface) is intuitive enough
Evaluation of LOCO-Analyst Predictors of the perceived utility information about interactions of students social networking  students’ comprehension of content collaborative tagging intuitiveness & ease-to-understand of  the presentation of the above two
Evaluation of LOCO-Analyst Predictors of user interface perceived value  students’ interaction with individual lessons Individual learning – granularity level students’ activities in discussion forums and  chat rooms social activities students’ comprehension of studied topics collaborative tagging
Part IV  Open Challenges
Challenges Ontology development Similar to databases –  someone needs to develop Some ontology development lessons learned Lightweight ontologies: “Little semantics goes a long way” Linked with other ontologies  Friend of a Friend Semantically-interlinked Online Communities
Challenges Peer, expert and user retrieval Networks and data are locked List of “friends” is not enough Interaction history also needed Online presence
Challenges Analytics for students Personal planning – social organizational Experience sharing Analytics for organizational Learn. organizations and organization learn. Learning ecosystems
Stay tuned… http://intelleo.eu Much more underway
Personal  learning  information  management   More Meaningful personalized interactive social collaborative ubiquitous  … Learning ecosystems
Thank you!

Semantic Technologies in Learning Environments

  • 1.
    Semantic Technologies in Learning Environments Dragan Ga šević Athabasca University Email: dgasevic@acm.org
  • 2.
  • 3.
    The Social Webis here! What now?
  • 4.
    Topics to discuss– morning Semantics as a big promise Learning ecosystems Examples of semantics in-use Authoring and reuse of learning content Learning analytics Open challenges
  • 5.
    Part I Semanticsas a Big Promise
  • 6.
    Semantic Web Tocreate a universal medium for the exchange of data. … to smoothly interconnect personal information management, enterprise application integration and the global sharing of commercial, scientific and cultural data. Semantic Web Activity Statement http://www.w3.org/2001/sw/Activity
  • 7.
    Semantic Web Keycharacteristics Anyone can say anything about anything Explicit definition of the meaning
  • 8.
    What is anontology? Definition (Swartout and Tate, 1999) the basic structure or armature around which a knowledge base can be built
  • 9.
  • 10.
    The Semantic Web is NOT opposite to the Social Web!
  • 11.
    Semantic Web Ontologies:Interconnecting applications Shared domain conceptualizations
  • 12.
  • 13.
    Linked Data SPARLQend points They enable data mash-ups
  • 14.
    Part III Promisesfor Learning Environments
  • 15.
  • 16.
    Learning Ecosystems AuthoringReusability Packaging Educators Reusability Adaptivity Evolution Collaboration with educators and students
  • 17.
    Learning Ecosystems AuthoringReusability Packaging Educators Feedback Learning and Collaborating Personalization Adaptivity Context-awareness Social interaction … Learners
  • 18.
    Learning Ecosystems AuthoringReusability Packaging Learning and Collaborating Community Peer-Review Presenting Administration Mobile Educators Learners
  • 19.
    Important considerations JulitaVassileva (U of Saskatchewan) “ Rule: hard/impossible to impose hard rules” Gord McCalla (U of Saskatchewan) Ecological approach – sharing experience
  • 20.
    Personal LearningInformation Management Connect presently isolated islands - not ecological! Students/Educators Content LORs Libraries Multimedia Reuse Pedagogy User models Adaptivity Educational models Collaboration Chat Discussion Services Community Course, University, … Portfolio Evidence Competencies Peer-review Courses Publishing Platforms Mobile Desktop Domain tools Mashed up with education tools Desktop Email Firefox… Authoring Word Frontpage Reload… Privacy Policy Identity
  • 21.
    Part IIIa Authoringand Reuse How to reduce the number of clicks, improve precision and shorten the effort time?
  • 22.
    Semantic Documents Resourcescomposed of data units Uniquely identified by URIs Annotated by concepts from ontologies Linked to other data units via explicit links
  • 23.
    Semantic Document ManagementSemantic Document Authoring RDFizing Annotation Indexing Linking Semantic Document Search & Retrieval Semantic Document Navigation Nešić Saša , Mehdi Jazyeri, Dragan Gasevic &quot;Semantic Document Architecture for Desktop Document Integration and Management, “ the 22nd International Conference on Software Engineering and Knowledge Engineering (SEKE), San Francisco, USA, 2010, In Press.
  • 24.
    Semantic Documents Sharing Social Networks around shared semantic documents Nešić Saša, Jazayeri Mehdi, Lelli Francesco, and Gasevic Dragan, &quot;Towards Efficient Document Content Sharing in Social Networks,” 2 nd International Workshop on Social Software Engineering and Applications, co-located with ESEC/FSE 2009.
  • 25.
    SemanticDoc – MSOffice Tools Nešić Saša, Jazayeri Mehdi, Gašević Dragan, &quot;Extending MS Office for sharing Document Content Units over the Semantic Web,&quot; – 8 th IEEE International Conference on Web Engineering (ICWE), Yorktown Heights, New York, USA, 2008.
  • 26.
    SemanticDoc – MSOffice Tools Nešić Saša, Jazayeri Mehdi, Gašević Dragan, &quot;Extending MS Office for sharing Document Content Units over the Semantic Web,&quot; – 8 th IEEE International Conference on Web Engineering (ICWE), Yorktown Heights, New York, USA, 2008.
  • 27.
    SemanticDoc – MSOffice Tools Nešić Saša, Jazayeri Mehdi, Gašević Dragan, &quot;Extending MS Office for sharing Document Content Units over the Semantic Web,&quot; – 8 th IEEE International Conference on Web Engineering (ICWE), Yorktown Heights, New York, USA, 2008.
  • 28.
    SemanticDoc – MSOffice Tools Nešić Saša, Jazayeri Mehdi, Gašević Dragan, &quot;Extending MS Office for sharing Document Content Units over the Semantic Web,&quot; – 8 th IEEE International Conference on Web Engineering (ICWE), Yorktown Heights, New York, USA, 2008.
  • 29.
    SemanticDoc – MSOffice Tools Nešić Saša, Jazayeri Mehdi, Gašević Dragan, &quot;Extending MS Office for sharing Document Content Units over the Semantic Web,&quot; – 8 th IEEE International Conference on Web Engineering (ICWE), Yorktown Heights, New York, USA, 2008.
  • 30.
    SemanticDoc – MSOffice Tools Nešić Saša, Jazayeri Mehdi, Gašević Dragan, &quot;Extending MS Office for sharing Document Content Units over the Semantic Web,&quot; – 8 th IEEE International Conference on Web Engineering (ICWE), Yorktown Heights, New York, USA, 2008.
  • 31.
  • 32.
    Usability Evaluation Usereffectiveness and efficiency Nešić Saša, Gašević Dragan, Jazayeri Mehdi, Monica Landoni, &quot; Using Semantic Documents and Social Networking in Authoring Course Material: An Empirical Study,&quot; 10th IEEE International Conference on Advanced Learning Technologies (ICALT), Tunisia, 2010 (Best paper award) .
  • 33.
    Usability Evaluation Usereffectiveness and efficiency Nešić Saša, Gašević Dragan, Jazayeri Mehdi, Monica Landoni, &quot; Using Semantic Documents and Social Networking in Authoring Course Material: An Empirical Study,&quot; 10th IEEE International Conference on Advanced Learning Technologies (ICALT), Tunisia, 2010 (Best paper award) .
  • 34.
    Usability Evaluation Usereffectiveness and efficiency Number of mouse clicks Nešić Saša, Gašević Dragan, Jazayeri Mehdi, Monica Landoni, &quot; Using Semantic Documents and Social Networking in Authoring Course Material: An Empirical Study,&quot; 10th IEEE International Conference on Advanced Learning Technologies (ICALT), Tunisia, 2010 (Best paper award) .
  • 35.
    Usability Evaluation Usereffectiveness and efficiency Number of windows switches Nešić Saša, Gašević Dragan, Jazayeri Mehdi, Monica Landoni, &quot; Using Semantic Documents and Social Networking in Authoring Course Material: An Empirical Study,&quot; 10th IEEE International Conference on Advanced Learning Technologies (ICALT), Tunisia, 2010 (Best paper award) .
  • 36.
    Semantic Documents Open-sourceproject Project website: http://www.semanticdoc.org Source code: http://sourceforge.net/projects/sdarch/
  • 37.
    Part IIIb ContentEvolution Feedback about effectiveness of used content and pedagogies
  • 38.
    Context is Missing!http://www.w3.org/2006/Talks/1023-sb-W3CTechSemWeb/DataServicesWebAppMetro2.jpg
  • 39.
    “ A crazyproblem requires a crazy solution!” (Griff Richards, 2005)
  • 40.
    Learning Object Context Ontology: LOCO Learning context Learner(s) Learner characteristics Learning activity Prerequisites, learning objectives, available time, … Learning object used/produced Parts of objects and their pedagogical role Domain concepts Jovanović, J., Knight, C., Gašević, D., Richards, G., &quot;Learning Object Context on the Semantic Web,&quot; In Proc. 6th IEEE International Conference on Advanced Learning Technologies , Kerkrade, The Netherlands, 2006 pp. 669-673 ( Best paper award ).
  • 41.
    Learning Object Context Ontology: LOCO Learning context Learner(s) Learner characteristics Learning activity Prerequisites, learning objectives, available time, … Learning object used/produced Parts of objects and their pedagogical role Domain concepts Jovanović, J., Knight, C., Gašević, D., Richards, G., &quot;Learning Object Context on the Semantic Web,&quot; 6th IEEE International Conference on Advanced Learning Technologies , Kerkrade, The Netherlands, 2006 pp. 669-673 ( Best paper award ).
  • 42.
    LOCO-Analyst LOCO-Analyst andiHelp Courses http://www.jelenajovanovic.net/LOCO-Analyst/
  • 43.
  • 44.
  • 45.
  • 46.
  • 47.
    OATS: Open Annotation& Tagging System OATS with Moodle
  • 48.
    Education Social SemanticWeb Combining Social and Semantic Web aspects OAST and LOCO-Analyst
  • 49.
  • 50.
    Evaluation of LOCO-AnalystTwo evaluations In 2006 Instructions provided and asked to try the tool Participants: 18 (14 male, 4 female) Experience: 3.09 (SD=2.2) In 2009 Video clips demonstrating the tool Participants: 22 (17 male, 5 female) Experience: 6.45 (SD=5.58)
  • 51.
    Evaluation of LOCO-AnalystInsights into the activities No statistical improvement over the previous version => Better feedback about interactions between students is needed 4.57, 0.68, 21 NA Help me identify the domain topics the students were having difficulties with. 3.54, 1.01, 22 3.17, 1.09, 18 The information helps me determine how to improve the students’ online interactions. † 4.41, 0.80, 22 3.72, 0.46, 18 Relevant information regarding the students’ interactions within the online learning environment † 4.27, 0.70, 22 3.50, 0.70, 18 The information helps me identify what needs to be improved in the learning content † 4.45, 0.67, 22 3.71, 0.47, 17 Enables me to get an insight into the students’ interactions with the learning content †
  • 52.
    Evaluation of LOCO-AnalystUser interface Significant preference for the improved tool version (t(38)=2.20, p < 0.05) No statistically significant increase of intuitiveness and information overload 4.5, 0.60, 22 4.00, 0.84, 18 General opinion about the GUI 2.5, 1.34, 22 1.72, 0.58, 18 LOCO-Analyst’s GUI is overburdened with information ‡ 4.5, 0.80, 22 4.22, 0.73,18 LOCO-Analyst’s GUI (Graphical User Interface) is intuitive enough
  • 53.
    Evaluation of LOCO-AnalystPredictors of the perceived utility information about interactions of students social networking students’ comprehension of content collaborative tagging intuitiveness & ease-to-understand of the presentation of the above two
  • 54.
    Evaluation of LOCO-AnalystPredictors of user interface perceived value students’ interaction with individual lessons Individual learning – granularity level students’ activities in discussion forums and chat rooms social activities students’ comprehension of studied topics collaborative tagging
  • 55.
    Part IV Open Challenges
  • 56.
    Challenges Ontology developmentSimilar to databases – someone needs to develop Some ontology development lessons learned Lightweight ontologies: “Little semantics goes a long way” Linked with other ontologies Friend of a Friend Semantically-interlinked Online Communities
  • 57.
    Challenges Peer, expertand user retrieval Networks and data are locked List of “friends” is not enough Interaction history also needed Online presence
  • 58.
    Challenges Analytics forstudents Personal planning – social organizational Experience sharing Analytics for organizational Learn. organizations and organization learn. Learning ecosystems
  • 59.
  • 60.
    Personal learning information management More Meaningful personalized interactive social collaborative ubiquitous … Learning ecosystems
  • 61.

Editor's Notes

  • #41 Learning Object Context as is a kind of LO metadata (we also call it context-awareness metadata) that captures all the information that characterizes the specific situations (contexts) in which certain LO has been used. A (specific) learning situation is determined by the learning activity, the learning content, and the learner(s) involved. Aimed at capturing diverse kinds of learning situations typical for modern e-Learning environments In a nutshell, context, as defined here, is about a student (or a group of students) interacting with a learning content by performing certain activity with a particular purpose in mind.
  • #42 Learning Object Context as is a kind of LO metadata (we also call it context-awareness metadata) that captures all the information that characterizes the specific situations (contexts) in which certain LO has been used. A (specific) learning situation is determined by the learning activity, the learning content, and the learner(s) involved. Aimed at capturing diverse kinds of learning situations typical for modern e-Learning environments In a nutshell, context, as defined here, is about a student (or a group of students) interacting with a learning content by performing certain activity with a particular purpose in mind.
  • #44 implemented as an extension of the well-known open-source Reload Content Packaging Editor this design decision ensured that instructors effectively use the same tool for creating LOs, receiving and viewing automatically generated feedback about their use, and modifying the LOs accordingly. The main goal was to enable easier and wider acceptance of LOCO-Analyst.
  • #45 implemented as an extension of the well-known open-source Reload Content Packaging Editor this design decision ensured that instructors effectively use the same tool for creating LOs, receiving and viewing automatically generated feedback about their use, and modifying the LOs accordingly. The main goal was to enable easier and wider acceptance of LOCO-Analyst.
  • #46 implemented as an extension of the well-known open-source Reload Content Packaging Editor this design decision ensured that instructors effectively use the same tool for creating LOs, receiving and viewing automatically generated feedback about their use, and modifying the LOs accordingly. The main goal was to enable easier and wider acceptance of LOCO-Analyst.
  • #47 implemented as an extension of the well-known open-source Reload Content Packaging Editor this design decision ensured that instructors effectively use the same tool for creating LOs, receiving and viewing automatically generated feedback about their use, and modifying the LOs accordingly. The main goal was to enable easier and wider acceptance of LOCO-Analyst.