Identification of Learning Goals in Forum-based Communities

1,939 views

Published on

When Internet users search for information, surf on websites or discuss with others, their actions are driven by certain goals. Extraction of users' goals can enable higher effectiveness and accuracy of web services. Supporting users in based on their goals can be highly beneficial, especially supporting of learners in the preparation for an exam as a learning process, Different phases of learning are identified when users learn collaboratively. We scrutinize how goals are constructed and achieved within a community, examining not only social activities based on patterns of behavior, but also emotions and intents users express in their posts. As a result we elicit users’ goals. We achieved good accuracy in defining emotions of users and recognizing their intents and social patterns in our case. Here we discuss how the obtained results contribute to mining of learning community goals.

Published in: Business, Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,939
On SlideShare
0
From Embeds
0
Number of Embeds
10
Actions
Shares
0
Downloads
16
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Identification of Learning Goals in Forum-based Communities

  1. 1. 11th IEEE International Conference on Advanced Learning Technologies Identification of Learning Goalsin Forum-based Communities Identification of Learning Goals in Forum-based Communities Julian Krenge Z. Petrushyna Milos Kravcik Ralf Klamma Julian Krenge, Zinayida Petrushyna, Milos Kravcik, Ralf Klamma RWTH Aachen University ICALT 2011, July 6-8 Athens, Georgia, USALehrstuhl Informatik 5(Information Systems) Prof. Dr. M. Jarke ICALT 2011-1
  2. 2. RWTH Aachen University Identification of Learning Goals 260 institutes in 9 faculties as Europe’s leading institutions for science and researchin Forum-based Communities Around 31,400 students enrolled in 100+ academic programs 5,000+ international students from 120 countries Julian Krenge Z. Petrushyna Milos Kravcik Ralf Klamma Leading German University in External Funding (September 2010) 1,250 spin-offs created around 30,000 jobs in greater Aachen region in 20 years The Chair of Computer Science I5Lehrstuhl Informatik 5 http://dbis.rwth-aachen.de(Information Systems) Prof. Dr. M. Jarke Our research group: ICALT 2011-2 Community Information Systems
  3. 3. Projects ROLE: Responsive Open Learning TEL-Map: Future gazing TEL Identification of Learning Goals Environmentsin Forum-based Communities  7th Framework ICT  IST 7th Framework Programme  Coordination and support action  Integrated Project  Dynamic roadmaps for unknown  Scientific coordination learning landscape  Self-regulated & social learning  http://www.telmap.org Julian Krenge Z. Petrushyna  http://www.role-project.eu  Portal: http://learningfrontiers.eu GaLA: Games and Learning Milos Kravcik Ralf Klamma TeLLNet: Teachers‘ Life Long Alliance Learning  IST 7th Framework Programme  Social Network Analysis to study  Network of Excellence on Serious eTwinning network (135 000+ teachers) Games  Reflections support for web communitiesLehrstuhl Informatik 5(Information Systems)  http://www.galanoe.eu/  Development of meta-competences Prof. Dr. M. Jarke ICALT 2011-3  http://www.tellnet.eun.org
  4. 4. Agenda Identification of Learning Goalsin Forum-based Motivation: Support of Self-Regulated Learning Communities Theoretical Background: Intent & Sentiment Analysis Julian Krenge Z. Petrushyna Context: Community preparing for English Language Tests Milos Kravcik Method: Identification of Learning Phases Ralf Klamma EvaluationLehrstuhl Informatik 5(Information Systems) Conclusion & Outlook Prof. Dr. M. Jarke ICALT 2011-4
  5. 5. Motivation: Self-Regulated Learning Identification of Learning Goalsin Forum-based Communities Julian Krenge Z. Petrushyna Milos Kravcik Ralf KlammaLehrstuhl Informatik 5(Information Systems) Prof. Dr. M. Jarke ICALT 2011-5 Motivation [Fruhmann, Nussbaumer & Albert, 2010]
  6. 6. Theoretical Background Natural Learning Processing Identification of Learning Goals in Forum-based Communities  Intent Analysis focuses on classification by a profile of the goals and intentions present in textual content [Strohmaier et al. 2008]  Sentiment Analysis aims to use automated tools to Julian Krenge detect subjective information such as opinions, attitudes, and feelings expressed in text [Lin & He 2009] Z. Petrushyna Milos Kravcik Ralf Klamma Social Network Analysis Lehrstuhl Informatik 5 (Information Systems)  Identifies patterns of behavior based on occurrence of posts and threads, not on the content Prof. Dr. M. Jarke ICALT 2011-6Theoretical Background
  7. 7. Context  Urch Forums (formerly TestMagic) Identification of Learning Goalsin Forum-based - Community: preparation for English language tests Communities - 120,000+ threads, 800,000+ posts, 100,000+ users over 10 years  Refinement - Focus on most relevant sub-forums Julian Krenge Z. Petrushyna Milos Kravcik - 67,000+ threads, 428,000+ posts, by 21,000+ users - Clique: a temporal complete sub-graph within global community Ralf Klamma  Group of users who appear in several threads together  Requirements: 4+ users, occurs 10+ times, 75+% clique members post in 10+ threadsLehrstuhl Informatik 5(Information Systems) Prof. Dr. M. Jarke ICALT 2011-7 Concept
  8. 8. Cliques Identification of User of clique Learning Goals Non-clique User in threadin Forum-based Communities Thread 1 Thread 2 Clique-user missing in thread Thread 3 Julian Krenge Z. Petrushyna Milos Kravcik Ralf Klamma TimeLehrstuhl Informatik 5(Information Systems) Prof. Dr. M. Jarke  12,881 cliques: ICALT 2011-8 Concept avg. size 5 users, avg. occurrence 14 times
  9. 9. Phases of Learning and Goal Model Identification of Learning Goalsin Forum-based Communities Julian Krenge Z. Petrushyna Milos Kravcik Ralf KlammaLehrstuhl Informatik 5(Information Systems) Prof. Dr. M. Jarke ICALT 2011-9 Concept Based on [Fruhmann, Nussbaumer & Albert, 2010]
  10. 10. Evaluation of Learning Phases Identification of Different users Learning Goals Phase 1 and 2 (low sentiment, questioner, lot of intents)in Forum-based Communities Phase 3 (increasing sentiment, conversationalist) Phase 4 (high sentiment, answering person) 1 week / step Julian Krenge Z. Petrushyna Milos Kravcik Ralf KlammaLehrstuhl Informatik 5(Information Systems)  40% of „footprints“ of cliques align with model for phases Prof. Dr. M. Jarke ICALT 2011-10 Evaluation
  11. 11. Intent Analysis Expressions Identification of Rank Firstword Keyverb Count Rank Keyverb Noun Count Learning Goalsin Forum-based 1 Want Know 1264 1 Take Test 837 Communities 2 Need Know 1027 2 Get Score 478 3 Planning Take 885 3 Spend Time 366 4 Like Know 854 4 Solve Problem 333 5 Going Take 788 5 Take Exam 253 6 Need Find 760 6 Take GRE 250 7 How Solve 708 7 Answer Question 231 Julian Krenge 8 Need Get 554 - Buy Homes 231 Z. Petrushyna Milos Kravcik 9 Want Get 552 9 Think People 221 Ralf Klamma 10 Wanted Know 468 10 Take TOEFL 219  Patterns of intent expressions  132,328 expressions of intent detectedLehrstuhl Informatik 5(Information Systems)  Most obvious keyverbs: know (solve), take (test) Prof. Dr. M. Jarke ICALT 2011-11 Evaluation
  12. 12. User Feedback on Significance Identification of Learning Goals 18 users gave feedback on combinations that reflected their goalsin Forum-based Communities  Specific verbs have high significance for goal expression -7 -2 3 8 13 Know Solve Analyse Julian Krenge Z. Petrushyna Work Milos Kravcik Find Share Yes Ralf Klamma Improve No Explain Get Think SupportLehrstuhl Informatik 5(Information Systems) Give Prof. Dr. M. Jarke Pass ICALT 2011-12 Evaluation Take
  13. 13. Conclusion  Issue: Extracting goals in learning communities Identification of Learning Goalsin Forum-based  Chosen criteria help identifying learning phase Communities - SNA pattern - Intent analysis - Sentiment analysis Julian Krenge Z. Petrushyna Milos Kravcik  Intent analysis patterns are significant for goals of learners as different aspects are expressed Ralf Klamma  Learners follow the assumed phase model (~40%)  Challenge: Support self-reflection & self-regulationLehrstuhl Informatik 5(Information Systems)  Holistic approach enables automatic identification of learning goals Prof. Dr. M. Jarke ICALT 2011-13Conclusion & Outlook
  14. 14. Announcements  Workshop: Self-Regulated Learning in Responsive Open Identification of Learning Goalsin Forum-based Communities Learning Environments - Thursday, 11:00-13:30  Poster: How can Psychology inform the Design of Learning Experiences - Thursday, 15:00-18:00 Julian Krenge Z. Petrushyna Milos Kravcik  ROLE Widget Enchantment Contest: Deadline – 15 July Ralf Klamma - Join the competition – create a widget – win a prize! - www.role-project.euLehrstuhl Informatik 5(Information Systems) Prof. Dr. M. Jarke ICALT 2011-14Conclusion & Outlook

×