The document discusses the identification of learning goals in forum-based communities, emphasizing the methods of intent and sentiment analysis, as well as social network analysis. It outlines the context of a community preparing for English language tests and the process of categorizing user engagement into distinct learning phases. The findings suggest a holistic approach that aids in the automatic identification of learners' goals and emphasizes self-regulated learning.

1. 11th IEEE International Conference on
Advanced Learning Technologies
Identification of
Learning Goals
in Forum-based
Communities
Identification of Learning Goals
in Forum-based Communities
Julian Krenge
Z. Petrushyna
Milos Kravcik
Ralf Klamma Julian Krenge, Zinayida Petrushyna, Milos Kravcik, Ralf Klamma
RWTH Aachen University
ICALT 2011, July 6-8
Athens, Georgia, USA
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
ICALT 2011-1

2. RWTH Aachen University
Identification of
Learning Goals 260 institutes in 9 faculties as Europe’s leading
institutions for science and research
in Forum-based
Communities
Around 31,400 students enrolled in 100+ academic
programs
5,000+ international students from 120 countries
Julian Krenge
Z. Petrushyna
Milos Kravcik
Ralf Klamma
Leading German University in External Funding
(September 2010)
1,250 spin-offs created around 30,000 jobs in
greater Aachen region in 20 years
The Chair of Computer Science I5
Lehrstuhl Informatik 5
http://dbis.rwth-aachen.de
(Information Systems)
Prof. Dr. M. Jarke Our research group:
ICALT 2011-2 Community Information Systems

3. Projects
ROLE: Responsive Open Learning TEL-Map: Future gazing TEL
Identification of
Learning Goals
Environments
in Forum-based
Communities  7th Framework ICT
 IST 7th Framework Programme  Coordination and support action
 Integrated Project  Dynamic roadmaps for unknown
 Scientific coordination learning landscape
 Self-regulated & social learning  http://www.telmap.org
Julian Krenge
Z. Petrushyna  http://www.role-project.eu  Portal: http://learningfrontiers.eu
GaLA: Games and Learning
Milos Kravcik
Ralf Klamma
TeLLNet: Teachers‘ Life Long
Alliance Learning
 IST 7th Framework Programme  Social Network Analysis to study
 Network of Excellence on Serious eTwinning network (135 000+ teachers)
Games  Reflections support for web communities
Lehrstuhl Informatik 5
(Information Systems)  http://www.galanoe.eu/  Development of meta-competences
Prof. Dr. M. Jarke
ICALT 2011-3  http://www.tellnet.eun.org

4. Agenda
Identification of
Learning Goals
in Forum-based
Motivation: Support of Self-Regulated Learning
Communities
Theoretical Background: Intent & Sentiment Analysis
Julian Krenge
Z. Petrushyna
Context: Community preparing for English Language Tests
Milos Kravcik
Method: Identification of Learning Phases
Ralf Klamma
Evaluation
Lehrstuhl Informatik 5
(Information Systems)
Conclusion & Outlook
Prof. Dr. M. Jarke
ICALT 2011-4

5. Motivation: Self-Regulated Learning
Identification of
Learning Goals
in Forum-based
Communities
Julian Krenge
Z. Petrushyna
Milos Kravcik
Ralf Klamma
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
ICALT 2011-5
Motivation
[Fruhmann, Nussbaumer & Albert, 2010]

6. Theoretical Background
Natural Learning Processing
Identification of
Learning Goals
in Forum-based
Communities
 Intent Analysis focuses on classification by a profile of the goals and
intentions present in textual content [Strohmaier et al. 2008]
 Sentiment Analysis aims to use automated tools to
Julian Krenge
detect subjective information such as opinions, attitudes,
and feelings expressed in text [Lin & He 2009]
Z. Petrushyna
Milos Kravcik
Ralf Klamma
Social Network Analysis
Lehrstuhl Informatik 5
(Information Systems)
 Identifies patterns of behavior based on occurrence of posts and
threads, not on the content
Prof. Dr. M. Jarke
ICALT 2011-6
Theoretical Background

7. Context
 Urch Forums (formerly TestMagic)
Identification of
Learning Goals
in Forum-based
- Community: preparation for English language tests
Communities
- 120,000+ threads, 800,000+ posts, 100,000+ users over 10 years
 Refinement
- Focus on most relevant sub-forums
Julian Krenge
Z. Petrushyna
Milos Kravcik
- 67,000+ threads, 428,000+ posts, by 21,000+ users
- Clique: a temporal complete sub-graph within global community
Ralf Klamma
 Group of users who appear in several threads together
 Requirements: 4+ users, occurs 10+ times, 75+% clique
members post in 10+ threads
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
ICALT 2011-7
Concept

8. Cliques
Identification of User of clique
Learning Goals
Non-clique User in thread
in Forum-based
Communities Thread 1 Thread 2 Clique-user missing in thread
Thread 3
Julian Krenge
Z. Petrushyna
Milos Kravcik
Ralf Klamma
Time
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
 12,881 cliques:
ICALT 2011-8
Concept
avg. size 5 users, avg. occurrence 14 times

9. Phases of Learning and Goal Model
Identification of
Learning Goals
in Forum-based
Communities
Julian Krenge
Z. Petrushyna
Milos Kravcik
Ralf Klamma
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
ICALT 2011-9
Concept
Based on [Fruhmann, Nussbaumer & Albert, 2010]

10. Evaluation of Learning Phases
Identification of
Different users
Learning Goals Phase 1 and 2 (low sentiment, questioner, lot of intents)
in Forum-based
Communities Phase 3 (increasing sentiment, conversationalist)
Phase 4 (high sentiment, answering person)
1 week / step
Julian Krenge
Z. Petrushyna
Milos Kravcik
Ralf Klamma
Lehrstuhl Informatik 5
(Information Systems)
 40% of „footprints“ of cliques align with model for phases
Prof. Dr. M. Jarke
ICALT 2011-10
Evaluation

11. Intent Analysis Expressions
Identification of Rank Firstword Keyverb Count Rank Keyverb Noun Count
Learning Goals
in Forum-based 1 Want Know 1264 1 Take Test 837
Communities
2 Need Know 1027 2 Get Score 478
3 Planning Take 885 3 Spend Time 366
4 Like Know 854 4 Solve Problem 333
5 Going Take 788 5 Take Exam 253
6 Need Find 760 6 Take GRE 250
7 How Solve 708 7 Answer Question 231
Julian Krenge 8 Need Get 554 - Buy Homes 231
Z. Petrushyna
Milos Kravcik
9 Want Get 552 9 Think People 221
Ralf Klamma 10 Wanted Know 468 10 Take TOEFL 219
 Patterns of intent expressions
 132,328 expressions of intent detected
Lehrstuhl Informatik 5
(Information Systems)
 Most obvious keyverbs: know (solve), take (test)
Prof. Dr. M. Jarke
ICALT 2011-11
Evaluation

12. User Feedback on Significance
Identification of
Learning Goals
18 users gave feedback on combinations that reflected their goals
in Forum-based
Communities  Specific verbs have high significance for goal expression
-7 -2 3 8 13
Know
Solve
Analyse
Julian Krenge
Z. Petrushyna
Work
Milos Kravcik Find
Share Yes
Ralf Klamma
Improve No
Explain
Get
Think
Support
Lehrstuhl Informatik 5
(Information Systems)
Give
Prof. Dr. M. Jarke Pass
ICALT 2011-12
Evaluation Take

13. Conclusion
 Issue: Extracting goals in learning communities
Identification of
Learning Goals
in Forum-based
 Chosen criteria help identifying learning phase
Communities
- SNA pattern
- Intent analysis
- Sentiment analysis
Julian Krenge
Z. Petrushyna
Milos Kravcik  Intent analysis patterns are significant for goals of learners as
different aspects are expressed
Ralf Klamma
 Learners follow the assumed phase model (~40%)
 Challenge: Support self-reflection & self-regulation
Lehrstuhl Informatik 5
(Information Systems)
 Holistic approach enables automatic identification
of learning goals
Prof. Dr. M. Jarke
ICALT 2011-13
Conclusion & Outlook

14. Announcements
 Workshop: Self-Regulated Learning in Responsive Open
Identification of
Learning Goals
in Forum-based
Communities
Learning Environments
- Thursday, 11:00-13:30
 Poster: How can Psychology inform the Design of Learning
Experiences
- Thursday, 15:00-18:00
Julian Krenge
Z. Petrushyna
Milos Kravcik
 ROLE Widget Enchantment Contest: Deadline – 15 July
Ralf Klamma
- Join the competition – create a widget – win a prize!
- www.role-project.eu
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
ICALT 2011-14
Conclusion & Outlook