Learning Analytics Panel Session      Panelists: Kathy Fernandes, James Frazee,            Andrew Roderick & Deone Zell   ...
IntroductionsKathy FernandesDirector of Academic Technology, Chico State UniversityDirector of CSU System-wide LMSS Projec...
Outline1. L.A. Context: Definition & Examples2. Panelist Discussion3. Audience Q & A                                      ...
Learning Analytics: Working Definition for          Academic Technologists Analysis of the relationship between the use o...
EXAMPLES OF LEARNINGANALYTICS IN PRACTICE
Chico State Case Study: RELS 180•   Redesigned to hybrid delivery    through Academy eLearning           54 F’s•   Enrollm...
Correlation: LMS Use w/Final Grade   Scatterplot ofAssessment Activity  Hits vs. Course       Grade  Statistically Signifi...
Correlation: Student Char. w/Final Grade   Scatterplot of HS GPA vs. Course      Grade      Statistically Significant (str...
Most interesting finding (so far):       LMS                      Student       Use                   Characteristic      ...
SIGNALSPurdue Signals Project   http://www.itap.purdue.edu/studio/signals/
Wordcloud of student evaluations of Course Signals (Arnold, 2010)
Signals Course Outcomes Compare same course (w/Signals v. w/o Signals)  -6.41% DWF  +10.97% A/B                          ...
PANEL QUESTIONS
Q1: What strategic question(s) does yourcampus hope to answer with LearningAnalytics?
Q2: What are some example(s) ofLearning Analytics that you haveconducted on your campus, no matterhow small the sample siz...
Q3: What should educationaltechnologists do to make progressdeploying Learning Analytics on theircampuses?
For More Information Learning Analytics Resources Googledoc:  http://goo.gl/Fwur6 Society for Learning Analytics Researc...
AUDIENCE Q & A   By WingedWolf                  Damián Navas
Contact InformationKathy Fernandes (kfernandes@csuchico.edu)James Frazee (jfrazee@mail.sdsu.edu)Andrew Roderick (roderick@...
Upcoming SlideShare
Loading in …5
×

Learner Analytics Panel Session: Deja-Vu all over again?

391 views

Published on

Panel presentation at the DET/CHE 2012 conference on November 28, 2012 by Kathy Fernandes (Chico State), James Frazee (San Diego State), Andrew Roderick (SFSU), and Deone Zell (CSU Northridge).

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
391
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Kathy
  • John
  • Kathy
  • Learner Analytics Panel Session: Deja-Vu all over again?

    1. 1. Learning Analytics Panel Session Panelists: Kathy Fernandes, James Frazee, Andrew Roderick & Deone Zell Moderator: John Whitmer DET/CHE 2012 November 28, 2012 D/L slides @ http://goo.gl/UgBYM
    2. 2. IntroductionsKathy FernandesDirector of Academic Technology, Chico State UniversityDirector of CSU System-wide LMSS Project, CSU Office of the ChancellorJames FrazeeDirector, Instructional Technology Services, San Diego State UniversityAndrew RoderickTechnology Development Manager, San Francisco State UniversityDeone ZellSenior Director, Academic Technology, California State University, NorthridgeJohn WhitmerAssociate Director System-wide LMSS Project, CSU Office of the Chancellor Slides: http://goo.gl/UgBYM
    3. 3. Outline1. L.A. Context: Definition & Examples2. Panelist Discussion3. Audience Q & A Slides: http://goo.gl/UgBYM
    4. 4. Learning Analytics: Working Definition for Academic Technologists Analysis of the relationship between the use of academic technology and student achievement – Uses data, frequently “big data”, disaggregated – Builds on (and moves beyond) usage reporting to examine impact – Focused on making change Isn’t a yes/no dichotomy; better seen as a spectrum Slides: http://goo.gl/UgBYM
    5. 5. EXAMPLES OF LEARNINGANALYTICS IN PRACTICE
    6. 6. Chico State Case Study: RELS 180• Redesigned to hybrid delivery through Academy eLearning 54 F’s• Enrollment: 373 students (54% increase on largest section)• Highest LMS usage entire campus Fall 2010 (>250k hits)• Bimodal outcomes: • 10% increased SLO mastery • 7% & 11% increase in DWF• Why? Can’t tell with aggregated reporting data
    7. 7. Correlation: LMS Use w/Final Grade Scatterplot ofAssessment Activity Hits vs. Course Grade Statistically Significant (strong to weak) r % Variance Sign. Total Hits 0.48 23% 0.0000 Assessment activity hits 0.47 22% 0.0000 Content activity hits 0.41 17% 0.0000 Engagement activity hits 0.40 16% 0.0000 Administrative activity hits 0.35 12% 0.0000 Mean value all significant variables 18% Slides: http://goo.gl/UgBYM
    8. 8. Correlation: Student Char. w/Final Grade Scatterplot of HS GPA vs. Course Grade Statistically Significant (strong to weak) r % Variance Sign. HS GPA 0.31 9% 0.0000 URM and Pell-Eligibility Interaction -0.26 7% 0.0001 Under-Represented Minority -0.21 4% 0.0001 Enrollment Status 0.19 3% 0.0003 URM and Gender Interaction -0.15 2% 0.0033 Pell Eligible -0.15 2% 0.0045 First in Family to Attend College -0.11 1% 0.0327 Mean value all significant variables 4% Not Statistically Significant Gender 0.10 1% 0.0557 Major-College 0.06 0% 0.2522 Slides: http://goo.gl/UgBYM
    9. 9. Most interesting finding (so far): LMS Student Use Characteristic Variables > Variables 18% 4% (Mean % change (Mean % change explained by any explained by anysingle LMS variable) single S.C. variable) Slides: http://goo.gl/UgBYM
    10. 10. SIGNALSPurdue Signals Project http://www.itap.purdue.edu/studio/signals/
    11. 11. Wordcloud of student evaluations of Course Signals (Arnold, 2010)
    12. 12. Signals Course Outcomes Compare same course (w/Signals v. w/o Signals) -6.41% DWF +10.97% A/B (Arnold, 2010) Slides: http://goo.gl/UgBYM
    13. 13. PANEL QUESTIONS
    14. 14. Q1: What strategic question(s) does yourcampus hope to answer with LearningAnalytics?
    15. 15. Q2: What are some example(s) ofLearning Analytics that you haveconducted on your campus, no matterhow small the sample size? What’sworked? What hasn’t? Why?
    16. 16. Q3: What should educationaltechnologists do to make progressdeploying Learning Analytics on theircampuses?
    17. 17. For More Information Learning Analytics Resources Googledoc: http://goo.gl/Fwur6 Society for Learning Analytics Research: http://goo.gl/bH9ts Educause Learning Analytics Library: http://goo.gl/UDRMx Slides: http://goo.gl/UgBYM
    18. 18. AUDIENCE Q & A By WingedWolf Damián Navas
    19. 19. Contact InformationKathy Fernandes (kfernandes@csuchico.edu)James Frazee (jfrazee@mail.sdsu.edu)Andrew Roderick (roderick@sfsu.edu)Deone Zell (deone.zell@csun.edu)John Whitmer (jwhitmer@calstate.edu) Slides: http://goo.gl/UgBYM

    ×