SlideShare a Scribd company logo
1 of 43
Download to read offline
danxoneil Flickr
Practical privacy issues
around Learning Analytics

Learning Analytics and Knowledge 2013



Abelardo Pardo (@abelardopardo)
The University of Sydney
www.slideshare.net/abelardo_pardo
horrigans Flickr
 This talk is NOT about...



    Generic analysis of privacy




    Ramiļ¬cations into ethics,
    societal issues, laws,
    governments



Abelardo Pardo   Practical privacy issues around Learning Analytics   2
nevolution Flickr
This talk IS

                                                                      Review principles
                                                                      to consider

 Restricted to the
 LA context




        Based on practical
        guidelines
Abelardo Pardo   Practical privacy issues around Learning Analytics                   3
Eleaf Flickr.com
                                                   Generate more questions




                                          Where to focus the questions?




Abelardo Pardo   Practical privacy issues around Learning Analytics          4
Mark Coggins ļ¬‚ickr.com
        Delicate issue!



Abelardo Pardo   Practical privacy issues around Learning Analytics   5
Wootpeanuts ļ¬‚ickr.com
            Prevents reaching a practical solution



Abelardo Pardo   Practical privacy issues around Learning Analytics   6
malias ļ¬‚ickr.com
                                                                      General
  Environment                                                         view


                                                   LA
                                                   Scenarios




Abelardo Pardo   Practical privacy issues around Learning Analytics             7
malias ļ¬‚ickr.com
  Environment




Abelardo Pardo   Practical privacy issues around Learning Analytics   8
http://blog.stephenwolfram.com/2012/03/the-personal-analytics-of-my-life (last accessed March 2013)
                                                                                                      9
                                                                                                      Practical privacy issues around Learning Analytics
                                                                                                      Abelardo Pardo
10
                                                                   Is she pregnant?




                                                                                                                                 Practical privacy issues around Learning Analytics
Dailymail.co.uk/news/article-2102859/How-Target-knows-shoppers-pregnantā€“ļ¬gured-teen-father-did.html (last accessed March 2013)




                                                                                                                                 Abelardo Pardo
http://hdguru.com/is-your-new-hdtv-watching-you/7643 (last accessed March 2013)
                                                                                  11
                                                                                  Practical privacy issues around Learning Analytics
                                                                                  Abelardo Pardo
Great Beyond ļ¬‚ickr.com
                                                           Privacy as a currency


Abelardo Pardo   Practical privacy issues around Learning Analytics                12
http://theweek.com/article/index/229508 (last accessed March 2013)
                                                                                                                                    B2B Data Market




Abelardo Pardo   Practical privacy issues around Learning Analytics                                                                                   13
www.nytimes.com (last accessed March 2013)
                                                                                                                         Lower
                                                                                                                      premium

                                                                                                                      With GPS

                                                                                                                   Without GPS




Abelardo Pardo   Practical privacy issues around Learning Analytics                                                              14
malias ļ¬‚ickr.com
                                                                      General
  Environment                                                         view




Abelardo Pardo   Practical privacy issues around Learning Analytics             15
https://www.privacyassociation.org/resource_center/consumer_data_privacy_in_a_networked_world (last accessed March 2013)
                                                                                                                           16
                                                                                                                           Practical privacy issues around Learning Analytics
                                                                                                                           Abelardo Pardo
http://www.csa.ca/cm/ca/en/privacy-code (last accessed March 2013)
Abelardo Pardo   Practical privacy issues around Learning Analytics   17
arstechnica.com/tech-policy/2013/02/eu-data-law-proposal-uses-language-word-for-word-from-us-eu-corporations (last accessed March 2013)
                                                                                                                                          18
                                                                     Similar legislation




                                                                                                                                          Practical privacy issues around Learning Analytics
                                                                                                                                          Abelardo Pardo
Reigh LeBlanc ļ¬‚ickr.com
        Absolute conļ¬dentiality: undesired
        Data ownership
        Information ļ¬‚ow


Abelardo Pardo   Practical privacy issues around Learning Analytics   19
http://www.nature.com/nm/journal/v13/n9/full/nm0907-999.html
        Uninformed consent is
        considered under special
        circumstances


Abelardo Pardo   Practical privacy issues around Learning Analytics   20
anthonylibrarian Flickr
            Internet requires new approach to privacy




Before: Limiting
surveillance, restricting
access to information,                                 Additionally: How is data
curtailing intrusions into                             captured, who owns it, how
private space.                                         is it shared?
Abelardo Pardo   Practical privacy issues around Learning Analytics             21
Small_Realm Flickr
            People act in different roles and contexts


            Applications should respect these contexts




Abelardo Pardo   Practical privacy issues around Learning Analytics   22
Context Integrity: Framework to provide
            guidance to solve privacy related conļ¬‚icts.




                                                                                                                Context Travel ļ¬‚ickr.com
                          Appropriateness & Distribution

                                     (Nissenbaum, H., 2004, Privacy as Contextual Integrity, Washington Law Review, 79(1))
Abelardo Pardo   Practical privacy issues around Learning Analytics                                                                        23
Cotton|Joe Flickr
 Appropriateness


                                                       What is collected?



                                                       What is revealed?



                                                       Valid in one context,
                                                       invalid in another


Abelardo Pardo   Practical privacy issues around Learning Analytics            24
johnthrm Flickr
 Distribution


                                                       Who sees the data?



                                                       When?



                                                       For what purpose?



Abelardo Pardo   Practical privacy issues around Learning Analytics         25
malias ļ¬‚ickr.com
                                                                      General
  Environment                                                         view


                                                   LA
                                                   Scenarios




Abelardo Pardo   Practical privacy issues around Learning Analytics             26
27
                                                         Database with
                                                      K-12 Student data




                                                                                                                   Practical privacy issues around Learning Analytics
http://www.reuters.com/article/2013/03/03/us-education-database-idUSBRE92204W20130303 (last accessed March 2013)




                                                                                                                   Abelardo Pardo
deepwarren Flickr
                                  Observe in and out of the classroom
Abelardo Pardo   Practical privacy issues around Learning Analytics     28
Case 1: K-12 Out-of-class support
          1      Collection while doing homework in tablet

          2      Data used by teachers to personalize
                 activities.

          3      Available to all teachers in the school.

          4      Performance vs demographic factors
                 correlated.

          5      Available to platform vendors.

          6      Kept for ever.
Abelardo Pardo     Practical privacy issues around Learning Analytics   29
Case 2: University course

          1      Collected in LMS and mobile application.
          2      Available to instructors for personalization.
          3      Some data considered for assessment.
          4      Available to university-wide units:
                 counseling, recruiting, marketing.
          5      Analyzed Retention vs demographic.
          6      eTextbook access available to publishers.
          7      Kept for ever.

Abelardo Pardo     Practical privacy issues around Learning Analytics   30
Case 3: Distance education
          1      Data collected in LMS.

          2      Available to instructors for personalization
                 purposes.

          3      Analyzed performance vs demographic.

          4      Some data considered for assessment.

          5      Results used in scientiļ¬c publication.

          6      Results available to funding institutions.

          7      Student right to request data removal.
Abelardo Pardo     Practical privacy issues around Learning Analytics   31
Ethical Principles
           ā€¢ LA as a moral practice

           ā€¢ Students as agents at the center

           ā€¢ Data is temporal and dynamic

           ā€¢ Student success is complex and
                 multidimensional
           ā€¢ Transparency

           ā€¢ Institutions obliged to use data


                   (Slade, S., Prinsloo, P. 2013, Learning Analytics: Ethical Issues and Dilemmas, American Behavioral Scientist)
Abelardo Pardo     Practical privacy issues around Learning Analytics                                                        32
Practical Principles
           ā€¢ Transparency: Explicit description of how
                 data is collected, manipulated, stored and
                 accessed
           ā€¢ Students as data owners: Include right to
                 consult, modify or remove data
           ā€¢ Data access policies: clearly stated and
                 observed.
           ā€¢ Accountability and assessment:
                 Embedded constant review and auditing of
                 the policy.
Abelardo Pardo     Practical privacy issues around Learning Analytics   33
lrargerich Flickr
Transparency
           ā€¢ Means to achieve Legitimacy

           ā€¢ Apply across the board

           ā€¢ Easily accessible and clearly explained
                 documentation
           ā€¢ How is data collected

           ā€¢ Who has access to the data

           ā€¢ Which calculations are performed

           ā€¢ How long is the data valid and available
Abelardo Pardo    Practical privacy issues around Learning Analytics   34
Students as data owners
                                                                         ā€¢ Right to access, amend,
                                                                          delete data




                                                Images of Money Flickr
                                                                         ā€¢ Institutions are
                                                                          borrowing the data
                                                                         ā€¢ In conļ¬‚ict with derived
                                                                          data
                                                                         ā€¢ Affects system design

                                                                         ā€¢ Consider ļ¬xed life span
                                                                          of collected data
Abelardo Pardo   Practical privacy issues around Learning Analytics                                  35
Data Access Policies
                                                                          ā€¢ Clarify the roles when




                                                        Chris Cambpelll
                                                                           accessing data
                                                                          ā€¢ Extend to derived data

                                                                          ā€¢ Consider connection
                                                                           with research
                                                                          ā€¢ Beware of
                                                                           ā€œanonymizationā€ or
                                                                           ā€œdeidentiļ¬cationā€

Abelardo Pardo   Practical privacy issues around Learning Analytics                                  36
On ā€œanonymizationā€



                                                 OperationPaperStorm Flickr
                                                                              ā€¢ Comprehensive
                                                                               anonymized dataset of
                                                                               course participation
                                                                              ā€¢ Include forum posts

                                                                              ā€¢ All students introduced
                                                                               themselves in forum the
                                                                               ļ¬rst week
                                                                              ā€¢ Student joins the course
                                                                               later.
Abelardo Pardo   Practical privacy issues around Learning Analytics                                        37
Accountability and Assessment


                                                                          ā€¢ Each aspect has a




                                                        colemama Flickr
                                                                           responsible person,
                                                                           body, department.
                                                                          ā€¢ Process continuously
                                                                           ā€œunder improvementā€
                                                                          ā€¢ Consider all
                                                                           stakeholders



Abelardo Pardo   Practical privacy issues around Learning Analytics                                38
Case 1: K-12 Out-of-class support
          1      Collection while doing homework in tablet

          2      Data used by teachers to personalize
                 activities.

          3      Available to all teachers in the school.

          4      Performance vs demographic factors
                 correlated.

          5      Available to platform vendors.

          6      Kept for ever.
Abelardo Pardo     Practical privacy issues around Learning Analytics   39
Case 2: University course

          1      Collected in LMS and mobile application.
          2      Available to instructors for personalization.
          3      Some data considered for assessment.
          4      Available to university-wide units:
                 counseling, recruiting, marketing.
          5      Analyzed Retention vs demographic.
          6      eTextbook access available to publishers.
          7      Kept for ever.

Abelardo Pardo     Practical privacy issues around Learning Analytics   40
Case 3: Distance education
          1      Data collected in LMS.

          2      Available to instructors for personalization
                 purposes.

          3      Analyzed performance vs demographic.

          4      Some data considered for assessment.

          5      Results used in scientiļ¬c publication.

          6      Results available to funding institutions.

          7      Student right to request data removal.
Abelardo Pardo     Practical privacy issues around Learning Analytics   41
johnthurm Flickr
 Privacy changed in
 Internet era


                 Integrity of the Learning
                 Context



                                           Appropriateness &
                                           Distribution


                                                        Ethical and Implementation
                                                        principles
Abelardo Pardo    Practical privacy issues around Learning Analytics             42
danxoneil Flickr
Practical privacy issues
around Learning Analytics

Learning Analytics and Knowledge 2013



Abelardo Pardo (@abelardopardo)
The University of Sydney
www.slideshare.net/abelardo_pardo

More Related Content

More from Abelardo Pardo

Using OnTask for Student Coaching in Large Student Cohorts
Using OnTask for Student Coaching in Large Student CohortsUsing OnTask for Student Coaching in Large Student Cohorts
Using OnTask for Student Coaching in Large Student CohortsAbelardo Pardo
Ā 
Using data to provide personalised feedback at scale
Using data to provide personalised feedback at scaleUsing data to provide personalised feedback at scale
Using data to provide personalised feedback at scaleAbelardo Pardo
Ā 
Facilitating feedback processes at scale through personalised support actions
Facilitating feedback processes at scale through personalised support actionsFacilitating feedback processes at scale through personalised support actions
Facilitating feedback processes at scale through personalised support actionsAbelardo Pardo
Ā 
Providing personalised student support in blended learning at scale
Providing personalised student support in blended learning at scaleProviding personalised student support in blended learning at scale
Providing personalised student support in blended learning at scaleAbelardo Pardo
Ā 
Designing Engaging Learning Experiences in Digital Environments
Designing Engaging  Learning Experiences in Digital EnvironmentsDesigning Engaging  Learning Experiences in Digital Environments
Designing Engaging Learning Experiences in Digital EnvironmentsAbelardo Pardo
Ā 
Provision of personalized feedback at scale using learning analytics
Provision of personalized feedback at scale using learning analyticsProvision of personalized feedback at scale using learning analytics
Provision of personalized feedback at scale using learning analyticsAbelardo Pardo
Ā 
Articulating the connection between Learning Design and Learning Analytics
Articulating the connection between Learning Design and Learning AnalyticsArticulating the connection between Learning Design and Learning Analytics
Articulating the connection between Learning Design and Learning AnalyticsAbelardo Pardo
Ā 
Increasing Student Engagement with Personalised Feedback
Increasing Student Engagement with Personalised FeedbackIncreasing Student Engagement with Personalised Feedback
Increasing Student Engagement with Personalised FeedbackAbelardo Pardo
Ā 
The role of data in the provision of feedback at scale
The role of data in the provision of feedback at scaleThe role of data in the provision of feedback at scale
The role of data in the provision of feedback at scaleAbelardo Pardo
Ā 
Designing Effective Flipped Learning Experiences
Designing Effective Flipped Learning ExperiencesDesigning Effective Flipped Learning Experiences
Designing Effective Flipped Learning ExperiencesAbelardo Pardo
Ā 
The role of data in the provision of feedback at scale
The role of data in  the provision of feedback at scaleThe role of data in  the provision of feedback at scale
The role of data in the provision of feedback at scaleAbelardo Pardo
Ā 
Exploring hands-on multidisciplinary STEM with Arduino Esplora
Exploring hands-on multidisciplinary STEM with Arduino EsploraExploring hands-on multidisciplinary STEM with Arduino Esplora
Exploring hands-on multidisciplinary STEM with Arduino EsploraAbelardo Pardo
Ā 
What is sustained innovation anyway?
What is sustained innovation anyway?What is sustained innovation anyway?
What is sustained innovation anyway?Abelardo Pardo
Ā 
The role of institutional data in Learning Analytics
The role of institutional data in Learning AnalyticsThe role of institutional data in Learning Analytics
The role of institutional data in Learning AnalyticsAbelardo Pardo
Ā 
Feedback at scale with a little help of my algorithms
Feedback at scale with a little help of my algorithmsFeedback at scale with a little help of my algorithms
Feedback at scale with a little help of my algorithmsAbelardo Pardo
Ā 
Generating Actionable Predictive Models of Academic Performance
Generating Actionable Predictive Models of Academic PerformanceGenerating Actionable Predictive Models of Academic Performance
Generating Actionable Predictive Models of Academic PerformanceAbelardo Pardo
Ā 
Exploring the relation between Self-regulation Online Activities, and Academi...
Exploring the relation between Self-regulation Online Activities, and Academi...Exploring the relation between Self-regulation Online Activities, and Academi...
Exploring the relation between Self-regulation Online Activities, and Academi...Abelardo Pardo
Ā 
Data2U: Scalable Real time Student Feedback in Active Learning Environments
Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsData2U: Scalable Real time Student Feedback in Active Learning Environments
Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsAbelardo Pardo
Ā 
Designing Flipped Learning Experiences
Designing Flipped Learning ExperiencesDesigning Flipped Learning Experiences
Designing Flipped Learning ExperiencesAbelardo Pardo
Ā 
Scaling the provision of feedback from formative assessment
Scaling the provision of feedback from formative assessmentScaling the provision of feedback from formative assessment
Scaling the provision of feedback from formative assessmentAbelardo Pardo
Ā 

More from Abelardo Pardo (20)

Using OnTask for Student Coaching in Large Student Cohorts
Using OnTask for Student Coaching in Large Student CohortsUsing OnTask for Student Coaching in Large Student Cohorts
Using OnTask for Student Coaching in Large Student Cohorts
Ā 
Using data to provide personalised feedback at scale
Using data to provide personalised feedback at scaleUsing data to provide personalised feedback at scale
Using data to provide personalised feedback at scale
Ā 
Facilitating feedback processes at scale through personalised support actions
Facilitating feedback processes at scale through personalised support actionsFacilitating feedback processes at scale through personalised support actions
Facilitating feedback processes at scale through personalised support actions
Ā 
Providing personalised student support in blended learning at scale
Providing personalised student support in blended learning at scaleProviding personalised student support in blended learning at scale
Providing personalised student support in blended learning at scale
Ā 
Designing Engaging Learning Experiences in Digital Environments
Designing Engaging  Learning Experiences in Digital EnvironmentsDesigning Engaging  Learning Experiences in Digital Environments
Designing Engaging Learning Experiences in Digital Environments
Ā 
Provision of personalized feedback at scale using learning analytics
Provision of personalized feedback at scale using learning analyticsProvision of personalized feedback at scale using learning analytics
Provision of personalized feedback at scale using learning analytics
Ā 
Articulating the connection between Learning Design and Learning Analytics
Articulating the connection between Learning Design and Learning AnalyticsArticulating the connection between Learning Design and Learning Analytics
Articulating the connection between Learning Design and Learning Analytics
Ā 
Increasing Student Engagement with Personalised Feedback
Increasing Student Engagement with Personalised FeedbackIncreasing Student Engagement with Personalised Feedback
Increasing Student Engagement with Personalised Feedback
Ā 
The role of data in the provision of feedback at scale
The role of data in the provision of feedback at scaleThe role of data in the provision of feedback at scale
The role of data in the provision of feedback at scale
Ā 
Designing Effective Flipped Learning Experiences
Designing Effective Flipped Learning ExperiencesDesigning Effective Flipped Learning Experiences
Designing Effective Flipped Learning Experiences
Ā 
The role of data in the provision of feedback at scale
The role of data in  the provision of feedback at scaleThe role of data in  the provision of feedback at scale
The role of data in the provision of feedback at scale
Ā 
Exploring hands-on multidisciplinary STEM with Arduino Esplora
Exploring hands-on multidisciplinary STEM with Arduino EsploraExploring hands-on multidisciplinary STEM with Arduino Esplora
Exploring hands-on multidisciplinary STEM with Arduino Esplora
Ā 
What is sustained innovation anyway?
What is sustained innovation anyway?What is sustained innovation anyway?
What is sustained innovation anyway?
Ā 
The role of institutional data in Learning Analytics
The role of institutional data in Learning AnalyticsThe role of institutional data in Learning Analytics
The role of institutional data in Learning Analytics
Ā 
Feedback at scale with a little help of my algorithms
Feedback at scale with a little help of my algorithmsFeedback at scale with a little help of my algorithms
Feedback at scale with a little help of my algorithms
Ā 
Generating Actionable Predictive Models of Academic Performance
Generating Actionable Predictive Models of Academic PerformanceGenerating Actionable Predictive Models of Academic Performance
Generating Actionable Predictive Models of Academic Performance
Ā 
Exploring the relation between Self-regulation Online Activities, and Academi...
Exploring the relation between Self-regulation Online Activities, and Academi...Exploring the relation between Self-regulation Online Activities, and Academi...
Exploring the relation between Self-regulation Online Activities, and Academi...
Ā 
Data2U: Scalable Real time Student Feedback in Active Learning Environments
Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsData2U: Scalable Real time Student Feedback in Active Learning Environments
Data2U: Scalable Real time Student Feedback in Active Learning Environments
Ā 
Designing Flipped Learning Experiences
Designing Flipped Learning ExperiencesDesigning Flipped Learning Experiences
Designing Flipped Learning Experiences
Ā 
Scaling the provision of feedback from formative assessment
Scaling the provision of feedback from formative assessmentScaling the provision of feedback from formative assessment
Scaling the provision of feedback from formative assessment
Ā 

Recently uploaded

Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxVS Mahajan Coaching Centre
Ā 
Blooming Together_ Growing a Community Garden Worksheet.docx
Blooming Together_ Growing a Community Garden Worksheet.docxBlooming Together_ Growing a Community Garden Worksheet.docx
Blooming Together_ Growing a Community Garden Worksheet.docxUnboundStockton
Ā 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17Celine George
Ā 
Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...Jisc
Ā 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Celine George
Ā 
CELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptxCELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptxJiesonDelaCerna
Ā 
call girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļø
call girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļøcall girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļø
call girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļø9953056974 Low Rate Call Girls In Saket, Delhi NCR
Ā 
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...JhezDiaz1
Ā 
Meghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentMeghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentInMediaRes1
Ā 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxNirmalaLoungPoorunde1
Ā 
Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...jaredbarbolino94
Ā 
EPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptxEPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptxRaymartEstabillo3
Ā 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementmkooblal
Ā 
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdfLike-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdfMr Bounab Samir
Ā 
Crayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon ACrayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon AUnboundStockton
Ā 
MARGINALIZATION (Different learners in Marginalized Group
MARGINALIZATION (Different learners in Marginalized GroupMARGINALIZATION (Different learners in Marginalized Group
MARGINALIZATION (Different learners in Marginalized GroupJonathanParaisoCruz
Ā 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentInMediaRes1
Ā 

Recently uploaded (20)

Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Ā 
Blooming Together_ Growing a Community Garden Worksheet.docx
Blooming Together_ Growing a Community Garden Worksheet.docxBlooming Together_ Growing a Community Garden Worksheet.docx
Blooming Together_ Growing a Community Garden Worksheet.docx
Ā 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17
Ā 
Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...
Ā 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17
Ā 
CELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptxCELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptx
Ā 
call girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļø
call girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļøcall girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļø
call girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļø
Ā 
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
Ā 
Model Call Girl in Tilak Nagar Delhi reach out to us at šŸ”9953056974šŸ”
Model Call Girl in Tilak Nagar Delhi reach out to us at šŸ”9953056974šŸ”Model Call Girl in Tilak Nagar Delhi reach out to us at šŸ”9953056974šŸ”
Model Call Girl in Tilak Nagar Delhi reach out to us at šŸ”9953056974šŸ”
Ā 
Meghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentMeghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media Component
Ā 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptx
Ā 
Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...
Ā 
EPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptxEPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptx
Ā 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
Ā 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of management
Ā 
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdfLike-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
Ā 
Model Call Girl in Bikash Puri Delhi reach out to us at šŸ”9953056974šŸ”
Model Call Girl in Bikash Puri  Delhi reach out to us at šŸ”9953056974šŸ”Model Call Girl in Bikash Puri  Delhi reach out to us at šŸ”9953056974šŸ”
Model Call Girl in Bikash Puri Delhi reach out to us at šŸ”9953056974šŸ”
Ā 
Crayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon ACrayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon A
Ā 
MARGINALIZATION (Different learners in Marginalized Group
MARGINALIZATION (Different learners in Marginalized GroupMARGINALIZATION (Different learners in Marginalized Group
MARGINALIZATION (Different learners in Marginalized Group
Ā 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media Component
Ā 

Practical privacy issues around Learning Analytics

  • 1. danxoneil Flickr Practical privacy issues around Learning Analytics Learning Analytics and Knowledge 2013 Abelardo Pardo (@abelardopardo) The University of Sydney www.slideshare.net/abelardo_pardo
  • 2. horrigans Flickr This talk is NOT about... Generic analysis of privacy Ramiļ¬cations into ethics, societal issues, laws, governments Abelardo Pardo Practical privacy issues around Learning Analytics 2
  • 3. nevolution Flickr This talk IS Review principles to consider Restricted to the LA context Based on practical guidelines Abelardo Pardo Practical privacy issues around Learning Analytics 3
  • 4. Eleaf Flickr.com Generate more questions Where to focus the questions? Abelardo Pardo Practical privacy issues around Learning Analytics 4
  • 5. Mark Coggins ļ¬‚ickr.com Delicate issue! Abelardo Pardo Practical privacy issues around Learning Analytics 5
  • 6. Wootpeanuts ļ¬‚ickr.com Prevents reaching a practical solution Abelardo Pardo Practical privacy issues around Learning Analytics 6
  • 7. malias ļ¬‚ickr.com General Environment view LA Scenarios Abelardo Pardo Practical privacy issues around Learning Analytics 7
  • 8. malias ļ¬‚ickr.com Environment Abelardo Pardo Practical privacy issues around Learning Analytics 8
  • 9. http://blog.stephenwolfram.com/2012/03/the-personal-analytics-of-my-life (last accessed March 2013) 9 Practical privacy issues around Learning Analytics Abelardo Pardo
  • 10. 10 Is she pregnant? Practical privacy issues around Learning Analytics Dailymail.co.uk/news/article-2102859/How-Target-knows-shoppers-pregnantā€“ļ¬gured-teen-father-did.html (last accessed March 2013) Abelardo Pardo
  • 11. http://hdguru.com/is-your-new-hdtv-watching-you/7643 (last accessed March 2013) 11 Practical privacy issues around Learning Analytics Abelardo Pardo
  • 12. Great Beyond ļ¬‚ickr.com Privacy as a currency Abelardo Pardo Practical privacy issues around Learning Analytics 12
  • 13. http://theweek.com/article/index/229508 (last accessed March 2013) B2B Data Market Abelardo Pardo Practical privacy issues around Learning Analytics 13
  • 14. www.nytimes.com (last accessed March 2013) Lower premium With GPS Without GPS Abelardo Pardo Practical privacy issues around Learning Analytics 14
  • 15. malias ļ¬‚ickr.com General Environment view Abelardo Pardo Practical privacy issues around Learning Analytics 15
  • 16. https://www.privacyassociation.org/resource_center/consumer_data_privacy_in_a_networked_world (last accessed March 2013) 16 Practical privacy issues around Learning Analytics Abelardo Pardo
  • 17. http://www.csa.ca/cm/ca/en/privacy-code (last accessed March 2013) Abelardo Pardo Practical privacy issues around Learning Analytics 17
  • 18. arstechnica.com/tech-policy/2013/02/eu-data-law-proposal-uses-language-word-for-word-from-us-eu-corporations (last accessed March 2013) 18 Similar legislation Practical privacy issues around Learning Analytics Abelardo Pardo
  • 19. Reigh LeBlanc ļ¬‚ickr.com Absolute conļ¬dentiality: undesired Data ownership Information ļ¬‚ow Abelardo Pardo Practical privacy issues around Learning Analytics 19
  • 20. http://www.nature.com/nm/journal/v13/n9/full/nm0907-999.html Uninformed consent is considered under special circumstances Abelardo Pardo Practical privacy issues around Learning Analytics 20
  • 21. anthonylibrarian Flickr Internet requires new approach to privacy Before: Limiting surveillance, restricting access to information, Additionally: How is data curtailing intrusions into captured, who owns it, how private space. is it shared? Abelardo Pardo Practical privacy issues around Learning Analytics 21
  • 22. Small_Realm Flickr People act in different roles and contexts Applications should respect these contexts Abelardo Pardo Practical privacy issues around Learning Analytics 22
  • 23. Context Integrity: Framework to provide guidance to solve privacy related conļ¬‚icts. Context Travel ļ¬‚ickr.com Appropriateness & Distribution (Nissenbaum, H., 2004, Privacy as Contextual Integrity, Washington Law Review, 79(1)) Abelardo Pardo Practical privacy issues around Learning Analytics 23
  • 24. Cotton|Joe Flickr Appropriateness What is collected? What is revealed? Valid in one context, invalid in another Abelardo Pardo Practical privacy issues around Learning Analytics 24
  • 25. johnthrm Flickr Distribution Who sees the data? When? For what purpose? Abelardo Pardo Practical privacy issues around Learning Analytics 25
  • 26. malias ļ¬‚ickr.com General Environment view LA Scenarios Abelardo Pardo Practical privacy issues around Learning Analytics 26
  • 27. 27 Database with K-12 Student data Practical privacy issues around Learning Analytics http://www.reuters.com/article/2013/03/03/us-education-database-idUSBRE92204W20130303 (last accessed March 2013) Abelardo Pardo
  • 28. deepwarren Flickr Observe in and out of the classroom Abelardo Pardo Practical privacy issues around Learning Analytics 28
  • 29. Case 1: K-12 Out-of-class support 1 Collection while doing homework in tablet 2 Data used by teachers to personalize activities. 3 Available to all teachers in the school. 4 Performance vs demographic factors correlated. 5 Available to platform vendors. 6 Kept for ever. Abelardo Pardo Practical privacy issues around Learning Analytics 29
  • 30. Case 2: University course 1 Collected in LMS and mobile application. 2 Available to instructors for personalization. 3 Some data considered for assessment. 4 Available to university-wide units: counseling, recruiting, marketing. 5 Analyzed Retention vs demographic. 6 eTextbook access available to publishers. 7 Kept for ever. Abelardo Pardo Practical privacy issues around Learning Analytics 30
  • 31. Case 3: Distance education 1 Data collected in LMS. 2 Available to instructors for personalization purposes. 3 Analyzed performance vs demographic. 4 Some data considered for assessment. 5 Results used in scientiļ¬c publication. 6 Results available to funding institutions. 7 Student right to request data removal. Abelardo Pardo Practical privacy issues around Learning Analytics 31
  • 32. Ethical Principles ā€¢ LA as a moral practice ā€¢ Students as agents at the center ā€¢ Data is temporal and dynamic ā€¢ Student success is complex and multidimensional ā€¢ Transparency ā€¢ Institutions obliged to use data (Slade, S., Prinsloo, P. 2013, Learning Analytics: Ethical Issues and Dilemmas, American Behavioral Scientist) Abelardo Pardo Practical privacy issues around Learning Analytics 32
  • 33. Practical Principles ā€¢ Transparency: Explicit description of how data is collected, manipulated, stored and accessed ā€¢ Students as data owners: Include right to consult, modify or remove data ā€¢ Data access policies: clearly stated and observed. ā€¢ Accountability and assessment: Embedded constant review and auditing of the policy. Abelardo Pardo Practical privacy issues around Learning Analytics 33
  • 34. lrargerich Flickr Transparency ā€¢ Means to achieve Legitimacy ā€¢ Apply across the board ā€¢ Easily accessible and clearly explained documentation ā€¢ How is data collected ā€¢ Who has access to the data ā€¢ Which calculations are performed ā€¢ How long is the data valid and available Abelardo Pardo Practical privacy issues around Learning Analytics 34
  • 35. Students as data owners ā€¢ Right to access, amend, delete data Images of Money Flickr ā€¢ Institutions are borrowing the data ā€¢ In conļ¬‚ict with derived data ā€¢ Affects system design ā€¢ Consider ļ¬xed life span of collected data Abelardo Pardo Practical privacy issues around Learning Analytics 35
  • 36. Data Access Policies ā€¢ Clarify the roles when Chris Cambpelll accessing data ā€¢ Extend to derived data ā€¢ Consider connection with research ā€¢ Beware of ā€œanonymizationā€ or ā€œdeidentiļ¬cationā€ Abelardo Pardo Practical privacy issues around Learning Analytics 36
  • 37. On ā€œanonymizationā€ OperationPaperStorm Flickr ā€¢ Comprehensive anonymized dataset of course participation ā€¢ Include forum posts ā€¢ All students introduced themselves in forum the ļ¬rst week ā€¢ Student joins the course later. Abelardo Pardo Practical privacy issues around Learning Analytics 37
  • 38. Accountability and Assessment ā€¢ Each aspect has a colemama Flickr responsible person, body, department. ā€¢ Process continuously ā€œunder improvementā€ ā€¢ Consider all stakeholders Abelardo Pardo Practical privacy issues around Learning Analytics 38
  • 39. Case 1: K-12 Out-of-class support 1 Collection while doing homework in tablet 2 Data used by teachers to personalize activities. 3 Available to all teachers in the school. 4 Performance vs demographic factors correlated. 5 Available to platform vendors. 6 Kept for ever. Abelardo Pardo Practical privacy issues around Learning Analytics 39
  • 40. Case 2: University course 1 Collected in LMS and mobile application. 2 Available to instructors for personalization. 3 Some data considered for assessment. 4 Available to university-wide units: counseling, recruiting, marketing. 5 Analyzed Retention vs demographic. 6 eTextbook access available to publishers. 7 Kept for ever. Abelardo Pardo Practical privacy issues around Learning Analytics 40
  • 41. Case 3: Distance education 1 Data collected in LMS. 2 Available to instructors for personalization purposes. 3 Analyzed performance vs demographic. 4 Some data considered for assessment. 5 Results used in scientiļ¬c publication. 6 Results available to funding institutions. 7 Student right to request data removal. Abelardo Pardo Practical privacy issues around Learning Analytics 41
  • 42. johnthurm Flickr Privacy changed in Internet era Integrity of the Learning Context Appropriateness & Distribution Ethical and Implementation principles Abelardo Pardo Practical privacy issues around Learning Analytics 42
  • 43. danxoneil Flickr Practical privacy issues around Learning Analytics Learning Analytics and Knowledge 2013 Abelardo Pardo (@abelardopardo) The University of Sydney www.slideshare.net/abelardo_pardo