Practical privacy issuesaround Learning Analytics
Learning Analytics and Knowledge 2013
Abelardo Pardo (@abelardopardo)The University of Sydney
www.slideshare.net/abelardo_pardo
danxoneilFlickr
Abelardo Pardo Practical privacy issues around Learning Analytics 2
horrigansFlickr
This talk is NOT about...
Generic analysis of privacy
Ramifications into ethics,societal issues, laws,governments
Abelardo Pardo Practical privacy issues around Learning Analytics 3
nevolutionFlickr
This talk IS
Restricted to theLA context
Review principlesto consider
Based on practicalguidelines
Abelardo Pardo Practical privacy issues around Learning Analytics 4
EleafFlickr.comGenerate more questions
Where to focus the questions?
Abelardo Pardo Practical privacy issues around Learning Analytics 5
Mark
Coggins
flickr.com
Delicate issue!
Abelardo Pardo Practical privacy issues around Learning Analytics 6
Wootpeanuts
flickr.com
Prevents reaching a practical solution
Abelardo Pardo Practical privacy issues around Learning Analytics 7
malias
flickr.com
EnvironmentGeneralview
LAScenarios
Abelardo Pardo Practical privacy issues around Learning Analytics 8
malias
flickr.com
Environment
Abelardo Pardo Practical privacy issues around Learning Analytics 9
http://blog.stephenwolfram
.com/2012/03/the-personal-analytics-of-m
y-life(lastaccessed
March
2013)
Is she pregnant?
Abelardo Pardo Practical privacy issues around Learning Analytics 10
Dailym
ail.co.uk/news/article-2102859/H
ow-Target-know
s-shoppers-pregnant–figured-teen-father-did.html(lastaccessed
March
2013)
Abelardo Pardo Practical privacy issues around Learning Analytics 11
http://hdguru.com/is-your-new
-hdtv-watching-you/7643
(lastaccessedM
arch2013)
Abelardo Pardo Practical privacy issues around Learning Analytics 12
GreatB
eyondflickr.com
Privacy as a currency
B2B Data Market
Abelardo Pardo Practical privacy issues around Learning Analytics 13
http://theweek.com
/article/index/229508(lastaccessed
March
2013)
Lowerpremium
With GPS
Without GPS
Abelardo Pardo Practical privacy issues around Learning Analytics 14
ww
w.nytim
es.com(lastaccessed
March
2013)
Abelardo Pardo Practical privacy issues around Learning Analytics 15
malias
flickr.com
EnvironmentGeneralview
Abelardo Pardo Practical privacy issues around Learning Analytics 16
https://ww
w.privacyassociation.org/resource_center/consum
er_data_privacy_in_a_networked_w
orld(lastaccessed
March
2013)
Abelardo Pardo Practical privacy issues around Learning Analytics 17
http://ww
w.csa.ca/cm
/ca/en/privacy-code(lastaccessed
March
2013)
Abelardo Pardo Practical privacy issues around Learning Analytics 18
arstechnica.com/tech-policy/2013/02/eu-data-law
-proposal-uses-language-word-for-w
ord-from-us-eu-corporations
(lastaccessedM
arch2013)
Similar legislation
Absolute confidentiality: undesiredData ownershipInformation flow
Abelardo Pardo Practical privacy issues around Learning Analytics 19
Reigh
LeBlanc
flickr.com
Uninformed consent isconsidered under specialcircumstances
Abelardo Pardo Practical privacy issues around Learning Analytics 20
http://ww
w.nature.com
/nm/journal/v13/n9/full/nm
0907-999.html
Abelardo Pardo Practical privacy issues around Learning Analytics 21
anthonylibrarianFlickr
Internet requires new approach to privacy
Before: Limitingsurveillance, restrictingaccess to information,curtailing intrusions intoprivate space.
Additionally: How is datacaptured, who owns it, howis it shared?
Abelardo Pardo Practical privacy issues around Learning Analytics 22
Sm
all_Realm
Flickr
People act in different roles and contexts
Applications should respect these contexts
Context Integrity: Framework to provideguidance to solve privacy related conflicts.
Abelardo Pardo Practical privacy issues around Learning Analytics 23
ContextTravelflickr.com
Appropriateness & Distribution
(Nissenbaum, H., 2004, Privacy as Contextual Integrity, Washington Law Review, 79(1))
Abelardo Pardo Practical privacy issues around Learning Analytics 24
Cotton|Joe
Flickr
Appropriateness
What is collected?
What is revealed?
Valid in one context,invalid in another
Abelardo Pardo Practical privacy issues around Learning Analytics 25
johnthrmFlickr
Distribution
Who sees the data?
When?
For what purpose?
Abelardo Pardo Practical privacy issues around Learning Analytics 26
malias
flickr.com
EnvironmentGeneralview
LAScenarios
Database withK-12 Student data
Abelardo Pardo Practical privacy issues around Learning Analytics 27
http://ww
w.reuters.com
/article/2013/03/03/us-education-database-idUS
BR
E92204W
20130303(lastaccessed
March
2013)
Abelardo Pardo Practical privacy issues around Learning Analytics 28
deepwarren
Flickr
Observe in and out of the classroom
Case 1: K-12 Out-of-class support
1 Collection while doing homework in tablet
2 Data used by teachers to personalizeactivities.
3 Available to all teachers in the school.
4 Performance vs demographic factorscorrelated.
5 Available to platform vendors.
6 Kept for ever.
Abelardo Pardo Practical privacy issues around Learning Analytics 29
Case 2: University course
1 Collected in LMS and mobile application.
2 Available to instructors for personalization.
3 Some data considered for assessment.
4 Available to university-wide units:counseling, recruiting, marketing.
5 Analyzed Retention vs demographic.
6 eTextbook access available to publishers.
7 Kept for ever.
Abelardo Pardo Practical privacy issues around Learning Analytics 30
Case 3: Distance education
1 Data collected in LMS.
2 Available to instructors for personalizationpurposes.
3 Analyzed performance vs demographic.
4 Some data considered for assessment.
5 Results used in scientific publication.
6 Results available to funding institutions.
7 Student right to request data removal.Abelardo Pardo Practical privacy issues around Learning Analytics 31
Ethical Principles
• LA as a moral practice
• Students as agents at the center
• Data is temporal and dynamic
• Student success is complex andmultidimensional
• Transparency
• Institutions obliged to use data
Abelardo Pardo Practical privacy issues around Learning Analytics 32
(Slade, S., Prinsloo, P. 2013, Learning Analytics: Ethical Issues and Dilemmas, American Behavioral Scientist)
Practical Principles• Transparency: Explicit description of how
data is collected, manipulated, stored andaccessed
• Students as data owners: Include right toconsult, modify or remove data
• Data access policies: clearly stated andobserved.
• Accountability and assessment:Embedded constant review and auditing ofthe policy.
Abelardo Pardo Practical privacy issues around Learning Analytics 33
Transparency• Means to achieve Legitimacy
• Apply across the board
• Easily accessible and clearly explaineddocumentation
• How is data collected
• Who has access to the data
• Which calculations are performed
• How long is the data valid and availableAbelardo Pardo Practical privacy issues around Learning Analytics 34
lrargerichFlickr
Students as data owners• Right to access, amend,
delete data
• Institutions areborrowing the data
• In conflict with deriveddata
• Affects system design
• Consider fixed life spanof collected data
Abelardo Pardo Practical privacy issues around Learning Analytics 35
Images
ofMoney
Flickr
Data Access Policies• Clarify the roles when
accessing data
• Extend to derived data
• Consider connectionwith research
• Beware of“anonymization” or“deidentification”
Abelardo Pardo Practical privacy issues around Learning Analytics 36
Chris
Cam
bpelll
On “anonymization”
• Comprehensiveanonymized dataset ofcourse participation
• Include forum posts
• All students introducedthemselves in forum thefirst week
• Student joins the courselater.
Abelardo Pardo Practical privacy issues around Learning Analytics 37
OperationP
aperStorm
Flickr
Accountability and Assessment
• Each aspect has aresponsible person,body, department.
• Process continuously“under improvement”
• Consider allstakeholders
Abelardo Pardo Practical privacy issues around Learning Analytics 38
colemam
aFlickr
Case 1: K-12 Out-of-class support
1 Collection while doing homework in tablet
2 Data used by teachers to personalizeactivities.
3 Available to all teachers in the school.
4 Performance vs demographic factorscorrelated.
5 Available to platform vendors.
6 Kept for ever.
Abelardo Pardo Practical privacy issues around Learning Analytics 39
Case 2: University course
1 Collected in LMS and mobile application.
2 Available to instructors for personalization.
3 Some data considered for assessment.
4 Available to university-wide units:counseling, recruiting, marketing.
5 Analyzed Retention vs demographic.
6 eTextbook access available to publishers.
7 Kept for ever.
Abelardo Pardo Practical privacy issues around Learning Analytics 40
Case 3: Distance education
1 Data collected in LMS.
2 Available to instructors for personalizationpurposes.
3 Analyzed performance vs demographic.
4 Some data considered for assessment.
5 Results used in scientific publication.
6 Results available to funding institutions.
7 Student right to request data removal.Abelardo Pardo Practical privacy issues around Learning Analytics 41
Abelardo Pardo Practical privacy issues around Learning Analytics 42
johnthurmFlickr
Privacy changed inInternet era
Integrity of the LearningContext
Appropriateness &Distribution
Ethical and Implementationprinciples
Practical privacy issuesaround Learning Analytics
Learning Analytics and Knowledge 2013
Abelardo Pardo (@abelardopardo)The University of Sydney
www.slideshare.net/abelardo_pardo
danxoneilFlickr