Top Banner
MOOC & SLN Mung Chiang Princeton University
45

MOOC & SLN - PolyU

Feb 23, 2023

Download

Documents

Khang Minh
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: MOOC & SLN - PolyU

MOOC  &  SLN  

Mung  Chiang    

Princeton  University  

Page 2: MOOC & SLN - PolyU
Page 3: MOOC & SLN - PolyU

I.  A  Personal  Journey  of  Learning  

Page 4: MOOC & SLN - PolyU

An  Inter-­‐disciplinary  Course    

Page 5: MOOC & SLN - PolyU

Two  Just-­‐in-­‐Time  Textbooks  

Page 6: MOOC & SLN - PolyU

Going  MOOC  

•  One  of  six  Princeton  pilots  in  Sept.  2012  – Non-­‐exclusive  arrangement  with  Coursera    

•  No  credits  at  all    –  Tons  of  emails  complaining  about  that…  

•  Khan  Academy  recording  style    –  Tremendous  TA  help    

•  Kudos,  VOH,  GCH    •  100,000+  students  enrolled  so  far    –  That  many  people  who  know  eigenvector?    

Page 7: MOOC & SLN - PolyU

Flipping  at  Princeton  

•  Why  pay  tuiUon?  Class  Ume  is  for  interacUon  •  One-­‐way  lecturing  stays  on  YouTube.    

•  “I  don’t  know  what  I’m  talking  about”    –  Be[er  teacher  on  campus.  

•  “Same  3-­‐hand”    –  Be[er  student  on  campus?  

•  “Did  you  actually  watch  the  video?”    – Where  is  the  new  spine  of  synchronous  learning?  

Page 8: MOOC & SLN - PolyU

Policy  

•  What  counts  as  teaching  outside?    •  What  counts  as  publishing?    •  Who  owns  IP?    •  What  counts  as  class  Ume  credit?    •  How  about  teacher-­‐signed  cerUficate?    

•  Why  are  we  even  in  MOOC?  –  PCAST,  Trustee/President,  Alumni,  Faculty,  Staff,  Students,  PotenUal  students        

Page 9: MOOC & SLN - PolyU

II.  Many  Dimensions  of  MOOC  

Page 10: MOOC & SLN - PolyU

There’s  More  Than  1  MOOC  

•  Content  provider  vs.  Plaaorm  provider    •  Content  aggregaUon  vs.  Content  creaUon    •  Open  source  plaaorm  vs.  closed    

•  Nonprofit  vs.  For  profit    •  Degree,  credits,  cerUficate,  nothing  

Page 11: MOOC & SLN - PolyU

Many  Types  of  MOOC  

Consumer/Producer   Ins/tu/ons   Individual  Teachers   Individual  Non-­‐teachers  

InsUtuUons   Needs  accreditaUon  

Georgia  Tech/Udacity  

Difficult  to  achieve  

Individuals     Coursera   Udacity   “Fancy”  publishing  

Goals/Ages   K12   College   Graduate  &  Professional    

Lifelong  Learning  

Accelerate  degree  

*     *    

Get/switch  jobs  

*     *    

General  educaUon  

*   *     *     *    

Fun   *    

Page 12: MOOC & SLN - PolyU

1.  Broad  Access  and  Reduce  Cost  

0  

5  

10  

15  

20  

25  

30  

1973   1983   1993   2003   2013  Thou

sand

s  of  Dollars  in  

2012  

Private  Nonprofit  Four-­‐Year   Public  Four-­‐Year  

Page 13: MOOC & SLN - PolyU

2.  Roles  of  University/Faculty  

•  What’s  the  physical  campus  of  a  university  for?  – A.  Drinking  at  party    – B.  Social  club  iniUaUon    – C.  Sanity  check  before  branded  stamp    – D.  Face  to  face  learning  experience    

•  So,  how  much  can  you  charge  for  the  service?  

•  What  about  students  who  didn’t  dare  to  apply?  

Page 14: MOOC & SLN - PolyU

3.  Economics  

•  Revenue  (not  working  out  yet)  –  Eyeballs  (e.g.,  adverUsing)  –  Content  (e.g.,  freemium  package)      –  CerUficate  (e.g.,  proctored  exams)  –   Data  (e.g.,  employment  matching)    

•  Cost  –  ProducUon    – HosUng    –  Labor  by  teaching  staff:  one-­‐Ume  and  recurrent  – Opportunity  cost  

Page 15: MOOC & SLN - PolyU

4.  Policy  

•  AuthenUcaUon  – Are  you  who  you  say  you  are?    

•  Assessment  –  Self-­‐grade  –  Peer-­‐grade  – Machine-­‐grade    –  Expert-­‐grade  

•  AccreditaUon  – Who  approves?    – Who  cares?      

Page 16: MOOC & SLN - PolyU

5.  (Most  Importantly)  Pedagogy  

•  New  science  of  learning  – Distance    – Asynchronous    

–   Heterogeneous    – Massive    – Low  (average)  engagement    

Page 17: MOOC & SLN - PolyU

III.  Scale  

Page 18: MOOC & SLN - PolyU

This  Isn’t  the  First  A[empt  Year   Name   Technology   Descrip/on  

1892  Correspondence  

Learning  Postal  mail  

University  of  Chicago  created  first  college-­‐level  distance  learning  program    

1921  EducaUonal  Radio  

Licenses  Radio  

FCC  began  granUng  educaUonal  radio  licenses  to  colleges,  allowing  educaUon  delivery  through  live  radio  shows    

1963   IFTS  

TV  

FCC  created  InstrucUonal  Television  Fixed  Service  (ITFS),  allowing  broadcast  of  courses  over  TV  

1970  Coastline  Community  

College  First  college  without  physical  campus,  courses  mainly  broadcasted  on  TV  

1985  NaUonal  Technological  

University  Satellite  

Online  degree  courses  via  satellite  transmission;  students  could  call  in  and  parUcipate  in  discussions  

1993  Jones  InternaUonal  

University  

Internet  

First  accredited,  fully  online  university  

2002  MIT’s  

OpenCourseWare  Free,  open,  web-­‐based  publicaUon  of  MIT  course  materials  

2005   Blackboard   Blackboard  and  WebCT  merge  to  become  a  leading  LMS  

2007  Kahn  Academy  

iTunes  U  Non-­‐profit  educaUonal  site  offering  video  lectures  to  anyone  

2008   MOOC   Canadian  universiUes    

2011   100K  MOOC   Udacity,  edX,  Coursera…  

Page 19: MOOC & SLN - PolyU

One  Core  Challenge  

•  Is  2013  the  year  for  teaching  and  learning  to  become  a  scalable  human  acUvity?    

–  Is  technology  ready?  (Pre[y  much)  

–  Is  pedagogy  ready?  (Not  yet)  – Are  business  models  ready?  (Not  yet)  – Are  teachers  and  students  ready?  (Not  yet)  

Page 20: MOOC & SLN - PolyU

Scale  –  Efficacy  Tradeoff  

Is  this  fronUer  possible?    Is  this  possible?  

Data  from  h[p://www.katyjordan.com/MOOCproject.html  

Page 21: MOOC & SLN - PolyU

Scale  Up:  Social  Learning  

Only  30%  of  Coursera  courses  have  1000+  forum-­‐acUve  students    

Page 22: MOOC & SLN - PolyU

Scale  Down:  IndividualizaUon  

IndividualizaUon  shows  promise  over  One-­‐Size-­‐Fits-­‐All  (OSFA)  

Page 23: MOOC & SLN - PolyU

Data  about  Learning  

•  (massive  amount  of)  Data  is  – Common  bridge  across  disciplines    – EssenUal  foundaUon  to  analyUcs    – Major  (potenUal)  revenue  source  

•  Open  access  to  data  presents:    – Legal  issues  – Business  issues    – A  key  uncertainty  today    

Page 24: MOOC & SLN - PolyU

What  is  “Open”?  

•  Open  content  consumpUon    •  Open  content  creaUon?    •  Open  content  packaging?  •  Open  policy-­‐seung?  

•  Open  plaaorm?  

•  Open  data?  

Page 25: MOOC & SLN - PolyU

Science  of  Learning  Research  

•  Metrics  of  efficacy    •  Design  of  experiment    

•  Personalize  •  IncenUvize    •  Social  learning  networks    

•  Model  of  learning    •  Taxonomy/structure  of  knowledge  (MOOE)    

Page 26: MOOC & SLN - PolyU

Social  Learning  Networks  (SLN)  

Science  of  learning    

Data  Science  

InformaUon  Technology    

Page 27: MOOC & SLN - PolyU

IV.  Scaling  Up  

Page 28: MOOC & SLN - PolyU

ObservaUons  About  Forum  

•  Sharp  decline  rate  –  Impact  on  social  learning    

•  InformaUon  overload  – Possibility  of  automaUc  recommendaUon  

•  Not  the  same  as  forums  like  Stackoverflow  – Focused  around  one  course    – Both  social  and  tech.  discussions        

Page 29: MOOC & SLN - PolyU

Data  

•  Summer  2013  •  73  courses  on  Coursera    – 8  vocaUonal  courses    – 29  quanUtaUve  (non-­‐vocaUonal)  courses    – 36  other  courses  

•  115,922  students  •  171,197  threads  •  830,000  posts      

Page 30: MOOC & SLN - PolyU

Examples  

0 20 40 60 80

050

100

150

Drug Discoveries Development

Post

s

0 10 20 30 40 50 60 70

010

020

030

0

Functional Programming

Post

s

0 10 20 30 40 50 60

010

0030

0050

00

Sustainability of Food Systems

Post

s

0 10 20 30 40 50

050

100

150

audiomusicengpart1

posts

Page 31: MOOC & SLN - PolyU

Student  AcUvity  &  Thread  Length  

1 5 50 500

110

100

1000

0

Log−log Plot

number of posts

num

ber o

f use

rs

1 2 5 10 20 50 2001

1010

010

000

Log−log Plot

length of the threads

coun

t

Page 32: MOOC & SLN - PolyU

1.  Regression  Analysis  

•  QuanUtaUve:  smaller  iniUal  volume,  but  slower  decline    

•  IniUal  popularity:  light  impact  on  decline  rate    

•  Teacher  parUcipaUon:  increased  volume  but  similar  decline  rate    

•  Peer-­‐reviewed  homework:  much  increased  volume  but  slightly  increased  decline  rate  

•  More  threads  at  the  same  Ume  reduces  a[enUon  received  by  each  thread  

Page 33: MOOC & SLN - PolyU

2.  GeneraUve  Model  •  SVM-­‐based  classifier  •  Topic  extracUon    •  Ranking  and  recommendaUon  

•  Fast  converging:  10  days  of  training  suffices    

•  Accurate  keyword  extracUon  •  Twice  as  accurate  as  a-­‐idf    

Page 34: MOOC & SLN - PolyU

V.  Scaling  Down  

Page 35: MOOC & SLN - PolyU

1.  IndividualizaUon    Scale  

Page 36: MOOC & SLN - PolyU

MIIC  •  Mobile  

–  Meet  the  challenge  of  seamless  dynamic  content  modificaUon  

•  Integrated  

–  First  system  integraUng  book  +  lecture  +  assessment  +  social  learning  •  Individualized  

•  One  course  transparently  and  intelligently  turns  into  “parallel  universes”    

Page 37: MOOC & SLN - PolyU

ImplementaUon  

•  iOS/Android  mobile  app    •  Webkit-­‐based  rendering    •  PDF/ePub  to  HTML    •  Video  hosUng    •  Assessment  database    •  Social  learning  features  

•  Machine  learning  engine    

•  AdaptaUon  logic      

Page 38: MOOC & SLN - PolyU

Student  Trial  

Page 39: MOOC & SLN - PolyU

2.  CollaboraUve  Filter  

•  3196  students  and  69  quizzes,  relaUvely  sparse  •  Train  neighborhood  method  •  81%  score-­‐predicUon  accuracy  so  far  

Page 40: MOOC & SLN - PolyU

VI.  This  Experiment  We  Call  MOOC  

Page 41: MOOC & SLN - PolyU

Long  Timescale  

•  Will  be  a  long  Ume  before  we  have  sufficient  data  to  validate  the  many  hypotheses  today.  

•  Tiered  models  to  emerge:    1.  (free)  TED  talks    2.  $49.99  freshman  courses  with  on-­‐campus  tutors  

3.  online  professional  degree  

Page 42: MOOC & SLN - PolyU

Diverse  ExpectaUons  

•  Extremely  diverse  set  of  consUtuents,  with  vastly  different  expectaUons    

•  Flipping  people  is  hard  

Page 43: MOOC & SLN - PolyU

Advancing  Pedagogy  

•  Pedagogical  advances  need  to  catch  up  with  business  discussions  

•  Are  these  millions  of  people  actually  learning?  What  data  informs  us?      

Page 44: MOOC & SLN - PolyU

Much  More  To  Learn  About  Learning  

Page 45: MOOC & SLN - PolyU

Thank  You  

[email protected]