TA webinar 5 nov 2014 Brant static - Transforming Assessment

Webinar(Series(

5(November(2014(:(07:00AM(GMT(

Designing'effec*ve'assessment'for''par*cipa*ve'learning'online'Brant(Knutzen,(University(of(Hong(Kong('Your'hosts'Professor(Geoff(Crisp,((Dean(Learning(and(Teaching,(RMIT(University(geoffrey.crisp[at]rmit.edu.au(Dr(Mathew(Hillier,((InsUtute(for(Teaching(and(Learning(InnovaUon,((University(of(Queensland(mathew.hillier[at]uq.edu.au(

Just'to'let'you'know:''By(parUcipaUng(in(the(webinar(you(acknowledge(and(agree(that:(The(session(may(be(recorded,(including(voice(and(text(chat(communicaUons((a(recording(indicator(is(shown(inside(the(webinar(room(when(this(is(the(case).(We(may(release(recordings(freely(to(the(public(which(become(part(of(the(public(record.(We(may(use(session(recordings(for(quality(improvement,(or(as(part(of(further(research(and(publicaUons.(

Building(on(a(FoundaUon(of(ParUcipaUon(

or(

(MoUvaUng(AcUve(Student(Engagement(

in(Blended(FormaUve(Learning(

Brant'Knutzen((

Adjunct(Lecturer(Faculty(of(Educa3on(

University(of((Hong(Kong(

IntroducUon(•  My(passion(is(online(discussions(

– Moderator(of(BBS(online(Debate(forum(in(1983(

•  I(have(been(using(Moodle(LMS(to(support(blended(teaching(/(learning(since(2005(–  The(“heart”(of(Moodle((Tomaz(Lasic)(–  Learning(acUvity(with(the(most(potenUal(for(social(construcUon(of(knowledge(

–  Also(the(most(likely(to(fail!((Why?(– What(works,(and(why(–  CreaUng(new(tools(

•  Enable(use(of(discussions(as(formaUve(learning(acUviUes(•  EvaluaUng(their(success((learning(analyUcs)(

Slide(Design:((Brant(Knutzen(

What(is(Blended(Learning?(

•  Blended(Teaching(/(Learning(– adding(online(acUviUes(to(expand(the(learning(environment(

•  Beyond(the(limited(faceftofface(classroom(Ume(•  IncorporaUng(the(use(of(external(resources(•  CreaUng(and(supporUng(learning(opportuniUes(which(suit(the(student’s(schedules((asynchronous(interacUon)(

•  Technology(supports(new(ways(to(collaborate(in(groups(•  Excellent(transparency(into(the(student(learning(process(


Social(ConstrucUvism(

•  John(Biggs(captured(the(educaUonal(value(of(discussion(when(he(stated:((

("Good'dialogue'elicits'those'ac*vi*es'that'shape,'

elaborate,'and'deepen'understanding“(((Biggs(1999(p.(5)(

Benefits(of(AcUve(Student(Engagement(


MoUvaUon(

MoUvaUon(:(how(do(we(encourage(student(engagement(with(online(acUviUes?(

–  Intrinsic(and(extrinsic(methods(–  EffecUve(use(of(technology((Goals:(

•  Engage(the(students(in(formaUve(learning(•  Social(construcUon(of(knowledge(•  Enable(teacher(to(focus(on(quality(•  Sustainable(teaching(pracUce(


MoUvaUon(on(three(levels(

1.   Construc*ve'Alignment'–(between(formaUve(and(summaUve(acUviUes((

2.   Situa*ve(–(groupings(and(task(design(create(social(pressure((

3.   Leverage'the'LMS'–(the(Learning(Management(System((Moodle)(provides(structures(and(automaUon(to(drive(collaboraUve(learning(


ConstrucUve(Alignment(


Intended(Learning(Outcomes(

Teaching(/(Learning(AcUviUes(

SummaUve(Assessment(

Biggs,(J.,(&(Tang,(C.((2007).(Teaching(for(quality(learning(at(university.((






FormaUve(Learning(AcUviUes(
















e.g.(:(Intended'Learning'Outcome(f(at(the(end(of(this(course,(students(will(be(able(to:((•  Cri*cally'evaluate(and'reflect'upon(theories,(

pracUce,(content(and(concepts(learned(in(this(course.(

Cri*cally'evaluate,(Reflect(

ILO'



CriUcally(evaluate,(Reflect(





e.g.(:(Learning(Poroolio(•  CumulaUve(reflecUon(blog(•  MetafcogniUve(thinking(•  ��(

Cumula*ve'Reflec*on'

Blog'

Assessment'ILO'



CriUcally(evaluate,(Reflect(


CumulaUve(ReflecUon(

Blog(



e.(g.(:(Weekly(Discussion(Forums(•  Oral(discussions(in(classroom(to(start(•  IniUal(perspecUve(is(first(forum(post(•  Q(&(A(for(one(week((average(≈(5(posts)(•  Final(post(is(reflecUon(on(learning(•  ReflecUve(posts(copied(into(Word(blog(

Weekly'Forum'

Discussion'

Assessment'ILO' TLA'

SituaUve(MoUvaUon(

•  Sociofcultural(factors((

•  Peer(pressure(to(perform((

•  Key(factors(to(achieve(this(moUvaUon:(– Group(formaUon(– Task(design(


SituaUve(MoUvaUon(

IniUal(state(on(first(class(session:(– Students(are(all(individuals,(no(group(idenUty(– Teacher(as(authority(and(arbiter(– TradiUonal(transmissionfstyle(teaching(

•  Mass(assignments(for(all(students(to(work(on(individually(

•  No(facilitaUon(of(collaboraUon(•  Very(limited(social(construcUon(of(knowledge(


SituaUve(–(no(Grouping(


Teacher(

S(

S(

S(

S(

S(S( S( S(

S(

S(S( S( S(

S(

S(

S(

S(

S(

Very(limited(collaboraUon(

Example(forum(–(no(groups(or(task(design(

Example(forum(–(no(groups(or(task(design(

•  No(groups(or(task(design(•  Each(student(assigned(a(unique(color,(or(can(use(the(Moodle(profile(picture(and(name(

•  Time(dimension(is(not(scaled(on(Y(axis(

SituaUve(–(Grouping(

•  Group(formaUon(by(common(interest((

•  Small(groups(around(size(5(–  Sets(up(proximal(access(–  Reduces(social(barriers(to(interacUon(–  Reduces(the(“noise”(level((

•  The(ParUcipaUon(Forum(allows(the(students(to(set(up(their(own(“semifprivate”(areas(for(discussion(


SituaUve(–(Task(Design(

•  Task(design(creates(a(structured(requirement(for(interacUon(– ParUcipaUon(Forum(task:(

•  Easy(first(post(gets(everyone(involved(•  QuesUons(gets(everyone(aware(and(thinking(•  Answers(require(criUcal(((or((transformaUve(thinking(•  (AddiUonal(rounds(of(Q&A(•  Final(post(is(reflecUve:(how(has(perspecUve(changed?(


SituaUve(–(aser(Grouping(/(Task(Design(


Teacher(

S(

S(

S( S(

S(

S(

S(

S( S(

S(

S(

S(

S( S(

S(

S(

S(

S( S(

S(



Teacher(

S(

S(

S( S(

S(

S(

S(

S( S(

S(

S(

S(

S( S(

S(

S(

S(

S( S(

S(



Teacher(

S(

S(

S( S(

S(

S(

S(

S( S(

S(

S(

S(

S( S(

S(

S(

S(

S( S(

S(

Example(forum(#2(with(Groups(and(Task(Design(

ParUcipaUon(Map(f(example(forum(with(Groups(and(Task(Design(

Assess(with(Rubric(

Public(Assignment(

Unsustainable(AcUvity(

Grouping,(Task(Design(

FormaUve(learning(acUvity(design(Goal:(Social'Construc*on'of'Knowledge'

Assessment(Design(

Students(Engage!(200f300(posts(

No(CollaboraUon(


OpUonal(AcUvity( Assess(with(Rubric(

Public(Assignment(


Lack(of(parUcipaUon(

No(points( Grouping,(Task(Design(


Assessment(Design(


No(CollaboraUon(

AcUvity(does(not(achieve(ILO(


OpUonal(AcUvity( Leverage'the'LMS' Assess(with(Rubric(

Public(Assignment(


Lack(of(parUcipaUon(

Near(100%(ParUcipaUon!(

Knowledge'Construc*on!'

Disaffected(Students(

Topic(QuesUons(Design,(AcUvity(Management(

No(points( Grouping,(Task(Design(Programmed(

Point(DistribuUon(


Assessment(Design(


No(CollaboraUon(Par*cipa*on'Forum'

AcUvity(does(not(achieve(ILO(

Students'Engage!'Collabora*on!'

Intended'Learning'Outcome'Achieved!'


Leveraging(the(power(of(the(LMS(

•  The(ParUcipaUon(Forum(automaUcally(awards(points(based(on(parUcipaUon,(produces(a(grade((–  Grades(produced(by(parUcipaUon:(

•  One(post(=(6(•  Two(posts(=(8(•  Three(posts(=(8.6((•  Four((posts(=(9(•  Five(posts(=(9.2(•  Six(posts(=(9.33(•  Seven(posts(=(9.42(•  Eight(posts(=(9.5((((((((etc(

(

•  More(Q&A(parUcipaUon(=(higher(grade(•  Carl(Rogers:(“uncondiUonal(posiUve(regard”((•  Grabinger(&(Dunlap:(REAL(–(“riskffree(environment”(

(

More(parUcipaUon(f>(higher(grade(

0(1(2(3(4(5(6(7(8(9(

10(

0( 1( 2( 3( 4( 5( 6( 7( 8( 9( 10( 11( 12( 13( 14( 15( 16( 17( 18( 19( 20( 21(

Forum&Grade&

Number'of'discussion'posts'

Number'of'posts'W>'Forum'Grade'

A(foundaUon(of(parUcipaUon(

•  This(assessment(method(for(assessing(a(forum(creates(a(foundaUon(of(parUcipaUon:(in(my(experience(over(90%(of(students(will(cogniUvely(engage(with(the(discussion((

•  As(always,(the(teacher’s(role(is(to(create(the(educaUonal(value(of(the(acUvity:(–  Set(up(challenging(topic(quesUons(to(guide(exploraUon(

– Maintain(a(“visible(presence”(in(the(forum(acUvity(–  Successfully(moderate(the(discussion(

Discussion(moderaUon(techniques(

•  Salmon’s(5fstage(model(of(eModeraUon((

•  Teacher(guides(students(up(the(levels(toward(knowledge(development(

Source:(hyp://www.aUmod.com/efmoderaUng/5stage.shtml(

ParUcipaUonfbased(forum(grade(

•  The(Moodle(LMS(handles(the(awarding(of(quanUtaUve(marks(for(parUcipaUon(

•  Teacher(can(focus(on(quality:(– Monitor(progress(– Guide(the(discussion(– Challenge(students(– Time(for(thoughoul(qualitaUve(feedback(

•  Minimum:(30(mins(to(1(hour(each(week(per(discussion(

The(ParUcipaUon(Map(

•  New(Moodle(plugfin(automates(the(producUon(of(the(map(of(discussion(acUvity:(– QuanUtaUve(staUsUcs(– QualitaUve(graphic(display:(a(“data(portrait”(

•  Useful(for(displaying(discussion(acUvity(– Feedback(to(students(in(the(class((who(is(working?)(– Feedback(to(teacher((what(approach(is(working?)(– Anonymous(mode(for(reporUng(research(results(

Example(ParUcipaUon(Map(

Student(profile(pictures(Students(can(interact(in(mulUple(groups(

Time(scale(from

(Day(1(to

(Day(14(

Red(line(shows(raUng(cutoff(

Group(comparison(stats(

Overall(discussion(staUsUcs(

QuanUtaUve(Data(

•  QuanUtaUve(raUngs(of(overall(discussion(

Map(of(discussion(starUng(in(class(


Map(of(ProcrasUnaUon(


ParUcipaUon(Map(is(a(teacher(tool(

•  Aser(install(on(Moodle(server,(this(learning(analyUc(tool(is(only(available(to(those(with(Teacher(roles(

•  New(opUon(on(Course(AdministraUon(block(

ParUcipaUon(Map(operaUon(

•  Select(the(forum,(and(then(plot(type:(– Normal(plot(for(feedback(to(teacher(and(students(

– Anonymous(for(reporUng(results(outside(

Conclusion(

•  I(have(been(using(the(ParUcipaUon(Forum(methodology(since(2007(– Three(levels(of(moUvaUon(consistently(achieves(very(high(levels(of(student(acUvity(and(engagement(with(group(discussions((

– Enables(the(teacher(to(focus(their(Ume(/(efforts(on(providing(qualitaUve(feedback(to(support(formaUve(learning(

– “Sounds(good,(but(do(you(have(any(evidence?”(Slide(Design:((Brant(Knutzen(

Student(acUvity(achieved(–(Moodle(report(


Student(parUcipaUon(achieved(


Course(comparison(–(posts(and(views(


QuesUons(and(Discussion(

•  My(blog(about(these(open(source(and(other(research(projects:(Brant.Knutzen.se(

•  Specific(websites(for(downloading(openfsource(projects:(–  ParUcipaUonForum.org(–  ParUcipaUonMap.org(

(•  QuesUons?((

•  My(email(is:(([email protected](

•  Handsfon(workshop(at:((bit.ly/HKUWVW'

Webinar(Series(

Session recording available via

transformingassessment.com

With thanks from your hosts

Professor Geoff Crisp, Dean Learning and Teaching, RMIT University geoffrey.crisp[at]rmit.edu.au Dr Mathew Hillier, Institute Teaching and Learning Innovation, University of Queensland mathew.hillier[at]uq.edu.au

Just'to'let'you'know:''By(parUcipaUng(in(the(webinar(you(acknowledge(and(agree(that:(The(session(may(be(recorded,(including(voice(and(text(chat(communicaUons((a(recording(indicator(is(shown(inside(the(webinar(room(when(this(is(the(case).(We(may(release(recordings(freely(to(the(public(which(become(part(of(the(public(record.(We(may(use(session(recordings(for(quality(improvement,(or(as(part(of(further(research(and(publicaUons.(

TA webinar 5 nov 2014 Brant static - Transforming Assessment

Documents