The Educational Portfolio and the F & J Award Process Nancy Searle, Ed.D. Director, Fulbright & Jaworski L.L.P. Faculty Excellence Award Program Office.

The Educational The Educational Portfolio and the F & J Portfolio and the F & J

Award ProcessAward ProcessNancy Searle, Ed.D.

Director, Fulbright & Jaworski L.L.P. Faculty Excellence Award Program

Office of Curriculum

Objectives: Objectives: By the end of this By the end of this workshop, participants will be able to:workshop, participants will be able to:

1. Articulate the Who, What, Why, How and When of educational portfolio preparation.

2. List the F&J categories and the steps involved in preparing a portfolio for F&J review.

3. Find additional information about the F&J award.

4. Determine who to contact with questions about the F&J award.

Getting to know you….getting to Getting to know you….getting to know all about you….know all about you….

It all started with Boyer…..It all started with Boyer…..

“Faculty, themselves, appear to be increasingly dissatisfied with conflicting priorities on campus.” w

ww

.ait

.net

/tec

hnos

/im

ages

Ernest L. Boyer. PhD

Scholarship ReconsideredScholarship Reconsidered

• Scholarship is not just research

• Four types of scholarship– Scholarship of discovery (“research”)– Scholarship of integration (making

connections across disciplines)– Scholarship of application (bridge the gap

between theory and practice)

Scholarship ReconsideredScholarship Reconsidered

– Scholarship of teaching (“seeks to bridge the distance between intrapersonal and interpersonal understanding, to do so in a way that is fully informed by the scholarships of discovery, integration, and application as crafted by a study of the discipline.”)

Scholarship of Teaching?Scholarship of Teaching?

• Good teaching – that which promotes student learning and other desired student outcomes

• Scholarly teaching – taking a scholarly approach to teaching– View teaching as a profession and the knowledge

base on teaching and learning as a second discipline in which to develop expertise

Scholarly Teachers:Scholarly Teachers:

• Reflect on their teaching

• Use classroom assessment techniques

• Discuss teaching issues with colleagues

• Try new things

• Read and apply the literature on teaching and learning in their discipline

• Is closely linked to reflective practice

The Scholarship of TeachingThe Scholarship of Teaching

• Systematic study of teaching and/or learning and

• The public sharing and review of such work through presentations or publications– May be local, regional, national or

international

Scholarship of Teaching and Scholarship of Teaching and Learning?Learning?

• “A systematic reflection on teaching and learning made public.”

Illinois State Univeristy, Kathleen McKinney

Charles E. GlassickCharles E. Glassick

Charles E. Glassick, PhD

How do we judge the work of faculty as scholars?

Criteria for Quality of Scholarship:Criteria for Quality of Scholarship:

1. Clear, realistic goals2. Adequate preparation3. Adequate methods4. Meaningful results5. Effective presentation of results6. Reflective critique

Glassick, CE. Acad Med. 2000 Sep;75(9):877-80.

At BCM, the Scholarship of Teaching At BCM, the Scholarship of Teaching is assessed through the Educator’s is assessed through the Educator’s Portfolio (F&J Program).Portfolio (F&J Program).

What is an educational portfolio?What is an educational portfolio?

- An organized compilation of evidence of the quality of educational contributions

Educational Contributions

CV

Educational Portfolio

Quantity

Quality & Quantity

What ?

Educational Contributions

CV

Artifacts(e.g. syllabi)

Educational Portfolio

GoalsIncentives

Evaluation Data

Evaluation Data

Personal Statement

Comprehensive

Sample, Partial

Quality Evidence

What ?

Educational Contributions

CV

Artifacts(e.g. syllabi)

Educational Portfolio

GoalsIncentives

Evaluation Data

Evaluation Data

Personal Statement

1. Goals

2. Preparation

6. Reflection3. Methods

4. Results

5. Presentation

Who should maintain an Who should maintain an educational portfolio?educational portfolio?

All Educators!All Educators!

The Fulbright & Jaworski L.L.P. The Fulbright & Jaworski L.L.P. Faculty Excellence Award is:Faculty Excellence Award is:

• A criterion-based program, established in 2001, that recognizes faculty educational scholarship in four categories:– Teaching and Evaluation; – Development of Enduring Educational

Materials; – Educational Leadership; – Educational Research.

What? Fulbright & Jaworski Faculty Excellence AwardWhat? Fulbright & Jaworski Faculty Excellence Award

F&J Mini-Portfolio – What?F&J Mini-Portfolio – What?

• Specific to one of the four categories

– Teaching and Evaluation

– Educational Leadership

– Development of Enduring Educational Materials

– Educational Research

Order of Material in Your PortfolioOrder of Material in Your Portfolio

1. Letter of Transmittal

2. Match to Standard Setting Examples

3. Structured Summary

4. Personal Statement5. Structured Abstract (only enduring materials

and research)

6. Table of Appendices

7. Supporting Documentation arranged in Appendices

1. Letter of Transmittal1. Letter of Transmittal• Your Baylor ID number• Your Complete Name and Degree(s)• Title• Department• Contact information including

– your Baylor inter-institutional mailing address

– email address

• Chairman’s name and his/her email address

2. Match to Standard Setting Examples2. Match to Standard Setting Examples

3. Structured Summary3. Structured Summary

4. Personal Statement4. Personal StatementIn narrative form, 2 pages maximum, incorporate

information from your Structured Summary including but not limited to:

• Your learner centered educational goals and your goals as an educational scholar

• Your personal preparation• Your personal reflection• Your process for improvement• Why you like teaching (or another category)• Why you are involved in teaching activities (or

another category)• Transmission of your attitudes, skills, and knowledge

in educational matters to others

5. Structured abstracts are 5. Structured abstracts are required in the required in the ResearchResearch and and Enduring Materials CategoriesEnduring Materials Categories onlyonly..

5. Structured Abstracts - Research5. Structured Abstracts - Research• Theme: list research questions under logical

groups• Research Question(s): number consecutively

under each theme. These should be the question(s) you have sought to answer while conducting a particular research effort

• Investigation: answer “why” this particular research effort was undertaken and include the dates of the effort. (Two or three sentences)

• Support: If grant supported, include both the amount of the grant and the source. If not grant supported report how it was supported (e.g. by department).

5. Structured Abstracts – Research (cont)5. Structured Abstracts – Research (cont)

• Methods: describe briefly how the particular research was conducted. (Two or three sentences)

• Results and the Impact of Findings: state briefly how the results address the research question(s) of the study and their impact

• Contributorship: list all participants and what each contributed to the effort

• Dissemination(s): number and list when and where information from the research was disseminated (i.e., presentations, posters, publications, grant reports)

5. Structured Abstract – Enduring Materials5. Structured Abstract – Enduring Materials

• Goals and/or Learning Objectives of the material (i.e., needs addressed; expected learning outcomes)

• Content area(s) covered• Learner Population(s) for which material

was developed (could include a primary and secondary population)

• Size and/or Scope (i.e., contact time, pages, number of components)

5. Structured Abstract – 5. Structured Abstract – Enduring Materials (cont)Enduring Materials (cont)

• My Role(s) (i.e., candidate’s role/level of involvement in the design, faculty preparation time, production/programming, implementation, and/or evaluation of the material)

• Methods employed in the design, production/programming, implementation, and/or evaluation of the material

5. Structured Abstract – 5. Structured Abstract – Enduring Materials (cont)Enduring Materials (cont)

• Peer Review process employed to ensure adequacy of content.

• Usage Statistics (e.g., number of users, copies sold)

• Impact on learners’ knowledge, skills and/or attitudes

• Ratings of peers, learners and/or others

6. Table of Appendices6. Table of Appendices

• Example:

7. Supporting Material – not to exceed 7. Supporting Material – not to exceed 25 pages or 13 front and back pages25 pages or 13 front and back pages

Some Examples:

• Peer Evaluations

• Letters/emails from previous students, peers, chairs, etc.

• Repeatedly asked to teach/present

• Student evaluations

8. CV8. CV

• In Baylor Format

F & J Process – When?F & J Process – When?

Submission Dates – See Timeline on F&J Web Site:

Summer – Usually late JuneFall – Usually Mid NovemberSpring – Usually late March

Portfolios must be in the Office of Graduate Medical Education M220 DeBakey Building by 5:00 PM

F & J Process – How?F & J Process – How?

Reviewers: 1 primary; 1 secondary; 10-12 general

• Compare to standard and assign points• Cutoff = 80 (with 75% agreement)• Criteria:

– Quality (Glassick et al) ....50– Quantity............40– Breadth ............10

F & J Reviewer WorksheetF & J Reviewer Worksheet

Standard: 3-4 PrototypesStandard: 3-4 Prototypes (found on the Web site)(found on the Web site)

• Based on diversity of real faculty • Validated through consensus-building

process• Establish

– general amount of accomplishment – types of accomplishments– desired structured format

• Would receive scores between 85 and 95

The Former Chair of the Promotions &Tenure The Former Chair of the Promotions &Tenure Committee in aCommittee in a Memo to Academic Council, Memo to Academic Council, 12/2/02:12/2/02:

• department-wide criterion-based program

• student and resident evaluations of faculty

• national and local CME course evaluations

• Letters from former trainees about the value of their

educational experience with faculty

• teaching awards

“The following are some ways to provide documentation of accomplishments in teaching and education as they relate to promotion…”

The Former Chair of the Promotions &Tenure The Former Chair of the Promotions &Tenure Committee in aCommittee in a Memo to Academic Council, Memo to Academic Council, 12/2/02:12/2/02:

• Faculty Appointments & Promotions Committee “will

consider all of these awards as strong evidence of an

applicant's excellence in education.”

• You may want to draw particular attention to the

Fulbright & Jaworski L.L.P. Faculty Excellence Award

““I emphasized the committee’s need for I emphasized the committee’s need for better documentation of educational better documentation of educational accomplishments…”accomplishments…”

The Baylor FAP Committee sends materials The Baylor FAP Committee sends materials to department chairs concerning faculty to department chairs concerning faculty appointments which states in the section appointments which states in the section entitled “Documentation of Educational entitled “Documentation of Educational

Excellence for Promotion”Excellence for Promotion”

• “the most desirable evidence of quality in educational effort is… recognition in two categories of the Fulbright and Jaworski LLP Faculty Excellence Award…(and these are) considered to be the primary internal benchmark of readiness to be considered for promotion.”

Portfolio – How?Portfolio – How?

• Have your teaching Peer-Reviewed

• Save all evidence of quality (letters, e-mails, learner evaluations, etc.)

• List your educational activities in an organized format (you decide)

• Review other peoples’ portfolios

• Write a personal statement

• Solicit a limited number of letters (not more than 6) of support

Review Fac-Ed websiteReview Fac-Ed website

http://www.bcm.edu/fac-ed

select: Recognition select: Recognition

select: Faculty Excellence Awardselect: Faculty Excellence Award

Total: 10-40 hours

80 % of F&J Submissions Have 80 % of F&J Submissions Have Received the AwardReceived the Award

2001 - 20092001 - 2009

• 372 Mini-portfolios have been submitted

• 298 Mini-portfolios have met or exceeded the standard as judged by the Review Panel

Awards Received 2001-2007 by Category by Year

0

10

20

30

40

50

60

2001 2002 2003 2004 2005 2006 2007

Research

Enduring Materials

Leadership

Teaching

Fulbtight & Jaworski L. L. P. Faculty Excellence

Questions?Questions?

[email protected]@bcm.edu