Results of the 2014 NRMP Program Director Survey www.nrmp.org June 2014
Results of the 2014 NRMP Program Director Survey
www.nrmp.org
June 2014
Requests for permission to use these data as well as questions about the content of this publication or the National Resident Matching Program data and reports may be directed to
Mei Liang, Director of Research, NRMP, at [email protected].
Questions about the NRMP should be directed to Mona M. Signer, Executive Director, NRMP, at [email protected].
Suggested CitationNational Resident Matching Program, Data Release and Research Committee: Results of the
2014 NRMP Program Director Survey. National Resident Matching Program, Washington, DC. 2014.
Copyright © 2014 National Resident Matching Program.
Introduction .................................................................................................................................................................. 1 All Specialties............................................................................................................................................................... 2 Charts for Individual Specialties
Anesthesiology ....................................................................................................................................................... 8 Child Neurology ................................................................................................................................................... 14 Dermatology ......................................................................................................................................................... 20 Emergency Medicine ........................................................................................................................................... 26 Family Medicine ................................................................................................................................................... 32 Internal Medicine .................................................................................................................................................. 38 Internal Medicine/Pediatrics ................................................................................................................................. 44 Neurological Surgery ............................................................................................................................................ 50 Neurology ............................................................................................................................................................. 56 Obstetrics and Gynecology .................................................................................................................................. 62 Orthopaedic Surgery ............................................................................................................................................. 68 Otolaryngology ..................................................................................................................................................... 74 Pathology .............................................................................................................................................................. 80 Pediatrics .............................................................................................................................................................. 86 Physical Medicine and Rehabilitation .................................................................................................................. 92 Plastic Surgery ...................................................................................................................................................... 98 Psychiatry ........................................................................................................................................................... 104 Radiation Oncology ............................................................................................................................................ 110 Radiology-Diagnostic ......................................................................................................................................... 116 Surgery ............................................................................................................................................................... 122 Thoracic Surgery ................................................................................................................................................ 128 Transitional Year ................................................................................................................................................ 134 Vascular Surgery ................................................................................................................................................ 140
Table of Contents
Introduction
1NRMP Program Director Survey Results, 2014
In March 2014, the National Resident Matching Program (NRMP) conducted its biennial survey of the directors of all programs participating in the Main Residency Match®. The primary purpose of the survey was to shed light on the factors that program directors use to (1) select applicants to interview and (2) rank applicants for the Match.
The survey was fielded during the 18 days between the rank order list deadline and Match Week so that program match outcomes would not influence respondents' answers.
The survey solicited information on: the number of applications received, screened, and
reviewed, as well as the number of applicants interviewed and ranked
whether the program typically interviews and ranks specific applicant groups
use of test scores in considering which applicants to interview, and
the factors used for both interview selection and for ranking applicants.
The overall response rate for all specialties in this report was 52.7 percent. Transitional Year and 22 specialties with 10 or more responses are included in this report. Their response rates are listed in the table below. Response rates for those specialties ranged from a high of 65.4 percent for Emergency Medicine and Pediatrics to a low of 42.6 for Radiology.
Several changes were made to the 2014 questionnaire. In the past, program directors were asked to indicate factors they used in selecting applicants to interview and to rate the importance of each factor in ranking. In this survey, program directors were asked to indicate factors they used in selecting applicants to interview and rank respectively. They were asked to rate the importance on a scale of 1 to 5 only for the factors they used in their selection process. In addition, this survey asked program directors how they handled unfilled positions after the 2013 Match and SOAP. Because the number of responses for that question was small, the results are only reported in the "All Specialties" section.
Numbers of responses are presented in most of the graphs. Some graphs use data from multiple survey questions. In those cases, different N's are listed. Numbers of applicants ranked and positions in the Match are extracted from the NRMP database. Graphs are suppressed for questions with fewer than five responses.
This report presents results by specialty on selected items from the survey. The NRMP hopes that program directors, medical school officials, and applicants find these data useful as they prepare for and participate in the Main Residency Match._______________
The NRMP's data reporting and research activities are guided by its Data Release and Research Committee. NRMP data and reports can be found at: www.nrmp.org/match-data/.
Specialty Surveys Sent Number Responding Response Rate
Anesthesiology 127 71 55.9%
Child Neurology 72 41 56.9%
Dermatology 110 60 54.5%
Emergency Medicine 159 104 65.4%
Family Medicine 429 236 55.0%
Internal Medicine 379 197 52.0%
Internal Medicine/Pediatrics 80 35 43.8%
Neurological Surgery 102 55 53.9%
Neurology 129 60 46.5%
Obstetrics and Gynecology 230 123 53.5%
Orthopaedic Surgery 147 87 59.2%
Otolaryngology 100 46 46.0%
Pathology 134 84 62.7%
Pediatrics 185 121 65.4%
Physical Medicine and Rehabilitation 77 34 44.2%
Plastic Surgery 63 39 61.9%
Psychiatry 180 84 46.7%
Radiation Oncology 84 44 52.4%
Radiology‐Diagnostic 176 75 42.6%
Surgery 275 121 44.0%
Thoracic Surgery 25 12 48.0%
Transitional Year 91 47 51.6%
Vascular Surgery 44 22 50.0%
All others 101 46 45.5%
Total 3,499 1,844 52.7%
All Specialties Combined(N=1,844)
Figure 1All SpecialtiesPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=1,793)
100% 50% 0%
94%
86%
84%
80%
78%
75%
70%
70%
69%
69%
69%
65%
65%
63%
63%
61%
61%
61%
57%
57%
56%
56%
54%
48%
43%
39%
34%
28%
27%
27%
25%
25%
18%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
1 2 3 4 5
4.1
4.2
4.0
4.1
3.6
4.1
4.0
4.1
4.0
4.3
3.9
4.5
4.1
4.0
4.0
4.3
4.3
3.8
4.1
4.1
4.0
3.6
3.6
3.8
3.7
4.0
4.8
3.7
3.5
3.7
3.7
3.6
3.5
Percent Citing Factor Average Rating
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
3NRMP Program Director Survey Results, 2014
100% 50% 0%
93%93%88%
82%80%
74%71%68%67%64%62%60%58%57%57%55%55%51%50%49%45%45%45%45%44%40%40%36%36%33%
26%23%22%20%20%20%19%
17%15%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
All SpecialtiesPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=1,799)
Figure 2
1 2 3 4 5
4.84.84.74.6
4.14.14.14.0
4.34.5
4.14.14.3
4.04.1
3.64.3
4.04.14.04.24.14.2
4.03.7
4.03.73.73.94.0
3.84.0
4.73.83.8
3.53.73.9
3.7
Average RatingPercent Citing Factor
4NRMP Program Director Survey Results, 2014
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
0%
20%
40%
60%
80%
100%
Yes, pass only Yes, target score No
31%
50%
19%
Scores required?
All SpecialtiesPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure 3
Percentage of Programs That Use USMLE Step 1 Score
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
20%
40%
60%
80%
100%
Yes, pass only Yes, target score No
31%
68%
1%
Scores required?
0%
20%
40%
60%
80%
100%
Never Seldom Often
26%
63%
11%
Would your program consider applicants who fail theexam on the first attempt?
0%
20%
40%
60%
80%
100%
Never Seldom often
35%
58%
6%
Would your program consider applicants who fail theexam on the first attempt?
N=1,746N=1,601
N=1,672 N=1,417
N=508N=684N=989
USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
N=688
170
180
190
200
210
220
230
240
250
260
Scores Below Which Programs Generally Do Not Grant Interviews
170
180
190
200
210
220
230
240
250
260
Scores Above Which Programs Almost Always Grant Interviews
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol in the box represents the mean.
USMLE Step 2 CKUSMLE Step 1USMLE Step 2 CKUSMLE Step 1
5NRMP Program Director Survey Results, 2014
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
17%10%
73%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
36%41%
23%
COMLEX-USA Level 1*
N=610%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
78%
22%
USMLE Step 2 Clinical Skills (CS)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
33% 33% 34%
COMLEX-USA Level 2-CE*
N=410%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
18%
11%
71%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
50%
12%
38%
COMLEX-USA Level 2-PE*
N=1,140 N=1,102
N=1,057 N=789
* Osteopathic applicants only
Figure 4 All SpecialtiesPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
N=1,604 N=1,049
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
6NRMP Program Director Survey Results, 2014
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
99%
69% 71%
51%
35%
60%
48%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
All SpecialtiesProgram's Interview Activities Figure 5
0
100
200
300
400
500
600
700
800
900
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants ranked
7
856
119 96 77
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applications rejected Percentage of applicants receivingan in-depth review
51%
44%
Average Percentage of Applicants Rejected and Reviewed
N=1,733 N=1,799
N=1,772
31% of all programs consider all applicant groups
N=1,799 N=1,776 N=1,791 N=1,844*N=1,844*
7NRMP Program Director Survey Results, 2014
* Data from the NRMP database. All Responding programs included
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
We want to receive only theERAS application
We will initiate contact withreferences and/or the
medical school, but we donot wish to be contacted
We want to be contacted bythe applicant’s medical
school after we have initiatedcontact with the applicant
Other
59%
24%
15%
2%
Preferred Type of Communication About Applicants During SOAP
N=1,582
Anesthesiology (N=71)
NRMP Program Director Survey Results, 2014 8
Figure AN-1AnesthesiologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=67)
1 2 3 4 5
4.5
3.9
4.2
4.1
3.4
4.1
4.1
4.2
4.0
4.2
4.1
4.5
4.2
4.0
4.2
4.2
4.2
3.8
3.9
4.0
4.2
3.6
3.6
3.7
3.4
3.8
4.9
3.2
3.3
3.8
2.9
3.8
3.1
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
99%
81%
87%
82%
78%
85%
69%
75%
75%
60%
81%
70%
75%
75%
67%
48%
52%
69%
46%
51%
69%
60%
57%
52%
51%
45%
45%
27%
40%
36%
25%
13%
15%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 9
AnesthesiologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=67)
Figure AN-2
1 2 3 4 5
4.84.84.74.6
4.23.8
4.24.24.24.4
4.04.1
4.34.1
4.33.3
4.14.14.14.04.03.93.93.8
3.74.0
3.63.5
3.93.7
3.23.9
4.73.4
3.83.7
3.33.7
3.4
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
96%91%
85%81%
88%65%
69%74%72%
76%69%
75%66%
75%59%60%
68%59%
43%54%
37%49%
41%56%51%
59%41%38%
43%28%
19%21%21%7%
26%29%
16%10%
13%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 10
170
180
190
200
210
220
230
240
250
260
AnesthesiologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure AN-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
43%
57%
0%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
45%
55%
0%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
15%
85%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%
48%
28%
Scores required?
N=68
N=63
N=64N=53
N=30N=53 N=42 N=26
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 11
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
22%
53%
24%
COMLEX-USA Level 1*
N=61
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
64%
36%
USMLE Step 2 CS
AnesthesiologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure AN-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
26%33%
42%
COMLEX-USA Level 2-CE*
N=41
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
7%
73%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
13% 13%
73%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
47%
8%
45%
COMLEX-USA Level 2-PE*
N=61 N=41
N=45 N=43
N=38 N=30
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 12
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
85% 84%
52%
31%
55%51%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure AN-5AnesthesiologyProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
7
704
152 142102
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
47% 46%
Average Percentage of Applicants Rejected andReviewed
N=68N=66N=71* N=71*N=68N=68
N=67
30% of Anesthesiology programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=67
NRMP Program Director Survey Results, 2014 13
Child Neurology (N=41)
NRMP Program Director Survey Results, 2014 14
Figure CN-1Child NeurologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=40)
1 2 3 4 5
3.9
4.3
4.2
3.9
3.7
4.0
4.1
4.1
4.1
4.2
3.8
4.2
3.5
3.9
3.9
4.1
4.3
3.6
4.0
4.3
4.0
3.5
3.5
3.9
3.7
4.0
4.7
3.6
3.8
3.6
3.4
3.5
3.8
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
93%
98%
95%
80%
83%
65%
80%
57%
83%
83%
73%
63%
57%
68%
70%
78%
78%
57%
73%
57%
55%
60%
53%
45%
63%
40%
18%
60%
35%
28%
23%
28%
53%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 15
Child NeurologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=40)
Figure CN-2
1 2 3 4 5
4.74.7
4.64.5
3.94.14.04.1
4.54.3
4.24.04.14.24.1
3.94.14.1
4.04.24.3
4.14.2
3.93.7
4.14.1
3.74.14.2
3.93.8
4.63.83.8
4.23.9
4.44.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
95%93%90%
75%83%
90%75%
83%75%
68%78%
60%57%
50%48%
70%60%57%
73%57%57%
38%55%
35%45%
33%43%
65%43%
45%50%
20%20%20%
10%25%
30%18%
45%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 16
170
180
190
200
210
220
230
240
250
260
Child NeurologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure CN-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
22%
76%
3%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
32%
65%
3%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
38%
62%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
37%
50%
13%
Scores required?
N=39
N=37
N=38N=34
N=11N=16 N=11 N=8
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 17
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
38%42%
19%
COMLEX-USA Level 1*
N=37
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
89%
11%
USMLE Step 2 CS
Child NeurologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure CN-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
35%42%
23%
COMLEX-USA Level 2-CE*
N=31
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
39%
29% 32%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
25%
35%40%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
39% 39%
22%
COMLEX-USA Level 2-PE*
N=37 N=31
N=26 N=26
N=23 N=20
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 18
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
73%78%
68%
45%
68%60%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure CN-5Child NeurologyProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
2
8525 18 13
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
49%
58%
Average Percentage of Applicants Rejected andReviewed
N=39N=39N=41* N=41*N=39N=39
N=40
43% of Child Neurology programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=39
NRMP Program Director Survey Results, 2014 19
Dermatology (N=60)
NRMP Program Director Survey Results, 2014 20
Figure D-1DermatologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=59)
1 2 3 4 5
4.3
4.5
4.0
4.1
4.0
4.2
4.2
3.6
4.3
4.5
4.3
4.6
4.5
4.4
4.3
4.5
4.4
4.0
4.1
4.2
4.3
3.8
3.7
3.8
3.9
4.1
4.9
4.1
3.9
4.2
3.9
3.1
4.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
92%
93%
83%
64%
85%
59%
64%
42%
76%
73%
59%
64%
75%
64%
63%
69%
58%
64%
25%
61%
68%
54%
51%
46%
53%
24%
17%
49%
39%
22%
29%
15%
10%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 21
DermatologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=59)
Figure D-2
1 2 3 4 5
4.94.94.94.8
4.14.2
3.94.0
4.44.6
4.14.3
4.64.24.2
3.94.7
4.33.8
4.24.5
4.04.3
3.94.0
4.34.04.1
3.73.6
4.14.3
4.63.83.8
3.62.0
3.93.8
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
97%95%95%
80%59%
71%39%
51%64%
68%63%
54%49%
34%34%
46%47%
37%20%
49%34%
20%34%36%
39%34%
37%39%
22%22%
39%5%
14%7%
15%27%
3%20%
7%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 22
170
180
190
200
210
220
230
240
250
260
DermatologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure D-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
57%
43%
0%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
58%
39%
3%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
18%
82%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
29%
47%
24%
Scores required?
N=57
N=51
N=51N=38
N=19N=43 N=13 N=8
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 23
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
18% 18%
65%
COMLEX-USA Level 1*
N=46
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
74%
26%
USMLE Step 2 CS
DermatologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure D-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
13%7%
80%
COMLEX-USA Level 2-CE*
N=24
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
17%13%
71%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
8%
0%
92%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
13%7%
80%
COMLEX-USA Level 2-PE*
N=46 N=24
N=17 N=15
N=15 N=12
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 24
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
74%
35%30%
19%26% 26%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure D-5DermatologyProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
4
412
43 36 32
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
33%
58%
Average Percentage of Applicants Rejected andReviewed
N=59N=54N=60* N=60*N=59N=59
N=57
18% of Dermatology programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=59
NRMP Program Director Survey Results, 2014 25
Emergency Medicine (N=104)
NRMP Program Director Survey Results, 2014 26
Figure EM-1Emergency MedicinePercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=101)
1 2 3 4 5
3.9
4.8
3.9
4.0
3.0
4.0
3.8
3.8
4.0
4.1
3.7
4.4
4.3
4.4
3.9
4.6
4.6
3.7
3.9
3.9
3.8
3.5
3.6
3.4
3.1
3.9
4.6
3.5
3.0
3.3
4.3
3.2
3.4
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
97%
99%
91%
94%
67%
83%
88%
72%
82%
81%
83%
69%
68%
87%
80%
86%
90%
75%
50%
65%
52%
72%
63%
61%
43%
37%
29%
30%
22%
39%
78%
22%
18%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 27
Emergency MedicinePercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=101)
Figure EM-2
1 2 3 4 5
4.84.84.74.6
3.84.7
4.03.8
4.14.5
4.04.1
4.43.8
4.13.0
4.53.83.94.0
4.43.6
4.43.9
3.73.83.8
3.43.83.9
3.64.0
4.53.63.6
2.93.4
4.33.5
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
89%93%91%88%86%87%
80%75%
66%61%62%
74%63%63%62%
43%75%
60%44%
57%71%
41%71%
50%58%
31%51%
28%41%36%
23%23%23%20%
28%16%
26%63%
11%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 28
170
180
190
200
210
220
230
240
250
260
Emergency MedicinePrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure EM-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
19%
76%
5%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
52% 48%
0%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
31%
69%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
22%
54%
24%
Scores required?
N=97
N=94
N=96N=85
N=46N=62 N=41 N=34
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 29
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
24%
40% 37%
COMLEX-USA Level 1*
N=88
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
66%
34%
USMLE Step 2 CS
Emergency MedicinePercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure EM-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%29%
48%
COMLEX-USA Level 2-CE*
N=55
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
15% 13%
73%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
11% 11%
78%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
31%
10%
59%
COMLEX-USA Level 2-PE*
N=88 N=55
N=68 N=66
N=58 N=45
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 30
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
72%77%
35%
24%
47%
22%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure EM-5Emergency MedicineProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
11
830
174138 123
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
41%
56%
Average Percentage of Applicants Rejected andReviewed
N=104N=99N=104* N=104*N=103N=104
N=101
20% of Emergency Medicine programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=101
NRMP Program Director Survey Results, 2014 31
Family Medicine (N=236)
NRMP Program Director Survey Results, 2014 32
Figure FM-1Family MedicinePercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=227)
1 2 3 4 5
3.8
4.0
4.0
4.1
3.9
4.1
3.9
4.3
3.7
4.5
3.5
4.6
4.2
4.0
3.9
3.9
4.1
3.4
4.2
4.2
3.8
3.7
3.8
3.6
3.3
4.3
4.8
3.2
2.9
3.5
3.2
3.7
3.4
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
91%
83%
80%
87%
87%
78%
68%
81%
52%
87%
56%
70%
69%
70%
60%
44%
51%
31%
81%
65%
54%
63%
65%
40%
10%
56%
38%
8%
20%
25%
12%
42%
24%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 33
Family MedicinePercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=227)
Figure FM-2
1 2 3 4 5
4.84.84.84.8
3.93.84.04.0
4.54.6
4.24.1
4.33.7
4.03.8
4.43.9
4.23.84.0
4.24.0
3.73.83.84.0
3.13.7
4.13.5
4.44.9
3.93.8
3.43.8
3.73.7
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
93%94%91%
84%79%
67%82%
69%84%
69%67%
59%64%
53%62%
68%61%
50%77%
36%30%
61%41%
27%52%
45%53%
12%31%
43%8%
29%25%
34%21%
13%36%
8%17%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 34
170
180
190
200
210
220
230
240
250
260
Family MedicinePrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure FM-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
5%
60%
35%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
13%
68%
19%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
57%
42%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
50%41%
8%
Scores required?
N=219
N=205
N=213N=194
N=65N=71 N=63 N=59
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 35
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
61%
36%
4%
COMLEX-USA Level 1*
N=208
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
89%
11%
USMLE Step 2 CS
Family MedicinePercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure FM-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
56%
32%
12%
COMLEX-USA Level 2-CE*
N=126
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
13%6%
80%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
16%
7%
77%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
75%
9%16%
COMLEX-USA Level 2-PE*
N=208 N=126
N=200 N=193
N=191 N=117
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 36
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
79%
95%
63%
47%
77%
53%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure FM-5Family MedicineProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
7
1,149
106 80 64
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
68%
29%
Average Percentage of Applicants Rejected andReviewed
N=228N=215N=236* N=236*N=225N=228
N=224
36% of Family Medicine programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=223
NRMP Program Director Survey Results, 2014 37
Internal Medicine (N=197)
NRMP Program Director Survey Results, 2014 38
Figure IM-1Internal MedicinePercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=194)
1 2 3 4 5
4.1
3.8
4.3
4.2
3.3
4.0
4.1
4.1
4.0
3.7
4.0
4.4
3.8
3.6
3.8
4.1
4.2
3.9
4.3
3.7
4.0
3.4
3.5
3.8
3.5
3.7
4.9
3.5
3.2
4.0
3.1
3.7
3.5
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
92%
73%
90%
89%
66%
79%
70%
73%
65%
51%
74%
64%
64%
54%
53%
57%
59%
58%
75%
47%
55%
46%
38%
45%
28%
40%
44%
21%
24%
29%
9%
31%
21%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 39
Internal MedicinePercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=194)
Figure IM-2
1 2 3 4 5
4.74.74.6
4.44.1
3.74.24.2
4.04.6
3.93.9
4.14.14.1
3.33.8
4.14.24.14.24.14.3
4.13.5
3.93.6
3.43.9
3.63.63.7
4.84.04.1
3.53.3
3.13.4
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
92%95%
82%73%
83%65%
86%79%
55%64%
55%55%
59%71%69%
52%47%
55%71%
51%52%
54%52%51%
36%46%
29%27%
40%21%21%
36%36%
28%25%
17%13%
7%24%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 40
170
180
190
200
210
220
230
240
250
260
Internal MedicinePrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure IM-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
16%
77%
6%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
33%
65%
2%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
29%
71%
1%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
25%
65%
11%
Scores required?
N=184
N=173
N=178N=167
N=100N=112 N=81 N=72
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 41
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
28%
55%
17%
COMLEX-USA Level 1*
N=172
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
86%
14%
USMLE Step 2 CS
Internal MedicinePercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure IM-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
27%
50%
23%
COMLEX-USA Level 2-CE*
N=119
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
13% 12%
76%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
14% 12%
74%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
57%
15%
27%
COMLEX-USA Level 2-PE*
N=172 N=119
N=132 N=130
N=131 N=94
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 42
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 97%
74%82%
63%
44%
85%
76%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure IM-5Internal MedicineProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
18
2,864
309251
178
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
61%
30%
Average Percentage of Applicants Rejected andReviewed
N=190N=178N=197* N=197*N=189N=190
N=190
39% of Internal Medicine programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=187
NRMP Program Director Survey Results, 2014 43
Internal Medicine/Pediatrics (N=35)
NRMP Program Director Survey Results, 2014 44
Figure IMP-1Internal Medicine/PediatricsPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=34)
1 2 3 4 5
4.1
4.0
4.1
3.9
3.6
4.2
4.2
4.2
3.9
4.3
4.2
4.4
3.7
3.2
3.7
4.4
4.6
4.0
4.2
4.1
3.8
3.3
3.5
3.9
2.9
3.9
4.8
3.0
3.4
3.8
3.0
3.2
3.6
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
94%
65%
74%
85%
71%
74%
82%
68%
68%
59%
74%
56%
56%
38%
71%
65%
68%
71%
53%
41%
59%
47%
62%
47%
24%
29%
24%
18%
24%
68%
9%
15%
21%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 45
Internal Medicine/PediatricsPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=34)
Figure IMP-2
1 2 3 4 5
4.74.74.7
4.64.1
3.64.24.14.3
4.24.3
3.93.6
4.14.3
3.43.7
4.04.4
4.24.3
3.84.2
3.73.4
3.83.8
3.34.2
3.33.8
4.34.3
2.33.9
3.32.8
3.74.5
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
94%86%
91%86%
89%71%
83%71%
77%77%
49%80%
49%83%
54%57%
34%71%
60%60%57%
60%57%
71%51%
46%66%
31%37%
26%11%
17%11%
9%40%
31%11%
9%11%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 46
170
180
190
200
210
220
230
240
250
260
Internal Medicine/PediatricsPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure IMP-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
29%
71%
0%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
48% 52%
0%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
24%
76%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
30%
58%
12%
Scores required?
N=34
N=31
N=33N=27
N=18N=23 N=20 N=14
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 47
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%
64%
14%
COMLEX-USA Level 1*
N=32
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
88%
13%
USMLE Step 2 CS
Internal Medicine/PediatricsPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure IMP-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
32%
50%
18%
COMLEX-USA Level 2-CE*
N=19
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
5%
16%
79%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
7%
20%
73%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
57%
24%19%
COMLEX-USA Level 2-PE*
N=32 N=19
N=22 N=22
N=21 N=15
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 48
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
35%
62%
35%
21%
47%
26%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure IMP-5Internal Medicine/PediatricsProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
5
245
69 53 49
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
48%42%
Average Percentage of Applicants Rejected andReviewed
N=34N=34N=35* N=35*N=35N=34
N=34
15% of Internal Medicine/Pediatrics programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=35
NRMP Program Director Survey Results, 2014 49
Neurological Surgery (N=55)
NRMP Program Director Survey Results, 2014 50
Figure NS-1Neurological SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=54)
1 2 3 4 5
4.4
4.7
3.8
4.0
3.7
4.3
4.3
3.9
4.2
4.6
3.9
4.5
4.3
4.2
4.3
4.3
4.3
3.8
3.9
4.3
4.0
3.6
3.5
3.8
4.1
4.0
4.6
4.1
3.4
3.4
3.9
3.7
4.5
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
93%
98%
81%
65%
78%
72%
59%
61%
69%
80%
59%
74%
63%
67%
74%
61%
44%
81%
39%
61%
61%
57%
56%
65%
80%
39%
22%
59%
41%
15%
56%
20%
4%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 51
Neurological SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=54)
Figure NS-2
1 2 3 4 5
4.84.84.9
4.74.44.5
4.23.5
4.54.6
4.44.44.6
3.64.3
3.84.6
3.84.14.04.03.94.04.03.94.03.94.1
4.04.24.2
3.54.6
3.73.33.4
3.93.9
5.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
94%85%87%85%
70%89%
44%70%
78%74%74%
65%56%
33%46%
56%65%
43%26%
50%43%
28%39%
48%31%
37%33%
63%43%
46%52%
20%13%13%
6%19%
31%37%
2%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 52
170
180
190
200
210
220
230
240
250
260
Neurological SurgeryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure NS-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
42%
58%
0%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
61%
39%
0%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
19%
79%
2%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
32%
47%
21%
Scores required?
N=52
N=48
N=47N=33
N=19N=35 N=24 N=13
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 53
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
24%
12%
65%
COMLEX-USA Level 1*
N=46
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
76%
24%
USMLE Step 2 CS
Neurological SurgeryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure NS-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
17%
6%
78%
COMLEX-USA Level 2-CE*
N=28
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
21%
4%
75%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
6%0%
94%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
18%
0%
82%
COMLEX-USA Level 2-PE*
N=46 N=28
N=17 N=18
N=17 N=16
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 54
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 96%
53%
26%
40%
23%
40% 42%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure NS-5Neurological SurgeryProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
2
202
50 38 27
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
40%
57%
Average Percentage of Applicants Rejected andReviewed
N=53N=52N=55* N=55*N=53N=53
N=53
21% of Neurological Surgery programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=53
NRMP Program Director Survey Results, 2014 55
Neurology (N=60)
NRMP Program Director Survey Results, 2014 56
Figure N-1NeurologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=59)
1 2 3 4 5
4.0
4.3
4.2
4.0
3.7
4.2
4.2
4.1
4.1
4.2
4.0
4.3
4.0
4.0
3.9
4.2
4.4
3.9
4.1
4.1
4.0
3.4
3.4
3.9
3.3
4.0
4.7
3.3
3.4
3.6
3.5
3.4
3.7
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
90%
92%
85%
75%
71%
71%
63%
76%
61%
71%
75%
63%
63%
59%
56%
58%
61%
56%
64%
49%
56%
44%
53%
58%
49%
39%
34%
39%
22%
31%
22%
27%
25%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 57
NeurologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=59)
Figure N-2
1 2 3 4 5
4.94.8
4.74.5
3.94.2
3.84.14.34.4
4.04.14.2
4.14.1
3.64.1
4.04.04.04.24.14.24.1
3.54.0
3.33.3
4.04.0
3.63.8
4.73.73.9
3.44.03.94.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
97%98%
93%73%
80%81%
68%73%75%
61%56%
59%61%
68%51%
54%47%49%
53%49%47%47%46%44%41%
46%37%
44%44%
37%39%
22%22%
25%25%
20%22%20%19%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 58
170
180
190
200
210
220
230
240
250
260
NeurologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure N-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
22%
76%
2%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
24%
73%
2%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
40%
60%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
34%
50%
16%
Scores required?
N=58
N=51
N=58N=49
N=23N=28 N=20 N=16
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 59
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
27%
51%
22%
COMLEX-USA Level 1*
N=57
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
77%
23%
USMLE Step 2 CS
NeurologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure N-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%
40% 38%
COMLEX-USA Level 2-CE*
N=40
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
13%20%
68%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
7%
25%
68%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
28% 25%
47%
COMLEX-USA Level 2-PE*
N=57 N=40
N=41 N=40
N=36 N=28
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 60
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 97%
71%80%
71%
53%
81% 85%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure N-5NeurologyProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
5
443
73 59 51
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
48% 50%
Average Percentage of Applicants Rejected andReviewed
N=60N=59N=60* N=60*N=59N=60
N=59
53% of Neurology programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=59
NRMP Program Director Survey Results, 2014 61
Obstetrics and Gynecology (N=123)
NRMP Program Director Survey Results, 2014 62
Figure OG-1Obstetrics and GynecologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=117)
1 2 3 4 5
4.2
4.1
3.9
4.1
3.5
4.2
4.1
4.2
4.2
4.2
4.0
4.4
4.1
3.9
4.0
4.4
4.4
3.7
4.0
4.0
4.0
3.6
3.7
3.6
3.6
4.2
4.8
3.5
3.2
3.6
3.7
3.5
3.7
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
97%
92%
76%
84%
81%
68%
75%
72%
72%
58%
72%
64%
69%
62%
65%
67%
62%
62%
57%
50%
57%
57%
51%
38%
43%
33%
33%
22%
21%
35%
13%
21%
14%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 63
Obstetrics and GynecologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=117)
Figure OG-2
1 2 3 4 5
4.84.84.84.7
4.13.94.0
3.74.2
4.54.24.24.1
3.94.1
3.44.2
4.04.24.14.14.2
4.04.0
3.74.0
3.63.7
4.14.0
3.73.9
4.73.83.9
3.13.53.6
4.2
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
96%91%91%
86%79%
72%74%
58%67%
61%57%
60%60%
53%54%
49%53%
46%45%
48%54%
42%46%47%42%
36%34%
28%29%
35%20%
16%17%15%
25%12%
22%10%11%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 64
170
180
190
200
210
220
230
240
250
260
Obstetrics and GynecologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure OG-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
19%
75%
6%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
41%
53%
6%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
25%
75%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
27%
54%
19%
Scores required?
N=114
N=104
N=112N=97
N=46N=71 N=50 N=34
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 65
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
29%
50%
21%
COMLEX-USA Level 1*
N=109
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
79%
21%
USMLE Step 2 CS
Obstetrics and GynecologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure OG-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
25%
35%41%
COMLEX-USA Level 2-CE*
N=60
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%
5%
72%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
4%
76%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
44%
11%
44%
COMLEX-USA Level 2-PE*
N=109 N=60
N=72 N=69
N=63 N=45
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 66
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 97%
54%
75%
34%
18%
48%
30%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure OG-5Obstetrics and GynecologyProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
5
425
89 72 63
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
52%
44%
Average Percentage of Applicants Rejected andReviewed
N=122N=117N=123* N=123*N=122N=122
N=116
15% of Obstetrics and Gynecology programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=119
NRMP Program Director Survey Results, 2014 67
Orthopaedic Surgery (N=87)
NRMP Program Director Survey Results, 2014 68
Figure OS-1Orthopaedic SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=85)
1 2 3 4 5
4.4
4.2
4.0
4.0
3.3
4.5
4.2
3.8
4.3
4.1
4.2
4.5
4.4
4.6
4.1
4.5
4.4
3.9
3.6
3.9
4.2
3.6
3.6
3.9
3.7
4.0
4.8
3.8
3.8
3.4
3.7
3.9
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
95%
92%
79%
64%
82%
81%
74%
52%
87%
53%
72%
75%
67%
64%
74%
69%
58%
84%
19%
55%
66%
64%
59%
46%
69%
19%
20%
25%
40%
12%
32%
9%
0%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 69
Orthopaedic SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=85)
Figure OS-2
1 2 3 4 5
4.64.64.64.6
4.24.3
4.03.94.1
4.54.04.1
4.54.0
4.43.5
4.74.0
4.34.14.14.0
4.23.9
3.74.0
3.73.94.0
3.93.94.0
4.73.0
3.83.63.7
3.54.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
89%88%86%82%
70%73%
48%57%
46%64%
57%57%54%50%
61%46%
62%48%
11%52%48%
33%37%
55%39%38%38%
48%30%
15%23%
10%12%
2%11%
25%12%
21%1%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 70
170
180
190
200
210
220
230
240
250
260
Orthopaedic SurgeryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure OS-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
61%
37%
3%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
65%
33%
2%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
7%
93%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
52%
28%
Scores required?
N=84
N=71
N=75N=55
N=30N=65 N=27 N=15
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 71
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
7%
19%
74%
COMLEX-USA Level 1*
N=65
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
66%
34%
USMLE Step 2 CS
Orthopaedic SurgeryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure OS-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
8% 8%
84%
COMLEX-USA Level 2-CE*
N=41
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
22%
5%
73%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
4% 4%
92%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
8%4%
88%
COMLEX-USA Level 2-PE*
N=65 N=41
N=27 N=25
N=26 N=26
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 72
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 99%
51%
27%20%
14%23%
16%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure OS-5Orthopaedic SurgeryProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
5
549
72 59 51
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
46%49%
Average Percentage of Applicants Rejected andReviewed
N=84N=81N=87* N=87*N=83N=84
N=83
13% of Orthopaedic Surgery programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=83
NRMP Program Director Survey Results, 2014 73
Otolaryngology (N=46)
NRMP Program Director Survey Results, 2014 74
Figure O-1OtolaryngologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=46)
1 2 3 4 5
4.3
4.6
3.5
4.0
3.7
4.4
4.2
3.6
4.4
4.3
4.0
4.4
4.4
4.3
4.4
4.6
4.5
4.0
4.1
4.3
4.2
3.7
3.8
3.9
4.3
4.0
4.8
4.2
3.7
3.9
3.8
2.8
4.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
98%
100%
74%
59%
74%
67%
74%
61%
85%
67%
59%
65%
70%
63%
76%
76%
61%
83%
20%
54%
46%
59%
72%
48%
80%
17%
24%
35%
33%
17%
39%
13%
4%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 75
OtolaryngologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=46)
Figure O-2
1 2 3 4 5
4.94.84.84.7
3.74.3
3.73.7
4.54.24.34.3
4.73.9
4.53.6
4.34.14.04.24.2
3.44.1
3.73.8
3.64.14.24.14.34.2
4.04.8
2.53.4
3.05.0
3.93.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
96%96%96%96%
71%80%
31%38%
60%64%
53%73%
56%40%
44%42%
53%40%
4%53%51%
33%44%
49%40%
22%42%
64%20%20%
33%7%
18%7%
16%20%2%20%2%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 76
170
180
190
200
210
220
230
240
250
260
OtolaryngologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure O-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
55%
45%
0%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
67%
33%
0%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
80%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
29%
38%33%
Scores required?
N=46
N=40
N=42N=27
N=14N=32 N=15 N=8
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 77
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
16%11%
74%
COMLEX-USA Level 1*
N=39
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
62%
38%
USMLE Step 2 CS
OtolaryngologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure O-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
16%
5%
79%
COMLEX-USA Level 2-CE*
N=28
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
14%11%
75%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
6%0%
94%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
16%
5%
79%
COMLEX-USA Level 2-PE*
N=39 N=28
N=19 N=19
N=19 N=16
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 78
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 98%
70%
28% 28%24%
37%
28%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure O-5OtolaryngologyProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
3
312
46 37 35
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
31%
67%
Average Percentage of Applicants Rejected andReviewed
N=45N=45N=46* N=46*N=45N=45
N=46
24% of Otolaryngology programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=45
NRMP Program Director Survey Results, 2014 79
Pathology (N=84)
NRMP Program Director Survey Results, 2014 80
Figure PA-1PathologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=84)
1 2 3 4 5
4.3
4.5
4.0
4.0
3.8
4.0
3.8
4.1
3.5
4.6
3.8
4.4
4.1
3.9
3.9
4.1
4.1
3.6
4.0
4.4
4.0
3.5
3.5
4.1
3.7
3.9
4.8
4.2
3.8
3.3
3.6
4.3
3.5
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
94%
98%
83%
86%
83%
68%
60%
75%
57%
93%
57%
63%
57%
64%
54%
58%
68%
54%
71%
67%
58%
39%
40%
61%
60%
46%
45%
35%
42%
8%
42%
26%
36%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 81
PathologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=84)
Figure PA-2
1 2 3 4 5
4.84.74.74.7
4.34.3
4.14.0
4.54.54.5
4.04.2
3.84.0
3.84.1
3.94.0
3.83.9
4.24.04.0
3.23.9
3.34.04.0
4.34.1
3.94.8
4.52.5
3.93.93.9
3.8
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
95%93%89%89%89%85%
79%65%
82%64%
71%42%
54%52%
60%55%54%
37%61%
35%36%
46%40%
31%25%
37%21%
45%40%40%37%
31%30%27%
2%27%
21%19%
31%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 82
170
180
190
200
210
220
230
240
250
260
PathologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure PA-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
14%
79%
6%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
13%
82%
6%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
35%
63%
1%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
32%
52%
16%
Scores required?
N=82
N=77
N=77N=72
N=34N=42 N=33 N=27
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 83
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
39%
50%
11%
COMLEX-USA Level 1*
N=73
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
84%
16%
USMLE Step 2 CS
PathologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure PA-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
41%38%
21%
COMLEX-USA Level 2-CE*
N=61
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
30%
7%
64%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
32%
13%
55%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
55%
18%
27%
COMLEX-USA Level 2-PE*
N=73 N=61
N=62 N=56
N=55 N=47
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 84
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 99%93% 93% 91%
68%
94% 91%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Group
Figure PA-5PathologyProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
4
349
55 41 32
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
56%
42%
Average Percentage of Applicants Rejected andReviewed
N=82N=80N=84* N=84*N=82N=82
N=81
67% of Pathology programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=82
NRMP Program Director Survey Results, 2014 85
Pediatrics (N=121)
NRMP Program Director Survey Results, 2014 86
Figure P-1PediatricsPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=120)
1 2 3 4 5
4.0
3.8
4.1
4.1
3.4
4.0
4.1
4.0
4.0
4.0
4.0
4.4
3.8
3.9
3.9
4.0
4.1
3.9
4.2
3.7
3.8
3.6
3.7
3.7
3.4
3.9
4.8
3.6
3.4
3.7
3.5
3.4
2.7
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
98%
77%
87%
81%
70%
77%
69%
77%
63%
56%
75%
54%
60%
65%
57%
63%
66%
62%
64%
39%
63%
52%
55%
44%
23%
33%
30%
18%
24%
39%
16%
33%
16%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 87
PediatricsPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=120)
Figure P-2
1 2 3 4 5
4.74.84.74.6
4.23.8
4.14.24.1
4.53.84.04.24.14.1
3.44.03.9
4.34.14.24.24.24.2
3.63.9
3.73.4
3.73.8
3.63.7
4.93.4
3.83.53.5
3.73.4
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
98%95%93%90%90%
76%88%
82%60%
67%56%
66%62%
77%68%
60%63%
69%71%
57%52%
56%56%52%
46%47%
57%30%
36%27%
21%23%23%
31%35%
21%18%
13%11%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 88
170
180
190
200
210
220
230
240
250
260
PediatricsPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure P-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
5%
77%
18%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
27%
67%
6%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
43%
56%
1%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
38% 42%
20%
Scores required?
N=116
N=113
N=113N=108
N=45N=54 N=49 N=40
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 89
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
33%
52%
15%
COMLEX-USA Level 1*
N=111
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
82%
18%
USMLE Step 2 CS
PediatricsPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure P-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
29%
44%
27%
COMLEX-USA Level 2-CE*
N=67
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
13%6%
81%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
15%7%
79%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
60%
10%
30%
COMLEX-USA Level 2-PE*
N=111 N=67
N=100 N=97
N=91 N=61
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 90
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
72%
86%
69%
47%
72%
60%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure P-5PediatricsProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
15
1,124
221192
161
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
58%
35%
Average Percentage of Applicants Rejected andReviewed
N=118N=114N=121* N=121*N=116N=118
N=118
42% of Pediatrics programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=116
NRMP Program Director Survey Results, 2014 91
Physical Medicine and Rehabilitation (N=34)
NRMP Program Director Survey Results, 2014 92
Figure PMR-1Physical Medicine and RehabilitationPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=33)
1 2 3 4 5
4.0
4.3
4.2
4.0
3.9
3.7
3.9
4.2
3.9
4.5
3.8
4.4
3.9
4.3
4.1
4.0
4.4
3.5
4.2
4.2
4.2
3.6
3.6
3.6
3.8
3.6
4.6
2.9
3.4
3.5
3.8
3.9
3.8
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
91%
91%
88%
85%
79%
64%
76%
73%
55%
76%
67%
76%
55%
67%
48%
45%
58%
42%
73%
58%
67%
55%
67%
33%
42%
33%
39%
21%
27%
6%
39%
42%
33%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 93
Physical Medicine and RehabilitationPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=33)
Figure PMR-2
1 2 3 4 5
4.84.74.74.6
4.04.2
4.04.2
4.54.6
4.24.14.1
3.94.0
3.74.7
3.84.04.1
4.53.9
4.33.8
3.64.1
3.73.4
3.84.14.0
3.84.9
3.83.73.7
3.34.4
3.8
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
94%94%
85%79%
82%82%
76%76%
79%58%58%
48%52%52%
39%64%64%
58%70%
36%33%
45%45%
39%52%
61%36%
52%24%
30%15%
18%21%
27%9%
18%9%
33%27%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 94
170
180
190
200
210
220
230
240
250
260
Physical Medicine and RehabilitationPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure PMR-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
13%
67%
20%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
7%
83%
10%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
48% 48%
3%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
45%
32%
23%
Scores required?
N=31
N=30
N=31N=29
N=12N=11 N=7 N=8
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 95
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
48%42%
10%
COMLEX-USA Level 1*
N=30
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
70%
30%
USMLE Step 2 CS
Physical Medicine and RehabilitationPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure PMR-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
45%
32%
23%
COMLEX-USA Level 2-CE*
N=23
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
17% 17%
65%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
26%
17%
57%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
55%
10%
34%
COMLEX-USA Level 2-PE*
N=30 N=23
N=31 N=31
N=29 N=23
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 96
0%10%20%30%40%50%60%70%80%90%
100%100%
79%
97%
61%
42%
79%
45%
U.S. S
enior
U.S. G
radu
ate
Osteop
athic
Physic
ianCan
adian
Fifth P
athw
ay
U.S. I
MG
Non-U
.S. I
MG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure PMR-5Physical Medicine and RehabilitationProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
5
349
86 68 54
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
45%51%
Average Percentage of Applicants Rejected andReviewed
N=34N=34N=34* N=34*N=34N=34
N=33
27% of Physical Medicine and Rehabilitation programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=34
NRMP Program Director Survey Results, 2014 97
Plastic Surgery (N=39)
NRMP Program Director Survey Results, 2014 98
Figure PS-1Plastic SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=34)
1 2 3 4 5
4.3
4.8
3.1
4.4
3.6
4.2
3.9
3.6
4.2
4.2
3.6
4.2
4.4
4.4
4.1
4.5
4.5
4.2
4.0
3.8
4.2
3.6
3.6
3.8
4.0
3.9
4.7
4.2
3.1
3.0
3.9
3.0
4.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
94%
94%
62%
65%
85%
74%
50%
35%
76%
74%
59%
68%
76%
65%
71%
74%
56%
79%
26%
53%
44%
62%
65%
62%
82%
47%
29%
47%
21%
12%
24%
3%
15%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 99
Plastic SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=34)
Figure PS-2
1 2 3 4 5
4.84.74.84.7
4.24.5
4.03.4
4.54.5
4.34.34.5
4.24.1
3.74.7
3.84.2
4.04.6
4.34.7
4.13.7
4.34.04.0
4.34.0
4.34.44.4
3.04.0
3.4
4.33.5
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
88%91%
85%68%
56%82%
32%32%
62%56%
35%53%53%
26%44%
29%62%
24%18%
44%47%
9%26%
47%38%
21%29%
62%24%9%
44%21%
15%3%3%
15%0%
18%12%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 100
170
180
190
200
210
220
230
240
250
260
Plastic SurgeryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure PS-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
67%
33%
0%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
65%
35%
0%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
14%
86%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%
57%
20%
Scores required?
N=35
N=30
N=35N=23
N=11N=21 N=14 N=8
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 101
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
33%
0%
67%
COMLEX-USA Level 1*
N=34
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
71%
29%
USMLE Step 2 CS
Plastic SurgeryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure PS-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
33%
0%
67%
COMLEX-USA Level 2-CE*
N=28
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
21%29%
50%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
38%
0%
63%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
38%
0%
63%
COMLEX-USA Level 2-PE*
N=34 N=28
N=9 N=9
N=8 N=8
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 102
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 97%
39%
27%
45%
18%24% 24%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure PS-5Plastic SurgeryProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
2
192
35 30 25
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
29%
67%
Average Percentage of Applicants Rejected andReviewed
N=38N=36N=39* N=39*N=37N=38
N=33
18% of Plastic Surgery programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=37
NRMP Program Director Survey Results, 2014 103
Psychiatry (N=84)
NRMP Program Director Survey Results, 2014 104
Figure PSY-1PsychiatryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=83)
1 2 3 4 5
3.7
4.1
4.2
3.7
4.1
3.9
3.9
4.3
3.7
4.5
3.6
4.6
4.0
4.1
4.1
4.1
4.2
3.4
4.0
4.2
4.0
3.8
3.6
3.6
3.3
3.9
4.8
3.4
2.8
3.4
3.1
4.0
3.4
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
87%
84%
94%
84%
92%
84%
70%
89%
66%
88%
58%
71%
70%
65%
65%
67%
71%
51%
82%
60%
51%
65%
57%
58%
45%
43%
54%
30%
22%
40%
24%
51%
29%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 105
PsychiatryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=83)
Figure PSY-2
1 2 3 4 5
4.95.04.94.8
3.83.93.9
4.24.4
4.84.24.14.1
3.64.1
3.74.2
3.84.1
3.83.9
4.24.0
3.73.9
4.23.8
3.63.83.83.7
4.14.9
4.23.7
3.33.63.6
3.3
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
98%99%95%
89%73%
78%73%71%
84%77%
62%61%61%
51%66%
74%59%
48%61%
44%48%
66%52%
45%54%
40%39%35%
45%39%
32%33%34%
48%29%
17%17%
11%27%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 106
170
180
190
200
210
220
230
240
250
260
PsychiatryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure PSY-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
3%
56%
41%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
6%
64%
30%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
69%
30%
1%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
60%
24%16%
Scores required?
N=83
N=71
N=83N=70
N=14N=17 N=14 N=12
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 107
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
67%
31%
3%
COMLEX-USA Level 1*
N=80
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
80%
20%
USMLE Step 2 CS
PsychiatryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure PSY-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
58%
24%18%
COMLEX-USA Level 2-CE*
N=63
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
30%
11%
59%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
33%
14%
53%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
67%
10%
23%
COMLEX-USA Level 2-PE*
N=80 N=63
N=72 N=71
N=70 N=49
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 108
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 98%
86%89%
67%
46%
80%
63%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure PSY-5PsychiatryProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
7
858
100 79 61
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
61%
30%
Average Percentage of Applicants Rejected andReviewed
N=81N=77N=84* N=84*N=83N=81
N=83
40% of Psychiatry programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=81
NRMP Program Director Survey Results, 2014 109
Radiation Oncology (N=44)
NRMP Program Director Survey Results, 2014 110
Figure RO-1Radiation OncologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=43)
1 2 3 4 5
4.3
4.5
4.0
4.1
3.8
4.2
3.9
3.8
4.2
4.5
4.0
4.6
4.3
4.3
4.3
4.3
4.3
3.8
4.3
4.1
4.3
3.7
3.9
4.0
4.4
3.6
4.7
4.0
3.9
3.7
3.8
3.4
4.5
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
95%
100%
86%
51%
84%
65%
77%
47%
72%
67%
65%
63%
56%
72%
60%
60%
56%
60%
21%
70%
60%
58%
53%
63%
86%
21%
23%
53%
28%
14%
44%
12%
9%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 111
Radiation OncologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=43)
Figure RO-2
1 2 3 4 5
4.94.94.8
4.63.8
4.44.24.2
4.44.6
4.44.24.4
4.04.04.0
4.43.7
4.03.8
4.33.4
4.04.0
3.64.2
3.74.4
3.84.5
4.24.0
5.03.3
3.54.3
4.04.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
84%86%
70%70%
57%77%
23%45%
57%39%
61%39%
45%39%
27%45%
39%41%
2%41%
23%11%
25%18%
32%23%20%
61%30%25%
41%2%5%7%
0%14%
7%30%
2%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 112
170
180
190
200
210
220
230
240
250
260
Radiation OncologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure RO-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
44%
54%
3%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
43%
54%
4%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
27%
73%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%
40% 37%
Scores required?
N=41
N=39
N=35N=28
N=10N=24 N=11 N=6
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 113
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
10%
70%
COMLEX-USA Level 1*
N=36
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
61%
39%
USMLE Step 2 CS
Radiation OncologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure RO-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
10%
70%
COMLEX-USA Level 2-CE*
N=23
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
22%
4%
74%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
22%
0%
78%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
10%
70%
COMLEX-USA Level 2-PE*
N=36 N=23
N=20 N=20
N=20 N=18
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 114
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
55%
45%
19%12%
19%14%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure RO-5Radiation OncologyProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
2
169
32 25 22
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
26%
73%
Average Percentage of Applicants Rejected andReviewed
N=43N=42N=44* N=44*N=44N=43
N=42
12% of Radiation Oncology programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=44
NRMP Program Director Survey Results, 2014 115
Radiology-Diagnostic (N=75)
NRMP Program Director Survey Results, 2014 116
Figure RD-1Radiology-DiagnosticPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=74)
1 2 3 4 5
4.2
3.9
4.5
3.9
3.3
4.2
4.5
4.1
4.1
3.9
4.3
4.2
4.1
3.9
3.7
4.2
4.2
3.9
4.4
4.0
4.1
3.6
3.3
3.9
3.5
4.1
4.6
3.3
3.8
3.9
3.2
3.0
3.5
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
99%
77%
91%
66%
74%
82%
76%
72%
81%
62%
85%
64%
64%
59%
58%
47%
50%
77%
31%
65%
64%
61%
50%
57%
47%
42%
42%
27%
41%
22%
15%
14%
18%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 117
Radiology-DiagnosticPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=74)
Figure RD-2
1 2 3 4 5
4.74.74.7
4.64.1
3.93.8
4.34.14.4
4.24.14.24.44.3
3.34.34.3
3.94.24.34.34.3
4.03.7
4.23.53.7
4.13.7
3.64.0
4.93.3
4.13.73.8
3.23.9
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
95%97%
85%82%
85%65%
53%78%
61%51%
64%57%55%
73%62%
49%50%
59%24%
50%32%
42%27%
53%50%
45%34%
39%42%38%
31%27%
22%8%19%
26%12%
8%11%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 118
170
180
190
200
210
220
230
240
250
260
Radiology-DiagnosticPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure RD-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
52%45%
3%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
48% 50%
2%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
14%
86%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
44%36%
Scores required?
N=71
N=62
N=66N=44
N=26N=53 N=33 N=15
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 119
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
24%28%
48%
COMLEX-USA Level 1*
N=62
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
60%
40%
USMLE Step 2 CS
Radiology-DiagnosticPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure RD-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
19%15%
67%
COMLEX-USA Level 2-CE*
N=39
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%
8%
69%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
16%8%
76%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
21%
11%
68%
COMLEX-USA Level 2-PE*
N=62 N=39
N=29 N=27
N=28 N=25
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 120
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 99%
78%
64%
45%
30%
50%
36%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure RD-5Radiology-DiagnosticProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
7
426
106 84 76
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
39%
56%
Average Percentage of Applicants Rejected andReviewed
N=74N=73N=75* N=75*N=73N=74
N=74
28% of Radiology-Diagnostic programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=71
NRMP Program Director Survey Results, 2014 121
Surgery (N=121)
NRMP Program Director Survey Results, 2014 122
Figure GS-1SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=115)
1 2 3 4 5
4.4
4.3
3.8
4.3
3.5
4.3
3.9
4.1
4.0
4.3
4.0
4.5
4.1
4.0
4.2
4.4
4.2
3.9
4.2
3.9
3.9
3.6
3.6
3.9
3.8
3.9
4.8
3.8
3.5
3.9
3.5
3.3
3.9
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
97%
92%
79%
87%
72%
76%
70%
69%
78%
65%
70%
58%
62%
53%
68%
73%
69%
70%
47%
55%
39%
52%
50%
43%
47%
45%
27%
33%
21%
29%
21%
10%
10%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 123
SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=115)
Figure GS-2
1 2 3 4 5
4.84.74.8
4.64.4
4.24.2
3.84.34.5
4.14.24.3
4.04.3
3.44.2
4.04.24.14.24.14.24.1
3.63.9
3.53.94.04.1
3.94.14.3
3.73.9
3.64.0
3.73.9
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
91%89%86%
76%82%79%78%
58%69%
53%64%59%
53%55%
62%51%48%
41%38%
46%59%
38%44%
48%42%
33%36%34%35%36%
31%24%
14%10%
18%17%
23%12%
8%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 124
170
180
190
200
210
220
230
240
250
260
SurgeryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure GS-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
53%45%
2%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
62%
36%
2%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
9%
91%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
10%
74%
16%
Scores required?
N=112
N=104
N=107N=92
N=76N=94 N=72 N=58
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 125
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
11%
37%
52%
COMLEX-USA Level 1*
N=102
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
80%
20%
USMLE Step 2 CS
SurgeryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure GS-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
13%
30%
57%
COMLEX-USA Level 2-CE*
N=62
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
10%16%
74%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
10% 10%
80%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
26%
10%
64%
COMLEX-USA Level 2-PE*
N=102 N=62
N=54 N=53
N=50 N=40
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 126
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
66%
50%
37%
23%
48%
39%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure GS-5SurgeryProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
5
731
92 74 55
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
62%
33%
Average Percentage of Applicants Rejected andReviewed
N=118N=115N=121* N=121*N=117N=118
N=113
19% of Surgery programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=115
NRMP Program Director Survey Results, 2014 127
Thoracic Surgery (N=12)
NRMP Program Director Survey Results, 2014 128
Figure TS-1Thoracic SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=12)
1 2 3 4 5
4.1
4.7
4.0
4.0
3.6
4.3
4.1
4.0
4.0
4.0
3.5
4.6
3.4
3.6
4.3
4.6
4.4
4.0
3.6
4.0
3.8
4.0
4.5
4.2
4.0
5.0
5.0
3.7
3.7
3.5
5.0
3.5
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
92%
92%
83%
83%
83%
33%
83%
50%
83%
50%
33%
58%
42%
42%
50%
58%
67%
58%
42%
33%
42%
25%17%
50%
58%
42%
17%
50%
25%
0%
17%
8%
17%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 129
Thoracic SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=12)
Figure TS-2
1 2 3 4 5
4.84.64.8
4.64.2
4.64.3
3.34.24.34.4
4.14.0
5.04.5
3.44.3
3.94.0
4.34.3
4.04.34.3
3.54.0
3.03.5
4.04.1
3.84.5
4.04.5
3.04.04.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
92%92%
83%83%
75%92%
67%58%
75%75%
42%67%
50%8%
33%67%
25%67%
33%67%67%
25%67%
50%33%
42%17%
67%58%58%
50%17%
25%17%
0%17%17%
8%0%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 130
Thoracic SurgeryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure TS-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
33%
67%
0%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
20%
80%
0%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
33%
58%
8%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
42% 42%
17%
Scores required?
N=12
N=6
N=12N=5
N=5
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 1
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
USMLE Step 2 CK not reported
because of low response rate
USMLE Step 1 not reported because of low response
rate
USMLE Step 2 CK not reported
because of low response rate
NRMP Program Director Survey Results, 2014 131
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
29% 29%
43%
COMLEX-USA Level 1*
N=11
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
91%
9%
USMLE Step 2 CS
Thoracic SurgeryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure TS-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
33%
17%
50%
COMLEX-USA Level 2-CE*
N=6
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
33%
0%
67%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
40%
0%
60%
COMLEX-USA Level 3*
N=11 N=6
N=7 N=6
N=4 N=5
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
Not reported because of low response rate
NRMP Program Director Survey Results, 2014 132
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
58% 58%50%
25%
42%
25%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure TS-5Thoracic SurgeryProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
1
108
33 28 23
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
36%
62%
Average Percentage of Applicants Rejected andReviewed
N=12N=12N=12* N=12*N=12N=12
N=12
17% of Thoracic Surgery programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=12
NRMP Program Director Survey Results, 2014 133
Transitional Year (N=47)
NRMP Program Director Survey Results, 2014 134
Figure TY-1Transitional YearPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=47)
1 2 3 4 5
4.2
3.9
4.2
4.1
3.9
4.4
4.4
4.4
4.3
4.1
4.3
4.7
4.3
3.9
4.2
4.1
4.2
3.8
4.2
4.4
4.0
3.9
3.8
3.6
3.8
4.3
4.6
3.9
3.9
3.5
4.0
4.4
3.3
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
98%
53%
85%
89%
70%
68%
53%
68%
70%
28%
72%
66%
68%
40%
45%
28%
23%
66%
64%
74%
53%
47%
60%
36%
28%
32%
40%
17%
26%
23%
6%
15%
9%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 135
Transitional YearPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=47)
Figure TY-2
1 2 3 4 5
4.74.8
4.64.3
4.03.9
4.24.3
4.14.6
4.44.2
4.44.24.2
3.94.34.24.24.1
3.94.3
4.14.04.04.3
3.93.84.04.04.0
4.54.8
4.43.94.1
3.73.8
3.7
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
89%89%
74%83%
91%40%
79%72%
21%72%
79%53%
57%66%
60%68%
36%60%60%
64%23%
49%19%
57%45%40%
47%28%
34%45%
15%23%26%
19%15%
28%15%13%
15%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 136
170
180
190
200
210
220
230
240
250
260
Transitional YearPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure TY-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
28%
65%
7%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
28%
69%
3%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%
74%
2%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
32%
41%
27%
Scores required?
N=47
N=43
N=44N=36
N=16N=26 N=19 N=10
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 137
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
33%
48%
19%
COMLEX-USA Level 1*
N=44
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
68%
32%
USMLE Step 2 CS
Transitional YearPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure TY-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
31% 31%38%
COMLEX-USA Level 2-CE*
N=19
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
16%
0%
84%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
0%
80%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
52%
8%
40%
COMLEX-USA Level 2-PE*
N=44 N=19
N=27 N=26
N=25 N=15
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 138
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
34%
74%
30%
19%
38%
23%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure TY-5Transitional YearProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
10
541
99 78 78
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
55%
34%
Average Percentage of Applicants Rejected andReviewed
N=46N=45N=47* N=47*N=45N=46
N=47
17% of Transitional Year programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=46
NRMP Program Director Survey Results, 2014 139
Vascular Surgery (N=22)
NRMP Program Director Survey Results, 2014 140
Figure VS-1Vascular SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=20)
1 2 3 4 5
3.8
4.7
3.9
3.6
3.9
3.9
4.0
3.5
4.1
4.8
4.0
4.5
3.3
4.0
4.0
4.2
4.2
3.8
3.6
4.5
3.7
3.9
3.7
3.8
4.0
3.7
4.6
3.9
3.5
3.0
3.7
3.3
4.3
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
95%
100%
70%
80%
80%
55%
50%
30%
70%
80%
55%
55%
60%
45%
60%
75%
65%
65%
45%
65%
50%
40%
50%
55%
75%
45%
25%
45%
10%
10%
30%
15%
15%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 141
Vascular SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=20)
Figure VS-2
1 2 3 4 5
4.94.74.7
4.23.9
4.73.93.8
4.74.54.6
3.93.93.8
4.33.6
4.04.1
3.73.7
4.03.0
4.14.1
3.64.2
2.83.93.9
3.64.2
3.55.0
2.53.4
3.04.04.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
95%100%
85%60%
75%95%
70%55%
60%55%
60%40%
50%50%
35%40%
30%40%
35%50%
40%10%
45%50%
40%35%
25%60%
40%40%
45%20%5%
0%10%
25%5%
15%20%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 142
170
180
190
200
210
220
230
240
250
260
Vascular SurgeryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure VS-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
32%
68%
0%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
33%
67%
0%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
19%
81%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
14%
71%
14%
Scores required?
N=21
N=19
N=21N=15
N=8N=11 N=8 N=6
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 143
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%
38% 38%
COMLEX-USA Level 1*
N=21
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
76%
24%
USMLE Step 2 CS
Vascular SurgeryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure VS-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
17%
33%
50%
COMLEX-USA Level 2-CE*
N=15
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
13%
33%
53%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
30%
50%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
27% 27%
45%
COMLEX-USA Level 2-PE*
N=21 N=15
N=13 N=12
N=11 N=10
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 144
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 95%
71%
62%
48%43%
52%
43%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure VS-5Vascular SurgeryProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
154
22 17 14
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
27%
69%
Average Percentage of Applicants Rejected andReviewed
N=21N=21N=22* N=22*N=22N=21
N=21
38% of Vascular Surgery programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=22
NRMP Program Director Survey Results, 2014 145