1 Running head: ESTABLISHING EVIDENCE-BASED PRACTICES Identifying and Promoting Transition Evidence-Based Practices and Predictors of Success: A Position Paper of the Division on Career Development and Transition Valerie L. Mazzotti Western Carolina University Dawn R. Rowe University of Oregon Renee Cameto SRI International David W. Test University of North Carolina at Charlotte Mary Morningstar University of Kansas Final Manuscript as Accepted Final Published as: Mazzotti, V. L., Rowe, D. A., Cameto, R., Test, D. W., & Morningstar, M. E. (2013). Identifying and promoting transition evidence-based practices and predictors of success: A position paper of the division on career development and transition. Career Development and Transition for Exceptional Individuals, 36(3), 140-151.
35
Embed
Identifying and Promoting Transition Evidence-Based Practices and Predictors of Success: A Position Paper of the Division on Career Development and Transition
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Identifying and Promoting Transition Evidence-Based Practices and Predictors of Success: A
Position Paper of the Division on Career Development and Transition
Valerie L. Mazzotti
Western Carolina University
Dawn R. Rowe
University of Oregon
Renee Cameto
SRI International
David W. Test
University of North Carolina at Charlotte
Mary Morningstar
University of Kansas
Final Manuscript as Accepted Final Published as:
Mazzotti, V. L., Rowe, D. A., Cameto, R., Test, D. W., & Morningstar, M. E. (2013). Identifying and promoting transition evidence-based practices and predictors of success: A position paper of the division on career development and transition. Career Development and Transition for Exceptional Individuals, 36(3), 140-151.
ESTABLISHING EVIDENCE-BASED PRACTICES 2
Abstract
This position paper describes the Division of Career Development and Transition’s (DCDT)
stance and recommendations for identifying and promoting secondary transition evidence-based
practices and predictors of post-school success for students with disabilities. Recommendations
for experimental research, correlational research, and secondary analysis of NLTS2 data are
provided. Finally, suggestions related to planning for future research in the area of secondary
transition are discussed.
ESTABLISHING EVIDENCE-BASED PRACTICES 3
Identifying and Promoting Transition Evidence-Based Practices and Predictors of Success: A
Position Paper of the Division on Career Development and Transition
Since 1990, and with subsequent amendments in 1997 and 2004, the transition provisions
of the Individuals with Disabilities Education Improvement Act (IDEA) have been a strong
impetus for secondary special education to assume a coordinated approach to planning and
facilitating the transition from school to adulthood for students with disabilities. IDEA contains
language defining transition services, as well as articulating what specifically should be included
in the Individual Education Program (IEP) when planning for transition. Despite such legislative
mandates, students with disabilities continue to leave high school unprepared for the challenges
of adulthood achieving success at a lower rate than their peers without disabilities (Newman,
Wagner, Cameto, & Knokey, 2009).
School programs focusing on post-school outcomes for students with disabilities are not
new phenomena. During the 1980s, federal initiatives to improve outcomes first pronounced the
term “transition” (Will, 1984). However, Rusch, Szymanski, and Chadsey-Rusch (1992) found
"transition services" for youth with disabilities could be traced back to the 1930s for deaf
students, and the 1940s for students with mental retardation. It was not until the 1960s that
models were developed to comprehensively address the dimensions of adult adjustment. These
early career education and vocational models were thought to be precursors to today’s transition
efforts (Halpern, 1992). Kohler (1998) advocated for a transition perspective to undergird all
secondary educational programs and activities using the Taxonomy for Transition Programming
(Kohler, 1996) consisting of five categories (a) Student Focused Planning, (b) Student
Development, (c) Family Involvement, (d) Interagency Collaboration, and (e) Program Structure.
A transition-focused educational approach was articulated that argued for transition to be
ESTABLISHING EVIDENCE-BASED PRACTICES 4
considered not as an add-on process only for students with disabilities, but as the primary
perspective guiding secondary educational programs (Kohler, 1998). This approach grew out of
theory and research that emerged as a response to the federal initiatives (Halpern, 1985;
Wehman, 1992). Kohler and Field (2003) noted progress had been made in implementing
effective transition practices with emergent research evaluating the impact of transition services
on student outcomes. However, such efforts were preliminary and scattered among pockets of
excellence, rather than widespread and consistently implemented. Therefore, the purpose of this
paper is to describe the Division of Career Development and Transition’s (DCDT) stance and
recommendations for identifying and promoting secondary transition evidence-based practices
and predictors of post-school success for students with disabilities.
Efforts to systematize the use of effective transition practices has coincided with
educational policies both within general and special education. In particular, the U. S.
Department of Education (USDOE) emphasized a clear focus on improving the quality of
education for all children in policies outlined under the No Child Left Behind Act (NCLB; 2001)
stating "federal support is targeted to those educational programs that have been demonstrated to
be effective through rigorous scientific research." (U. S. Department of Education, n.d., para. 1).
Teachers were now required to use scientifically-based research practices to teach students with
and without disabilities (Odom, Brantlinger, Gersten, Thompson, & Harris, 2005). Secondary
transition education and services for students with disabilities were not excluded from such
authorizations. Indeed, Test, Fowler, et al. (2009) noted that IDEA 2004 echoed the NCLB
definition of scientifically-based research for special education and related/supplemental aids and
services used with children with disabilities.
ESTABLISHING EVIDENCE-BASED PRACTICES 5
Since Odom et al. (2005) began calling scientifically-based research practices, evidence-
based practices (EBPs), it appears that EBPs have become more than another education “fad”.
Unfortunately, as the literature to identify, and then disseminate, EBPs has been reviewed, there
has been much confusion about how EBPs are defined. As a result, NSTTAC developed a
suggested set of definitions around EBPs based on the earlier work of Innes-Helsel, Hitchcock,
Miller, Malinow, and Murray (2006) and Twyman and Sota (2008). Table 1 provides a set of
definitions for describing different types of practices. Using these definitions, all practices and
predictors discussed in this paper would be considered, evidence-based.
<Insert Table 1>
Given the history of policies and practices regarding how to prepare and support youth
with disabilities to achieve successful adult outcomes, there is considerable work still to be
accomplished, particularly in ensuring educators know about, and can use, evidence-based
secondary transition practices leading to improved outcomes for students with disabilities. As
described in this position paper, more empirically sound research is needed to possess a full
arsenal of scientifically-based methods addressing the complexity of transition education and
services. Therefore, DCDT is advocating researchers increase efforts to conduct rigorous
experimental research to continue to build on current EBPs.
Additionally, as noted by Berliner (2002), a conceptualization of scientifically-based
educational research has been constructed from the research of the physical sciences where
clinical control is de rigor. Berliner argued educational research maybe the "hardest-to-do
science" (p. 18), given the complexities of educational conditions and multiple levels of
As part of the movement to define effective practices in the field, the Council for
Exceptional Children’s (CEC) Professional Standards and Practice Committee is developing
criteria for identifying EBPs that can be used consistently across the field of special education.
This process includes developing quality indicators for group experimental, single-subject, and
correlational research to ensure researchers in the field are conducting high quality research
(Test, Carter, Baer, & Morningstar, 2012). By developing quality indicators researchers can use
consistently in the field, it is more likely researchers will adhere to guidelines that ensure high
quality research is being conducted to build EBPs in special education.
Commented [W1]: So, isn’t this in collaboration with the Division of Research…and Dave, didn’t you guys disseminate these at CEC? May need to update this statement?
ESTABLISHING EVIDENCE-BASED PRACTICES 8
Research in Secondary Transition
The use of high quality research is also important in the field of secondary transition to
identify EBPs and in-school predictors of post-school success for secondary students with
disabilities. In 2006, when the National Secondary Transition Technical Assistance Center
(NSTTAC) was funded by the USDOE Office of Special Education Programs (OSEP), one of its
objectives was to identify EBPs in secondary transition for students with disabilities.
To do this, NSTTAC conducted two comprehensive systematic reviews of secondary
transition literature using quality indicators to determine EBPs (Test, Fowler, et al., 2009) and
evidence-based predictors of post-school success for students with disabilities (Test, Mazzotti, et
al., 2009). The reviews examined experimental and correlational research articles published
between 1984 and 2008. Electronic and hand searches have been conducted since that time to
annually update the original findings. Through June 2011, the search yielded 1,562 articles that
met basic inclusion criteria. Of those articles, only 272 (17.4%) group/single-subject research
studies and 100 (6.4%) correlational studies met advanced inclusion criteria to be examined.
Criteria included (a) were published in peer-reviewed journals, (b) included students with
disabilities between the ages of 11 and 22, (c) independent variable or predictor variable related
to a transition practice or program, and (d) dependent variable or outcome variable related to in-
school or post-school outcomes (see Test, Fowler, et al., 2009 [EBPs] and Test, Mazzotti, et al.,
2009 [evidence-based predictors] for detailed lists of inclusion criteria).
Evidence-Based Practices in Secondary Transition
Experimental studies (i.e., group experimental, single subject), that measure the
effectiveness of a particular strategy by examining the effects of the strategy (i.e., independent
variable) on a particular behavior (i.e., dependent variable), are used to establish EBPs. All
ESTABLISHING EVIDENCE-BASED PRACTICES 9
experimental studies that met the initial inclusion criteria above were first organized by the broad
areas of Kohler’s Taxonomy for Transition Programming (Kohler, 1996). Articles were then
organized by clusters within each of the broad categories (i.e., IEP Development, Life Skills
Instruction). While an original set of 33 EBPs were published in Test, Fowler, et al. (2009),
NSTTAC has continued to annually update its literature review. The 272 (17.4%) group/single-
subject studies that met advance review criteria were reviewed using quality indicator checklists
for group/single-subject research. Next, articles were analyzed using the quality indicators to
determine quality of the research. NSTTAC developed quality indicator guidelines based on
criteria suggested by Horner et al. (2005; single-subject research) and Gersten et al. (2005; group
experimental) from the Exceptional Children (2005) special issue. For more information, see
NSTTAC’s general coding form instructions found at http://www.nsttac.org/content/literature-
review-process. After this analysis, 102 (37.5%) articles met the criteria for group/single-subject
research quality. Each article was then evaluated to determine the level of evidence. Level of
evidence was determined using criteria adapted from the Institute for Education Science (IES)
standards for levels of evidence (What Works Clearinghouse, n.d.), and EBPs were identified as
having a strong, moderate, or potential level of evidence based on number of studies identified.
Of the 102 (37.5%) articles, 98 (36.0%) contributed to identification of EBPs and practice
descriptions. Table 2 provides the decision rules for determining levels of evidence based on
single-subject and group experimental research designs.
<Insert Table 2>
Currently, NSTTAC has identified 64 EBPs for secondary transition. Of these 64
practices, only 6 have a strong level of evidence based on the adapted IES standards, 34 have a
moderate level of evidence, and 24 have a potential level of evidence. These EBPs fall under
Evidence-Based Predictors by Post-School Outcome Area
Predictor/Outcome Education Employment Independent Living
Career Awareness X X
Community Experiences X
Exit Exam Requirements/High
School Diploma Status
X
Inclusion in General Education X X X
Interagency Collaboration X X
Occupational Courses X X
Paid Employment/Work
Experience
X X X
Parental Involvement X
Program of Study X
Self-Advocacy/Self-Determination X X
Self-Care/
Independent Living
X X X
Social Skills X X
Student Support X X X
Transition Program X X
Vocational Education X X
Work Study X
ESTABLISHING EVIDENCE-BASED PRACTICES 34
Table 4 Summary of DCDT’s Recommendations
Recommendations for Experimental Research • Conduct research that meets the quality indicator guidelines established by
Gersten et al. (2005) and Horner et al. (2005) • Focus research efforts on the areas of Kohler’s Taxonomy that have few or no
evidence to support practices (e.g., family involvement, interagency collaboration, program structure)
• Conduct research that includes students from all disability categories and ethnicities
• Conduct longitudinal studies to examine the effects of secondary transition practices overtime on both in-school and post-school outcomes
Recommendations for Correlational Research • Conduct multivariate studies that build on established levels of evidence
(Test, Mazzotti, et al., 2009) • Conduct high quality correlational research that disaggregates data by
disability category to identify predictors of post-school success for specific disability groups
• Conduct research that provides a more comprehensive understanding of in-school predictors of post-school success for students with disabilities
Planning for Future Research • Ensure future qualitative studies in secondary transition be designed to meet
the quality indicators suggested by Brantlinger et al. (2005) • Make high quality research (i.e., using quality indicators suggested by Gersten
et al., 2005; Horner et al., 2005; and Brantlinger et al., 2005) the expectation when reviewing articles for submission in the various journals in the field
• Conduct studies that deal with complex transition issues • Build capacity of future researchers • Collaborate across universities and with stakeholders • Attend to the recommendations from Implementation Science to bridge the
research-to-practice gap
ESTABLISHING EVIDENCE-BASED PRACTICES 35
Table 5 A Sample of Published Articles Based on Secondary Analysis of NLTS2 Berry, H. G., Ward, M., & Caplan, L. (2012). Self-determination and access to
postsecondary education in transitioning youths receiving supplemental security income benefits. Career Development and Transition for Exceptional Individuals, 35, 68-75.
Bouck, E. C., & Joshi, G. S. (2012) Functional curriculum and students with mild intellectual disabilities: Exploring postschool outcomes through the NLTS2. Education and Training in Autism & Developmental Disabilities, 47, 139-153.
Carter, E. W., Austin, D., & Trainor, A. A. (2012). Predictors of postschool employment outcomes for young adults with severe disabilities. Journal of Disability Policy Studies, 23, 50-63. doi: 10.1177/1044207311414680
E.L. (2011) Prevalence and correlates of psychotropic medication use in adolescents with an autism spectrum disorder, with and without ADHD. Journal of Child and Adolescent Psychopharmacology, 21, 571-579.
Grigal M., Hart, D., & Migliore, A. (2011) Comparing the transition planning,
postsecondary education, and employment outcomes of students with intellectual and other disabilities. Career Development for Exceptional Individuals, 34, 4-17.
Joshi, G. S., Bouck, E. C., & Maeda, Y. (2012). Exploring employment preparation
and postschool outcomes for students with mild intellectual disabilities. Career Development and Transition for Exceptional Individuals, 35, 97-107
Kelly, S. M. (2011). The use of assistive technology by high school students with
visual impairments: A second 1ook at the current problem. Journal of Visual Impairment and Blindness, 105, 235-239.
McDonnall, M. C., & O’Mally, J. (2012). Characteristics of early work experiences
and their association with future employment. Journal of Visual Impairment and Blindness, 106, 133-144.
Shattuck, P.T., Wagner, M., Narendorf, S., Sterzing, P., & Hensley, M. (2011). Post
high school service use among young adults with autism. Archives of Pediatrics and Adolescent Medicine, 165, 141-146.
Shogren, K. A., & Plotner, A. J. (2012). Characteristics of transition planning for
students with intellectual disability, autism or other disabilities: Data from the National Longitudinal Transition Study-2. Intellectual and Developmental Disabilities, 50, 16-30.