1ME=ASURING EFFECTIVE TEACHING IN INCLUSIVE CLASSROOMS Melissa Romain McGee A thesis su bmitted in conformity with the requirernents for the degree of Master of Arts Department of Curriculum Teaching and Learning Ontario Institute for Studies in Education of the University of Toronto O Copyright by Melissa Romain McGee (2001)
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
1ME=ASURING EFFECTIVE TEACHING IN INCLUSIVE CLASSROOMS
Melissa Romain McGee
A thesis su bmitted in conformity with the requirernents for the degree of Master of Arts
Department of Curriculum Teaching and Learning Ontario Institute for Studies in Education of the
University of Toronto
O Copyright by Melissa Romain McGee (2001)
National Library 1*1 of Canada Bibliothèque nationale du Canada
Acquisitions and Acquisitions et Bibliographie Services services bibliographiques 395 Weüington Street 395, rue Wellington Oîîawa ON K1A ON4 O(tawa0N KlAON4 Canada Canada
Your Ni Vœm r/Ymme
OLW & WR
The author has granted a non- exclusive licence dowing the National Library of Canada to reproduce, loan, distribute or sell copies of this thesis in microfonn, paper or electronic formats.
The author retains ownership of the copyright in this thesis. Neither the thesis nor substantiai extracts fkom it may be printed or othewise reproduced without the author's permission.
L'auteur a accordé une licence non exclusive permettant à la Bibliothèque nationale du Canada de reproduire, prêter, distribuer ou vendre des copies de cette thèse sous la fome de microfiche/film, de reproduction sur papier ou sur format électronique.
L'auteur conserve la propriété du droit d'auteur qui protège cette thèse. Ni la thèse ni des extraits substantiels de celle-ci ne doivent être imprimés ou autrement reproduits sans son autorisation.
MEASURING EFFECTIVE TEACHING IN INCLUSIVE CLASSROOMS
Melissa Romain McGee Master of Arts
Department of Curriculum, Teaching and Learning University of Toronto
2001
ABSTRACT
The purpose of this study was to examine the relationships among teacher
variables in general education classrooms that included students who were designated as
exceptional and at-risk, through the larger contexts of Stanovich's and Roach's tested path
models of inclusion effectiveness.
Thirteen teachers and their 329 students from a suburban Catholic school system
in southem Ontario participated in this study. Effective teaching behaviors were measured
wi th two instruments: one that evaluated classroom management, time management, and
tesson presentation skills, and another that evaluated indi vidual student-teacher
instructional interactions as instructional adaptations with students designated as
exceptional and at-risk, as well as non-designated students. Two measures of teacher
attitudes toward inclusion and one rneasure of teacher efficacy were also obtained.
Intercorrelations among the fi ve teacher variables were calculated. A signi ficant
positive relationship emerged between the two teaching behavior measures, although
other correlations were not significant. The results are discussed in terms of their
implications for adaptive instruction in inclusive classrooms.
ACKNO WLEDGEMENTS
First, 1 would like to thank my cornmittee memkrs, Dr. Paula Stanovich and Dr.
Anne Jordan, for inviting me to be a part of the SET (Supponing Effective Teaching)
Project. They gave me the awesome opponunity to be a part of the research that shapes
the future of inclusive education. which is an opponunity that 1 wish al1 teachers had. I
also thank Dr. Donna McGhie-Richmond for her constant friendship, encouragement, and
support as we worked together on the SET Project. Paula, Anne, and Donna, the three of
you have dramatically influenced rny professional development as an educator by opening
my eyes and helping me realize what effective teaching should mean to everyone
involved in promoting academic achievement for students. 1 tnily admire your
strength, intelligence, and wisdom.
1 must also thank my fellow SET Project team members, Henk Demeris, Kathryn
Underwood, Tasha Cate, Bridget Gambell, and Cecilia Kwon, for their camaraderie,
cooperation, and col laboration.
A great deal of thanks goes to my parents, Marie and Herman Romain, as well as
my brother. Byron Romain. From childhood to adulthood, your unwavering faith in my
ability to accomplish anything 1 set my mind to, is evident in every goal I set for myself,
as well as every mi lestone 1 cross.
1 thank my husband, Jay McGee, for the unending amount of patience he must
have with me. His willingness to place his own professional pursuits on hold. so that 1
may succeed in my own academic advancement, is a truly selfless charactenstic that
seems to elicit responses of absolute respect from everyone we know and meet. Thank
you, Jay, for the sacrifices you have made for me, and also, for always rerninding me how
proud you are of me for doing this.
Finally, and most important of all, 1 would iike to thank my grandmother who's
presence in rny life was the driving force behind my desire to be a special educator.
Almost a decade ago, when we al1 thought her time here on earth was up, little did we
know that God still had plans for her and that some of her most important work on this
earth was yet to corne. Through her persona1 experiences with disability and loss, she hüs
served as a confidant, a friend, a counselor, and an inspiration to those around her. Her
optimism about life and her ability to laugh in the face of adversity, are qualities that
have, and always will, leave lasting impressions on the hearts and souls of everyone she
meets. For al1 of the joys, sorrows, accomplishments, and tribulations that we have shared
and experienced together, E am etemally grateful. 1 know 1 have made you proud, Granny.
TABLE OF CONTENTS
.. ABSTRACT ........................................................................................................................ i i
..................................................... A Framework for Understanding Effective Inclusion 3 Teacher Behaviors ......................................................................................................... 11
Generai Effective Teaching Practices ................................................................. I I Individual Student-Teacher Interactions and Enstmctional Adaptations ................... 12 Variations in Student-Teacher Interactions and Di fferential Treatment ................... 15 The Validity of Macro-Level Versus Micro-Level Measures of Effective Teaching Behaviors ................................................................................................................... 17
....................................................................................... Teacher Attitudes and Beliefs 18 Implications of Teacher Beliefs on Teaching Behaviors ........................................ 18 Teacher Beliefs and the Use of Effective Instructional Strategies with Students with Disabilities ................................................................................................................. 19 Pathognomonic-Interven tionist Perspectives .......................................................... 30
73 ........................ Operationalization of Teacher Attitudes with Questionnaire Versus ,,
CHAPTER IV ................................................................................................................... DISCUSSION 43
Non-Findings ................................................................................................................. 44 The Intercomelations Between the NO, COC, PH. ATIES, and TES ...................... 44
................................................................................................... Confirmed Hypothesis 44 The Relationship Between the Micro-Level A I 0 and Macro-Level COC ................ 44 Individual Student-Teacher Interactions with Students Designated as Exceptional and At-Risk Versus Non-Designated Students ......................................................... 47
..................................................................................... Limitations and Future Research 49
..................................................................................... Operationaiization of the AI0 50 ............................................................................................... Differential Treatment 52
The Affect of Small Sample Size and Policy Changes on the Validity of the PU Measure of Teacher Attitudes ................................................................................... 54 Validation of the ATIES ........................................................................................... 56 Personal Teaching Efficacy and Effective Teaching Behaviors ................................ 56
............................................................................................... Implications for Practice 57 ..................................................................................................................... Conclusion 59
Table 1: Distribution of Teachers by Sex. Grade Level. Class Size. Years of Teaching Experience. Highest Degree Attained. and Special Education Training ............ 27
Table 2: Cornparison of Adaptive Instruction Observation ( N O ) Scores with Classroom Observation CheckIist Scores ............................................................................. 39
Table 3: Intercorrelations Among the Five Teacher Variables ......................................... 42
LIST OF FiGURES
Figure 1. Feedback mode1 of effective inclusion. .......................................................... 3
Figure 2. Stanovich's (1 994) proposed path mode1 displaying teacher and school ............ 6
Figure 3. Roach's (1998) proposed path mode1 displaying teacher and school variables and operationalizations. ................................................................................. 7
Figure 4. Stanovich's (1994) results of path analysis with significant beta weights identified. ........................................................................................................... 8
Figure 5. Roach's (1998) results of path analysis with significant beta weights identified. ............................................................................................................ 9
Figure 6. Scattergram showing the Interrater Reliability Correlation Calculated for the Pathognomonic-lnterventionist Interviews. ................................................. 40
Figure 7. Teachers' level of adaptation with non-designated students compared to students designated as exceptional and at-risk, with or without an educational
Figure 8. Number of teachers scoring on 7-point scale of level of interaction for Item #1 of the Adaptive Instruction Observation - individual Teacher-student instructional interactions with non-designated students during seütwork. ....... 5 1
Figure 9. Number of teachers sconng on the 7-point scale for Item #2 of the Adaptive Instruction Observation - Individual student-teacher instructional interactions with students designated as exceptional and at-risk during seatwork ............... 53
... V l l l
LIST OF APPENDICES
APPENDK A SET Project Adaptive Instruction Observation 99/00 .............................. ... ......... 67 Examples of Individual Student-Teacher Instructional Interactions ............................. 70
APPENDIX B SET Project Classroom Observation Checklist .......................................................... 7 1
APPENDM C SET Project Coding Cntena for Pathognomonic-Interventionist Interview ................. 75 SET Project Teacher Pathognomonic-Interventionist Interview ................................... 78 SET Project Pathognomonic-Interventionist Interview Scoring Form .......................... 82
APPENDIX D SET Project Attitude Toward Inclusive Education Scale ............................................ 86
APPENDIX E SET Project Teacher Efficacy Scale .............................................................................. 88
C H A m R I
INTRODUCTION
Now. more than ever, general education teachers are being required to meet an
increasingly diverse range of learning needs in their classrooms for a variety of reasons:
the number of at-risk students is increasing (Berliner & Biddle. 1995). immigration is
increasing the number of students for whom English is a second language (Natnello,
McDill, & Pallas, 1990), and the inclusion of students with disabilities in general
education is occuning increasingly (Baker & Zigmond, 1995). As a result of these
pressures, the general education classroom teacher's job is more difficult. It is imperative
that teachers be given the tools that they need to be effective in these heterogeneous
classrooms. In order to assist them, we need to understand what variables impact the
success of their efforts. For example, in what ways do teachers interact with pupils of
differing ability? Do such differentiated interactions have any relationship with other
variables of effective instruction?
A debate still exists about the effectiveness of inclusion. As it has been claimed
that segregated special class placement is inappropriate for the education of students wi th
disabilities. it is still not clear whether inclusive placement of students with disabilities in
general education classrooms will provide optimal learning opportunities (Carlberg &
Kavale, 1980). For instance. it has been found that many instructional adaptations that are
known to foster academic achievement and successful inclusion for students with
disabilities (Friend Br Bursuck, 1996) are not being provided in inclusive general
education classrooms (Kauffman, 1995; Kauffman, Gerber, & Semmel, 1988). However,
as many students in the general education clrissroom experience cultural, behavioral, and
linguistic differences that would benefit from the provision of instructional adaptations
(McIntosh, Vaughn, Schumm, Haager, & Lee, 1993), it is important that general
education teachers' provision of instructional adaptations is also addressed in an attempt
to gain a better understanding of the success of teachers' efforts in inclusive classrooms.
Previous inclusion efforts to merge general and special education in order to
create a more unified education system, such as that seen with the Regular Education
Initiative (Reynolds, Wang, & Walberg, 1987), were based on many assumptions, one
being that good teachers can teach al1 students (Kavale & Forness, 2000). This
assumption emanates from research on effective schools where "Many have contended
that effective instruction as practiced by teachers in regular classes can be appropriately
i mplemented for al 1 chi ldren and can accommodate the indi vidual di fferences among
pupils characterized by special educators as students with disabilities" (Semmei,
Abernathy, Butera, & ksar, 1991, p. 9).
Ultimately, i t has been suggested that teachers who are effective teachers with
students with disabilities are effective teachers with al1 students (Englert, Tarrant, &
Mariage, 1992; Larrivee, 1986). Within this context, general education classroom
teachers are the key to effective inclusion, and in being so, need to be effective teachers
as well as possess the ability to provide adaptive instruction, or systematically Vary
instructional accommodations and learning experiences in order to adequütely meet the
diverse learning needs of students (Walberg & Wang, 1987). Furthemore, many
researchers have found that effective inclusive practices, such as the use of instructional
adaptations, appear to be related to effective instructional practices, in general (Brophy &
Good, 1986; Englert et al., 1992; Jordan & Stanovich, 1998, Larrivee, 1986).
A Frarnework for Understanding Effective Inclusion
General education classrooms that include students with disabili ties are very
complex places. There are many school, classroom, teacher, and pupil characteristics,
which interact to at least partiitlly determine the success or failure of inclusion. Though
much work has been done on individual variables that impact the success of inclusion,
not much work has been done toward developing a framework that would help us
understand how the myriad variables interact with one another. Stanovich and Jordan and
1980) noted in the development of the ATMS, teachers, parents, and members of the
general public tend to have more negative attitudes toward mainstreaming students with
behavioral problems. So, the ATIES was adapted to include more items (than the ATMS)
that address attitudes about including students with specific degrees of behavioral
problems in general education classrooms.
The terminology used in the ATIES has also been updated, from that used in the
ATMS, in order to reflect more acceptable usage of language when refemng to
individuals with disabilities, which avoids equating individuals with their condition
(Arnerican Psychological Association, 1999). In following, this updating of language,
including the use of the terrn "inclusion" on the ATIES as opposed to "mainstreaming,"
reflects the change in the nature of special education services over the past decade (Brice
& Miller, 2 0 ) , as mainstreaming and labeling have been identified as ineffective
strategies for students who receive special services (The National Association of State
Boards of Education, 1992).
The use of the REITS was discontinued for the purpose of the present study
because it did converge with the ATMS in Stanovich's (1994) and Roach's (1998) studies
to form a composite variable. The ATMS and the REITS appeared to be tapping in to a
similar construct.
Teacher Efficacv Scale (TES)
The Teacher Efficacy Scale (TES; Gibson & Dembo, 1984) used to measure
teaching efficacy in Stanovich's (1994) and Roach's (1998) studies, was a 38-item
questionnaire, that was adapted by Johnston (1993) and also used by Kircaali-Iftar (1992).
However, as Gibson and Dembo (1984) found that acceptable reliability coefficients only
resulted from 16 of their original 30 questionnaire items, suggesting that further research
be conducted with a revised 16- to 20-item questionnaire, those 16 highest loading items
were used to measure teaching efficacy in this study. Therefore, the adaptation of the TES
that was used in this study, consisted of 16 items, seven of which addressed generaf
teaching efficacy and nine of which addressed personal teaching efficacy (see Appendix E
for the TES questionnaire).
General teaching efficacy is descnbed as beliefs about what teachers in general
can accomplish and reflects how teachers' beliefs about teaching efficacy is influenced by
external factors such as the home environment or the emotional needs of students
(Tschannen-Moran, Hoy, & Hoy, 1998). An example of a general teaching efficacy item
from the TES is "The hours in my class have little influence on students compared to the
influence of their home environment."
Personal teaching efficacy is more specific and is a belief about teachers' efficacy
which is influenced by intemal factors such as their own ability to impact student leaming
because they feel they have the knowledge and skills to do so (Tschannen-Moran et al.,
1998). An example of persona1 teaching efficacy from the TES is "When a student gets a
better grade than he or she usually gets, it is usually because 1 found better ways to teach
that student."
Each of the 16 items on the TES was a statement, similar to the previous
examples, for which teachers were required to rate their agreement based on a 6-point
Likert-type scale (ranging from 1 = stronglv disagree to 6 = siron& amee).
Due to this study's focus on teacher characteristics that influence inclusion
successfulness, only the items that make up the personal teaching efficacy subscale were
used for analysis. According to Guskey and Passaro (1994). the intemal factor of personal
teaching efficacy "appears to represent perceptions of personal influence, power, and
impact in teaching and learning situations" (p.639), whereas the extemal factor of general
teaching efficacy "relates to perceptions of the influence, power, and impact of elements
that lie outside the classroom and, hence, may be beyond the direct control of individual
teachers" (Guskey & Passaro, 1994, p. 639). Therefore, only the ratings from Items 1, 5,
6, 7, 9, 10, 12, 13, and 15 were used for analysis.
Procedure
The teachers and students involved in this study were voluntary participants and
were recruited as part of a larger research project. Recruitment of teachers took place via
phone calls to their principals, information letters, and meetings that were arranged
during the first half of the school year. Recruitment of students took place via information
letters and consent forms that were sent home to their parents or guardians through their
teachers. Participation was contingent upon return of consent forms.
Data collection for this particular study took place in three phases. During the first
phase, teachers were interviewed with the PII at the beginning of the second half of the
school year (January/February). The PII took place in private, while two or three other
graduate students administered student outcome measures (as part of a larger study of
which this study is a component) to the students in that teacher's class. During the PII,
each teacher was asked to nominate those students in his or her classroom who have
formerly been identified as exceptional, and those who they felt might be at risk for
school difficulties in the foreseeable future, requiring special education assistance.
The second phase of data collection involved a visit to the classrooms in which
the two observation measures of teaching behaviors, the AI0 and the COC, took place
simultaneously. Each teacher was observed over two lesson periods in one half day,
which took approximately three hours. Two core lessons (Le., language arts, math,
science, social studies; not gym, art, li brary) were observed wi th al 1 students present
(none withdrawn). On the day of the observations, observers randomly selected rwo
students who were previously designated as exceptional and at-risk by their teacher, for
the purpose of the adaptive instruction observation measure (e.g., Target Student A and
Target Student B).
During the third phase of data collection, teachers completed the TES and the
ATIES at the end of the school year. The two questionnaires were left with teachers to
complete at their own convenience, which took approximately 20 minutes, and were
subsequently retrieved by researchers before the last day of school.
CHAPTER IIi
RESULTS
The correlates of teacher variables that have been found to impact the success of
inclusion were calculated with the data of the present study in order to explore the
relationship between the two measures of effective teaching behaviors (Le. the micro-
level Adaptive Instruction Observation and the rnacro-level Ciassroom Observation
Checklist) and the relationship between effective teaching behaviors and teacher beliefs
about inclusion (i .e., Pathognomonic-Interventionist Interview and Attitude Toward
Inclusive Education Scale) and teacher beliefs about their personal teaching efficacy (Le.,
Teacher Efficacy Scale). The methods used for the scoring of each instrument, dong with
the final scores that were used to calculate the intercorrelations of the five measures for
the present study, will also be presented.
Scoring
Adaptive Instruction Observation (AI01
For Item #1, which was a rating of the individual student-teacher instructional
interactions with non-designated students that occurred during seatwork, based on the 7-
point scale, the highest rating that each teacher received from either of the two obsewers,
dunng either of the two observed lessons, was used for data analysis. The same was done
for the interactions that took place with Target Student A and Target Student B on item
#2. which was a rating of individual student-teacher instructional interactions with
students designated as exceptional and at-risk dunng seatwork. based on the 7-point
scale, and Item #3, which was a "yes" (scored as 1) or "no" (scored as O) rating of
whether or not the teacher took up responses or called on students designated as
exceptional and at-risk dunng large-group instruction. However, the mean of the two
subsequent scores for each teacher's interactions with Target Student A and Target
Student B, was calculated for Item #2 and Item #3 and these single scores were used in
further analysis. The final score for the A I 0 that was used in the analysis of this study,
was a summed t-sore which was denved from standardizing al1 13 teachers' scores for
each of the three observation items and summing the three standardized z-scores for each
teacher. Teachers' scores ranged frorn 3 to 7 on Item #1, from 1 to 6.5 on Item #2, and O
to 1 o n Item #3. Table 2 displays the scores of al1 13 teachers, as well as the sample mean
and standard deviation for each of the three AI0 items.
Classroom Observation Chec klist (COC)
As indicated previously, only Items 1 though 27 of the COC were used in the
analysis of this study. The ratings given by the two most experienced observers, from
each observation, were scored and used for further analysis.
For each of the 27 observation items, an allotted rating of "not in evidence" was
scored as O, a rating of "inconsistent" was scored as 1, and a rating of "consistent" was
scored as 2. The interrater reliability was obtained by calculating the per cent agreement
between the two observers for d l 27 observation items across al1 13 teacher observations,
and was 73%. The means of the scores given by the two observers for each observation
item were calculated and summed for a total overall composite score for each teacher,
which was used for analysis. The highest score attainable was 54. The scores of al1 13
teachers ranged from 13.75 to 53.50. Table 2 displays al1 13 teacher scores and the
sample mean and standard deviation for the COC.
Table 2
Cornparison of Adaptive Instruction Observation (AI01 Scores with Classroom
Observation Checklist (COC) Scores
AI0 COC
Teacher Item #1 Item #2 Item #3 Summed Sum Score
z-score
TOS* 4.0 1 .O 1 -2.89 13.75
T22 5.0 3.5 O -2.89 19.50
T26 7.0 6.0 O -2 1 24.50
Tl9 4.5 4.5 .5 -1.41 27.25
T15* 3 .O 1 .O 1 -2.96 27.66
T25 7 .O 5.5 .5 .83 33.00
T37 7 .O 5.5 1 2.13 39.25
TS 1 6.5 6.0 I 2.05 43.50
T39* 7.0 4.5 .5 .30 43.50
T28 7.0 6.5 1 2.65 44.50
T27* 7.0 2.5 1 .56 45.00
T23 4.5 4.5 1 -. 1 1 48.25
Tl0 7.0 6.5 .5 1.35 53.50
Note. M = Mean; SD = Standard Deviation; Summed z-score = Sum of standardized z- - scores from AI0 Items #1, #2, and #3; * = Teachers who had an educational assistant
presen t in their cIassrooms during observation.
Pathognomonic/Interventionist - Interview (PII)
For each of the 20 items on the PU, a rating of "pathognûmonic" was scored as i . a
rating of "middle" was scored as 2, and a rating of "interventionist" was scored as 3. If an item
was not applicable (NA) to the interview. then it was dropped from analysis. An overall
composite score for each teacher was derived from the mean of the five topical scores by
summing the scores for al1 items included in each topical area. and dividing each sum by the
number of items in that topical area that were not rated as "not applicable." The mean of both
raters' allotted scores for each teacher, was then calculated and used for further analysis. The
thirteen PI1 scores ranged from 1.38 to 2.95. The sample mean for the PU was 2.12 with a
standard deviation of .47.
The internter reliability for the PD was obtained by correlating the ovenll means of
the composite scores given independently by both raters, for al1 13 teacher interviews, and was
+.63. However. a scattergram depicting this correlation reveals a fairly strong positive linear
relationship, with the exception of one distinctive outlier (see Figure 6). Subsequently, a
correlation. excluding both raters' final scores for that particular teacher interview. was
also calculated, resulting in a high interrater reliability of +.91.
Figure 6. Scattergram showing the Interrater Reliability Correlation Calculated for the
Pathognornonic-Interventionist Interviews.
Scores Given by Rater 1
Attitude Toward Inclusive Education Scale (ATIES)
For each of the 16 ATIES items, a rating of "strongly disagree" was scored as 1,
"moderately disagree" was scored as 2, "disagree slightl y more than agree" was scored as
3, "agree slightly more than disagree" was scored as 4, "moderately agree" was scored as
5, and "strongly agree" was scored as 6. The numerical scores for the 16 items were
summed for each teacher and used for analysis. The highest possible score attainable was
96. The 13 teachers' scores ranged from 55 to 85. The sample mean for the ATIES was
67.62 with a standard deviation of 9.94.
Teacher Efficacv Scale (TES)
For the 16 items on the TES, a rating of "strongly disagree" was scored as 1,
"moderately disagree" was scored as 2, "disagree slightly more than agree" was scored as
3, "agree slightly more than disagree" was scored as 4, "moderately agree" was scored as
5, and "strongly agree" was scored as 6. The final TES scores that were used for analysis
were the sums of the nine persona1 teaching efficacy items calculated for each teacher.
The highest possible score was 54 and the scores for the 13 teachers ranged frorn 36 to
5 1. The sample mean for the TES was 40.92 with a standard deviation of 4.39.
Analysis
Table 3 presents a correlation matnx of the teacher behaviors, teacher attitudes
and beliefs, and teacher efficacy measures. The relationships between the AIO, the COC,
the PH, the ATIES, and the TES were exarnined using a Pearson r one-tailed t-test with
significance set at the .O 1 level.
Table 3
Intercorrelations Among the Fi ve Teacher Variables
Teachers Ranked by Item #1 Scores (and if Equal, then Item #2 Scores)
I Level reached with non-designated students
El Level reached with designated students, no E.A. present
0 Level reached with designated students, E.A. present
Limitations and Future Research
Within the context of the present study, the combination of expected and unexpected
findings indicates that the explanation of possible limitations is in order. Issues regardmg
sample size, the operationdization of the NO, the influence of educational assistants on
tesichers' differential treatment of students designated exceptional and at-risk, changes in
educational policy, and the continued tack of a positive relationship between the TES and
measures of effective teaching behaviors wi I l be addressed.
Otlerationaiization of the AI0
The present study was a pilot study in which observers worked together to develop the
critena for the AIO. Because the development process imposed several ongoing changes
throughout the 13 teacher observations, the amount of consistent data was limited. In order to
preserve the essence of the individuai student-teacher instmctional interactions that were
observed, and report it through the presentation of data. the anaiysis of data for the A I 0 did
not follow traditional protocol. For al1 of the observation items, the highest score that was
given by either of the two observers, for the entire observation period for each teacher, was the
score used in analysis, not a mean of both raters' scores. Therefore, an internter reliability
could not be calcuiated. It was only when two target students were included, that the mean of
the highest scores from either of the two observers for student-teacher interactions with Target
Student A and Target Student B, were calculated. However, none of the raters' scores ever
differed by more than two points on the 7-point scale for any item for any teacher observation.
The strong underlying relationship that was evident between the AI0 and the COC,
even with the small sarnple size, suggests that the Ai0 is a valid measure of effective teaching
behaviors. However, the skewed distribution of teachers' scores on Item #1 (individual
student-teacher instmctional interactions with non-designated students; see Figure 8), as
opposed to the more evenly disuibuted scores on Item #2 (individual student-teacher
instructional interactions with students who are designated as exceptional and at-nsk; see
Figure 9), represents a ceiling effect, which indicates that there is still much to be done in
order to strengthen the AIO as a diable measure of individual student-teacher instmctiond
interactions as adaptive instruction. For future research involving the use of the AIO, fonnd
observer training, involving more time spent in discussions of examples and non-examples
and severai classroom observation training sessions until internter reliability is established,
should be conducted. The use of audio r~cordings of student-teacher interactions, and
subsequent transcriptions of the recordings to be used for sconng purposes, as opposed to just
counting or tdlying the interactions as they are observed, might provide more accurate ratings
based on the 7-point scale, than what was recorded for this study. Also, the administration of
the AI0 by itself (not synonymously with the COC), dong with the adminisuaiion of multiple
AI0 observations over various lessons, would also provide the opportunity for observen to
establish the stability or consistency of student-teacher interaction levels, as one haif day may
not be enough time in order to accurately do this.
Figure 8. Number of teachers scoring on 7-point scale of level of interaction for Item # 1
of the Adaptive Instruction Observation - Individual Teacher-student instructional
interactions with non-designated students during seatwork.
1 2 3 4 5 6 7
Interaction Levels
Figure 9. Number of teachers scoring on the 7-point scale for Item #2 of the Adaptive
Instruction Observation - Individual student-teacher instructional interactions with
students designated as exceptional and at-risk dunng seatwork.
Interaction Levels
Di fferential Treatment
According to the empirical findings of the present study, there appears to be
evidence of teachers di fferentialt y interacting wi th students designated as exceptional and
at-risk, compared to students who are non-designated. By looking at Table 2 and Figure
7, which display teachers' scores on Item #l (individual student-teacher instructional
interactions with non-designated students) and Item #2 (individual student-teacher
instructional interactions with students who designated as exceptional and at-risk) this
differential treatment appears to be to the disadvantage of students designated as
exceptional and at-risk, particularly if attention is focused on Teachers T08, T15, T39,
and T27, whose scores on Item #2 ranged from 3 to 4.5 points lower than their scores on
Item #l. Two of these teachers did not interact with students designated as exceptional
and at-risk on any academic content at all. As it was previously mentioned, these four
teachers were the only teachers in the entire sample who had an educational assistant
present in their classroorn during the time of the observation.
Perhaps for future research, the presence of educational assistants should be
examined in greater depth, including investigations into the type and amount of
instruction that general education teachers delegate to educational assistants. However,
whi le the teachers who were assisted by educational assistants interacted at low levels
with their students designated as exceptional and at-risk, some of the other teachers also
varied in their interactions with students designated as exceptional and at-risk compared
to non-designated students. For example, Teacher T22 interacted with students designated
as exceptional and at-risk at the level of "check and move on" compared to the level of
"transmitting" with non-designated students. As well, Teachers T25 and T37 interacted
with students designated as exceptional and at-risk at the level of "transmitting"
compared to the level of "elaboration" with non-designated students. Such variations in
interactions indicate that some teachers may respond differentially to students designated
as exceptional and at-risk while others do not. This clearly needs further investigation.
The Affect of Small Sample Size and Policy Changes on the Validitv of the PI1 Measure
of Teacher Attitudes
Although the A I 0 demonstrated a strong positive relationship with the COC in
this study, the possible convergent vaiidity of the two measures would be that much more
impressive if the A I 0 and the COC were found to behave in a similar manner with the
PII, that they have been shown to do in other studies (Jordan et al., 1997; Roach, 1998;
Stanovich, 1994; Stanovich & Jordan, 1998). Unfortunately, this was not the case in the
present study, as the lack of strong positive relationships between both measures of
effective teaching behaviors and the Pil was disappointing but not surprising, particularly
when the small sample size is taken into consideration.
In addition, the small sample size also contributed to the low interrater reliability
of the PII. One single outlying score, on which the two raters varied in their overall
composite scores for one of the teacher interviews, significantly affected the outcome of
the correlation that was calculated for the interrater reliability of the PII (Figure 6). When
a second correlation was calculated, omitting the outlying data point, the interrater
reliability increased significantly from +.63 for al1 13 teacher interviews, to +.90 for the
remaining 12 teacher interviews. Obviously, further simultaneous testing of the PU in
relation to both measures of effective teaching behaviors, should involve a larger sample
size, as the use of a large sample size would increase the possibility of obtaining the
significant results of a strong correlation between the Pii and both measures of effective
teaching behaviors.
Change in educational policies is another explanation that may pmvide some
insight into why the Pii may not have been as valid a measure of grounded attitudes and
beliefs for this study as it was for past studies (i.e., Jordan et al., 1997; Stanovich, 1994).
Ontario education policies concerning identification and service delivery to students with
disabilities have changed since the interview and coding criteria for the PII were last
updated. Several of the interview questions conceming the general education teachers'
attitudes and beliefs about students who have formal ly been identi fied as exceptional,
were not applicable in rnany interview cases because, compared to studies conducted
under different policies, students are now able to be provided with an E P even if they are
not fomall y identified as exceptional through an PRC procedure.
For interviews that were conducted in studies before these policy changes,
students who were referred to as exceptional were put on iEPs only if they had formally
been identified as exceptional through IPRC proceedings. However, the recent nature of
these policy changes may have infiuenced the outcorne of the PII as teachers could have
variously understood the status of terms defined by Ontario provincial guidelines. For
example, if students were on IEPs, they were still referred to as exceptional when the
interview data was collected for this study. This may have influenced the dynamics of
how teac hers ' "grounded" beliefs were expected to be predictors of their behaviors,
particularly since the general education teachers' willingness to take responsibility for the
educational needs of included students is supposed to be reflected in their actual behavior
of planning for and delivenng instruction to these students. For future use of the PiI,
perhaps the terminology should be reviewed or updated and teachers provided with exact
definitions of tems as they appear in Ontario provincial guidelines.
Validation of the ATIES
As it has been previously indicated, this was a pilot study with a small sample
size. Although there were a few substantial changes in the adaptation of the ATIES, from
the ATMS used by Stanovich (1994) and Roach (1998), the sample size in this study was
not large enough to justify running factor analyses in order to substantially establish the
ATIES as a highly reliable and valid measure. Thus, factor analyses and other
comparative analyses with the ATMS must await a larger sample size.
Personal Teachin~ - Efficacy and Effective Teaching Behaviors
As noted previousl y, the negati ve relationships that the TES demonstrated wi th
the A I 0 and the COC, although consistent with the findings of Stanovich (1994) and
Roach (1998), are still unexpected outcomes. Although other researchers have found that
self-efficacy appears to be a strong predictor of behaviors (i.e., Bandura, 1997), the
results of Bender et al.'s (1995) study indicate that many teachers who have fairly
positive perceptions of their own effectiveness do not necessarily have positive attitudes
about programs that involve mainstreaming andor including students with disabilities in
general education classrooms. Furthemore, Tschannen-Moran et al. (1 998) state:
Self-efficacy has to do with self-perception of competence rather than
actual level of competence. This is an important distinction, because
people regularly overestimate or underestimate their actual abilities, and
these estimations may have consequences for the courses of action they
choose to pursue or the effort they exert in those pursuits. Over- or
underestimating capabilities rnay also influence how well people use the
skills they possess. (p. 2 1 1)
However, other researchers sugpst the skills and knowledge that teachers feel
they possess may be associated with their performance of instructional planning that is
shared with their colleagues, although the two concepts appear to operate in parallel to,
though independently of each other (Guskey & Passaro, 1994; Roach, 1998). Likewise, as
Jordan and Stanovich (1998) evaluated exemplary teachers in inclusive classrooms, they
indicate that teachers' "reflection about their craft with or wi thout li ke-minded
colleagues" (p. 37) is a possible contributor to their strong sense of self efficacy.
Therefore, further investigations into the relationship between persona1 teaching efficacy
and teachers' collaborative exchanges with colleagues, within the context of the model of
inclusion effectiveness, are wmmted.
Implications for Practice
The central fmding of this study certainly has implications for the professional
developrnent of teachers in diverse classrooms, particularly within the context of the
model of inclusion effectiveness. As a majority of the teachers in the sample of this study
interacted similarly with al1 students, it would appear that as teachers improved upon their
instructional interactions with al1 students, they would also be improving on their
teaching effectiveness with students with disabilities who are inciuded in their general
education classroorns (Roach, 1998).
However, as the macro-level COC measure of effective teaching behaviors was
based on the process-product 1 i terature, which indicates that certain teacher behaviors are
related to student achievement, Shulman (1987) indicates that policy makers took what
the research communi ty understood was "simpli fied and incomplete" and "accepted them
as sufficient for the definitions of standards" (p. 6). Therefore, the COC as a self-checklist
may prove beneficial in helping teachers better understand how their teaching practices
relate to student achievement for ail students in inclusive classrooms. Furthemore,
professional development programs that incorporate the combined use of the COC and
the AI0 as well as the process-product and social constructivist literature that gave rise to
them, could also prove to be an effective means through which teachers Ieam to translate
their theories about teaching and leaming into effective teac hing practices. In addressing
professional development for preservice teachers, Fang (1996) States:
Rather than feedinp them wi th a piethora of theories, teacher educators
should perhaps make more conscious efforts to help them realize what
theory, or combination of theories, is most effective in enhancing student
leaming. Once they are equipped with sound learning and teaching
theories, teacher educators will then need to look for ways (Le.,
pedagogical knowledge) that will help them translate their beliefs and
theones into effective instructional practice so the outcome of student
leaming is maximized. (p. 59)
AccordingIy, although the measures of teacher attitudes and teaching efficacy did
not show any significant relationships with either of the effective teaching behavior
measures in the present study, al1 teachers in inclusive classrooms (not only preservice
teachers) would benefit from professional development programs incorporating the use of
the PI1 criteria, the ATIES, and the TES, along with the A I 0 and the COC, within the
context of the feedback modei of inclusion effecti veness (see Figure 1). Such professional
development could be essential in raising teachers' awareness of their own beliefs about
inclusion, the origins of those beliefs, and how they possibly relate to their teaching
behaviors, which may prove to be an important aspect of teacher knowledge required for
the successfut implementation of inclusion.
According to Kennedy and Kennedy (1996):
Beliefs about the innovation, about its consequences and the contextual
variables associated with it are dl important in determining behavior and
are certainly as important as attitude itself. Awareness-raising of beliefs
and their origins will therefore be important if we wish to change or get
teachers to question their beliefs. (p. 359)
Conclusion
The initial intent of this study was to establish the equivalence of two rneasures
that are used separately as outcome measures of teaching practices in a mode1 of effective
inclusion. Although certain aspects of the results failed to confirm some hypotheses, the
significant relationship that occurred between the two measures of effective teaching
behaviors indicates that provision of adaptive instruction is related to teachers' general
teaching effectiveness. It is suggested that teachers' classroom organizational and
management skills possibly play an important role in their ability to rnaximize their time
spent in elaborative individual student-teacher instructional interactions. Furthemore, the
importance of using elaborative instructional adaptations with students with disabilities,
as well as with students without disabilities, justifies the continued evaluation of teaching
effectiveness at the micro-level of individual student-teacher instructional interactions.
The PD, the TES questionnaire, and the COC al1 have a suong foundation of
empirical evidence behind them to justify using them as operational measures of teacher
attitudes, teacher efficacy, and general teaching behaviors. They could be used in the
further developrnent of Stanovich's (1994) and Roach's (1998) path models of inclusion
effectiveness. The ATIES was adapted from the ATMS, which also has a strong empirical
base, but still requires analyses to establish its validity and reliability. The evolution of
the AI0 is still in the early stages and requires further development and testing in order to
increase upon its validity as a measure of effective teaching behaviors based on its
operationalization of individual student-teacher instructional interactions as adaptive
instruction.
REFERENCES
Adams, G., & Cohen, A. (1974). Children's physical and interpersonal characteristics that affect student-teacher interactions. Journal of Exwrirnental Education, 43, 1-5.
Allington, R. (1980). Teacher interruption behaviors during primary-grade oral reading. Journal of Educational Psvchologv. 72, 37 1-377.
American Psychological Association (1 999). Publication Manual of the American Psycholo~ical Association. Washington, DC: Author.
Ashton, P. T., & Webb, R. B. (1986). Making a difference: Teachers' sense of efficacy and student achievement. New York: Longman.
Babad, E., Inbar, J., & Rosenthal, R. (1982). Pygmalion, Galatea, and the Golem: Investigations of biased and unbiased teachers. Journal of Educational Psvcholog;~, 74,459-474.
Baker, J. M., & Zigmond, N. ( 1990). Are regular education classes equipped to accommodate students with learning disabilities? Exceptional Children, 56. 525- 526.
Baker, J. M., & Zigmond, N. (1995). The meaning and practices of inclusion for students with learning disabilities: Implications from the five cases. The Journal of Swcial Education, 29, 163- 180.
Bandura, A. (1997). Self-efficacv: The exercise of control. New York: W. H. Freeman.
Bender, W. N., Vail, C. O., & Scott, K. (1995). Teachers' attitudes toward increased mainstrearning: implementing effective instruction for students with iearning disabilities. Journal of Leaming Disabilities, 26(2), 87-94.
Berliner, D. C., & Biddle, B. J. (1995). The manufactured crisis: Mvths, fraud and the attack on America's public schools. Reading, MA: Addison-Wesley.
Berman, P., McLaughlin, M., Bass, G., Pauly, E., & Zellman, G. (1977). Federal programs supporting educational change: - Vol. VII. Factors affecting irnplementation and continuation. Santa Monica, CA: RAND.
Berryman, J. D. (1988). Attitudes Toward Mainstreaming Scale: Factonal validity for a lay population. Educational and Psvchologicat Measurement, 48,23 1-236.
Benyman, J. D. (1989). Attitudes of the pliblic toward educational mainstreaming. Remedial and Special Education, 10(4), 4449.
Benyman, J. D., & Berryman, C. R. (1981, April). Use of the attitudes toward mainstrearning - scale with rural Georgia teachers. Paper presented at the annual meeting of the American Educational Research Association, Los Angeles, CA.
Benyman, J. D., & Neal, W. R. (1980). The cross-validation of the Attitudes Toward Mainstreaming Scale (ATMS). Educational and Psychological Measurement, 40(469-474).
Berryman, J. D., Neal, W. R., & Robinson, J. E. (1980). The validation of a scale to measure attitudes toward the classroom integration of disabled students. Journal of Educational Research, 73( 199-203).
Brice, A., & Miller, R. J. (2000). Case studies in inclusion: What works, what doesn't. Communication Disorders Ouarterlv, 2 1 (4), 337-24 1.
Broph y, J., & Good, T. L. ( 1974). Teacher-student relationships: Causes and conseauences. New York: Holt, Rinehart and Winston.
Brophy, J., & Good, T. L. (1986). Teacher behavior and student achievernent. In M. C. Wittrock (Ed.), Handbook of research on teaching. New York: American Educational Research Association.
Bulgren, J. A., & Carta, J. J. (1993). Examining the instructional contexts of students with learning disabilities. Exce~tional Children, 59,182-19 1.
Carlberg, C., & Kavale, K. (1980). The efficacy of special versus regular class placement for exceptional children: A meta-analysis. The Journal of Special Education, 14(3), 295-309. -
Carta, J. J., Atwater, J. B., Schwartz, 1. S., & Miller, P. A. (1990). Applications of ecobehavioral analysis to the study of transitions across earty education settings. Education and Treatment of Children, 13, 298-3 15.
Cooper, H. M. (1979). Pygmalion grows up: A mode1 for teacher expectation communication and performance influence. Review of Educational Research, 49, 389-410.
Durkin, D. (1990). Matching classroom instruction with reading abilities: An unmet need. Remedial and Swcial Education. 1 1, 23-28.
Englert, C. S., Tarrant, K. L., & Mariage, T. V. (1992). Defining and redefining instructional practice in special education: Perspectives on good teaching. Teacher Education and Special Education, 15(2), 62-86.
Fang, Z. (1996). A review of research on teacher beliefs and practices. Educational Research, 38(1), 47-65.
Friend, M., & Bursuck, W. D. (1996). Including students with srxcial needs. Boston: Allyn & Bacon.
Fuchs, D., Fuchs, L. S., Mathes, P. G., & Simmons, D. C. (1997). Peer-assisted leming strategies: Making classrooms more responsive to diversity. American Educational Research Journal. 34(1), 174-206.
Fuchs, L. S., Fuchs, D., & Bishop, N. (1992). Instructional adaptations for students at risk. Journal of Educational Research, 86,7043.
Fuchs, L. S., Fuchs, D., Hamlett, C. L., Phillips, N. B., & Karns, K. (1995). General educators' specialized adaptation for students with leaming disabilities. Exceptional Children, 6 1,440-459.
Fulk, C. L., & Smith, P. J. (1995). Students' perceptions of teachers' instnictional and management adaptations for students with leaming or behavior problems. Eiementarv Schooi Journal, 95,409-4 19.
Fumharn, A. ( 1986). Response bias, social desirabili ty and dissimulation. Personali ty and Individual Differences, 7,385-400.
Gerber, M. M., & Semmel, M. 1. (1984). Teacher as irnperfect test: Reconceptualizing the referral process. Educational Psvcholo~ist, 19, 137- 148.
Gibson, S., & Dembo, M. (1984). Teacher efficacy: A construct validation. Journal of Educational Psvcholo~v, 76,569-582.
Guskey, T. R. (1988). Teacher efficacy, self-concept, and attitudes the implementation of instructional innovation. Teaching and Teacher Education, 4(1), 63-69.
Guskey, T. R., & Passaro, P. D. (1994). Teacher efficacy: A study of construct dimensions. American Educational Research Journal, 31,627-643.
Johnston, D. (1993). Teacher's Ievels of efficacv and belief systerns in relation to student problern tmes. Unpublished MA Thesis, University of Toronto.
Jordan, A., Kircaali-Iftar, G., & Diamond, C. T. P. (1993). Who has a problem, the student or the teacher? Differences in teachers' beliefs about their work with at- risk and integrated exceptional students. International Journal of Disabilitv, Development and Education, 40(1), 45-62.
Jordan, A., Lindsay, L., & Stanovich, P. J. ( 1997). Classroom teachers' instructional interactions with students who are exceptional, at risk, and typically achieving. Rernedial and Special Education, 18(2), 82-93.
Jordan, A., & Stanovich, P. (1998, March). Exemplary teaching in inclusive classrooms. Paper presented at the Annual Meeting of the American Educational Research Association, San Diego, CA.
Jordan, A., & Stanovich, P. (2001). Patterns of teacher-student interaction in inclusive elernentaty classrooms and correlates with student self-concept. International Journal of Disabilitv, Development and Education, 48(1), 33-52.
Jordan-Wilson, A., & Silverman, H. (1991). Teachers' assumptions and beliefs about the delivery of services to exceptional children. Teacher Education and S~ecial Education, 14, 198-206.
Kauffman, J. M. (1995). The illusion of full inclusion: A comprehensive critique of current special education bandwagon. - Austin, Texas: Pro-Ed.
Kauffman, J. M., Gerber, M. M., & Semmel, M. 1. (1988). Arguable assumptions underlying the regular education initiative. Journal of Learning Disabilities, 2 l(6- 12).
Kavale, K. A., & Forness, S. R. (7000). History, rhetoric, and reality. Rernedial and Special Education, 2 1(5), 279-296.
Kennedy, C., & Kennedy, J. (1996). Teacher attitudes and change implementation. Svstem, 24(3), 35 1-360.
Kircaali-Iftar, G. (1992). Teacher and student characteristics which influence teacher preferences for resource and consultation approaches. Un pub1 ished doctoral dissertation, University of Toronto.
Lamvee, B. (1986). Effective teaching for mainstreamed students is effective teaching for al1 students. Teacher Education and Special Education, 9(4), 173-179.
Logan, K. R., Bakeman, R., & Keefe, E. B. (1997). Effects of instructional variables on engaged behavior of students with disabilities in general education classrooms. Exceritional Children, 63(4), 48 1-497.
Marshall, H. (1992). Seeing, redefining and supporting student learning. In H. Marshall (Ed.), Redefining - student learning: Roots of educational change (pp. 1-32). Norwood, NJ: Ablex.
McIntosh, R., Vaughn, S., Schumm, J. S., Haager, D., & Lee, 0. (1993). Observations of students with learning disabilities in general education classrooms. Exceptional Chi ldren, 60, 249-26 1.
Meijer, C., & Foster, S. (1988). The effect of teacher self-efficacy on referral chance. Journal of Special Education, 22, 378-385.
NatrielIo, G., McDill, E. L., & Pallas, A. M. (1990). Schooling Disadvantaged Children: Racing aminst Catastrophe. New York: Teachers College Press.
Pajares, M. F. (1992). Teachers' beliefs and educational research: Cleaning up a messy constnict. Review of Educational Research, 62(3), 307-332.
Paulhus, D. L., & Reid, D. B. (1991). Enhancement and denial in socially desirable responding. Journal of Personalitv and Social Psvcholonv, 60, 307-3 17.
Peterson, P. L., & Clark, C. M. (1978). Teachers' reports of their cognitive process dunng teaching. American Educational Research Journal, 15, 555-565.
Podell, D., & Soodak, L. (1993). Teacher efficacy and bias in special education referrals. Journal of Educational Research, 86, 247-253.
Prawat, R. (1992). Teachers' beliefs about teaching and learning: a constructivist perspective. American Journal of Education, 100, 354-394.
Pressley, M., Hogan, K., Wharton-McDonald, R., Mistretta, J., & Etten berger, S. ( 1996). The chailenges of instructional scaffolding: the challenges of instruction that supports student thinking. LRarning Disabilities Research & Practice, 1 1(3), 138-146.
Reynolds, M. C., Wang, M. C., & Walberg, H. J. (1987). The necessary restructunng of special and general education. Exceptional Children. 53, 391-398.
Roach, D. A. (1998). Factors that affect the instructional interactions of teachers with exceptional. at-risk, and typicallv achieving students in intenrated classrooms. Unpublished doctoral dissertation, University of Toronto, Toronto, ON.
Sindelar, P. T., Smith, M. A., Harriman, N. E., Hale, R. L., & Wilson, R. J. (1989). Teacher effectiveness in special education programs. The Joumal of Swcial Education, 20, 195-207.
Schumm, J. S., & Vaughn, S. (1991). Making adaptations for rnainstreamed students: General classroom teachers' perspectives. Remedial and Speci al Education, 1 2, 1 8-25.
Schumm, J. S., & Vaughn, S. (1995). Getting ready for inclusion: 1s the stage set? Learning Disabilities Research & Practice, 10, 169- 179.
Schumm, J. S., Vaughn, S., & Saumell, L. (1994). Assisting students with difficult textbooks: Teacher perceptions and practices. Reading Research and Instruction, 34, 39-56. -
Scott, B. J., Vitale, M. R., & Masten, W. G. (1998). implementing instructional adaptations for students with disabilities in inclusive c1;ssrooms. Remedial and Special Education, 19(2), 106- 1 19.
Semmel, M. I., Abernathy, T. V., Butera, G., & ksar , S. (199 1). Teacher perceptions of the Regular Education Initiative. Exceptional Children. 58(1), 9-24.
Shulman, L. S. (1987). Knowledge and teaching: Foundations of the new reform. Harvard Educational Review, 19(2), 4- 14.
Soodak, L., & Podell, D. (1993). Teacher efficacy and student probiem as factors in special education referral. Journal of Special Education, 27,66-8 1.
Stanovich, P. J. (1994). Teachers' sense of efficacv, beliefs about practice, and teaching behaviors as predictors of effective inclusion of exce~tional and at-risk vupils. Unpublished doctoral dissertation, University of Toronto, Toronto, ON.
Stanovich, P. J., & Jordan, A. (1998). Canadian teachers' and principals' beliefs about inclusive education as predictors of effective teaching in heterogeneous classrooms. The Elementaw School Joumal. 98(3), 219-236.
Stanovich, P. J., Jordan, A., & Perot, J. (1998). Relative differences in academic self- concept and peer acceptance among students in inclusive classroorns. Remedial and Special Education. 19(2), 130- 126.
Stein, M. K., & Wang, M. C. (1988). Teacher development and school improvement: The process of teacher change. Teaching and Teacher Education, 4, 17 1-1 87.
Swank, P. R., Taylor, R. D., Brady, M. P., & Freiberg, H. J. (1989). Sensitivity of classroom observation systems: Measuring teacher effectiveness. Journal of Experimental Education, 57, 17 1 - 186.
The National Association of State Boards of Education. (1992). Winners d l : A cal1 for inclusive schools. The report of the NASBE study group on svecial education. Alexandria, VA: Author.
Tschannen-Moran, M., Hoy, A. W., & Hoy, W. K. (1998). Teacher efficacy: Its meaning and measure. Review of Educational Research. 68(2), 202-248.
Walberg, H. J., & Wang, M. C. (1987). Effective educational practices and provisions for individual differences. In M. C. R. M. C. Wang, & H. J. Walberg Pd.) , Handbook of svecial education: Research and practice (pp. 1 13- 128). Oxford: Pergamon.
Zigmond, N., & Baker, J. M. (1994). 1s the mainstream a more appropriate educational setting for Randy? A case study of one student with learning disabilities. Learninq Disabilities Research & Practice, 9, 108-1 17.
SET Project Adaptive Instruction Observation 99/00
Observer: Date: Time: to Teac her: School:
Student A
1 2 3 4 5 6 7
No Yes
Target Student B
3 - . 1 2 3 4 5 6 7
3. No Yes
Target Student A
3 - . 1 2 3 4 5 6 7
3. No Yes
Target Student B
2. 1 2 3 4 5 6 7
3. No Ycs
Lesson #l
1. During seatwork, what is the preduniinarit style of interaction between the teacher and al1 students? (academic interaction involving lesson material, not managerial interactions)
1 No
irctmciion with
studcnls on lesson content
2 Teac her
circulatcs. checking
work brietïy and moving on (bncf and
cursory ). lnconsistcntl
Y
3 Teacher
circulatcs. chccking
work bricfly and moving on (brief and
cursory). ConsisientIy
4 Tcacher circulatcs,
innsmitriny and dirccting lesson responscs (tells
studenb what to work on. how to corrcct it. and movcs on) rare
intenction. lnconsistently
5 Tcachcr circuiatcs.
tnnsmiiting and directing lesson rcsponses (tells
studcnis what fo work on, how to corrcct it, and movcs on) m e
intenction. Cnnsistently
6 Tcachcr claboratcs
(asks siudents questions about lesson matcrial concepts that
requirc responscs; frcqucnt
intcnction requiring student
panicipation). Inconsisiently
7 Tacher çlabontcs
( s k s studcnts questions about lesson mtenal concepts that
require rcsponscs: frequcnt
intcnction requiring student
participation). Cnnsisicnily
2. Dunng seatwork, the teacher uses what style of interaction with the target student: (refer to styles of interaction described in question #l and assign score of 1-7 for each target student)
Target Student A: Target Student B:
3. During large group instruction, are target student's responses taken up - is target child called upon? (record Yes or No for each target student)
Target Student A: Target Student B:
1. During seatwork, what is the predomirta~rr style of interaction between the teacher and al1 students? (academic interaction involving lesson material, not managerial interactions)
1 No
intcnction with
students on lesson conten t
2 T a c h e r
circu!ates. chrcking
work briefly and moving
on (brief and cursory).
lnconsisrcntl Y
3 Tcachrr
circulates. checking
work bricfly and moving on i bricf and
C U B O ~ ~ ) . Consistently
4 Tmcher circulates.
innsmitting and directing lcsson responscs (tclls students what to work on, how to correct it. and moves on) n r c
interaction. lnconsistentlv
5 Teachcr circu lates,
transmiiting and directing lesson responses (tells
students what ro work on. Iiow to correct it. and moves on) n r e
intcnction. Consistcntly
6 Teachcr çiabontes
( a k s students questions about lesson material concepts that
require responses: frequent
interaction requiring studcnt
participation). lnconsistentlv
7 Tcacher elabonies
( a k s students questions about tesson matcrial conccpts b a t
requirt: responses; frequent
inicnction requiring student
participation). Consistently
2. During seatwork, the teacher uses what style of interaction with the target student: (refer to styles of interaction described in question #1 and assign score of 1-7 for each target student)
Target Student A: Target Student B:
3. Dunng large group instruction, are target student's responses taken up - is target child called upon? (record Yes or No for each target studentj
Target Student A: Target Student B:
Examples of Indi vidual Student-Teacher Instructional Interactions
Adapted from Roach (1 998, p. 1 17).
1. Check and move on: The teacher moves on to another question or another student if
child respond correctly or incorrectly.
Teacher: John, what is three times four?
Student: Seven.
Teac her: Matthew ?
2. Transmit: The teacher acknowledges andor praises the student's response if it is
correct or slhe gives the student the correct answer if the student's answer is
incorrect, Le.,
Teacher: We've been leaming about the different parts to a novel.
What is the setting of this novet?
Student: The prairies.
Teac her: Yes. That's good.
3. Elabonte: The teacher acknowledges the student's response and elaborated on it
while trying to extend the student's knowledge, i.e.,
Teacher: What color on this map do you think represents water:
Student: Blue.
Teacher: Good. We use blue on the map because often water in real
life is blue. If that's the case, what color is going to represent
forests?
APPENDIX B
SET Project Classroom Observation Checklist
Observer: Date: Time: t o - Teacher: School:
ME = not in evidence Inc = inconsistent Con = consistent NA = not applicable
A. Classroorn Management C.
NIE Inc Con NA
NIE Inc Con NA
NIE Inc Con NA
NIE Inc Con NA
ME Inc Con NA
NIE Inc Con NA
NIE Inc Con NA
NIE Inc Con NA
Time Management
NIE Inc Con NA
NIE Inc Con NA
NIE Inc Con NA
ME Inc Con NA
NIE Inc Con NA
NIE Inc Con NA
NIE Inc Con NA
Lesson Presentation
NIE Inc Con NA
NIE inc Con NA
N E Inc Con NA
NIE Inc Con NA
ME Inc Con NA
NIE Inc Con NA
NIE Inc Con NA
NIE Inc Con NA
NIE Inc Con NA
NIE Inc Con NA
NIE Inc Con NA
Adaptive Instruction
Yes No NA
Yes No NA
Yes No NA
Yes No NA
8. NIE Inc Con NA
A. Classroom Management
B. Time Management
Arranges physical space to maintain minimally disruptive traffic patterns and procedures.
Rules and procedures exist for non-instructional events (e.g., movement about room, student talk, distributing materials, bathroom use, etc.) and for instructional events (e-g., getting ready for lessons, expected behavior of instmctional group, obtaining hel p, seatwork procedures, out-of-seat procedures, etc.).
Evidence of rules that involve respect for other members of class andhr provides verbal reminders to students about how to treat others.
Consequates rule noncompliance quickly; cites rule or procedure in responding to disrupti ve behaviors.
Positions self in room to providc high degree of visibility (e.g., can make eye contact with al1 students).
Scans class frequently.
Uses nonverbal signals whenever possible to direct students in a nondisruptive manner when teaching other groups of students.
Administers praise contingently and uses speci fic praise statements.
Allocates generous amounts of time for instruction (limits time spent on behavior management, recess, and nonacademic activities and talk, keeps transition time between lessons short).
States expectations for seatwork and transitions in advance (e.g., prepares students for transitions in advance by stating behavioral expectations and informing students that lesson is drawing to a close).
Establishes clear lesson routines that signal a clear beginning and end.
Gains students' attention at the beginning of the lesson and maintains attention during instruction at 90% level.
Moni tors transitions by scanning and circulating among students.
Maintains students' attention during seatwork at 86% or higher.
7. Circulates frequently among seatwork students to assist students and to rnonitor progress.
8. Provides active forms of seatwork practice clearly related to academic goals.
C. Lesson Presen tation
1 Provides review of previous day's concepts at beginning of lesson; actively tests students' understanding and retention of previous day's lesson content.
2. Provides a clear overview of the lesson: a. explains task in ternis of teachers' and students' actions b. States the purpose and objective of the lesson c. tells students what they will be accountable for knowing or doing d. introduces topic(s) of the learning task e. activates prior experiences and knowledge relevant to the topics, strategies
or ski Ils to be learned
Actively mode1 and demonstrate concepts, learning strategies, and procedures related to effective problem solving in the content area:
a. provides an organizational framework that will help students organize the lesson information ( e g , text structure genre, diagram of lesson topics and subtopics, concept maps, semantic web, etc.).
b. points out distinctive features of new concepts and uses exarnples and nonexamples to show relevant and imelevant features of the concept.
c. points out organization, relationships and ches in leming materials that elicit learning strategies.
d. models task-specific leming strategies and self-talk that will help students achieve ( e g , rehearsal strategies, retrieval strategies, etc.).
4. Maintainsa briskpaceduring thelesson.
5. Provides frequent questions to evaluate students' mastery of lesson concepts.
6. Evaluates students' understanding of seatwork tasks and cognitive processes by aslung students "what, how, when, why" questions related to the targeted skill or strategy .
7. Maintains high accurate responding rate (70-90%) in teacher-led activities: a. repeats practice opportunities until students are not making errors b. deli vers instructional cues and prompts c. provides error correction procedures d. using promptinp or modeling following errors rather than telling the
answer
8. Provides error drill on missed concepts or review of difficult concepts during and at the end of each lesson.
9. Gives s u m m q of the lesson content and integrates lesson content with content of other lessons or experiences.
10. Summarizes the Iesson accomplishments of individuals and group.
1 1. Forecasts upcoming lesson content.
D. Adaptive Instruction
1. Are the included students working on the same curriculum area as the other students:
2. Are al1 the students sitting in the same seat mangement/fomation?
3. Are al1 the included students called on to answer questions in teacher-led activities?
4. Are the included students regularly included in classroom routines and procedures?
APPENDIX C
SET Project Coding Critena for Pathognomonic-Interventionist Interview
Adapted frorn Jordan, Lindsay, and Stanovich (1997, p. 84-85).
Coding Criteria Stage in Del i very Process Pathognomonic Interventionist
Stage 1: Assessriient
Prereferral (at- risk pupils)
Assessment (at-risk pupils)
Referral (at-risk pupils)
Prere ferra1 (exceptional pupi 1s)
Assessment (exceptional pupi 1 s)
No prereferral activities prior to refening to a resource teacher or psychologist.
Student referred to assess student's deficits and confirm problem.
Teacher refers student as soon as possible (within 1 month of receiving).
Teacher seeks no previous information about student's leaming characteristics beyond information held on file (if any).
Teacher relies on file information and regularly scheduled class tests to assess student's current learning levels (nom-based).
Prereferral activities (collecting data observations, confemng with others) are used to try program adaptations
Student referred to clarify student's learning characteristics and to request altemati ve approaches for teacher to try
Teacher refers only after tying a variety of teaching approaches (more than 1 month).
Teacher accesses several sources of information (previous teachers, resource staff, parents) to find out about pupil's learning characteristics and programming approaches tned.
Teacher conducts in formal, individual tests, observations, and assessments of current learning events.
Setting goals Teacher does not monitor student Teacher monitors progress in order and objectives progress to adapt, update, or guide to adapt, update, or guide
Teacher does not set or record individual objectives; expects siudent to perform on criteria set for total group/class.
No special accommodations for included pupils (no flexible groupings, peer pairing, class layout).
Teacher does not adapt teaching techniques (no peer tutoring, cooperative learni ng, individualized learning packages) to accommodate pupi 1 differences.
Teacher records and fol lows individual instructional objectives for al1 students in class and expects students to perform according to their individually set criteria. Teacher makes accommodations to layout of class, flexible groupings of pupils, etc., for included pupils.
Teacher adapts teaching techniques.
Stage 3: Revie w (ar-rîsk and identifieci plipils)
In-SC ho01 Teacher is unaware of team or sees Teacher uses team to seek team i t as a route to refer pupil for additional resources within the
withdrawal. classroom.
Monitoring Teacher reviews students' progress Teacher reviews students' progress at regularly scheduled testing times on a regular, ongoing basis. a d o r when required to report to others.
Stage 4: Corttnzunication wirh sran (at- risk and idenriflëd pripils)
Collaboration Teacher works usually alone, Teacher works cooperatively with except to refer student to resource resource staff teac her.
Planning Teacher uses no cooperative Teacher plans cooperatively to planning to carry over regular cmy over own objectives and program to resource teacher's content to resource teacher's program. program.
Coordination Teacher does not coordinate to Teacher coordinates and carries carry over resource or special over resource or special education education teacher's program into program into own program. own program.
Pathognomonic Interventionist
Information Teacher does not report to shari ng resource/special education teacher
the pupil's goals or progress, but assumes each teacher keeps track of his or her piece of student's program.
Stage 5: Cumntu~zicatior2 with parents
Contact Parents of at-risk students (at-risk) contacted only at regular reporting
times (e-g., report cards, parent rights, etc.).
Contact Teacher contacts parents if (exceptional) identified pupil exhibits new/major
di fficulties.
Report Teacher reports progress of at-risk, coordination exceptional students but only for a
portion of the program for which teacher is responsi ble.
Teachers meet a regular and systematic intervals to keep each other aware of pupils' progress.
Parents involved prior to regularl y scheduled meetings when risk first becomes apparent.
Teacher keeps in touch with parents weekIy by notes and phone calls, and requests parents to participate.
Teacher shares with special education resource teacher the reporting of information to parents at meetings.
SET Project Teacher Pathognomonic-Interventionist Interview
Teacher: Interviewer:
Grade: Sc hool :
Date: Time:
A. At Risk Pupils 1. Are there any students that are at risk that you are concerned about?
(names, sex, label, subjects?)
2. Tell me what happened when they first came to your attention. -with whom did you confer about your concems? -what steps did you take? -information? Ontario School Record, precious teachers, other? -contacts? staff, principal, parents? -school-based support team. how do they work together, whedhow often do they rnect? where worW who sets objectives?
-expectations/hopes? -how long did it take prior to referral? -steps taken to get back on track?
3. Did you do anything special to accommodate the child? (class organization , program adaptation)
4. Did you make a referral to the in-school team? (who, when, why, your role, hopes/expectations, satisfied?)
5. How did you evaIuate/monitor the situation? (what methods iised? frequency? how did you judge your success?)
6. Did you involve the parents? (when were they first contacted? How often were they contacted? Tell me about how you involved them?)
7. What about reporting to parents? (when, how often, who?)
B. Identified Exceptional Pupils 1. Do you have any pupils in your classroorn who have been identified as
exceptional by an Identification, Placement, and Review Cornmittee? -name, sex -label -subjects -amount of time in your room?
2. What do you see your role with those students as being? -goals/expectations for t hem? for yourself? -information you sought, number and variety of sources -usefulness and use of information gathered +teps, action
3. With whom did you work? -tell me how you worked with the school-based support teacher? -school-based support team? -others? -who set objectives?
4. How do you coordinate information with the school-based support teacher or team?
5. Do you attend team meetings about the child? (if yes, who, when, why, your role, satisfied?)
6. What are your feelings about collaboration?
7. Have you done anything special to accommodate the child? -class organization? -program adaptation? -materials? -teaching techniques?
8. What about evaluating and monitoring? -methods used? -your own? others? coordination of? -identification, placement, and review cornmittees?
9. What about record keeping and reporting? -your own? -others? -shared? -when -how often?
10. How would you judge how successful you were with these identified children?
11. How did you work with parents? (when first contacted, how often, how did you involve them?)
12. Reporting to parents? (when, how often, who?)
SET Project Pat hognomonic-Interventionist Interview Scoring Form
1 = Pathognomonic 2 = Middle 3 = Interventionist
1. REFERRAL AND ASSESSMENT A. At-Risk
1. No prereferral activities prior to bringing in the resource teacher or psychotogist (e.g., collecting data, observations, confemng with others), or prereferral activities are used for confirming student problem. 1 2 3 N/A Prereferral activities (collecting data, observations, confemng with others) are used to program for at-risk student.
2. Student referred to examine student's deficits and confirm student problem. 1 2 3 N/A Student referred to clarify student's learning characteristics and to request al temati ve prograrnming approaches for teacher to try.
3. Teacher refers student for psychoeducational, including Level 1 assessments, as soon as possible (Le., one month). 1 3 - 3 N/A Teacher refers student for psychoeducational, including LeveI 1 assessment, on1 y after trying a variety of teaching approaches.
4. Teacher views the problem within the student, and expects that student's problem to be dealt with by the resource teacher or other specialist. 1 3 - 3 NIA Teacher views the student's problem as a result of the student's interaction with hisker environment, and expects the student's problem to be addressed within the regular classroom.
B. Identified 5. Teacher sought no previous information about student's learning characteristics
beyond the information contained in the OSR. 1 2 3 N/A Teacher accesses a variety of sources (teachers, learning skills teacher, special education coordinator, resource teacher, principal, parents) to find out about students' learning characteristics in order to develop programming ideas.
6. Teacher relies on information in OSR, or from regularly scheduled board-wide tests to assess student's current leaming levels. 1 2 3 N/A Teacher conducts informal, individual observations and assessments of student's current learning levels.
Subscore of Section 1 :
II. PROGRAMMING (AT-RISK AND IDENTIFIED) A. Goals and Objectives
1. Teacher does not monitor student's progress in order to adapt, update and guide instructional interventions. Student's progress is checked only to report at formal
Teacher monitors student's progress in order to adapt, update and guide instructional interventions. Student's progress is checked throughout the year.
2. Teacher does not set or record individual objectives and expects students to perform on cri teria set for total class. 1 7 - 3 NIA Teacher records and fol lows individual instructional objectives for al1 students in the class, and expects students to perfonn according to their individually set criteria.
B. Organization and Teaching Techniques 3. Teacher does not do anything special to accommodate integrated students into the
classroom (e.g., flexible groupings, peer pairings or classroom layout). 1 2 3 N/A Teacher uses modifications to accommodate integrated students into the classroom (e.g., flexible grouping, peer painngs, or classroom Iayout).
4. Teacher does not adapt teaching techniques (peer tutoring, cooperative Ieming, individualized program packages) to accommodate differences among students. 1 3 - 3 NIA Teacher adapts teaching techniques (peer-tutonng, cooperative learning, individualized program packages) to accommodate differences among students.
Subscore for Section lI:
III. REVIEW (IDENTIHED AND AT-RIS K) 1. Teacher is unaware of ISRT, or sees i t as a route to getting the student to resource
people. I 7 - 3 N/A Teacher uses ISRT to seek additionai resources for self to use within the classroom.
2. Teacher sees the purpose of the IPRC as a route to confirming the student's identification and placement. 1 2 3 N/A Teacher sees the purpose of the IPRC as a process to review the student's progress and make appropriate adaptations.
3. Teacher reviews the student's progress at regularly scheduled testing (school- or board-wide tests) andor when required for reporting to others. 1 2 3 NIA Teacher reviews the student's progress on a regular, on-going basis.
Subscore for Section iIi:
IV. COMMUNICATION WTH STAFF 1. Teacher works largely alone, except to refer student out.
I 2 3 NIA Teacher works cooperativel y with resource andor special education teachers to solve student problerns.
2. Teacher uses no cooperative planning to carry over the regular classroom's program to the resource or special education teacher's program. 1 7 - 3 N/A Teacher uses cooperative planning to carry over the regular classroorn's program to the resource or special education teacher's program.
3. Teacher does no planning to carry over the resource or special education teacher's program into the regular classroom's program. 1 2 3 N/A Teacher does planning to cany over the resource or special education teacher's program in to the regular classroom's program.
4. Teachers do not report to each other about the student's progress but assume that each is keeping trac k of hisher piece of the student's program. 1 2 3 N/A Teachers meet at regular and systematic intervals to keep each other aware of the student's progress.
Subscore for Section IV:
V. COMMUNICATION WITH PARENTS 1. Parents of at-risk students are contacted to report student progress only at
regularl y scheduled times, such as report card time. 1 2 3 NIA Teacher involves parents of at-nsk students early, and pior to regulxly scheduled meetings of at-risk students early, and prior to regularly scheduled meetings to discuss student's performance within the classroom.
2. Teacher contacts parents if identified pupil exhibits major problems. 1 2 3 N/A Teacher keeps in touch with parents weekly by notes home, phone calls or annotations on student's work to which parents are asked to respond.
3. Teacher reports the progress of identified and at-risk students to parents, but only for that portion of the program for which teacher is responsible: no coordination of reporting to parents is done. 1 2 3 NIA Teacher coordinates and shares the reporting of information on the student's progress wi th the resource or special education teachers to parents at meetings.
Subscore for Section V:
TOTAL SCORE:
SET Project Attitude Toward Inclusive Education Scale
Directions: For each statement below, select the response that best matches your level of agreement with that statement. Remember, al1 results are confidential, with only group responses king reported.
Scale: 1 = strongly disagree 2 = moderately disagree 3 = disagree slightly more than agree 4 = agree slightly more than disagree 5 = moderately agree 6 = strongly agree
Students whose academic achievernent is 2 or more years below the other students in the grade should be in regular classes.
Students who are physically aggressive toward their peers should be in regular classes.
Students who cannot move without help from others should be in regular ciasses.
Students who are shy and withdrawn should be in regular classes.
Students whose academic achievement is 1 year below the other students in the grade should be in regular classes.
Students whose speech is difficult to understand should be in regular classes.
Students who cannot read standard print and need to use Braille should be in regular classes.
Students who are verbally aggressive toward their peers should be in regular classes.
Scale: 1 = strongly disagree 2 = moderately disagree 3 = disagree slightly more than agree 4 = agree slightly more than disagree 5 = moderately agree 6 = strongly agree
Students who have difficulty expressing their thoughts should be in regular classes.
Students who need training in self-help skills and activities of daily living should be in regular classes.
Students who use sign language or communication boards should be in regular classes.
Students who cannot control their behavior and disrupt activities should be in regular classes.
Students who need an individurtlized functional academic program in everyday reading and math skills should be in regular classes.
Studen ts who cannot hear conversationd speech should be in regular classes.
Students who do not follow school rules for conduct should be in regular classes.
Students who are frequently absent from school should be in regular classes.
SET Project Teacher Efficacy Scale
Directions: For each statement below, select the response that best matches your level of agreement with that statement. Remember, al1 results are confidential, with only group responses being reported.
Scale: 1 = strongly disagree 2 = moderately disagree 3 = disagree slightly more than agree 4 = agree slightly more than disagree 5 = moderately agree 6 = strongly agree
When a student does better than usual, many times it is because 1 exerted a little extra effort.
The hours in my class have little influence on students compared to the influence of their home environment.
The amount that a student can learn is primarily related to family background.
If students are not disciplined at home, they aren't Iikely to accept any discipline.
When a student is having difficulty with an assignment, 1 am usually able to adjust it to his/her level.
When a student gets a better grade thün he/she usually gets, it is usually because 1 found better ways of teaching that student.
When 1 really try, 1 can get through to most difficult students.
A teacher is very limited in what he/she c m achieve because a student's home environment is a large influence on hisher achievement.
Scale: 1 = strongly disagree 2 = moderately disagree 3 = disagree slightly more than agree 4 = agree slightly more than disagree 5 = maderately agree 6 = strongly agree
9. When the grades of my students improve it is usually because 1 found more effective teac hing approac hes.
10. If a student masters a new math concept quickly, this might be because 1 knew the necessary steps in teaching that concept.
I l . If parents would do more with their children, 1 could do more.
12. If a student did not remernber information 1 gave in a previous lesson, 1 would know how to increase hisher retention in the next lesson.
13. If a student in my class kcomes disruptive and noisy, 1 feel assured that 1 know some techniques to redirect hirnlher quickly.
14. The influences of a student's home experiences can be overcome by good teaching.
15. If one of my students could not do a class assignrnent, I would be able to accurately assess whether the assignment was at the correct Ievel of difficulty.
16. Even a teacher with good teaching abilities may not reach many students.