Top Banner
CHAPTER 4 Top-Down and Bottom-Up NCLB, Charter Schools, and the Public School Principalship [We] have only vague notions as to what constitutes an educated child or an adequate shelter. But we can learn rather easily whether we have satis‹ed people, for the essence of a market is the opportunity it affords clients to vote with their feet. James Q. Wilson, Bureaucracy Accountability systems based on cross-sectional test score results tell us much more about the race, ethnicity, and resource inequalities of students than about the underlying quality of the schooling. But it is also true that leadership can matter to academic achievement, even when measured with an instrument as blunt as aggregate test scores. In this chapter, I will ›ip the analysis around and look at the effects of No Child Left Behind on leadership rather than the effects of lead- ership on status under NCLB. To do so, however, I must complicate the picture a bit. Looking thoroughly at NCLB’s effects on leadership within the public schools requires acknowledging that we are simultaneously undertaking the centralized reforms of NCLB and decentralized or 74
33

Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

Feb 04, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

C H A P T E R 4

Top-Down and Bottom-UpNCLB, Charter Schools, and the

Public School Principalship

[We] have only vague notions as to what constitutes an educated child or an adequate shelter. But we can learn rather easily whether we have satis‹ed people, for the essence of a market is the opportunity it affords clients to vote with their feet.

James Q. Wilson, Bureaucracy

Accountability systems based on cross-sectional test score results tell usmuch more about the race, ethnicity, and resource inequalities ofstudents than about the underlying quality of the schooling. But it isalso true that leadership can matter to academic achievement, evenwhen measured with an instrument as blunt as aggregate test scores.In this chapter, I will ›ip the analysis around and look at the effectsof No Child Left Behind on leadership rather than the effects of lead-ership on status under NCLB. To do so, however, I must complicatethe picture a bit.

Looking thoroughly at NCLB’s effects on leadership within thepublic schools requires acknowledging that we are simultaneouslyundertaking the centralized reforms of NCLB and decentralized or

74

Page 2: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

consumer-oriented reforms in the form of school choice. Theaccountability approach underlying NCLB asserts that centralizingand controlling the establishment and enforcement of objectivemeasures of educational quality will allow us to ‹nd underperform-ing schools, help them get better, and spur other schools to improveas a result of this threat. In contrast, school choice policies seek toallow customers to identify schools that are not producing high-qual-ity educational services and to sanction these underperformingschools through the consequences of their departure.

The forms of choice—charter schools, vouchers, and systems ofpublic choice—differ in many important ways, particularly in theireffects on political participation;1 however, they all share the assump-tion that devolving the power of sanction in educational productionas closely as possible to the level of the consumer-client will lead tohigher-quality educational services. Customers will choose betterschools, and the threat of customer exit will assert a powerful motiva-tional force on all involved in educational production.2

While allowing parents of failing schools to use taxpayer-fundedvouchers to attend private schools had been part of the original bill,No Child Left Behind as enacted contained no such provisions.3 Giv-ing parents in failing schools the option of choosing a successful pub-lic school, however, survived the law’s negotiations and comes intoplay early in the sanctioning process. NCLB also incorporated a thirdtype of choice, charter schools. These publicly funded but moreautonomous schools aim to improve public education by leaving thesanctioning to parents and students in the form of deciding to leave(along with their tax dollars) a traditional public school for a moreautonomous (though still public) charter institution. Their auton-omy is incomplete, as charter schools are still subject to many regula-tions, particularly regarding nondiscrimination, health, and safety.They do, however, typically have more freedom in terms of curricu-lum selection and staff policy than their traditional public counter-parts.

Charter schools occupy an interesting position as both targets andsolutions under No Child Left Behind. They are subject to the sametests and sanctions as traditional public schools yet are also one of theoptions for reconstituting a failing school in the later stages of NCLB

Top-Down and Bottom-Up 75

Page 3: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature haslargely ignored their placement as such.4

Although charter schools predate the passage of NCLB by adecade, no clear consensus exists about whether charter schools pro-duce better educational quality for their students,5 though parentsappear to be satis‹ed with their choices.6 Unfortunately, charterschools’ prospects under No Child Left Behind do not appear verypromising. Across the country, charter schools appear to be failing tomake adequate yearly progress (AYP) at a higher rate than the tradi-tional public schools. In spite of these concerns, the number of char-ter schools and students who attend them continue to grow, withroughly thirty-four hundred charter schools serving about 1 millionstudents.7

Comparing test scores of charter schools and noncharter schoolsmay not be particularly instructive, however, since the lack of demon-strated achievement gains may result mainly from the fact that char-ter schools often serve student populations with traditionally low aca-demic performance. Given the close and positive relationshipbetween student characteristics and AYP failure rates, it likely mattersto charters’ disproportionate AYP identi‹cation that 42 percent ofcharter schools are located in only three states—Arizona, California,and Florida—all of which land in the top ten in the United States interms of percentage minority student enrollment; that roughly halfof all charter schools are located in urban centers, compared to 29percent of regular public schools;8 and that nearly 60 percent ofcharter school students are minorities, as opposed to 44 percent ofthe students in traditional public schools.9 These patterns arerepeated in Minnesota’s charter schools, with AYP failure rates morethan twice those of traditional public schools but student populationsthat are much more diverse than those in Minnesota’s typical publicschool (table 4).

The large increase in failure rates among both types of schoolsresults from the growth in the number of grades tested between 2003and 2004. AYP status in 2003 was based on the results of reading andmath tests for grades three and ‹ve in elementary schools, atten-dance by total student population and by subgroups for middle

76 N O C H I L D L E F T B E H I N D A N D T H E P U B L I C S C H O O L S

Page 4: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

schools, and graduation for high schools. The 2004 AYP calculationsalso included the results of seventh-grade reading and math tests aswell as the results of tenth-grade reading and eleventh-grade mathtests.10 This increase in NCLB’s scope will only continue as newgrade-level tests are added each year.

Surprisingly, the question of how No Child Left Behind will inter-act with school choice reforms has received little attention in the lit-erature. Proponents of government-based reforms and advocates ofmarket-based reforms have generally not accounted for the possibil-ity that their approach might not be the only one adopted, thoughthere have been a few exceptions. Political scientist Terry Moe hasargued that “a combination of top-down and bottom-up approachesis likely to prove far more potent” than standards-based accountabil-ity alone.11 Chester E. Finn Jr. also argues for the bene‹ts of bothapproaches simultaneously, calling for a “public policy pluralism”involving standards and choice.12 Tom Loveless is one of the few

Top-Down and Bottom-Up 77

TABLE 4. Minnesota’s Charter Schools and No Child Left Behind

Regular Charter Public Schools Schools

(1) (2)

Percentage of Minnesota schools not making adequate yearly progress

2003 5% 19%2004 21% 47%

Percentage of enrolled students classified as . . . Black 6% 24%Hispanic 5% 7%American Indian 3% 5%Asian or Pacific Islander 4% 7%Eligible for free or reduced-price lunch 24% 44%LEP 6% 11%Special education 13% 14%

Number of schools (2004) 1,589 108

Source: Author’s analysis based on data from Minnesota Department of Education 2003b,2003c, 2003d, 2004a.

Note: The slight discrepancy between some of these calculated percentages and totals andthe official figures released by the Minnesota Department of Education results from the exclu-sion of schools that were missing data on other variables in my subsequent analysis (2.3 per-cent of the original cases). However, no internal discrepancies exist in subsequent analyses, sothese data will be used throughout. Though these data are publicly available, they are usedwith the verbal permission of the Minnesota Department of Education.

Page 5: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

researchers speci‹cally to examine the position of charter schoolsunder No Child Left Behind, noting that studies of their academicachievement gains are not yet conclusive but cautioning that “thenumber of charters brought under the scrutiny of state accountabil-ity systems is certain to increase dramatically” as more grades arebrought into No Child Left Behind’s assessment system.13

Researchers have not yet suf‹ciently commented on the contra-diction inherent in applying a top-down system of accountability to aunique set of public schools whose explicit purpose is to succeed byvirtue of their relative freedom from regulation. In spite of their dif-ferences, both No Child Left Behind and school choice adopt anindirect approach to improving the quality of schooling. Bothapproaches are based on the hope that turning the screws, eitherfrom above (with NCLB’s threat of sanction) or below (with thedeparture of customers to greener pastures), will induce more qual-ity-oriented behaviors on the part of teachers and administrators.

The underlying theoretical arguments about how these issueshave been framed in the policy debate surrounding NCLB have twolimitations. First, NCLB makes no effort to encourage principals andteachers to excel in their jobs rather than just shirk. As the discussionof agency in chapter 2 noted, the challenge was to induce the schoolprincipal to orient her behavior toward producing higher-qualityeducation. Unfortunately, economists have a dif‹cult time quantify-ing a person’s decision to go above and beyond the call of duty.Rather, school principals or teachers are generally viewed as havingthree choices: to do their jobs, to slack off (called shirking in thepolitical science literature), or actively to undermine the organiza-tion’s goals.14 All else being equal, it is assumed that people willchoose to slack off. No room is made for the possibility that a teacheror principal will put in long hours, often at the expense of their pri-vate lives, simply because it is the right thing to do.15

The second limitation of NCLB’s approach is that it fails to takeinto account the fact that school principals are “boundedly rational,”meaning that they make rational decisions but do so in the presenceof inevitable limitations on their time and information.16 The publicschool principalship is characterized by a great deal of uncertaintyand inevitable trade-offs. The problem is that any system of reform,

78 N O C H I L D L E F T B E H I N D A N D T H E P U B L I C S C H O O L S

Page 6: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

top-down or bottom-up, is likely to lead—for better or worse—to areorientation of principals’ and teachers’ time and attention, a prob-lem known in economics as multitasking: “compensation on any sub-set of tasks will result in a reallocation of activities toward those thatare directly compensated and away from the uncompensated activi-ties.”17 While the literature has featured considerable discussionabout whether No Child Left Behind will cause teachers to teach tothe tests, not enough attention has been paid to the equal possibilitythat principals will lead to the tests.

Assessing either top-down or bottom-up reforms, economistsmight ask, “Does this reform keep teachers and principals from shirk-ing?” While this kind of logic makes for nice, tidy economic models,it misses several aspects of educational leadership. Instead, we shouldbe asking whether top-down or bottom-up reforms encourage teach-ers and principals to go above and beyond the call of duty or whetherthese reforms will inhibit their ability to do so. We also need to askhow either reform effort might impact the inevitable trade-offs inallocation of time and energy that these people must make every day.

A useful way to think about the decision to excel (rather than tojust put in the time) is that of a decision tree. At any step, the possi-bility for teachers or principals to excel can vanish: only if they makeit through all of the steps will they put in the kind of extraordinaryeffort that will make an impact on students’ lives. The principal mustcare enough to want to try. She must have the autonomy to makemeaningful changes. She must have the resources and support to doso. The principal must also have meaningful feedback on whetherthese efforts are working, and she must be operating under anaccountability system that does not ignore or punish her efforts toexcel.

This kind of thinking offers some additional context for compar-ing No Child Left Behind to charter schools and other forms ofschool choice by raising some important issues to guide furtherempirical exploration. Speci‹cally, we need to examine whetherthese two accountability regimes “see” quality in the same way. Inother words, customers may perceive schools with higher test scoresas more desirable or may look instead for other qualities. In addition,it is important carefully to examine the incentive effects of top-down

Top-Down and Bottom-Up 79

Page 7: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

and bottom-up reforms. The analyses in this chapter explore thesequestions and potential contradictions in some detail:

What do public school principals think about No Child LeftBehind?

What effects does the law have on leadership within the pub-lic schools?

What does it mean for the quality of the public school princi-palship of doing top-down accountability and bottom-upschool choice at the same time? Do they reinforce eachother, or do they get in each other’s way?

Is sanction better than competition?

No Child Left Behind: What Principals Think

Surprisingly, relatively little systematic evidence documents whatschool principals think about No Child Left Behind and how the lawdoes or does not change the principalship. One of the most compre-hensive surveys of leadership under No Child Left Behind was con-ducted by Public Agenda in 2003.18 The nearly one thousand publicschool principals and just over one thousand district superintendentssurveyed in Public Agenda’s national sample did not report a sense ofpanic or pessimism but did voice several concerns.19 In fact, themajority of these school and district leaders felt that insuf‹cientfunding, not No Child Left Behind, was their biggest challenge goingforward, though NCLB ranked second. More than 80 percent of thesuperintendents and principals believed that “keeping up with theentire local, state, and federal mandates handed down to the schoolstakes up way too much time.”20 Nearly three-quarters of districtsuperintendents but less than half of the principals in the studyagreed that it is a “good idea to hold principals accountable for stu-dents’ standardized test scores at the building level.”21 Both sets ofschool leaders overwhelmingly agreed that “the push for standards,testing, and accountability . . . is something that is here to stay.”22

Both principals and superintendents rejected the idea that No ChildLeft Behind was irretrievably broken, though they acknowledged thatit would “require many adjustments before it can work.”23

80 N O C H I L D L E F T B E H I N D A N D T H E P U B L I C S C H O O L S

Page 8: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

Minnesota’s public and charter school principals agreed with thecautious optimism of their counterparts in other states. Though amajority of Minnesota’s principals believed that No Child LeftBehind would ultimately improve academic achievement, their atti-tudes suggested some interesting differences (table A6). Principals inregular public schools with large percentages of minority studentswere more likely to believe that NCLB would improve achievement,and nearly as many principals in schools with large percentages ofstudents eligible for free or reduced-price lunch concurred in spiteof the fact that their schools are being placed on the consequencestrack at a much higher rate than other schools. Principals in charterschools were much less optimistic about NCLB’s likely effects, withjust over a third believing that it would improve achievement.

Several possible explanations can account for why principals andsuperintendents have at least some hope for No Child Left Behind.These data do not permit any of these explanations to be completelyruled in or out, but the ‹ndings raise some important considerationsin thinking about NCLB’s prospects. The ‹rst possibility is that pub-lic school principals think No Child Left Behind is well designed andwill work smoothly. Public Agenda’s national survey results castdoubt on this assertion. Another possibility involves a question ofagency. The threat of sanction can be useful in a principal’s hands ifit is based on good data and if it improves the ability of good leadersto shape the delivery of educational services in a useful way. Thinkingabout the law in terms of agency suggests the possibility that top-down accountability might work—alone or in combination with bot-tom-up reforms—but that the speci‹c provisions and features of NoChild Left Behind might provide the wrong mechanism or basis forthese evaluations.24 Finally, there exists the possibility of desperationor least a willingness to live with NCLB’s imperfections if doing so willcall attention to and perhaps improve the educational conditions inthe poorest U.S. communities.

More pessimism generally existed among the small group of Min-nesota’s principals whom I interviewed about No Child Left Behind’sprospects than the larger survey results would indicate. This ‹ndingis not surprising, given that those with strong beliefs probably hadmore incentive to respond to my interview requests, and should not

Top-Down and Bottom-Up 81

Page 9: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

be taken as representative of any underlying distribution of opinions.The details of their concerns, however, are noteworthy. Feelings thatNCLB’s good intentions will ›ounder on its improper design cen-tered on a now-familiar litany of concerns. The principal of a smallrural elementary school that has been making AYP believed thatNCLB was ›awed in its foundational assumption of achieving 100percent pro‹ciency. His seventeen years of experience as a principalplus thirteen as a teacher led him to believe that NCLB was destinedto fail:

The No Child Left Behind Act is one of the most poorly craftedpieces of legislation in the entire history of the U.S. Congress.Forget that it is an unfunded mandate. It attempts to create theimpression that it is possible to have one standard for everychild or school nationwide. Yet, as we well know, this is not thecase.

In fact, there is not even unanimity among the 50 states as toa de‹nition for Adequate Yearly Progress or what standardsshould be met; leaving both of those up to individual states todecide. But, worst of all, it creates the false impression that allstudents can meet some arti‹cial level of achievement called“pro‹ciency.” Those of us in education know this to be patentlyabsurd. A worthy aspiration, but an absolute impossibility. Notevery child can meet such a level. If that were the case, therewould be no 2nd chair clarinet players or students earning D’sor F’s. What the law fails to take into account is the human andsocio-economic factors . . . (aside from measuring a school’sworth based upon a one-shot, large-group test score by 3rd or5th graders) in measuring a student or school’s worth.25

The principal of a school on one of Minnesota’s Native Americanreservations was more optimistic about the law’s intentions but wasalso very concerned about the academic pro‹ciency targets, particu-larly in the connection between poverty and pro‹ciency. Despite hisworries about his school’s prospects for the next year, particularly inlight of a student population that made his school one of the poorestin the state, the school made AYP.

82 N O C H I L D L E F T B E H I N D A N D T H E P U B L I C S C H O O L S

Page 10: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

The school is a high risk school on an Indian Reservation, withhigh minority and high poverty. Although we made AYP lastyear, we will surely soon be a school identi‹ed as needingimprovement. I have many thoughts on NCLB, but none ofthem are positive. It’s great in theory, but unrealistic in prac-tice to think that schools will achieve 100%. This year, we hada special ed. kid who refused to take the 7th grade . . . readingtest. He was one-on-one with two teachers and they could notget him to pick up the pencil and attempt even one answer onthe test. With our small numbers, this could put us on “needsimprovement” status. Is this any fault of the school or my lead-ership, I think not. I also am not sure how the school can beresponsible for student attendance. Are we supposed to go anddrag the kids out of their homes if their parents decide theydon’t have to come to school? I could go on and on.

Other principals focused on some of the additional problems anduncertainties inherent in NCLB’s exclusive focus on the results ofone-day snapshots of only one aspect of the truly educated child,including worries about the consequences for the learning of thestate’s most gifted children:

I’m not sure our high ability students are bene‹ting becausetoo much time and resources are going to the ones who arefailing.

Will kids retain what they’ve been taught under the stress oftest scores and student achievement, AYP, etc.? Or would theybe better off making meaning and connections to real liferather than almost a “roteness” to the learning or teaching tothe test [way] of educating?

I do not have a teacher (of 55) that is excited about NCLB. Wewill successfully “dummy-down” our curriculum . . . and ensurewe have fewer National Merit scholars, etc.

One of the biggest areas of concern among this small group ofMinnesota principals was the failure to address the fundamental

Top-Down and Bottom-Up 83

Page 11: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

issue of resource inequalities between schools and students beforetrying to hold schools accountable to the challenge of success for all:

Students are more than numbers. They are unique individualswith thoughts, desires, dreams, talents and imaginations.These do not show up on multiple choice tests! No one wantsto leave any child behind. We can provide visionary and effec-tive leadership but the federal government needs to provideour families support for their children by helping to providean economy where there is “No family left without a job or ahome!” We can take it from there.

I support the idea of standards for student achievement andstaff quali‹cations. I question the idea of putting so much pres-sure on states to achieve and compete against each other, thatAYP is used in a punitive way. I fear that mandates createinequity as poor districts or districts with large numbers of stu-dents who have risk factors for low achievement work to over-come those built in obstacles. It takes proportionately largeramounts of resources that are always in short supply.

Any child who improves his/her skills is a bene‹t. But if stu-dents move to other schools because they perceive that otherplaces achieve better scores, the funds that go with them willalso move. That will make it more dif‹cult to keep good staffand fund our system which is successful for many, many stu-dents.

Not all of the principals whom I interviewed, however, were pes-simistic about No Child Left Behind’s prospects. The principal ofone school that had achieved ‹ve-star status despite its relatively highpopulation of students eligible for free or reduced-price lunch sawNCLB’s focus on accountability as bene‹cial:

The accountability movement is something I believe in, as Iknow that many public schools in this country do a poor job ofutilizing their resources to meet the needs of students. When Idescribe some of the things we have implemented at our

84 N O C H I L D L E F T B E H I N D A N D T H E P U B L I C S C H O O L S

Page 12: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

school to fellow principals, they look shocked. The model ofcontinuous improvement, which is what I believe is the basic[tenet] of NCLB, has resulted in a positive impact on studentachievement.

Others agreed or at least were willing to give No Child Left Behindthe bene‹t of the doubt:

The actual testing is only a small part of what NCLB is all about.It is about great teaching and smart teaching. All aspects of myleadership go into working with staff to achieve studentachievement. I have always believed that in order to lead weneed to take an occasional leap of faith. So I actually feel ener-gized by this legislation. My only regret is the lack of funding to[our] school. But without funding it will take a little more timeand creative energy. These are challenging times. We canmake them [worthwhile] or we can sink with the sinking ship.I personally prefer to face the challenge and make it fun.

I know that we will work on “test taking.” This will mean leavingother areas out of the mix. I believe we will see increase inachievement in some areas and a decrease in achievement inothers. I know that we will take a serious look at how we dothings. It is always good to re›ect on what and why we do whatwe do. I know positive changes will come of this.

The patterns of cautious optimism about No Child Left Behind’sprospects, though often framed within speci‹c concerns, observed inthe empirical data could result from either agency concerns (in thatthese principals feel less powerful in relation to their teachers orother actors and welcome No Child Left Behind’s stick) or despera-tion and frustration (in that something needs to be done, even if it isa ›awed strategy). The interview responses suggest that NCLB’s goodintentions may be hampered by poor design. Support also appears toexist for the bene‹cial aspects of the law in terms of bureaucraticagency, in that the law—if properly designed—might give principalsuseful tools for motivating and guiding teachers.

Top-Down and Bottom-Up 85

Page 13: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

No Child Left Behind and Principals’ Influence

To disaggregate the relationship between NCLB’s potential effectson in›uence and a principal’s status from the many confoundingin›uences on leadership and achievement, I constructed a series ofregression models using the student, school, and principal charac-teristics discussed in chapter 3. In this case, however, I sought todetermine whether being a principal of a regular public school thathas achieved AYP status, of a regular public school that has failed, orof a charter school has any systematic relationship to that individual’sview of NCLB’s leadership consequences.

The key variables are principals’ responses to the question, “Dur-ing the 2003–4 academic year, to what extent will the No Child LeftBehind Act limit or enhance your in›uence on the following policyareas at your school?” The policy areas were (1) setting performancestandards, (2) guiding the curriculum, (3) setting discipline policy,(4) hiring and evaluating teachers, and (5) setting the budget. Theresponses were coded from one (limit very much) to ‹ve (enhancevery much).

Most Minnesota principals anticipated that No Child Left Behindwould enhance their ability to set performance standards in theirschools, though nearly a third felt that the law would limit theirin›uence in this area (table A7). In addition, a signi‹cant percent-age of principals believed that NCLB would facilitate their ability toestablish a curriculum. From this perspective, the law might allowprincipals to push for standards and curricular reform, since theywould now be able to argue that the law was forcing these changes.Similarly, smaller but sizable percentages of principals expected thatNCLB would make it easier for them to evaluate their teachers, lend-ing some support to the agency view of NCLB’s potential utility forthose who assume that principals need more carrots with which toentice their teachers.

These data have a few important limitations, and other considera-tions must be taken into account. First, these analyses are based onself-reports, though the perceptual side of the equation may very wellbe important in its own right. Second, the 2004 data set lacks asuf‹ciently large number of charter school principals whose schools

86 N O C H I L D L E F T B E H I N D A N D T H E P U B L I C S C H O O L S

Page 14: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

failed to make AYP in the previous year. These models present onlythe probabilities conditional on holding the other indicator variableat zero. In other words, these data do not permit an examination ofthe speci‹c effects of AYP failure on the charter school principalshipbeyond its effects on the public school principalship in general,because only four charter schools in the sample had failed to makeAYP in 2003. Nevertheless, I believe that much useful informationcan be gained from the analysis.

Finally, any observed relationship between being a principal in afailing or charter school and that principal’s leadership may resultfrom aspects of their leadership and the type of school in which theyteach, and this relationship may not be random but may instead bebased on unobservable factors. This issue, however, is less of a con-cern here. The leadership patterns that I observed in chapter 3showed that principals in schools that were more likely to fail basedon the demographic makeup of their student populations spentmore, not less, time on the things that translate into higher achieve-ment.

For charter school principals, however, the story is more compli-cated. Because of their unique nature and greater autonomy, charterschools may attract different kinds of principals. Any observed lead-ership patterns might result from these inherent differences in theprincipals rather than in the structure of the charter school princi-palship itself. In terms of demographic characteristics of principals,some notable differences exist. While only 38 percent of Minnesota’sregular public school principals are female, 60 percent of the charterschools in my study were led by women principals. Charter schoolprincipals are also less likely to have doctorates and averaged about‹ve years’ total experience as a principal versus ten for their regularpublic school counterparts.

I have, therefore, taken two steps to account for these possibleendogeneity effects. The ‹rst is to use more complicated statisticaltechniques to see if my original ‹ndings hold up when confrontingpossible bias.26 The second step was to include a principal’s age, gen-der, race, and ethnicity in all of the analyses in this chapter.27 I amsomewhat agnostic regarding the question of whether charter schoolleaders act differently because charter schools attract different types

Top-Down and Bottom-Up 87

Page 15: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

of leaders or because they allow principals to act differently. Nodoubt, the answer probably includes some of both factors. Unless astate has so many charter schools that the drain of the best principalsfrom the regular public schools becomes an issue (which Minnesotadoes not), however, we should focus on the possibility that charterschools’ advantage may result at least in part from their ability tofacilitate a different kind of principalship.

With these considerations in mind, I now turn to the empiricalresults of my study of the effects of No Child Left Behind on princi-palship in Minnesota, beginning with a more systematic look at howprincipals expect their in›uence to change under No Child LeftBehind. The underlying regressions suggest a few important results.First, looking at the relationship between charter school status andthe mean expected consequences of NCLB shows that charter schoolprincipals have much lower expectations about the law’s effects ontheir in›uence in general (table A9). In contrast, there is no clearindication that principals facing AYP identi‹cation generally expectto have more or less in›uence, possibly either because AYP failurehas no impact on principals’ expectations or because failure is asso-ciated with expected gains in in›uence in some areas and loss ofin›uence in others.

Figure 11 presents the predicted percentages of principals whothink that NCLB will enhance their in›uence across the six schoolpolicy areas, broken down by whether the principal’s school is a reg-ular public school that made AYP, a regular school that failed to doso, or a charter school. Again, these analyses separate the relation-ships among NCLB, charter schools, and leadership from all of theother possibly correlated factors, especially student and school char-acteristics.

Of all of the areas of leadership about which they were asked, onlyin setting performance standards did a majority of principals feel thatNo Child Left Behind would enhance their in›uence. This ‹ndingindicates that top-down accountability might be useful if it providesprincipals with the tools to guide their schools to higher levels of per-formance. In addition, principals of traditional public schools thatfailed to make AYP were more optimistic about their ability to set per-formance standards and evaluate their teachers than those whose

88 N O C H I L D L E F T B E H I N D A N D T H E P U B L I C S C H O O L S

Page 16: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

schools made AYP according to the lists published three months ear-lier but were less optimistic about their ability to establish the cur-riculum and spend the school’s budget. Principals in schools thatfailed to make AYP were more than twice as likely as either of theother groups to report that No Child Left Behind would enhancetheir in›uence in evaluating their teachers.

These ‹ndings lend more support to the idea that at least some ofthe perceived bene‹ts of No Child Left Behind are explained by theagency view of the principalship. NCLB involves a trade-off ofin›uence, but principals might be willing to make this deal if they

Top-Down and Bottom-Up 89

Fig. 11. Expected consequences of NCLB on principal’s in›uence. (Probabilitiesobtained using Clarify [see King, Tomz, and Wittenberg 2000]. Source: MinnesotaSchools Survey 2003. Demographic and AYP data from Minnesota Department ofEducation 2003c, 2003d, 2004a.)

Page 17: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

believe that it will allow them to get closer to their goal of improvingacademic achievement. The threat of sanction can be bene‹cial ifstrategically used, a logic similar to that of the president drawing ahard line with a foreign power and claiming that an intransigentCongress has tied his hands.

Charter school principals generally displayed patterns ofexpected in›uence that closely resembled those of their counter-parts in traditional public schools that made AYP. The principals ofcharter schools were, however, more skeptical than their colleaguesat regular public schools about NCLB’s likely effects on theirin›uence in hiring and evaluating teachers, a ‹nding that is not sur-prising given the greater autonomy that charter school principalsenjoy in these areas (although it is not possible to rule out the possi-bility that these differences in expectations result from chance). Thatcharter school principals felt more optimistic about NCLB’s effectson their budget-setting abilities is surprising, though the underlyingcoef‹cient estimates are not signi‹cant. Further study of this ‹ndingmight be warranted.

While expected consequences are interesting, it is more instruc-tive to compare patterns of in›uence among principals whoseschools have made or failed to make AYP. Observers have extensivelydiscussed whether teachers teach to the tests but have given muchless thought to the question of whether principals lead to the testsand to whether this would be a desirable outcome. The next set ofsimulations is based on a set of regression models that examines prin-cipals’ perceptions of their in›uence in these six school policy areas.In the Minnesota survey, principals were asked to respond to thequestion, “How much actual in›uence do you think you as principalhave regarding the following policy areas at your school?” for sixschool policy areas: setting performance standards, establishing thecurriculum, hiring teachers, evaluating teachers, setting disciplinepolicy, and spending the budget. While the basic regression modelsunderlying these simulations resembled those in ‹gure 11, thesemodels also included principals’ views on the in›uence of parents,teachers, and the Minnesota Department of Education as a means ofcapturing the fact that principals are embedded in a complex web ofagency relationships that affect the exercise of the others’ power.28

90 N O C H I L D L E F T B E H I N D A N D T H E P U B L I C S C H O O L S

Page 18: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

Some clear patterns emerge from the underlying regressions. Incontrast to predictions that principal and teacher power exist inopposition to each other—a view that most scholars of agency in edu-cational production have asserted—principals in my study felt thattheir in›uence was positively tied to that of their teachers across allsix of the school policy areas examined (table A10). All of these rela-tionships were statistically signi‹cant. The notion of educational pro-duction as a zero-sum administrative game in which principals areconstantly at war with their teachers is much too simplistic in theframework of experiential organizations, where school principals tryto assemble the best team that they can and lead by ‹ghting with andfor their teachers. This of course does not mean that no con›ictarises, only that principals are most effective when they do not haveto constantly monitor their teachers.

Interestingly, principals felt that their in›uence was positively tiedto the in›uence of parents and of the Minnesota Department of Edu-cation, but only in those areas where one actor’s contributions mightoffset the power of another. The principals in my study felt that theirin›uence was positively related to that of their parents when settingperformance standards and guiding the curriculum and was posi-tively related to that of the Minnesota Department of Education inenforcing discipline policy and to a lesser extent in setting perfor-mance standards and hiring teachers.

The simulation results derived from a look at principals’ views oftheir in›uence challenge the most optimistic expectations of thebureaucratic consequences of No Child Left Behind, both on thepart of policymakers and on the part of the principals (‹gure 12).AYP failure (announced during the summer) is associated with lowerlevels of in›uence across all six areas of school policy during the fol-lowing fall. These differences were statistically signi‹cant in two criti-cal areas: setting performance standards and guiding the develop-ment of the curriculum.29 Principals of schools that have failed tomake AYP were 63 percent less likely to report that they had a greatdeal of in›uence in setting performance standards in the school and59 percent less likely to report that they had a great deal of in›uencein guiding the curriculum within the school.

The two areas where Minnesota’s principals expected the greatest

Top-Down and Bottom-Up 91

Page 19: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

bene‹t from No Child Left Behind in the previous analysis—settingperformance standards and establishing the curriculum—were alsothe two areas where they felt the least in›uential. The two areaswhere they felt the most in›uential—hiring and evaluating teach-ers—were also two of the three areas where they perceived the leastbene‹t from NCLB.

These patterns are entirely consistent with what James Q. Wilsonpredicted about top-down reforms in coping organizations. Ofcourse, one might counter that we want these principals in failingschools to be less in›uential since whatever they were doing was notworking. This conclusion, however, rests on the assumption that AYP

92 N O C H I L D L E F T B E H I N D A N D T H E P U B L I C S C H O O L S

Fig. 12. In›uence of principal in policy areas. (Probabilities obtained using Clar-ify [see King, Tomz, and Wittenberg 2000]. Source: Minnesota Schools Survey2003. Demographic and AYP data from Minnesota Department of Education2003c, 2003d, 2004a.)

Page 20: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

failure results only from leadership, not from things beyond the con-trol of principals and teachers, which I have established is not thecase. This assertion also rests on the assumption that the law bases itscon‹scation of principal autonomy on a true measure of the qualityof the principal’s efforts in developing and implementing theschool’s curriculum.

Charter school principals, in contrast, perceive themselves as lessin›uential in setting discipline policy (possibly as a consequence ofgreater in›uence by their customers) and hiring and evaluating theirteachers but more in›uential in setting performance standards, guid-ing the curriculum, and spending the budget. These patterns areconsistent with the expected ‹ndings, given these principals’ greaterautonomy in these areas. The differences for charter schools are sta-tistically signi‹cant in setting performance standards and disciplinepolicy as well as in evaluating teachers.

NCLB and the Influence of Other Actors in Education

Principals are only one of many sets of actors in education, and it isuseful to relate what they think about the in›uence of these playersin the educational policy space to the top-down and bottom-upreforms in place. Figure 13 breaks down the predicted percentagesof principals who feel that each of four actors in the educational pol-icy space has a great deal of in›uence in making decisions that affecttheir schools by the same status variables as before: whether the prin-cipal is leading a school that made AYP, whether she is leading a fail-ing school, or whether she is the principal of a charter school. Thisset of models, similar in all other ways to those in ‹gure 12, examinesprincipals’ responses to the question, “How much actual in›uencedo you think each of the following has regarding making decisionsthat affect your school?” for four actors in the educational policyspace: principals, teachers, parents, and the Minnesota Departmentof Education. Both of these sets of responses were coded on a ‹ve-point scale, where zero equals no in›uence and ‹ve equals a greatdeal of in›uence.30

Minnesota’s public school principals were much more likely toreport that of‹cials with the Department of Education had a great

Top-Down and Bottom-Up 93

Page 21: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

deal of in›uence than any of the other three sets of actors and weremuch less likely to report that parents had a great deal of in›uencein their schools. This pattern echoes a long-standing criticism of pub-lic education in the United States: that the inevitable product ofdemocratic control over education results in the ossi‹cation of con-trol over schooling and undue in›uence by bureaucrats far removedfrom the actual production of education.31

Some notable differences in in›uence also exist among thesegroups of principals. Charter school principals were more than threetimes as likely to report that their teachers had a great deal of

94 N O C H I L D L E F T B E H I N D A N D T H E P U B L I C S C H O O L S

Fig. 13. In›uence of actors in education. (Probabilities obtained using Clarify[see King, Tomz, and Wittenberg 2000]. Source: Minnesota Schools Survey 2003.Demographic and AYP data from Minnesota Department of Education 2003c,2003d, 2004a.)

Page 22: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

in›uence than either group of regular public school principals andthe least likely of the three groups to report that the MinnesotaDepartment of Education had a great deal of in›uence.32 Principalsin regular public schools that failed to make AYP, however, weremore than 50 percent more likely than those whose schools madeAYP to report that the Minnesota Department of Education had agreat deal of in›uence in setting policy in their schools. These prin-cipals, however, were less than half as likely to perceive themselves asvery in›uential than their counterparts in schools that had not beenso labeled. As noted in chapter 3, these results cannot prove that AYPsanction causes the Minnesota Department of Education to becomemore powerful and principals less powerful. However, these correla-tions are entirely consistent with such an explanation and concurwith my theoretical predictions. If one believes that AYP identi‹-cation is based on a true measure of the quality of the principalshipand that the answer to this failure is to increase the power of stateof‹cials, then No Child Left Behind appears to be a bureaucratic suc-cess. Both of these assumptions are questionable at best and mis-guided at worst.

These patterns of in›uence are entirely consistent with the pre-dictions of chapter 2 (and those made by Wilson) about the contrastbetween top-down and bottom-up reforms. If policymakers evaluateschools from the top down, they end up increasing their in›uenceand decreasing that of those closer to educational production. If,however, policymakers pass the ultimate evaluations of quality to theconsumers of the services, they increase the power of those close tothe real action and decrease the power of those farther away from it.

The complex relationships among expectations, in›uence, andagency observed in the survey results were echoed in the open-endedcomments that principals provided in the follow-up interviews. Thoseprincipals who were optimistic about NCLB’s potential consequencesfor Minnesota’s public schools tended to locate the bene‹ts withinthe agency relationships in which the schools are embedded becausesuch relationships give the principals either additional tools for eval-uating their leadership or additional levers with which to bring alongteachers and staff. For the principal of a ‹ve-star school, the bene‹tsof No Child Left Behind derived from having more information with

Top-Down and Bottom-Up 95

Page 23: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

which to assess his school’s progress toward his goals. Though poten-tially at a disadvantage given his school’s high proportion of studentseligible for free or reduced-price lunch, he welcomed the focus onstudents in all subgroups:

From my perspective NCLB has been a driving force behindseveral positive changes in my school. Our desire as a staff is todo our best for kids, and I have been able to use the NCLB leg-islation to promote the need to work smarter and focus moreon moving all students forward academically. I believe that myteachers have always strived to do their best, and NCLB is justone more program that is assisting us in de‹ning what we doon a daily basis.

I am very concerned with the rhetoric I hear from many ofmy principal colleagues regarding NCLB. They view this as aBush mandate, and therefore it is all bad. My approach hasbeen to focus on the positives of the legislation, including thetraining of paraprofessionals, using research based curricu-lum, measuring student growth from year to year, and address-ing the various subgroups that need a more specializedapproach to helping them catch up. I believe that my leader-ship and how I have responded to NCLB has actually improvedthe working conditions for teachers. We have developed bettersystems to help students, monitor achievement, etc. which hasresulted in a smarter working environment.

An elementary school principal in another part of the state framedthe bene‹ts of No Child Left Behind directly in terms of agency rela-tionships. With twenty-four years of teaching under her belt, she wel-comed the chance to encourage her staff to do more:

My leadership has been affected positively by NCLB. The staffat this school are very resistant to change. The changes thathave been needed can be moved forward better because wehave a goal and expectation. I speak of NCLB as a goal that isgood, and it can help us focus what we do. My philosophy isthat if we are addressing the needs of students and focusing

96 N O C H I L D L E F T B E H I N D A N D T H E P U B L I C S C H O O L S

Page 24: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

our energy, then communicating this to students and parentsand are able to give speci‹c information about how studentsare doing in relation to the goal each year, we will get moreinvolvement from parents and more motivation from students.

A high school principal with an equally long record of teachingagreed:

NCLB encourages accountability and focus in a district. Ibelieve very much that educators need to be held moreaccountable for student learning. In this light, my leadership isreinforced by NCLB. I would guess that roughly 20% of mytime now is spent trying to insure our school makes AYP. Muchof the increase is due to testing, increased demands for docu-mentation, and developing and implementing changes in poli-cies and procedures. I now have less time for other duties, liketeacher observation and associated staff development.

As his comments reveal, however, the added focus on excellenceand the added ability to motivate and encourage teachers and stu-dents do not come without cost. Refocusing efforts invariably meanstime taken away from other tasks, and having a bigger stick withwhich to motivate teachers has the very real potential to erode theconsensus-building aspects of the public school principalship, a com-ment echoed by several of his colleagues:

NCLB is just one small aspect of my leadership. However, it haschallenged me to move mountains in short order. It has chal-lenged me to become an expert in best practices in curriculumand instruction. It has challenged me to provide learningopportunities for all staff to increase student achievement.These challenges are very exciting; . . . however, they are alsovery time consuming and draining. . . . The day-to-day opera-tions, being in the hallways with kids, etc., suffer.

I’ve been more directive—top-down decisions, even though Ihave a site team. The pressure is on me from my superinten-

Top-Down and Bottom-Up 97

Page 25: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

dent to produce higher achievement too. It trickles down toteachers and students and parents. I feel that it puts me in aposition to “enforce” rather than “support” good teaching.The mandate of NCLB has become a “do it or I’ll hurt you”model. . . . [M]ake the progress or you’ll end up on thedreaded list.

The principal of one Minnesota’s charter schools agreed. With a stu-dent population nearly 100 percent nonwhite, a student populationeligible for free or reduced-price lunch nearly as high, and havingmade AYP the year before, the principal felt that No Child LeftBehind must be carefully examined for its effects on the broadercommunity that she believes de‹nes what a school is supposed to beabout:

If we are to embrace the beliefs of intrinsic motivation and thatsuccess is its own reward for our students, we should then set anexample of a balanced life, strong work ethic and [acknowl-edgment] of differences. Too much focus on external rewardsturns even the best people into poor citizens. [NCLB’s]approach can have some bene‹ts but must be examined verycarefully.

Another Minnesota principal perceived it to be part of his job toactively shield his teachers from the stresses and consequences of NoChild Left Behind. In terms of bureaucratic agency, he thus sabo-tages the law’s intent. With seventeen years of experience as a princi-pal plus thirteen as a teacher, he felt, however, that part of his pro-fessionalism was to act as a counterweight to the power of theMinnesota Department of Education, which his survey responsesindicated he believed surpassed that of any of the other actors in thestate’s educational environment:

As principal, I have made it a point to downplay the impor-tance of the results of tests to my students, staff, and parents. Isimply tell the teachers to follow our curriculum scope andsequence and not teach to the test or set aside special test prep

98 N O C H I L D L E F T B E H I N D A N D T H E P U B L I C S C H O O L S

Page 26: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

times. We encourage our students to be here and do their best;and we encourage the parents to make sure their children arehere so we don’t get “dunced” for the simple lack of test takers.By putting a priority on good teaching practices, supportingstaff development activities to improve those practices, andmaking school a positive, nurturing environment for studentsand staff, we hope to create an atmosphere where students areable to do their best . . . no matter what that “best” is.

When re›ecting on the effects of NCLB on the in›uence of theirteachers, the small group of Minnesota’s principals in my follow-upinterviews worried about the reallocation of teachers’ time andenergy and the prospect of risk aversion in their approach to theirjobs. Mostly, however, they focused on the stress that the law causestheir teachers, a group without which—as the survey results show—principals do not feel that they can effectively do their jobs.

We have wonderful teachers. They work hard and do a greatjob of meeting needs. My concern is the extra, unnecessarypressure added to them due to NCLB. They work hard andcare. . . . [T]hey should be given credit for that.

My teachers are very stressed out. While we have taken greatsteps to provide them with a positive attitude and excellent staffdevelopment and resources to support students and learning,teachers typically don’t move this quickly. This has been a veryoverwhelming year for many. Also, recognizing that they haveto teach all children with the expectation that they all performat or above grade level is a new concept for the middle schools.

They are stressed. . . . [T]est scores drive teaching now, morethan ever, and [NCLB is] increasing the amount of pressurefor teachers and principals.

Many principals also felt that the added stress placed on teacherswould lead not to increased academic achievement but to risk aver-sion and a narrowing of the curriculum, just as the theoretical frame-work in chapter 2 predicts:

Top-Down and Bottom-Up 99

Page 27: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

The teachers prepare for the tests. They are accountable fortest scores. This makes the teachers more irritable and less will-ing to try new things in class.

Teachers are more nervous about how students do on tests andspend more time on test related items and less on creativemind expanding activities. They have less time to help developthe total student emotionally, physically, and academically.[The] staff has been less inclined to look at new and differentthings. I encourage their taking risks but not as many are will-ing or have the time to try new things at this point.

When our school scores are being measured against the otherscores of schools around us, I believe people feel they need toconcentrate on the things that are measured. In some ways thisis good, but it has decreased the willingness on teachers’ partsto try to [do] new things or approaches.

Teachers are spending less time on social skills, art, music, sci-ence, academic survival skills, and social studies and more timeon math and reading. Teachers are spending less time ongifted and talented students, the best readers and mathemati-cians.

A few principals saw the stress of NCLB’s potential consequencesas forcing a change in the character of the principalship itself, as theyfound themselves engaged in activities that they had not imagined astraditional roles, such as providing damage control and protectionfor their students and staff:

Last year one of the elementary buildings was identi‹ed earlyon as a school [in need of] improvement. Later it was deter-mined that it was a clerical error which had placed the schoolon the list. Even in this situation the hours of time that itrequired to deal with this situation was a tremendous amountof lost resources and very little educational value. I had con-ducted numerous interviews with the media over this period oftime as well as drafting responses to the school board, commu-nity, and state department.

100 N O C H I L D L E F T B E H I N D A N D T H E P U B L I C S C H O O L S

Page 28: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

I have staff members who tell me that NCLB has taken the funout of teaching and learning. Kids can’t just be kids anymore.Teachers in grades 3 and 5 feel added stress. There is so muchto teach and not enough time to do it. I know I am not alone inmy beliefs, many elementary principals are just too nice (ordiplomatic) to say it.

The challenge to my leadership is to protect the staff from theoutside impacting agencies and policies and to allow them thefreedom to engage their students to become the citizens forfuture generations of leaders.

These responses raise a critical concern, again brought up in thetheoretical discussions of chapter 2: that No Child Left Behind’speculiar method of top-down accountability may lead to an ulti-mately counterproductive reallocation of principals’ limited timeand energy toward ful‹lling the narrow vision of educational qualityembodied in the law’s one-size-‹ts-all approach to identi‹cation andsanction.

NCLB and Principals’ Allocation of Time

This chapter’s ‹nal analysis involves a closer empirical look at howNo Child Left Behind affects how principals spend their time, whichis probably their scarcest and easily their most valuable asset. Figure14 presents the relationship between status as a target of AYPidenti‹cation, status as an example of bottom-up charter schoolreforms, and the way in which principals allocate their time.33 One ofthe foundational assumptions of this analysis is that principals allo-cate this scarce resource as best they can in response to the continu-ally arising demands on their energy and efforts. As ‹gure 14 shows,principals in all three groups were much more likely to have spent agreat deal of time on administrative activities than any of the otherpolicy areas about which they were asked. That charter school princi-pals spent a great deal of time on administration is not surprising,given the enormous challenges of ‹nding a home for, organizing,and leading a brand-new school, but it does cast a bit of doubt on themost optimistic claims that charter school principals will be free of all

Top-Down and Bottom-Up 101

Page 29: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

administrative duties to focus on parents and curriculum. This ques-tion will be more easily addressed when there are large numbers ofcharter schools that have existed for longer periods of time.

The results show that charter school principals differed substan-tially from their counterparts in traditional public schools in spend-ing much more time facilitating their school’s mission and reachingout to their parent communities. Both of these differences are statis-tically signi‹cant and are consonant with what the effective schoolsresearchers called good leadership. Charter school principals alsospent less time supervising their faculty, a difference that was statisti-

102 N O C H I L D L E F T B E H I N D A N D T H E P U B L I C S C H O O L S

Fig. 14. Principals’ allocation of time. (Probabilities obtained using Clarify [seeKing, Tomz, and Wittenberg 2000]. Source: Minnesota Schools Survey 2003.Demographic and AYP data from Minnesota Department of Education 2003c,2003d, 2004a.)

Page 30: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

cally signi‹cant. The probabilities that either group would spend agreat deal of time on this activity, however, were so small that I didnot include it in ‹gure 14. Wilson suggests that coping organizationswill be characterized by adversarial manager-operator relationships:charter school principals may supervise their faculty less because theyfeel that they can do so.

With principals in regular public schools that failed to make AYP,the important story is partly what we see but mostly what we do notsee. Failure is not associated with a corresponding rededication tothose aspects of the principalship that increase test scores anddecrease the probability of future failure and sanction under NoChild Left Behind. Principals in regular public schools that failed tomake AYP are less focused on the school mission than those notidenti‹ed, a statistically signi‹cant difference. Neither the variablefor having failed to make AYP nor the variable indicating status asprincipal of charter school were signi‹cant in a regression on themean amount of time spent on all activities, indicating that differ-ences really exist in the patterns of time allocation; the ‹ndings donot show merely that principals feel more overwhelmed by thedemands of their jobs because of AYP failure or by the stresses asso-ciated with starting and operating a charter school.

Even the principals who expressed support for No Child LeftBehind in the follow-up interviews generally agreed that the law ledto a reallocation of their time and energy toward meeting the law’srequirements and away from other, perhaps more fundamental,aspects of their leadership. Again, such a change could be bene‹cial,if the law is measuring true quality. Given the ‹nite nature of theresource, some of this reallocation of time came at the expense ofother leadership areas, and while some came from the principals’personal lives. The principal of a metro-area middle school thatfailed to make AYP found the demands overwhelming:

NCLB has had a direct impact on my leadership at school. Ispend signi‹cant time out of the building, working with districtof‹ce personnel, understanding all the rami‹cations, inter-ventions, data, etc. . . . I also spend 12–14 hour days. . . . [I]t isafter 5:00 P.M. even as I write and I will be here for at least a 12

Top-Down and Bottom-Up 103

Page 31: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

hour day. . . . [T]here is much to do with little support. I spenda signi‹cant amount of time ensuring that my school is makingAYP. . . . I realize that in principle this is a wonderful thing . . .every child at grade level. However, I need a partner to take onsome of the “regular” principal business while I take this on.

Others—even those who favored the law—concurred with the senseof increased demands:

I am all for school improvement, using research based method-ology, and analyzing test data. Schools are not factories. WhenI hear the phrase “No Child Left Behind,” my staff and I cringe.For those of us from Minnesota, NCLB is a step backwards. Wespend way too much time testing, doing paperwork, and tryingto ‹gure out what we are suppose[d] to do. It has created morework for secretaries, business managers, paraprofessionals,teachers, and administrators. I’m talking hours.

I spend more time with data and accountability, yet have topull from my family to do it. The only way to keep up is to worklonger and longer. If this would lead to higher achievement, itmay be worthwhile. However, we need to have time workingwith the instructional aspects, too. We simply don’t have timeto hold teachers accountable for instruction.

Many of the things I already did as we have always strived to bea high performing school and embrace educational reform. Iwould estimate that exploring data takes at least extra 5 dayseach year. Testing takes about 10 days out of my year. Staffdevelopment issues consume another 3 days. [The] servicetime I spend and additional time writing the district Title grantadd another 10 days. Add additional state reports all in oneway or another tying into AYP it adds about 30 days time intotal taken away from other duties I used to perform. Some donot get done, some are shortchanged, and some I do by addingon to my day or year.

I am much more in tune with data about school performance.

104 N O C H I L D L E F T B E H I N D A N D T H E P U B L I C S C H O O L S

Page 32: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

I spend a lot of time sharing information about standards withmy staff and curriculum groups. It seems that I am always look-ing for explanations for what I consider or others could con-sider low performance, but trying not to use excuses. Publicrelations is a big deal.

The ‹rst thing the students hear on the radio and television ontesting days is “how are the students in your child’s school mea-suring up?” This year on one of the testing days I was bom-barded 5 times from the media about the day’s testing and howwell our school was doing before I got to school, and I liveacross the street from building. Now we have school reportcards handed out at the state fair!

Time is a ‹nite and scarce commodity. If we can be sure that ahigh-stakes testing policy is forcing this reallocation on the basis ofaccurate measures of the quality of educational production, then wecan be more optimistic. As I have shown, however, this is a highlydoubtful proposition.

Conclusions

Nothing in these analyses suggests that No Child Left Behind cannotwork, only that given its current assessment regime, it does not yetappear to be producing the kinds of positive leadership responsesthat it is designed to create. Principals in traditional public schoolsthat are not making AYP present very different patterns of leadershipand in›uence than their nonidenti‹ed counterparts, patterns thatsuggest effects on leadership that will make it less rather than morelikely for principals in identi‹ed schools to improve their perfor-mance. Of course, these ‹ndings do not mean that innovativeschools are doomed to fail under NCLB—good leaders will always tryto ‹nd ways to lead—only that the incentives structures currently inplace run counter to the goal of educational innovation.34

Principals in charter schools, also subject to the quality assess-ments of their parent communities, appear to be more focused onthose aspects of leadership that the effective schools literature has

Top-Down and Bottom-Up 105

Page 33: Top-Down and Bottom-Up - University of Michigan …implementation. In spite of charters’ involvement with both top-down and bottom-up reforms, however, the empirical literature has

shown to be associated with producing better quality in education. Ihave not been able to comment on the charter-school-speci‹c lead-ership consequences of No Child Left Behind. NCLB may produce adifferent, better bureaucratic response in charter schools thanappears to be the case in traditional public schools. The data fromMinnesota are not suf‹cient to refute this possibility. Given the highprobability of sanction for charter schools, however, NCLB wouldneed to induce or reinforce in charter school principals enough ofan increase in customer, curricular, and mission orientation to over-come the destructive implications of sanction—an unlikely prospect.Either time-series studies or well-chosen microlevel work will beneeded to con‹rm or refute the ‹ndings of these preliminary studies.

There is nothing inherently incompatible with top-down and bot-tom-up reforms in education; however, NCLB’s current require-ments do not properly align incentives and behaviors in the best waypossible. If being accountable to parents and having bureaucraticautonomy are bene‹cial, then there is no reason to withhold thesebene‹ts from the regular public schools and give them only to thecharter schools. This is where NCLB, properly conceived and exe-cuted, could be a powerful and positive force in educational reform.If we can incorporate assessments that motivate traditional publicschool principals to listen to their parent communities and if we candesign incentives to reward these principals for excellence withautonomy as well as resources, then we have the chance of making asystem that not only is top-down and bottom-up driven but also self-reinforcing rather than self-contradictory.

Charter schools represent only one means of creating a moreautonomous and responsive principalship, and they may not even bethe most promising way given the extraordinary challenges inherentin creating a new set of ‹nancially sound, stable, and excellentschools. As part of a state’s implementation of NCLB, a system couldbe created to identify outstanding public school principals, to betteralign their interests with those of their customers, and to providethem with the support needed to ful‹ll the critical ambitions of NoChild Left Behind.

106 N O C H I L D L E F T B E H I N D A N D T H E P U B L I C S C H O O L S