standardized tests

Want Accountability in Education? Empower Parents

The selection of Betsy DeVos for Secretary of Education has exposed longstanding tensions among education reformers who are united in their support for expanding educational choice but divided over the government’s role in regulating such programs.

The schism is often portrayed as being between those who support or reject “accountability,” but this isn’t quite accurate. The real disagreement is not whether there should be accountability, but to whom schools should be held accountable: parents or bureaucrats. As Lindsey Burke and I argue in a new report published by the Heritage Foundation and the Texas Public Policy Foundation, educational choice programs like education savings accounts should place the accountability for academic outcomes with parents.

For decades, the term “accountability” primarily referred, in education policy circles, to government regulations intended to ensure quality. That’s because most children attend their assigned district schools, which are not directly answerable to parents and function as de facto monopolies. As Lindsey and I explain:

A distinctive feature of monopolies is lack of accountability. Because district schools are not held directly accountable to parents, some policymakers have attempted to impose accountability through top-down government regulations. Yet decades of attempts to regulate district schools into quality have had little effect. Unfortunately, too many policymakers have still come to see centralized government regulations as synonymous with “accountability” rather than an inferior alternative to direct accountability to parents, and have therefore sought to impose similar regulations on choice programs. However, regulations designed for a monopoly system are inappropriate for a market-based system.

In a market-based system, producers are held directly accountable to consumers for results. The government sets certain rules against fraud or health and safety standards, but the consumers ultimately decide whether a product or service meets their needs. Likewise, the government could ensure that ESA funds are spent on qualifying educational products and services, but the accountability for results should lie with parents, who are in the best position to evaluate those results. Holding education providers directly accountable to parents creates a feedback loop that does not exist in more centralized, top-down systems like the district schools. As social scientist Yuval Levin has argued, this enables the system to “channel social knowledge from the bottom up rather than…impose technical knowledge from the top down.” This channeling is accomplished “through a process of experimentation, evaluation, and evolution.”

If we want an education system that makes significant improvements in quality over time, education providers must be free to innovate and parents must be free to choose the providers that work best for their own children. This system evolves over time because higher-quality providers will attract more parents and lower-quality providers will face pressure to either improve or shut down.

However, technocratic attempts to guarantee quality through imposing uniform standards can interrupt this evolutionary process.

The Price of Technocratic Accountability

The technocratic approach to accountability requires that all schools are judged according to uniform metrics, therefore the technocrats rely heavily (indeed, almost exclusively) on standardized test scores, particularly in math and language arts. The technocratic reformers want to use these scores to set a minimum standard, meaning “underperforming” schools would be excluded from receiving voucher funds–or, in the case of charter schools, be shut down entirely–even against the will of parents who still want to enroll their children there.

Let us be clear about what is at stake. The technocratic approach would eliminate a family’s least-bad educational alternative, leaving children worse off “for their own good.” For example, parents may have chosen a private or charter school that did not perform well on the state’s standardized test overall, but the school may have provided a safer environment than the local district school. Or perhaps the school was succeeding at its mission to aid the most at-risk students, but the state’s uniform “accountability” system failed to take its mission into account. The damage done to children who lose the opportunity to attend schools that their parents believe are better than the alternative is incalculable.

We should also be realistic about the unintended consequences of over-reliance on test scores. Although standardized tests can provide parents with useful information about their child’s academic performance, using them to impose uniform standards that so narrowly define “quality” creates perverse incentives that narrow the curriculum, stifle innovation, and can drive away quality schools from participating in the choice program. As Lindsey and I explain:

When schools are rewarded or punished based on their students’ performance on math and reading tests, they have a strong incentive to divert their time and resources to tested subjects and away from others. A study by the Center on Education Policy found that the time district schools spent on subjects besides math and reading declined considerably after Congress enacted the No Child Left Behind Act (NLCB), which mandated that states require district schools to administer the state standardized math and reading tests in grades three through eight and report the results. In the five years after NCLB was implemented, approximately 62 percent of elementary district schools reported increasing the amount of time spent on English language arts and/or math, and 44 percent reported decreasing time spent on social studies, science, art and music, physical education, lunch, or recess.

The narrowing curriculum is particularly alarming because, as Jay P. Greene has noted, recent research has found that “later success in math, reading, and science depends on early acquisition of the kind of ‘general knowledge’ and fine-motor skills learned through art and other subjects.” In other words, a narrower curriculum not only deprives students of having a broader and more enriching education, but also negatively impacts their performance in the tested subjects. “If we narrow education to the mechanics of math and reading as captured by yearly testing,” Greene concludes, “we short-change the broader knowledge that is the key to academic success later.”

Mandating a single test exacerbates this phenomenon. Within the tested subjects, schools have a strong incentive to teach the concepts that will be on the mandated test. This incentive to “teach to the test” can result in a de facto curriculum. For example, if a school had been teaching math concepts A, B, and C in grade 7, but the new state test was going to cover concepts B, D, and E, the school would almost certainly drop concepts A and C in favor of D and E, even if the math teachers believe that the original curriculum was superior. Keeping the original curriculum would put their students at a disadvantage on the state test vis-à-vis students at other schools that had aligned their curriculum to the test. This standardization might make sense in a world in which there was one right way to teach math, or at least one right order to teach concepts, but that is not the case.

Again, this isn’t to say that we should do away with testing entirely. As Robert Pondiscio recently wrote, standardized tests should be “used to illuminate and inform parent choice, but not to limit it.” Tests can provide valuable information, but using the tests as the sole or primary metric of performance does more harm than good. What’s needed is a more comprehensive understanding of quality that considers the needs of individual students, not just the “typical” student, and that’s something that parents are in a much better position to determine than technocrats.

The Common Coring of Private Schools

Today, the Fordham Institute released a “policy toolkit” proposing private schools be required to administer state tests to all students participating in a school choice program, and publicize the results. Private schools that the state deemed persistently underperforming would be expelled from the program. Fordham argues that such measures have the potential to raise student achievement and provide parents with the information needed to make better decisions about their children’s education. Though Fordham’s plan is well-intentioned, their justifications are unpersuasive and their proposal is more likely to do harm than good.

Little Evidence to Support a Testing Mandate for Private Schools

First, there is scant evidence to support Fordham’s claim that test-based accountability measures “may boost student achievement.” Fordham rests its claim on the results of but a single year in a single study of a single school choice program: the final year of the School Choice Demonstration Project’s five-year analysis of the Milwaukee voucher program.

During the first four years of the study, voucher students took a low-stakes test, but in the final year of the study, policymakers increased the stakes by mandating that the test results be publicized and the scores improved. Fordham argues that this proves that high-stakes testing improves performance but one of the study’s authors, Dr. Patrick Wolf of the University of Arkansas, has previously cautioned the Fordham Institute against reading too much into that finding, calling it “enticing and suggestive but hardly conclusive”:

As we point out in the report, it is entirely possible that the surge in the test scores of the voucher students was a “one-off” due to a greater focus of the voucher schools on test preparation and test-taking strategies that year.  In other words, by taking the standardized testing seriously in that final year, the schools simply may have produced a truer measure of student’s actual (better) performance all along, not necessarily a signal that they actually learned a lot more in the one year under the new accountability regime.

But even if the was no question that the higher test scores actually reflected increased performance, it would still only be one study. When Fordham cited this study as support for its proposal six months ago, Andrew J. Coulson responded:

A single study, no matter how carefully executed, is not a scientific basis for policy. Because a single study is not science. Science is a process of making and testing falsifiable predictions. It is about patterns of evidence. Bodies of evidence. Fordham offers only a toe.

By contrast, there is a significant body of evidence that school choice programs work without Fordham’s sought-after government regulation. Of twelve randomized controlled trials—the gold standard of social science research—eleven found that school choice programs improve outcomes for some or all students while only one found no statistically significant difference and none found a negative impact. None of these school choice programs studied were designed along the lines of the Fordham proposal.

In fact, Fordham’s preferred policy is undermined by a large body of evidence. A 2009 literature review of the within-country studies comparing outcomes among different types of school systems worldwide revealed that the most market-like and least regulated education systems tended to produce student outcomes superior to more heavily regulated systems, including those with a substantial number state-funded and regulated private schools. In short, the best form of accountability is directly to parents, not government bureaucrats and their tests.

Subscribe to RSS - standardized tests