Tag: schools

NAEP Math Scores, NCLB, and the Federal Government

I’m surprised anyone was surprised by the recent flat-lining of scores on the NAEP 4th grade math test. The rate of improvement in NAEP scores has been declining since No Child Left Behind was passed, and the recent results are consistent with that trend.

But what really amazes me is that so many people think the solution is just to tweak NCLB! The unstated assumption here is that federal policy is a key determinant of educational achievement. That’s rubbish.

We’ve spent $1.8 trillion on hundreds of different federal education programs since 1965, and guess what: at the end of high school, test scores are flat in both reading and math since 1970, and have actually declined slightly in science. (Charted for your viewing pleasure here).

If we’ve proved anything in the past 40 years, it is that federal involvement in education is a staggering waste of money.

Meanwhile, education economists have spent the last several decades finding out what actually does work in education. They’ve compared different kinds of school systems and it turns out that parent-driven, competitive education markets consistently outperform state monopoly school systems like ours. I tabulated the results in a recent peer-reviewed paper and they favor education markets over monopolies by a margin of 15 to 1.

So policymakers who actually care about improving educational outcomes should be spending their time and resources enacting laws that will bring free and competitive education markets within reach of all families. And they should be ignoring the education technocrats who – like Soviet central planners – just want to keep spending other people’s money tweaking their fruitless five year plans.

Why Is For-Profit Education So Difficult in the U.S.?

Matt Yglesias has a post up looking at the PISA scores, and he seems to imply that for-profit schooling has been tried and found wanting in Sweden and the U.S.:

The big difference is that many Swedish charters are run by for-profit firms. We’ve had some experiments with that in the U.S. and it hasn’t worked very well. Nobody’s really found a great way of making consistent profits running K-12 schools in America.

Of course even he notes that Sweden’s schools are highly regulated by the state.

And in the U.S., the difficulty of succeeding in for-profit education just might have something to do with that government monopoly on k-12 education and the $560 billion or so in tax revenues that fund it. Maybe.

Chart of the Day — Federal Ed Spending

The debate over No Child Left Behind re-authorization is upon us.

Except it isn’t.

In his recent speech kicking off the discussion, education secretary Arne Duncan asked not whether the central federal education law should be reauthorized, he merely asked how.

Let’s step back a bit, and examine why we should end federal intervention in (and spending on) our nation’s schools… in one thousand words or less:

Fed Spend Ach Pct Chg (Cato -- Andrew Coulson)

While the flat trend lines for overall achievement at the end of high school mask slight upticks for minority students (black students’ scores, for instance, rose by 3-5 percent of the 500 point NAEP score scale), even those modest gains aren’t attributable to federal spending. Almost that entire gain happened between 1980 and 1988, when federal spending per pupil declined.

And, in the twenty years since, the scores of African American students have drifted downard while federal spending has risen stratospherically.

Duncan’s NCLB Reauthorization Push Shows Extreme Tunnel Vision

In a major speech to be delivered today, education secretary Arne Duncan will call for an end to “ ‘tired arguments’ about education reform” and ask for input in crafting a ”sweeping reauthorization” of the federal No Child Left Behind act. His decision not to openly debate the merits of reauthorization – to simply assume it – guarantees the tiredness and futility of the discussion.

Americans have spent $1.85 trillion on federal education programs since 1965, and yet student achievement at the end of high school has stagnated while spending per pupil has more than doubled – after adjusting for inflation. The U.S. high school graduation rate and adult literacy rates have been declining for decades. The gap in achievement between children of high school dropouts and those of college graduates hasn’t budged by more than a percent or two despite countless federal programs aimed at closing it.

The secretary himself acknowledges that after more than half a century of direct and increasing federal involvement in schools, “we are still waiting for the day when every child in America has a high quality education that prepares him or her for the future.

In light of the abject and expensive failure of federal intrusion in America’s classrooms, it is irresponsible for the Secretary of Education to assume without debate that this intrusion should continue.  Cutting all federal k-12 education programs would result in a permanent $70 billion annual tax cut. Given the stimulative benefits of such a tax cut it is also fiscally irresponsible for the Obama administration to ignore the option of ending Congress’ fruitless meddling in American schools.

Repeat after Me: “We Are All Individuals”

A millennium or so ago, Steve Martin played a stadium with his stand-up act. He got the crowd of tens of thousands to repeat a series of statements in unison. My favorite, for sheer irony: “We Are all Individuals.”

But, the thing is, we are.

This is why I never cease to be amazed by disagreements like the one currently playing out between the curriculum groups “Common Core,” and “Partnership for 21st Century Skills.”

Is there really one curriculum that is right for every child in this nation of 300 million people? Really?

Rather than fighting a winner-take-all Shootout at the O.K. Curriculum, which is what our illustrious leaders seem to want, how about this peace-loving alternative: we let teachers teach whatever and however they want, and we let families choose and pay for whichever schools they think are best for their kids (with financial aid for those who need it).

‘Cause the thing is, a quarter century of econometric research is repeating, in Steve-Martin-Like unison that: educational freedom works.

From MSNBC to Cato — America’s Top Models

Next Sunday, MSNBC will feature a sort of townhall meeting on how great schools can pull kids out of poverty. Though headlined by Bill Cosby, perhaps the most electrifying panelist will be charter school principal Ben Chavis. On October 2nd at noon, you can come to Cato to see Ben live, and ask him how we can replicate his stunning success. Also joining us will be Washington Post columnist Jay Mathews, who’ll talk about the growing KIPP network of (now 82!) charter schools. Other than perhaps KIPP’s founders, nobody knows more about them than Jay. I’ll be simultaneously acting as cheerleader (I love these schools) and devil’s advocate (I’m skeptical that they can be brought to the masses within the charter sector).

To register, just visit the event page here:  “America’s Top Models: Can the Nation’s Best Charter Schools Be Brought to Scale?”

Incidentally, Ben has been called the most politically incorrect man in America, so Cato disavows all responsibility for any heads that explode during the course of his presentation.

Evidence-based for Thee, But Not for Me

One of the things that strikes me as curious about supporters of the No Child Left Behind Act is that they talk regularly about “evidence” and having everything be “research-based,” yet they often ignore or distort evidence in order to portray NCLB as a success. Case in point, an op-ed in today’s New York Times by the Brookings Institution’s Tom Loveless and the Fordham Foundation’s Michael Petrilli.

Truth be told, the piece doesn’t lionize NCLB, criticizing the law for encouraging schools to neglect high-performing students because its primary goal is to improve the performance of low achievers. Fair enough. The problem is, Loveless and Petrilli assert with great confidence that the law is definitely doing the job it was intended to do. “It is clear,” they write, “that No Child Left Behind is helping low-achieving students.”

As you shall see in a moment, that is an utterly unsustainable assertion according to the best available evidence we have: results from the National Assessment of Educational Progress, which carries no consequences for schools or states and, hence, is subject to very little gaming. Ironically, Loveless and Petrilli make their indefensible pronouncement while criticizing a study for failing to use NAEP in reaching its own conclusions about NCLB.

So what’s wrong with stating that NCLB is clearly helping low-achieving students? Let me count the ways (as I have done before):

  1. Numerous reforms, ranging from class-size reduction, to school choice, to new nutritional standards, have been occurring at the same time as NCLB. It is impossible to isolate which achievement changes are attributable to NCLB, and which to myriad other reforms
  2. As you will see in a moment, few NAEP score intervals start cleanly at the beginning of NCLB – which is itself a difficult thing to pinpoint – making it impossible to definitively attribute trends to the law
  3. When we look at gains on NAEP in many periods before NCLB, they were greater on a per-year basis than during NCLB. That means other things going on in education before NCLB were working just as well or better than things since the law’s enactment.

So let’s go to the scores. Below I have reproduced score trends for both the long-term and regular NAEP mathematics and reading exams. (The former is supposed to be an unchanging test and the latter subject to revision, though in practice both have been pretty consistent measures.) I have posted the per-year score increase or decreases above the segments that include NCLB (but that might also include years without NCLB). I have also posted score increases in pre-NCLB segments that saw greater improvements than segments including NCLB. (Note that on 8th-grade reading I didn’t highlight pre-NCLB segments with smaller score decreases than seen under NCLB. I didn’t want to celebrate backward movement in any era.)

For context, NCLB was signed into law in January 2002 but it took at least a year to get all the regulations written and more than that for the law to be fully implemented. As a result, I’ll leave it to the reader to decide whether 2002, 2003, or even 2004 should be the law’s starting point, noting only that this problem alone makes it impossible to say that NCLB clearly caused anything. In addition, notice that some of the biggest gains under NCLB are in periods that also include many non-NCLB years, making it impossible to confidently attribute those gains to NCLB.

Please note that I calculated per-year changes based on having data collected in the same way from start to end. So some lines are dashed and others solid (denoting changes in how some students were counted); I calculated changes based on start and end points for the type of line used for the period. I also rounded to one decimal point to save space. Finally, I apologize if this is hard to read—I’m no computer graphics wizard—and would direct you to NAEP’s website to check out the data for yourself.

4th Grade Regular Math

8th Grade Regular Math

4th Grade Regular Reading

8th Grade Regular Reading

Age 9 Long-term Math

Age 13 Long-term Math

Age 17 Long-term Math

Age 9 Long-term Reading

Age 13 Long-term Reading

Age 17 Long-term Reading

So what does the data show us? First, that there were numerous periods that didn’t include NCLB that saw greater or equal growth for low-achieving students as periods with NCLB. That means much of what we were doing before NCLB was apparently more effective than what we’ve been doing under NCLB, though it is impossible to tell from the data what any of those things are. In addition, it is notable that those periods with the greatest gains that include NCLB are typically the ones that also include non-NCLB years, such as 2000 to 2003 for 4th and 8th-grade math. That means there is inescapable doubt about what caused the gains in those periods most favorable to NCLB. And, let’s not forget, 4th -grade reading saw a downward trend from 2002 to 2003, and 8th-grade reading dropped from 2002-2005. That suggests that NCLB was actually decreasing scores for low-achievers, and one would have to acknowledge that if one were also inclined to give NCLB credit for all gains.

And so, the evidence is absolutely clear in one regard, but in the opposite direction of what Loveless and Petrilli suggest: One thing you definitely cannot say about NCLB is that it has clearly helped low achievers. And yet, they said it anyway!