Tag: students

Presidential Cults

Glenn Greenwald, author of Cato’s much-discussed paper on the success of drug decriminalization in Portugal, writes about cults of presidential personality. He notes that Jay Nordlinger of National Review and other conservatives – not to mention a few libertarians – have criticized the Obama administration’s plan to broadcast a presidential speech into American schools and push teachers to post Obama quotes in their classrooms and encourage students to talk about how President Obama inspires them.

Greenwald never actually defends the Obama plan. But he does argue that conservatives have short memories when they say that this is something unique. In particular, he reminds us of the notorious Monica Goodling’s questions to job candidates at the George W. Bush Department of Justice, such as “[W]hat is it about George W. Bush that makes you want to serve him?” And also of White House political aide Sara Taylor, who told the Senate Judiciary Committee, “I took an oath to the president, and I take that oath very seriously.” Committee chairman Patrick Leahy had to ask her, “Did you mean, perhaps, you took an oath to the Constitution?”

Greenwald has a good point. Both the red and blue teams have been far too quick to succumb to a cult of presidential personality. (And really, swooning over Reagan or Obama is sort of understandable. But George W. Bush? You have to wonder if they worked really hard at creating a Bush cult because there wasn’t really much there.)

But I do see one difference: The Obama administration is trying to push its president-worship onto 50 million captive schoolchildren (not to mention using the NEA to enlist the nation’s artists in promoting Obama and his agenda). Goodling was asking people looking for government jobs why they wanted to “serve George W. Bush.” Now, sure, they should want to serve the public interest – and she was asking these questions to people seeking career legal positions as well as to political appointees. Still, it seems a smaller bit of cultishness than going into every public school.

Gene Healy wrote about cultishness by both Bush and Obama supporters here.

Author of the Private School Spending Study Responds

Bruce Baker, author of the study of private school spending about which I blogged yesterday, has responded to my critique. Dr. Baker thinks I should “learn to read.”

He takes special exception to my statement that he “makes no serious attempt to determine the extent of the bias [in his chosen sample of private schools], or to control for it.” Baker then points to the following one paragraph discussion in his 51 page paper that deals with sample bias, which I reproduce here in full [the corresponding table appears on a later page]:

The representativeness of the sample analyzed here can be roughly considered by comparing the pupil-teacher ratios to known national averages. For CAS and independent schools, the pupil-teacher ratio is similar between sample and national (see Figure 21, later in this report). Hebrew/Jewish day schools for which financial data were available had somewhat smaller ratios (suggesting smaller class sizes) than all Hebrew/Jewish day schools, indicating that the mean estimated expenditures for this group might be high. The differential, in the same direction, was even larger for the small group of Catholic schools for which financial data were available. For Montessori schools, however, ratios in the schools for which financial data were available were higher than for the group as a whole, suggesting that estimated mean expenditures might be low.

Even with my admittedly imperfect reading ability, I was able to navigate this paragraph. I did not consider it a serious attempt at dealing with the sample’s selection bias. I still don’t. In fact, it entirely misses the main source of bias. That bias does not stem chiefly from class size differences, it stems from the fact that religious schools need not file spending data with the IRS, and that the relatively few that do file IRS Form 990 (0.5% of Catholic schools!) have a very good reason for doing so: they’re trying harder to raise money from donors.  This is not just my own analysis, but also the analysis of a knowledgeable source within Guidestar (the organization from which Baker obtained the data), whose name and contact information I will share with Dr. Baker off-line if he would like to follow-up.

Obviously, schools that are trying harder to raise non-tuition revenue are likely to… raise more non-tuition revenue. That is the 800 pound flaming pink chihuahua in the middle of this dataset. According to the NCES, 80 percent of private school students are enrolled in religious schools (see p. 7), and this sample is extremely likely to suffer upward bias on spending by that overwhelming majority of private schools. They may spend the extra money on facilities, salaries, equipment, field trips, materials, or any number of other things apart from, or in addition to, smaller classes.

Baker’s study does not address this source of bias, and so can tell us nothing reliable about religious schools, or private schools in general, either nationally or in the regions it identifies. The only thing that the study tells us with any degree of confidence is that elite independent private schools, which make up a small share of the private education marketplace, are expensive. An uncontroversial finding.

It is surprising to me that this seemingly obvious point was also missed by several other scholars whose names appear in the frontmatter of the paper. This is yet another reminder to journalists: when you get a new and interesting paper, send it to a few other experts for comment (embargoed if you like) before writing it up. Doing so will usually lead to a much more interesting, and accurate, story.

Evidence-based for Thee, But Not for Me

One of the things that strikes me as curious about supporters of the No Child Left Behind Act is that they talk regularly about “evidence” and having everything be “research-based,” yet they often ignore or distort evidence in order to portray NCLB as a success. Case in point, an op-ed in today’s New York Times by the Brookings Institution’s Tom Loveless and the Fordham Foundation’s Michael Petrilli.

Truth be told, the piece doesn’t lionize NCLB, criticizing the law for encouraging schools to neglect high-performing students because its primary goal is to improve the performance of low achievers. Fair enough. The problem is, Loveless and Petrilli assert with great confidence that the law is definitely doing the job it was intended to do. “It is clear,” they write, “that No Child Left Behind is helping low-achieving students.”

As you shall see in a moment, that is an utterly unsustainable assertion according to the best available evidence we have: results from the National Assessment of Educational Progress, which carries no consequences for schools or states and, hence, is subject to very little gaming. Ironically, Loveless and Petrilli make their indefensible pronouncement while criticizing a study for failing to use NAEP in reaching its own conclusions about NCLB.

So what’s wrong with stating that NCLB is clearly helping low-achieving students? Let me count the ways (as I have done before):

  1. Numerous reforms, ranging from class-size reduction, to school choice, to new nutritional standards, have been occurring at the same time as NCLB. It is impossible to isolate which achievement changes are attributable to NCLB, and which to myriad other reforms
  2. As you will see in a moment, few NAEP score intervals start cleanly at the beginning of NCLB – which is itself a difficult thing to pinpoint – making it impossible to definitively attribute trends to the law
  3. When we look at gains on NAEP in many periods before NCLB, they were greater on a per-year basis than during NCLB. That means other things going on in education before NCLB were working just as well or better than things since the law’s enactment.

So let’s go to the scores. Below I have reproduced score trends for both the long-term and regular NAEP mathematics and reading exams. (The former is supposed to be an unchanging test and the latter subject to revision, though in practice both have been pretty consistent measures.) I have posted the per-year score increase or decreases above the segments that include NCLB (but that might also include years without NCLB). I have also posted score increases in pre-NCLB segments that saw greater improvements than segments including NCLB. (Note that on 8th-grade reading I didn’t highlight pre-NCLB segments with smaller score decreases than seen under NCLB. I didn’t want to celebrate backward movement in any era.)

For context, NCLB was signed into law in January 2002 but it took at least a year to get all the regulations written and more than that for the law to be fully implemented. As a result, I’ll leave it to the reader to decide whether 2002, 2003, or even 2004 should be the law’s starting point, noting only that this problem alone makes it impossible to say that NCLB clearly caused anything. In addition, notice that some of the biggest gains under NCLB are in periods that also include many non-NCLB years, making it impossible to confidently attribute those gains to NCLB.

Please note that I calculated per-year changes based on having data collected in the same way from start to end. So some lines are dashed and others solid (denoting changes in how some students were counted); I calculated changes based on start and end points for the type of line used for the period. I also rounded to one decimal point to save space. Finally, I apologize if this is hard to read—I’m no computer graphics wizard—and would direct you to NAEP’s website to check out the data for yourself.

4th Grade Regular Math

8th Grade Regular Math

4th Grade Regular Reading

8th Grade Regular Reading

Age 9 Long-term Math

Age 13 Long-term Math

Age 17 Long-term Math

Age 9 Long-term Reading

Age 13 Long-term Reading

Age 17 Long-term Reading

So what does the data show us? First, that there were numerous periods that didn’t include NCLB that saw greater or equal growth for low-achieving students as periods with NCLB. That means much of what we were doing before NCLB was apparently more effective than what we’ve been doing under NCLB, though it is impossible to tell from the data what any of those things are. In addition, it is notable that those periods with the greatest gains that include NCLB are typically the ones that also include non-NCLB years, such as 2000 to 2003 for 4th and 8th-grade math. That means there is inescapable doubt about what caused the gains in those periods most favorable to NCLB. And, let’s not forget, 4th -grade reading saw a downward trend from 2002 to 2003, and 8th-grade reading dropped from 2002-2005. That suggests that NCLB was actually decreasing scores for low-achievers, and one would have to acknowledge that if one were also inclined to give NCLB credit for all gains.

And so, the evidence is absolutely clear in one regard, but in the opposite direction of what Loveless and Petrilli suggest: One thing you definitely cannot say about NCLB is that it has clearly helped low achievers. And yet, they said it anyway!

New DOE Study: On-Line Learning Beats the Classroom Kind

The Dept. of Education has just released a study finding that (predominantly college-aged or older) students learn significantly more if their lessons occur at least partly on-line, than if they rack up seat-time exclusively in conventional classrooms (HT: Matt Ladner).

This makes sense. On-line learning usually allows students to progress at their own pace, so as soon as the student’s ready to move on to the next stage, she can. There’s no falling behind the rest of the class, or doodling in your notebook while you wait for them to catch up. So, like performance-based grouping and one-on-one instruction, it’s more efficient than the status quo, which lumps together students by age regardless of their knowledge or performance.

The great irony of this report is that it bears the name, in its frontmatter, of one Arne Duncan, secretary of education. Secretary Duncan had this to say shortly after taking office back in February: “If we accomplish one thing in the coming years, it should be to eliminate the extreme variation in standards across America.”

While the evidence presented by his own Department shows that greater student achievement comes from more individually customized on-line learning, Duncan’s diametrically opposed priority is to homogenize education so that every 10 year old is being taught the same things at the same time.

Fortunately, short of actually outlawing or invasively regulating on-line learning, there’s nothing that anyone can do to stop it from gradually displacing the old model, particularly for high school and older students.

DC Residents Want Private School Choice

As Adam Schaeffer mentions below, a new poll commissioned by the Friedman Foundation and others reports that the vast majority of DC residents are in favor of the DC opportunity scholarships voucher program and are critical of the decision of congressional Democrats, President Obama, and ed. sec. Arne Duncan to phase out the program.

Many on the city council have already voiced their support for the program as well.

This begs a question: Why doesn’t the DC government just create its own private school choice program and save itself a boatload of money in the process?

DC spends about $28,000 per pupil on k-12 education right now. The federal vouchers, at an average of $6,600 each, are rather more cost effective, in addition to producing much better academic achievement after students have been in the program for a few years. 

So most folks in DC want it. It would save the city massive amounts of money. And it would do great things for kids.

What are the mayor and the city council waiting for?

Does Watching Whales Make You a Better Teacher?

whale_watchingYears ago, talking with a public school teacher friend of mine at the end of the school year, she told me how excited she was about her impending orca whale watching outings in the San Juan Islands. Not only would it be a blast, but it would count as a continuing education credit (toward a master’s of education degree, as I recall) that would boost her salary substantially.

Normally, I bite my tongue in such situations. But before I could stop myself I blurted out the question: “Is watching whales going to make you a better teacher?”

The lack of any relationship between education master’s degrees and student achievement is acknowledged in a recent study from the Center for American Progress by Marguerite Roza and Raegen Miller.  In fact, Roza and Miller find that states waste $8.6 billion every year paying for master’s degrees that do nothing to improve student performance. Ironically, the state that offers the highest wage bump to teachers who obtain an M. Ed. ($10,777) is my home state of Washington.

Watching whales may not do much for your students, but it does wonders for your pocketbook. (HT: Joanne Jacobs)