Jukin' the Stats

I recently saw a billboard proclaiming that charter schools graduate 80% of their students.

Fans of The Wire are already familiar with the awesome phrase "jukin' the stats." And, as The Wire itself pointed out in Season 4, schools are no strangers to this phenomenon. The regular public schools in my district graduate just under 60% of their students. Do charter schools really graduate 20% more? Of course not.

These days in education, as in many other realms, data is king. Everyone has an almost blind allegiance to rationalism. Numbers don't lie, right? But, the thing is, numbers can lie. Public education reform policy is replete with ideas involving common-sense, easy-to-understand "data" that, beneath the surface, has very little validity.

Take, for example, the biggest thing that our Education Secretary Arne Duncan has been pushing in his Race to the Top agenda: evaluating teacher "performance" and "effectiveness" by using so-called "value-added" measures. The premise behind this program is that we can measure how "effective" a teacher has been by taking her students' scores on the state test at the beginning of the year and subtracting them from the scores on the test at the end of the year. Sounds simple, right? And of course, the next thing you know, newspapers like The L.A. Times and The New York Times are filing FOIA petitions to publish teachers' scores. The thing is, most statisticians will tell you that this method produces numbers for individual teachers that vary widely from year to year for the same teachers, have large margins of error, and are, basically, mostly bogus. In my own experience, what a student would have to score to show "gains" is within the margin of error of the test. In other words, if a student scored X in September, and needs to score Y in May, the student may actually score Y or X, give or take, taking the test in two consecutive weeks. Because most of the tests being used to get these scores don't even claim anywhere near that kind of accuracy for a student taking it just once. That means that "value added" actually only works--only actually tells you something significant--when you measure large groups of students and large groups of teachers over time, like a school's improvement over several years.

And then let's look at the premise of value-added itself: this is a method that assumes that children are vessels into which teachers can simply add more volume over the course of a year of teaching. Any real teacher or student of education knows that this is not what teaching and learning actually looks  like. The people who espouse this policy are essentially treating children as if they are so many widgets on an assembly line, a view of education that is now nearly a century old--as old as the assembly line itself. You can see this attitude in the language they use--talk of teacher "efficiency" and "productivity." These are simply code words for spending less money to educate more students. Those who say that teacher quality is "the most important factor" in a student's education really mean that it is the most important *school* factor. More than that, they also mean that it is the most cost-efficient factor, far more cost-efficient than, say, decreasing class size, which has been shown to be effective especially for urban minority and low-income students. In other words, the recent attacks on teachers and their unions is actually a movement to find the cheapest way to "save" public education.

And so this is where jukin' the stats leads us. To believe that there is an easy, common-sense way to fix public education, just like on The Wire the higher-ups want an easy, common-sense way to fix all of the problems of urban poverty--crime, the drug trade, schools, everything. But, if anything, we should be intensely suspicious of simple solutions and straightforward-seeming numbers. Teachers are, after all, professionals. Do people honestly think that millions of smart people who have been working on this problem for decades haven't thought of these simple solutions before?

Less Money Mo Problems

Many of the new education reformers will tell you that money doesn't matter. Right now, everyone tells you that teachers are the only factor that matters. The truth is, teachers are the biggest "in school" factor in student achievement. BUT, that doesn't mean that there aren't other "in school" factors. If money weren't a factor, then why would a wealthy suburban district outside my city spend 50% more per pupil than my urban district?* If they could do just as well while spending less, would they spend more? That's bad capitalism!

Of course, these numbers for expenditures per student don't factor in how much teachers spend of their own money on materials for their pupils. According to this CNN article, 97% of teachers report spending some of their own income on materials for their pupils, and, on average, they report spending $350 of their own money per year. That's $100 more than the maximum amount the federal government allows us to deduct from our taxable income. (And, by the way, when you have it written into your tax code that educators spend their own money on their students, shouldn't that tell you something is wrong?) So, our public education system is being funded in part (even if it's a small part) by the educators themselves. And if you believe that teachers are underpaid, then you will think that's a travesty. Of course, there are those out there that believe that teachers are overpaid.

Take my students, for example. They're always pointing out to me that I make money, and they don't. They're also always pointing out that all adults seem to get paid, which is way better, to their way of thinking, than not getting paid. I have a student who is writing a persuasive essay about why students should get paid for all the work they do studying in school. I routinely have students tell me that they don't need to pick things up off the floor because the custodial staff in our building is paid to clean. And, my favorite, this conversation I had, while passing out index cards to my students to make flashcards:

Me: You all do know that I buy these cards with my own money, right? I don't get money from the school to buy them. I buy them with my own money.
Student: Yeah, but you get money from the school.
Me: No, that's just what I'm saying. The school doesn't give me money to buy classroom supplies. I use my own money.
Student: Yeah, but the school pays you.
Me: Yes. They pay me. And I use that money to eat.


So, herewith, my list of emergency supplies that you absolutely must keep on hand for students:
-pencils
-pens
-notebook paper
-bandaids
-kleenex
-hand sanitizer
-healthy snacks for cranky first period students who eat hot chips for breakfast
-feminine hygiene products



*My district spends approximately $21,000 per student; the suburban district that boasts the #1 high school in the state spends $32,000 per student. These numbers are the sum of the average "instructional expenditures" and the "operational expenditures" per student, from the state report card.