Tags
api scores, John Deasy, magnet schools, reconstitution, Robert Felner, statistics, University of Louisville
Share it
I listened to LAUSD’s head honcho call himself a “numbers guy” recently: “…mathematics, chemistry, physics – I get that; I’m a numbers guy”. With breath-taking self-righteousness for one with such shady academic credentials, he asserts the common, insidious mistake of believing that just because some concept is quantified it holds inherent meaning.
Sure, numbers can be manipulated. And mathematical models can be built to parse its constituent components. That’s what statisticians do – they try to identify all the bits that together compose reality.
But those constituent components – which are just numbers – have to themselves have some tie to reality. Without knowing what a number represents – what it measures, how and why – without that backward tie to reality, any mathematical modeling has no practical interpretation, no meaning.
So numbers guys can do all the numbers-manipulation they want, all the mathematical modeling and calculating that so intimidates far too many. But in the end the interpretation of numbers that do not measure a parameter accurately, amounts to just so much magical thinking.
And therein lies the difference between a numbers guy, who admires numbers for their purity alone, and a statistician, who searches for a valid mathematical argument to capture reality. And, by the way, it is the difference between these two that provides cover for the public’s disdain for statistics. (Ethical) Statisticians do not lie with numbers, people with statistical software do.
Of course this all matters, a lot. When the entire enterprise of a school, including its “permission” to expand, its teachers’ livelihood, its students’ educational future, its community’s integrity — when all this is dependent on some one number like, say, API or a “proficiency” score improvement over a short period of time, that number had better represent some clear, uncontroversial metric of excellence.
But it doesn’t. It is folly to attribute a false degree of objectivity to an undertaking as inherently subjective and transcendental as ‘Education’. Else, one day you awaken to discover the educational landscape revolutionized, and to no good end.
8 Comments
May 31, 2013 at 8:39 pm
Reblogged this on News & Notes on LEADERSHIP for LEARNING.
May 29, 2013 at 8:48 am
It is of course a misnomer to call this “data-driven decision-making” when these data-driveling cargo cultists violate every standard of practice in the valid use of measurement.
But I suppose it will take the entire field of qualified data professionals rising up in unified protest to prevent these carpet-bagging bunko artists from giving their profession the bad name it is getting today.
In the mean time, Phrenology will have its revival, and the Great Dumbing Down will continue …
May 29, 2013 at 8:57 am
Dr. Ravitch pointed to this article some time ago: http://www.ams.org/notices/201105/rtx110500667p.pdf
I wish more statisticians would take note. For far too long educational research has enjoyed peerless review with devastating consequences to our children, our schools, our society, our democracy.
May 29, 2013 at 9:21 am
Data-Driven-Distraction is what it should be called!
May 29, 2013 at 8:09 am
The ed reformers I know take their quantitative ethos not from scientists but from the financial industry. The people they went to college with whom they describe as “really smart people” are the investment bank vp’s and hedge fund managers who got rich and who fund their ed projects. (The backstory to that social dynamic is the way that the financial industry since the ’80s has become the leading career choice for elite STEM grads.) The thing is, the financial industry is the place where numbers have the least complex meaning of all: money. In that world, if the numbers come out right, you have the money, and you don’t have to think about other dynamics underlying the process. Money is the illusion of “inherent meaning” in numbers that we all live with. I think the “data-driven” reformers bring that degree of thoughtless abstraction to ed policy because in their world it defines success.
May 29, 2013 at 8:33 am
Bingo. Couldn’t possibly have said it any better. Thank you.
May 29, 2013 at 7:39 am
Very eloquent! Thank you for putting words on this subject.