News, data and conversation
about schools in New York City.
WNYC’s participation is supported by

No Way Out of the Evaluation Trap

13 Comments
Respond

Feb. 27, 2012, 4:40 p.m.

Arthur Goldstein

Believe it or not, I wake up every morning eager to go to work. I never know what’s going to happen in my classes, but I invariably look forward to them. My students never fail to surprise me. I feel privileged to introduce newcomers to my language. But now, if they don’t pass tests likely designed for English speakers, I face losing my job.

This is particularly disturbing because I see patterns, especially among kids who did not actually want to be uprooted, torn away from their friends, family and quite often even their parents. I had several students last year who spoke almost no English, and learned next to nothing the entire year. When I checked their records, I learned that two of them had not only passed junior high English classes (not E.S.L., but regular English), but had also passed Spanish.

Without my crystal ball I can only speculate on how they managed this. But it doesn’t take a genius to figure out that their value-added scores would not have put me in a favorable light. Under New York State’s new paradigm, two years of kids like that would leave me selling pencils on the corner.

Yet stats will not show two kids I have this year who have turned around. One young man sits in front of my class (full disclosure — I forced him to) and now participates every day. He’s not my best student. He’s always joking. On the brighter side, he’s not only pretty funny sometimes, but he’s also learning rapidly. He now has every chance of graduating high school, and his life prospects are much improved over those of someone who doesn’t know any English.

Another student who failed my class last year faced the unhappy prospect of moving back into my class again. “I don’t want to go there,” she told the counselor, “He always makes you talk.” But she’s now grasping everything that eluded her last year. Also, she’s happy. I see her smile every day, from wherever in the classroom I happen to be.

Did I fail these kids last year? Maybe I did. But I spoke to them, cajoled them, threatened them, contacted their counselors and called their homes repeatedly. I try everything I can think of, and sometimes I fail. Does this mean my name ought to be on page 3 of The New York Post as a poster boy for everything wrong with education?

These days, that’s something every New York teacher needs to worry about. You’ve probably heard that New York State is on the verge of a brand new teacher evaluation system. Gov. Andrew M. Cuomo calls it a balanced system, one that relies on multiple measures, including observation and student test scores.

That’s because student test scores are used to determine 40 percent of the rating. However, anyone who doesn’t succeed in this area is rated ineffective. Many are now pointing out that 40 percent of “objective measures” can magically equal 100 percent.

Resultant feedback after two ineffective ratings may include things like, “Get lost,” “You’re toast,” or “Take a long walk off a short pier.”

Perhaps as this happens Mr. Cuomo will take solace in knowing New York state will be paying considerably less in pensions.

The “reformers” who shout the virtues of this new plan from the rooftops ought not to be so comfortable. As far as I can tell, since bad test scores can afflict even excellent teachers, teacher dismissals can occur utterly at random. So while the district might be able to pick off big mouth pain in the neck unionists (like me), they could just as easily end up firing members of Educators for Excellence, which happily backs every darn “reform” that comes down the pike.

There are, in fact, multiple issues with value-added measures that tie teacher ratings to student performance. They have wild margins of error, and many things kids do are well out of the control of teachers who see them 40 minutes a day.

In fact, the New York Post education reporter Yoav Gonen tweeted that margins of error on recently released teacher data reports ran as high as 87 percent. Diane Ravitch pointed out that odds were worse than a coin toss. Nonetheless, my union has agreed to make them part of the evaluation system.

Maybe I should stop volunteering to teach beginners and dump them on rookie teachers. Rookies often get the toughest classes. The thinking behind this is rookies can’t teach, and these classes can’t learn, so they’re perfect together. So what if we ruin a few teaching careers before they even start?

Beyond value-added, administrators, even principals, are human, subject to all the frailties and weaknesses that afflict all of us. Believe it or not, some take a personal dislike to certain teachers, for reasons in no way related to their teaching abilities. And some take things so far as to give these teachers poor ratings. As I am a public and vocal critic of Mayor Michael R. Bloomberg’s administration, this concerns me in no small way.

If I’m a terrible teacher, fine. Give me a bad rating. But when I advocate for kids, smaller class sizes, reasonable standards for high-needs students, classrooms instead of trailers, or kids eating lunch at noon rather than 9 a.m., that’s no reason to question my teaching. Nor is the fact that, as U.F.T. chapter leader, I represent each and every working teacher in my school. My colleague received a poor rating for doing his job as chapter leader, and had to go to court at his own expense to have that rating reversed.

This ought to be enough to prove that principals are not infallible. Yet in New York City, only 13 percent of poorly rated teachers will have the opportunity to go to a mutually agreed-upon independent arbitrator.

Considering this, teachers may be reluctant to speak up for themselves, let alone kids. They’ll be subject to arbitrary dismissal from not only junk science like value-added, but from small-minded vindictive administrators as well.

I want strong, smart role models for my kid and yours. Mr. Bloomberg, it appears, does not.

Arthur Goldstein is an E.S.L. teacher and United Federation of Teachers chapter leader at Francis Lewis High School in Queens.

13 Comments

Respond
Picture?type=square
John Elfrank-Dana February 27, 2012, 11:21 PM

Don't worry Art, the UFT will offer you a position- NOT! ;)
Isn't Leo ever going to retire?

Add Reply
Picture?type=square
Zulma Villalba February 28, 2012, 12:13 AM

Another great article that speaks volume of truth. Arthur is the "big mouth pain in the neck unionists (like me)' that is needed in every school and many chapter leaders have been rated unfairly for their “big mouth” against injustice and unfairness. The mayor does not want teachers to speak against the TDRs and its Grand Canyon wide margin of error and the new teacher evaluation, which can end a teacher's career in two years. I want to thank Arthur because I, too, am proud of being a ""big mouth pain in the neck unionists". At times, my mouth does get pretty big and loud when it is time for me to speak.

I would like to say that teachers should look forward to being in their classrooms and waiting for the unexpected, yet pleasant surprises from their students. That’s the joy of teaching, knowing the students, having the unexpected and seeing them grow in class. We should not dread teaching; it would seem, to me, unfortunate to have those feelings. But, Arthur brought it out, why should he take beginners, why should any experienced teacher take those students that bring such challenges?

Teachers take those types of students because they care. That's what teaching is all about.

1 Reply
Picture?type=square
Arthur Goldstein February 28, 2012, 10:40 AM

You're right Zulma, and it gets worse. Why would teachers tutor students who aren't theirs when it may end up hurting their standings? Why would teachers help out by taking kids who don't get along with other teachers, for whatever reason? Why would anyone take on a student teacher, ever, and place test results at risk? This is not the sort of culture we want in education, and regrettably, the politicians seem neither to know nor care.

Add Reply
Picture?type=square
Buddy Bronx February 28, 2012, 9:38 AM

The future teacher evaluations could backfire across the state of New York. Let's pretend I am a young teacher working for the NYC DOE for a few years. My pay is low, I lack the needed supplies to do my job, working conditons are poor, I am insulted by my so called leaders regularly, and I have not received a pay raise in years. When I receive my evaluation report I find that I am in the top 25% for teacher effectiveness. I realize that this high effectiveness rating is my ticket out of the working for the City. Rather than remaining with the City, I find the hiring superintendents in the wealthier, higher paying suburbs are actually looking for the best teaching talent and are offering a much higher salary to applicants who have a proven record of classroom effective instruction. For that young, bright, energetic, and talented NYC teacher, the evaluations are his/her ticket out of the NYC DOE. The result of this scenario is devastating for our inner city students. The City and other large towns across the State may end up loosing the most talented instructors. Just the opposite of what was hoped for by all! Again, the inner city chidren and our New York City education system will suffer the consequences.

Add Reply
Picture?type=square
Rudy Kipper February 28, 2012, 11:58 AM

Mentioned briefly is the "savings" due to teacher turnover. As shortsighted as this may be, I do believe politicians look at pension reduction.
What troubles me even more is that NO ONE has said how much the testing, scoring, lost clasroom time, reviwing, purchasing tests, purchasing scoring systems, analyzing the information actually costs AND who is really getting the money. The companies who produce such materials and systems are the ONLY winners and they win big time. Tis is costing far more than $700 millions and no one even recognizes that this is really what it is ALL ABOUT- in politics, it always has been and always will be.
Next step- charter schools for all! The destruction of public education.

Add Reply
Picture?type=square
Vicki Zunitch February 29, 2012, 5:45 AM

Dear Big Mouth Pain in the Neck Unionist, Keep It Up. Signed, Big Mouth Pain in the Neck Citizen and Parent, or, as DOE Functionaries called me: "Somebody Who Has Nothing to Do With Anything! A Parent!"

Add Reply
Picture?type=square
Michael Rosenthal February 27, 2012, 10:22 PM

Another real problem which I have posted elsewhere is the more direct perverse incentive. Now teachers that refuse to game the system by cheating, "scrubbing" exams to find extra points, guide students inappropriately during the test and other unethical moves will be at a severe disadvantage. Those teachers who commit those act and who are very rarely caught will ruin the curve for those teachers who won't commit those acts. What you will be left with are unethical, ineffective teachers who are effective and cheating and you will lose effective teachers who want to model moral behavior to our next generation.

1 Reply
Picture?type=square
Dave Greene February 27, 2012, 11:56 PM

Arthur, I applaud you. You are 100% spot on. Where are the other brave souls ready to tell it like it is.

We also have to look at the hidden political-economic agendas.

Mayors and governors like Bloomberg and Cuomo are seeking to establish themselves as powerful leaders by branding themselves as budget. Leadership has become so debased as to have become budget management. Poll results rise and fall with their ability to say "I got more done for less $." I slashed the education budget and got rid of bad teachers... therefore, I improved education." Maybe Cuomo can run for President on that line.

He and others like him may succeed in doing some of that...by slashing pensions because good and great teachers will leave the system earlier to avoid this crap. Younger teachers will resign before they are vested in the pension. More lowered costs. Average salaries will decrease because the average age of teachers will drop to the late 20's or early 30's. Who would stay more than 10 years? More lower costs.

What are the consequences (intended and unintended) of these actions. What are the costs? Ultimately the opportunity costs in making these economic decisions will be the lives of the students they said they were trying to improve.

How can they believe their own hype? How can so many NYers believe it? How can so many Americans believe it? Are we that ignorant? That naive? Maybe too many of us didn't listen to the good teachers who taught them to QUESTION authority, not blindly follow it like lemmings calmly walking off a cliff.

Add Reply
Picture?type=square
Rick Archer February 27, 2012, 11:44 PM

Michael,
So in other words, the only teacher left will be like politicians? Right.

Add Reply
Picture?type=square
Dave Greene February 28, 2012, 12:09 AM

Mayors and governors like Bloomberg and Cuomo are seeking to establish themselves as powerful leaders by branding themselves as budget. Leadership has become so debased as to have become budget management. Poll results rise and fall with their ability to say "I got more done for less $." I slashed the education budget and got rid of bad teachers... therefore, I improved education." Maybe Cuomo can run for President on that line.

He and others like him may succeed in doing some of that...by slashing pensions because good and great teachers will leave the system earlier to avoid this crap. Younger teachers will resign before they are vested in the pension. More lowered costs. Average salaries will decrease because the average age of teachers will drop to the late 20's or early 30's. Who would stay more than 10 years? More lower costs.

What are the consequences (intended and unintended) of these actions. What are the costs? Ultimately the opportunity costs in making these economic decisions will be the lives of the students they said they were trying to improve.

How can they believe their own hype? How can so many NYers believe it? How can so many Americans believe it? Are we that ignorant? That naive? Maybe too many of us didn't listen to the good teachers who taught us to QUESTION authority, not blindly follow it like lemmings calmly walking off a cliff.

Add Reply
Picture?type=square
Wendy Waczek February 28, 2012, 2:26 AM

Brilliant and so true. I am going to start using your terminology - value added to describe what really happens in schools. I keep telling those who don't work in schools that if we post teacher evaluations to the general public, we should post the student grades on standardized tests as well as their attendance records. For those who want transparency, let there be transparency. While we are at it, publish the emails of administrators.

Add Reply
Picture?type=square
Jonathan Hollinger February 28, 2012, 2:27 AM

The actual data with graphs is at http://teachrate.com

Add Reply
Picture?type=square
Rachel Anderson February 28, 2012, 3:40 AM

Amen! Thank you for saying exactly what we're feeling!

Add Reply
Picture?type=square
Arthur Goldstein February 29, 2012, 10:53 AM

Thanks for the encouragement, and for your great comment!

Add Reply
Picture?type=square
Jay Taylor February 29, 2012, 2:41 PM

"But it doesn’t take a genius to figure out that their value-added scores would not have put me in a favorable light"

Actually, you are incorrect. It would take a genius to determine this, from the information you've given. The only way to determine your value-added is to compare you to other ESL teachers who teach students with similar demographics. One cannot tell by the value of a student's test score, be it good or bad, whether a teacher is "effective". Value-added methods compare you with other teachers in your group, and also adjust for your students past performance. If you teach students who fail to improve year after year, and yet they improve one quarter of a grade level during the year they are with you - guess what - you are a great teacher. On the other hand, if you teach geniuses who typically make a year and a half's progress during their school year, and yet they only make a year's progress in your class - guess what - you are a poor teacher.

The only way a teacher's value-added score could be worse than a coin toss is if the value-added score was anti-correlated with the teacher's true ability. But there's the rub, there is no "gold standard" to measure a teacher's true ability. Many in the teaching profession would have us observe teachers to determine if they are using accepted teaching methods, but this doesn't measure the student's learning, it measures the teacher's behavior.

Finally, the uncertainties associated with the NYC value-added scores vary by teacher, according to the number of students they've taught, which in turn is a function of class size, years teaching, and number of classes. Some teachers have uncertainties much smaller than the average. These teachers can be classified more easily as either effective or ineffective. Can we agree that a teacher at the 1st percentile, with a confidence interval of 10 percentiles, is very likely in need of improvement? And that if they don't improve over the following year, they should perhaps consider that teaching is not their forte?

Add Reply
Add a Response
SchoolBook Bulletin Board
Welcome to SchoolBook

Schoolbook is a site dedicated to news, data and conversation about schools in New York City.

Have a News Tip?

Tell us what’s going on in your school. You can e-mail us with your tips or documents, or call 646-801-9698 and leave a voice message.

Contribute to Current & Future News Coverage

Join the Public Insight Network and help our journalists cover education in the city. Your stories and insights can help us create relevant and distinctive reporting. Join more than 100,000 people and become a trusted source.