Swap “Doctor” for” Teacher”

>
By  |  February 25, 2012 | 

If you have not heard, the NYC Dept. of Education released a report card assessing all of its 18,000 teachers.  It is making a lot of noise, particularly here in the city.  Read the story, regardless of where you live–it is interesting and a policy exercise that is no doubt, coming to a theater near you.

What is striking, and I allude to it in my title, is the resemblance of the arguments here, as compared to those made by the physician community.  The CMS ratings site will ramp up with substantive data in the upcoming decade, and the same fears of inadequate adjustment, sample size, and inaccurate information are front and center:

In simple terms, value-added models use mathematical formulas to predict how a group of students will do on each year’s tests based on their scores from the previous year, while accounting for factors that include race, gender, income level and other test results. If the students surpass expectations, their teacher is rated well — “above average” or “high” under New York’s models. If they fall short, the teacher is rated “below average” or “low.”

What many teachers point out is that the scores cannot account for many other factors: distractions on test day; supportive parents or tutors; allergies; a dog continually barking near the test site. There are also schools where students are taught by more than one teacher, making it hard to discern individual contributions. (The reports released by the city gave the same rankings to those teachers.)

Additionally, the curve and presentation don’t differ much from hospitalcompare.gov, oddly enough:

In New York, the ratings cover teachers in fourth through eighth grades, because of when state tests are given. They are distributed on a curve, so that for 2009-10, 50 percent of teachers were ranked “average”; 20 percent each “above average” and “below average”; and 5 percent each “high” and “low.”

The question is what to make of this.  On one hand, transparency is ideal, and on its face, the public clamors for it.  On the other, in a rush to judgment, are we promoting tools that are not ready for prime time?  My gut tells me the top and bottom 5% “outliers” are there for a reason; assess these folks with rigor and make the appropriate decisions (I assume this is automatic).  Otherwise, be damn careful.  It does seem ironic that a city official makes the quote below in the context of this publication.  It is cautionary, and a good conclusion for the post:

“The purpose of these reports is not to look at any individual score in isolation, ever,” Shael Polakow-Suransky, the No. 2 official in the city’s Education Department, said Friday. “No principal would ever make a decision on this score alone, and we would never invite anyone — parents, reporters, principals, teachers — to draw a conclusion based on this score alone.”

Do you find that credible?  Are you watching the news, the primaries, or popular culture play out in the media.  Call me a cynic, but I do not believe it.  The public loves ratings, including me, but with the imprimatur of a sanctioned distribution, these data just received the “Consumer Reports” stamp of approval.  Lets see if teachers (and doctors) perform like toaster ovens.

UPDATE: And here is the blowback response from the UFT president.  A future AMA president is taking notes. 🙂

 

 

 

 

Share This Post

2 Comments

  1. Jack Percelay February 25, 2012 at 2:31 pm - Reply

    Brad,
    Typically well written and insightful. I’ll confess, as a New Yorker listening to this on the news last night, I tended to dismiss the teachers’ concerns. But making the swap you suggested, I am more receptive to the teachers’ points, more concerned that public reporting of physician performance will suffer from the same pitfalls, and more convinced that the public will fail to appreciate the complexity of this entire process.

  2. […] Posted 2/25/12 on the Hospitalist Leader […]

Leave A Comment

For security, use of Google's reCAPTCHA service is required which is subject to the Google Privacy Policy and Terms of Use.

About the Author: Bradley Flansbaum

Bradley Flansbaum, DO, MPH, MHM works for Geisinger Health System in Danville, PA in both the divisions of hospital medicine and population health. He began working as a hospitalist in 1996, at the inception of the hospital medicine movement. He is a founding member of the Society of Hospital Medicine and served as a board member and officer. He speaks nationally in promoting hospital medicine and has presented at many statewide meetings and conferences. He is also actively involved in house staff education. Currently, he serves on the SHM Public Policy Committee and has an interest in payment policy, healthcare market competition, health disparities, cost-effectiveness analysis, and pain and palliative care. He is SHM’s delegate for the AMA House of Delegates. Dr. Flansbaum received his undergraduate degree from Union College in Schenectady, NY and attended medical school at the New York College of Osteopathic Medicine. He completed his residency and chief residency in Internal Medicine at Long Island Jewish Medical Center in New York. He received his M.P.H. in Health Policy and Management at Columbia University. He is a political junky, and loves to cook, stay fit, read non-fiction, listen to many genres of music, and is a resident of Danville, PA.

Categories

Related Posts

By Suchita Shah Sata, MD, SFHM
September 30, 2022 |  0
If you were designing the perfect hospitalist job description, what would be the optimal workload to achieve high productivity? This was the crux of the discussion during September’s JHMChat. The conversation featured Drs. Marisha Burden, Moksha Patel, Mark Kissler, and Elizabeth Harry as well as researcher Angela Keniston, coauthors of “Measuring and driving hospitalist value: […]
January 25, 2021 |  0
Never let a good salary signal go to waste. Here is a meta-assembly of hospitalist, as well as comparator specialties, of 2018-19 salary moves courtesy of Modern Healthcare. It is useful seeing the various estimates from the leading consultants, placement firms, and intelligentsia to get some bearings on the pay trends, Covid notwithstanding.
November 12, 2020 |  1
“My census is too high.” “I don’t have enough time to talk to patients.” “These are outside our scope of practice.” These are statements that I have heard from colleagues over the last fourteen years as a hospitalist. Back in 1996, when Dr. Bob Wachter coined the term ‘hospitalist,’ we were still in our infancy […]
Go to Top