PGY-4,5,6….27. Experience is Not the Answer.

>
By  |  August 25, 2011 | 

I assume, incorrectly perhaps, that mechanics have a basic knowledge of their craft such that routine auto repairs require little effort.  The tasks do not supersede the expected competency of the repairperson, and the customer can expect a car that operates at the time of pick up.  A small percentage of jobs may stretch that assumption, but that is okay by me.  Just like medicine, some mends are complicated.    You need assistance from another mechanic or you refer the auto to a specialty garage.  No one is superman.

How does this relate to the practice of medicine?

I frequently notice pharmaceutical ads on Sunday AM television broadcasts, as well as newspaper articles that advertise a medical product, or report on a new device, surgery, or therapy—usually of the latest and greatest vintage.  As the data for these interventions is incomplete, or the costs unknown, the story concludes with a riposte conveying that the reader need not concern themselves with the alien facts—just “consult your health professional” and all will be well.

I also observe that politicians object to “meddling” when EBM-based policies from expert committees passively (or actively) affect the doctor-patient relationship, especially as it relates to decision-making and the counsel we provide.  Just watch the nightly news—sound bites abound.  This relationship is sacrosanct after all, and our advice is authoritative and 98.7% correct.  Who would question a physician after all?

Numerous articles document the poor health literacy of patients; their ability to understand prescription instructions, comprehend insurance policies, or reliably complete an informed consent form.  However, the literacy of physicians resides on a loftier peak.  Society assumes we know our business.

Nevertheless, consider the capacity of our profession to interpret basic clinical studies or unravel slanted industry messages.  Is society overestimating our ability?  Is our erudition reliable enough when patients seek our guidance for care?  More importantly, for those who contemplate this role, how it needs expanding in a patient directed system, and its authenticity, can we deliver?  After all, the strength of our health system depends on whether we perform this task—assuming congress requires us to execute it.

A new study in The Journal of General Internal Medicine examines both patient and physician ability to discern potential differences in how each interprets survival odds in a hypothetical case vignette.

Outcomes were expressed as follows:  [%] absolute survival, [%] absolute mortality, [%] relative mortality reduction, or all three simultaneously.

As children, teachers ask us if a pound of feathers or bricks weigh more.  No difference obviously, and likewise, the study tests whether framing, how we cast equivalent data, influences how caregivers and patients interpret information.

The following table, with notable highlights, answers the question.

Table 1: Note the highlighted RRR

Of note, the variance between physicians and patients in categorizing treatment effects (better to worse) is notably similar—regardless of how they viewed the information.  Of greater concern however, is the loss of physician’s contextual ability when presented with a relative risk calculation.

The doctors rate the treatment as clearly better two-thirds of the time when the investigators present a 2% absolute improvement in this way (RRR=33%).  The error is disturbing.  Also, while it was a Swiss study, I am comfortable extrapolating the results to our shores.  You might be a skeptic, but I expect identical findings here.

As an illustrative example, associate the findings above and apply that same physician health “illiteracy” to the interpretation of a seminal study recently released this summer.  The findings were available earlier in November 2010.

A journalist’s take:

The hospitals – including the University of Pittsburgh Medical Center, Swedish Medical Center in Denver, Abbott Northwestern Hospital in Minneapolis, Rhode Island Hospital in Providence and Pomona Valley Hospital Medical Center in California – say they are responding to the study by the National Cancer Institute. It  found annual low-dose CT – or computerized tomography – screening of asymptomatic current or former smokers could cut the death rate from lung cancer by 20 percent by identifying the disease earlier than X-rays.  The results were so striking that federal officials last November ended the study early to announce their findings.

Caution however, as that is not the final word:

Table 2: NNT Alternate View

How would you perceive the publication?  Would have reflexively ordered the screen based on the RRR of 20%, or rather, would you have noticed the ARR and high false (+) rate? Most importantly, do you have the ability to overcome the framing bias, or the capacity to defend against it when patients request a screen?

Not all that glitters is gold.  The numbers require analysis and thinking, and not of the passive sort (read the study, if for no other reason than it is influential, and patients will inquire about its relevance to their care).

On a personal note, I cared for an 83-year-old woman this week. Regrettably, I diagnosed her with metastatic lung cancer.  She had partial decision-making capacity and poor functional status.

Hospice was my first inclination, where we ultimately moved her.  However, while I do not regret the oncology consult, I opened a therapeutic door I was unable to close.  It was the system gateway I often (altruistically) rail against, and sometimes loathe.  Guilty as charged.

My reluctance to accept a recommendation, which I assumed was fruitless, produced this paper from the pocket of the oncology fellow.  This study was my patient.

Tolerability.  Survival.  Cost.  Weigh the balance.  I was in the dark, and my first thought was the internal sounding board we all utilize: if this was my mom…

Politicians, society, the WSJ op-ed page, they all assume the verdict of treatment certitude is between the doctor and patient only–and the course we navigate is always correct.  However, take it from one who knows.  We need help.  We do not have the answers.  We are not that black box that will cure our system’s ills, and the bond between physician and patient needs more than just our expertise.

Did I give the drug by the way?  No, and it was a difficult decision.  That is the hat I hate wearing, and the one I feel so conflicted in.  It does not suit me.

 

Share This Post

4 Comments

  1. Care And Cost August 26, 2011 at 5:05 am - Reply

    […] posted 8/25/11 on The Hospitalist […]

  2. […] Flansbaum writes about the difficulty of correctly interpreting survival odds for patients and physicians. His post is based on an interesting study about framing bias in medical decision making. He notes […]

  3. […] Bradley Flansbaum blogs about his irritation with ads and news stories that advise patients – just “consult your […]

  4. susan August 29, 2011 at 12:39 pm - Reply

    Excellent post. It reminds me that as patients, we must gather our information from many sources and do our homework. Gone are the days of relying on a single doctor to care for our health. Don’t be afraid to ask questions.

Leave A Comment

For security, use of Google's reCAPTCHA service is required which is subject to the Google Privacy Policy and Terms of Use.

About the Author: Bradley Flansbaum

Bradley Flansbaum, DO, MPH, MHM works for Geisinger Health System in Danville, PA in both the divisions of hospital medicine and population health. He began working as a hospitalist in 1996, at the inception of the hospital medicine movement. He is a founding member of the Society of Hospital Medicine and served as a board member and officer. He speaks nationally in promoting hospital medicine and has presented at many statewide meetings and conferences. He is also actively involved in house staff education. Currently, he serves on the SHM Public Policy Committee and has an interest in payment policy, healthcare market competition, health disparities, cost-effectiveness analysis, and pain and palliative care. He is SHM’s delegate for the AMA House of Delegates. Dr. Flansbaum received his undergraduate degree from Union College in Schenectady, NY and attended medical school at the New York College of Osteopathic Medicine. He completed his residency and chief residency in Internal Medicine at Long Island Jewish Medical Center in New York. He received his M.P.H. in Health Policy and Management at Columbia University. He is a political junky, and loves to cook, stay fit, read non-fiction, listen to many genres of music, and is a resident of Danville, PA.

Categories

Related Posts

By Suchita Shah Sata, MD, SFHM
September 30, 2022 |  0
If you were designing the perfect hospitalist job description, what would be the optimal workload to achieve high productivity? This was the crux of the discussion during September’s JHMChat. The conversation featured Drs. Marisha Burden, Moksha Patel, Mark Kissler, and Elizabeth Harry as well as researcher Angela Keniston, coauthors of “Measuring and driving hospitalist value: […]
By Lanna Felde, MD
November 22, 2021 |  2
Last week’s #JHMChat saw an all-star guest lineup including Drs. Adam Rodman, Zahir Kanjee, Laura McNamara, and Shane Warnock of Beth Israel Deaconess Medical Center debating the value of the routine daily physical exam – is it worthwhile or a waste of time? This question was recently debated in our Point: Counterpoint series and got […]
December 11, 2020 |  0
I’ve been thinking a lot about endurance recently. For the third time, COVID-19 is surging in the U.S., and this time, it’s not localized to New York or the Sun Belt – it’s everywhere. Healthcare workers exhausted from the first and second waves – and those in smaller Midwestern communities who are just now experiencing […]
Go to Top