Evaluating Physician Performance

I was invited to give a talk about “patient satisfaction” at a recent OB/Gyn Grand Rounds. I have written previously that “satisfaction” is a pretty low bar, and so I spoke instead about the patient experience. 

I opened my talk with this cartoon:

image001

As I anticipated (and intended), it got a few chuckles from the audience, and I pointed out that it is funny because it resonates – we already recognize that we often provide a poor experience for patients.

I went on to explain that we are all being evaluated by our patients in unscientific ways and that we should embrace soliciting a more authentic voice of our patients through surveys, so that we can improve the experience we provide them. I also pointed out that hospitals are already subject to penalties or bonuses from CMS based on their standardized patient survey results and that the same will soon be true for physicians as well.

After my remarks, I received an email from someone who had been there. It included a blog post that implied that it was a fool’s errand to try to evaluate the performance of physicians, and likened it to trying to catch “a cloud with a butterfly net.” Patient surveys were said to be particularly useless, since patients may “like” an incompetent physician. I replied (and believe) that patient surveys are certainly insufficient to evaluate physician performance, but still tell us something important about a particular dimension of care.

I was still thinking about that when I came across two recent articles in the New England Journal of Medicine. Both discuss the effort underway by CMS to measure physician performance and tie individual physician payment to it, and both made compelling cases that this effort is deeply flawed. And, frankly, both left me feeling a bit depressed.

I do believe it is important to evaluate physician performance. It is a basic professional obligation, and we can’t improve if we don’t measure. But the current “state of the art” doesn’t seem up to the task. In fact, the “objective measures” of physician performance remind me of the old joke about the drunk who looked for his car keys under the lamppost – not because he dropped them there, but because the light was better. We are measuring things not because they are important, but because we can measure them.

So where does this leave us? Rather than throw in the towel, I believe we should:

  • Continue to collect and report publically some objective measures of physician performance, recognizing that we have very few that really make sense.
  • Continue to survey patients about their experience, and strive to improve it.
  • Move toward measuring – and holding physicians accountable for — patient outcomes, instead of adherence to physician performance standards. In the end, it is how patients “do” and how they experience care that really count.

What do you think?

3 thoughts on “Evaluating Physician Performance

  1. I particularly like the reference to the drunk looking for his lost car keys under the lamp post because the light is better there.
    I do agree that you must measure something to improve upon it. I also agree that that which you measure must make sense and be meaningful which I believe is the challenge at hand.
    Rad Med Faculty

Join the Discussion! Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s