Monday, July 6, 2009

Health

Comarow on Quality Graphic

Checklists Can Save Lives

January 17, 2008 12:50 PM ET | Avery Comarow | Permanent Link | Print

Good morning, passengers—this is your captain speaking. There will be a brief delay before we leave the gate. For your comfort and safety, we've added a couple of extra steps to the preflight checklist. The flight attendants will be handing out consent forms to make sure that's OK with you. Please read your copy carefully, and if you're satisfied that none of your rights are being violated, sign it and turn it in so we can get you to your destination. Thanks for your cooperation.

Think you'll hear that announcement anytime soon?

It almost would be less surprising, at least to me, than a federal agency's recent disruption of a study meant to see if following a five-step checklist—simple things like cleaning the skin with a disinfectant soap before inserting a catheter—could reduce infections and deaths in intensive-care units. It could and did. In the first 18 months, the infection rate in 108 ICUs at 67 Michigan hospitals was slashed by two thirds. It was reported in the New England Journal of Medicine at the end of 2006.

Last year a complaint (I haven't gotten the details) triggered an investigation of the study by the federal Office for Human Research Protections, a part of the Department of Health and Human Services. The OHRP determined that hospitals could keep using the checklist, but the research element—collecting and sending data to Peter Pronovost, the Johns Hopkins architect of the program—had to stop. The office ruled that the study amounted to a formal research project, and, as such, it should have gone through formal internal vetting by institutional review boards at all of the 67 hospitals to make sure patients' rights were protected and consent forms provided in case patients wanted to opt out.

Pronovost thought he'd covered all the bases by having the Johns Hopkins review board scrutinize and approve the study. "It wasn't exactly a stealth intervention," he told me yesterday evening. The view of the Hopkins IRB was that the checklist program was only a change in procedure that would lead to an improvement in quality, not research involving human subjects. That seems logical enough, since there was nothing new about any of the five checklist items. Pronovost was simply bundling them into a checklist. The federal office didn't agree, and Pronovost halted his analysis of the data and told the hospitals to stop sending him any more.

All this would have gone mostly unnoticed but for a December 30 opinion piece in the New York Times by surgeon Atul Gawande, who had extolled Pronovost's program in a long New Yorker article a few weeks earlier about the ability of simple checklists to reduce hospital errors and unsafe practices. Since then, a number of medical blogs have picked up the gauntlet, most vociferously Wachter's World, run by hospitalist Bob Wachter at the University of California-San Francisco. Like Pronovost, Wachter is heavily involved with the patient quality movement, and he is irate.

"As someone who cares about the lives of patients, this one gets me PISSED," he wrote yesterday in his latest rant. He went on: "OHRP does important work, and local and regional internal review boards are critical to protecting patients from potential harm. But we're talking about checklists here. CHECKLISTS!"

The agency usually labors in obscurity—and wasn't ready for the attention stirred up by Gawande's opinion piece. On Tuesday, a press release stated that Gawande's op-ed piece had "inaccurately characterized certain facts of the case." I spent the better part of an hour yesterday with federal officials who tried to explain the reasoning behind the decision, and I confess that I still don't completely understand it. My sense is that it was technically correct but based on a very narrow reading of the regulations—and unnecessarily rigid. Spokesperson Rebecca Ayers gave me a prepared statement that said in part: "We hope every hospital implements this five-step program, which has been proven to reduce infections—saving lives and millions of dollars. Current research regulations in no way prohibit the adoption of this five-step program by hospitals whose only goal is to improve the quality of care."

She's right. Hospitals can use the checklist. But they'd better not even think about doing what the Michigan hospitals naively agreed to do with Johns Hopkins: see how the checklist did and hand over the data (which, by the way, were clumped to prevent individual patients from being identified) to be analyzed and published, for physicians and quality experts at other hospitals to follow suit. Unless, of course, they run it through their review board first. That will take time, but what's the rush? So many patients die in ICUs—what's a few more?

"I'm not sure how to proceed," said a clearly frustrated Pronovost. "I have six or so states that have said, 'Hey, could you come put this here?' I scratch my head and say, 'OK, but we'll have to get IRB approval from every hospital.' " He points out that 40 percent of Michigan hospitals are rural and don't have institutional review boards because they do minimal research and can't afford the cost anyway. "These are hospitals that would be cut out of initiatives like this," said Pronovost. "I don't think the public would stand for that, and the hospitals are unhappy at not having access to them."

It's hard to disagree with another of his observations: "We have to clarify this issue in a wise way. Focusing on a very bureaucratic, regulatory interpretation rather than evaluating the risks and benefits to patients of a quality initiative seems very unproductive."

Tags: medical quality | patient safety

Tools: Share | | Comments (17) | Print

Reader Comments

Recall all the facts.

I don't think it builds my confidence to think that these doctors, who apply for grants for a living, don't understand the regulatory environment in which they apply. Imagine the surgeon staring at the tray: "gosh I don't remember what all these different clamps do." Especially at the alleged premier research institution in America.

And it certainly does not build my confidence that people want to regulate an exception for this activity. Suppose that checklist, inadvertently and in good faith, unfortunately had a step in it that actually increased infection rates? And that step was never noticed because it is mixed in with other steps that offset the damage? Since it is exempt "quality improvement" research, there would be no oversight whatever.

And to bev, two questions: if it was so confusing whether to apply to the IRB, why did Pronovost submit the study to his own IRB in Baltimore? No I am sorry there is no diagnosis that explains ALL of the symptoms other than arrogant duplicity.

Second question: should a hospital without an IRB be doing human subjects research? I don't think so. I am sure the small community hospitals are full of good people but it is good for them to have an undiluted focus on patient care, not that stupid triangle that shortchanges everyone in the end.

reply to Lars

Lars;

I had a different take on the letters than you did. I think Provonost told the OHRP that he was doing human subjects research because there was no other box on the form to check to indicate what he was really doing. If you read their regs, (see 'regulations' on the left side of their website) you will see what I mean; it's like wandering in a dark forest. Even the AHRQ director to whom I wrote, Dr. Francis Chesley, agreed that there is confusion among researchers and the feds alike over what constitutes "human subjects research". According to him, HHS seems to be talking this over and trying to provide some guidance as to what constitutes "research" vs. "quality improvement activity." I personally think they are using the wrong terms. The distinction should be between "human subjects research" and "quality improvement research."

As for the IRB requirement, see Dr. Gawande's article about how he is working with the WHO on similar "research" - if some of these hospitals, who are small and don't even have IRB's, have to form them and then obtain informed consent from all patients, his efforts will just die.

This is not a simple issue; I think everyone has to read all the articles, letters and regs themselves and make their own judgement.

Respectfully, you are misled.

Orac: actually no, there is no disagreement over whether this is human subjects research, except in the sensational accounts in the press. If you read the actual record you find:

Pronovost told the HHS (the AHRQ specifically) that he was doing human subjects research. The OHRP based its conclusion in no small part on that statement, and others MADE BY THE INVESTIGATORS.

Repeat: Pronovost told the HHS (the AHRQ specifically) that he was doing human subjects research.

This is getting worse and worse, this is really irresponsible. Gawande is suggesting in the NY Times that people write to HHS, but it is not their fault and there is nothing they can do now. People who really care about patients over subscriber counts should write to the Michigan hospitals, tell them to put on a pot of coffee, page their IRB members off the golf course, and convene sessions to properly review and approve the study at their hospitals. They may (gasp) have to do it on an evening or a Saturday.

Add your thoughts

Your comment will be posted immediately, unless it is spam or contains profanity. For more information, please see our Comments FAQ.

advertisement

Avery Comarow

U.S. News's Avery Comarow has been editor of the America's Best Hospitals annual rankings since they first appeared in 1990. His reporting on clinical medicine, from the latest cholesterol guidelines to robotic surgery, has been driven by the question: What does this mean to patients? And that is the perspective he brings to his observations and commentaries on the increasing number of programs by hospitals and other healthcare providers to improve care and patient safety.

advertisement

NEWSLETTER

Sign up today for the latest headlines from U.S. News & World Report delivered to you free.

RSS FEEDS

Personalize your U.S. News with our feeds of blogs and breaking news headlines.

U.S. NEWS MOBILE

U.S. News daily briefings are also available on your mobile device.

People who read this also read ...

Featured Video

Learning About Depression

Depression is more than just a "down mood."

Learning About Cancer

Learn how cancer cells form in the body and how to perform a breast self-exam.

What Is Breast Cancer?

Watch how cancer forms inside the breast, and learn the possible signs and symptoms.

Chemotherapy

Learn why chemotherapy often plays a large part in cancer treatment.

Use of this Web site constitutes acceptance of our Terms and Conditions of Use and Privacy Policy.
Make USNews.com your home page.