Skip to Main Content

It was a win-win. Hospitals needed to prevent patient deaths from sepsis, a complication of infection; and Epic, the nation’s largest seller of medical records, needed users for its new product — an algorithm that could predict which patients would develop the condition so doctors could intervene earlier.

Over the last few years, hundreds of hospitals have plugged in the algorithm without verifying its advertised 80% accuracy rate. Then a group of researchers at the University of Michigan started asking questions about its performance.

advertisement

Their findings, published Monday in JAMA Internal Medicine, underscore the perils of allowing algorithms to run unchecked in U.S. health care: Epic’s sepsis predictor missed two-thirds of cases in the University of Michigan’s hospital system; its overall accuracy was about 63%, which is little better than a coin flip; and its high rate of false alarms meant clinicians would have to respond to 109 alerts to find a single patient with sepsis.

Unlock this article by subscribing to STAT+ and enjoy your first 30 days free!

GET STARTED

Create a display name to comment

This name will appear with your comment

There was an error saving your display name. Please check and try again.