he Trump administration has abruptly halted work on a highly regarded program to help physicians, families, state and local government agencies, and others separate effective “evidence-based” treatments for substance abuse and behavioral health problems from worthless interventions.
The program, called the National Registry of Evidence-Based Programs and Practices, was launched in 1997 and is run by the Substance Abuse and Mental Health Services Administration. Its website lists 453 programs in behavioral health — aimed at everything from addiction and parenting to HIV prevention, teen depression, and suicide-hotline training — that have been shown, by rigorous outcomes measures, to be effective and not quackery. The most recent were added last September.
In an email dated Jan. 4 and sent to program developers, the contractor hired by SAMHSA to work on the registry said, “It is with great regret that we write to inform you that on December 28, 2017, we received notification from SAMHSA that the NREPP contract is being terminated for the convenience of the government. This cancellation means that we can no longer make any updates to your program profile. … We are deeply saddened by the government’s sudden decision to end the NREPP contract, under which we have been able to provide and strengthen science-based information about mental health and substance use treatment and prevention programs.”
A recipient shared the email with STAT.
Dr. Elinor McCance-Katz, assistant secretary for mental health and substance use, argues that NREPP needs to be improved so that it is more rigorous, calling the current registry “flawed.” In reviewing some of the listed programs, she told reporters on Jan. 11, “I see [evidence-based programs and practices] that are entirely irrelevant to some disorders, ‘evidence’ based on review of as few as a single publication that might be quite old and, too often, evidence review from someone’s dissertation.” While NREPP is frozen, she said, SAMHSA will work on helping programs deliver to people “living with these disorders the care and treatment and recovery services that they need.”
The website of the now-frozen registry has not been taken down. In an online statement, SAMHSA said future work on the registry, including vetting new applications, would be moved in-house “to reconfigure its approach to identifying and disseminating evidence-based practice and programs.”
Despite the inclusion of the phrase “evidence-based,” the statement did not assuage critics’ concerns: The decision to freeze the registry comes as the Trump administration has advised agencies such as the Centers for Disease Control and Prevention to avoid using seven words — including “evidence-based,” “science-based,” “fetus,” and “transgender” — in budget documents and to instead use language that won’t antagonize members of Congress.
The guidance, for example, suggested that instead of describing a policy or decision as “evidence-based,” the CDC say that it “bases its recommendations on science in consideration with community standards and wishes.”
The coincidence of the “banned words” policy and the decision to freeze the behavioral health registry “should give us pause,” said Rosalyn Bertram of the University of Missouri, Kansas City, an expert on evidence-based practices in the social sciences.
Because SAMHSA has not explained how or when it will pick up the registry work, “I’m pessimistic,” said psychology professor Warren Throckmorton, of Grove City College in Pennsylvania, who teaches a seminar that includes lessons on evidence-based programs and practices. “Why did they stop something before they had something to put in its place? Why stop what was working reasonably well?”
The registry has long been “the first stop” for communities trying to figure out which programs to adopt to, say, battle teen alcohol use, said Suzanne Kerns of Denver University and executive director of the Center for Effective Interventions. “If you’re a community official in the middle of Kansas, you might not have access to all the scientific literature, or the time or resources to read and critique it. That’s the gift that NREPP offers.”
Some states have laws requiring that public programs for, say, children and family services use only evidence-based interventions vetted by NREPP. Because NREPP stopped vetting and listing new programs three months ago (90 were reportedly in the pipeline), “there are potentially effective programs that communities need to know about but that are sitting dead in the water,” Bertram said.
She and other researchers alarmed by the SAMHSA decision said it suggests that what they described as the administration’s skepticism about scientific evidence has now been extended.
Just as mainstream medicine has been embracing an evidence-based approach (testing assumptions that, say, arthroscopic surgery for knee osteoarthritis works) so that patients do not receive useless care, so has behavioral health, which includes mental health as well as things such as parent-child relationships and social functioning. Behavioral health has lagged behind, however, because some of the problems it addresses are partly subjective, making it “easy to convince yourself that something is effective when it’s not,” said Throckmorton. That’s harder to demonstrate for interventions meant to help with parent-child interactions than, say, to treat cancer.
Throckmorton said his interest in the field grew from his realization that “change therapy” — to alter people’s sexual orientation — has no scientific basis.
By identifying programs whose effectiveness is supported by evidence, the registry “has been a gold seal of approval,” said a physician at a child health program who asked not to be identified because he did not want to jeopardize his SAMHSA funding. And there is considerable work still to be done in spreading evidence-based programs: Only 3 percent of children with problems ranging from attention deficit hyperactivity disorder to disruptive behavior to suicidality receive evidence-based services, he said, partly because scientifically valid programs often have a high price tag.
Making it harder for people struggling with addiction and their families to see whether a treatment they’re being offered has been shown to work is especially worrisome, said the physician. “In the midst of an opioid epidemic, they’re suspending work on a registry that tells you this,” he said.
This story was updated on Jan. 17 with comments from SAMHSA.