Five sentences. Longer than a tweet but shorter than the average elementary school essay. That’s the length of an influential letter published in 1980 in the New England Journal of Medicine, the world’s most prestigious medical journal. It alleged that narcotics are not addictive. This letter, combined with aggressive marketing efforts by pharmaceutical companies and the emergence of improving pain control as a focus for physicians and hospitals, led doctors to begin prescribing opioids as painkillers for conditions that once simply called for aspirin.
The outcome of this perfect storm? Millions of Americans addicted to opioids, and more than 200,000 dead by overdose between 1999 and 2016. And that number keeps growing.
Why was such a short letter so influential? It has what are considered to be the hallmarks of a reliable scientific publication: It appears in a prestigious journal and it has been highly cited by other researchers, 608 times as of 2017.
When a group of researchers analyzed the hundreds of papers citing the letter, their findings prompted NEJM to append the letter with a stark warning: “For reasons of public health, readers should be aware that this letter has been ‘heavily and uncritically cited’ as evidence that addiction is rare with opioid therapy.”
This is just one example that science, like news and social media, has a “fake news” problem.
Major pharmaceutical organizations have published reports and given talks saying that they are unable to validate studies, sometimes up to 90 percent of the times. The Open Science Collaboration turned up similar worrying results, showing that the majority of psychology studies can’t be confirmed. One initiative that tried to replicate the top 50 cancer studies had to stop at 18, simply because it was too difficult and expensive to continue. Irreproducibility in the sciences seems to be one of the most reproducible findings, perhaps because each irreproducible study generates many more that follow it.
The issue of results becoming “facts” by being repeated citation by citation isn’t a new plague for science — or the internet. In fact, it has been a focus since the beginning of search engines. In the early days of ranking webpages, the more that other sites linked to yours, the more your ranking was boosted. In science today, the more a paper is cited, the more visible it is and the better it is perceived.
Google revolutionized webpage ranking with PageRank, an algorithm that not only evaluated the number of inbound links, but also the quality of those links (it evaluated quality by determining the number of links those links themselves had received).
A somewhat similar ranking, known as Shepardizing, has been available to the legal community through the LexisNexis database. It lets lawyers easily understand and cite cases that still stand, as well as those that have been overturned or contested.
Science currently has no good way to assess scientific rigor, and proxies of quality — such as social media attention, total citation counts, and journal brand — are highly flawed, if only because a citation refuting a report is counted the same way as one supporting it.
That may be changing. With today’s progress in machine learning and artificial intelligence, machines can do laborious tasks like citation analysis with great accuracy and efficiency. Unlike the internet, though, most research cannot be easily scraped or text mined because it is behind paywalls and bound by restrictive copyrights. This means it is easier to text mine Twitter than it is to text mine the cancer literature.
Opening up scientific publications to read and reuse, referred to as open access, has been a growing movement over the last decade. It now seems to be at a tipping point, with funders in the European Union proposing to mandate by 2020 that all future publications be open access immediately upon publication. The consequences of that change could be profound for science and society.
Deep learning models, used to power advances in self-driving cars and voice recognition (hi, Siri!), tend to emerge from communities that openly share their papers, data, and code. If this can be expanded to the biomedical research literature, the potential for new advances is far-reaching.
The company I co-founded, scite, is working to develop a system that uses natural language processing combined with a network of human experts to classify citations as supporting, contradicting, or simply mentioning. Such a system has the potential to stop publications like the now-infamous 1980 letter on opioids from becoming authoritative by shifting the emphasis to how research has been cited, not just how many times it has been cited. Science has had intense interest in reproducibility initiatives and proposed policy changes, but to the best of my knowledge no one is doing what scite is trying to do.
Marc Andreessen, the co-author of Mosaic and the co-founder of Netscape, once wrote that “software is eating the world.” It’s taken a bit longer than expected, but it’s now gobbling up scientific literature.
Josh Nicholson is the CEO and co-founder of scite.
Dr. David Healy exposes most medical journal papers are also ghost written. So where is the accurate reporting? I certainly didn’t find any when I heavily researched deep into the annals of psychiatry/pharmaceutical companies, FDA, CDC, from there it only got worse. There was so much fraud it was mind-blowing. If people only knew. Medical journalist Robert Whitaker has written extensively on the disastrous results of this catastrophe in the making. Or ask any psychiatric drug survivor that spans across the Globe who’s lives have been destroyed in ways most can’t even imagine. We not only need ‘open access’ to data, we DEMAND open access to truthful, accurate data to all the clinical trials, especially deliberately hidden studies & data reported to the FDA. Most importantly concerning deaths deliberately withheld data from clinical trials and not reporting post trial ‘adverse’ deaths from psychiatric drugs when required. Clinical trials screening toddlers. I want you to read every word of this friggin’ horror show:
A Randomized Controlled Trial of PCIT-ED for Preschool Depression (3-6 year old children (They’re also heavily targeting teens right now.) – https://clinicaltrials.gov/ct2/show/NCT02076425
Primary Outcome Measures : Kiddie Schedule for Affective Disorders and Schizophrenia – Early Childhood (KSADS-EC) [ Time Frame: completion of therapy (average of 20 weeks) ]
The K-SADS-EC is a semi-structured diagnostic interview designed to assess current and past episodes of psychopathology in children according to DSM criteria.
Probes and objective criteria are provided to rate individual symptoms. Primary diagnoses assessed include: Major Depression, Dysthymia, Mania, Hypomania,
Bipolar, Agoraphobia, Separation Anxiety, Simple Phobia, Social Phobia, Generalized Anxiety, Obsessive Compulsive, Attention Deficit Hyperactivity, Conduct,
Oppositional Defiant, Post-Traumatic Stress, and Adjustment Disorders. Revisions include adjusting/adding questions and threshold anchors reflecting developmentally
appropriate symptom and diagnostic criteria for 3-6 year old children, removing sections less applicable to young children, editing probes to use parent-directed
wording, and providing directions for clarifying symptom severity and genesis where necessary. The KSADS-EC was adapted from the KSADS-PL by Michael S. Gaffrey, Ph.D. and Joan L. Luby, M.D.
• Even Dr. Francis Collins when he reveals ‘2017 Tissue Chips in Space Projects’ (National Center for Advancing Translational Research/NIH (Pretty bizarre) that Program Overview: During human clinical trials, approximately 90 percent of candidate drugs fail because 1) they are unsafe (30 percent)- [far too low as most are very unsafe, if not ALL) or 2) ineffective (60 percent) 2)’ – New drugs to market are skyrocketing at fever pitch and never so lucrative for big pharma. Trump’s big pharma pick Scott Gottlieb pealed back rules & regulations to enable them to fast-track drugs to market to maximize profit for pharmaceutical/tech industries (Don’t forget ‘smart pill’ is already here keeping track if you ‘missed’ a dose reporting back.) Trump’s almost ready to heavily invest in DEPARTMENT of HEALTH and HUMAN SERVICES to the tune of $10,000,000,000 for their ‘Opioids Epidemic and Serious Mental Illness and Serious Emotional Disturbance Initiative’ project. This should terrify everyone. This is the state of America today. Actually, all of humanity around the world. Pharmaceutical drugs are already the third leading cause of death in America. We demand transparency into the pharmaceutical companies that are poisoning us. Because everyone’s life is in jeopardy. Even the babies.
It looks like they still want to ignore facts. That letter was factual, however it was misused, by clever marketers. We see the same misreporting of facts constantly, by the Pharma, Medial and Device industries with no criticism. The letter should have been taken in context, which is still lacking in our physicians, as we can see from the current opioid deaths. now the misinformation campaign has gone too far the other way as the death toll climbs.