News

When authoritative sources hold onto bad data

A legal scholar explains the need for government databases to retract information
Janet Freilich
By Janet Freilich
Dec. 23, 2023

In 2004, Hwang Woo-suk was celebrated for his breakthrough discovery creating cloned human embryos, and his work was published in the prestigious journal Science. But the discovery was too good to be true; Dr. Hwang had fabricated the data. Science publicly retracted the article and assembled a team to investigate what went wrong.

Retractions are frequently in the news. The high-profile discovery of a room-temperature superconductor was retracted on Nov. 7, 2023. A series of retractions toppled the president of Stanford University on July 19, 2023. Major early studies on COVID-19 were found to have serious data problems and retracted on June 4, 2020.

Government information sources like the U.S. patent database often file bad information without labeling it or providing a way to retract it.
Government information sources like the U.S. patent database often file bad information without labeling it or providing a way to retract it.

Retractions are generally framed as a negative: as science not working properly, as an embarrassment for the institutions involved, or as a flaw in the peer review process. They can be all those things. But they can also be part of a story of science working the right way: finding and correcting errors, and publicly acknowledging when information turns out to be incorrect.

A far more pernicious problem occurs when information is not, and cannot, be retracted. There are many apparently authoritative sources that contain flawed information. Sometimes the flawed information is deliberate, but sometimes it isn’t – after all, to err is human. Often, there is no correction or retraction mechanism, meaning that information known to be wrong remains on the books without any indication of its flaws.

As a patent and intellectual property legal scholar, I’ve found that this is a particularly harmful problem with government information, which is often considered a source of trustworthy data but is prone to error and often lacking any means to retract the information.

Patent fictions and fraud

Consider patents, documents that contain many technical details that can be useful to scientists. There is no way to retract a patent. And patents contain frequent errors: Although patents are reviewed by an expert examiner before being granted, examiners do not check whether the scientific data in the patent is correct.

In fact, the U.S. Patent and Trademark Office permits patentees to include fictional experiments and data in patents. This practice, called prophetic examples, is common; about 25% of life sciences patents contain fictional experiments. The patent office requires that prophetic examples be written in the present or future tense while real experiments can be written in the past tense. But this is confusing to nonspecialists, including scientists, who tend to assume that a phrase like “X and Y are mixed at 300 degrees to achieve a 95% yield rate” indicates a real experiment.

Almost a decade after Science retracted the journal article claiming cloned human cells, Dr. Hwang received a U.S patent on his retracted discovery. Unlike the journal article, this patent has not been retracted. The patent office did not investigate the accuracy of the data – indeed, it granted the patent long after the data’s inaccuracy had been publicly acknowledged – and there is no indication on the face of the patent that it contains information that has been retracted elsewhere.

This is no anomaly. In a similar example, Elizabeth Holmes, the former – now imprisoned – CEO of Theranos, holds patents on her thoroughly discredited claims for a small device that could rapidly run many tests on a small blood sample. Some of those patents were granted long after Theranos’ fraud headlined major newspapers.

The U.S. Patent and Trademark Office granted a patent to Theranos on Dec. 18, 2018, three months after the company was dissolved following a series of investigations and lawsuits that detailed its fraud. The patent has not been rescinded and contains no notice of the faulty nature of the information it contains.
U.S. Patent and Trademark Office
The U.S. Patent and Trademark Office granted a patent to Theranos on Dec. 18, 2018, three months after the company was dissolved following a series of investigations and lawsuits that detailed its fraud. The patent has not been rescinded and contains no notice of the faulty nature of the information it contains.

Long-lived bad information

This sort of under-the-radar wrong data can be deeply misleading to readers. The system of retractions in scientific journals is not without its critics, but it compares favorably to the alternative of no retractions. Without retractions, readers don’t know when they are looking at incorrect information.

My colleague Soomi Kim and I conducted a study of patent-paper pairs. We looked at cases where the same information was published in a journal article and in a patent by the same scientists, and the journal paper had subsequently been retracted. We found that while citations to papers dropped steeply after the paper was retracted, there was no reduction in citations to patents with the very same incorrect information.

This probably happened because scientific journals paint a big red “retracted” notice on retracted articles online, informing the reader that the information is wrong. By contrast, patents have no retraction mechanism, so incorrect information continues to spread.

There are many other instances where authoritative-looking information is known to be wrong. The Environmental Protection Agency publishes emissions data supplied by companies but not reviewed by the agency. Similarly, the Food and Drug Administration disseminates official-looking information about drugs that is generated by drug manufacturers and posted without an evaluation by the FDA.

Retractions play an important role in science.

Consequences of nonretractions

There are also economic consequences when incorrect information can’t be easily corrected. The Food and Drug Administration publishes a list of patents that cover brand-name drugs. The FDA won’t approve a generic drug unless the generic manufacturer has shown that each patent that covers the drug in question is expired, not infringed or invalid.

The problem is that the list of patents is generated by the brand-name drug manufacturers, who have an incentive to list patents that don’t actually cover their drugs. Doing so increases the burden on generic drug manufacturers. The list is not checked by the FDA or anyone else, and there are few mechanisms for anyone other than the brand-name manufacturer to tell the FDA to remove a patent from the list.

Even when retractions are possible, they are effective only when readers pay attention to them. Financial data is sometimes retracted and corrected, but the revisions are not timely. “Markets don’t tend to react to revisions,” Paul Donovan, chief economist of UBS Global Wealth Management, told the Wall Street Journal, referring to governments revising gross domestic product figures.

Misinformation is a growing problem. There are no easy answers to solve it. But there are steps that would almost certainly help. One relatively straightforward one is for trusted data sources like those from the government to follow the lead of scientific journals and create a mechanism to retract erroneous information.

This article is republished from The Conversation under a Creative Commons license. Read the original article.

The Conversation

Enjoy reading ASBMB Today?

Become a member to receive the print edition monthly and the digital edition weekly.

Learn more
Janet Freilich
Janet Freilich

Janet Freilich is an associate professor of law at Fordham University.

Get the latest from ASBMB Today

Enter your email address, and we’ll send you a weekly email with recent articles, interviews and more.

Latest in Policy

Policy highlights or most popular articles

Advocacy workshops at Discover BMB 2024
Annual Meeting

Advocacy workshops at Discover BMB 2024

Feb. 7, 2024

Topics include running for office, becoming an advocate, and navigating the grant review process at the NIH.

NIH’s advisory committee releases report on re-envisioning postdoc training
News

NIH’s advisory committee releases report on re-envisioning postdoc training

Jan. 8, 2024

The working group developed six primary recommendations for the National Institutes of Health.

Can science publishing be both open and equitable?
Feature

Can science publishing be both open and equitable?

Dec. 14, 2023

An updated memo from the White House Office of Science and Technology Policy has researchers, funders and publishers looking ahead

ASBMB pushes federal agencies to help students struggling with loan debt
Funding

ASBMB pushes federal agencies to help students struggling with loan debt

Nov. 30, 2023

The society states that increasing student debt and financial strain are hurting the U.S. research enterprise and federal agencies must do more to ease this burden.

NIH diversity supplements offer a pathway to independence
Funding

NIH diversity supplements offer a pathway to independence

Nov. 29, 2023

These funding mechanisms have been underutilized. The ASBMB public affairs staff offers recommendations to change that.

ASBMB weighs in on wage rules for postdocs
Blotter

ASBMB weighs in on wage rules for postdocs

Nov. 28, 2023

The society supports the Department of Labor’s proposed increase in minimum salary for exempt employees.