Essay

A paleolithic peer review

Bill Sullivan
April 18, 2024

You might think review panels have only been around for the last century or so. You would be mistaken. Archeologists recently discovered the following etched into the wall of a cave deep below the campus of Flintstone University, an R1 research institution.

Research Plan

Midday fatigue is a significant problem affecting the majority of our tribe, reducing our ability to hunt and gather effectively.

Our preliminary studies show that when goats eat the berries of plants in the genus Coffea, they become more energetic.

We hypothesize that coffee berries may be used to brew an energy drink for humans.

Our research plan will involve steeping the grinds from the coffee berry fruit or seed (or placebo) into heated water for 10 minutes. Samples will be blinded and consumed by age-matched participants. Energy levels of participants will be quantified 30 minutes later, assessed by how far each subject can run.

Unfortunately, the proposal was not discussed, delaying the discovery of coffee for many years. Here are the reviews:

Reviewer 1

- The premise is flawed as what happens in goats is not guaranteed to happen in humans.
- The PI has no experience grinding seeds.
- Water source is not specified.

Reviewer 2

- Leaves are already used to brew tea. Proposal lacks innovation.
- It is surprising that the PI did not determine whether goats are more energetic after consuming other foods.
- Only oral dosing is proposed. The PI should include alternate routes of administration.

Reviewer 3

- PI did not ensure that all participants would have equal leg lengths, complicating interpretation of the data.
- What if the alleged effects of coffee berries are not felt until 31 minutes postconsumption?
- Findings will have low impact: It is unlikely that most people would go to this sort of trouble when they could easily take a nap.

Enjoy reading ASBMB Today?

Become a member to receive the print edition four times a year and the digital edition monthly.

Learn more
Bill Sullivan

Bill Sullivan is a professor at Indiana University School of Medicine and the author of several books.

Get the latest from ASBMB Today

Enter your email address, and we’ll send you a weekly email with recent articles, interviews and more.

Latest in Opinions

Opinions highlights or most popular articles

Debugging my code and teaching with ChatGPT
Essay

Debugging my code and teaching with ChatGPT

Oct. 16, 2025

AI tools like ChatGPT have changed the way an assistant professor teaches and does research. But, he asserts that real growth still comes from struggle, and educators must help students use AI wisely — as scaffolds, not shortcuts.

AI in the lab: The power of smarter questions
Essay

AI in the lab: The power of smarter questions

Oct. 14, 2025

An assistant professor discusses AI's evolution from a buzzword to a trusted research partner. It helps streamline reviews, troubleshoot code, save time and spark ideas, but its success relies on combining AI with expertise and critical thinking.

How AlphaFold transformed my classroom into a research lab
Essay

How AlphaFold transformed my classroom into a research lab

Oct. 10, 2025

A high school science teacher reflects on how AI-integrated technologies help her students ponder realistic research questions with hands-on learning.

Writing with AI turns chaos into clarity
Essay

Writing with AI turns chaos into clarity

Oct. 2, 2025

Associate professor shares how generative AI, used as a creative whiteboard, helps scientists refine ideas, structure complexity and sharpen clarity — transforming the messy process of discovery into compelling science writing.

Teaching AI to listen
Essay

Teaching AI to listen

Sept. 18, 2025

A computational medicine graduate student reflects on building natural language processing tools that extract meaning from messy clinical notes — transforming how we identify genetic risk while redefining what it means to listen in science.

What’s in a diagnosis?
Essay

What’s in a diagnosis?

Sept. 4, 2025

When Jessica Foglio’s son Ben was first diagnosed with cerebral palsy, the label didn’t feel right. Whole exome sequencing revealed a rare disorder called Salla disease. Now Jessica is building community and driving research for answers.