The gap between supplement hype and supplement evidence

Search for a command to run...

There are two supplement industries. There is the one in the research — slow, hedged, full of "more study is needed" — and there is the one in your feed, where everything works for everything and the only debate is the dose. The distance between those two is the most useful thing Panacea Index measures. It is also the hardest thing to put a single number on.
Here is how we think about the gap, and why measuring it is more interesting than ranking supplements.
When you line up what influencers say about a supplement against what the research supports, the mismatches fall into a few patterns. Learning to see the patterns is more useful than memorizing a list.
The overstated blockbuster. A supplement gets famous for one outcome, and the fame outruns the evidence. Influencers talk about it constantly for that outcome, the research is thin or mixed, and the confidence of the claims has no relationship to the confidence the data deserves. The supplement is not useless — it just does not do, with the certainty claimed, the thing it is famous for.
The quiet performer. The opposite. A supplement has respectable evidence for an outcome that is boring or un-marketable, so the conversation ignores it. The research is there; the reach is not. These are the most underrated entries in the whole field, and they are invisible if you only read what goes viral.
The direction flip. The most interesting and the most damaging. An influencer says a supplement increases an outcome, and the research says it decreases it — or has no effect. This is not a disagreement about confidence. It is a disagreement about which way the arrow points. When the evidence behind the outcome is strong and the influencer is confidently wrong, that is a busted myth in the cleanest sense.
Our leaderboard surfaces all three. The first two are questions of attention. The third is a question of fact.
It is tempting to publish a list — the ten most overhyped supplements, ranked. We have not, and the reason is the same reason we gate the leaderboard.
To call a supplement "overstated," you need two things: a measure of how loud the claims are, and a measure of how thin the evidence is, for the same outcome. A supplement can be heavily hyped for outcome A and well-supported for outcome B. Vitamin D is the canonical example — extraordinary reach, real evidence for some outcomes, overstated reach for many others. Flatten that into a single "overrated" rank and you have lied about it in a sophisticated way.
So instead of a list, we give you the comparison at the level where it is true: per supplement, per outcome. For any pair, you can see how many influencer claims exist, what direction they point, and what the research says underneath. The gap is right there, and it is honest because it is specific.
There is a second gap worth naming, and it is not in the data — it is in us.
Attention is not evenly distributed across the evidence. A supplement with a single dramatic study gets a decade of press. A supplement with twenty quiet, consistent studies gets none. The result is that your mental model of "what works" is shaped more by what was surprising once than by what has been confirmed repeatedly. This is why creatine — genuinely one of the best-studied, most reliably effective supplements — is famous instead for a hair-loss claim the evidence does not support. The noise is louder than the signal, because noise is more interesting.
You cannot fix this by reading more supplement content. You can only fix it by weighting what you read against the volume and agreement of the underlying studies. Which is, again, the entire point.
The practical version of all this is a habit. When you encounter a supplement claim, before you accept or reject it, find the pair on the site and check three things.
How many studies are there. Three or thirty is the difference between a hint and a finding. What direction they point. A clean direction is worth more than a mixed one, and a mixed result is not the same as "no effect." And how much agreement there is. Eighty percent of studies agreeing is a different beast from fifty-fifty.
If the claim you heard matches the direction and the strength of that evidence, it is probably fine. If it outruns it — and most viral claims do — you have found the gap, and now you know its exact size.
That is a more useful thing to carry than any top-ten list.