Why an independent review of a product’s evidence matters

An uncomfortable fact about skin care: the company that wants to sell you a cream is almost always the one that paid to test it, designed the test, and wrote the sentence on the box. That’s not a conspiracy; nobody else has a reason to fund a study of a hand cream. But it does mean that somewhere between the data and the label, a lot of choices were made by people who wanted a particular answer. An independent review exists to look at those choices.

What a conflict of interest actually is

A conflict of interest is any situation where the person producing or judging evidence stands to gain from one result over another. It isn’t an accusation. It’s a description of incentives.

In skin care, the incentives stack up in layers:

• The sponsor. The company funds the study and decides what to test, against what, for how long, and which results to use.
• The experts. Dermatologists who endorse products, sit on advisory boards or run sponsored trials may be paid for it. A 2017 study in JAMA Dermatology looked at 49 authors of dermatology clinical practice guidelines and found that 40 had received industry payments, averaging over $157,000 each across three years, and that 22 of those 40 had not accurately disclosed the relationships.
• The publication. A disappointing study can simply stay in a drawer. Nobody is obliged to publish a result that makes the product look ordinary.

None of this means the science is fake. It means the science was done by people with a stake in the outcome, and that stake shapes the work in ways that are hard to see from outside.

Does funding actually change results?

Yes, measurably. A Cochrane review updated in 2017 pooled 75 papers that had compared industry-sponsored drug and device studies with independently funded ones. The sponsored studies reported efficacy results favourable to the sponsor more often (a risk ratio of 1.27) and reached favourable overall conclusions more often (1.34).

The more interesting finding is the one that follows. The authors write that this industry bias “cannot be explained by standard ‘Risk of bias’ assessments.” In plain terms: the sponsored studies often looked fine on the usual checklist. Randomized, blinded, controlled, all boxes ticked. The lean came from somewhere subtler: the choice of comparator, the choice of outcome, the framing of a conclusion, the decision to publish or not.

That’s exactly why a checklist isn’t enough and a reader is needed. Somebody has to open the study and ask not just “was it randomized?” but “was this the right comparison, and does the label say what the data says?”

What “arm’s length” means

An arm’s-length reviewer is someone with no financial or professional stake in the product’s success. Not employed by the company, not paid per approval, not selling a competing product, not dependent on the company’s goodwill for the next contract.

The US Federal Trade Commission’s health products guidance describes the standard evidence should meet: research “conducted and evaluated in an objective manner by experts in the relevant disease, condition, or function.” It also says that when a company uses an expert endorsement, any financial connection consumers wouldn’t expect “is a material connection” that must be disclosed. That’s a US rule, but it names the two things that matter anywhere: objective evaluation, and transparency about who is being paid.

The Canadian Code of Advertising Standards, run by Ad Standards, makes the same demand in its own words: advertising claims “must be supported by competent and reliable evidence,” and ads must not “distort the true meaning of statements made by professionals or scientific authorities.”

Independence is what makes “competent and reliable” credible. A company saying its own study is reliable is a company grading its own homework.

What a third-party review of a claim looks at

An independent review of a claim is not a re-run of the study. It’s a careful read of what the company already has, by people who know what to look for. Typically that means:

• The data, not the summary. The full study report, with the protocol, the numbers and the statistical analysis, rather than the one-line version on the box.
• The design. How many participants, and were they the people the product is for? Was there a control group? Were people randomized? Were the assessors blinded? How long did it run?
• The measurements. Was the outcome an instrument reading, a trained grader’s score, or a questionnaire? Does the claim match the kind of evidence? “Clinically shown to hydrate” backed by a corneometer is one thing; backed by a survey, another.
• The analysis. Was the outcome chosen before the study started? Are the numbers on the label averages or best cases? What happened to the participants who dropped out?
• The wording. This is the part that gets the least attention and matters most. Does “reduces redness” mean a visible change or a small shift on a scale? Does “up to 40%” describe one person? Does “dermatologist tested” refer to a safety test being passed off as a performance result?
• What wasn’t tested. A study on adults says nothing about babies. A two-week study says nothing about three months.

The output is a judgement about the claim, not the product: does this evidence support these words?

In Canada, the Dermatology Review Panel is one example of a third-party body that reviews the evidence behind non-prescription skin care claims in this way; other countries have similar dermatological or consumer-protection review schemes.

What an independent review doesn’t do

This is worth being precise about, because “reviewed” gets read as “approved”, and it isn’t.

An independent claim review is not a safety approval. In Canada, Health Canada is clear that it “does not have legislative powers to approve cosmetics before they are sold,” and that safety is the manufacturer’s responsibility under the Food and Drugs Act. A third-party review of a claim doesn’t change that. It doesn’t test the product for contaminants, doesn’t certify that it won’t irritate your skin, and doesn’t replace the Cosmetic Ingredient Hotlist or the notification system.

It also isn’t a promise that the product will work for you. A good study shows an average effect in a group. Your skin isn’t an average.

What it is: a filter between the study and the sentence. It catches the gap between what was shown and what is said.

Why this matters more for skin than for most things

Skin care sits in an odd place. It’s low-risk enough that regulators don’t pre-approve it, but personal enough that people buy it to manage real problems: dry winter hands, a baby’s rash, an adult’s eczema (atopic dermatitis, the itchy inflamed rash that comes and goes). The claims lean on science, but the science is almost entirely self-funded and almost never published.

That combination, high trust and low oversight, is where an outside reader earns their keep. Not to replace your own judgement, but to do the part you can’t: open the study.

If you’re managing a skin condition rather than a preference, the same rule applies whatever any review says. If it isn’t better after two weeks, see your doctor or pharmacist.

What to remember: the people who test skin care products are the people selling them, and the research shows that leans results, often in ways a checklist won’t catch. An independent review means someone with no stake reads the actual study and compares it with the label. It isn’t a safety approval and it isn’t a guarantee. It’s an answer to one question the box never asks itself: does the evidence say what we’re saying?