Marketing effectiveness

What can you actually prove in a quarter?

Your CFO wants evidence. The measurement chain is broken and it is not coming back. PROOF calculates which form of evidence is achievable at your volume, how long a test would need to run, and which effect you can demonstrate at all within your decision cadence.

You do not end with a score. You end with an agreement you can put on the table.

Three levels of evidence

1
ObservedYou watch something happen and lay it next to your spend. Costs almost nothing, proves almost nothing about cause.
2
ExperimentedYou deliberately withhold something and compare. Costs revenue and time, and proves causality.
3
ModelledYou build a relationship across all channels. Costs the most, and is only reliable when calibrated on level 2.
Nine questions

Tell us how your business works.

Everything stays in your browser. Nothing is sent until you submit it yourself.

Volume and model
Take the conversion you steer on: purchases, enquiries, sign-ups. A rough estimate is fine.
conversions per week
Which business model fits best?
Determines how much your weekly figures swing independently of media.
How long from first contact to conversion?
Determines how many maturation weeks come on top of your measurement period.
Media and history
What is your annual media budget?
Media buying only, excluding production and agency fees.
How many channels are you active on?
Count every channel you steer and budget separately.
How much usable weekly spend history do you have?
Usable means: per week, per channel, without gaps.
Decision and evidence
How finely can you steer your media geographically?
In Belgium this is often the decisive constraint.
How often do you have to account or adjust?
This is the window within which an answer is still usable.
Who is asking for the evidence?
Sets the tone of your proof agreement, not the calculation.
Method

How we calculate.

The audience is split into a test group and a control group. We treat conversions as counts. The logarithm of the ratio between the two groups has approximately a variance inversely proportional to the number of conversions, the number of weeks, and the product of the holdout share with its complement.

From that follows the number of measurement weeks you need to separate a given effect from chance. And in reverse, which is often more useful: for a given number of weeks it gives you the smallest effect you can still demonstrate.

We do not calculate with pure Poisson noise. Real weekly figures swing more than that, driven by season, promotions, stock and competitive pressure. So we multiply the variance by a factor that depends on your business model: the further the conversion sits from media exposure, the higher that factor.

On top of the measurement weeks comes a maturation period. With a long sales cycle, todayu2019s conversions belong to media from months ago, and that lag has to fit inside the window.

All calculations happen in your browser. The calculation core is the same one behind the other public instruments from IKAg, and it is verified by its own test suite.

How we calculate

What this instrument does not do

No scoreA mark out of a hundred would suggest measurability is a report card. It is a choice with a price.
No ratesWe express agency effort in PAR, not in euros per day. That is a deliberate limitation.
No model of your channelsWe say what is achievable, not what works. The second one needs your data.