What do you agree before reviewing a first affiliate test?

[InVault]

Before a first affiliate test, I’d put the review plan on one page with the partner.

Start with one offer and a defined audience. Agree the traffic source, market, test period, spending cap where relevant and the customer action you want to measure.

Then decide how both sides will read the results: which report you’ll use, how pending and approved actions are shown, and when the numbers are ready to review. Name someone on each side who can resolve a mismatch.

At the review, follow the customer journey. If people click but few sign up, look at the offer and landing page together. If signups arrive but few become approved customers, work through the reasons with the partner. Agree one change for the next test and keep a note of it.

For people managing these partnerships, which detail has made your first test easier to judge?

[aiangels.io]

Good list. The one thing I'd add to that page is how reversals are handled: refunds, chargebacks, and how long a conversion stays pending before it counts. On subscription offers that is where most disputes start, because a signup can look fine in week one and get reversed in week five.

 

I'd also agree in advance what happens when the partner's report and your own tracking don't match. Either pick whose numbers win, or agree a small tolerance below which nobody chases the difference. That saves an awkward conversation right when you are deciding whether to scale.

 

And write down the payout terms that apply to the test itself: minimum threshold, hold period, payment method. A first test is often too small to reach the minimum, and it is better to know that before it starts.

[InVault]

Good point on a small test never reaching the payout threshold. I’d set two review dates: one for the initial signups and sales, then another after the refund window to see what stayed approved. Keep both reports tied to the same customer batch so later traffic doesn’t muddy the result. That gives both sides a clearer basis for deciding whether to increase spending.

[aiangels.io]

Tying both reports to the same customer batch is the part most people skip. Without it, week-five reversals get netted against week-one signups from newer traffic, and the test looks better than it was. One small addition: agree before the test what reversal rate you'd treat as normal for that offer. Then the second review is a quick yes/no check against a number you both signed off on, not a debate after the results are already in.

[InVault]

I’d put the count next to the percentage as well. One reversal out of five and twenty out of a hundred both show 20%, but they give you different grounds for the next decision. At that second review, separate customer cancellations from tracking or eligibility errors. That makes it easier to agree what to change for the next test.

[aiangels.io]

Good point on putting the count next to the rate. With five conversions, one reversal is mostly noise, so for small tests it may be worth agreeing a minimum count before the reversal rate is even discussed. Splitting cancellations from tracking or eligibility errors also makes it clear who acts on what: cancellations usually point to traffic quality on the affiliate side, while tracking errors sit in the advertiser's setup. Then each side fixes its own part before the next test starts.