The vendor published a case study that reported positive campaign outcomes, including click-through performance, high reported return on ad spend, and participation from multiple creators over a defined campaign period.
Critical evaluation / methodology gaps:
- The reported ROAS is not accompanied by a disclosed attribution model, conversion window, or details about fraud controls, incrementality testing, or baseline comparisons.
- No independent verification or third-party measurement report was provided.
- Missing buyer-relevant details: total spend, how “return” is defined (e.g., revenue, installs, LTV), and channel overlap or attribution methodology.
How a buyer should validate:
- Request raw reporting exports and the vendor's attribution methodology
- Request documentation of anti-fraud controls and cohort retention or downstream conversion data if ROAS implies revenue