- Source quality: Several outcome claims appear in vendor materials or press-distribution channels; these are closer to vendor PR than independent validation.
- Missing methodology: Case study claims typically omit detailed definitions for automation (contained vs solved vs assisted), time periods, CSAT impact, guardrails, or segment exclusions.
Recommendation for buyers: Treat vendor case studies as hypotheses to be validated in a structured pilot that measures baseline containment/deflection, CSAT, and error/incorrect-resolution rates. Define success metrics clearly (for example, target containment at stable CSAT or reduced average handle time) and audit incorrect-response rates on critical intents.