Public marketing materials include vendor-stated metrics such as low false positive rates and large improvements in remediation speed or automation rates. Specific claims observed in vendor content include reported false positive characteristics and automation outcomes.
Critical evaluation:
- Methodologies and sampling for these claims are not publicly disclosed.
- Vendor-reported customer outcomes may be selective and not independently verified.
Recommended buyer actions:
- Request definitions and measurement methodologies for false positive rates (precision, recall, sampling)
- Seek benchmarks broken down by application type (API-only, SPA, legacy)
- Conduct a pilot with explicit acceptance criteria (precision/recall, time-to-remediate, CI build impact)