- Official/public case studies
- No customer case studies were found on the official site during this research.
- Vendor-published benchmark as a case-study proxy: CUB
- Theta published "Introducing CUB: Theta’s Computer Use Benchmark" (published May 2025), describing a large set of end-to-end workflows across multiple industries, created with domain experts (accountants, investment bankers, clinicians).
- Theta reports that several leading agents scored at very low levels overall on the benchmark and that full end-to-end completion instances were infrequent in the initial evaluation.
- Critical evaluation
- Strength: Publishing a benchmark with low absolute scores can be interpreted as an indication that the benchmark authors did not select only favorable comparisons.
- Limitations:
- Benchmark design, scoring, and environment realism materially affect outcomes; no independent replication of CUB results was found in public sources.
- Synthetic versions of enterprise platforms may not capture authentication, data quality, permissions, or UI customizations present in production environments.
- Vendor performance claim (memory-layer improvement)
- YC Launch materials present a vendor-reported result that adding a memory layer substantially improved a particular agent's accuracy and substantially reduced the number of steps required.
- Critical evaluation
- The methodology, dataset, and baseline were not documented in a way that enables independent verification.
- Buyers should request detailed evaluation artifacts, including success criteria, task definitions, sample sizes, variance measures, and evidence that tasks reflect the buyer's operational context.