- Scenarios where alternatives are better
- Regulated enterprise workloads
- Organizations that require documented security attestations, explicit subprocessor lists, SSO/SCIM, and residency controls should consider vendors that publicly document these controls or self-hosted routing solutions.
- Simple model routing needs
- If an organization only needs multi-model routing without payments or an integrations marketplace, established multi-model gateways or self-hosted proxies may be simpler.
- Ultra-low cost sensitivity
- If any possible gateway markup would materially impact unit economics, direct-to-provider integrations may be less costly.
- Maximum control / minimum dependency
- Projects that require deterministic caching and complete control over tool-calling behaviors may prefer a self-hosted router layer.
- Red flags in the purchasing process to watch for
- Pricing opacity (difficulty exporting or auditing live pricing)
- No published security attestations
- Unclear incident/status reporting and lack of public SLAs
- Current limitations acknowledged by the vendor
- The vendor does not publish a consolidated list labeled as "known issues" in the accessible documentation reviewed for this report.
- Roadmap / not-yet-available features
- Future product roadmap items were not clearly documented in the sources reviewed.
- Scale limitations
- No public, documented scale limitations were identified in accessible sources.
- Security or compliance gaps
- Security certifications and enterprise compliance attestations were not publicly documented in the accessible sources.
- Technical debt / architectural limitations mentioned in reviews
- No product-specific reviews addressing technical debt were found; general community concerns relate to long-term maintenance burdens of multi-provider gateways.
- API limitations or integration constraints
- In any OpenAI-compatible proxy, provider-specific parameters and feature differences can create integration complexity. Tool calling, streaming, and multimodal behavior may diverge across underlying providers, requiring engineering effort to normalize behaviors.