- Enterprise buyers requiring formal compliance and security assurances
- Security certifications and formal compliance documentation were not clearly documented in the materials reviewed.
- Buyers requiring predictable SLAs and single-vendor accountability
- When access is provided through third-party gateways, reliability, support, and incident response depend primarily on the selected gateway operator rather than solely on the protocol.
- Workloads involving consistently very large prompts/contexts
- Project documentation references systematic issues for sustained large payloads (greater than approximately 50k tokens) and recommends splitting requests; intensive large-context workloads should be validated with proof-of-concept testing.
- Use cases that require frontier proprietary model performance
- If an application requires performance levels provided by top-tier proprietary models, lower-cost OpenAI-compatible endpoints that expose alternative models may not meet application-specific requirements.
- Current limitations acknowledged by project documentation
- The project documentation identifies a recurring limitation for sustained large payloads (greater than roughly 50k tokens) and recommends splitting requests as a mitigation. This should be validated with proof-of-concept testing for relevant workloads.
- Features on the roadmap (not yet available)
- Third-party ecosystem materials reference roadmap items such as multi-model support, distributed training primitives, and confidential computing. These references were not official protocol roadmap pages and should be treated as unverified unless confirmed by project maintainers.
- Scale limitations
- No rigorous, third-party benchmarks were located. Project and gateway documentation that advises retries and splitting large payloads suggests that capacity heterogeneity and runtime variability can affect real-world performance.
- API limitations / integration constraints
- OpenAI-compatible endpoints offered by gateways do not guarantee perfect feature parity across operators; behaviors for streaming, tools integration, and structured outputs may vary by gateway implementation.