Spice AI provides a runtime called Spice that combines the following capabilities:
- Federated SQL query across disparate sources (databases, warehouses, data lakes, APIs).
- Acceleration/materialization/caching using engines such as DuckDB, SQLite, and Arrow.
- Hybrid search (vector + keyword/full-text) accessible via SQL.
- LLM inference and an OpenAI-compatible gateway to enable model calls with governance and observability from the same runtime.
The product is designed to consolidate components commonly used together (query engine, cache, vector store, inference gateway, and integration code) into a single runtime that can be deployed adjacent to applications ("sidecar" / app-adjacent runtime) rather than only as a centralized analytics cluster. This architectural choice introduces tradeoffs discussed later.
Sources: product site and documentation, open-source README.