Envoy
:::info Status: roadmap (stub) The Envoy adapter is scaffolding. Capabilities below are intended scope, not yet implemented. The reference adapter today is LiteLLM. :::
Intended integration
| Capability | Mechanism (planned) | Notes |
|---|---|---|
| Request transform | ext_proc (external processing, gRPC) → POST {OPTIMIZER}/v1/optimize | Strong rewrite support — ext_proc can mutate request bodies and headers. |
Cache hit (canShortCircuit) | ext_proc | Served directly from the processor. |
| Response transform | ext_proc → POST {OPTIMIZER}/v1/optimize-response (+ /v1/cache) | Expected to work. |
Envoy's ext_proc is one of the most capable hooks of any target — it can both rewrite the
request and serve a response directly, so it can report canShortCircuit: true and do
both request transforms and direct cache-hit serving. The processor will be its own
package and speak Optimizer Protocol v1
(/v1/optimize, /v1/optimize-response, /v1/cache).
Want this sooner?
See adding a new gateway and track status in
integrations/README.md.