Cost arbitrage
Send a model that runs on several platforms to the cheapest one for you, counting your committed-use discounts and credits. The model never changes.
The same model is often available on several platforms: Claude on the Anthropic API, AWS Bedrock and Google Vertex AI, for example. Their prices differ, and your own discounts and credits make the difference larger. Cost arbitrage sends each request for such a model to whichever platform is cheapest for you. It never changes which model runs; that is auto mode’s job.
Cost arbitrage is off by default.
Setting it up
Open Admin → Cost policies → Cost arbitrage (requires the Connect and disconnect AI provider accounts permission). For each model and platform you can enter:
| Field | Meaning |
|---|---|
| List price | Supplied by ACOG from the provider’s published prices |
| Reserved rate | Your committed-use price, if you have one |
| Reserved left | How much committed capacity remains |
| Credits left | Provider credits you want used first |
Fill in only what you have. ACOG uses the cheapest platform for each request, given what you entered. Changes apply from the next request.
Interaction with routing
Cost arbitrage can move a model your default connection declares to another platform (see Routing and failover). An x-acog-channel header on a request overrides it. If you need traffic to stay in one region, leave cost arbitrage off or declare the model only on connections pinned to that region.