cohere-cost-tuning

# Cohere Cost Tuning ## Overview Optimize Cohere costs through model selection, token budgets, embedding compression, and usage monitoring. Cohere pricing is token-based with separate input/output rates. ## Prerequisites - Cohere production key (trial is free but limited) - Access to [dashboard.cohere.com](https://dashboard.cohere.com) billing page ## Cohere Pricing Model **Key principle:** Cohere charges per token. Input tokens and output tokens have different rates. Embed, Rerank, and Classify have separate pricing based on search units. | Tier | Access | Rate Limits | Cost | |------|--------|-------------|------| | Trial | Free | 5-20 calls/min, 1000/month | $0 | | Production | Metered | 1000 calls/min, unlimited | Per-token | ### Model Cost Comparison | Model | Input (per 1M tokens) | Output (per 1M tokens) | Best For | |-------|----------------------|------------------------|----------| | `command-r7b-12-2024` | Lowest | Lowest | High-volume, simple tasks | | `command-r-08-2024` | Low | Low | RAG, cost-effective | | `command-r-plus-08-2024` | Medium | Medium | Complex reasoning | | `command-a-03-2025` | Higher | Higher | Best quality | ### Non-Chat Pricing | Endpoint | Pricing Unit | Notes | |----------|-------------|-------| | Embed | Per input token | Batch 96 texts to minimize calls | | Rerank | Per search unit | 1 query + N docs = 1 search unit | | Classify | Per classification | Charges per input classified | ## Instructions ### Strategy 1: Model Tiering ...