# LLMWise

> Auto-first AI routing and orchestration platform. Start with a free preview, use Starter for the curated Auto lane, and move to Teams for manual GPT, Claude, and Gemini Pro access. One API key, token-settled billing, compare/blend/judge workflows, and failover routing.

Base URL: https://llmwise.ai
API base: https://llmwise.ai/api/v1
Auth: Bearer token (API key with `mm_sk_` prefix) or Clerk JWT
Streaming: Server-Sent Events (SSE)
Compatibility: OpenAI-style messages (role + content)

## API Endpoints

- `POST /api/v1/chat` — Chat and Auto routing. Final billing settles from actual token usage. Manual premium models require Teams.
- `POST /api/v1/compare` — Teams workflow. Same prompt to 2-9 models simultaneously, streamed side-by-side, then settled from actual combined token usage.
- `POST /api/v1/blend` — Teams workflow. Multi-model synthesis with 6 strategies; final billing reflects the actual workflow token usage.
- `POST /api/v1/judge` — Teams workflow. Contestants + judge are billed from actual token usage after evaluation finishes.
- `POST /api/v1/chat` with `routing` — Mesh failover. Circuit breaker auto-failover on 429/500/timeout with actual token-settled billing.

## Blend Strategies

- **consensus** (default): Combine strongest points, resolve contradictions. 2-6 models, 1 layer.
- **council**: Structured deliberation — agreements, disagreements, follow-ups. 2-6 models, 1 layer.
- **best_of**: Pick best response, enhance with others. 2-6 models, 1 layer.
- **chain**: Iterative sequential integration. 2-6 models, 1 layer.
- **moa**: Mixture-of-Agents multi-layer refinement. 2-6 models, 1-3 layers. Models see previous layer answers.
- **self_moa**: Single model, 2-8 diverse candidates via temperature variation + agent prompts. 1 model, 1 layer.

## SSE Streaming Format

All endpoints stream via SSE. Each line: `data: {JSON}`. Terminator: `data: [DONE]`.
Standard chunk: `{model, delta, done, latency_ms, content_length}`
Final chunk adds: `{ttft_ms, prompt_tokens, completion_tokens, tokens_per_second, cost, finish_reason, full_content}`
Mesh events: `route` (trying/failed/skipped), `chunk` (content), `trace` (summary with final_model, attempts, total_ms)

## Error Codes

- 400: Bad Request (invalid body, unknown model)
- 401: Unauthorized (missing/invalid auth)
- 402: Payment Required (no included plan usage remaining and no add-on credits available)
- 429: Too Many Requests (rate limited — check Retry-After header)
- 502: Bad Gateway (upstream provider error)

## Plans

- Free: 5 messages total to preview the product
- Starter: $29/mo, 10M tokens/month, Auto lane only
- Teams: $99/mo, 20M tokens/month, Auto + manual GPT, Claude, and Gemini Pro access
- Add-ons: after included plan tokens are exhausted, subscribers can buy add-on credits
- Legacy wallet users remain supported

## Rate Limits

Token bucket, 60s window. Headers: X-RateLimit-Limit, X-RateLimit-Remaining, X-RateLimit-Reset, Retry-After.
Buckets: chat=90, compare=45, blend=30, judge=30, uploads=30, default=180 (per 60s).
Multipliers: paid=1.5x, free=0.6x. IP limits: free=120/60s, paid=360/60s.

## Docs

- [Getting Started](https://llmwise.ai/docs/getting-started): Quickstart guide — API key setup, first request, streaming
- [Dashboard User Guide](https://llmwise.ai/docs/dashboard-user-guide): Web UI walkthrough — chat, compare, settings
- [Authentication & API Keys](https://llmwise.ai/docs/authentication-and-api-keys): Auth methods, API key management, BYOK
- [Chat API Reference](https://llmwise.ai/docs/chat-api-reference): POST /api/v1/chat — models, parameters, streaming format
- [Compare, Blend & Judge Reference](https://llmwise.ai/docs/compare-blend-judge-reference): Multi-model endpoints — compare, blend, judge
- [Blend Strategies & Algorithms](https://llmwise.ai/docs/blend-strategies-and-algorithms): Deep dive into all 6 blend strategies, MoA, circuit breaker, auto-router, optimization scoring
- [Mesh Mode Tutorial](https://llmwise.ai/docs/mesh-mode-tutorial): Failover routing, circuit breakers, strategies
- [Billing, Plans & Add-ons](https://llmwise.ai/docs/billing-and-credits): Plans, add-on credits, auto top-up, settlement
- [Rate Limits & Reliability](https://llmwise.ai/docs/rate-limits-and-reliability): Rate limiting, concurrency, error handling
- [Privacy, Security & Data Controls](https://llmwise.ai/docs/privacy-security-and-data-controls): Zero-retention mode, data policies, BYOK encryption

## Guides

- [Replay Lab Tutorial](https://llmwise.ai/docs/replay-lab-tutorial): Test model switches against historical requests
- [Regression Testing](https://llmwise.ai/docs/regression-testing-tutorial): Automated quality checks across model versions
- [Semantic Memory API](https://llmwise.ai/docs/semantic-memory-api): Per-user conversation context via embeddings
- [Webhooks & Sync](https://llmwise.ai/docs/webhooks-and-sync): Clerk and Stripe webhook integration
- [API Explorer](https://llmwise.ai/docs/api-explorer-playground): Interactive API playground

## Optional

- [Full compiled docs](https://llmwise.ai/llms-full.txt): Complete platform documentation in plain text
- [Machine-readable view](https://llmwise.ai/ai): Structured HTML overview for AI agents with full API schemas
- [Landing page machine mode](https://llmwise.ai): Toggle "Machine" button for structured API reference