Multi-provider Routing
Based on examples/multi-provider.
Idea
- Route requests to different LLMs based on task (cost/latency/quality).
- Example: use
gpt-5.6-lunafor chit-chat,claude-sonnet-5for tool use,gemini-3.5-flashfor vision.
Approach
- Instantiate multiple providers and select per turn using your own logic.
- Expose a
providerfield in requests from the client, or infer from message content.
Run
npm install
npm run dev
Ensure all required API keys are set for the providers you route to.