Skip to main content

Multi-provider Routing

Based on examples/multi-provider.

Idea

  • Route requests to different LLMs based on task (cost/latency/quality).
  • Example: use gpt-5.6-luna for chit-chat, claude-sonnet-5 for tool use, gemini-3.5-flash for vision.

Approach

  • Instantiate multiple providers and select per turn using your own logic.
  • Expose a provider field in requests from the client, or infer from message content.

Run

npm install
npm run dev

Ensure all required API keys are set for the providers you route to.