Skip to main content

Local-only Assistant

Based on examples/local-only and examples/local-assistant.

Stack

  • Ollama (LLM)
  • FasterWhisper (STT)
  • Piper (TTS)
  • Optional vision: gemma3, llava, or llama3.2-vision (via OllamaLLMProvider)

Run

LOCAL_ONLY=true \
OLLAMA_BASE_URL=http://localhost:11434 \
FASTER_WHISPER_URL=http://localhost:9000 \
PIPER_URL=http://localhost:5002 \
npm run dev

Use this when you need offline/air-gapped deployments.