Switching LLM providers

One of the powerful features of this project is LiteLLM support. You can switch between OpenAI, Anthropic, Google, and other providers just by changing your .env file.

Yes! LiteLLM supports Ollama too. Set DEFAULT_MODEL=ollama/llama3 and make sure Ollama is running locally. The tradeoff is that local models are usually less capable at complex SQL generation and analysis than cloud models, so expect some quality differences.

You can now run your chatbot with any LLM provider. Next, we will explore customization challenges to make the system your own.