I’m exploring how to integrate an AI chatbot into a Flutter application and would like to hear from developers who have implemented something similar.
The chatbot should maintain conversation history, provide contextual responses, and potentially retrieve information from the app’s own backend or database. I’m considering using an LLM API with a Flutter frontend and a separate backend layer.
For a production app, would you recommend connecting Flutter directly to an AI API, or keeping the AI logic behind a backend service? How would you handle conversation memory, authentication, API-key security, streaming responses, and rate limiting?
Also, has anyone tried using Firebase AI, MCP, or another approach for building AI-powered chat experiences in Flutter?
What architecture has worked best for you?