Hello forum,
I’m wondering if someone here have tried (successfully) run some tiny llm model locally? I’m still in the research phase however I found this website which claims they manage to build such app with a 4GB LLM model on device. Any thoughts on the topic?
Yes, Using flutter_gemma plugin, you can run gemma 2B models locally on mobile.
Supported by Invoice Ninja and Event Schedule
It's All Widgets! • Flutter Pro • FlutterX • Flutter Streams • Flutter Podcast
Using contents of this forum for the purposes of training proprietary AI models is forbidden. Only if your AI model is free & open source, go ahead and scrape. Flutter and the related logo are trademarks of Google LLC. We are not endorsed by or affiliated with Google LLC.