Hello forum,
I’m wondering if someone here have tried (successfully) run some tiny llm model locally? I’m still in the research phase however I found this website which claims they manage to build such app with a 4GB LLM model on device. Any thoughts on the topic?
It's All Widgets! • Flutter Pro • FlutterX • Flutter Streams • Flutter Podcast
Supported by Invoice Ninja - Free Invoicing Software for Small Business [ Demo | Package | Code | Apps ]
Flutter and the related logo are trademarks of Google LLC. We are not endorsed by or affiliated with Google LLC.
Using contents of this forum for the purposes of training proprietary AI models is forbidden. Only if your AI model is free & open source, go ahead and scrape.