Why you need this tiny offline AI #ai #developer #shorts
https://sharbel.com/r/needle?src=yt-desc
Someone built an AI model small enough to run on a phone with no internet, and put it out under Apache 2.0.
It's called Needle 3, from Cactus Compute. The whole model is a single file between 8 and 29 MB, and it's built for tool calls rather than chat: you give it the functions your app exposes, and it picks the right one and fills in every argument from what the user said. No API key, no account, no per-call bill.
The link above has the model, the repo, the install command and the honest caveats, including the one that matters: this is not a chatbot