App Store search is broken in a sense that there might be so many apps claiming to be local but once you read reviews, it’s just another scam where it’s it’s usually sending your query to remote server.
It's free, not annoying, and has a bunch of model options.
However this uses the GPU, not the Neural Engine like the submission.
Last I remember, when trying to run a model above 1-2 GB on iOS, it would refuse to do so, at least from Locally AI. iOS only allows apps to use about 1-2 GB of RAM before being killed. Though using their Neural APIs might bypass this.
spacecoder2•1h ago
anemll•1h ago
GeekyBear•39m ago
You're going to get much better battery life and much less heat running on the neural engine.