⟩ Key Questions to Ask
Should user content be centralized on cloud (AWS, GCP, Azure etc.), or private server (Mac Mini?) or smart phone?
Big techs want you to use their cloud services for everything of your work and life, the reason you heard news of the giant data center, with huge financial pressure of GPU depreciation. Yes they are desperate. But, do you really trust them fully? Private server or smart phone on edge might be safer. You can have more options to execuate a task on a private server as you are the admin, while smart phone with less options might be the best because link to data on private server could still be risky.
Should user rely on local open source LLM or commercial APIs?
Open source LLMs are getting better and better, and could be run on local GPU or even phone with the help of optimized frameworks. But, today they are still not comparable to commercial APIs in terms of capability and reliability. On the other hand, commercial APIs have concerns of data privacy and cost. A flexible solution is to support both. |
⟩ What It Does
Autonomous agent that can plan, execute, and report tasks with user content on an iPhone.
Flexible models via API provider with subscription, or use your private Ollama server for free.
|
⟩ Works With Native iPhone Apps |
