On-device AI offers privacy, offline use, predictable marginal cost, and low network latency. Cloud models offer broader capability, larger context, and consistent behavior across supported devices.
Choose per task, not per app. Keep sensitive lightweight work local, route demanding jobs to the cloud with consent, and provide fallbacks for unavailable models. Evaluate quality and latency on the actual device mix your users have.