ShotodoKey takeaways
- On-device AI processes data on your phone's Neural Engine, so screenshots and personal details never leave the device.
- On-device AI works instantly and offline, while cloud AI offers more capability but depends on a connection.
- Modern iPhones have shipped a Neural Engine since 2017, and iOS 26 runs features like Live Translation and Visual Intelligence directly on the device.
- An AI PC needs at least 40 TOPS of NPU power per Microsoft and Intel's definition, but a recent iPhone already delivers the same benefit.
- On-device models handle small, frequent, personal tasks like screenshot-to-reminder best, with the cloud as a fallback for messy input.
On-device AI means your phone or computer does the thinking itself instead of sending your data to a server somewhere else. For you, that's the difference between a screenshot of a dentist appointment becoming a calendar event privately on your iPhone, or that screenshot traveling to a company's computers first. This guide explains which is better, and when.
What is on-device AI?
On-device AI is when your phone does the smart work itself, on its own chip, instead of sending your data to a company's servers. Most apps do the opposite: they upload your screenshot or message to the cloud, process it there, and send the result back. With on-device AI, the reading and understanding of your screenshot happens inside the iPhone. Apple builds this into iOS using the Neural Engine, a dedicated chip that handles AI tasks on the device, and Apple states that many features process data entirely on your iPhone rather than in the cloud (Apple on-device processing). For you, the difference is simple: your dentist appointment screenshot never leaves your phone, it works even on airplane Wi-Fi, and it's usually faster. That's the model Shotodo uses when turning a screenshot into a reminder, and you can see what's shipped so far in the changelog.
How does on-device AI actually work?
When AI runs on your phone, the thinking happens on the chip inside your iPhone instead of a server somewhere else. Your screenshot never leaves the device. The phone reads the text in the image, works out that "dentist, Tuesday 3pm" is an appointment, and turns it into a reminder or calendar event, all locally. That is why apps like Shotodo can say "screenshot it, it's done" without uploading your family's plans to anyone: see https://shotodo.app/privacy/.
The chip inside your iPhone does the heavy lifting
Modern iPhones have a dedicated part of the processor built for this kind of work, called the Neural Engine. Apple has shipped one in every iPhone since 2017, and iOS 26 uses it to run AI features directly on the device. Because the chip is right there, results come back in a second or two, even in airplane mode.
Why small models are enough for everyday tasks
Cloud AI uses enormous models because it handles everything: poetry, code, legal documents. Reading an appointment time off a screenshot is a much smaller job, so a compact model running on your phone can do it well. Smaller also means faster and more private, since there is nothing to send and nothing to store.
On-device AI vs cloud AI: which is better?
Neither wins everywhere. On-device AI keeps your screenshots private and works instantly, even with no signal. Cloud AI can handle bigger, trickier requests. Here is how they compare:
| On-device AI | Cloud AI | |
|---|---|---|
| Privacy | Stays on your phone | Sent to a server |
| Speed | Instant | Depends on connection |
| Works offline | Yes | No |
| Capability | Smaller tasks | Bigger, harder tasks |
| Cost to run | Free to you | Someone pays per request |
Privacy: what leaves your phone
With on-device AI, the dentist appointment in your screenshot never leaves your iPhone. Apple processes many requests like these entirely on device, and for some features extends that privacy to the cloud by not storing or making your data readable to Apple, as described in Apple's platform security guide. With cloud AI, the content of your screenshot is sent to a company's servers.
Latency and offline use
On-device means no waiting on your connection. Screenshot it at the school gates with one bar of signal and it still becomes a reminder. Cloud AI stalls or fails when you have no service.
Cost and who pays for it
Every cloud request costs the app maker money, which often shows up as subscriptions. On-device running costs nothing per screenshot.
Capability: where the cloud still wins
Cloud models can handle messier, longer, more unusual requests. Shotodo uses on-device reading for most screenshots and falls back to the cloud when needed, so you do not have to choose. See how the whole flow works at https://shotodo.app/screenshot-to-task/.
What are real examples of on-device AI on phones and PCs?
You already use on-device AI every day without opening a single settings menu. If your iPhone suggests the next word as you type, finishes a name when you text a friend, or sorts faces into albums in Photos, that all happens on the phone itself. Your texts and photos aren't sent anywhere for those features to work.
On your iPhone
iOS 26 runs several AI features directly on the phone. Live Translation can translate a conversation without sending it to a server first. Visual Intelligence lets you point your camera at something and ask questions about it. Siri can pull up the email with your flight details because the phone searched your own mail, on the device, rather than uploading your inbox somewhere. Face recognition in Photos, keyboard predictions, and spam call screening all follow the same pattern: the model lives on your phone, and your personal information stays there too.
On-device AI examples in apps you already use
The same pattern shows up in apps built for one job. A screenshot-to-reminder app is a good example: it reads the appointment time and date in your screenshot right on the iPhone, then drops it into Apple Reminders or Calendar. No typing, no waiting on a server, and the screenshot never leaves your phone. That's the whole appeal of the category, and it's why we built Shotodo the way we did (https://shotodo.app/about/). The trade-off is that on-device models are smaller, so they handle simple, well-defined jobs like dates and times better than open-ended questions.
What is an on-device AI PC?
An "AI PC" is a laptop or desktop with a special chip called an NPU that runs AI features on the machine itself instead of sending everything to the internet. Microsoft and Intel require at least 40 trillion operations per second of NPU power for a Windows PC to earn the label, according to IDC's definition of the AI PC category.
Here's the honest answer for a parent: you don't need one. Your iPhone already does this. The same idea, AI running on the device rather than in the cloud, is what lets your phone turn a screenshot of a dentist appointment into a calendar event without uploading the photo anywhere.
If you already own a recent iPhone, you're getting the benefit. Buying an AI PC just to process screenshots would be paying twice for something in your pocket.
When should an app use on-device AI instead of the cloud?
On-device AI is the right choice when a task is small, frequent, and personal: reading a screenshot of a dentist appointment and turning it into a reminder takes a split second and involves private family details. The cloud makes sense when a job is heavy or rare, like writing a long essay, because big servers can handle work your phone can't.
How can you tell which one an app uses? Check the privacy policy and settings for phrases like "processes on your device" versus "data sent to our servers." Apps that work offline, or that ask for no network connection, are a strong signal. If a screenshot app uploads every image before it works, it's cloud-based.
A quick checklist before you trust an app with your screenshots
- Does it work in airplane mode? If yes, it runs on your phone.
- Does the privacy policy say screenshots stay on the device?
- Does it need an account and a subscription just to function?
- Is there a clear reason your data needs to leave your phone?
For family logistics, on-device wins: your kids' appointments are nobody else's business, and you shouldn't wait on a server to add a birthday to your calendar.
What are the limits of on-device AI?
The biggest limit is capability. A phone chip can handle focused jobs like turning a screenshot into a reminder, but it cannot match the largest cloud models at open-ended reasoning or long, complicated documents. If a task needs broad knowledge or heavy thinking, on-device tools either send it to the cloud or give you a weaker answer.
The second limit is hardware. Newer iPhones run these features well; older models may not support them at all or may run them slowly.
The third is awareness. Some on-device features only work offline in certain conditions, and Apple notes that Siri requests are processed on device only when the feature and your device support it (Apple Support). Check what works without a connection before you rely on it.
How Shotodo handles your screenshots: on-device, cloud, or both?
Shotodo reads your screenshot right on your iPhone, so the picture of the dentist card or the school email never needs to leave your phone to become a reminder, calendar event, or contact. That keeps family photos, addresses, and appointment details private, and it works even on spotty Wi-Fi at the sports field.
The honest limits: on-device reading can miss small print on crumpled receipts or handwriting, and it needs iOS 26 or later. When a screenshot is genuinely ambiguous, Shotodo asks you to confirm rather than guessing, so you never end up with a dentist appointment on the wrong day. Screenshot it, check it, it's done.
FAQ
Does on-device AI work without internet or in airplane mode?
Yes. Because the model runs on the chip inside your phone, there is nothing to send anywhere. Turning a screenshot into a reminder works at the school gates with one bar of signal, or in airplane mode entirely. Cloud AI cannot do this: with no connection, the request simply stalls or fails.
Is on-device AI actually more private, or is that marketing?
It is genuinely more private. With cloud AI, the content of your screenshot is sent to a company's servers before anything happens. With on-device AI, the picture never leaves your iPhone, so your kids' appointments and family details stay yours. Apple states that many of its features process data entirely on the device.
Does on-device AI drain my iPhone battery?
The Neural Engine is built for this kind of work, so short, focused tasks like reading a screenshot are quick and lightweight. You will not notice a difference from the occasional reminder. Sustained, heavy AI use of any kind costs battery, but everyday on-device tasks are not a meaningful drain.
Can on-device AI read text from a screenshot as well as cloud AI can?
For simple, well-defined jobs like dates, times, and names, yes, and often faster. For messy input like crumpled receipts or handwriting, cloud models still have an edge. That is why a hybrid approach works well: on-device reading for most screenshots, with the cloud as a fallback when a screenshot is genuinely ambiguous.
Do I need a new iPhone or an AI PC to get on-device AI?
No new hardware purchase is needed if you already own a recent iPhone. On-device features generally require iOS 26 or later, and older models may not support every feature. You do not need an AI PC at all: your phone already does this, so buying one just for screenshots means paying twice.