Sentient OS: a custom on-device vision LLM that understands your entire digital life (every screenshot, note, file, email...), while your device charges overnight. Talk to your data, get proactive reminders, and explore knowledge graphs!

About this article

99% of "AI" apps are just GPT wrappers that pipe your data to cloud LLMs and call it a product. No one's ever created an intelligence layer that understands your entire digital life (all your screenshots, notes, files...) before, because that’d mean sending all your data to the cloud: a privacy nightmare stupidly expensive to analyze 1000s of files But on-device models are generally too dumb and run too slowly. I spent close to a year optimizing every single layer of the on-device AI stack fr...