A small Caltech spinout called PrismML has done something that looked implausible a year ago: it compressed a 27-billion-parameter large language model down small enough to run entirely on an iPhone, and Apple is now evaluating the technology. PrismML CEO Babak Hassibi told CNBC that Apple and other companies have been measuring the startup’s models for speed, energy efficiency, and on-device performance. “They’re really evaluating our technology right now,” Hassibi said, characterizing the talks as very early but progressing. For Apple, whose entire AI strategy hinges on keeping processing on the device rather than in the cloud, the timing could hardly be more pointed.
What PrismML Actually Did
The demonstration that got Apple’s attention: PrismML took Alibaba’s open-source Qwen 3.6 model, which has 27 billion parameters and weighs roughly 54 gigabytes in standard precision, and shrank it to under 4 gigabytes, a compression ratio above 90%, and ran it on an iPhone 17 Pro. Crucially, the company claims no meaningful loss in performance, and says the compressed model can still handle complex chat, reasoning, fully autonomous agents, and software coding. The startup publicly released compressed versions of Qwen under an Apache 2.0 license, along with custom kernels for Apple’s Metal framework so the models run on iPhone and Mac hardware. By PrismML’s numbers, the compressed models use 10 to 15 times less memory, generate responses 6 to 8 times faster, and consume 3 to 6 times less energy than full-precision versions on existing hardware.
The Trick: One Bit Instead of Sixteen
The core method is extreme quantization. Where conventional models store each internal weight as a 16-bit floating-point number, PrismML reduces each value to just one of a handful of possibilities, using 1-bit or ternary architectures where every weight is simply -1, 0, or +1. Hassibi compared it to the chip industry’s move from 8-bit to 4-bit computing, but taken further. The reason this saves so dramatically on both memory and energy is intuitive: multiplying by 1 or 0 is trivial compared to full floating-point math, so the model needs far less storage and far less power to run. PrismML is careful to frame the achievement as mathematics rather than an AI breakthrough, the work comes out of years of neural-network compression research at Caltech, not a new model or a cleverer training recipe.
Why This Matters for Apple Specifically
Apple has been fighting a losing battle against a hard constraint: the most capable AI models are simply too big for a phone. The most advanced parts of Siri are still large enough that Apple runs them on Nvidia chips inside Google Cloud, exactly the cloud dependency Apple wants to escape. Apple’s own new on-device model, AFM 3 Core Advanced, has 20 billion parameters but uses a sparse architecture where only 1 to 4 billion are active at any moment, a workaround that limits capability. PrismML’s compressed Qwen, by contrast, keeps all 27 billion parameters active simultaneously while fitting in under 4GB. If Apple could run models that large and dense on-device, it could move demanding features, computational photography, video generation, health and fitness tools handling sensitive personal data, off the cloud entirely, improving both speed and privacy. As analyst Carolina Milanesi of Creative Strategies put it, the more you can do on-device, the better, especially for health and medication data users want kept private.
The Backers
PrismML emerged from stealth earlier this year as a spinout of the California Institute of Technology, co-founded by Babak Hassibi, a professor of electrical engineering, alongside other PhDs who did the underlying compression research. It raised a $16.25 million seed round backed by Khosla Ventures, OpenAI’s first venture investor, along with Cerberus Capital and Caltech itself. Vinod Khosla has publicly called the work a “mathematical breakthrough” that could shift AI away from data-center dominance toward efficient edge deployment. The company frames its ambitions well beyond phones, positioning the technology for laptops, robotics, wearables, and industrial edge devices, and says it eventually intends to compress even trillion-parameter models to run locally.
Insight: The Skeptic’s Case on Chip Demand
The most interesting question isn’t whether PrismML’s compression works, it’s what happens to chip demand if it does, and here the analysts urge caution. The instinctive read is that shrinking models means needing far fewer chips, a potential threat to the memory and datacenter-GPU buildout driving the entire AI trade. But Gil Luria of D.A. Davidson argues that’s the wrong conclusion. Compression doesn’t eliminate the need for processors and memory, he says, it relocates them: “You’re still going to need the GPU, and you’re still going to need the memory.” Moving AI onto hundreds of millions of individual phones can actually be less efficient than shared datacenter infrastructure, because chips sitting in a phone are idle most of the time, whereas datacenter GPUs run near-continuously across many users. In other words, on-device AI might shift where the silicon lives rather than reduce how much is needed, and could even increase total memory demand as every premium phone ships with more RAM to hold these models. That nuance matters for anyone reading this as bearish for memory suppliers.
Insight: The Claims Still Need Independent Proof
Every number in PrismML’s pitch, the 90%-plus compression, the “no performance loss,” the speed and energy multiples, currently comes from the startup itself. Extreme quantization normally degrades a model’s accuracy, sometimes severely, which is precisely why “compress it and lose nothing” is such a strong claim. The fact that PrismML open-sourced its models under Apache 2.0 helps, because it invites the research community to verify the performance independently rather than taking marketing figures on faith. And Apple’s willingness to sit at the table is itself a meaningful signal, a company that runs its own compression research wouldn’t bother evaluating an outside startup unless it saw a genuine gap between what its models deliver and what the hardware could theoretically support. But “Apple is evaluating” is not “Apple is partnering,” and definitely not “Apple is acquiring.” The talks are exploratory, with no agreement, timeline, or deployment confirmed, and there’s no guarantee they lead anywhere.
Insight: A Broader Rewiring of Where AI Runs
Step back and PrismML is one data point in a larger structural question the whole industry is circling: how much AI belongs in the cloud versus on the device. The cloud model has three well-known pain points, privacy (data that leaves the device can be intercepted or subpoenaed), cost (every query to a remote GPU costs money, multiplied across hundreds of millions of users), and latency (a round trip to a datacenter is slower than local inference, which matters enormously for voice assistants and camera features). Compression that genuinely preserves capability attacks all three at once. If techniques like PrismML’s mature, the competitive advantage in consumer AI could tilt toward whoever controls the device and its silicon, which is exactly the position Apple has spent years and billions building toward with its Neural Engine. The irony is that Apple may end up needing an outside startup’s math to finally unlock the on-device strategy its own hardware was designed for.
What to Watch Next
Three things will tell whether this becomes real. First, independent benchmarks: now that the compressed models are open-source, third-party researchers can confirm or puncture the “no performance loss” claim, and that verdict will matter more than any demo. Second, whether Apple’s exploratory talks convert into a partnership, an acquisition, or nothing, Apple has bought AI startups before, but evaluating is not committing. Third, the competitive response: if compression this aggressive holds up, expect the other frontier labs and device makers to move fast on their own edge strategies, and expect memory and chip analysts to start modeling what a shift from datacenter to device actually does to demand. For now, PrismML has cleared the hardest bar, a working iPhone demo of a model this size, but the distance between a compelling demo and a shipping product is exactly where most breakthroughs stall.
Leave a Reply