Explained: Apple's new method for running LLMs on iPhones
Explained: Apple's new method for running LLMs on iPhones
Apple GPT, a large language model (LLM), may soon run on iPhones using a breakthrough flash memory utilization technique. The technique allows LLMs to utilise the abundant flash storage in mobile devices instead of RAM. Apple's researchers developed two key techniques, windowing and row-column bundling, to minimise data transfer and maximise flash memory throughput.
Apple GPT, a large language model (LLM), may soon run on iPhones using a breakthrough flash memory utilization technique. The technique allows LLMs to utilise the abundant flash storage in mobile devices instead of RAM. Apple's researchers developed two key techniques, windowing and row-column bundling, to minimise data transfer and maximise flash memory throughput.
We use cookies to improve your experience on our site and to show you relevant advertising. To find out more, read our updated privacy policy and cookie policy
Through RSS Feeds 
Apple GPT, a large language model (LLM), may soon run on iPhones using a breakthrough flash memory utilization technique. The technique allows LLMs to utilise the abundant flash storage in mobile devices instead of RAM. Apple's researchers developed two key techniques, windowing and row-column bundling, to minimise data transfer and maximise flash memory throughput. 
