Apple has released a family of several large language models (LLM) designed for open source run on the device instead of on cloud serversboth on personal devices and on laptops or mobile phones, which is an important advantage.
Under the name of OpenELMthis Apple artificial intelligence will employ a strategy of Layered scaling to efficiently drive parameters within each model layer and will focus on specific tasks so that users get more accurate results. In addition, the fact that you do not have to require cloud servers will provide better privacy.
This is OpenELM, Apple’s new family of language models
According to Macrumorsthe new family of language models of the Cupertino brand is composed by four models represented in various sizes: 270 million parameters, 450 million, 1.1 billion and 3 billion. Apple uses a layered scaling strategy that aims improve accuracy and efficiency.
Apple brand engineers indicate, within a technical documentwho have managed to execute them in a MacBook Pro with M2 Max chip and 64 GB of RAM and on a computer with Intel i9-13900KF CPU, which is equipped with DDR5-4000 DRAM and NVIDIA RTX 4090 GPU with 24 GB of VRAM. After carrying out several tests, they have confirmed that OpenELM achieves greater efficiency compared to other language models.
Specifically, it shows a 2.36% improvement in accuracy compared to OLMo and requires twice as many pre-training tokens. They also comment that these models are being launched for enhance and enrich open research. This will allow researchers to Study data and model riskswhich were trained with data from Wikipedia, Reddit, Githubamong others.
OpenELM is available on Hugging Face Hub, an AI code sharing community, under a sample code license that allows commercial use as well as modification. Of course, Apple recognizes that makes no guarantees about the accuracy and security of the data generated. These LLMs are not incorporated yet, but are expected to iOS 18 includes a host of new AI features and that they can arrive.
Sign up for our newsletter and receive the latest technology news in your email.
