PALO A OPENAI, GOOGLE AND NVIDIA: Microsoft has an AI that works on a standard CPU

Foto del autor

By Jack Ferson

From the beginning they have told us that artificial intelligence can only work at home, if we have an integrated chip integrated into the processor or the GPU. But Microsoft is already working with an AI that works on a conventional CPU Is that possible?

This revolutionary AI model is called BitNet b1.58 2B4Tand according to Microsoft herself obtains a performance similar to Llama 3.2 of Google Meta and Gemma 3, both with 1,000 million parameters, in school mathematical problems, and in the PIQA reasoning test. Alibaba also equals Qwen 2.5 with 1,500 million.

According to the creative company of Windows, Bitnet B1.58 2B4T is twice as quickly in obtaining the results, and consumes much less memory. How does it work?

Which is a bitnet, the AI ​​that works without AI chips

A bitnet o red de bits It is a compressed model to function in conventional hardware.

Standard artificial intelligence quantifies the «pesos», the values ​​that define the internal structure of the model, to reduce the number of bits needed to represent those weights. Thus they work faster, and with less memory.

Bitnets manage to quantify those weights in just three values: 1, 0 and -1. This makes them very efficient, and can work in a processor without a chip.

According to account TechCrunchMicrosoft says that Bitnet B1.58 2B4T is the first bit network with 2,000 million parametersequivalent to pesos. They have managed to train this AI with 4 billion tokens, the equivalent of 33 million books, to achieve the aforementioned results.

The only limitation is that this bitnet needs to operate the framework of Microsoft called Bitnet.cpp. Therefore it only works in the processors that the company of Satya Nadella chooses. Some Intel CPUs have been confirmed, and even Apple M2. You can try it and download it for free in Hugging Face.

Does this mean that AI does not need AI chips? Not quite. The Bitnets They have limited yield and abilities. But they show that, in the future, many basic functions of AI may be used in conventional processors.

Know How we work in NoticiasVE.

Tags: Artificial Intelligence, Microsoft, CPU, processors

Deja un comentario