Generative AI has exploded over the past year, with a series of applications being released to create text, photos, music and even general-purpose assistants.
The latest sign that phone manufacturers are welcoming generative AI from Google.
SoC chip on Google phones.
This is made possible thanks to the Tensor G3 chip, with a much improved Tensor processing unit (TPU) compared to last year.
Google is not the only phone company using artificial intelligence at the hardware level.
Qualcomm’s Snapdragon chip is the heart of many of the world’s leading Android smartphones, causing users to place expectations on the AI-generated operating capabilities of the Snapdragon 8 Gen 3 model.
Qualcomm earlier this year demonstrated a version of the Stable Diffusion text-image generation application running on Snapdragon 8 Gen 2 devices. This suggests that image generation support could be a new feature on Gen 3 chipsets, especially when
Qualcomm senior director Karl Whealton said upcoming devices `can do almost anything you want` if their hardware is powerful, efficient and flexible enough.
Several smartphones with 24 GB RAM were also launched this year, signaling that they could be leveraged for generative AI models.
AI models are often loaded and reside continuously in RAM, as conventional flash memory significantly increases application load times.
`People want to reach 10-40 tokens per second. That will ensure good results, providing almost real-life conversations. This speed can only be achieved when the model is in RAM, which is
Close-up of Snapdragon 8 Gen 2 chip. Photo: Qualcomm
However, this does not mean that smartphones with low RAM will be left behind.
`Generative AI on the device will not set a minimum RAM level, but the amount of RAM will be proportional to the level of feature enhancement. Phones with low RAM will not be out of the game, but the results from generative AI will
Qualcomm communications director Sascha Segan proposed a hybrid plan for smartphones that cannot accommodate large AI models on the device.
According to experts, generative AI models will play an increasingly important role on upcoming mobile devices.
