Qualcomm held a one day analyst event in San Diego updating us all on their AI research. Pretty amazing stuff, but the big news is yet to come with a new Oryon-based Snapdragon expected this Fall, and perhaps a new Cloud AI 100 next year.
Qualcomm was pretty confident last week that their AI edge in, well, the edge, is strong and getting stronger. Most of what they covered was known, and we covered a lot of itWhile the rush is on to make AI ever larger, with mixture of expert models exceeding one trillion parameters, Qualcomm has been busy squeezing these massive models down so they can fit on a mobile device, a robot, or in a car.
Qualcomm showed off some data that says an optimized 8B parameter Llama 3 model can yield the same quality as a 175B parameter GPT 3.5 Turbo model., and runs really fast on Snapdragon 8 Gen 3 powered phones. Spokespeople said that this tiny chip, which runs on less electricity than an LED lightbulb, can generate AI imagery 30 times more efficiently than data center infrastructure in the cloud.
More interesting, Qualcomm confirmed that it will announce the next step in Snapdragon SoCs this fall, and that it would be based on the same Oryon cores that power its laptop offering, the Snapdragon X Elite. Stay tuned!The Cloud AI 100 Ultra has been getting a lot of wins of late, with nearly every server company providing support as well as public clouds like AWS.
And for the first time we are aware of, a Qualcomm engineer confirmed that they are working on a new version of the AI100, probably using the same Oryon cores as the X Elite, which they acquired when the company bought Nuvia. We expect this third-generation of Qualcomm’s data center inference engine will focus on generative AI. Ultra has established a strong foundation for Qualcomm, and the next generation platform could be a material added business for the company.
Ai Ai Latest News, Ai Ai Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Source: verge - 🏆 94. / 67 Read more »