The AIHW and Edge AI Summit had a treasure trove of insightful presentations from luminaries such as Andrew Ng, Lip-Bu Tan, Marc Tremblay, and many others. I hope to get around to writing about what I learned, but first, I want to share the innovations from a startup called Enfabrica. The company recently raised a $125M Series B funding round, led by Atreides and Nvidia as a strategic investor.
Nvidia CEP Jensen Huang does not fear technologies that disrupt the status quo. He embraces them if they advance performance and lower costs.While Enfabrica could replace a lot of NICs he sells, it is a far more elegant solution.EnfabricaThe Enfabrica ACF-S acts like Pac-Man, gobbling up existing silicon products and replacing them with an integrated solution that is far more cost-effective and lowers latencies.
The image below shows that the ACF-S provides direct access to pools of CXL-attached DDR5 DRAM with only four microseconds latency and 400 GB/s aggregate bandwidth. In this vision, there are no more PCIe, NICs, or isolated CPU-attached DRAM. The system integrates HBM-equipped GPUs connected over NVLink and ACF-s interfacing to other nodes and shared memory.
with a single chip, add shared memory over the network to reaplce the NVMe, while the combination of GPU and CPU on a single package eliminates the stand-alone CPU.It is pretty cool to imagine how this technology will impact system design. Everything is shared, everything is connected with lower power and everything will be faster. You can even run your GPUs at a higher clock frequency as you aren't cooling the now-discarded components.
In the future, Nvidia and OEMs may ship more dense and streamlined systems, replacing NICs and PCIe switch revenue with Enfabrica switch revenue.
Ai Ai Latest News, Ai Ai Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
The 10 Biggest Business Trends For 2024 Everyone Must Be Ready For NowDiscover the top business trends for 2024, from the rise of generative AI and the emphasis on soft skills to the importance of sustainable practices and data monetization
Source: ForbesTech - 🏆 318. / 59 Read more »
Source: engadget - 🏆 276. / 63 Read more »
Source: nbcchicago - 🏆 545. / 51 Read more »