Nvidia Reveals New AI Chip, Expects Significant Drop in LLM Running Costs

  • 📰 CNBC
  • ⏱ Reading Time:
  • 18 sec. here
  • 2 min. at publisher
  • 📊 Quality Score:
  • News: 10%
  • Publisher: 72%

Ai Ai Headlines News

Ai Ai Latest News,Ai Ai Headlines

Nvidia reveals new A.I. chip, says cost of running large language models will 'drop significantly'

Nvidia's GH200 has the same GPU as the H100, Nvidia's current highest-end AI chip, but pairs it with 141 gigabytes of cutting-edge memory, as well as a 72-core ARM central processor.

Nvidia's new chip, the GH200, has the same GPU as the company's current highest-end AI chip, the H100. But the GH200 pairs that GPU with 141 gigabytes of cutting-edge memory, as well as a 72-core ARM central processor. Oftentimes, the process of working with AI models is split into at least two parts: training and inference.

 

Thank you for your comment. Your comment will be published after being reviewed.
Please try again later.
We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

 /  🏆 12. in Aİ

Ai Ai Latest News, Ai Ai Headlines