Nvidia debuts upgraded GH200 Grace Hopper chip with high-speed memory - These new chips have memory that is directly integrated and accessible by the CPU. They are particularly good for AI workloads because the memory can be used to store intermediate values calculated by each layer of a neural network. That makes them much faster since large language models spend significant amounts of time moving this type of data from memory to the CPU. siliconangle.com #