Why AI Needs Optics: Scale-Up Networks, KV Cache and the Copper Wall
Executive Vice President and General Manager of the Custom Cloud Solutions Business Will Chu and Executive Vice President and General Manager, Data Center Networking Business Group Dave Lazovsky join John Furrier on theCUBE after the Marvell Investor Day to explain why AI infrastructure is hitting the copper wall and what comes next. They break down how KV cache pressure drives the need for larger scale-up networks, why copper limits those networks to a single rack, and how moving to optics can extend scale-up beyond 500 XPUs while cutting power by up to 50% in round-trip memory transactions.
