The Memory Pyramid Is Breaking—Here's What Replaces It
SVP and GM of Photonic Fabric Preet Virk and Senior Director of Photonic Fabric Ravi Mahatme discuss how Marvell is approaching the shift from training to inference, and how the rise of agentic AI and reasoning models is driving new demands on data center architecture. They explain why traditional memory hierarchies are hitting their limits, and how the work Marvell does on optically connected shared memory offers a path forward for managing KV cache at scale. The conversation highlights how Marvell optical connectivity technology is enabling new architectures for CPU-GPU communication, memory pooling, and on-die integration. Looking ahead, Virk and Mahatme share the company's vision for extending optics beyond rack-to-rack connections to the package level and ultimately the die itself, positioning the company at the forefront of solving signal integrity and bandwidth challenges as AI clusters continue to scale.
