XClose

Institute of Communications and Connected Systems

Home
Menu

MONet: Heterogeneous Memory over Optical Network for Large-Scale Data Centre Resource Disaggregation

Optical Society of America | Mishra V, Benjamin J, Zervas G | Memory over Optical Network (MONet) system is a disaggregated data center architecture where serial (HMC) / parallel (DDR4) memory reso...

9 April 2021

MONet: Heterogeneous Memory over Optical Network for Large-Scale Data Centre Resource Disaggregation

Abstract

Memory over Optical Network (MONet) system is a disaggregated data center architecture where serial (HMC) / parallel (DDR4) memory resources can be accessed over optically switched interconnects within and between racks. An FPGA/ASIC-based custom hardware IP (ReMAT) supports heterogeneous memory pools, accommodates optical-to-electrical conversion for remote access, performs the required serial/parallel conversion and hosts the necessary local memory controller. Optically interconnected HMC-based (serial I/O type) memory card is accessed by a memory controller embedded in the compute card, simplifying the hardware near the memory modules. This substantially reduces overheads on latency, cost, power consumption and space. We characterize CPU-memory performance, by experimentally demonstrating the impact of distance, number of switching hops, transceivers, channel bonding and bit-rate per transceiver on bit-error rate, power consumption, additional latency, sustained remote memory bandwidth/throughput (using industry standard benchmark STREAMS) and cloud workload performance (such as operations per second, average added latency and retired instructions per second on memcached with YCSB cloud workloads). MONet pushes the CPU-memory operational limit from a few centimetres to 10s of metres, yet applications can experience as low as 10% performance penalty (at 36m) compared to a direct-attached equivalent. Using the proposed parallel topology, a system can support up to 100,000 disaggregated cards.

Publication Type:Journal article
Publication Sub Type:Article
Authors:Mishra V, Benjamin J, Zervas G
Publisher:Optical Society of America
Publication date:09/04/2021
Pagination:1
Journal:IEEE Transactions on Biomedical Engineering
Status:Accepted
Print ISSN:1536-5379
Full Text URL:https://discovery.ucl.ac.uk/id/eprint/10121637/

Explore how UCL research is advancing the future technologies of a connected world: