11 January 2023 in IEEE Micro
The arrival of the Compute Express Link (CXL) protocol is a significant milestone for the systems community. CXL provides a standardized, cache-coherent memory protocol that can be used to attach devices and memory to a system, while maintaining memory coherency with the host processor. CXL enables accelerators (e.g., GPU, DPU) to both have direct load/store access to the host memory and the ability to make their own on-device memory likewise accessible to the host CPU. Because CXL allows technology interposition on the memory data plane, it opens up the possibility of “pushing down” functions into the memory subsystem. In this paper, we introduce the concept of Enhanced Memory Functions (EMFs). We then describe two use-cases, one prototyped using an FPGA-based Intelligent Memory Controller (IMC) platform. Finally, we show initial experimental results indicating that EMFs could present valuable solutions to problems that are difficult to solve within existing computer architectures.
5 May 2023 in IEEE Computer Architecture Letters
In this paper, we propose and evaluate designs for a novel hardware-assisted data versioning system (in-memory versioning or IMV) in the context of high-performance computing. Our main novelty and advantage over recent published work is that it does not require any changes to host processor logic, instead augmenting a memory controller within memory modules. It is faster and more efficient than existing high-performance computing (HPC) checkpointing schemes and works from hours to sub-second checkpoint intervals. The main premise is to perform most operations in hardware at cache-line granularity, avoiding operating system (OS) latency and page copying bandwidth overhead. Energy is saved by keeping data movement in the memory module, compared with page granularity cross channel or cross-network copying that is currently used. For a 1-second checkpoint commit interval, we demonstrate up to 20x checkpoint performance and 70x energy savings using IMV versus page copy-on-write (COW).