4 October 2019 in IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
Recent support for unified memory and demand paging has improved GPU programmability and enabled memory oversubscription. However, this support introduces high overhead when page faults occur. Therefore, when the GPU memory fills to capacity, an important issue is how to select eviction candidates. The widely-used policy, LRU, and the advanced replacement policies, RRIP and CLOCK-Pro, suffer from inefficiency when dealing with thrashing access patterns. They also incur significant overhead due to managing metadata at page level. In this paper, we propose Hierarchical Page Eviction (HPE), a new replacement policy for GPUs with unified memory. Aided by page walk hit information, HPE manages a page set chain dynamically. It uses statistics to classify applications into three categories and selects an appropriate eviction strategy for each category. It also applies dynamic adjustment to switch the eviction strategy when necessary. Simulation results show that, on average, HPE achieves 1.34x and 1.16x speedup (up to 2.81x) over LRU when the oversubscription rate is 75% and 50%, respectively. HPE also outperforms RRIP and CLOCK-Pro.
16 November 2019 in The Journal of Supercomputing
19 May 2018 in Innovations in Systems and Software Engineering