A Multiagent Reinforcement Learning-Assisted Cache Cleaning Scheme for DM-SMRShow others and affiliations
2023 (English)In: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, ISSN 0278-0070, E-ISSN 1937-4151, Vol. 42, no 8, p. 2500-2513Article in journal (Refereed) Published
Abstract [en]
To support nonsequential writes, persistent cache (PC) is constructed in drive managed SMR (DM-SMR) drive. However, PC cleaning introduces drastic performance degradation and enlarges tail latencies. In this article, we propose to utilize reinforcement learning (RL) to mitigate the longtail latency of PC cleaning. Our scheme uses the lightweight Q-learning method to monitor and learn the idle time of I/O workloads, based on which PC cleaning is intelligently guided, thus maximally exploit idle time between requests and hiding tail latency from normal requests. In addition, a multiagent RL scheme with clustering algorithm is adopted to further mitigate the tail latencies and adapt to variable workloads. We emulate a DM-SMR drive inside a Linux device driver to implement our proposed scheme. According to the experimental results, our scheme can effectively reduce the tail latency by 59.45% at the 99.9th percentile and the average latency by 48.75% compared with a typical shingled magnetic recording (SMR) design.
Place, publisher, year, edition, pages
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC , 2023. Vol. 42, no 8, p. 2500-2513
Keywords [en]
Cleaning process; clustering algorithm; reinforcement learning (RL); shingled magnetic recording (SMR); tail latency
National Category
Computer Engineering
Identifiers
URN: urn:nbn:se:liu:diva-196621DOI: 10.1109/TCAD.2022.3222670ISI: 001033520500006OAI: oai:DiVA.org:liu-196621DiVA, id: diva2:1788540
Note
Funding Agencies|National Science Foundation for Young Scientists of China [61902218]; National Natural Science Foundation of China [62272271]; National Natural Science Foundation of Shandong Joint Fund [U1806203]; Research Grants Council of the Hong Kong Special Administrative Region, China [GRF 15224918]; Chinese University of Hong Kong [4055151]; U.S. National Science Foundation [2208317, 2204657]
2023-08-162023-08-162023-08-16