liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
A Multiagent Reinforcement Learning-Assisted Cache Cleaning Scheme for DM-SMR
Shandong Univ, Peoples R China.
Shandong Univ, Peoples R China.
Linköping University, Department of Computer and Information Science, Software and Systems. Linköping University, Faculty of Science & Engineering.ORCID iD: 0000-0002-4647-2412
Shandong Univ, Peoples R China.
Show others and affiliations
2023 (English)In: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, ISSN 0278-0070, E-ISSN 1937-4151, Vol. 42, no 8, p. 2500-2513Article in journal (Refereed) Published
Abstract [en]

To support nonsequential writes, persistent cache (PC) is constructed in drive managed SMR (DM-SMR) drive. However, PC cleaning introduces drastic performance degradation and enlarges tail latencies. In this article, we propose to utilize reinforcement learning (RL) to mitigate the longtail latency of PC cleaning. Our scheme uses the lightweight Q-learning method to monitor and learn the idle time of I/O workloads, based on which PC cleaning is intelligently guided, thus maximally exploit idle time between requests and hiding tail latency from normal requests. In addition, a multiagent RL scheme with clustering algorithm is adopted to further mitigate the tail latencies and adapt to variable workloads. We emulate a DM-SMR drive inside a Linux device driver to implement our proposed scheme. According to the experimental results, our scheme can effectively reduce the tail latency by 59.45% at the 99.9th percentile and the average latency by 48.75% compared with a typical shingled magnetic recording (SMR) design.

Place, publisher, year, edition, pages
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC , 2023. Vol. 42, no 8, p. 2500-2513
Keywords [en]
Cleaning process; clustering algorithm; reinforcement learning (RL); shingled magnetic recording (SMR); tail latency
National Category
Computer Engineering
Identifiers
URN: urn:nbn:se:liu:diva-196621DOI: 10.1109/TCAD.2022.3222670ISI: 001033520500006OAI: oai:DiVA.org:liu-196621DiVA, id: diva2:1788540
Note

Funding Agencies|National Science Foundation for Young Scientists of China [61902218]; National Natural Science Foundation of China [62272271]; National Natural Science Foundation of Shandong Joint Fund [U1806203]; Research Grants Council of the Hong Kong Special Administrative Region, China [GRF 15224918]; Chinese University of Hong Kong [4055151]; U.S. National Science Foundation [2208317, 2204657]

Available from: 2023-08-16 Created: 2023-08-16 Last updated: 2023-08-16

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full text

Search in DiVA

By author/editor
Pan, Yungang
By organisation
Software and SystemsFaculty of Science & Engineering
In the same journal
IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
Computer Engineering

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 49 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf