liu.seSök publikationer i DiVA
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Optimal Status Updates for Minimizing Age of Correlated Information in IoT Networks With Energy Harvesting Sensors
Northwest A&F Univ, Peoples R China; Northwest A&F Univ, Peoples R China.
Northwest A&F Univ, Peoples R China; Northwest A&F Univ, Peoples R China.
Zhejiang Univ, Peoples R China.
Sun Yat Sen Univ, Peoples R China.
Visa övriga samt affilieringar
2024 (Engelska)Ingår i: IEEE Transactions on Mobile Computing, ISSN 1536-1233, E-ISSN 1558-0660, Vol. 23, nr 6, s. 6848-6864Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

Many real-time applications of the Internet of Things (IoT) need to deal with correlated information generated by multiple sensors. The design of efficient status update strategies that minimize the Age of Correlated Information (AoCI) is a key factor. In this paper, we consider an IoT network consisting of sensors equipped with the energy harvesting (EH) capability. We optimize the average AoCI at the data fusion center (DFC) by appropriately managing the energy harvested by sensors, whose true battery states are unobservable during the decision-making process. Particularly, we first formulate the dynamic status update procedure as a partially observable Markov decision process (POMDP), where the environmental dynamics are unknown to the DFC. In order to address the challenges arising from the causality of energy usage, unknown environmental dynamics, unobservability of sensors' true battery states, and large-scale discrete action space, we devise a deep reinforcement learning (DRL)-based dynamic status update algorithm. The algorithm leverages the advantages of the soft actor-critic and long short-term memory techniques. Meanwhile, it incorporates our proposed action decomposition and mapping mechanism. Extensive simulations are conducted to validate the effectiveness of our proposed algorithm by comparing it with available DRL algorithms for POMDPs.

Ort, förlag, år, upplaga, sidor
IEEE COMPUTER SOC , 2024. Vol. 23, nr 6, s. 6848-6864
Nyckelord [en]
Internet of Things (IoT); age of correlated information (AoCI); deep reinforcement learning (DRL); energy harvesting (EH); partially observable Markov decision process (POMDP)
Nationell ämneskategori
Kommunikationssystem
Identifikatorer
URN: urn:nbn:se:liu:diva-203736DOI: 10.1109/TMC.2023.3329170ISI: 001216462000008OAI: oai:DiVA.org:liu-203736DiVA, id: diva2:1861180
Anmärkning

Funding Agencies|National Natural Science Foundation of China

Tillgänglig från: 2024-05-27 Skapad: 2024-05-27 Senast uppdaterad: 2024-05-27

Open Access i DiVA

Fulltext saknas i DiVA

Övriga länkar

Förlagets fulltext

Sök vidare i DiVA

Av författaren/redaktören
Pappas, Nikolaos
Av organisationen
Databas och informationsteknikTekniska fakulteten
I samma tidskrift
IEEE Transactions on Mobile Computing
Kommunikationssystem

Sök vidare utanför DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetricpoäng

doi
urn-nbn
Totalt: 41 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf