In this work, we focus on the communication aspect of decentralized learning, which involves multiple agents training a shared machine learning model using decentralized stochastic gradient descent (D-SGD) over distributed data. In particular, we investigate the impact of broadcast transmission and probabilistic random access policy on the convergence performance of D-SGD, considering the broadcast nature of wireless channels and the link dynamics in the communication topology. Our results demonstrate that optimizing the access probability to maximize the expected number of successful links is a highly effective strategy for accelerating the system convergence.

We provide the optimal receive combining strategy for federated learning in multiple-input multiple-output (MIMO) systems. Our proposed algorithm allows the clients to perform individual gradient sparsification which greatly improves performance in scenarios with heterogeneous (non i.i.d.) training data. The proposed method beats the benchmark by a wide margin.

Anomaly detection plays a critical role in ensuring the robustness and reliability of federated learning (FL) systems involving distributed implementation of stochastic gradient descent (SGD). Existing methods in the literature usually apply norm-based gradient filters in each iteration and eliminate possible outliers, which can be ineffective in a setting with heterogeneous and unbalanced training data. We propose a heuristic yet novel scheme for adjusting the weights in the gradient aggregation step that accounts for two anomaly metrics, namely the relative distance and the convergence measure. Simulation results show that our proposed scheme brings notable performance gain compared to norm-based policies when the agents have distinct data distributions.

Federated Learning (FL) is a newly emerged decentralized machine learning (ML) framework that combines on-device local training with server-based model synchronization to train a centralized ML model over distributed nodes. In this paper, we propose an asynchronous FL framework with periodic aggregation to eliminate the straggler issue in FL systems. For the proposed model, we investigate several device scheduling and update aggregation policies and compare their performances when the devices have heterogeneous computation capabilities and training data distributions. From the simulation results, we conclude that the scheduling and aggregation design for asynchronous FL can be rather different from the synchronous case. For example, a norm-based significance-aware scheduling policy might not be efficient in an asynchronous FL setting, and an appropriate "age-aware" weighting design for the model aggregation can greatly improve the learning performance of such systems.

Grant-free multiple access (GFMA) mitigates the uplink handshake overhead to support low-latency communication by transmitting payload data together with the pilot (preamble). However, the channel capacity with random access is limited by the number of available orthogonal pilots and the incoordination among devices. We consider a delay-constrained GFMA system, where each device with randomly generated data traffic needs to deliver its data packets before some pre-determined deadline. The pilot selection problem is formulated to minimize the average packet drop rate of the worst user. A priority-sorting based centralized policy is derived by introducing a fairness promoting function. For decentralization, we propose a multi-agent policy optimization algorithm with improved sample efficiency by exploring the model structure. Simulation results show that our proposed scheme facilitates near-optimal coordination between devices by using only partial state information.

In this work, we study age-optimal scheduling with stability constraints in a multiple access channel with two heterogeneous source nodes transmitting to a common destination. The first node is connected to a power grid and it has randomly arriving data packets. Another energy harvesting (EH) sensor monitors a stochastic process and sends status updates to the destination. We formulate an optimization problem that aims at minimizing the average age of information (AoI) of the EH node subject to the queue stability condition of the grid-connected node. First, we consider a Probabilistic Random Access (PRA) policy where both nodes make independent transmission decisions based on some fixed probability distributions. We show that with this policy, the average AoI is equal to the average peak AoI, if the EH node only sends freshly generated samples. In addition, we derive the optimal solution in closed form, which reveals some interesting properties of the considered system. Furthermore, we consider a Drift-Plus-Penalty (DPP) policy and develop AoI-optimal and peak-AoI-optimal scheduling algorithms using the Lyapunov optimization theory. Simulation results show that the DPP policy outperforms the PRA policy in various scenarios, especially when the destination node has low multi-packet reception capabilities.

In this paper, we analyze the impact of caching on the performance of a cache enabled system with heterogeneous traffic where one of the users need to be served with confidential data. In this setup, a wireless helper system always serves a dedicated user and it can also serve a user requesting cached content. A cellular network access point is also available to serve the latter user if it cannot retrieve the requested data from the helper’s cache. The impact of caching and secrecy on throughput and delay performance for each user is then examined when the access point can deploy superposition coding to serve both users simultaneously. Two decoding schemes are considered in this work. The first decoding scheme treats interference from parallel transmissions as noise while the second one utilizes the parallel transmission to apply successive decoding for the intended data. Furthermore, network and cache related factors are identified and their impact on the overall performance of the system are analyzed. In order to find the optimal transmission power allocations, two distinct optimization problems are set in this context comparing the two decoding schemes. This will assist to identify the benefits of the considered decoding schemes for each user satisfying the secrecy requirements of the dedicated user and reducing its impact on the overall performance of the system.

In this paper, we investigate the effect of bursty traffic and random availability of caching helpers in a wireless caching system. More explicitly, we consider a general system consisting of a caching helper with its dedicated user in proximity and another non-dedicated user requesting for content. Both the non-dedicated user and the helper have limited storage capabilities. When the user is not able to locate the requested content in its own cache, then its request shall be served either by the caching helper or by a large data center. Assuming bursty request arrivals at the caching helper from its dedicated destination, its availability to serve other users is affected by the request rate, which will further affect the system throughput and the delay experienced by the non-dedicated user. We characterize the maximum weighted throughput and the average delay per packet of the considered system, taking into account the request arrival rate of the caching helper, the request probability of the user and the availability of the data center. Our results provide fundamental insights in the throughput and delay behavior of such systems, which are essential for further investigation in larger topologies. 

Long Term Evolution (LTE)-Wireless Local Area Network (WLAN) Path Aggregation (LWPA) based on Multi- path Transmission Control Protocol (MPTCP) has been under standardization procedure as a promising and cost-efficient solution to boost Downlink (DL) data rate and handle the rapidly increasing data traffic. This paper aims at providing tractable analysis for the DL performance evaluation of large-scale LWPA networks with the help of tools from stochastic geometry. We consider a simple yet practical model to determine under which conditions a native WLAN Access Point (AP) will work under LWPA mode to help increasing the received data rate. Using stochastic spatial models for the distribution of WLAN APs and LTE Base Stations (BSs), we analyze the density of active LWPA- mode WiFi APs in the considered network model, which further leads to closed-form expressions on the DL data rate and area spectral efficiency (ASE) improvement. Our numerical results illustrate the impact of different network parameters on the performance of LWPA networks, which can be useful for further performance optimization.