TY - JOUR
T1 - Dynamic Scheduling for Heterogeneous Federated Learning in Private 5G Edge Networks
AU - Guo, Kun
AU - Chen, Zihan
AU - Yang, Howard H.
AU - Quek, Tony Q.S.
N1 - Publisher Copyright:
© 2007-2012 IEEE.
PY - 2022/1/1
Y1 - 2022/1/1
N2 - Private 5G edge networks support secure and private service, spectrum flexibility, and edge intelligence. In this paper, we aim to design a dynamic scheduling policy to explore the spectrum flexibility for heterogeneous federated learning (FL) in private 5G edge networks. Particularly, FL is implemented with multiple communication rounds, in each of which the scheduled device receives the global model from the edge server, updates its local model, and sends the updated local model to the edge server for global aggregation. The heterogeneity in FL comes from unbalanced data sizes across devices and diverse device capabilities. In this regard, we start with the convergence analysis of FL to determine the role of unbalanced data sizes in the learning performance. Then, based on the fact that diverse device capabilities make the completion times of local updates asynchronous, we adopt the sequential transmission for global aggregation. On this basis, we formulate a heterogeneity-aware dynamic scheduling problem to minimize the global loss function, with the consideration of straggler and limited device energy issues. By solving the formulated problem, we propose a dynamic scheduling algorithm (DISCO), to make an intelligent decision on the set and order of scheduled devices in each communication round. Theoretical analysis reveals that under certain conditions, the learning performance and energy constraints can be guaranteed in the DISCO. Finally, we demonstrate the superiority of the DISCO through numerical and experimental results, respectively.
AB - Private 5G edge networks support secure and private service, spectrum flexibility, and edge intelligence. In this paper, we aim to design a dynamic scheduling policy to explore the spectrum flexibility for heterogeneous federated learning (FL) in private 5G edge networks. Particularly, FL is implemented with multiple communication rounds, in each of which the scheduled device receives the global model from the edge server, updates its local model, and sends the updated local model to the edge server for global aggregation. The heterogeneity in FL comes from unbalanced data sizes across devices and diverse device capabilities. In this regard, we start with the convergence analysis of FL to determine the role of unbalanced data sizes in the learning performance. Then, based on the fact that diverse device capabilities make the completion times of local updates asynchronous, we adopt the sequential transmission for global aggregation. On this basis, we formulate a heterogeneity-aware dynamic scheduling problem to minimize the global loss function, with the consideration of straggler and limited device energy issues. By solving the formulated problem, we propose a dynamic scheduling algorithm (DISCO), to make an intelligent decision on the set and order of scheduled devices in each communication round. Theoretical analysis reveals that under certain conditions, the learning performance and energy constraints can be guaranteed in the DISCO. Finally, we demonstrate the superiority of the DISCO through numerical and experimental results, respectively.
KW - Dynamic scheduling
KW - Federated learning
KW - Heterogeneous devices
KW - Straggler issue
KW - Unbalanced data
UR - https://www.scopus.com/pages/publications/85125335404
U2 - 10.1109/JSTSP.2021.3126174
DO - 10.1109/JSTSP.2021.3126174
M3 - 文章
AN - SCOPUS:85125335404
SN - 1932-4553
VL - 16
SP - 26
EP - 40
JO - IEEE Journal on Selected Topics in Signal Processing
JF - IEEE Journal on Selected Topics in Signal Processing
IS - 1
ER -