跳到主要导航 跳到搜索 跳到主要内容

Integrating Staleness and Shapley Value Consistency for Efficient K-Asynchronous Federated Learning

  • Yuhui Jiang
  • , Xingjian Lu*
  • , Wei Mao
  • , Ying Lin
  • *此作品的通讯作者
  • East China Normal University

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

In the big data era, Federated Learning (FL), which allows multiple participants to collaboratively train a global model without sharing their raw data, emerges as a promising solution to address the challenges of isolated data silos and privacy protection. Federated learning has two main communication strategies: synchronous and asynchronous. Synchronous FL ensures stable convergence but may encounter model quality degradation and server crash risks. Asynchronous FL avoids the straggler effect and supports more participants, but unstable convergence and non-IID data could affect the model performance. In this paper, inspired by real-world FL scenarios, we propose a highly efficient K-Asynchronous FL framework, KFLBSV, which addresses the limitations of synchronous and asynchronous strategies to some extent, leading to improved model performance and convergence speed. The framework allows clients to upload updates multiple times within the same round instead of blocking after each upload, thereby enhancing training efficiency. To ensure the stability and performance of the global model, we introduce a novel aggregation method. By approximating Shapley value to assess model consistency and balancing client contribution frequency and model staleness, we allocate weights more accurately to each participating client. We extensively conducted experiments on benchmark datasets using three distinct models, and the results show that KFLBSV outperforms existing algorithms in terms of both model performance and convergence speed.

源语言英语
主期刊名Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023
编辑Jingrui He, Themis Palpanas, Xiaohua Hu, Alfredo Cuzzocrea, Dejing Dou, Dominik Slezak, Wei Wang, Aleksandra Gruca, Jerry Chun-Wei Lin, Rakesh Agrawal
出版商Institute of Electrical and Electronics Engineers Inc.
680-689
页数10
ISBN(电子版)9798350324457
DOI
出版状态已出版 - 2023
活动2023 IEEE International Conference on Big Data, BigData 2023 - Sorrento, 意大利
期限: 15 12月 202318 12月 2023

出版系列

姓名Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023

会议

会议2023 IEEE International Conference on Big Data, BigData 2023
国家/地区意大利
Sorrento
时期15/12/2318/12/23

指纹

探究 'Integrating Staleness and Shapley Value Consistency for Efficient K-Asynchronous Federated Learning' 的科研主题。它们共同构成独一无二的指纹。

引用此