Byzantine-Robust Federated Machine Learning through Adaptive Model Averaging
Federated learning enables training collaborative machine learning models at scale with many participants whilst preserving the privacy of their datasets. Standard federated learning techniques are vulnerable to Byzantine failures, biased local datasets, and poisoning attacks. In this paper we introduce Adaptive Federated Averaging, a novel algorithm for robust federated learning that is designed to detect failures, attacks, and bad updates provided by participants in a collaborative model. We propose a Hidden Markov Model to model and learn the quality of model updates provided by each participant during training. In contrast to existing robust federated learning schemes, we propose a robust aggregation rule that detects and discards bad or malicious local model updates at each training iteration. This includes a mechanism that blocks unwanted participants, which also increases the computational and communication efficiency. Our experimental evaluation on 4 real datasets show that our algorithm is significantly more robust to faulty, noisy and malicious participants, whilst being computationally more efficient than other state-of-the-art robust federated learning methods such as Multi-KRUM and coordinate-wise median.
NurtureToken New!

Token crowdsale for this paper ends in

Buy Nurture Tokens

Authors

Are you an author of this paper? Check the Twitter handle we have for you is correct.

Luis Muñoz-González (add twitter)
Kenneth T. Co (add twitter)
Emil C. Lupu (add twitter)
Ask The Authors

Ask the authors of this paper a question or leave a comment.

Read it. Rate it.
#1. Which part of the paper did you read?

#2. The paper contains new data or analyses that is openly accessible?
#3. The conclusion is supported by the data and analyses?
#4. The conclusion is of scientific interest?
#5. The result is likely to lead to future research?

Github
User:
None (add)
Repo:
None (add)
Stargazers:
0
Forks:
0
Open Issues:
0
Network:
0
Subscribers:
0
Language:
None
Youtube
Link:
None (add)
Views:
0
Likes:
0
Dislikes:
0
Favorites:
0
Comments:
0
Other
Sample Sizes (N=):
Inserted:
Words Total:
Words Unique:
Source:
Abstract:
None
09/11/19 06:03PM
7,560
1,952
Tweets
arxiv_in_review: #AAAI2020 Byzantine-Robust Federated Machine Learning through Adaptive Model Averaging. (arXiv:1909.05125v1 [stat\.ML]) https://t.co/SnooaBDnfj
arxiv_cs_LG: Byzantine-Robust Federated Machine Learning through Adaptive Model Averaging. Luis Muñoz-González, Kenneth T. Co, and Emil C. Lupu https://t.co/LifnqNguW0
arxivml: "Byzantine-Robust Federated Machine Learning through Adaptive Model Averaging", Luis Muñoz-González, Kenneth T. Co,… https://t.co/ANxPGlCD3b
BrundageBot: Byzantine-Robust Federated Machine Learning through Adaptive Model Averaging. Luis Muñoz-González, Kenneth T. Co, and Emil C. Lupu https://t.co/f8C2jxqOxt
Images
Related