University of Oulu

S. Savazzi, S. Kianoush, V. Rampa and M. Bennis, "A Joint Decentralized Federated Learning and Communications Framework for Industrial Networks," 2020 IEEE 25th International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD), Pisa, Italy, 2020, pp. 1-7, doi: 10.1109/CAMAD50429.2020.9209305

A joint decentralized federated learning and communications framework for industrial networks

Saved in:
Author: Savazzi, Stefano1; Kianoush, Sanaz1; Rampa, Vittorio2;
Organizations: 1Consiglio Nazionale delle Ricerche (CNR), IEIIT institute, Milano
2Consiglio Nazionale delle Ricerche (CNR) IEIIT institute, Milano
3Centre for Wireless Communications, University of Oulu, Finland
Format: article
Version: accepted version
Access: open
Online Access: PDF Full Text (PDF, 1 MB)
Persistent link: http://urn.fi/urn:nbn:fi-fe2020102687717
Language: English
Published: Institute of Electrical and Electronics Engineers, 2020
Publish Date: 2020-10-26
Description:

Abstract

Industrial wireless networks are pushing towards distributed architectures moving beyond traditional server-client transactions. Paired with this trend, new synergies are emerging among sensing, communications and Machine Learning (ML) co-design, where resources need to be distributed across different wireless field devices, acting as both data producers and learners. Considering this landscape, Federated Learning (FL) solutions are suitable for training a ML model in distributed systems. In particular, decentralized FL policies target scenarios where learning operations must be implemented collaboratively, without relying on the server, and by exchanging model parameters updates rather than training data over capacity-constrained radio links. This paper proposes a real-time framework for the analysis of decentralized FL systems running on top of industrial wireless networks rooted in the popular Time Slotted Channel Hopping (TSCH) radio interface of the IEEE 802.15.4e standard. The proposed framework is suitable for neural networks trained via distributed Stochastic Gradient Descent (SGD), it quantifies the effects of model pruning, sparsification and quantization, as well as physical and link layer constraints, on FL convergence time and learning loss. The goal is to set the fundamentals for comprehensive methods and procedures supporting decentralized FL pre-deployment design. The proposed tool can be thus used to optimize the deployment of the wireless network and the ML model before its actual installation. It has been verified based on real data targeting smart robotic-assisted manufacturing.

see all

Series: IEEE International Workshop on Computer Aided Modeling and Design of Communication Links and Networks
ISSN: 2378-4865
ISSN-L: 2378-4865
ISBN: 978-1-7281-6339-0
ISBN Print: 978-1-7281-6340-6
Pages: 1 - 7
DOI: 10.1109/CAMAD50429.2020.9209305
OADOI: https://oadoi.org/10.1109/CAMAD50429.2020.9209305
Host publication: 2020 IEEE 25th International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD). 14-16 Sept. 2020
Conference: IEEE International Workshop on Computer Aided Modeling and Design of Communication Links and Networks
Type of Publication: A4 Article in conference proceedings
Field of Science: 213 Electronic, automation and communications engineering, electronics
Subjects:
Copyright information: © 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.