Cooperative perception in vehicular networks using multi-agent reinforcement learning |
|
Author: | Abdel-Aziz, Mohamed K.1; Samarakoon, Sumudu1; Perfecto, Cristina2; |
Organizations: |
1Centre for Wireless Communications, University of Oulu, Finland 2University of the Basque Country UPV/EHU, Spain |
Format: | article |
Version: | accepted version |
Access: | open |
Online Access: | PDF Full Text (PDF, 3.9 MB) |
Persistent link: | http://urn.fi/urn:nbn:fi-fe2021082744479 |
Language: | English |
Published: |
Institute of Electrical and Electronics Engineers,
2021
|
Publish Date: | 2021-08-27 |
Description: |
AbstractCooperative perception plays a vital role in extending a vehicle’s sensing range beyond its line-of-sight. However, exchanging raw sensory data under limited communication resources is infeasible. Towards enabling an efficient cooperative perception, vehicles need to address fundamental questions such as: what sensory data needs to be shared? at which resolution? In this view, this paper proposes a reinforcement learning (RL)-based content selection of cooperative perception messages by utilizing a quadtree-based point cloud compression mechanism. Furthermore, we investigate the role of federated RL to enhance the training process. Simulation results show the ability of the RL agents to efficiently learn the message content selection that maximizes the satisfaction of the vehicles in terms of the received sensory information. It is also shown that federated RL improves the training process, where better policies can be achieved within the same amount of time compared to the non-federated approach. see all
|
Series: |
Asilomar Conference on Signals, Systems & Computers |
ISSN: | 1058-6393 |
ISSN-E: | 1058-6393 |
ISSN-L: | 1058-6393 |
ISBN: | 978-0-7381-3126-9 |
ISBN Print: | 978-0-7381-3125-2 |
Pages: | 408 - 412 |
Article number: | 9443539 |
DOI: | 10.1109/IEEECONF51394.2020.9443539 |
OADOI: | https://oadoi.org/10.1109/IEEECONF51394.2020.9443539 |
Host publication: |
54th Asilomar Conference on Signals, Systems and Computers, ACSSC 2020 |
Conference: |
Asilomar Conference on Signals, Systems, and Computers |
Type of Publication: |
A4 Article in conference proceedings |
Field of Science: |
113 Computer and information sciences 213 Electronic, automation and communications engineering, electronics |
Subjects: | |
Funding: |
This work was supported in part by the Academy of Finland project CARMA, and 6Genesis Flagship (grant no. 318927), in part by the INFOTECH project NOOR, in part by the EU-CHISTERA projects LeadingEdge and CONNECT, and in part by the Kvantum Institute strategic project SAFARI. |
Academy of Finland Grant Number: |
318927 |
Detailed Information: |
318927 (Academy of Finland Funding decision) |
Copyright information: |
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. |