Hyperbolic spatial temporal graph convolutional networks |
|
Author: | Mostafa, Abdelrahman1; Peng, Wei1; Zhao, Guoying1 |
Organizations: |
1Center for Machine Vision and Signal Analysis, University of Oulu, Finland |
Format: | article |
Version: | accepted version |
Access: | open |
Online Access: | PDF Full Text (PDF, 4.1 MB) |
Persistent link: | http://urn.fi/urn:nbn:fi-fe2023033134056 |
Language: | English |
Published: |
Institute of Electrical and Electronics Engineers,
2022
|
Publish Date: | 2023-03-31 |
Description: |
AbstractSpatial-temporal graph convolutional networks (ST-GCNs) have been successfully applied for dynamic graphs representation learning, such as modeling skeleton-based human actions. However, ST-GCNs embed these non-Euclidean graph structures into Euclidean space, which is not the natural space to represent such structures as embedding them in this space incurs a large distortion. In this work, we make use of hyperbolic non-Euclidean geometry and construct compact ST-GCNs in the hyperbolic space. It can be shown that hyperbolic ST-GCNs (HST-GCNs) outperform the corresponding Euclidean counterparts. Additionally, these compact hyperbolic models can be used to increase the performance of large complex Euclidean models. Moreover, we show that the same or even better performance of large Euclidean models can be achieved by fusing the scores of smaller Euclidean models and a compact hyperbolic model. This in turn leads to reducing the total number of model parameters and hence model size. To validate the performance of these hyperbolic networks, we conducted extensive experiments on NTU RGB+D, NTU RGB+D 120 and Kinectics-Skeleton datasets for human action recognition. see all
|
Series: |
IEEE International Conference on Image Processing |
ISSN: | 1522-4880 |
ISSN-E: | 2381-8549 |
ISSN-L: | 1522-4880 |
ISBN: | 978-1-6654-9620-9 |
ISBN Print: | 978-1-6654-9621-6 |
Pages: | 3301 - 3305 |
DOI: | 10.1109/ICIP46576.2022.9897522 |
OADOI: | https://oadoi.org/10.1109/ICIP46576.2022.9897522 |
Host publication: |
2022 IEEE International Conference on Image Processing (ICIP) |
Conference: |
IEEE International Conference on Image Processing |
Type of Publication: |
A4 Article in conference proceedings |
Field of Science: |
213 Electronic, automation and communications engineering, electronics |
Subjects: | |
Funding: |
This work was supported by the Academy of Finland for Academy Professor project EmotionAI (grants 336116, 345122) and ICT 2023 project (grant 328115), as well as the CSC-IT Center for Science, Finland, for computational resources. |
Academy of Finland Grant Number: |
336116 345122 328115 |
Detailed Information: |
336116 (Academy of Finland Funding decision) 345122 (Academy of Finland Funding decision) 328115 (Academy of Finland Funding decision) |
Copyright information: |
© 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. |