University of Oulu

J. Kim, H. Seo, W. Choi and K. Jung, "Homeostasis-Inspired Continual Learning: Learning to Control Structural Regularization," in IEEE Access, vol. 9, pp. 9690-9698, 2021, doi: 10.1109/ACCESS.2021.3050176

Homeostasis-inspired continual learning : learning to control structural regularization

Saved in:
Author: Kim, Joonyoung1; Seo, Hyowoon2; Choi, Wan1,3;
Organizations: 1Department of Electrical and Computer Engineering, Seoul National University, Seoul 08826, South Korea
2Centre for Wireless Communications, University of Oulu, 90570 Oulu, Finland
3Institute of New Media and Communications, Seoul National University, Seoul 08826, South Korea
Format: article
Version: published version
Access: open
Online Access: PDF Full Text (PDF, 0.9 MB)
Persistent link: http://urn.fi/urn:nbn:fi-fe202103298638
Language: English
Published: Institute of Electrical and Electronics Engineers, 2021
Publish Date: 2021-03-29
Description:

Abstract

Learning continually without forgetting might be one of the ultimate goals for building artificial intelligence (AI). However, unless there are enough resources equipped, forgetting knowledge acquired in the past is inevitable. Then, we can naturally pose a fundamental question about how to control what knowledge and how much of it to forget to improve the overall accuracy. To give a clear answer to it, we propose a novel trainable network termed homeostatic meta-model. The proposed neuromorphic framework is a natural extension of the conventional concept Synaptic Plasticity (SP) for further optimizing the accuracy of continual learning. In the preceding works on SP and its variations, though they seek important network parameters for structural regularization, they care less about the intensity of regularization (IoR). Per contra, this work reveals that a careful selection of IoR during continual training can remarkably improve the accuracy of tasks. The proposed method balances IoR between newly learned knowledge and the previously-acquired ones rather than biasing it to a specific task or evenly balancing. To obtain effective and optimal IoRs for the real-time continual learning circumstances, we propose a homeostasis-inspired meta learning architecture. The proposed meta-model automatically controls the IoRs by capturing important parameters from the previous tasks and the current learning direction. We provide experimental results considering various types of continual learning tasks showing that the proposed method notably outperforms the conventional methods in terms of learning accuracy and knowledge forgetting. We also show that the proposed method is relatively stable and robust compared to the existing SP-based methods. Furthermore, the IoR generated by our model interestingly appears to be proactively controlled within a specific range, which resembles a negative feedback mechanism of homeostasis in synapses.

see all

Series: IEEE access
ISSN: 2169-3536
ISSN-E: 2169-3536
ISSN-L: 2169-3536
Volume: 9
Pages: 9690 - 9698
DOI: 10.1109/ACCESS.2021.3050176
OADOI: https://oadoi.org/10.1109/ACCESS.2021.3050176
Type of Publication: A1 Journal article – refereed
Field of Science: 213 Electronic, automation and communications engineering, electronics
Subjects:
Funding: This work was supported in part by the BK21 FOUR Program of the Education and Research Program for Future ICT Pioneers, Seoul National University, in 2020, and in part by the Automation and Systems Research Institute (ASRI), Seoul National University.
Copyright information: © The Authors 2021. This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/.
  https://creativecommons.org/licenses/by/4.0/