Robust data-driven accelerated mirror descent |
|
Author: | Tan, Hong Ye1; Mukherjee, Subhadip1,2; Tang, Junqi1; |
Organizations: |
1Damtp, University of Cambridge, Cambridge, U.K. 2Department of Computer Science, University of Bath, U.K. 3Research Unit of Mathematical Sciences, University of Oulu
4Department of Mathematics, University College London, London, U.K.
|
Format: | article |
Version: | accepted version |
Access: | open |
Online Access: | PDF Full Text (PDF, 0.4 MB) |
Persistent link: | http://urn.fi/urn:nbn:fi-fe2023071090466 |
Language: | English |
Published: |
Institute of Electrical and Electronics Engineers,
2023
|
Publish Date: | 2023-07-10 |
Description: |
AbstractLearning-to-optimize is an emerging framework that leverages training data to speed up the solution of certain optimization problems. One such approach is based on the classical mirror descent algorithm, where the mirror map is modelled using input-convex neural networks. In this work, we extend this functional parameterization approach by introducing momentum into the iterations, based on the classical accelerated mirror descent. Our approach combines short-time accelerated convergence with stable long-time behavior. We empirically demonstrate additional robustness with respect to multiple parameters on denoising and deconvolution experiments. see all
|
Series: |
Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing |
ISSN: | 1520-6149 |
ISSN-E: | 2379-190X |
ISSN-L: | 1520-6149 |
ISBN: | 978-1-7281-6327-7 |
ISBN Print: | 978-1-7281-6328-4 |
Article number: | 10096875 |
DOI: | 10.1109/icassp49357.2023.10096875 |
OADOI: | https://oadoi.org/10.1109/icassp49357.2023.10096875 |
Conference: |
IEEE International Conference on Acoustics, Speech and Signal Processing |
Type of Publication: |
A4 Article in conference proceedings |
Field of Science: |
111 Mathematics 113 Computer and information sciences |
Subjects: | |
Copyright information: |
© 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. |