University of Oulu

Beddiar, DR., Oussalah, M. & Seppänen, T. Automatic captioning for medical imaging (MIC): a rapid review of literature. Artif Intell Rev 56, 4019–4076 (2023).

Automatic captioning for medical imaging (MIC) : a rapid review of literature

Saved in:
Author: Beddiar, Djamila-Romaissa1; Oussalah, Mourad1; Seppänen, Tapio1
Organizations: 1Center for Machine Vision and Signal Analysis, University of Oulu, 90014, Oulu, Finland
Format: article
Version: published version
Access: open
Online Access: PDF Full Text (PDF, 5.2 MB)
Persistent link:
Language: English
Published: Springer Nature, 2022
Publish Date: 2022-11-22


Automatically understanding the content of medical images and delivering accurate descriptions is an emerging field of artificial intelligence that combines skills in both computer vision and natural language processing fields. Medical image captioning is involved in various applications related to diagnosis, treatment, report generation and computer-aided diagnosis to facilitate the decision making and clinical workflows. Unlike generic image captioning, medical image captioning highlights the relationships between image objects and clinical findings, which makes it a very challenging task. Although few review papers have already been published in this field, their coverage is still quite limited and only particular problems are addressed. This motivates the current paper where a rapid review protocol was adopted to review the latest achievements in automatic medical image captioning from the medical domain perspective. We aim through this review to provide the reader with an up-to-date literature in this field by summarizing the key findings and approaches in this field, including the related datasets, applications and limitations as well as highlighting the main competitions, challenges and future directions.

see all

Series: Artificial intelligence review
ISSN: 0269-2821
ISSN-E: 1573-7462
ISSN-L: 0269-2821
Volume: 56
Issue: 5
Pages: 4019 - 4076
DOI: 10.1007/s10462-022-10270-w
Type of Publication: A2 Review article in a scientific journal
Field of Science: 113 Computer and information sciences
Funding: Open Access funding provided by University of Oulu including Oulu University Hospital.
Copyright information: © The Author(s) 2022. This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit