Automated Text Detection and Recognition in Annotated Biomedical Publication Images


Images in biomedical publications often convey important information related to an article's content. When referenced properly, these images aid in clinical decision support. Annotations such as text labels and symbols, as provided by medical experts, are used to highlight regions of interest within the images. These annotations, if extracted automatically, could be used in conjunction with either the image caption text or the image citations (mentions) in the articles to improve biomedical information retrieval. In the current study, automatic detection and recognition of text labels in biomedical publication images was investigated. This paper presents both image analysis and feature-based approaches to extract and recognize specific regions of interest (text labels) within images in biomedical publications. Experiments were performed on 6515 characters extracted from text labels present in 200 biomedical publication images. These images are part of the data set from ImageCLEF 2010. Automated character recognition experiments were conducted using geometry-, region-, exemplar-, and profile-based correlation features and Fourier descriptors extracted from the characters. Correct recognition as high as 92.67% was obtained with a support vector machine classifier, compared to a 75.90% correct recognition rate with a benchmark Optical Character Recognition technique.


Electrical and Computer Engineering

Keywords and Phrases

Decision support systems; Image annotation; Medical imaging; Optical character recognition; Publishing; Automatic Detection; Biomedical information retrieval; Clinical decision support; Correlation features; Feature based approaches; Fourier descriptors; Regions of interest; Support vector machine classifiers; Image enhancement

International Standard Book Number (ISBN)


Document Type

Book - Chapter

Document Version


File Type





© 2016 IGI Global, All rights reserved.

Publication Date

01 Jul 2016