An image feature-based approach to automatically find images for application to clinical decision support


The illustrations in biomedical publications often provide useful information in aiding clinicians' decisions when full text searching is performed to find evidence in support of a clinical decision. In this research, image analysis and classification techniques are explored to automatically extract information for differentiating specific modalities to characterize illustrations in biomedical publications, which may assist in the evidence finding process. Global, histogram-based, and texture image illustration features were compared to basis function luminance histogram correlation features for modality-based discrimination over a set of 742 manually annotated images by modality (radiological, photo, etc.) selected from the 2004-2005 issues of the British Journal of Oral and Maxillofacial Surgery. Using a mean shifting supervised clustering technique, automatic modality-based discrimination results as high as 95.57% were obtained using the basis function features. These results compared favorably to other feature categories examined. The experimental results show that image-based features, particularly correlation-based features, can provide useful modality discrimination information.


Electrical and Computer Engineering


Intramural Research Program of the National Institutes of Health
Lister Hill National Center for Biomedical Communications
National Library of Medicine

Keywords and Phrases

Computer-Assisted; Image Interpretation; Information Storage and Retrieval; Medical Informatics Computing

Library of Congress Subject Headings

Image analysis
Image processing

Document Type

Article - Journal

Document Version


File Type





© 2011 Elsevier, All rights reserved.