Learning to Transfer Microscopy Image Modalities


Phase Contrast and Differential Interference Contrast (DIC) microscopy are two popular noninvasive techniques for monitoring live cells. Each of these two imaging modalities has its own advantages and disadvantages to visualize specimens, so biologists need these two complementary modalities together to analyze specimens. In this paper, we propose a novel data-driven learning method capable of transferring microscopy images from one imaging modality to the other imaging modality, reflecting the characteristics of specimens from different perspectives. For example, given a Phase Contrast microscope, we can transfer its images to the corresponding DIC images without using DIC microscope, vice versa. The preliminary experiments demonstrate that the image transfer approach can provide biologists a computational way to switch between microscopy imaging modalities, so biologists can combine the advantages of different imaging modalities to better visualize and analyze specimens over time, without purchasing all types of microscopy imaging modalities or switching between imaging systems back-and-forth during time-lapse experiments.


Computer Science

Research Center/Lab(s)

INSPIRE - University Transportation Center

Second Research Center/Lab

Intelligent Systems Center


This project was supported by National Science Foundation (NSF) CAREER award IIS-1351049 and Established Program to Stimulate Competitive Research (NSF EPSCoR) Grant IIA-1355406.

Keywords and Phrases

EM algorithm; Energy minimization; Factor analyzer; Image transfer; Microscopy image analysis

International Standard Serial Number (ISSN)

0932-8092; 1432-1769

Document Type

Article - Journal

Document Version


File Type





© 2018 Springer Verlag, All rights reserved.

Publication Date

01 Nov 2018