Multi-Contrast Imaging and Digital Refocusing on a Mobile Microscope with a Domed LED Array

PLOS ONE, Dec 2019

We demonstrate the design and application of an add-on device for improving the diagnostic and research capabilities of CellScope—a low-cost, smartphone-based point-of-care microscope. We replace the single LED illumination of the original CellScope with a programmable domed LED array. By leveraging recent advances in computational illumination, this new device enables simultaneous multi-contrast imaging with brightfield, darkfield, and phase imaging modes. Further, we scan through illumination angles to capture lightfield datasets, which can be used to recover 3D intensity and phase images without any hardware changes. This digital refocusing procedure can be used for either 3D imaging or software-only focus correction, reducing the need for precise mechanical focusing during field experiments. All acquisition and processing is performed on the mobile phone and controlled through a smartphone application, making the computational microscope compact and portable. Using multiple samples and different objective magnifications, we demonstrate that the performance of our device is comparable to that of a commercial microscope. This unique device platform extends the field imaging capabilities of CellScope, opening up new clinical and research possibilities.

Multi-Contrast Imaging and Digital Refocusing on a Mobile Microscope with a Domed LED Array

May Multi-Contrast Imaging and Digital Refocusing on a Mobile Microscope with a Domed LED Array Zachary F. Phillips 0 1 Michael V. D'Ambrosio 0 1 Lei Tian 0 1 Jared J. Rulison 0 1 Hurshal S. Patel 0 1 Nitin Sadras 0 1 Aditya V. Gande 0 1 Neil A. Switz 0 1 Daniel A. Fletcher 0 1 Laura Waller 0 1 0 1 Graduate Group in Applied Science and Technology, University of California , Berkeley, CA 94720 , USA , 2 Department of Electrical Engineering and Computer Sciences, University of California , Berkeley, CA 94720 , USA , 3 Department of Bioengineering, University of California , Berkeley, CA 94720 , USA 1 Academic Editor: Jonathan A Coles, Glasgow University , UNITED KINGDOM We demonstrate the design and application of an add-on device for improving the diagnostic and research capabilities of CellScope-a low-cost, smartphone-based point-of-care microscope. We replace the single LED illumination of the original CellScope with a programmable domed LED array. By leveraging recent advances in computational illumination, this new device enables simultaneous multi-contrast imaging with brightfield, darkfield, and phase imaging modes. Further, we scan through illumination angles to capture lightfield datasets, which can be used to recover 3D intensity and phase images without any hardware changes. This digital refocusing procedure can be used for either 3D imaging or software-only focus correction, reducing the need for precise mechanical focusing during field experiments. All acquisition and processing is performed on the mobile phone and controlled through a smartphone application, making the computational microscope compact and portable. Using multiple samples and different objective magnifications, we demonstrate that the performance of our device is comparable to that of a commercial microscope. This unique device platform extends the field imaging capabilities of CellScope, opening up new clinical and research possibilities. - Competing Interests: The authors have declared that no competing interests exist. Optical microscopy is an important tool for disease screening and diagnosis throughout the world; however, access is often restricted to centralized hospitals due to the cost and complexity of imaging hardware. Significant resources have been devoted to developing portable and affordable compact microscopes for remote clinical applications [112]. Compact microscopes based on mobile phones, including CellScope [13, 14], have demonstrated that microscopy can be effectively performed outside of hospitals and diagnostic laboratories by minimally trained healthcare workers, that images can be transmitted for confirmation of diagnosis, and that phone-based computational analysis can be used to provide automated diagnosis. These mobile microscopes complement a host of other new devices for health monitoring on smart phones [1518]. Here, we demonstrate a new variation of the CellScope microscope which incorporates recently developed techniques of computational illumination [1921] to enable new imaging modalities, including darkfield, phase imaging and digital refocusing. Contrast in clinical microscopy is usually obtained through chemical staining or tagging to enhance specific features of a sample, requiring extensive sample preparation. Label-free contrast methods which do not require staining (e.g. darkfield, phase contrast, DIC) have not yet found widespread use as a field diagnostic tool [10], in part due to significant expense and complexity of the related optical hardware. We implement here a simple phase imaging modality, Differential Phase Contrast (DPC) [2224], which requires only two images with complementary illumination patterns. The result is qualitatively similar to differential interference contrast (DIC) imaging, but has the advantage of being quantitative, which enables measurement of cell volume and dry mass [25, 26], as well as cell confluence and tracking studies [27]. Since brightfield, darkfield and phase imaging are achieved in our system simply by switching the illumination pattern, we are able to display of all three contrast modes simultaneously by synchronizing the LED illumination patterns with the camera acquisition [21]. Image capture is quasi-realtime, with a phone-processor-limited frame rate of 0.43 Hz. Given trends in the industry toward ever-more processing power, real-time (58Hz) imaging is reasonable to expect within a couple of product cycles. Using the same hardware, our Computational CellScope also implements lightfield digital refocusing, so that a sample focus can be changed after the fact (without mechanically changing focus) and 3D image stacks can be extracted for both intensity and phase modes. Further, constant focus correction (auto-focusing) can be implemented in post-processing for long timelapse studies. The digital refocusing is achieved by sequentially illuminating the sample from each of the LEDs that lie inside the numerical aperture (NA) of the objective, then post-processing to form a stack of through-focus images of intensity [19, 28] or phase contrast [20]. For thick samples, the result also provides a 3D reconstruction of the sample, similar to limited angle tomography. The computational illumination techniques used here have been previously demonstrated in a traditional microscope using a planar LED array [1921, 29]. The purpose of the LED array is to flexibly pattern illumination angles at the sample by turning on different sets of LEDs corresponding to different illumination angles. The optimal arrangement of LEDs, however, is not planar but rather a dome shape [30], which we utilize here. The domed arrangement provides significant improvements in intensity uniformity and light throughput, since LEDs can be directionally biased and arranged at uniform radius from the sample. These benefits contribute to increased signal-to-noise ratio (SNR) in the darkfield images, allowing effective high angle illumination patterning and shorter exposure times. The flexibility and speed of the programmable LED array illuminator, as well as the lack of moving parts and low cost, make the hardware very amenable to modification as a CellScope attachment. In order for our device to be practically useful in the field, we have here enforced the requirement that all of our processing and control be performed on the smartphone, without use of a PC. Thus, the device can be field-deployable as a simple add-on to CellScope. In the following sections we detail the design and performance of the hardware and software of our new Computational CellScope device. The Computational CellScope hardware involves a custom-built domed LED illuminator attached to an inverted variant of the CellScope smartphone-based microscope platform (see Fig 1). The CellScope used here is a finite-conjugate transmission microscope coupled to an Android-based Nexus 5 smartphone (LG Electronics/Google) as described in in Skandarajah, et al. [14]. Our domed illumina (...truncated)


This is a preview of a remote PDF: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0124938&type=printable
Article home page: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0124938

Zachary F. Phillips, Michael V. D'Ambrosio, Lei Tian, Jared J. Rulison, Hurshal S. Patel, Nitin Sadras, Aditya V. Gande, Neil A. Switz, Daniel A. Fletcher, Laura Waller. Multi-Contrast Imaging and Digital Refocusing on a Mobile Microscope with a Domed LED Array, PLOS ONE, 2015, 5, DOI: 10.1371/journal.pone.0124938