Search tips
Search criteria 


Opt Express. Jul 2, 2012; 20(14): 14797–14813.
Published online Jun 18, 2012. doi:  10.1364/OE.20.014797
PMCID: PMC3443681
GPU accelerated real-time multi-functional spectral-domain optical coherence tomography system at 1300nm
Yan Wang, Christian M. Oh, Michael C. Oliveira, M. Shahidul Islam, Arthur Ortega, and B. Hyle Park *
Department of Bioengineering, University of California, Riverside, 900 University Ave., Riverside, CA 92521, USA
Received April 12, 2012; Revised June 1, 2012; Accepted June 4, 2012.
We present a GPU accelerated multi-functional spectral domain optical coherence tomography system at 1300nm. The system is capable of real-time processing and display of every intensity image, comprised of 512 pixels by 2048 A-lines acquired at 20 frames per second. The update rate for all four images with size of 512 pixels by 2048 A-lines simultaneously (intensity, phase retardation, flow and en face view) is approximately 10 frames per second. Additionally, we report for the first time the characterization of phase retardation and diattenuation by a sample comprised of a stacked set of polarizing film and wave plate. The calculated optic axis orientation, phase retardation and diattenuation match well with expected values. The speed of each facet of the multi-functional OCT CPU-GPU hybrid acquisition system, intensity, phase retardation, and flow, were separately demonstrated by imaging a horseshoe crab lateral compound eye, a non-uniformly heated chicken muscle, and a microfluidic device. A mouse brain with thin skull preparation was imaged in vivo and demonstrated the capability of the system for live multi-functional OCT visualization.
OCIS codes: (170.4500) Optical coherence tomography, (170.3880) Medical and biological imaging, (260.1440) Birefringence, (230.5440) Polarization-selective devices, (280.2490) Flow diagnostics, (200.4560) Optical data processing
Optical coherence tomography (OCT) is an optical imaging method based on low-coherence interferometry capable of high-resolution cross-sectional imaging of internal microstructure by measuring light backscattered from the sample [1]. Traditional time-domain OCT systems obtain depth-profiles (A-lines) of the sample using a moving reference arm. The emergence of second-generation systems of both spectral-domain and swept source types allows for increases in both line acquisition rate and sensitivity by several orders of magnitude compared to their time-domain counterparts [25]. OCT has the capacity to perform non-contact, non-invasive in vivo imaging and has been applied in medical and scientific fields such as ophthalmology [610], dermatology [1113], developmental biology [1417], and cardiology [1821].
Extensions of OCT such as Doppler OCT and polarization-sensitive OCT (PS-OCT) provide additional information about biological tissues. Doppler OCT combines the Doppler principle with OCT to obtain high-resolution tomographic images of simultaneous tissue structure and blood flow [22]. Bi-directional flow and phase variance can be calculated by observing the phase difference between successive depth profiles and this phase difference squared [2328]. PS-OCT combines polarization sensitive detection with OCT to determine tissue birefringence [2931]. PS-OCT has been used for imaging a variety of tissues, including thermal injury [3234], retinal nerve fiber layer [35,36], caries lesions [37], dental structures [38], and human atherosclerosis [39,40]. A multi-functional SD-OCT system including intensity OCT, Doppler OCT and PS-OCT enables simultaneous acquisition of structure, flow and phase retardation information of tissue [4144]. Advances in hardware have enabled line acquisition rates of 500 kHz for spectrometer-based OCT systems [45] and 1.5 million Hz for swept-source OCT systems [46]. However, the heavy computational load required to process the acquired data stream creates a bottleneck in the realization of real-time OCT, especially multi-functional OCT imaging [4144, 4750].
Rapid visualization allows for quick identification of different features of biological samples in any of the three image types (intensity, Doppler, and polarization-sensitive) during acquisition. Beyond OCT intensity image processing, which involves spectral resampling, interpolation and a fast Fourier transform (FFT), performing multi-functional OCT imaging demands additional processing for reconstruction of both PS-OCT and Doppler OCT images, further increasing the total processing time. One method to decrease the processing time is to exploit the inherent parallelism of graphics processing units (GPU). It has been demonstrated previously that an A-line processing rate of 680,000 A-scan/s can be achieved using GPU implementations of linear spline interpolation and the FFT [51]. A processing rate of 720,000 A-scan/s could be achieved by using GPU paged memory to render data in the GPU rather than copying back to CPU [52]. However, GPU implementations of PS-OCT and Doppler OCT processing algorithms have yet to be demonstrated. A multi-functional OCT imaging system would allow rapid visualization of biological samples with enhanced contrast, allowing the user to scan samples quickly for features of interest to image.
In this paper, we present a multi-functional SD-OCT system with real-time GPU processing capable of displaying simultaneous intensity, phase retardation, flow and en face images with size of 512 pixels by 2048 A-lines at a rate of 10 frames per second. Diattenuation and phase retardation characterization were accomplished using a combined polarizing film and wave plate sample. Finally, we demonstrate the acquisition and processing speed of the system by imaging of a horseshoe crab eye in vivo, non-uniformly heated chicken muscle, microfluidic device and mouse brain in vivo.
2.1 Experimental setup
A schematic of the multi-functional SD-OCT system is shown in Fig. 1 . The broadband source is composed of two super-luminescent diodes (SLD), one centered at 1295nm with a full-width at half maximum (FWHM) bandwith of 97nm (Thorlabs Inc.) and the other centered at 1350nm with a FWHM bandwidth of 48nm (Denselight Semiconductors Pte Ltd). The resulting source is centered at 1298nm with a 120 nm FWHM bandwidth and 16mW power. Light from the source is collimated and passes through a polarization beam splitter (pbs) and a polarization modulator (pm, Thorlabs Inc.) that toggles the light between two orthogonal polarization states in a Poincare sphere representation. The polarized light is sent to a fiber circulator (Thorlabs Inc.) and an 80/20 fiber splitter (AC Photonics Inc) with a polarization controller (pc). In the reference arm, a neutral density filter (ndf) is used to adjust light reflecting from reference mirror, and a polarizer (pl) is used to insure uniformity of the reference polarization state. In the sample arm, galvanometer mounted mirrors in the hand-piece provide transverse scanning of a 10 micron diameter focused spot. Light from both arms is recombined at the splitter and passes through a transmission diffraction grating (1100 lines per mm, Wasatch Photonics) before being focused by a planoconvex lens. The two polarization states of light are separated by a polarization beam splitter, and collected by two line scanning cameras (lsc, Goodrich SUI SU-LDH linear digital high speed InGaAs camera) separately with readout rates up to 45 kHz. Output from the two cameras is digitized through two National Instruments boards (PCIeNI-1429). The cameras, galvanometer mirrors and polarization modulator are triggered by synchronized signals sent from the computer via the National Instruments PCIe6259 board. The GPU used for data processing is the NVIDIA Tesla C1060 card, which is also connected via PCI express 2.0 x16 interface. This GPU card has 240 cores with core clock speed of 1.296 GHz, 4GB physical memory and memory clock speed of 800 MHz. The computer CPU is an Intel Xeon W5580, which has two cores with clock speed of 3.2 GHz.
Fig. 1
Fig. 1
Scheme of multi-functional SD-OCT system with GPU assisted processing
2.2 Acquisition and processing program
The real-time acquisition program was written in Visual C + + in Microsoft Visual Studio 2008, similar to the program written in previous SD-OCT system [44], but with significant modifications to the basic thread structure to accommodate GPU processing. The multi-threaded program synchronizes the cameras, galvanometer-mounted-mirrors and polarization modulator. In the meantime, one thread saves all the acquired data into a specified folder while another thread processes the raw data and displays the appropriate images on the different views in the graphical user interface (GUI). The thread responsible for processing the raw data controls the data transfer to and from the GPU, as well as the kernel invocations required for GPU processing of the different views (intensity, Doppler, and polarization-sensitive imaging).
The GUI is comprised of five views with a sixth panel that shows program status (Fig. 2 ). The spectra of the two cameras are shown at the bottom left (the red and green spectra distinguish the two cameras), top middle and bottom middle display the intensity image and the phase retardation image respectively, and the top right and bottom right display the flow image and en face reconstruction. The red spots in the intensity image indicate regions in which the SNR exceeds a pre-specified range, the yellow line in intensity, polarization and flow images indicate the depth of en face reconstruction, which can be toggled between the different views. The pixel number and approximate physical depth of the en face view is also shown in upper left corner of en face view. The sizes of the image views on the GUI were scaled reflect the physical size of the scanned region of the sample (2mm by 2mm). The position and size of the four image views can be adjusted depending on lateral scan width and user preference. The imaged sample in Fig. 2 was a mouse brain with a thin skull preparation (2048A-lines equation m1200 frames equation m2512 points in depth, 2mm equation m32mm equation m42mm).
Fig. 2
Fig. 2
Snap-shot of the GUI of the real-time data acquisition program during imaging of a mouse brain with a thin skull preparation. The control panel, indicating processing status, is shown at top left. The other five views are of the unprocessed spectra of (more ...)
Figure 3 is a flowchart of the data flow through the hybrid CPU-GPU processing scheme in the acquisition software. The GPU was programmed using NVIDIA’s Compute Unified Device Architecture (CUDA) [53]. Pre-calculation for wavelength-to-wavenumber resampling and loading of the calibration files for this interpolation are both done during software initialization on the CPU. Raw data with size of 1024 pixels by 2048 A-lines was converted from 16 bit unsigned integers into 32 bit floats on the CPU, and then copied to the GPU for processing. In GPU memory, the averaged spectrum was first calculated for each polarization state and then subtracted from the appropriate spectra. Next, linear interpolation was performed. Interpolation parameters differ between the two polarization channels. The gray boxes in Fig. 3 from the “resampled k” to “interpolation” steps indicate that two instances of the same thread logic with these different parameters were run separately. FFT operation was implemented using the CUFFT library provided by NVIDIA [54] identically for both channels. The data from these two channels was combined in a secondary processing step, which consisted of dB conversion and gray-scale encoding for intensity image display. The phase encoded by the complex result after FFT was used to calculate both phase retardation and flow, details of which are described in sections 2.3.2 and 2.3.3, respectively. Next, bitmap encoding for both phase retardation and flow images was performed. The phase retardation values are encoded into an 8-bit gray scale color map, in which 0 and 180 degrees are represented by black and white respectively. The flow phase variance values are encoded in a similar color map, with zero and π2 represented by black and white respectively. Finally, an en face image is generated based on the desired image type (intensity, phase retardation or flow) by choosing a depth in an image and fetching the appropriate data from that depth in sequentially acquired cross-sectional images. The intensity (512 pixels by 2048 A-lines), phase retardation (512 pixels by 1024 A-lines), flow (512 pixels by 2046 A-lines) and en face (100 images by 2048 A-lines) bitmaps are then all copied back from GPU memory to CPU memory for display. The 2-D images (intensity, flow, phase retardation) display cross-sectional images of sample while the en face view displays a top-down view of the sample. Choosing the type of en face image and depth is done via a mouse click on any of the cross-sectional viewing frames in the GUI.
Fig. 3
Fig. 3
Flowchart of the computation and image display of the hybrid CPU/GPU processing scheme in the program.
All image frames have 512 pixels in depth. The intensity, phase retardation and flow images have 2048, 1024 and 2046 A-lines respectively. The update rate for all the displays using strictly CPU processing is 2 frames per second. In the previous CPU version multi-threaded program, a main processing thread computed intensity image, then sent data after FFT done by using Intel Performance Primitives (IPP) to two threads to compute phase retardation and flow information separately. We see a 5x increase in the update rate to 10 frames per second when processing is performed on the GPU on the same computer.
A breakdown of the processing times for CPU and GPU processing is displayed in Table 1 . It is clear that using a GPU to perform the computation necessary to reconstruct the three image types is faster compared to CPU processing. The total GPU processing and display time is 5 times faster than its CPU counterpart, despite the fact that 20% of the total time is used to transfer the data to and from the GPU. The effective A-line processing rate for intensity imaging only is 61 kHz. Newer versions of CUDA improve the use of pinned memory and execution of multiple kernels concurrently, which may help reduce the total computation time even further. Using pinned memory is theoretically possible to help reduce the data copying time between CPU and GPU by several milliseconds for our data size [52]. However, a significant improvement is still demonstrated here using GPU-CPU hybrid processing compared to CPU processing.
Table 1
Table 1
Time comparison of CPU and GPU calculation
To determine the minimum number of A-lines per image required to see an improvement using GPU to process intensity only and multi-functional images, we compared the total time to process and display a single frame using the purely CPU and CPU-GPU hybrid programs respectively, while varying the number of A-lines (Fig. 4 ).
Fig. 4
Fig. 4
Time comparison of CPU and GPU computation of intensity image only and multi-functional images at different number of A-lines.
The time difference between CPU and CPU-GPU processing of only intensity images increases as number of A-lines increases, indicating that GPU processing has an obvious advantage when processing larger amounts of data. The bulk of the GPU processing advantage come from the parallel implementation of the FFT. The time required to perform the FFT does not significantly increase with data size due to the efficient parallezation of different A-lines over the GPU cores. The time difference of computing all intensity, phase retardation and flow images by purely CPU and CPU-GPU hybrid programs increases even more rapidly with number of A-lines. When the number of A-lines increases to be 2048, the total time to process multi-functional images using GPU program is smaller than the time of computing intensity image only by purely CPU program.
2.3 MF-SD-OCT Processing Steps
2.3.1 Intensity
Calibrating the spectrum on each camera is critical in SD-OCT systems, and even more so for accurate calculation of phase retardation in PS-OCT [55]. The initial wavelength assignments on the cameras were calculated from the spectrometer, similar to a previous method [44]. Next, a correction was applied by inducing a known modulation on the spectrum using a coverslip [55]. Raw data read from the cameras was resampled uniformly in k-space using the calibrated wavelengths. A depth profile was obtained after a fast Fourier transform (FFT) of the spectrum. The combination of the two polarization channels, Hn(zm) and Vn(zm), contributed to the intensity image, where H and V distinguish depth profiles from the two cameras respectively, n is the depth profile number, z is the depth into the tissue and m is the pixel number in the depth profile. The intensity was computed as
equation m5
where * represents the complex conjugate, and displayed using a logarithmic gray scale.
2.3.2 Flow
Flow was calculated as the phase difference between two successive complex depth profiles after Fourier transforming the resampled data. Two kinds of flow information can be obtained, bi-directional and phase variance. Bi-directional flow was calculated as the weighted phase difference of two successive depth profiles at corresponding depths. Phase variance was calculated as the weighted square of this phase difference. Since there were two polarization states alternating in the source for neighboring depth profiles, the phase difference at depth zm was calculated as phase difference between A-lines having the same incident polarization state:
equation m6
The overall phase shift between depth profiles was removed. The phase differences of the last two depth profiles were assumed to be zero. Bi-directional flow and phase variance flow are expressed as Eq. (3) and Eq. (4), respectively [44]:
equation m7
equation m8
Either bi-directional flow or phase variance are calculated in the real-time processing program depending on user preference. Phase variance was used in the figures in this paper.
2.3.3 Phase Retardation
Phase retardation was calculated using the Stokes vector based method [44] in the real-time processing program due to its relatively low computational load. Stokes vectors, Sn(zm), were calculated from complex depth profiles after FFT, Hn(zm), Vn(zm), such that
equation m9
The position of the sample surface within each depth profile, sn, was determined by thresholding the intensity depth profile. The cumulative sample relative optic axis, Ai, that simultaneously rotates a pair of surface polarization states to states at a particular depth, was determined by
equation m10
The phase retardation angle was calculated by the rotation angle from surface state to state at specific depth, which was given by
equation m11
θ2i + 1(zm) can be obtained similarly. The overall phase retardation angle is calculated through a weighted average based on the intensities of the polarization states. Moreover, the effect of noise on the value of θ2i + 1(zm) increases as the angle between the rotation axis Ai(zm) and either Stokes states S2i(s2i) or S2i(zm) decreases. The angle between Ai(zm) and S2i(s2i) can be calculated from:
equation m12
The angles between Ai(zm) with S2i + 1(s2i + 1) and S2i + 1(zm) can be calculated similarly. The overall weight factor can be determined as the product of the sines of the angles between the axis of rotation and the polarization states, which are:
equation m13
equation m14
The overall weighted averaged phase retardation angle was determined as:
equation m15
3.1 System characterization
Basic system characterization was done in a similar fashion to that of Yun et al [56]. The power incident on the sample surface is 6mW. The photon-to-electron conversion efficiency of the spectrometer is 63% for both cameras. The theoretical imaging depth is 3.4mm calculated from spectrometer, the actual measured imaging depth in air is 3 mm, thus 2mm in biological tissue if refractive index is 1.5. The SNR ranges from 51dB at the surface to 40dB at 3mm measured by using a mirror as sample, the sensitivity drop-off is less than 10dB from surface to 2.5mm in air. The axial resolution is 8μm up to a depth of 1mm and 11μm at a depth of 3mm measured by a mirror.
While a computationally-efficient Stokes vector approach was implemented in the acquisition software, the general appearance of PS-OCT images were compared to a more rigorous Jones matrix-based method in post-processing. This Jones matrix approach has the advantage of determining relative optic axis, phase retardation, and diattenuation simultaneously [57]. Characterization data was obtained using a polarizing film for diattenuation and a waveplate for phase retardation. The polarizing film had a diattenuation of 1 and the wave plate had a round-trip phase retardation of 166° at 1300nm. The round-trip diattenuation and phase retardation were calculated for these two samples separately using the Jones matrix method [57]. The measured round-trip diattenuation using one polarizing film at different set orientations is 0.98 ± 0.002 (Fig. 5(a) , red dots, PF1).The measured round-trip phase retardation of the wave plate is 167.5 ± 2.5°(Fig. 5(b), red dots, WP). The measured optic axis orientation is shown in Fig. 5(c) with red dots. The measured round-trip diattenuation, round-trip phase retardation and optic axis orientation match the theoretical values. A polarizing film with diattenuation of 0.15 (measured as 0.15 ± 0.022 shown in Fig. 5(a), blue squares, PF2) was placed on top of the same wave plate with their optic axes aligned. Measured round-trip phase retardation and diattenuation after placing the polarizing film are167.4 ± 5.2° (Fig. 5(b), blue squares, PFWP) and 0.179 ± 0.085 (Fig. 5(a), black triangles, PFWP) respectively. The measured optic axis is shown in Fig. 5(c) with blue squares. Both sets of measurements (the separate samples and combined sample) agree well with theoretical values. A combined sample comprised of a polarizing film and a wave plate demonstrates that phase retardation, diattenuation, and optic axis can be measured using the Jones matrix method.
Fig. 5
Fig. 5
(a) Measured round-trip diattenuation of polarizing films with diattenuation of 1 (PF1, red dots) and 0.15 (PF2, blue squares) with set orientation; (b) measured round-trip phase retardation of a single wave plate (WP, red dots) and combined sample with (more ...)
It is known that muscle tissue is highly birefringent and adipose tissue is not [58,59]. Chicken muscle and adipose were imaged under PS-OCT. Post processed intensity and PS-OCT images of adipose and muscle tissue are shown in Fig. 6 . It is clear that adipose tissue is not birefringent and muscle is highly birefringent, as demonstrated by the striped pattern in the PS-OCT image. Phase retardation was quantified by averaging the phase retardation over regions of muscle and adipose tissue starting from sample surface. A linear fit was applied to the resulting curve and the slope extracted as a measurement of phase retardation per unit depth. The averaged slope for adipose and muscle are shown in Fig. 6(g) and 6(h). The phase retardation per unit depth is 0.8821 ± 0.045°/μm for muscle tissue and −0.026 ± 0.08°/μm for adipose tissue. As proof that the above characterization can accurately extract phase retardation amidst the existence of diattenuation, the polarizing film with diattenuation of 0.15 was put on top of the sample of chicken muscle and imaged as a single sample. Extraction of phase retardation requires identical eigenvectors determined from the Jones matrices of the sample and film. The polarizing film was carefully put atop of the chicken muscle with their optic axes aligned in the same direction. Figure 6(c), 6(f) and 6(i) show the intensity image, PS-OCT image and averaged phase retardation per unit depth. The measured average phase retardation per unit depth is 0.907 ± 0.07°/μm, which agrees well with the previous measurement. The PS-OCT characterization and imaging results demonstrate the ability of our multi-functional SD-OCT system to maintain good sensitivity while operating the cameras at their maximum line rate of 45 kHz.
Fig. 6
Fig. 6
Intensity, PS-OCT images, and averaged phase retardation along depth for chicken adipose tissue (a, d, g), muscle (b, g, h) and a polarizing film putting on top of the same muscle (c, f, i). After putting polarizing film on the same piece of chicken muscle, (more ...)
3.2 Imaging and video recording of a Horseshoe crab eye
A live horseshoe crab eye was imaged in vivo using the CPU-GPU hybrid acquisition program. A horseshoe crab lateral compound eye is comprised of hundreds of thousands of small segments called ommatidia. The compound eye was scanned in a volume of 0.8 equation m160.8 equation m172mm3. Only the cross-sectional intensity and its en face images were calculated and displayed to test the processing program, every frame acquired was processed and displayed. Three different volume sizes were tested, which are: 256 equation m1850 equation m19512(12,800 A-lines/volume), 512 equation m2050 equation m21512 (25,600 A-lines/volume), 1024 equation m2250 equation m23512(51,200 A-lines/volume).These volumes were acquired and visualized at 3volumes/second, 3volumes/2seconds, 4volumes/5seconds, respectively.
The representative frames of videos recorded for above volume sizes are shown in Fig. 7 (a, Media 1), (b, Media 2), (c, Media 3) respectively. The en face depth was 380 μm from eye surface. Figure 7 (c, Media 4) shows a representative frame of video for volume size of 512 equation m2550 equation m26512 with en face depth 70 μm deeper. The intensity cross-sectional image is on the left and en face image on the right in each frame. In Fig. 7(a), arrows in cross-sectional image point to crystal cone walls of ommatidia, and arrows in en face image indicate hexagonal ommatidia. The arrows in cross-sectional image of Fig. 7(b) show the membrane fenestrate at the end of ommatidia. Moving 70 μm deeper in Fig. 7(d), more ommatidia are seen on right section of en face image as indicated by arrows. A single ommatidium has a diameter of about 200 μm from the en face image.
Fig. 7
Fig. 7
Live imaging of a horseshoe crab lateral compound eye, cross-sectional intensity image (0.8mm in width and 2mm in height) is on left and en face image (both width and height are 0.8mm) is on right. (a) 256×50×512 voxels: en face depth (more ...)
The intensity images were updated on a frame-to-frame basis, and the en face image was updated simultaneously line by line. The program is capable of processing and updating image frames quickly enough for the en face image of the volume to be updated at a rate of 3 volumes/second for voxel size of 256 equation m2750 equation m28512.
3.3 Imaging and video recording of chicken muscle
In order to test the phase retardation computation of the CPU-GPU hybrid acquisition program, a piece of chicken muscle was imaged as heat was applied to the top right corner of imaging area. The scanned volume size is 1.3 equation m291.3 equation m302mm3(256 equation m3150 equation m32512).
The fast computation speed (1.7 seconds/volume) allowed visualization of the birefringence changes during propagation of thermal injury in the volume. Figure 8(a) and 8(b) are two representative frames of chicken muscle during heating process ( Media 5). In each frame, the image views are cross-sectional intensity (top left), phase retardation (bottom left), and en face phase retardation (bottom right) images. The yellow lines in the cross-sectional images indicate the depth of en face image. The cumulative phase retardation in en face image at chosen depth is roughly equal at the start of the recording as the sample was uniformly birefringent. As localized heat was applied to one corner, the cumulative phase retardation at the en face depth visualized changes non-uniformly as shown in Fig. 8(a). In the cross-sectional phase retardation image, right half started losing more birefringence than left. As heat continued propagating to surrounding area, chicken in heated area gradually lost birefringence. In Fig. 8(b), the en face image showed a larger area of black, indicated low levels of cumulative phase retardation; this is reflected in the cross-sectional images, as the portion of the sample with less applied heat retained greater amount of birefringence than that where the heat was applied.
Fig. 8
Fig. 8
Imaging and video recording of chicken muscle ( Media 5), with heated applied to a lateral position corresponding to the top right corner: (a) A representative frame of the video when heat started transmitting from top right corner; (b) A representative (more ...)
3.4 Imaging and video recording of microfluid flow
A microfluidic device was imaged in order to test flow computation (phase variance) of the CPU-GPU hybrid program. The program was set to process every other frame (1028 A-lines by 512 pixel) acquired such that while 200 frames/volume were acquired, only 100 frames/volume were processed and displayed in the GUI. The scanned volume size was 1.8mm equation m331.8mm equation m342mm (1028 equation m35100 equation m36512), and it took 5 seconds to update one volume. As shown in Fig. 9(a) , a micro channel with 600 μmin diameter was carved on apolydimethylsiloxane (PDMS) sheet and fixed to a glass slide with 1.1 mm thickness. One end of the micro channel was connected to a syringe through a plastic tube and a needle, the other end of the micro channel was connected to a petri dish containing diluted intralipid through a tube. The syringe could pump in and out diluted intralipid through the micro channel by pushing or pulling the syringe. The microfluidic device was imaged with glass slide surface close to the incident beam. Figure 9(b) is a representative frame of the video recording fluid change, the four views are cross-sectional intensity image (top left, 1.8mm equation m372mm), en face flow image (top right, 1.8mm equation m381.8mm), cross-sectional flow image (bottom right, 1.8mm equation m392mm), cross-sectional phase retardation image (bottom left, blocked during video recording). In order to focus the light at the microfluidic channel, the glass slide was slightly shifted towards to the complex positions to portray a more intense image of the microfluidic channel on the display. The top surface of the glass slide was indicated by arrow 1 in Fig. 9(b), and arrow 2 showed bottom layer of glass slide sticking with PDMS. In cross-sectional flow image, the white region shows the spatial position where there was flow change, the black rings indicate phase wrapping as phase change went beyond pi. Turbulent flow was observed shown as two regions of flow, similar to the observation by Bonesi [60].
Fig. 9
Fig. 9
(a) Set-up of the microfluidic device: the micro channel with 600 μm diameter was carved on a PDMS sheet and fixed to a glass slide. Top surface of glass slide was close to incident beam. Inlet of micro channel was connected to a syringe through (more ...)
3.5 Multi-functional imaging of a mouse brain
A mouse brain with a thin skull preparation was imaged in vivo by using this multi-functional SD-OCT system. The CPU-GPU hybrid processing program is capable of processing and displaying every other image frame (512 pixel by 2048 A-lines) and update the intensity, phase retardation and flow images, as well as the en face image of the selected image type at the selected depth (10 frames per second).The scanning volume was composed of 400 frames, processing every other image frame results in 200 frames displaying in the volume (2mm equation m402mm equation m412mm,2048 equation m42200 equation m43512).
Figure 10 shows a snapshot of the 4 image views of the GUI during in vivo imaging of a mouse brain with a thin skull preparation ( Media 7). The four views are cross-sectional intensity image (top left), flow image (top right), phase retardation image (bottom left), and en face flow image (bottom right) respectively, the image sizes are all 2mm equation m442mm. The red spots in intensity image indicate signal saturation at the surface, the red line in polarization image shows the surface of the sample. The yellow line in intensity, flow and phase retardation indicates the depth of en face image in volume. This depth was also shown in en face image as number of pixels and microns. In the intensity image, corpus callosum was visible with higher scattering indicated by arrow. The gray matter was weakly birefringent thus it showed generally dark in phase retardation image. The cross-sectional flow image captured the spatial cross-section positions of two blood vessels in this frame indicated by arrows. In the en face flow image after finishing scanning the whole volume, four blood vessels were visible at the chosen en face depth. As the blood vessels did not lie exactly on the same en face plane, that flow signal was weaker or stronger for part of blood vessels at this specific depth.
Fig. 10
Fig. 10
A representative frame of in vivo imaging a mouse brain with thin skull ( Media 7): cross-sectional intensity image (top left), cross-sectional flow image (top right), cross-sectional phase retardation image (bottom left) and en face flow image (bottom (more ...)
In conclusion, we have demonstrated a GPU-accelerated multi-functional SD-OCT system at 1300nm. The program is capable of processing and displaying every frame for intensity images (512 pixel by 2048 A-lines) and its en face images (100 images by 2048 A-lines) at a rate of 20 frames per second using GPU-accelerated processing algorithms. The program is capable of processing and displaying simultaneous intensity and flow images (512 pixel by 2048 A-lines), phase retardation images (512 pixels by 1024 A-lines) and en face images (100 images by 2048 A-lines) at 10 frames per second. The data processing time of the GPU-accelerated program is five times faster than the previous CPU-based processing program. Additionally, it is first time that the characterization of diattenuation and phase retardation for PS-OCT systems has been done simultaneously from a single sample using the Jones matrix method. The characterized diattenuation, phase retardation and optic axis match well with the theoretical values. Our imaging results of a chicken muscle demonstrate that phase retardation can be extracted correctly by Jones matrix in the presence of diattenuation. A horseshoe crab eye was imaged in vivo and four videos with varying volume sizes (12800, 25600, 51200A-lines/volume) were recorded which gave volume update rate of 3volumes/second, 3volumes/2seconds, 4volumes/5seconds, respectively. Structures of ommatidia were observed from theen face images and can be identified quickly due to the rapid visualization capability of our system. The fast visualization capability allowed visualization of large-scale birefringence changes due to localized heating of a chicken sample. The en face phase retardation image clearly showed the heat propagation from top right corner to surrounding area where showed black color with birefringence loss. A microfluidic device with a channel of 600μm in diameter was used to test the flow computation, the cross-sectional flow image showed the phase variance change, and turbulent flow was observed. The frequency of pushing and pulling syringe to pump diluted intralipid through the micro channel was visible in en face image. Finally, a mouse brain with a thin skull preparation was imaged with all image views (intensity, phase retardation, flow, en face flow) updating at a rate of 10 frames per second with the en face flow view displaying blood vasculature and demonstrated our ability to do rapid identification of structures in OCT images.
We acknowledge the support from National Institute of Health ( R00EB 007421) and the Department of Bioengineering at UCR. We also wish to thank Mike Hsu and Jenny Szu for the assistance on the animal protocol and mouse preparation, and Md. Rezuanul Haque for help with horseshoe crab eye imaging. B.H. Park’s email address is
1. Huang D., Swanson E. A., Lin C. P., Schuman J. S., Stinson W. G., Chang W., Hee M. R., Flotte T., Gregory K., Puliafito C. A., Fujimoto J. G., “Optical Coherence Tomography,” Science 254(5035), 1178–1181 (1991). doi: 10.1126/science.1957169. [PubMed] [Cross Ref]
2. Mitsui T., “Dynamic range of optical reflectometry with spectral interferometry,” Jpn. J. Appl. Phys. 38(Part 1, No. 10), 6133–6137 (1999). doi: 10.1143/JJAP.38.6133. [Cross Ref]
3. Leitgeb R., Hitzenberger C. K., Fercher A. F., “Performance of fourier domain vs. time domain optical coherence tomography,” Opt. Express 11(8), 889–894 (2003). doi: 10.1364/OE.11.000889. [PubMed] [Cross Ref]
4. de Boer J. F., Cense B., Park B. H., Pierce M. C., Tearney G. J., Bouma B. E., “Improved signal-to-noise ratio in spectral-domain compared with time-domain optical coherence tomography,” Opt. Lett. 28(21), 2067–2069 (2003). doi: 10.1364/OL.28.002067. [PubMed] [Cross Ref]
5. Choma M. A., Sarunic M. V., Yang C. H., Izatt J. A., “Sensitivity advantage of swept source and Fourier domain optical coherence tomography,” Opt. Express 11(18), 2183–2189 (2003). doi: 10.1364/OE.11.002183. [PubMed] [Cross Ref]
6. Hee M. R., Izatt J. A., Swanson E. A., Huang D., Schuman J. S., Lin C. P., Puliafito C. A., Fujimoto J. G., “Optical coherence tomography of the human retina,” Arch. Ophthalmol. 113(3), 325–332 (1995). doi: 10.1001/archopht.1995.01100030081025. [PubMed] [Cross Ref]
7. Drexler W., Morgner U., Ghanta R. K., Kärtner F. X., Schuman J. S., Fujimoto J. G., “Ultrahigh-resolution ophthalmic optical coherence tomography,” Nat. Med. 7(4), 502–507 (2001). doi: 10.1038/86589. [PMC free article] [PubMed] [Cross Ref]
8. Wojtkowski M., Leitgeb R., Kowalczyk A., Bajraszewski T., Fercher A. F., “In vivo human retinal imaging by Fourier domain optical coherence tomography,” J. Biomed. Opt. 7(3), 457–463 (2002). doi: 10.1117/1.1482379. [PubMed] [Cross Ref]
9. Cense B., Nassif N. A., Chen T., Pierce M., Yun S. H., Park B. H., Bouma B. E., Tearney G. J., de Boer J. F., “Ultrahigh-resolution high-speed retinal imaging using spectral-domain optical coherence tomography,” Opt. Express 12(11), 2435–2447 (2004). doi: 10.1364/OPEX.12.002435. [PubMed] [Cross Ref]
10. Wollstein G., Schuman J. S., Price L. L., Aydin A., Beaton S. A., Stark P. C., Fujimoto J. G., Ishikawa H., “Optical coherence tomography (OCT) macular and peripapillary retinal nerve fiber layer measurements and automated visual fields,” Am. J. Ophthalmol. 138(2), 218–225 (2004). doi: 10.1016/j.ajo.2004.03.019. [PubMed] [Cross Ref]
11. Welzel J., Lankenau E., Birngruber R., Engelhardt R., “Optical coherence tomography of the human skin,” J. Am. Acad. Dermatol. 37(6), 958–963 (1997). doi: 10.1016/S0190-9622(97)70072-0. [PubMed] [Cross Ref]
12. Pierce M. C., Strasswimmer J., Park B. H., Cense B., de Boer J. F., “Advances in optical coherence tomography imaging for dermatology,” J. Invest. Dermatol. 123(3), 458–463 (2004). doi: 10.1111/j.0022-202X.2004.23404.x. [PubMed] [Cross Ref]
13. Gambichler T., Moussa G., Sand M., Sand D., Altmeyer P., Hoffmann K., “Applications of optical coherence tomography in dermatology,” J. Dermatol. Sci. 40(2), 85–94 (2005). doi: 10.1016/j.jdermsci.2005.07.006. [PubMed] [Cross Ref]
14. Fujimoto J. G., Brezinski M. E., Tearney G. J., Boppart S. A., Bouma B., Hee M. R., Southern J. F., Swanson E. A., “Optical biopsy and imaging using optical coherence tomography,” Nat. Med. 1(9), 970–972 (1995). doi: 10.1038/nm0995-970. [PubMed] [Cross Ref]
15. Rollins A. M., Yazdanfar S., Kulkarni M., Ung-Arunyawee R., Izatt J. A., “In vivo video rate optical coherence tomography,” Opt. Express 3(6), 219–229 (1998). doi: 10.1364/OE.3.000219. [PubMed] [Cross Ref]
16. Boppart S. A., Brezinski M. E., Fujimoto J. G., “Optical coherence tomography imaging in developmental biology,” Methods Mol. Biol. 135, 217–233 (2000). [PubMed]
17. Bagnaninchi P. O., Yang Y., Zghoul N., Maffulli N., Wang R. K., Haj A. J., “Chitosan microchannel scaffolds for tendon tissue engineering characterized using optical coherence tomography,” Tissue Eng. 13(2), 323–331 (2007). doi: 10.1089/ten.2006.0168. [PubMed] [Cross Ref]
18. Fujimoto J. G., Boppart S. A., Tearney G. J., Bouma B. E., Pitris C., Brezinski M. E., “High resolution in vivo intra-arterial imaging with optical coherence tomography,” Heart 82(2), 128–133 (1999). [PMC free article] [PubMed]
19. Jang I. K., Bouma B. E., Kang D. H., Park S. J., Park S. W., Seung K. B., Choi K. B., Shishkov M., Schlendorf K., Pomerantsev E., Houser S. L., Aretz H. T., Tearney G. J., “Visualization of coronary atherosclerotic plaques in patients using optical coherence tomography: comparison with intravascular ultrasound,” J. Am. Coll. Cardiol. 39(4), 604–609 (2002). doi: 10.1016/S0735-1097(01)01799-5. [PubMed] [Cross Ref]
20. Bouma B. E., Tearney G. J., Yabushita H., Shishkov M., Kauffman C. R., DeJoseph Gauthier D., MacNeill B. D., Houser S. L., Aretz H. T., Halpern E. F., Jang I. K., “Evaluation of intracoronary stenting by intravascular optical coherence tomography,” Heart 89(3), 317–320 (2003). doi: 10.1136/heart.89.3.317. [PMC free article] [PubMed] [Cross Ref]
21. Luo W., Marks D. L., Ralston T. S., Boppart S. A., “Three-dimensional optical coherence tomography of the embryonic murine cardiovascular system,” J. Biomed. Opt. 11(2), 021014 (2006). doi: 10.1117/1.2193465. [PubMed] [Cross Ref]
22. Chen Z., Milner T. E., Dave D., Nelson J. S., “Optical Doppler tomographic imaging of fluid flow velocity in highly scattering media,” Opt. Lett. 22(1), 64–66 (1997). doi: 10.1364/OL.22.000064. [PubMed] [Cross Ref]
23. Izatt J. A., Kulkarni M. D., Yazdanfar S., Barton J. K., Welch A. J., “In vivo bidirectional color Doppler flow imaging of picoliter blood volumes using optical coherence tomography,” Opt. Lett. 22(18), 1439–1441 (1997). doi: 10.1364/OL.22.001439. [PubMed] [Cross Ref]
24. van Leeuwen T. G., Kulkarni M. D., Yazdanfar S., Rollins A. M., Izatt J. A., “High-flow-velocity and shear-rate imaging by use of color Doppler optical coherence tomography,” Opt. Lett. 24(22), 1584–1586 (1999). doi: 10.1364/OL.24.001584. [PubMed] [Cross Ref]
25. Zhao Y., Chen Z., Saxer C., Xiang S., de Boer J. F., Nelson J. S., “Phase-resolved optical coherence tomography and optical Doppler tomography for imaging blood flow in human skin with fast scanning speed and high velocity sensitivity,” Opt. Lett. 25(2), 114–116 (2000). doi: 10.1364/OL.25.000114. [PubMed] [Cross Ref]
26. Zhao Y., Chen Z., Saxer C., Shen Q., Xiang S., de Boer J. F., Nelson J. S., “Doppler standard deviation imaging for clinical monitoring of in vivo human skin blood flow,” Opt. Lett. 25(18), 1358–1360 (2000). doi: 10.1364/OL.25.001358. [PubMed] [Cross Ref]
27. White B. R., Pierce M. C., Nassif N., Cense B., Park B. H., Tearney G. J., Bouma B. E., Chen T. C., de Boer J. F., “In vivo dynamic human retinal blood flow imaging using ultra-high-speed spectral domain optical coherence tomography,” Opt. Express 11(25), 3490–3497 (2003). doi: 10.1364/OE.11.003490. [PubMed] [Cross Ref]
28. Nassif N. A., Cense B., Park B. H., Pierce M. C., Yun S. H., Bouma B., Tearney G. J., Chen T. C., de Boer J. F., “In vivo high-resolution video-rate spectral-domain optical coherence tomography of the human retina and optic nerve,” Opt. Express 12(3), 367–376 (2004). doi: 10.1364/OPEX.12.000367. [PubMed] [Cross Ref]
29. Hee M. R., Huang D., Swanson E. A., Fujimoto J. G., “Polarization-sensitive low-coherence reflectometer for birefringence characterization and ranging,” J. Opt. Soc. Am. B 9(6), 903–909 (1992). doi: 10.1364/JOSAB.9.000903. [Cross Ref]
30. de Boer J. F., Milner T. E., van Gemert M. J. C., Nelson J. S., “Two-dimensional birefringence imaging in biological tissue by polarization-sensitive optical coherence tomography,” Opt. Lett. 22(12), 934–936 (1997). doi: 10.1364/OL.22.000934. [PubMed] [Cross Ref]
31. de Boer J. F., Milner T. E., Nelson J. S., “Determination of the depth-resolved Stokes parameters of light backscattered from turbid media by use of polarization-sensitive optical coherence tomography,” Opt. Lett. 24(5), 300–302 (1999). doi: 10.1364/OL.24.000300. [PubMed] [Cross Ref]
32. Park B. H., Saxer C., Srinivas S. M., Nelson J. S., de Boer J. F., “In vivo burn depth determination by high-speed fiber-based polarization sensitive optical coherence tomography,” J. Biomed. Opt. 6(4), 474–479 (2001). doi: 10.1117/1.1413208. [PubMed] [Cross Ref]
33. Srinivas S. M., de Boer J. F., Park H., Keikhanzadeh K., Huang H. E., Zhang J., Jung W. Q., Chen Z., Nelson J. S., “Determination of burn depth by polarization-sensitive optical coherence tomography,” J. Biomed. Opt. 9(1), 207–212 (2004). doi: 10.1117/1.1629680. [PubMed] [Cross Ref]
34. Pierce M. C., Sheridan R. L., Hyle Park B., Cense B., de Boer J. F., “Collagen denaturation can be quantified in burned human skin using polarization-sensitive optical coherence tomography,” Burns 30(6), 511–517 (2004). doi: 10.1016/j.burns.2004.02.004. [PubMed] [Cross Ref]
35. Cense B., Chen T. C., Park B. H., Pierce M. C., de Boer J. F., “Invivo depth-resolved birefringence measurements of the human retinal nerve fiber layer by polarization-sensitive optical coherence tomography,” Opt. Lett. 27(18), 1610–1612 (2002). doi: 10.1364/OL.27.001610. [PubMed] [Cross Ref]
36. Cense B., Chen T. C., Park B. H., Pierce M. C., de Boer J. F., “In vivo birefringence and thickness measurements of the human retinal nerve fiber layer using polarization-sensitive optical coherence tomography,” J. Biomed. Opt. 9(1), 121–125 (2004). doi: 10.1117/1.1627774. [PubMed] [Cross Ref]
37. Fried D., Xie J., Shafi S., Featherstone J. D. B., Breunig T. M., Le C., “Imaging caries lesions and lesion progression with polarization sensitive optical coherence tomography,” J. Biomed. Opt. 7(4), 618–627 (2002). doi: 10.1117/1.1509752. [PubMed] [Cross Ref]
38. Baumgartner A., Dichtl S., Hitzenberger C. K., Sattmann H., Robl B., Moritz A., Fercher A. F., Sperr W., “Polarization-sensitive optical coherence tomography of dental structures,” Caries Res. 34(1), 59–69 (2000). doi: 10.1159/000016571. [PubMed] [Cross Ref]
39. Nadkarni S. K., Pierce M. C., Park B. H., de Boer J. F., Whittaker P., Bouma B. E., Bressner J. E., Halpern E., Houser S. L., Tearney G. J., “Measurement of collagen and smooth muscle cell content in atherosclerotic plaques using polarization-sensitive optical coherence tomography,” J. Am. Coll. Cardiol. 49(13), 1474–1481 (2007). doi: 10.1016/j.jacc.2006.11.040. [PMC free article] [PubMed] [Cross Ref]
40. Kuo W. C., Hsiung M. W., Shyu J. J., Chou N. K., Yang P. N., “Assessment of arterial characteristics in human atherosclerosis by extracting optical properties from polarization-sensitive optical coherence tomography,” Opt. Express 16(11), 8117–8125 (2008). doi: 10.1364/OE.16.008117. [PubMed] [Cross Ref]
41. Pierce M. C., Hyle Park B., Cense B., de Boer J. F., “Simultaneous intensity, birefringence, and flow measurements with high-speed fiber-based optical coherence tomography,” Opt. Lett. 27(17), 1534–1536 (2002). doi: 10.1364/OL.27.001534. [PubMed] [Cross Ref]
42. Ren H., Ding Z., Zhao Y., Miao J., Nelson J. S., Chen Z., “Phase-resolved functional optical coherence tomography: simultaneous imaging of in situ tissue structure, blood flow velocity, standard deviation, birefringence, and Stokes vectors in human skin,” Opt. Lett. 27(19), 1702–1704 (2002). doi: 10.1364/OL.27.001702. [PubMed] [Cross Ref]
43. Park B. H., Pierce M. C., Cense B., de Boer J. F., “Real-time multi-functional optical coherence tomography,” Opt. Express 11(7), 782–793 (2003). doi: 10.1364/OE.11.000782. [PubMed] [Cross Ref]
44. Park B. H., Pierce M. C., Cense B., Yun S., Mujat M., Tearney G. J., Bouma B. E., de Boer J. F., “Real-time fiber-based multi-functional spectral-domain optical coherence tomography at 1.3 μm,” Opt. Express 13(11), 3931–3944 (2005). doi: 10.1364/OPEX.13.003931. [PubMed] [Cross Ref]
45. An L., Li P., Shen T. T., Wang R., “High speed spectral domain optical coherence tomography for retinal imaging at 500,000 A-lines per second,” Biomed. Opt. Express 2(10), 2770–2783 (2011). doi: 10.1364/BOE.2.002770. [PMC free article] [PubMed] [Cross Ref]
46. Bonin T., Franke G., Hagen-Eggert M., Koch P., Hüttmann G., “In vivo Fourier-domain full-field OCT of the human retina with 1.5 million A-lines/s,” Opt. Lett. 35(20), 3432–3434 (2010). doi: 10.1364/OL.35.003432. [PubMed] [Cross Ref]
47. Ustun T. E., Iftimia N. V., Ferguson R. D., Hammer D. X., “Real-time processing for Fourier domain optical coherence tomography using a field programmable gate array,” Rev. Sci. Instrum. 79(11), 114301 (2008). doi: 10.1063/1.3005996. [PubMed] [Cross Ref]
48. Desjardins A. E., Vakoc B. J., Suter M. J., Yun S. H., Tearney G. J., Bouma B. E., “Real-time FPGA processing for high-speed optical frequency domain imaging,” IEEE Trans. Med. Imaging 28(9), 1468–1472 (2009). doi: 10.1109/TMI.2009.2017740. [PMC free article] [PubMed] [Cross Ref]
49. Watanabe Y., Itagaki T., “Real-time display on Fourier domain optical coherence tomography system using a graphics processing unit,” J. Biomed. Opt. 14(6), 060506 (2009). doi: 10.1117/1.3275463. [PubMed] [Cross Ref]
50. Van der Jeught S., Bradu A., Podoleanu A. G., “Real-time resampling in Fourier domain optical coherence tomography using a graphics processing unit,” J. Biomed. Opt. 15(3), 030511 (2010). doi: 10.1117/1.3437078. [PubMed] [Cross Ref]
51. Zhang K., Kang J. U., “Real-time 4D signal processing and visualization using graphics processing unit on a regular nonlinear-k Fourier-domain OCT system,” Opt. Express 18(11), 11772–11784 (2010). doi: 10.1364/OE.18.011772. [PMC free article] [PubMed] [Cross Ref]
52. Rasakanthan J., Sugden K., Tomlins P. H., “Processing and rendering of Fourier domain optical coherence tomography images at a line rate over 524 kHz using a graphics processing unit,” J. Biomed. Opt. 16(2), 020505 (2011). doi: 10.1117/1.3548153. [PubMed] [Cross Ref]
53. NVIDIA, “NVIDIA CUDA Compute Unified Device Architecture Programming Guide Version 4.0,” (2011).
54. NVIDIA, “NVIDIA CUDA CUFFT Library Version 4.0,” (2011).
55. Mujat M., Park B. H., Cense B., Chen T. C., de Boer J. F., “Autocalibration of spectral-domain optical coherence tomography spectrometers for in vivo quantitative retinal nerve fiber layer birefringence determination,” J. Biomed. Opt. 12(4), 041205 (2007). doi: 10.1117/1.2764460. [PubMed] [Cross Ref]
56. Yun S. H., Tearney G. J., Bouma B. E., Park B. H., de Boer J. F., “High-speed spectral-domain optical coherence tomography at 1.3 um wavelength,” Opt. Express 11(26), 3598–3604 (2003). doi: 10.1364/OE.11.003598. [PMC free article] [PubMed] [Cross Ref]
57. Park B. H., Pierce M. C., Cense B., de Boer J. F., “Jones matrix analysis for a polarization-sensitive optical coherence tomography system using fiber-optic components,” Opt. Lett. 29(21), 2512–2514 (2004). doi: 10.1364/OL.29.002512. [PMC free article] [PubMed] [Cross Ref]
58. Fischer E., “Birefringence and ultrastructure of muscle,” Ann. N. Y. Acad. Sci. 47(6Art 6), 783–797 (1947). doi: 10.1111/j.1749-6632.1947.tb31736.x. [PubMed] [Cross Ref]
59. Cox R. W., ““Hibernoma”: The lipoma of immature adipose tissue,” J. Pathol. Bacteriol. 68(2), 511–518 (1954). doi: 10.1002/path.1700680223. [PubMed] [Cross Ref]
60. Bonesi M., Churmakov D. Y., Ritchie L. J., Meglinski I. V., “Turbulence monitoring with Doppler optical coherence tomography,” Laser Phys. Lett. 4(4), 304–307 (2007). doi: 10.1002/lapl.200610098. [Cross Ref]
Articles from Optics Express are provided here courtesy of
Optical Society of America