|Home | About | Journals | Submit | Contact Us | Français|
To evaluate RTVue spectral-domain optical coherence tomography (OCT) (Optovue Inc, Fremont, California, USA) reproducibility and to assess agreement with Stratus time-domain OCT (Carl Zeiss Meditec, Dublin, California, USA) measurements.
Observational clinical study.
Scans were obtained from both eyes of all participants 3 times using the RTVue nerve head map 4-mm diameter protocol and once using Stratus OCT within the same session. RTVue reproducibility and agreement with Stratus OCT were evaluated for retinal nerve fiber layer (RNFL) and optic disc measurements.
Thirty healthy participants (60 eyes) and 38 glaucoma patients (76 eyes) were included in the study. RTVue reproducibility was good in both healthy participants and patients. For average RNFL thickness, the intraclass correlation coefficients in healthy eyes and patient eyes were 0.97 whereas for rim area they were 0.97 and 0.96, respectively. The correlation between RTVue and Stratus measurements generally was good, especially for average RNFL thickness (healthy eyes and patient eyes, r2 = 0.82 and 0.86, respectively) and rim volume (healthy eyes and patient eyes, r2 = 0.78 and 0.76, respectively). Bland-Altman plots showed good agreement between the instruments, with better agreement for average RNFL thickness (95% limits of agreement in healthy eyes and patient eyes, −8.6 to 12 µm and −5.6 to −14.8 µm, respectively) than optic disc parameters. Cup-to-disc ratio 95% limits of agreement in healthy eyes and patient eyes were −0.3 to 0.4 and −0.2 to 0.3, respectively. Optic disc measurements with RTVue were smaller than those with Stratus OCT (eg, disc area was on average 0.4 mm2 smaller and rim area was 0.3 mm2 smaller with RTVue).
Reproducibility of RTVue RNFL and optic disc measurements was excellent in both groups. The level of agreement between RTVue and Stratus measurements suggests that RTVue has the potential to detect glaucomatous structural changes.
Optical Coherence Tomography (Oct) is a noninvasive retinal nerve fiber layer (RNFL) and optic disc imaging method that provides micrometer-scale resolution.1– 4 OCT technology has changed considerably in recent years with the incorporation of spectral-domain (SD) imaging that offers significant advantages over the traditional time-domain (TD) OCT techniques.5
Unlike TD-OCT, SD-OCT uses a stationary reference mirror, and the OCT signal is acquired using a spectrometer as a detector.6,7 SD technology currently is capable of an acquisition speed of up to 29,000 A scans per second.8 In addition, SD-OCT offers a higher resolution than TD-OCT2 and can provide a significant reduction in motion artifacts and an increased signal-to-noise ratio compared with TD-OCT.9,10 Until very recently, ophthalmic applications of OCT technology were performed exclusively using TD-OCT (Stratus OCT; Carl Zeiss Meditec, Dublin, California, USA). The recently introduced RTVue (Optovue Inc, Fremont, California, USA) is one of several ultra high-speed, high-resolution OCT retina scanners based on SD-OCT technology. Because of its high frame transfer rate and fast Fourier transform algorithm, RTVue can perform 26,000 A scans per second with a depth resolution of 5 µm (RTVue; RT100 User Manual, Fremont, California, USA).
Before any new device can be widely accepted for use in clinical practice, it is important that its reproducibility, diagnostic accuracy, and ability to detect changes over time are tested. Estimating instrument reproducibility is essential for describing the smallest changes detectable for identifying and monitoring the progression of glaucoma. Additionally, because both RTVue and Stratus OCT were designed to assess anatomic structures of the eye (ie, RNFL and the optic disc features) to help clinicians to identify the presence of glaucomatous structural damage, it is important to understand how measurements from both instruments compare. The objective of the present study was to assess the repeatability of RNFL thickness and optic disc measurements using RTVue in healthy participants and glaucoma patients and to compare these measurements with those acquired with Stratus OCT.
All participants from the university of California, San Diego, Diagnostic Innovations in Glaucoma Study, a prospective longitudinal study designed to evaluate optic nerve structure and visual function in glaucoma,11 imaged using RTVue were included in this study. Informed consent was obtained from all participants.
Participants were recruited between June 2007 and April 2008. All participants underwent a complete ophthalmologic examination, including assessment of medical and family history, visual acuity testing with refraction, slit-lamp biomicroscopy including gonioscopy, intraocular pressure (IOP) measurement with Goldmann applanation tonometry, and dilated stereoscopic fundus examination. Visual sensitivity was tested using Humphrey Field Analyzer (Humphrey-Zeiss Systems, Dublin, California, USA) 24-2 Swedish interactive threshold algorithm standard automated perimetry (SAP), and stereophotographs of the optic disc and peripapillary retina were obtained (TRC-SS; Topcon Instruments Corp of America, Paramus, New Jersey, USA).
The inclusion criteria for all participants were a best-corrected visual acuity of 20/40 or better, a spherical refraction within ±5.0 diopters (D), cylinder correction within ±3.0 D, a healthy anterior segment appearance by examination with slit-lamp biomicroscopy, open angles at gonioscopy, good-quality stereophotography of the optic disc, and reliable (false positives, fixation losses, and false negatives of 33% or less with no observable testing artifacts) SAP results, all within 6 months of optical imaging using RTVue and Stratus OCT.
Exclusion criteria were history of ocular surgery (except for uncomplicated glaucoma and cataract surgery), other diseases affecting the visual fields (VF) (eg, pituitary lesions, demyelinating diseases, human immunodeficiency virus seropositivity or acute immune deficiency symptoms, or diabetic retinopathy), secondary causes of IOP increase (eg, iridocyclitis, trauma), or a combination thereof and use of medications known to affect VF sensitivity or diseases affecting color vision.
For the purpose of this study, participants were categorized as healthy participants or glaucoma patients. Healthy participants were those with IOP of less than 22 mm Hg, normal-appearing optic discs and RNFLs by masked stereophotograph assessment, and normal SAP results in both eyes. Glaucoma patients had repeatable abnormal SAP results (pattern standard deviation (SD) with P ≤ 0.05, glaucoma hemifield test results outside normal limits, or both), glaucomatous optic disc appearance by masked stereophotograph assessment (those with cup-to-disc area ratio, rim thinning, or RNFL defects indicative of glaucoma), repeatable IOP of 22 mm Hg or more in at least 1 eye, or a combination thereof.
RTVue software version 184.108.40.206 (Model RT 100; Optovue Inc) uses a scanning laser diode to emit a scan beam with a wavelength of 840 ± 10 nm to provide images of ocular microstructures. In this study, the 3-dimensional (3D) disc and nerve head map 4-mm diameter (NHM4) RTVue protocols were used. The 3D disc protocol is a 4 × 4-mm raster scan centered on the optic disc and composed of 101 B scans each composed of 512 A scans (acquisition time, 2.2 seconds). The resulting scan provides a 3D image of the optic disc and surrounding area. The en face image generated by this scanning protocol was used to draw the contour line describing the disc margin that is required to generate optic disc parameters from the NHM4 protocol (below). The contour line initially was drawn on the en face image by hand. The position of the contour line then was assessed and, if necessary, corrected by examining the interface between its position and the position of the retinal pigment epithelium (RPE) tips in approximately 8 locations.
The NHM4 protocol is composed of 12 radial scans 3.4 mm in length (452 A scans each) and 6 concentric ring scans ranging from 2.5 to 4.0 mm in diameter (587 or 775 A scans each) all centered on the optic disc (using the previously drawn contour line to ensure scan registration). This scan configuration provides 9510 A scans in 0.39 seconds. Areas between A scans are interpolated. A polar RNFL thickness map and various parameters that describe the optic disc are provided. To compare measurements between the RTVue and Stratus OCT, RNFL thickness measurements were obtained for the 3.45-mm radius ring only, and measurements were described as average RNFL and RNFL in the inferior, temporal, superior, and nasal quadrants. The RNFL thickness parameters were measured by assessing a total of 2,325 data points between the anterior and posterior RNFL borders. The optic cup was defined automatically by RTVue software as the intersection points of the nerve head inner boundary and a parallel line that is 150 µm above the connecting line of the RPE tips. Optic disc parameters obtained were optic disc area, optic cup area, neuroretinal rim area, nerve head volume, cup volume, rim volume, cup-to-disc area ratio, cup-to-disc horizontal ratio, and cup-to-disc vertical ratio.
For this study, Stratus OCT software version 4.0.7 (OCT Model 3000) fast RNFL thickness and fast optic disc acquisition protocols were used. Details about Stratus OCT are described elsewhere.12 In brief, for the fast RNFL protocol, a total of 3 scans, each composed of 256 A scans, are acquired consecutively using a circle with a diameter of 3.4 mm. An automated computer algorithm delineates the anterior and posterior margins of the RNFL. The RNFL thickness parameters are measured by assessing 768 data points between the anterior and posterior RNFL borders.
For fast optic disc analysis, 6 radial linear scans measuring 4-mm long are centered on the optic disc. After the scans are acquired, an automated algorithm detects the edges of the optic nerve head based on the change in reflectivity determined by the termination points of the RPE layer. For each radial scan, a straight line traced between the 2 reference points defines the disc diameter. The optic cup is defined automatically by Stratus OCT software as the intersection points of the nerve head inner boundary and a parallel line that is 150 µm above the connecting line of the RPE tips. Stratus OCT parameters investigated were average and quadrant specific RNFL thicknesses, disc area, cup area, rim area, vertical integrated rim area (volume), and cup-to-disc area ratio.
For both instruments, good-quality OCT images were obtained without pupil dilation. Criteria for determining scan quality were: signal strength of 30 or more for RTVue and 6 or more for Stratus OCT (as suggested by the manufacturers), a clear fundus image allowing optic disc and the scan circle visibility before and during image acquisition, even and dense color saturation throughout all retinal layers with red color visible in the RPE, and RNFL visible with no interruptions and a continuous scan pattern without missing or blank areas (ie, no algorithm failures). For the RTVue, absence of scan failures and en face OCT image distortions because of blinking or eye movements was required. For the optic nerve head analysis with Stratus OCT, each radial scan was evaluated for the presence of artifacts such as failure to detect the edges of the RPE or improper identification of retinal boundaries. Scans with algorithm failure to detect the edges of the RPE or improper identification of retinal boundaries were excluded from the analysis. One RTVue 3D disc scan, 3 consecutive RTVue NHM4 scans, 1 Stratus fast RNFL scan, and 1 Stratus fast optic disc scan were obtained by an experienced technician within a single session.
To determine the intratest variability of RTVue RNFL and optic disc measurements, the within-subjects SD, the intraclass correlation coefficient, and the coefficient of variation (CV) were calculated. The within-subjects SD was defined as the square root of the within-subject variance (defined as the within-subjects sum of squares divided by its degrees of freedom). Linear regression (r2) was performed to describe the strength of relationships for RNFL and optic disc measurements between instruments. The method of generalized estimating equations was applied to adjust for the correlation between the 2 eyes of each subject.13 Bland-Altman plots were used to evaluate the agreement in the measurements obtained by the 2 instruments. P < .05 was considered to be statistically significant. Statistical analyses were performed using SPSS software version 15.0.0 (SPSS Inc, Chicago, Illinois, USA) and JMP software version 7.0 (SAS Institute, Cary, North Carolina, USA).
All participants satisfying the criteria for inclusion participated in the study. Two subjects (4 eyes) were excluded because of poor-quality scans. Two eyes were excluded because of Stratus OCT signal strength of less than 6, and 2 eyes were excluded because of Stratus OCT algorithm failure to identify retinal boundaries properly. A total of 68 individuals (136 eyes) with a mean age ± SD of 65.3 ± 10.3 years were included in the study. Of these, 30 subjects (60 eyes) were classified as healthy and 38 subjects (76 eyes) were classified as glaucoma patients. Table 1 shows demographics and ocular characteristics of the study population. There were statistically significant differences in SAP mean deviation (P < .001, t test) and pattern SD (P < .001, t test) between healthy and glaucoma patients.
Table 2 shows RTVue RNFL thickness measurements and describes their reproducibility. CVs for RNFL thickness ranged from 1.54% (average RNFL) to 3.88% (nasal RNFL) for healthy participants and ranged from 1.9% (average RNFL) to 4.72% (temporal RNFL) for glaucoma patients. Table 3 shows optic disc measurements and describes their reproducibility. For healthy participants’ and patients’ optic disc parameters, CVs ranged from 0.27% and 0.4%, respectively, for disc area to 29.1% and 21.3%, respectively, for cup volume.
Linear regression (r2) was performed to test the strength of the relationship between RTVue and Stratus OCT measurements. The results are provided in Table 4 for healthy participants and glaucoma patients.
Bland-Altman plots were used to evaluate the agreement between RTVue and Stratus OCT measurements. For constructing the plots, the difference between RTVue and Stratus OCT measurements was used (ie, RTVue measurement minus Stratus OCT measurement; these values are shown in the second and fourth columns of Table 4). Table 4 shows the 95% limits of agreement for RNFL thickness and optic disc measurements in healthy participants and glaucoma patients. Rim area and disc area showed particularly large average differences (25% to 28% of the RTVue mean) between the instruments. Bland-Altman plots also were constructed for the average RNFL thickness (Figure 1) and for the rim area (Figure 2) for healthy and patient eyes combined to assess the agreement between instruments at different ranges of RNFL thickness and rim area, respectively. The slopes calculated were significant for average RNFL thickness (r2 = 0.27; P < .001) indicating that RTVue measurements are larger compared with Stratus OCT measurements for average RNFL thickness values of up to approximately 110 µm (Figure 1). This was not the case for the rim area (r2 = 0.03; P = .08; Figure 2).
We also evaluated the signal strength as provided by RTVue and Stratus OCT. The mean signal strength of the RTVue NHM4 scans was 58.22 (95% confidence interval [CI], 55.91 to 60.52) and 54.43 (95% CI, 52.52 to 56.34) in healthy and patient eyes, respectively (F = 6.48; P = .03). In addition, a statistically significant but weak correlation was found between signal strength and RNFL thickness in healthy eyes (r2 = 0.07; P = .04). For Stratus OCT, the mean signal strength of the fast RNFL scans was 8.96 (95% CI, 8.64 to 9.27) and 8.56 (95% CI, 8.29 to 8.83) in healthy and glaucoma patient eyes, respectively (F = 3.89; P = .05). For Stratus OCT, the signal strength of the optic disc image was significantly higher in healthy subject eyes than in glaucoma patient eyes (F = 6.25; P = .01). Specifically, the mean signal strength was 9.2 (95% CI, 8.89 to 9.5) in healthy subject eyes and 8.68 (95% CI, 8.4 to 8.96) in glaucoma patient eyes. In addition, there was a positive association between signal strength and RNFL thickness in healthy eyes (r2 = 0.11; P = .02). There was no association between RTVue and Stratus OCT RNFL and optic disc signal strengths (r2 = 0.02 and P = .08; r2 = 0.02 and P = .12, respectively).
In this study, RTVue-measured RNFL thickness and optic disc parameters showed high repeatability and excellent reproducibility in both healthy and glaucoma patient eyes. In addition, good correlation and agreement between RTVue and Stratus OCT was found in both groups. These results suggest the ability for the RTVue to detect glaucomatous structural damage is likely as good as that of the Stratus OCT.12,14–16
Because the reproducibility of Stratus OCT results has been evaluated in previous studies, this study was designed to assess RTVue reproducibility only. Previous studies have shown that Stratus OCT intrasession variability is low, with the tendency for the measurements in glaucomatous eyes to be more variable.17,18 A recent study by Budenz and associates that evaluated the reproducibility of the Stratus OCT fast RNFL thickness protocol in glaucomatous eyes with 3 scans repeated in sequence during the same session (ie, using a method similar to the one applied for this study) found excellent reproducibility, with the CV ranging between 3.8% (intraclass correlation coefficient, 0.98) and 8.6% (intraclass correlation coefficient, 0.89) for average and nasal quadrant RNFL thickness, respectively.18 Because the Stratus OCT fast RNFL protocol is composed of the average of 3 single, immediately consecutive scans obtained within 1.3 seconds, it is possible to estimate reproducibility within our single Stratus RNFL scans. Although a direct comparison with RTVue reproducibility would not be appropriate because RTVue images were single images that were acquired separately, we estimated the CVs for Stratus OCT-measured average RNFL thickness and found the results to be similar to those from RTVue. For healthy eyes, the Stratus OCT CV was 2.33% vs the RTVue CV of 1.54%. For glaucoma patient eyes, the Stratus OCT CV was 2.26% vs the RTVue CV of 1.9%. Slightly better reproducibility of RTVue in part is the result of the increased number of A scans, increased resolution, and robust algorithms used by RTVue for detecting structural damage. However, the study design and the study population have the potential to influence the results. In our study, although mean deviation and pattern SD were significantly different between the 2 groups, patients had only mild (61 eyes, 80%) or moderate (15 eyes, 20%) VF defects based on the Hodapp-Anderson Parrish classification, indicating early disease.19 Previous studies have not characterized the study population adequately. It is possible that the reproducibility of the measurements decreases in eyes with more advanced glaucomatous damage.
As expected, our results indicate that most RTVue and Stratus OCT measurements are highly correlated, although some correlations were moderate at best (eg, disc area in healthy eyes). Correlations generally were lower in healthy eyes than patient eyes, particularly for parameters describing disc topography (eg, for the rim area, r2 was 0.22 in healthy eyes vs 0.67 in glaucoma patient eyes). This may be explained in part by the use of different strategies to identify the RPE tips and to define the optic disc contour line. The Stratus OCT is limited by the number of radial scans used to identify the RPE tips. In the case of healthy discs with small cups, RPE tips can be masked by the presence of vessel shadows, making it difficult for the instrument to delineate the optic disc margin properly. The RTVue allows the operator to identify the RPE tips at any location around the optic disc with the use of the en face OCT image, capable of providing both horizontal and vertical scans at any given point within the map. This may prevent the interference of the vessels in defining the optic disc margin, thus allowing more accurate measurements of the optic disc parameters.
When transitioning to a new and more advanced technology, such as SD-OCT for retina and optic disc imaging, evidence is required to confirm that the new instrument can offer clinicians a significant advantage over previous technologies. In glaucoma, one challenge is to demonstrate that SD-OCT can improve diagnostic accuracy and progression detection compared with TD-OCT. The current study shows that RTVue measurement variability is small, and this finding represents preliminary evidence that SD-OCT has the potential to advance glaucoma diagnosis and management. However, because glaucoma is a slowly progressing disease and follow-up is required to monitor disease progression, it is also important to assess how RNFL thickness and optic disc measurements compare with previous OCT technology that currently may be used by clinicians for the follow-up of their glaucoma patients. In this study, Bland-Altman plots showed good agreement between RTVue and Stratus OCT RNFL measurements. However, in healthy eyes, RTVue average, temporal, and inferior RNFL measurements tended to be thicker than those of Stratus OCT by an average of 1.7, 7.5, and 6.4 µm, respectively (Table 4). In addition, the Bland-Altman plot in Figure 1 shows that RTVue tends to provide average RNFL thickness measurements approximately 3 µm thicker than Stratus OCT and that this effect is more pronounced for lower values of average RNFL thickness. The plot also indicates that for values of average RNFL thickness greater than approximately 110 µm, the relationship tends to invert (ie, Stratus OCT provides greater RNFL thickness measurements than RTVue). Clinicians incorporating RTVue in their clinical practice should be aware of the discrepancies in the measurements between RTVue and Stratus OCT.
Evaluating the presence of systematic discrepancies between the 2 instruments will help to identify factors responsible for the disagreement that can be ruled out in clinical practice. For example, it is possible that differences in signal strength between the 2 instruments explain at least in part the differences between the measurements. Signal strength has been shown to affect RNFL thickness measurements using Stratus OCT (also confirmed by our study).20,21 The current study showed that RTVue RNFL thickness measurements also can be affected by signal strength. It is possible that differences in signal strength between images taken with the 2 instruments influenced the agreement between the measurements. However, only good-quality scans were used for this study, restricting the range of this parameter. In addition, in healthy eyes, RTVue measurements were not consistently greater than Stratus OCT measurements for all sectors, suggesting the presence of other factors responsible for these findings. Differences between the instruments’ scan circle placement and software edge detection algorithms for RNFL detection may influence RNFL thickness measurements.
Our results also showed that RTVue optic disc measurements consistently were smaller than Stratus OCT measurements in healthy and patients eyes. Table 4 shows negative mean values for all disc parameters when subtracting Stratus OCT measurements from RTVue measurements, with values ranging from −0.4 mm2 for disc area to −0.1 mm2 for the cup area. Figure 2 shows the Bland-Altman plot for rim area, with RTVue providing measurements on average 0.3 mm2 lower than Stratus OCT, independent of the size of the rim. Again, this finding may be explained in part by the different strategies applied to detect the RPE tips by the 2 devices. Further studies are needed to determine whether optic disc parameters measured by RTVue with the help of the en face OCT image may provide greater accuracy than the measurements provided by Stratus OCT. In this study, scans were obtained within the same session and by the same operator. It is possible that RTVue may provide a greater intervisit variability and that results may be less repeatable when scans are obtained by different operators over time.
In conclusion, the present study demonstrates excellent reproducibility of RTVue measurements in healthy and patient eyes. RTVue average RNFL measurements generally were thicker and optic disc measurements were smaller than Stratus OCT measurements, suggesting that RNFL and optic disc measurements obtained with RTVue and Stratus OCT are not interchangeable. The former findings suggest that RTVue can detect small changes in RNFL thickness and optic disc topography over time.
This study was supported by grants EY011008 and EY008208 from the National Institutes of Health, Bethesda, Maryland. Dr Weinreb is a consultant for Carl Zeiss Meditec, Dublin, California. Drs Weinreb, Zangwill, and Medeiros receive research support from Carl Zeiss Meditec, Optovue Inc, Fremont, California, and Heidelberg Engineering, Dossenheim, Germany. Dr Medeiros also receives research support from Reichert Ophthalmic Instruments, Depew, New York. Dr Bowd receives research support from Lace Elettronica, Pisa, Italy. Involved in design of study (A.O.G.-G., G.V., C.B., L.M.Z., R.N.W.); conduct of study (A.O.G.-G., G.V.); data collection, management, and analysis (A.O.G.-G., G.V., C.B., L.M.Z.); and preparation, review, and approval of the manuscript (A.O.G.-G., G.V., C.B., L.M.Z., F.A.M., R.N.W.). The University of California San Diego Institutional Review Board approved all protocols and adheres to the Declaration of Helsinki. Health Insurance Portability and Accountability Act authorization forms were obtained from all participants.
Alberto O. González-García, MD, is an Assistant Professor at the Cuban Institute of Neurology and Neurosurgery and Consultant Ophthalmic Surgeon and Clinician at the Cuban Institute of Ophthalmology. Dr González-García has completed a fellowship in neuro-ophthalmology at the Cuban Institute of Neurology and Neurosurgery and a glaucoma research fellowship at the Hamilton Glaucoma Center, University of California San Diego.