About the Author(s)


Nishanee Rampersad
Discipline of Optometry, University of KwaZulu-Natal, South Africa

Rekha Hansraj Email symbol
Discipline of Optometry, University of KwaZulu-Natal, South Africa

Citation


Rampersad N, Hansraj R. Repeatability of macular thickness measurements with the iVue-100 optical coherence tomographer. Afr Vision Eye Health. 2018;77(1), a413. https://doi.org/10.4102/aveh.v77i1.413

Original Research

Repeatability of macular thickness measurements with the iVue-100 optical coherence tomographer

Nishanee Rampersad, Rekha Hansraj

Received: 10 July 2017; Accepted: 08 Nov. 2017; Published: 26 Mar. 2018

Copyright: © 2018. The Author(s). Licensee: AOSIS.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background: The reliability of an instrument is dependent on its accuracy and repeatability. The iVue-100 optical coherence tomographer (OCT) is a spectral domain device that has the advantage of being able to measure both the anterior and posterior segments of the eye. But its repeatability for macular thickness measurements has not been assessed and this was the primary purpose of this study.

Aim: To determine the repeatability of the iVue-100 OCT for macular thickness measurements.

Settings: This study was conducted at the University of KwaZulu-Natal.

Methods: Repeatability (intra-observer, inter-observer and inter-session) of the iVue-100 OCT was assessed on 50 participants selected using convenience sampling. Data were statistically analysed using Bland–Altman analysis, the intra-class correlation coefficient (ICC), coefficient of variation and the paired t-test.

Results: The mean age and standard deviation for the 50 participants were 23.88 ± 6.93 years (range 18–51 years). The ICCs for intra-observer repeatability ranged between 0.940 and 0.989, whereas the coefficients of variation ranged between 0.040 and 0.084. For both inter-observer and inter-session repeatability, the t-test showed no statistically significant differences (p > 0.05), and Bland–Altman analysis found the majority of the measurements to be within the 95% limits of agreement.

Conclusion: Irrespective of whether repeated measurements are being taken consecutively by the same examiner, by a different observer or at a different time, the iVue-100 OCT is highly reliable in terms of repeatability which is of paramount importance in any clinical or research setting.

Introduction

The word fovea refers to a small region and in terms of the retina is the area in the posterior pole measuring approximately 1.5 mm in diameter, situated approximately 4 mm temporal to the optic disc.1,2,3 The fovea allows the best visual resolution in the entire retina.4,5 Unlike the rest of the retina, the macula contains more than one layer of ganglion cells and an additional pigment called xanthophyll. Histologically, the macula is subdivided into the fovea, parafovea and perifovea from the centre to its periphery.6 The cone density decreases as one moves from the fovea to the perifovea while the rod density increases.7 The centre of the fovea, called the foveola, is completely devoid of both ganglion and inner nuclear cells but has the highest density of cones.1,2,6,8 The parafovea, located between the foveola and the perifovea, has fewer blood vessels but the highest density of ganglion cells. The perifovea, which is rich in blood vessels, is where the ganglion cell layer is the thickest.6 The histological differences of the different areas result in varying thickness in the sub-areas of the macula.

Macular thickness is least at the foveola, thickest within 3 mm of the centre and then decreases towards its periphery, with the temporal part being thinner than the nasal quadrant.9 Differences in macular thickness with gender and ethnicity have been reported.10 Ocular pathologies including retinal vein occlusion, diabetic retinopathy and age-related macular degeneration can result in changes in macular thickness.10 Traditional methods for measuring macular thickness include fluorescein angiography and slit lamp biomicroscopy with a retinal lens; however, these methods are qualitative.10 The advent of optical coherence tomography (OCT) has provided both quantitative and qualitative methods for measuring ocular structures with good precision.9,11

Optical coherence tomography is an objective, non-invasive imaging technology,12 first introduced in 1991, and is similar to ultrasonography except that reflected light rays instead of sound waves are analysed.13,14,15 OCT is based on the principle of low-coherence interferometry15 whereby the reflected light rays are examined to create high-resolution cross-sectional images (tomograms). The two methods of detecting and examining the reflected light rays are referred to as time-domain OCT and Fourier-domain OCT.16 Traditional time-domain OCT devices have lower axial resolutions (8 µm – 10 µm) and slower scanning speeds (400 A-scans per second). The new-generation Fourier-domain OCT devices are capable of achieving scanning speeds of greater than 20 000 A-scans per second with 5 µm – 7 µm axial resolutions.17 Furthermore, Fourier-domain OCT devices are less affected by eye movements and allow for more stable tomograms17 with better visualisation of the retinal layers.18 Subsequently, OCT plays an important role in the screening, diagnosis and monitoring of retinal diseases.10,13,19

Measurements of macular thickness with different OCT devices are not interchangeable,12 and because of their extensive use in monitoring pathologies, the reproducibility of measurements with each device is essential.10 Previous studies20,21,22 have found good repeatability with other OCT devices and concluded that they are effective in monitoring retinal thickness in the macular area particularly in diseased states. With technological devices, newer instruments are constantly being produced with claims of better optical resolution, higher speed and increased precision, which need to be verified. This study therefore set out to determine the repeatability of macular thickness measurements with the iVue-100 OCT which, to the best of the researcher’s knowledge, has not been studied previously.

Research methods and design

This was an observational cross-sectional study, and convenience sampling was used to recruit 50 healthy participants, of all races, gender and ages. The study adhered to the tenets of the Declaration of Helsinki, and all participants were required to give written informed consent. Participants recruited had normal corneal topography, visual acuity in each eye of at least 6/6 (aided or unaided) and no history of ocular injury and/or surgery.

The iVue-100 OCT device was used to scan and measure retinal thickness at the macula. This Fourier-domain OCT device has a scanning speed of 26 000 A-scans per second and axial resolution of 5 µm.23 The retinal map scan protocol in the iVue-100 OCT was used to determine macular thickness. This scan protocol consists of a raster pattern of 13 horizontal line scans of 512 A-scans and 7 horizontal line scans of 1024 A-scans within the central 1.5 mm vertical zone.23 The tomograms were automatically analysed (to segment the retinal layers) with the preprogrammed algorithm in the iVue-100 OCT device. This algorithm defines the retinal pigment epithelium and the inner limiting membrane as the outer and inner limits of the retina, respectively.23 Consequently, the retinal thickness is automatically calculated as the distance between these two limits.

When scanning, participants fixated an internal fixation target while the real-time image of the participant’s eye and corresponding retina was monitored on the laptop screen. Chin and forehead rests were used to stabilise the participant’s head. As per the manufacturer’s recommendations, repeat scans were taken if the scan quality index was less than 40 or labelled as ‘poor’ on the laptop screen display.23 The retinal scanning protocol was repeated three times per eye on the same participant to investigate intra-observer repeatability. A second observer repeated the retinal scanning protocol on the same participant at each visit to determine inter-observer repeatability. Observer one repeated the scanning protocol on the same participant on another day for inter-session repeatability. The approximate time between sessions ranged from 1 to 70 days. Each observer realigned the iVue-100 OCT device before capturing each scan. Both eyes of each participant were scanned with the measurements taken between 10h00 and 14h00. All macular thickness measurements were taken within the same session.

The retinal map scan protocol displays retinal thickness in a retinal map as defined by the Early Treatment Diabetic Retinopathy Study (ETDRS).24 This retinal map shows the average retinal thickness in the nine areas (Figure 1). Central foveal thickness refers to the average thickness in the central 1 mm ring of the ETDRS24 macular map. The inner and outer rings in the ETDRS24 macular map, of 3 mm and 5 mm diameter, correspond to the parafovea and perifovea, respectively (Figure 1). The parafovea and perifovea are divided into four quadrants (superior, inferior, nasal and temporal). The retinal map displays the average thicknesses of nine areas of the ETDRS24 macular map using a false-colour tomographic image display (Figure 1).

FIGURE 1: Early Treatment Diabetic Retinopathy Study retinal thickness map from the iVue-100 optical coherence tomographer.

The Statistical Package for Social Sciences (SPSS version 24) was used to analyse the data. The intra-class correlation coefficient (ICC) and coefficient of variation (CoV) were used to report on the repeatability of the measurements. The ICC can range between zero and one and describes the correlation between repeated measurements. The higher the ICC, the better the repeatability. The CoV expresses the standard deviation in relation to the mean and can also range from one to zero, with a value closer to zero indicating better repeatability. In addition, Bland-Altman analysis and t-tests were used to report on the inter-observer and inter-session repeatability. The significance level was set at 95% with p-value of ≤ 0.05.

Ethical considerations

Data collection commenced after ethical clearance was obtained from the Biomedical Research and Ethics Committee (BE024/13).

Results

Demographics

The sample (N = 50) comprised of 64% (n = 32) women and 36% (n = 18) men with a mean age of 23.88 ± 6.93 years. The racial distribution included 54% Indians, 36% Africans, 8% Europeans and 2% Asians. Fifty-two percent of the sample were emmetropic. The spherical equivalents for the right and left eyes, respectively, ranged from -8.38 to 1.63 D and -9.63 to 3.00 D. The right and left eye measurements were highly correlated (r ≥ 0.895) in the nine areas with differences ≤ 2.30 µm; therefore, in this article only the right eye measurements were analysed and reported upon.

Intra-observer repeatability

Table 1 shows ICC together with the 95% confidence intervals (CIs) and the CoV for each observer at the different areas of the macula as measured.

TABLE 1: Intra-class correlation coefficient with 95% confidence intervals and coefficient of variation for each observer for macular thickness measured at the different areas of the right eyes of 50 participants (the majority being Indian or African) aged 18–51 years.

The ICC for observer one ranged from 0.946 to 0.989 and that for observer two ranged from 0.940 to 0.988, indicating good repeatability. The CoV for observer one ranged from 0.040 to 0.081 and that of observer two from 0.042 to 0.084, again indicating excellent intra-observer repeatability.

Inter-observer repeatability

Table 2 shows the mean differences and their standard deviations when comparing the measurements of each observer at the different macular areas for the 50 right eyes. Table 2 also shows the Bland-Altman limits of agreement. The t-test was used in the specific regions to determine the t- and p-values as an indication of significant differences between observers.

TABLE 2: The mean differences (), and their standard deviations for macular thickness (µm) between observers, Bland-Altman upper and lower limits of agreement, t- and p-values from paired t-tests and the intra-class correlation coefficients.

There was no statistically significant difference in means between the two observers for all nine macular areas (p > 0.05). Overall, the measurements between the two observers were found to be within 1 µm of each other in all areas, with the exception of the nasal parafoveal area, where the mean difference was 1.120 µm. The ICC ranged between 0.961 and 0.983, indicating good repeatability.

Bland-Altman plots were used to graphically compare inter-observer macular thicknesses of all areas as taken by two observers. The Bland-Altman plot for the foveal macular thickness is illustrated in Figure 2.

FIGURE 2: A Bland–Altman plot comparing iVue-100 macular thicknesses of the 50 right eyes taken by observers one and two.

With the exception of two measurements, all measurements were within the 95% limits of agreement.

Inter-session repeatability

Only the measurements of observer one were used to determine the inter-session repeatability. This observer had completed a higher number (n = 33) of inter-session repeat readings taken on two separate sessions. The interval between sessions 1 and 2 ranged between 1 and 70 days. The mean difference of the macular readings ranged from 0.020 µm to 0.799 µm (Table 3) with the ICC ranging between 0.967 and 0.993. Paired t-tests were used to determine the t- and p-values as an indication of significant differences between sessions. For all regions, there were no statistically significant differences in the mean macular thickness between sessions (see Table 3).

TABLE 3: The mean differences () and their standard deviations for iVue-100 macular thickness (µm) for observer one taken over two sessions (between 1 and 70 days apart), Bland-Altman upper and lower limits of agreement, and t- and p-values from paired t-tests and the intra-class correlation coefficients.

Bland-Altman plots were used to graphically compare the macular thicknesses for all areas taken by observer one over two sessions, but only the Bland-Altman plot for the foveal macular thicknesses is illustrated here in Figure 3. With the exception of only two measurements, all measurements were within the 95% limits of agreement. The foveal mean difference (0.313 µm) was almost zero and less than 1 µm.

FIGURE 3: Bland-Altman plot comparing iVue-100 foveal macular thickness measurements of the 50 right eyes taken by observer one in two separate sessions separated by a minimum of 1 day and a maximum of 70 days.

Discussion

In any clinical setting, it is imperative that the quantitative measurement of a variable is not only reliable but also reproducible.25 Accurate and consistent measurements of macular thickness are essential when screening for, diagnosing and/or monitoring macular diseases, as well as glaucomatous damage.20,22 OCT provides accurate, non-invasive and rapid quantitative assessment of macular thickness.9,10,11 For the iVue-100 OCT to be classified as producing valid clinical macular thickness measurements, its repeatability has to be high. To the best of our knowledge, this aspect of the iVue-100 OCT has not previously been measured.

The test–retest reliability of an instrument can be assessed in terms of intra-observer, inter-observer and inter-session repeatability. While intra-observer repeatability refers to consistency of measurements when taken by the same operator, inter-observer repeatability is assessed using multiple operators. Inter-session repeatability requires the comparison of measurements taken by a single operator but on two or more separate sessions. The reliability of an instrument is important for clinical and research applications. The ICC, CoV and Bland–Altman analysis have been used as indicators of instrument repeatability in previous studies involving macular thickness measurements.12,21,22,26

The ICC was used to describe the correlation and relationship between repeated measurements for all three aspects, that is, intra-observer, inter-observer and inter-session repeatability. An ICC of 1 implies that the measurements are perfectly correlated. An ICC between 0.81 and 0.99 represents good agreement between repeated measurements.27 The ICCs for intra-observer, inter-observer and inter-session repeatability were consistently above 0.90, ranging between 0.940 and 0.993, indicating good agreement for all three aspects and for all nine areas measured. Garcia-Martin et al.21 using a Cirrus Fourier-domain OCT also reported ICCs of higher than 0.9 for intra-session repeatability except for the temporal parafoveal (ICC of 0.881) and superior perifoveal (ICC of 0.832) areas.

The CoV that indicates the measurement variability in relation to the mean is also known as the relative standard deviation. It is obtained by dividing the standard deviation of the thickness measurements by its mean and is another valid method of describing the reproducibility of repeated measurements.22 A CoV below 0.1 indicates high reproducibility,22 whereas a CoV below 0.05 is considered as excellent.21 Intra-observer repeatability was assessed with the CoV in addition to the ICC. Excellent repeatability was obtained for all nine areas (range of 0.04–0.049) with the exception of the fovea, by both observers. A similar range was reported by Gürses-Özden et al.22 of 0.047–0.064 and Garcia-Martin et al.21 of 0.6–1.8 for macular thickness measurements using the time-domain OCT Model 3000 and Fourier-domain Cirrus OCT, respectively. In this study, the CoVs for the fovea were greater than 0.05 but less than 0.1 which is still regarded as good repeatability (CoV of observers 1 and 2 were 0.081 and 0.084, respectively). Other studies21,22 also reported more variability in their CoVs for foveal measurements. As the fovea (1.5 mm in diameter according to Kanski2) comprises a small part of the macula, small shifts in alignment could bring the instrument onto the foveal margins which could lead to significant differences in thicknesses for this area12 and thus impact the repeatability.

Paired t-tests and Bland–Altman analysis were the third methods used in this study for both the inter-observer and inter-session repeatability. Overall, the measurements between the two observers were found to be within 1 µm of each other in all areas with the exception of the nasal parafoveal area where the difference was 1.120 µm. Similarly, the mean difference for all nine areas between sessions was also within 1 µm of each other. There were no statistically significant differences in measurements, for all nine areas between observers or between sessions. Garcia-Martin et al.21 also noted no significant differences between macular thickness measurements taken in two sessions using the Cirrus OCT. In this study, the mean difference in foveal thicknesses for inter-session repeatability was only 0.313 µm. Garcia-Martin et al.21 noted a slightly higher difference of 1.9 µm in mean foveal thickness measurements taken over two sessions. Even though both the iVue-100 and the Cirrus OCT are Fourier-domain instruments, differences in the algorithms, scanning speeds and axial resolution may account for the variation in findings.

Bland–Altman analysis quantifies the agreement between two quantitative measurements using the mean difference and the construction of limits of agreement.25 Agreement between two measurements is concluded if 95% of the data points lie within two (1.96) standard deviations of the mean difference.20,25 In this study, good repeatability was obtained for both inter-observer and inter-session repeatability as 96% of data points were within the 95% limits of agreements for the foveal region. The limitation of this type of analysis is that it does not indicate if the limits are clinically meaningful or not.25 The limits of agreement for inter-observer and inter-session repeatability were 21.65 µm and 18.37 µm, respectively. Considering the average foveal thickness as measured with the iVue-100 in a myopic South African population28 was 240.50 µm, the limits of agreement in this study represent less than 9% of the thickness. If the outliers were removed or the sample size increased, then perhaps the LoA might reduce.

Conclusion

The iVue-100 OCT demonstrates good intra-observer, inter-observer and inter-session repeatability for macular thickness measurements, which validates its use in a clinical setting and also for research. This study, however, did not determine the accuracy of the measurements. Future studies should evaluate the repeatability of this instrument in eyes with conditions such as macular pathology or glaucoma to more completely understand its reliability when measuring macular thicknesses.

Acknowledgements

Competing interests

The authors declare that they have no financial or personal relationships that may have inappropriately influenced them in writing this article.

Authors’ contributions

N.R. and R.H. conceptualised the study, collected and analysed the data, and wrote the manuscript.

References

  1. Kronfeld PC, McHugh G, Polyak SL. The human eye in anatomical transparencies. New York: Bausch and Lomb Optical Company; 1944.
  2. Kanski JJ. Clinical ophthalmology: A systematic approach. 3rd ed. Oxford: Butterworth-Heinemann; 1994.
  3. Zhang SX. An atlas of histology. New York: Springer Science and Business Media; 1999.
  4. Cunningham DJ. Cunningham’s manual of practical anatomy. New York: Oxford University Press; 1986.
  5. Lens A, Nemeth SC, Ledford JK. Ocular anatomy and physiology. Thorofare, NJ: SLACK; 2008.
  6. Hildebrand GD, Fielder AR. Anatomy and physiology of the retina. In: Reynolds J, Olitsky S, editors. Pediatric retina. Berlin: Springer-Verlag, 2011; p. 39–63.
  7. Tortora GJ, Amitrano RJ. Anatomy and physiology laboratory manual. Belmont, CA: Brookes/Cole, Cengage Learning; 2013.
  8. Guyton AC. Textbook of medical physiology. Philadelphia, PA: WB Saunders Company; 1991.
  9. Chan A, Duker JS, Ko TH, Fujimoto JG, Schuman JS. Normal macular thickness measurements in healthy eyes using stratus optical coherence tomography. Arch Ophthalmol. 2006;124:193–198. https://doi.org/10.1001/archopht.124.2.193
  10. Adhi M, Aziz S, Muhammad K, Adhi MI. Macular thickness by age and gender in healthy eyes using spectral domain optical coherence tomography. PLoS One. 2012;7(5):e37638. https://doi.org/10.1371%2Fjournal.pone.0037638
  11. Song AP, Wu XY, Wang JR, Liu W, Sun Y, Yu T. Measurement of retinal thickness in macular region of high myopic eyes using spectral domain OCT. Int J Ophthalmol. 2014;7:122–127.
  12. Giani A, Cigada M, Choudhry N, et al. Reproducibility of retinal thickness measurement on normal and pathologic eyes by different optical coherence tomography instruments. Am J Ophthalmol. 2010;150:815–824. https://doi.org/10.1016/j.ajo.2010.06.025
  13. Hee MR, Izatt JA, Swanson EA, et al. Optical coherence tomography of the human retina. Arch Ophthalmol. 1995;113:325–332. https://doi.org/10.1001/archopht.1995.01100030081025
  14. Townsend KA, Wollstein G, Schuman JS. Imaging the retinal nerve fibre layer for glaucoma. Br J Ophthalmol. 2009;93:139–143. https://doi.org/10.1136/bjo.2008.145540
  15. Huang D, Swanson EA, Lin CP, et al. Optical coherence tomography. Science. 1991;254:1178–1181. https://doi.org/10.1126/science.1957169
  16. Ţălu S, Ţălu M, Giovanzana S, Shah RD. The history and use of optical coherence tomography in ophthalmology. Hum Vet Med. 2011;3:29–32.
  17. Pierro L, Giatsidis SM, Mantovani E, Gagliardi M. Macular thickness interoperator and intraoperator reproducibility in healthy eyes using 7 optical coherence tomography instruments. Am J Ophthalmol. 2010;150:199–204. https://doi.org/10.1016/j.ajo.2010.03.015
  18. Srinivasen VJ, Wojtkowski M, Witkin AJ, et al. High-definition and 3-dimensional imaging of macular pathologies with high-speed ultrahigh-resolution optical coherence tomography. Ophthalmology. 2006;113:2054.e1–2054.14. https://doi.org/10.1016%2Fj.ophtha.2006.05.046
  19. Lam DSC, Chan CKM, Mohamed S, et al. Intravitreal triamcinolone plus sequential grid laser versus triamcinolone or laser alone for treating diabetic macular edema. Ophthalmology. 2007;114:2162–2167. https://doi.org/10.1016/j.ophtha.2007.02.006
  20. Muscat S, Parks S, Kemp E, Keating D. Repeatability and reproducibility of macular thickness measurements with the Humphrey OCT system. Invest Ophthalmol Vis Sci. 2002;43:490–495.
  21. Garcia-Martin E, Pinilla I, Idoipe M, Fuertesi I, Pueyoi V. Intra and interoperator reproducibility of retinal nerve fibre and macular thickness measurements using Cirrus Fourier-domain OCT. Acta Ophthalmol. 2011;89:e23–e29. https://doi.org/10.1111/j.1755-3768.2010.02045.x
  22. Gürses-Özden R, Teng C, Vessani R, Zafar S, Liebmann JM, Ritch R. Macular and retinal nerve fiber layer thickness measurement reproducibility using optical coherence tomography (OCT-3). J Glaucoma. 2004;13:238–244. https://doi.org/10.1097/00061198-200406000-00012
  23. Optovue. iVue-100 user’s manual version 1.9. Fremont, CA: Optovue Inc.; 2011.
  24. Early Treatment Diabetic Retinopathy Study Research Group. Early treatment diabetic retinopathy study design and baseline patient characteristics. ETDRS report number 7. Ophthalmology. 1991;98:741–756. https://doi.org/10.1016/S0161-6420(13)38009-9
  25. Giavarina D. Understanding Bland-Altman analysis. Biochem Med. 2015;25:141–151. https://doi.org/10.11613/BM.2015.015
  26. Paunescu LA, Schuman JS, Price LL, et al. Reproducibility of nerve fiber thickness, macular thickness, and optic nerve head measurements using Stratus OCT. Invest Ophthalmol Vis Sci. 2004;45:1716–1724. https://doi.org/10.1167/iovs.03-0514
  27. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174. https://doi.org/10.2307/2529310
  28. Murugan C, Golodza BZ, Pillay K, et al. Retinal thickness in black and Indian myopic students at the University of KwaZulu-Natal. Afr Vision Eye Health. 2015;74, a24:1–6. https://doi.org/10.4102/aveh.v74i1.300

 

Crossref Citations

1. Characterization of Retinal Thickness in Individuals with Albinism: Baseline Data for a Black South African Population
Ethan Pillay, Thiroshnee Naidu, Khadija Asmal, Lilitha Maliwa, Sinenhlanhla Mchunu, Diane Beverly van Staden, Nishanee Rampersad
Clinical Optometry  vol: Volume 13  first page: 15  year: 2021  
doi: 10.2147/OPTO.S273141