The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Statistical methods for conducting agreement (comparison of clinical tests) and precision (repeatability or reproducibility) studies in optometry and ophthalmology
Open accessAbstract
Citation information : McAlinden C, Khadka J & Pesudovs K. Statistical methods for conducting agreement (comparison of clinical tests) and precision (repeatability or reproducibility) studies in optometry and ophthalmology. Ophthalmic Physiol Opt 2011, 31 , 330–338. doi: 10.1111/j.1475‐1313.2011.00851.x The ever‐expanding choice of ocular metrology and imaging equipment has driven research into the validity of their measurements. Consequently, studies of the agreement between two instruments or clinical tests have proliferated in the ophthalmic literature. It is important that researchers apply the appropriate statistical tests in agreement studies. Correlation coefficients are hazardous and should be avoided. The ‘limits of agreement’ method originally proposed by Altman and Bland in 1983 is the statistical procedure of choice. Its step‐by‐step use and practical considerations in relation to optometry and ophthalmology are detailed in addition to sample size considerations and statistical approaches to precision (repeatability or reproducibility) estimates.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“This was consistent with recommendations from McAlinden et al that sample sizes for agreement studies should include at least 100 subjects(McAlinden et al., 2011).”
From Acceptability and Concordance of Self- Versus Clinician- Sampling for HPV Testing among Rural South Indian Women (2021) · cites this paper as McAlinden et al., 2011
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Measuring agreement in method comparison studies
Bland, J. M., & Altman, D. G. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800204 · Cited by 9,619
A concordance correlation coefficient to evaluate reproducibility.
Lin, L. I.-K. (1989) · Biometrics · doi:10.2307/2532051 · Cited by 8,785
Scheffé, H. (1960) · Soil Science · doi:10.1097/00010694-196006000-00016 · Cited by 5,625
Measurement in Medicine: The Analysis of Method Comparison Studies
Altman, D. G., & Bland, J. M. (1983) · The Statistician · doi:10.2307/2987937 · Cited by 4,300
Comprehensive Textbook of Psychiatry
Schwab, J. J. (1968) · Psychosomatics · doi:10.1016/s0033-3182(68)71813-2 · Cited by 1,291
Measurement reliability and agreement in psychiatry
Shrout, P. E. (1998) · Statistical Methods in Medical Research · doi:10.1177/096228029800700306 · Cited by 1,211
Clinical biostatistics: LIV. The biostatistics of concordance
Kramer, M. S., & Feinstein, A. R. (1981) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.1981.18 · Cited by 1,087
Improving the Reliability of the Pelli-Robson Contrast Sensitivity Test
Bullimore, M. A., Elliott, D. B., & Bailey, I. L. (1991) · Noninvasive Assessment of the Visual System · doi:10.1364/navs.1991.md12 · Cited by 257
Clinical evaluation of the Grand Seiko Auto Ref/Keratometer WAM-5500
Sheppard, A. L., & Davies, L. N. (2009) · Ophthalmic and Physiological Optics · doi:10.1111/j.1475-1313.2009.00701.x · Cited by 197
Maust, D. T., Cristancho, M. A., Gray, L. B., Rushing, S. E., Tjoa, C., & Thase, M. E. (2012) · Handbook of clinical neurology · doi:10.1016/b978-0-444-52002-9.00013-9 · Cited by 183
Pesudovs, K. (2003) · British Journal of Ophthalmology · doi:10.1136/bjo.88.1.11 · Cited by 177
Self-citationAccounting for the Correlation Between Fellow Eyes in Regression Analysis
Glynn, R. J. (1992) · Archives of Ophthalmology · doi:10.1001/archopht.1992.01080150079033 · Cited by 150
Rohrer, K., Frueh, B. E., Wälti, R., CLEMETSON, I., Tappeiner, C., & Goldblum, D. (2009) · Ophthalmology · doi:10.1016/j.ophtha.2009.04.019 · Cited by 147
Comparison of 2 laser instruments for measuring axial length
Hoffer, K. J., Shammas, J. H., & Savini, G. (2010) · Journal of Cataract & Refractive Surgery · doi:10.1016/j.jcrs.2009.11.007 · Cited by 144
Chen, S., Huang, J., Wen, D., Chen, W., Huang, D., & Wang, Q. (2010) · Acta Ophthalmologica · doi:10.1111/j.1755-3768.2010.01947.x · Cited by 121
Raasch, T. W., Schechtman, K. B., Davis, L. J., Zadnik, K., & The CLEK Study Group (2001) · Ophthalmic and Physiological Optics · doi:10.1046/j.1475-1313.2001.00596.x · Cited by 109
Hashemi, H., & Mehravaran, S. (2007) · Journal of Cataract & Refractive Surgery · doi:10.1016/j.jcrs.2007.01.019 · Cited by 94
A Comparison of Autorefractor Performance
Pesudovs, K., & Weisinger, H. S. (2004) · Optometry and Vision Science · doi:10.1002/j.1538-9235.2004.tb01830.x · Cited by 93
Self-citationImproving the reliability of visual acuity measures in young children
McGraw, P. V., Winn, B., Gray, L. S., & Elliott, D. B. (2000) · Ophthalmic and Physiological Optics · doi:10.1016/s0275-5408(99)00054-x · Cited by 91
The Precision of Wavefront Refraction Compared to Subjective Refraction and Autorefraction
Pesudovs, K., Parker, K. E., Cheng, H., & Applegate, R. A. (2007) · Optometry and Vision Science · doi:10.1097/opx.0b013e31804f81a9 · Cited by 70
Self-citationHuang, J., Pesudovs, K., Wen, D., Chen, S., Wright, T., Wang, X., Li, Y., & Wang, Q. (2011) · Journal of Cataract & Refractive Surgery · doi:10.1016/j.jcrs.2010.08.044 · Cited by 69
Self-citationShammas, J. H., & Chan, S. (2010) · Journal of Cataract & Refractive Surgery · doi:10.1016/j.jcrs.2010.02.027 · Cited by 63
Static and Dynamic Accommodation Measured Using the WAM‐5500 Autorefractor
Win-Hall, D. M., Houser, J., & Glasser, A. (2010) · Optometry and Vision Science · doi:10.1097/opx.0b013e3181f6f98f · Cited by 63
Carey, P. J., Leccisotti, A., McGilligan, V., Goodall, E. A., & Moore, T. (2010) · Journal of Cataract & Refractive Surgery · doi:10.1016/j.jcrs.2009.08.033 · Cited by 58
Comparison of horizontal corneal diameter measurements using Galilei, EyeSys and Orbscan II systems
Salouti, R., Nowroozzadeh, M. H., Zamani, M., Ghoreyshi, M., & Salouti, R. (2009) · Clinical and Experimental Optometry · doi:10.1111/j.1444-0938.2009.00407.x · Cited by 58
Bourne, R., Rosser, D. A., Sukudom, P., Dineen, B., Laidlaw, D. A. H., Johnson, G. J., & Murdoch, I. (2003) · Eye · doi:10.1038/sj.eye.6700500 · Cited by 54
Effect of cycloplegia on axial length and anterior chamber depth measurements in children
Cheung, S. W., Chan, R., Cheng, R., & Cho, P. (2009) · Clinical and Experimental Optometry · doi:10.1111/j.1444-0938.2009.00419.x · Cited by 52
Babalola, O. E., Kehinde, A., Iloegbunam, A. C., Akinbinu, T., Moghalu, C., & Onuoha, I. (2009) · Ophthalmic and Physiological Optics · doi:10.1111/j.1475-1313.2008.00621.x · Cited by 51
Hrynchak, P. K., Herriot, C., & Irving, E. L. (2010) · Ophthalmic and Physiological Optics · doi:10.1111/j.1475-1313.2010.00723.x · Cited by 51
Ceruti, P., Morbio, R., Marraffa, M., & Marchini, G. (2008) · Eye · doi:10.1038/sj.eye.6703102 · Cited by 49
Evaluating agreement between clinical assessment methods
Marshall, G. N., Hays, R. D., & Nicholas, R. (1995) · Cited by 43
Zhang, Q., Jin, W., & Wang, Q. (2010) · Journal of Cataract & Refractive Surgery · doi:10.1016/j.jcrs.2009.12.038 · Cited by 42
Intra‐examiner repeatability and agreement in accommodative response measurements
Antona, B., Sanchez, I., Barrio, A. R., Barra, F., & González-Romero, E. (2009) · Ophthalmic and Physiological Optics · doi:10.1111/j.1475-1313.2009.00679.x · Cited by 42
Intra‐observer and inter‐observer variation of Hertel exophthalmometry
Lam, A. K. C., Lam, C., Leung, W., & Hung, P. (2009) · Ophthalmic and Physiological Optics · doi:10.1111/j.1475-1313.2008.00617.x · Cited by 42
Visual acuity assessment: a comparison of two tests for measuring children's vision
JONES, D. A., Westall, C. A., Averbeck, K., & Abdolell, M. (2003) · Ophthalmic and Physiological Optics · doi:10.1046/j.1475-1313.2003.00150.x · Cited by 38
An evaluation of the Bausch & Lomb Zywave aberrometer
Dobos, M. J., Twa, M. D., & Bullimore, M. A. (2009) · Clinical and Experimental Optometry · doi:10.1111/j.1444-0938.2009.00360.x · Cited by 28
Validation of Optical Coherence Tomography–Based Crystalline Lens Thickness Measurements in Children
Lehman, B. M., Berntsen, D. A., Bailey, M. D., & Zadnik, K. (2009) · Optometry and Vision Science · doi:10.1097/opx.0b013e318198198d · Cited by 27
Macular pigment measurement in clinics: controlling the effect of the ageing media
Makridaki, M., Carden, D. E., & Murray, I. J. (2009) · Ophthalmic and Physiological Optics · doi:10.1111/j.1475-1313.2009.00667.x · Cited by 25
Higher Order Aberrations Using the NIDEK OPD-Scan and AMO Wavescan
McAlinden, C., & Moore, J. E. (2010) · Journal of Refractive Surgery · doi:10.3928/1081597x-20100407-02 · Cited by 23
Self-citationRae, S. M., Allen, P. M., Radhakrishnan, H., Theagarayan, B., Price, H., Sailaganathan, A., Calver, R., & O’Leary, D. J. (2009) · Ophthalmic and Physiological Optics · doi:10.1111/j.1475-1313.2009.00678.x · Cited by 22
The use of correlation and regression methods in optometry
Armstrong, R. A., Eperjesi, F., & Gilmartin, B. (2005) · Clinical and Experimental Optometry · doi:10.1111/j.1444-0938.2005.tb06672.x · Cited by 21
Shah, N., Laidlaw, D. A. H., Brown, G. M., & Robson, C. (2010) · Ophthalmic and Physiological Optics · doi:10.1111/j.1475-1313.2009.00700.x · Cited by 20
Anterior Chamber Depth Measurement in Pseudophakic Eyes: A Comparison of Pentacam and Ultrasound
Savini, G., Olsen, T., Carbonara, C., Pazzaglia, S., Barboni, P., Carbonelli, M., & Hoffer, K. J. (2010) · Journal of Refractive Surgery · doi:10.3928/1081597x-20090617-02 · Cited by 18
Carrim, Z. I., & Lavy, T. E. (2009) · Ophthalmic and Physiological Optics · doi:10.1111/j.1475-1313.2009.00680.x · Cited by 15
Teller II and Cardiff Acuity Testing in a School‐Age Deafblind Population
Johnson, C., Kran, B. S., Deng, L., & Mayer, D. L. (2009) · Optometry and Vision Science · doi:10.1097/opx.0b013e318196bd35 · Cited by 13
Shemesh, G., Waisbourd, M., Varssano, D., Michaeli, A., Lazar, M., & Kurtz, S. (2009) · Cornea · doi:10.1097/ico.0b013e3181930be8 · Cited by 12
Construction and validation of a Tamil logMAR chart
Varadharajan, S., Srinivasan, K., & Kumaresan, B. (2009) · Ophthalmic and Physiological Optics · doi:10.1111/j.1475-1313.2009.00657.x · Cited by 9
Cited by
Sorted by citations
Statistical guidelines for the analysis of data obtained from one or both eyes
Armstrong, R. A. (2012) · Ophthalmic and Physiological Optics · doi:10.1111/opo.12009 · Cited by 538
Goligher, E. C., Laghi, F. A., Detsky, M. E., Farias, P., Murray, A., Brace, D., Brochard, L. J., Sebastien-Bolz, S., Rubenfeld, G. D., Kavanagh, B. P., et al. (2015) · Intensive Care Medicine · doi:10.1007/s00134-015-3687-3 · Cited by 451
Goligher, E. C., Laghi, F., Detsky, M. E., Farias, P., Murray, A., Brace, D., Brochard, L. J., Bolz, S.-S., Rubenfeld, G. D., Kavanagh, B. P., et al. (2015) · Intensive Care Medicine · doi:10.1007/s00134-015-3724-2 · Cited by 315
Sample Size for Assessing Agreement between Two Methods of Measurement by Bland−Altman Method
Lu, M., Zhong, W.-H., Liu, Y., Miao, H., Li, Y., & Ji, M. (2016) · The International Journal of Biostatistics · doi:10.1515/ijb-2015-0039 · Cited by 307
Comparison of subjective grading and objective assessment in meibography
Pult, H., & Riede-Pult, B. H. (2012) · Contact Lens and Anterior Eye · doi:10.1016/j.clae.2012.10.074 · Cited by 277
Metadata
- Authors
- McAlinden, C., Khadka, J., & Pesudovs, K.
- Affiliations
- Flinders University (AU)
- Corresponding author
- McAlinden, Colm
- Venue
- Ophthalmic and Physiological Optics
- Published
- 2011-05-26
- Volume
- 31
- Issue
- 4
- Pages
- 330-338
- ISSN
- 0275-5408 (ISSN-L)
- 1475-1313
- OpenAlex
- W2126376404
- Cited by
- 436
- References
- 49
- Citations by year
- 2026: 22 · 2025: 24 · 2024: 33 · 2023: 30 · 2022: 37 · 2021: 42 · 2020: 47 · 2019: 33 · 2018: 22 · 2017: 28 · 2016: 27 · 2015: 27 · 2014: 20 · 2013: 15 · 2012: 22
- FWCI
- 5.01
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Ophthalmic and Physiological Optics (publishedVersion)
- PubMed (publishedVersion)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Medicine › Ophthalmology › Ophthalmology and Visual Impairment Studies
- Keywords
- repeatability, reproducibility, limits of agreement, correlation coefficient, ophthalmic instruments, sample size, measurement precision, optometry
- MeSH terms
- Humans, Ophthalmology, Optometry, Vision, Ocular, Reproducibility of Results, Qualitative Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
