The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
The Development, Assessment, and Selection of Questionnaires
Abstract
Patient-reported outcome measurement has become accepted as an important component of comprehensive outcomes research. Researchers wishing to use a patient-reported measure must either develop their own questionnaire (called an instrument in the research literature) or choose from the myriad of instruments previously reported. This article summarizes how previously developed instruments are best assessed using a systematic process and we propose a system of quality assessment so that clinicians and researchers can determine whether there exists an appropriately developed and validated instrument that matches their particular needs. These quality assessment criteria may also be useful to guide new instrument development and refinement. We welcome debate over the appropriateness of these criteria as this will lead to the evolution of better quality assessment criteria and in turn better assessment of patient-reported outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
(1965) · The Lancet · doi:10.1016/s0140-6736(65)91037-8 · Cited by 16,856
Quality criteria were proposed for measurement properties of health status questionnaires
Terwee, C. B., Bot, S. D. M., de Boer, M. R., van der Windt, D. A. W. M., Knol, D. L., Dekker, J., Bouter, L. M., & de Vet, H. C. W. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.03.012 · Cited by 10,764
Measuring agreement in method comparison studies
Bland, J. M., & Altman, D. G. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800204 · Cited by 9,619
Measuring agreement in method comparison studies
Bland, J. M., & Altman, D. G. (1999) · Statistical Methods in Medical Research · doi:10.1191/096228099673819272 · Cited by 9,619
(1932) · Medical Entomology and Zoology · Cited by 9,568
Focus Groups: A Practical Guide for Applied Research
Billson, J. M. (1989) · Human Biology · Cited by 8,560
Applying the Rasch Model: Fundamental Measurement in the Human Sciences
Bond, T. G., & Fox, C. M. (2003) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2003.tb01103.x · Cited by 4,492
Measuring Health: A Guide to Rating Scales and Questionnaires
McDowell, I., & Newell, C. (1987) · Cited by 4,207
Fleiss, J. L., & Cohen, J. (1973) · Educational and Psychological Measurement · doi:10.1177/001316447303300309 · Cited by 3,354
A Rating Formulation for Ordered Response Categories
Andrich, D. (1978) · Psychometrika · doi:10.1007/bf02293814 · Cited by 2,970
Wright, B. D., & Masters, G. N. (1982) · ACEReSearch Repository (Australian Council for Educational Research) · Cited by 1,930
The International Classification of Functioning, Disability and Health (ICF)
Bickenbach, J. E., & Jerosch‐Herold, C. (2009) · UEA Digital Repository (University of East Anglia) · Cited by 1,598
Methods for assessing responsiveness
Husted, J. A., Cook, R. J., Farewell, V. T., & Gladman, D. D. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00206-1 · Cited by 1,471
Health Measurement Scales: A Practical Guide To Their Development And Use
Streiner, D. L., & Norman, G. R. (2003) · doi:10.1093/oso/9780198528470.001.0001 · Cited by 1,460
Bond, T. G., & Fox, C. M. (2001) · Psychology Press eBooks · doi:10.4324/9781410600127 · Cited by 1,346
The VF-14: An Index of Functional Impairment in Patients With Cataract
Steinberg, E. P. (1994) · Archives of Ophthalmology · doi:10.1001/archopht.1994.01090170074026 · Cited by 960
Bland, J. M., & Altman, D. G. (1990) · Computers in Biology and Medicine · doi:10.1016/0010-4825(90)90013-f · Cited by 691
Health measurement scales. A practical guide to their development and use, 3rd ed
Rajmil, L. (2005) · Europe PMC (PubMed Central) · Cited by 567
Development of the Activities of Daily Vision Scale: A Measure of Visual Functional Status
Mangione, C. M., Phillips, R. S., Seddon, J. M., Lawrence, M. G., Cook, E. F., Dailey, R., & Goldman, L. (1992) · Medical Care · doi:10.1097/00005650-199212000-00004 · Cited by 539
Kappa coefficients in medical research
Chmura Kraemer, H., Periyakoil, V. S., & Noda, A. (2002) · Statistics in Medicine · doi:10.1002/sim.1180 · Cited by 527
Application of Rasch Analysis in the Development and Application of Quality of Life Instruments
Tennant, A., McKenna, S. P., & Hagell, P. (2004) · Value in Health · doi:10.1111/j.1524-4733.2004.7s106.x · Cited by 448
Eton, D. T., Cella, D., Yost, K. J., Yount, S. E., Peterman, A. H., Neuberg, D. S., Sledge, G. W., & Wood, W. C. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.01.012 · Cited by 390
Bravo, G., & Potvin, L. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90076-l · Cited by 316
Validity threats: overcoming interference with proposed interpretations of assessment data
Downing, S. M., & Haladyna, T. M. (2004) · Medical Education · doi:10.1046/j.1365-2923.2004.01777.x · Cited by 282
Psychometric properties of vision‐related quality of life questionnaires: a systematic review
De Boer, M. R., Moll, A. C., De Vet, H. C. W., Terwee, C. B., Völker‐Dieben, H. J. M., & Van Rens, G. H. M. B. (2004) · Ophthalmic and Physiological Optics · doi:10.1111/j.1475-1313.2004.00187.x · Cited by 263
The Quality of Life Impact of Refractive Correction (QIRC) Questionnaire: Development and Validation
Pesudovs, K., Garamendi, E., & Elliott, D. B. (2004) · Optometry and Vision Science · doi:10.1002/j.1538-9235.2004.tb01962.x · Cited by 242
Self-citationLamoureux, E. L., Pallant, J. F., Pesudovs, K., Hassell, J. B., & Keeffe, J. E. (2006) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.06-0220 · Cited by 227
Self-citationThe Measurement of Vision Disability
Massof, R. W. (2002) · Optometry and Vision Science · doi:10.1002/j.1538-9235.2002.tb01524.x · Cited by 201
Content Validity—The Source of My Discontent
Guion, R. M. (1977) · Applied Psychological Measurement · doi:10.1177/014662167700100103 · Cited by 200
The Activity Inventory: An Adaptive Visual Function Questionnaire
MASSOF, R. W., AHMADIAN, L., GROVER, L. L., DEREMEIK, J. T., GOLDSTEIN, J. E., RAINEY, C., EPSTEIN, C., & BARNETT, G. D. (2007) · Optometry and Vision Science · doi:10.1097/opx.0b013e3181339efd · Cited by 198
Pesudovs, K., Garamendi, E., Keeves, J. P., & Elliott, D. B. (2003) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.02-1075 · Cited by 183
Self-citationMassof, R. W., & Fletcher, D. C. (2001) · Vision Research · doi:10.1016/s0042-6989(00)00249-2 · Cited by 176
Brożek, J. L., Guyatt, G. H., & Schünemann, H. J. (2006) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-4-69 · Cited by 174
Lamoureux, E. L., Pallant, J. F., Pesudovs, K., Rees, G., Hassell, J. B., & Keeffe, J. E. (2007) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.06-0361 · Cited by 165
Self-citationDay, H. I., Jutai, J. W., & Campbell, K. A. (2002) · Disability and Rehabilitation · doi:10.1080/09638280110066343 · Cited by 161
Associations of Presbyopia With Vision-Targeted Health-Related Quality of Life
McDonnell, P. J. (2003) · Archives of Ophthalmology · doi:10.1001/archopht.121.11.1577 · Cited by 161
Psychometric properties of the National Eye Institute–Refractive Error Quality of Life instrument
Hays, R. D., Mangione, C. M., Ellwein, L. B., Lindblad, A. S., Spritzer, K. L., & McDonnell, P. J. (2003) · Ophthalmology · doi:10.1016/j.ophtha.2002.07.001 · Cited by 158
Comparing Alternative Rasch-Based Methods vs Raw Scores in Measuring Change in Health
Norquist, J. M., Fitzpatrick, R. M., Dawson, J., & Jenkinson, C. (2003) · Medical Care · doi:10.1097/01.mlr.0000103530.13056.88 · Cited by 157
Fundamental Measurement for Psychology
Embretson, S. E., & Hershberger, S. L. (1999) · doi:10.4324/9781410603593-9 · Cited by 154
Seiler, L. H. (1973) · Journal of Health and Social Behavior · doi:10.2307/2137117 · Cited by 153
Pesudovs, K., Garamendi, E., & Elliott, D. B. (2006) · Journal of Refractive Surgery · doi:10.3928/1081-597x-20060101-07 · Cited by 151
Self-citationResearch Methods Knowledge Base. (2nd ed.)
Trochim, W. M. (2017) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.15338895 · Cited by 151
Psychometric Properties of the Veterans Affairs Low-Vision Visual Functioning Questionnaire
Stelmack, J. A., Szlyk, J. P., Stelmack, T. R., Demers-Turco, P., Williams, R. T., Moran, D., & Massof, R. W. (2004) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.04-0208 · Cited by 141
Garamendi, E., Pesudovs, K., Stevens, M. J., & Elliott, D. B. (2005) · Vision Research · doi:10.1016/j.visres.2005.07.007 · Cited by 121
Self-citationPatient-centred measurement in ophthalmology – a paradigm shift
Pesudovs, K. (2006) · BMC Ophthalmology · doi:10.1186/1471-2415-6-25 · Cited by 111
Self-citationEvaluating cataract surgery gains by assessing patients' quality of life using the VF-7
Uusitalo, R. J., Brans, T., Pessi, T., et al. (1999) · Journal of Cataract & Refractive Surgery · doi:10.1016/s0886-3350(99)00082-6 · Cited by 110
Use of Rasch person-item map in exploratory data analysis: A clinical perspective
Stelmack, J. A., Szlyk, J. P., Stelmack, T. R., Babcock-Parziale, J. L., Demers-Turco, P., Williams, R. T., & Massof, R. W. (2004) · The Journal of Rehabilitation Research and Development · doi:10.1682/jrrd.2004.02.0233 · Cited by 110
Why Measurement Matters for Measuring Patient Vision Outcomes
Mallinson, T. (2007) · Optometry and Vision Science · doi:10.1097/opx.0b013e3181339f44 · Cited by 108
Massof, R. W., Hsu, C. T., Baker, F., Barnett, G. D., Park, W. L., Deremeik, J. T., Rainey, C., & Epstein, C. (2005) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2004.09.016 · Cited by 92
Thomeé, R., Grimby, G., Wright, B., & Linacre, J. M. (1995) · Journal of Rehabilitation Medicine · doi:10.2340/165019779527145151 · Cited by 89
Reliability and Validity of Refractive Error–Specific Quality-of-Life Instruments
Nichols, J. J., Mitchell, G. L., Saracino, M., & Zadnik, K. (2003) · Archives of Ophthalmology · doi:10.1001/archopht.121.9.1289 · Cited by 88
Visual Disability Variables. II: The Difficulty of Tasks for a Sample of Low-Vision Patients
Massof, R. W., Hsu, C. T., Baker, F. H., Barnett, G. D., Park, W. L., Deremeik, J. T., Rainey, C., & Epstein, C. (2005) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2004.09.017 · Cited by 85
Patient outcomes of refractive surgery
Schein, O. D., Vitale, S., Cassard, S. D., & Steinberg, E. P. (2001) · Journal of Cataract & Refractive Surgery · doi:10.1016/s0886-3350(01)00844-6 · Cited by 75
Changes in quality of life after laser in situ keratomileusis for myopia
Garamendi, E., Pesudovs, K., & Elliott, D. B. (2005) · Journal of Cataract & Refractive Surgery · doi:10.1016/j.jcrs.2004.12.059 · Cited by 70
Self-citationUsing the VA LV VFQ‐48 and LV VFQ‐20 in Low Vision Rehabilitation
Stelmack, J. A., & Massof, R. W. (2007) · Optometry and Vision Science · doi:10.1097/opx.0b013e3181339f1a · Cited by 64
An Interval‐Scaled Scoring Algorithm for Visual Function Questionnaires
Massof, R. W. (2007) · Optometry and Vision Science · doi:10.1097/opx.0b013e31812f5f35 · Cited by 62
Application of Stochastic Measurement Models to Visual Function Rating Scale Questionnaires
Massof, R. W. (2005) · Ophthalmic Epidemiology · doi:10.1080/09286580590932789 · Cited by 56
Improving Subjective Scaling of Pain Using Rasch Analysis
Pesudovs, K., & Noble, B. A. (2005) · Journal of Pain · doi:10.1016/j.jpain.2005.04.001 · Cited by 53
Self-citationStatistical strategies to assess reliability in ophthalmology
Patton, N., Aslam, T. M., & Murray, G. D. (2005) · Eye · doi:10.1038/sj.eye.6702097 · Cited by 46
Are Standard Instruments Valid for the Assessment of Quality of Life and Symptoms in Glaucoma?
Lamoureux, E. L., Ferraro, J. G., Pallant, J., Pesudovs, K., Rees, G., & Keeffe, J. E. (2007) · Optometry and Vision Science · doi:10.1097/opx.0b013e3181334b83 · Cited by 43
Self-citationValderas, J. M., Alonso, J., Prieto, L., Espallargues, M., & Castells, X. (2004) · Quality of Life Research · doi:10.1023/b:qure.0000015298.09085.b0 · Cited by 37
DeRoos, Y. S., & Allen‐Meares, P. (1998) · Journal of Social Service Research · doi:10.1300/j079v23n03_06 · Cited by 28
ASSOCIATIONS OF PRESBYOPIA WITH VISION-TARGETED HEALTH-RELATED QUALITY OF LIFE
Luo, B. (2004) · Evidence-Based Eye Care · doi:10.1097/00132578-200404000-00020 · Cited by 26
The Eye Sensation Scale: An Ophthalmic Pain Severity Measure
Caudle, L. E., Williams, K. A., & Pesudovs, K. (2007) · Optometry and Vision Science · doi:10.1097/opx.0b013e31812f7690 · Cited by 17
Self-citationGrow, S. J. L. (2007) · Optometry and Vision Science · doi:10.1097/opx.0b013e31812f5f24 · Cited by 8
Research works printed but not linked: 12
- Jutai J, 2003, The predictability of retention and discontinuation of contact lenses, Optometry, 74, 299
- Day HY, 2001, The stability of impact of assistive devices, Disabil Rehabil, 23, 400, 10.1080/09638280010008906 · doi:10.1080/09638280010008906
- Day H, 2003, Is telephone assessment a valid tool in rehabilitation research and practice, Disabil Rehabil, 25, 1126, 10.1080/0963828031000152057 · DOI
- Vitale S, 2000, The refractive status and vision profile: a questionnaire to measure vision‐related quality of life in persons with refractive error, Ophthalmology, 107, 1529, 10.1016/S0161-6420(00)00171-8 · doi:10.1016/s0161-6420(00)00171-8
- Schein OD, 2000, The measurement of patient‐reported outcomes of refractive surgery: the refractive status and vision profile, Trans Am Ophthalmol Soc, 98, 439
- Nichols JJ, 2005, Sensitivity of the National Eye Institute Refractive Error Quality of Life instrument to refractive surgery outcomes, J Cataract Refract Surg, 31, 2313, 10.1016/j.jcrs.2005.04.033 · doi:10.1016/j.jcrs.2005.04.033
- McDonnell PJ, 2003, Responsiveness of the National Eye Institute Refractive Error Quality of Life instrument to surgical correction of refractive error, Ophthalmology, 110, 2302, 10.1016/j.ophtha.2003.02.004 · doi:10.1016/j.ophtha.2003.02.004
- Trochim WMK, 2000, The Research Methods Knowledge Base
- Embretson SE, 1999, The New Rules of Measurement: What Every Psychologist and Educator Should Know, 65, 10.4324/9781410603593 · DOI · Paper page
- Linacre JM, 1998, Structure in Rasch residuals: why principal components analysis, Rasch Meas Trans, 12, 636
- Linacre JM, 2003, Size vs. significance: Standardized chi‐square fit statistic, Rasch Meas Trans, 17, 918
- Fisher W, 1992, Reliability statistics, Rasch Meas Trans, 6, 238
Cited by
Revised Olweus Bully/Victim Questionnaire: Evaluation in Visually Impaired
Gothwal, V. K., Sumalini, R., Irfan, S. M., Giridhar, A., & Bharani, S. (2013) · Optometry and Vision Science · doi:10.1097/opx.0b013e3182959b52 · Cited by 367
Patient involvement in the development of patient‐reported outcome measures: a scoping review
Wiering, B., de Boer, D., & Delnoij, D. (2017) · Health Expectations · doi:10.1111/hex.12442 · Cited by 371
Social and emotional impact of diabetic retinopathy: a review
Fenwick, E., Rees, G., Pesudovs, K., Dirani, M., Kawasaki, R., Wong, T. Y., & Lamoureux, E. (2012) · Clinical & Experimental Ophthalmology · doi:10.1111/j.1442-9071.2011.02599.x · Cited by 156
Self-citationGimeno-Santos, E., Raste, Y., Demeyer, H., Louvaris, Z., de Jong, C., Rabinovich, R. A., Hopkinson, N. S., Polkey, M. I., Vogiatzis, I., Tabberer, M., et al. (2015) · European Respiratory Journal · doi:10.1183/09031936.00183014 · Cited by 151
Knibb, R. C., Barnes, C., & Stalker, C. (2015) · Clinical & Experimental Allergy · doi:10.1111/cea.12599 · Cited by 60
Metadata
- Authors
- PESUDOVS, K., BURR, J. M., HARLEY, C., & ELLIOTT, D. B.
- Venue
- Optometry and Vision Science
- Publisher
- Wiley
- Published
- 2007-08
- Volume
- 84
- Issue
- 8
- Pages
- 663-674
- ISSN
- 1040-5488 (ISSN-L)
- OpenAlex
- W2160509611
- Cited by
- 403
- References
- 67
- FWCI
- 71.07
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- onlinelibrary.wiley.com/termsAndConditions#vor (vor)
- doi.wiley.com/10.1002/tdm_license_1.1 (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.