The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Internet-based Questionnaire Assessment: Appropriate Use in Clinical Contexts
Abstract
Use of internet-mediated questionnaire assessment is growing in behavioural telehealth provision. Literature on web-based psychological testing indicates that--while tests used online should be validated for online use--such measures can be reliable and valid. However, use of normative data (especially data from paper-and-pencil samples) presents problems. Studies have shown score distributions may differ across testing media, even when comparisons are made between equivalent samples. Data from 3 different projects illustrate such (substantive) differences, and the errors that would result from using established norms to interpret internet-mediated assessments. Given representativeness issues with "internet norms", it is recommended that if online tests are used for clinical purposes, this should currently be done in a manner that does not rely on normative data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The online administration of assessments can yield psychometric properties equivalent to their paper-and-pencil counterparts.60”
In the citing paper
“Self-reported online questionnaires generally have the same psychometric properties as paper-and-pencil administrated questionnaires (Buchanan, 2003).”
From Internet-based treatment for vulvodynia (EMBLA) – Study protocol for a randomised controlled study (2021) · cites this paper as Buchanan, 2003
Citations
Cites
The Hospital Anxiety and Depression Scale
Zigmond, A. S., & Snaith, R. P. (1983) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1983.tb09716.x · Cited by 47,139
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032
(1970) · Cited by 24,983
Self-monitoring of expressive behavior.
Snyder, M. (1974) · Journal of Personality and Social Psychology · doi:10.1037/h0037039 · Cited by 3,525
(1999) · Medical Entomology and Zoology · Cited by 3,151
Personality Psychology in Europe
Vera-Bermudez, J., Raad, D. B., de Vries, J., García, A. M. P., Sanchez-Elvita, A., & Heck, G. V. (1997) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 2,462
Measures in Health Psychology: A User's Portfolio
Johnston, M., Wright, S., & Weinman, J. A. (1995) · Cited by 1,300
Social desirability, anonymity, and internet-based questionnaires
Joinson, A. (1999) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03200723 · Cited by 818
Moorey, S., Greer, S., Watson, M., Gorman, C., Rowden, L., Tunmore, R., Robertson, B., & Bliss, J. M. (1991) · The British Journal of Psychiatry · doi:10.1192/bjp.158.2.255 · Cited by 653
World-Wide Web survey research: Benefits, potential problems, and solutions
Schmidt, W. C. (1997) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03204826 · Cited by 620
Research works printed but not linked: 4
- 2001, The Psychologist, 14, 244
- 2000, APA Monitor on Psychology, 31, 13
- Snyder, 1987, Public Appearances/Private Realities
- Woolhouse, Myers. Factors Affecting Sample Make-up: Results from an Internet-based Personality Questionnaire. Paper presented at the 1999 British Psychological Society Social Psychology Section Conference. September,
Cited by
Sorted by citations
Items 101–168 of 168
Terhorst, Y., Braun, L., Titzler, I., Buntrock, C., Freund, J., Thielecke, J., Ebert, D., & Baumeister, H. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-034271 · Cited by 10
Maternal Fair/Poor Self-Rated Health and Adverse Infant Birth Outcomes
Teoli, D. A., Zullig, K. J., & HENDRYX, M. S. (2013) · Health Care For Women International · doi:10.1080/07399332.2013.862796 · Cited by 9
“Prior researchers have shown that health care screenings conducted in this style furnish easy and expedited access to large populations at very low cost (Austin, Carlbring, Richards, & Andersson, 2006; Buchanan, 2003).”
BackgroundPilot study of an Internet-based personalized feedback intervention for problem gamblers
Cunningham, J. A., Hodgins, D. C., & Toneatto, T. (2011) · Journal of Gambling Issues · doi:10.4309/jgi.2011.26.2 · Cited by 8
“This limitation also points to the need to explore whether this screener—consisting of measures that have largely been validated in paper and pencil format—is also psychometrically valid in a computerized format (Buchanan, 2003).”
BackgroundHirai, M., Vernon, L. L., & Clum, G. A. (2016) · Assessment · doi:10.1177/1073191116661630 · Cited by 9
“Given the increasing popularity of online assessment and research and the benefits noted above, it is important to establish the psychometric properties of assessment instruments using this medium (e.g., Buchanan, 2003).”
BackgroundPsychometric properties of the body dysmorphic disorder‐dimensional scale
Macfarlane, F., Luo, A., Moses, K., Russell, A., Cheyne, J., de Bolger, A. D. P., & Wootton, B. M. (2019) · Clinical Psychologist · doi:10.1111/cp.12200 · Cited by 8
Psychometric properties of the excoriation (skin‐picking disorder) dimensional scale
Russell, A., de Bolger, A. D. P., Moses, K., Luo, A., & Wootton, B. M. (2020) · Clinical Psychologist · doi:10.1111/cp.12207 · Cited by 8
Bedeutung der Medien für klinisch-psychologische Interventionen
Eichenberg, C. (2008) · Springer-Lehrbuch · doi:10.1007/978-3-540-46899-8_21 · Cited by 8
Internet-based treatment for vulvodynia (EMBLA) – Study protocol for a randomised controlled study
Hess Engström, A., Kullinger, M., Jawad, I., Hesselman, S., Buhrman, M., Högberg, U., & Skalkidou, A. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100396 · Cited by 7
“Self-reported online questionnaires generally have the same psychometric properties as paper-and-pencil administrated questionnaires (Buchanan, 2003).”
BackgroundUse of a smartphone application to screen for bipolar spectrum disorder in a community sample
Woo, Y. S., Bahk, W., Hong, J., Yoon, B.-H., Hwang, T.-Y., Kim, M.-D., & Jon, D. (2015) · Health Informatics Journal · doi:10.1177/1460458215589601 · Cited by 8
Cross validation of hard-copy and web-based formats of the Sport Imagery Ability Measure
Ruiz, M. C., Watt, A. P., Samper, N. P., & Morris, T. (2018) · International Journal of Sport and Exercise Psychology · doi:10.1080/1612197x.2018.1428209 · Cited by 7
“Thus, comparative analysis of web-based instruments of which there is a hard-copy version is recommended (Buchanan, 2003).”
BackgroundMañanes, G., Vallejo, M. A., & Vallejo-Slocker, L. (2016) · Gaceta Sanitaria · doi:10.1016/j.gaceta.2015.07.004 · Cited by 6
Sabb, F. W., Hellemann, G., Lau, D., Vanderlan, J. R., Cohen, H. J., Bilder, R. M., & McCracken, J. T. (2013) · Brain and Behavior · doi:10.1002/brb3.158 · Cited by 6
Establishing the content validity of an online depression screening tool for South Africa
Hassem, T. (2021) · African Journal of Psychological Assessment · doi:10.4102/ajopa.v3i0.62 · Cited by 6
Successful Self-Treatment of a Case of Writer's Block
Carlbring, P., & Andersson, G. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2010.549791 · Cited by 6
Validation of the Italian Version of the Web Screening Questionnaire for Common Mental Disorders
Pietrabissa, G., Semonella, M., Marchesi, G., Mannarini, S., Castelnuovo, G., Andersson, G., & Rossi, A. A. (2024) · Journal of Clinical Medicine · doi:10.3390/jcm13041170 · Cited by 6
Gómez-Gómez, I., Domínguez-Salas, S., Rodríguez-Muñoz, M. F., Rodríguez-Domínguez, C., Gómez-Baya, D., & Motrico, E. (2024) · Psicothema · doi:10.7334/psicothema2023.293 · Cited by 5
Translation and validation of the contact lens dry eye questionnaire 8 (CLDEQ-8) in Canadian French
Lortie-Milner, É., Boily, L., Michaud, L., Quesnel, N., Simard, P., Milner, V., & Boissy, P. (2022) · Contact Lens and Anterior Eye · doi:10.1016/j.clae.2022.101779 · Cited by 5
The Online Version of the Chinese Intolerance of Uncertainty Scale: Psychometric Properties
Yang, Z., Chen, H., Zhang, X., Wang, R., & Ding, J. (2016) · Cyberpsychology Behavior and Social Networking · doi:10.1089/cyber.2015.0149 · Cited by 5
“It 34–36 There are some possible explanations.”
Technology Integration and Behavioral Assessment
Richard, D. C. S., & Gloster, A. T. (2006) · Elsevier eBooks · doi:10.1016/b978-012343013-7/50021-5 · Cited by 4
Sleep disorder diagnosis: the design and implications of online tools
Blake, J., & Kerr, D. V. (2014) · Decision Analytics · doi:10.1186/2193-8636-1-7 · Cited by 4
“ous studies that the Internet administration of questionnaires offers a valid mode of delivery (Buchanan 2003; Carlbring et al. 2007; Johnson 2005).”
BackgroundClinical Assessment in Clinical Videoconferencing
Luxton, D. D., Pruitt, L. D., & Jenkins‐Guarnieri, M. A. (2014) · Behavioral telehealth · doi:10.1007/978-3-319-08765-8_9 · Cited by 5
ACT with Pain : measurement, efficacy and mechanisms of Acceptance & Commitment Therapy
Trompetter, H. (2014) · doi:10.3990/1.9789036537087 · Cited by 4
Panic! Its Prevalence, Diagnosis and Treatment via the Internet
Carlbring, P. (2004) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 4
Tanaka, M., Saito, M., Takahashi, M., Adachi, M., & Nakamura, K. (2021) · JMIR Pediatrics and Parenting · doi:10.2196/20172 · Cited by 3
“Therefore, it is necessary to evaluate the comparability of web-based and paper-and-pencil versions of the questionnaires [35].”
BackgroundImpact of online live broadcasts on environmental destructive behavioral intention
Xiao, F., Xu, M., Wu, J., Meng, C., & Hong, Y. (2023) · PLoS ONE · doi:10.1371/journal.pone.0286967 · Cited by 4
Knudsen, B. M., Nørgaard, B., Rasmussen, H., & Bruun, I. H. (2023) · BMC Geriatrics · doi:10.1186/s12877-023-04240-2 · Cited by 3
“Even though the online questionnaire is an adaption of a traditional paper-based version, more is needed to assume that the psychometric properties of the original version apply to the translated online version [32].”
BackgroundFrizelle, P., BUCKLEY, A., Biancone, T., Ceroni, A., Dahly, D. L., Fletcher, P. J., Bishop, D., & McKean, C. (2023) · Journal of Child Language · doi:10.1017/s0305000923000545 · Cited by 4
“In any case, we cannot assume that the psychometric properties of an online test are identical to its traditional equivalent (Buchanan, 2003; Buchanan et al., 2010).”
Persönlichkeitsdiagnostik in der Online-Psychotherapieforschung
Tibubos, A. N., Zwerenz, R., Brähler, E., & Beutel, M. E. (2018) · Zeitschrift für Psychiatrie Psychologie und Psychotherapie · doi:10.1024/1661-4747/a000353 · Cited by 3
Altmann, T., & Kapoor, N. (2021) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000465 · Cited by 3
Internet-based cognitive behaviour therapy for subthreshold depression in people over 50 years old
Cuijpers, W. J. M. J., Pop, V. J. M., Nyklíček, I., & Spek, V. (2004) · Cited by 3
Enhancing the Oregon Crash Reporting Process: A Feasibility Assessment
Monsere, C. M., Wilson, E. E., & Springberg, A. (2006) · Cited by 2
How Can You Improve Quality Without Measuring Outcome? Getting From Here to There
Zimmerman, M. A., Young, D., Chelminski, I., & Dalrymple, K. L. (2010) · Cited by 2
Grussu, P., Quatraro, R. M., Alderdice, F. A., & Jorizzo, G. J. (2022) · Maternal and Child Health Journal · doi:10.1007/s10995-022-03468-5 · Cited by 2
“However, some tools have different psychometric properties when delivered online, suggesting a need for validation for online use and potentially different cut-off points (Buchanan, 2003).”
BackgroundEthical challenges and dilemmas of online psychotherapy
Lodha, P., & Sousa, A. D. (2023) · Elsevier eBooks · doi:10.1016/b978-0-443-15299-3.00001-4 · Cited by 2
Rosmarin, D. H. (2009) · ScholarWorks@BGSU (Bowling Green State University) · Cited by 2
A Linguistic Decision Making Model for Psychometric Tests
Seth, T., Gupta, P. K., & Muhuri, P. K. (2019) · IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) · doi:10.1109/fuzz-ieee.2019.8858794 · Cited by 2
“Response 1: After normalizing the domain from [1,5]to [0,1], the resulting interval is [0.”
BackgroundInfluentialPsicoterapia a través de internet: recursos tecnológicos en la práctica de la psicoterapia
Pareja, M. Á. V., & Cristóbal, C. M. J. (2007) · Dialnet (Universidad de la Rioja) · Cited by 2
Domínguez‐Salas, S., Gómez‐Gómez, I., Rodríguez-Muñoz, M. F., Rodríguez-Domínguez, C., Gómez‐Baya, D., & Motrico, E. (2026) · Human Behavior and Emerging Technologies · doi:10.1155/hbe2/8792831 · Cited by 1
Evaluating strategies for detecting test faking
Davies, J., & Hepworth, C. (2009) · The British Journal of Forensic Practice · doi:10.1108/14636646200900006 · Cited by 1
Technology-Based Cognitive-Behavioral Therapy in School Settings
Tazeau, Y. N., & Fortugno, D. A. (2014) · Springer eBooks · doi:10.1007/978-1-4939-1972-7_16 · Cited by 1
Test-retest reliability and further validity of the cognitive fusion questionnaire
Campbell, L. (2010) · ERA · Cited by 1
Understanding pain in people who have had breast cancer
Andrews, S. (2015) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York) · Cited by 1
Tele-health and clinical assessment (tele-assessment)
Wright, A. J. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-91497-0.00051-5 · Cited by 1
On the digital road to recovery? Assessment, theory, and treatment of depression via the internet
de Graaf, L. E. (2009) · Research Publications (Maastricht University) · doi:10.26481/dis.20091023lg
How an internet intervention works to achieve benefit for patients with coronary heart disease
Kerr, C. (2010) · UCL Discovery (University College London)
Guided Internet-Based Cognitive Behaviour Therapy for Chronic Pain
Buhrman, M. (2012) · KTH Publication Database DiVA (KTH Royal Institute of Technology)
Using the internet to conduct research relevant to forensic practice
Davies, J., Oddie, S., & Powls, J. (2007) · The British Journal of Forensic Practice · doi:10.1108/14636646200700022
Kramer, S. E., Stephens, D., & Espeso, A. (2006) · Hearing Balance and Communication · doi:10.1080/16513860601028957
“(21) and Buchanan (22) argue that equivalence cannot be taken for granted, even though conflicting evidence for significant differences between paperand-pencil formats and internet administration is found (23).”
BackgroundCariola, L. A. (2014) · Rorschachiana Journal of the International Society for the Rorschach · doi:10.1027/1192-5604/a000048
“…web-based questionnaire scores compared with offline questionnaires scores, which alludes to the question of whether Internet-mediated assessment might more accurately reflect the personalities and dispositions of participants compared with offline tests (Barak & Hen, 2008; Buchanan, 2003).”
ResultEnhancing the Oregon Crash Reporting Process: A Feasibility Study
Monsere, C. M., Wilson, E. E., & Springberg, A. (2005) · PDXScholar (Portland State University)
Phobia Inventory (Mini-SPIN) Applied to One Clinical and Two Nonclinical Samples 1
Ek, A., & Östlund, P. (2013)
Telepsychology: A Potential Lifeline for People in the UAE
O’Connell, C. (2015) · Palgrave Macmillan US eBooks · doi:10.1057/9781137558237_14
a Jewish community sample: A preliminary investigation
Rosmarin, D. H., Pargäment, K. I., & Mahoney, A. (2008)
Validation of an Internet-based Approach to Cognitive Screening in Multiple Sclerosis
Akbar, N. (2011) · TSpace (University of Toronto)
Blake, J., & Kerr, D. V. (2014) · Advances in healthcare information systems and administration book series · doi:10.4018/978-1-4666-6316-9.ch008
Validation of Web-based Psychological Assessments
곽지은, Kwak, H.-W., & 정혜원 (2008) · 한국심리학회지: 인지 및 생물 · doi:10.22172/cogbio.2008.20.4.007
Neural respons till information i trevalenser för patienter med social ångest
Månsson, K. N. T. (2010) · KTH Publication Database DiVA (KTH Royal Institute of Technology)
CAARS-S:L Infrequency Index Validation
Wallace, E. R. (2017) · UKnowledge (University of Kentucky) · doi:10.13023/etd.2017.504
“However, some have raised concerns regarding equivalence between online and paper forms (Buchanan, 2002; Buchanan, 2003; Noyes & Garland, 2008), such as dissimilar factor structure in online forms converted from paper measures or unforeseen interactions between assessment medium and construct.”
BackgroundBlake, J., & Kerr, D. V. (2015) · IGI Global eBooks · doi:10.4018/978-1-4666-8619-9.ch069
Малиношевська, А. В., & Melnyk, M. (2023) · Information Technologies and Learning Tools · doi:10.33407/itlt.v94i2.5130
Andersson, G., & Berger, T. (2015) · Wiley eBooks · doi:10.1002/9781394259229.ch20
جادالله, ش. م. ع. ا., & سيلمان, س. م. (2023) · مجلة بحوث و دراسات نفسية · doi:10.21608/jshp.2023.352614
Knudsen, B. M., Nørgaard, B., Rasmussen, H., & Bruun, I. H. (2023) · Figshare · doi:10.6084/m9.figshare.24054280
Knudsen, B. M., Nørgaard, B., Rasmussen, H., & Bruun, I. H. (2023) · Figshare · doi:10.6084/m9.figshare.24054277
Davey, C. J. (2011) · Bradford Scholars (University of Bradford)
Metadata
- Authors
- Buchanan, T.
- Affiliations
- University of Westminster (GB)
- Corresponding author
- Buchanan, Tom
- ORCID
- Buchanan, Tom
- Venue
- Cognitive Behaviour Therapy
- Publisher
- Informa UK Limited
- Published
- 2003-01
- Volume
- 32
- Issue
- 3
- Pages
- 100-109
- ISSN
- 1650-6073 (ISSN-L)
- 1651-2316
- OpenAlex
- W2065602829
- Cited by
- 168
- References
- 40
- Citations by year
- 2026: 1 · 2024: 2 · 2023: 8 · 2022: 4 · 2021: 7 · 2020: 2 · 2019: 6 · 2018: 7 · 2017: 7 · 2016: 5 · 2015: 10 · 2014: 19 · 2013: 12 · 2012: 5
- FWCI
- 28.68
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Cognitive Behaviour Therapy (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- reference values, test-retest reliability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
