The DOI matches its Crossref record; 37 of the 38 references it cites were found in a registry or an index.
Internet vs. paper and pencil administration of questionnaires commonly used in panic/agoraphobia research
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Some of these advantages are that missing data can be handled better, and the assessment is easy and immediate [101]”
In the citing paper
“Research results encourage the use of online questionnaires because they offer advantages over traditional data collection strategies [101, 102].”
In the citing paper
“However, other studies have demonstrated the usefulness of Internet and telephone assessments, and their concordance with traditional face-to-face assessment (87–90).”
In the citing paper
“research has consistently shown that this administration format is feasible and works as well as paper and pencil questionnaires [39].”
From The promise and pitfalls of the internet for cognitive behavioral therapy (2010) · cites this paper as [39]
In the citing paper
“The outcome measures used in the trial have been shown to have good psychometric properties when administered via the Internet [29]”
From Individually Tailored Internet-Based Treatment for Young Adults and Adults With Panic Attacks: Randomized Controlled Trial (2012) · cites this paper as [29]
Citations
Cites
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032
An inventory for measuring clinical anxiety: Psychometric properties.
Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.6.893 · Cited by 14,407
A new depression scale designed to be sensitive to change
Montgomery, S. A., & Åsberg, M. (1979) · British Journal of Psychiatry · doi:10.1192/bjp.134.4.382 · Cited by 13,962
Psychometric properties of the Beck Depression Inventory: Twenty-five years of evaluation
Beck, A. T., Steer, R. A., & Carbin, M. G. (1988) · Clinical Psychology Review · doi:10.1016/0272-7358(88)90050-5 · Cited by 11,696
(2012) · Springer eBooks · doi:10.1007/springerreference_179754 · Cited by 2,095
Chambless, D. L., Caputo, G. C., Bright, P., & Gallagher, R. (1984) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.52.6.1090 · Cited by 1,247
Frisch, M. B., Cornell, J., Villanueva, M., & Retzlaff, P. J. (1992) · Psychological Assessment · doi:10.1037/1040-3590.4.1.92 · Cited by 1,075
The Mobility Inventory for Agoraphobia
Chambless, D. L., Caputo, G. C., Jasin, S. E., Gracely, E. J., & Williams, C. (1985) · Behaviour Research and Therapy · doi:10.1016/0005-7967(85)90140-8 · Cited by 775
Svanborg, P., & Åsberg, M. (1994) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1994.tb01480.x · Cited by 693
World-Wide Web survey research: Benefits, potential problems, and solutions
Schmidt, W. C. (1997) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03204826 · Cited by 620
Flagged first, then by citations
1 of the 38 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Computer-based psychological treatments for depression: A systematic review and meta-analysis
Richards, D., & Richardson, T. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.02.004 · Cited by 1,442
“However, research to date comparing different administrations of standard instruments have yielded similar results (Carlbring et al., 2007).”
ResultHoule, D., Govindaraju, D. R., & Omholt, S. W. (2010) · Nature Reviews Genetics · doi:10.1038/nrg2897 · Cited by 1,319
“For humans, web-based tools to recover behavioural data from volunteer subjects may prove particularly effectiv”
BackgroundAdvantages and limitations of Internet-based interventions for common mental disorders
Andersson, G., & Titov, N. (2014) · World Psychiatry · doi:10.1002/wps.20083 · Cited by 1,160
Self-citationThe economic and social burden of compulsive hoarding
Tolin, D. F., Frost, R. O., Steketee, G., Gray, K. D., & Fitch, K. E. (2008) · Psychiatry Research · doi:10.1016/j.psychres.2007.08.008 · Cited by 445
“Although several studies now show that data collection over the internet yields results comparable to those using a paper-and-pencil format (Carlbring et al., 2007; Coles et al., 2007; Gosling et al., 2004), a clinical interview might be more reliable and valid than are self-report measures of…”
BackgroundResultInfluentialTitov, N., Andrews, G., Davies, M., McIntyre, K., Robinson, E., & Solley, K. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010939 · Cited by 406
“All of these measures are considered reliable, valid, and appropriate for clinical and research purposes, with recent research indicating that online administration of questionnaires results in acceptable reliability of responses [40,41].”
BackgroundLy, K. H., Ly, A.-M., & Andersson, G. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.10.002 · Cited by 368
Self-citationTreatment of panic disorder: live therapy vs. self-help via the Internet
Carlbring, P., Nilsson-Ihrfelt, E., Waara, J., Kollenstam, C., Buhrman, M., Kaldo, V., Söderberg, M., Ekselius, L., & Andersson, G. (2005) · Behaviour Research and Therapy · doi:10.1016/j.brat.2004.10.002 · Cited by 372
“The internal consistency on a Swedish panic-sample was excellent (a ¼ 0:90) and the test–retest reliability was high (r ¼ 0:94; Carlbring et al., 2004).”
MethodInfluentialSelf-citationComputer- vs. paper-based tasks: Are they equivalent?
Noyes, J. M., & Garland, K. J. (2008) · Ergonomics · doi:10.1080/00140130802170387 · Cited by 354
“For example, Finegan and Allen (1994), Lankford et al. (1994), Peterson et al. (1996), Tseng et al. (1997), Schwartz et al. (1998) and Carlbring et al. (2007) all found that the computerised versions of their tests produced significantly different results from their paper counterparts.”
BackgroundResultInfluentialTitov, N., Dear, B. F., McMillan, D., Anderson, T., Zou, J., & Sunderland, M. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2010.550059 · Cited by 342
“Recent research indicates that online administration of questionnaires results in acceptable reliability of responses (Carlbring et al., 2007; Donker, van Straten,Marks, &Cuijpers, 2010; Garb, 2007; Hedman et al., 2010), with no reported differences between administration that involves presenting…”
BackgroundTransdiagnostic internet treatment for anxiety and depression: a randomised controlled trial
Titov, N., Dear, B. F., Schwencke, G., Andrews, G., Johnston, L., Craske, M. G., & McEvoy, P. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2011.03.007 · Cited by 285
Carlbring, P., Gunnarsdóttir, M., Hedensjö, L., Andersson, G., Ekselius, L., & Furmark, T. (2007) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.105.020107 · Cited by 299
“Internet administration of questionnaires has generally resulted in adequate psychometric properties (see Carlbring et al, 2007).”
Self-citationFamily burden of compulsive hoarding: Results of an internet survey
Tolin, D. F., Frost, R. O., Steketee, G., & Fitch, K. E. (2008) · Behaviour Research and Therapy · doi:10.1016/j.brat.2007.12.008 · Cited by 288
“Equivalence of internet and paper-and-pencil measurement has been established in clinical disorders, including anxiety (Carlbring et al., 2007) and OCD (Coles, Cook, & Blake, 2007); in these studies, participants completed the same measures in paperand-pencil and internet formats, and results did not differ.”
MethodRobinson, E., Titov, N., Andrews, G., McIntyre, K., Schwencke, G., & Solley, K. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010942 · Cited by 277
“All of these measures are considered reliable, valid, and appropriate for clinical and research purposes, with recent research indicating that online administration of questionnaires results in acceptable reliability of responses [39,40].”
BackgroundBuhrman, M., Skoglund, A., Husell, J., Bergström, K., Gordh, T., Hursti, T., Bendelin, N., Furmark, T., & Andersson, G. (2013) · Behaviour Research and Therapy · doi:10.1016/j.brat.2013.02.010 · Cited by 285
“QOLI has further been validated in an internet sample with similar psychometric properties to those reported involving paper and pencil administration (Carlbring et al., 2007).”
Self-citationLjótsson, B., Falk, L., Vesterlund, A. W., Hedman, E., Lindfors, P., Rück, C., Hursti, T., Andréewitch, S., Jansson, L., Lindefors, N., et al. (2010) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.03.003 · Cited by 270
Self-citationDonker, T., van Straten, A., Marks, I., & Cuijpers, P. (2011) · Psychiatry Research · doi:10.1016/j.psychres.2011.01.016 · Cited by 273
“One possible explanation for this finding is that people sometimes disclose more sensitive information in computer-based compared to face-to-face interviews (Buchanan, 2002; Carlbring et al., 2007; Joinson, 1999), hence higher mean scores, and consequently higher cut-off scores on questionnaires may be needed.”
BackgroundLy, K. H., Trüschel, A., Jarl, L., Magnusson, S., Windahl, T., Johansson, R., Carlbring, P., & Andersson, G. (2014) · BMJ Open · doi:10.1136/bmjopen-2013-003440 · Cited by 269
Self-citationJohansson, R., Sjöberg, E., Sjögren, M., Johnsson, E., Carlbring, P., Andersson, T., Rousseau, A., & Andersson, G. (2012) · PLoS ONE · doi:10.1371/journal.pone.0036905 · Cited by 268
“These results suggest that baseline depression severity may moderate response even in different variants of Internet-delivered CBT (ICBT).”
InfluentialSelf-citationCarlbring, P., Bohman, S., Brunt, S., Buhrman, M., Westling, B. E., Ekselius, L., & Andersson, G. (2006) · American Journal of Psychiatry · doi:10.1176/ajp.2006.163.12.2119 · Cited by 262
Self-citationGuided and unguided self-help for social anxiety disorder: randomised controlled trial
Furmark, T., Carlbring, P., Hedman, E., Sonnenstein, A., Clevberger, P., Bohman, B., Eriksson, A., Hållén, A., Frykman, M., Holmström, A., et al. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.060996 · Cited by 256
Self-citationCourse of compulsive hoarding and its relationship to life events
Tolin, D. F., Meunier, S. A., Frost, R. O., & Steketee, G. (2010) · Depression and Anxiety · doi:10.1002/da.20684 · Cited by 250
Muehlhausen, W., Doll, H., Quadri, N., Fordham, B., O'Donohoe, P., Dogar, N., & Wild, D. (2015) · Health and Quality of Life Outcomes · doi:10.1186/s12955-015-0362-x · Cited by 259
“[27] 2007 Web/PC C Y N 494 Panic disorder 37.”
BackgroundIndividually-tailored, internet-based treatment for anxiety disorders: a randomized controlled trial
Carlbring, P., Maurin, L., Törngren, C., Linna, E., Eriksson, T., Sparthan, E., Strååt, M., Marquez von Hage, C., Bergman-Nordgren, L., & Andersson, G. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.10.002 · Cited by 227
“The outcome measures have good psychometric properties even when administered via the Internet (Carlbring et al., 2007).”
BackgroundSelf-citationVernmark, K., Lenndin, J., Bjärehed, J., Carlsson, M., Karlsson, J., Öberg, J., Carlbring, P., Eriksson, T., & Andersson, G. (2010) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.01.005 · Cited by 226
“Internet administered guided self-help versus individualized e-mail therapy: A randomized trial of two versions of CBT for major depression Kristofer Vernmark a,b, Jan Lenndin a, Jonas Bjärehed a,c, Mattias Carlsson a, Johan Karlsson a, Jörgen Öberg a, Per Carlbring a, Thomas Eriksson d, Gerhard Andersson a,e, f,*…”
BackgroundInfluentialSelf-citationHedman, E., Ljótsson, B., Rück, C., Furmark, T., Carlbring, P., Lindefors, N., & Andersson, G. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2010.01.010 · Cited by 220
Self-citationVallejo, M., Jordán, C., Díaz, M. I., Comeche, M. I., & Ortega, J. (2007) · Journal of Medical Internet Research · doi:10.2196/jmir.9.1.e2 · Cited by 241
“In that sense, a growing number of computerized or online questionnaires related to areas such as panic/agoraphobia [3], youth independence living [7], aggression and impulsivity [8], quality of life in diabetes [9], and a battery of 16 other health-related questionnaires [10] have already been studied.”
BackgroundDíaz-García, A., González-Robles, A., Mor, S., Mira, A., Quero, S., García-Palacios, A., Baños, R. M., & Botella, C. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-2472-1 · Cited by 207
Establishing Guidelines for Executing and Reporting Internet Intervention Research
Proudfoot, J., Klein, B., Barak, A., Carlbring, P., Cuijpers, P., Lange, A., Ritterband, L., & Andersson, G. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2011.573807 · Cited by 202
Self-citationThe Brunnsviken Brief Quality of Life Scale (BBQ): development and psychometric evaluation
Lindner, P., Frykheden, O., Forsström, D., Andersson, E., Ljótsson, B., Hedman, E., Andersson, G., & Carlbring, P. (2016) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2016.1143526 · Cited by 212
“All data were collected online, a method shown to give valid data comparable to traditional pen-and-paper administration (Carlbring et al., 2007; Hedman et al., 2010; Holländare, Andersson, & Engström, 2010; Lindner et al., 2013; Thorndike et al., 2009).”
MethodSelf-citationAndersson, G., Paxling, B., Wiwe, M., Vernmark, K., Felix, C. B., Lundborg, L., Furmark, T., Cuijpers, P., & Carlbring, P. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.05.003 · Cited by 202
Self-citationTransdiagnostic Internet treatment for anxiety disorders: A randomized controlled trial
Titov, N., Andrews, G., Johnston, L., Robinson, E., & Spence, J. (2010) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.05.014 · Cited by 196
Family Informants’ Perceptions of Insight in Compulsive Hoarding
Tolin, D. F., Fitch, K. E., Frost, R. O., & Steketee, G. S. (2008) · Cognitive Therapy and Research · doi:10.1007/s10608-008-9217-7 · Cited by 201
“Equivalence of internet and paper-andpencil measurement has been established in clinical disorders, including anxiety (Carlbring et al. 2007) and OCD (Coles et al. 2007).”
BackgroundA simulation approach on Cronbach's alpha statistical significance
Leontitsis, A., & Pagge, J. (2006) · Mathematics and Computers in Simulation · doi:10.1016/j.matcom.2006.08.001 · Cited by 192
Validation of the insomnia severity index as a web-based measure
Thorndike, F. P., Ritterband, L. M., Saylor, D. K., Magee, J. C., Gonder-Frederick, L. A., & Morin, C. M. (2011) · Behavioral Sleep Medicine · doi:10.1080/15402002.2011.606766 · Cited by 186
“This approach followed similar methods favored by much of the existing Internet assessment literature to establish associations between two versions of a measure (Carlbring et al., 2007; Vallejo, Jordan, Diaz, Comeche, & Ortego, 2007).”
BackgroundMethodInfluentialCarlbring, P., Hägglund, M., Luthström, A., Dahlin, M., Kadowaki, Å., Vernmark, K., & Andersson, G. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.12.020 · Cited by 177
Self-citationRandomized trial of internet-delivered self-help with telephone support for pathological gamblers.
Carlbring, P., & Smit, F. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0013603 · Cited by 187
Self-citationShyness 1: Distance Treatment of Social Phobia Over the Internet
Titov, N., Andrews, G., Schwencke, G., Drobny, J., & Einstein, D. (2008) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670802119762 · Cited by 180
Holländare, F., Andersson, G., & Engström, I. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1392 · Cited by 179
“In an earlier study [16] with a sample size of 350, the subjects scored significantly higher on the Internet version than on the paper version of the full BDI-II.”
BackgroundMethodResultInfluentialTully, P. J., Zajac, I. T., & Venning, A. J. (2009) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-009-9306-4 · Cited by 177
“As recommended elsewhere ( Buckby et al. 2008 ) for each model, the fit statistics reported include the Comparative Fit Index (CFI), Root Mean Square Error of Approximation (RMSEA) and Standardized Root Mean Square Residual (SRMR).”
MethodResultInfluentialJohansson, R., Ekbladh, S., Hebert, A., Lindström, M., Möller, S., Petitt, E., Poysti, S., Larsson, M. H., Rousseau, A., Carlbring, P., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0038021 · Cited by 167
“The measures were administered via the Internet, which has been shown to be a valid format for questionnaires regarding depression and anxiety [17,18].”
MethodSelf-citationEffectiveness of Guided Internet-Based Cognitive Behavior Therapy in Regular Clinical Settings
Andersson, G., & Hedman, E. (2013) · Verhaltenstherapie · doi:10.1159/000354779 · Cited by 165
“Overall, evidence suggests that psychometric measurement characteristics are maintained when measures are administered online [Carlbring et al., 2007; Hedman et al., 2010], but to our knowledge there is not much written about how well online measures work in routine clinical practice.”
Self-citationIvanova, E., Lindner, P., Ly, K. H., Dahlin, M., Vernmark, K., Andersson, G., & Carlbring, P. (2016) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2016.09.012 · Cited by 165
Self-citationHøifødt, R. S., Lillevoll, K. R., Griffiths, K. M., Wilsgaard, T., Eisemann, M., Waterloo, K., & Kolstrup, N. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2714 · Cited by 154
“Equivalent psychometric properties have been shown across paper-and-pencil and online formats of the questionnaire, and the 2 formats are highly correlated [59,67].”
BackgroundResultInfluentialJohnston, L., Titov, N., Andrews, G., Spence, J., & Dear, B. F. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028079 · Cited by 150
“Moreover, recent research indicates that online administration of questionnaires results in acceptable reliability of responses with emerging evidence for equivalence between paper-and-pencil versions of self-report questionnaires and online administration [40,41,42,43].”
BackgroundPaxling, B., Almlöv, J., Dahlin, M., Carlbring, P., Breitholtz, E., Eriksson, T., & Andersson, G. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2011.576699 · Cited by 147
“All measures were administered via the Internet, which generally has proven to be acceptable in terms of psychometric properties (Carlbring, Brunt, et al, 2007 ).”
MethodSelf-citationNordgren, L. B., Hedman, E., Etienne, J., Bodin, J., Kadowaki, Å., Eriksson, S., Lindkvist, E., Andersson, G., & Carlbring, P. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.05.007 · Cited by 145
“The outcome measures all show good psychometric properties even when administered online (Carlbring et al., 2007; Hedman et al., 2010).”
BackgroundSelf-citationLjótsson, B., Lundin, C., Mitsell, K., Carlbring, P., Ramklint, M., & Ghaderi, A. (2006) · Behaviour Research and Therapy · doi:10.1016/j.brat.2006.06.010 · Cited by 148
Self-citationSpence, J., Titov, N., Dear, B. F., Johnston, L., Solley, K., Lorian, C. N., Wootton, B. M., Zou, J. B., & Schwencke, G. (2011) · Depression and Anxiety · doi:10.1002/da.20835 · Cited by 151
Predicting Active Users' Personality Based on Micro-Blogging Behaviors
Li, L., Li, A., Hao, B., Guan, Z., & Zhu, T. (2014) · PLoS ONE · doi:10.1371/journal.pone.0084997 · Cited by 136
“However, because of its limitations in participant recruitment and resource consumption, self-report method needs to be improved [7,8].”
BackgroundEquivalence of electronic and paper-based patient-reported outcome measures
Campbell, N., Ali, F. M., Finlay, A. Y., & Salek, S. (2015) · Quality of Life Research · doi:10.1007/s11136-015-0937-3 · Cited by 135
Ly, K. H., Asplund, K., & Andersson, G. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.06.003 · Cited by 133
“Previous psychometric research has validated internetadministration of self-rating scales for depression, quality of life and anxiety (Carlbring et al., 2007; Hedman et al., 2010; Holländare et al., 2010; Buchanan, 2003).”
MethodSelf-citationTillfors, M., Carlbring, P., Furmark, T., Lewenhaupt, S., Spak, M., Eriksson, A., Westling, B. E., & Andersson, G. (2008) · Depression and Anxiety · doi:10.1002/da.20416 · Cited by 132
“[23] All the above outcome measures have shown adequate psychometric properties and were administrated via the Internet.”
BackgroundSelf-citationGuided internet-based CBT for common mental disorders
Andersson, G., Carlbring, P., Ljótsson, B., & Hedman, E. (2013) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-013-9237-9 · Cited by 119
“Comparing against a waiting list control condition the between group effect was large, d = 0.95 (Carlbring et al. 2007b).”
BackgroundMethodInfluentialSelf-citationKlein, B., Mitchell, J., Abbott, J.-A., Shandley, K. A., Austin, D., Gilson, K., Kiropoulos, L. A., Cannard, G., & Redman, T. (2010) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2010.04.005 · Cited by 136
“Both telephone-based clinical interviews (Crippa et al., 2008) and administration of online assessments (Carlbring et al., 2007) have been found to be reliable when compared to face-to-face clinical interviews and paper and pencil assessments, respectively.”
BackgroundSelf-citationThe promise and pitfalls of the internet for cognitive behavioral therapy
Andersson, G. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-82 · Cited by 114
Self-citationModeration and mediation of the effect of attention training in social anxiety disorder
Kuckertz, J. M., Gildebrant, E., Liliequist, B., Karlström, P., Väppling, C., Bodlund, O., Stenlund, T., Hofmann, S. G., Andersson, G., Amir, N., et al. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2013.12.003 · Cited by 117
Self-citationvan Ballegooijen, W., Riper, H., Cuijpers, P., van Oppen, P., & Smit, J. H. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-0735-7 · Cited by 114
“Carlbring P, Brunt S, Bohman S, Austin D, Richards J, Ost LG, et al. Internet vs. paper and pencil administration of questionnaires commonly used in panic/ agoraphobia research.”
BackgroundInfluentialHolländare, F., Johnsson, S., Randestad, M., Tillfors, M., Carlbring, P., Andersson, G., & Engström, I. (2011) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2011.01698.x · Cited by 111
Self-citationCampos, J. Á. D. B., Zucoloto, M. L., Bonafé, F. S. S., Jordani, P. C., & Marôco, J. P. (2011) · Computers in Human Behavior · doi:10.1016/j.chb.2011.04.011 · Cited by 114
“….com/locate /comphumbeh (Meyerson & Tryon, 2003), stress and depression (Herrero & Meneses, 2006; Naus et al., 2009), panic/agoraphobia (Carlbring et al., 2007), aggression, impulsivity, health functioning (Suris et al., 2007), psychological assessment (Naus et al., 2009; Suris et al.,…”
BackgroundMethodResultInfluentialJones, S. L., Hadjistavropoulos, H. D., & Soucy, J. N. (2016) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2015.10.006 · Cited by 110
Månsson, K. N., Skagius Ruiz, E., Gervind, E., Dahlin, M., & Andersson, G. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.3031 · Cited by 102
“87 for MADRS-S [40]; and Cronbach alpha=.”
Self-citationKrein, S. L., Kadri, R., Hughes, M. V., Kerr, E. A., Piette, J. D., Holleman, R. G., Kim, H. M., & Richardson, C. R. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2605 · Cited by 108
Gnambs, T., & Kaspar, K. (2016) · Assessment · doi:10.1177/1073191115624547 · Cited by 106
“…with paper-and-pencil questionnaires (Fogarty et al., 2013), and people also report 748 Assessment 24(6) slightly higher levels of depression on the Internet (Carlbring et al., 2007), whereas Risko et al. (2006) found no evidence of such mode differences for various measures of social desirability.”
BackgroundThe Trichotillomania Scale for Children: Development and Validation
Tolin, D. F., Diefenbach, G. J., Flessner, C. A., Franklin, M. E., Keuthen, N. J., Moore, P. S., Piacentini, J. C., Stein, D. J., & Woods, D. W. (2008) · Child Psychiatry & Human Development · doi:10.1007/s10578-007-0092-3 · Cited by 102
“Equivalence of internet and paper- and pencil measurement has been established in clinical disorders, including anxiety [42] and obsessive– compulsive disorder [43].”
BackgroundIvarsson, D., Blom, M., Hesser, H., Carlbring, P., Enderby, P., Nordberg, R., & Andersson, G. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.03.002 · Cited by 102
“Self-report measures were administered via the internet which generally has been found to generate acceptable psychometric properties (Buchanan, 2003; Carlbring et al., 2007).”
MethodSelf-citationTillfors, M., Andersson, G., Ekselius, L., Furmark, T., Lewenhaupt, S., Karlsson, A., & Carlbring, P. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2011.555486 · Cited by 101
Self-citationAndersson, G., Waara, J., Jonsson, U., Malmaeus, F., Carlbring, P., & Öst, L. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070902931326 · Cited by 101
“The outcome measures have good psychometric properties, and in the case of the BDI and BAI this includes Internet administration (cf. Carlbring et al., 2007).”
BackgroundSelf-citationCarlbring, P., Nordgren, L. B., Furmark, T., & Andersson, G. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.06.012 · Cited by 101
Self-citationBergman Nordgren, L., Carlbring, P., Linna, E., & Andersson, G. (2013) · JMIR Research Protocols · doi:10.2196/resprot.2292 · Cited by 92
Self-citationKivi, M., Eriksson, M. C. M., Hange, D., Petersson, E.-L., Vernmark, K., Johansson, B., & Björkelund, C. (2014) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2014.921834 · Cited by 92
“Carlbring et al. (2007) identified significant effects between Internet- and paper administration of BDI-II and BAI.”
BackgroundErbe, D., Eichert, H.-C., Rietz, C., & Ebert, D. (2016) · Internet Interventions · doi:10.1016/j.invent.2016.06.006 · Cited by 97
“, 2014), there are also a few results suggesting that higher values are obtained on the Becks Depression Inventory if it is administered over the Internet or on a computer (Carlbring et al., 2007; George et al., 1992).”
BackgroundNordin, S., Carlbring, P., Cuijpers, P. J., & Andersson, G. (2010) · Behavior Therapy · doi:10.1016/j.beth.2009.06.001 · Cited by 101
Self-citationInternet-based cognitive behavior therapy for obsessive compulsive disorder: A pilot study
Andersson, E., Ljótsson, B., Hedman, E., Kaldo, V., Paxling, B., Andersson, G., Lindefors, N., & Rück, C. (2011) · BMC Psychiatry · doi:10.1186/1471-244x-11-125 · Cited by 94
“The online version of the QOLI has been compared to the paper and pencil version with mixed results [54,55].”
MethodSelf-citationBrancu, M., Wagner, H. R., Morey, R. A., Beckham, J. C., Calhoun, P. S., Tupler, L. A., Marx, C. E., Taber, K. H., Hurley, R. A., Rowland, J. A., et al. (2017) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1570 · Cited by 94
Interformat Reliability of Digital Psychiatric Self-Report Questionnaires: A Systematic Review
Alfonsson, S., Maathz, P., & Hursti, T. J. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3395 · Cited by 94
“One sample crossover (2x2) PnP, online Body Sensations Questionnaire, Agoraphobic Cognitions Questionnaire, Mobile Inventory, Beck Anxiety Inventory, Beck Depression Inventory-II, Montgomery-Asberg Depression Rating Scale-Self-report Carlbring et al (2007) [19]”
Dahlin, M., Andersson, G., Magnusson, K., Johansson, T., Sjögren, J., Håkansson, A., Pettersson, M., Kadowaki, Å., Cuijpers, P., & Carlbring, P. (2016) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.12.007 · Cited by 86
Self-citationde Graaf, L. E., Huibers, M. J. H., Riper, H., Gerhards, S. A. H., & Arntz, A. (2009) · Journal of Affective Disorders · doi:10.1016/j.jad.2008.12.009 · Cited by 86
“There are indications that they show similar psychometric properties (Carlbring et al., 2007a; Garb, 2007; Schulenberg and Yutrzenka, 2001).”
BackgroundCarlbring, P., Furmark, T., Steczkó, J., Ekselius, L., & Andersson, G. (2006) · Clinical Psychologist · doi:10.1080/13284200500378662 · Cited by 90
Self-citationBrief self-rated screening for depression on the Internet
Donker, T., van Straten, A., Marks, I., & Cuijpers, P. (2010) · Journal of Affective Disorders · doi:10.1016/j.jad.2009.07.013 · Cited by 88
“Though several studies have found equivalent psychometric properties in webbased versus paper-pencil questionnaires (Andersson et al., 2003; Carlbring et al., 2007a; Houston et al., 2001; Spek et al., 2008), other studies did not (reviewed by Buchanan (2002), which means that the psychometric…”
Resultİnce, B. Ü., Cuijpers, P. J., Hof, E. V., van Ballegooijen, W., Christensen, H. M., & Riper, H. M. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2853 · Cited by 89
“Research has shown that online self-report questionnaires have good validity (eg, [41]) and yield scores equivalent to paper-and-pencil questionnaires (eg, [70]).”
Shandley, K., Austin, D. W., Klein, B., Pier, C., Schattner, P., Pierce, D., & Wade, V. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.1033 · Cited by 84
“Recent studies have shown that the majority of validated paper-and-pencil questionnaires generally retain their psychometric qualities and produce equivalent results when administered in an online format [40,41].”
BackgroundSelf-citationAbstract Spatial Reasoning as an Autistic Strength
Stevenson, J. L., & Gernsbacher, M. A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0059329 · Cited by 88
“Internet-based studies, including studies that administer cognitive tests, provide results comparable to in-person studies [35,36].”
ResultWeb-based measurement: Effect of completing single or multiple items per webpage
Thorndike, F. P., Carlbring, P., Smyth, F. L., Magee, J. C., Gonder-Frederick, L., Ost, L.-G., & Ritterband, L. M. (2009) · Computers in Human Behavior · doi:10.1016/j.chb.2008.05.006 · Cited by 83
Self-citationBuhrman, M., Syk, M., Burvall, O., Hartig, T., Gordh, T., & Andersson, G. (2015) · The Clinical Journal of Pain · doi:10.1097/ajp.0000000000000176 · Cited by 83
Self-citationLindner, P., Andersson, G., Öst, L., & Carlbring, P. (2013) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2013.806584 · Cited by 83
Self-citationAxelsson, E., Lindsäter, E., Ljótsson, B., Andersson, E., & Hedman-Lagerlöf, E. (2017) · JMIR Mental Health · doi:10.2196/mental.7497 · Cited by 79
“The self-reported Montgomery-Åsberg Depression Rating Scale (MADRS-S) is a widely used nine-item questionnaire that measures depressive symptoms on a scale from 0 to 54, with higher scores indicating more symptoms of depression [24-26].”
A validation of well-being and happiness surveys for administration via the Internet
Howell, R. T., Rodzon, K. S., Kurai, M., & Sanchez, A. H. (2010) · Behavior Research Methods · doi:10.3758/brm.42.3.775 · Cited by 78
“Carlbring et al. (2007) demonstrated that respondents reported higher levels of depression when completing a CB survey than when completing a PP survey.”
BackgroundThe longitudinal relationship between fear of positive evaluation and fear of negative evaluation
Rodebaugh, T., Weeks, J. W., Gordon, E. A., Langer, J. K., & Heimberg, R. (2012) · Anxiety, Stress, & Coping · doi:10.1080/10615806.2011.569709 · Cited by 72
“Carlbring and colleagues ( 2007 ) have reported that anxiety measures completed using online versus paper-and-pencil administration formats demonstrate similar psychometric properties and are very strongly correlated.”
BackgroundStarosta, A. J., & Brenner, L. A. (2017) · Springer eBooks · doi:10.1007/978-3-319-56782-2_1972-2 · Cited by 77
Hedman, E., Ljótsson, B., Blom, K., El Alaoui, S., Kraepelien, M., Rück, C., Andersson, G., Svanborg, C., Lindefors, N., & Kaldo, V. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2818 · Cited by 75
Less Positive or More Negative? Future-Directed Thinking in Mild to Moderate Depression
Bjärehed, J., Sarkohi, A., & Andersson, G. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070902966926 · Cited by 76
“The Internetadministered self-rated version of the MADRS-S has been found comparable to the pencil-and-paper version in terms of validity and reliability (Carlbring et al., 2007), with a Cronbach’s alpha of .”
MethodSelf-citationPredicting treatment outcome in internet versus face to face treatment of panic disorder
Andersson, G., Carlbring, P., & Grimlund, A. (2008) · Computers in Human Behavior · doi:10.1016/j.chb.2008.02.003 · Cited by 75
“Excellent psychometric characteristics have been reported for the online version (Austin, Carlbring, Richards, & Andersson, 2006; Carlbring et al., 2007 ), which is a widely used and validated cognitive test (Lezak, 1995).”
BackgroundSelf-citationRozental, A., Forsell, E., Svensson, A., Forsström, D., Andersson, G., & Carlbring, P. (2014) · BMC Psychology · doi:10.1186/s40359-014-0054-z · Cited by 85
“…log on to a secure online interface requiring registration and electronic identification, i.e., SLL Certificates, in order to complete an automated and fully computerized online screening process, minimizing the risk of data loss or data distortion (Carlbring et al., 2007; Thorndike et al., 2009).”
BackgroundSelf-citationAn Internet administered treatment program for obsessive–compulsive disorder: A feasibility study
Wootton, B. M., Titov, N., Dear, B. F., Spence, J., Andrews, G., Johnston, L., & Solley, K. (2011) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2011.07.009 · Cited by 72
Internet Administration of Paper-and-Pencil Questionnaires Used in Couple Research
Brock, R. L., Barry, R. A., Lawrence, E. E., Dey, J., & Rolffs, J. L. (2010) · Assessment · doi:10.1177/1073191110382850 · Cited by 77
“Whereas examinations of equivalence have been conducted for measures of personality, individual psychopathology, and physical health (e.g., Buchanan, 2007; Carlbring et al., 2007; Coles, Cook, & Blake, 2007; Davis, 1999; Hewson & Charlton, 2005), they have yet to be conducted for measures of relationship constructs (e.”
BackgroundInternet-Delivered Acceptance and Values-Based Exposure Treatment for Fibromyalgia: A Pilot Study
Ljótsson, B., Atterlöf, E., Lagerlöf, M., Andersson, E., Jernelöv, S., Hedman, E., Kemani, M., & Wicksell, R. K. (2014) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2013.846401 · Cited by 70
“The outcome measures were administered online, a method which has been shown to be as reliable and valid as traditional paper-andpencil administration (Carlbring et al., 2007; Hedman et al., 2010).”
MethodFrom paper to pixels: A comparison of paper and computer formats in psychological assessment
Naus, M. J., Philipp, L. M., & Samsi, M. (2008) · Computers in Human Behavior · doi:10.1016/j.chb.2008.05.012 · Cited by 79
Silfvernagel, K., Carlbring, P., Kabo, J., Edström, S., Eriksson, J., Månson, L., & Andersson, G. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1853 · Cited by 69
“The outcome measures used in the trial have been shown to have good psychometric properties when administered via the Internet [29], and the same accounts for administrating the SCID-I interview over telephone [30].”
MethodSelf-citationBjörnsdotter, A., Enebrink, P., & Ghaderi, A. (2013) · Child and Adolescent Psychiatry and Mental Health · doi:10.1186/1753-2000-7-40 · Cited by 71
Ström, M., Uckelstam, C.-J., Andersson, G., Hassmén, P., Umefjord, G., & Carlbring, P. (2013) · PeerJ · doi:10.7717/peerj.178 · Cited by 64
“…Information and Declarations can be found on page 13 DOI 10.7717/peerj.178 Copyright 2013 Ström et al. Distributed under Creative Commons CC-BY 3.0 OPEN ACCESS Subjects Clinical Trials, Psychiatry and Psychology Keywords Physical activity, Depression, Internet, Psychotherapy, Treatment, RCT”
BackgroundMethodInfluentialSelf-citation
Metadata
- Authors
- Carlbring, P., Brunt, S., Bohman, S., Austin, D., Richards, J., Öst, L.-G., & Andersson, G.
- Affiliations
- Linköping University (SE)
- Uppsala University (SE)
- Monash University (AU)
- Stockholm University (SE)
- Corresponding author
- Carlbring, Per
- Venue
- Computers in Human Behavior
- Publisher
- Elsevier BV
- Published
- 2007-05
- Volume
- 23
- Issue
- 3
- Pages
- 1421-1434
- ISSN
- 0747-5632 (ISSN-L)
- OpenAlex
- W2060387706
- Cited by
- 319
- References
- 38
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 3 · 2023: 8 · 2022: 11 · 2021: 10 · 2020: 14 · 2019: 13 · 2018: 10 · 2017: 19 · 2016: 16 · 2015: 21 · 2014: 29 · 2013: 45 · 2012: 17
- FWCI
- 12.96
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Computers in Human Behavior (publishedVersion)
- Swinburne figshare (Swinburne University of Technology) (submittedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- paper-and-pencil questionnaires, panic disorder, agoraphobia, psychometric properties, test-retest reliability, Beck Anxiety Inventory, Beck Depression Inventory-II, Quality of Life Inventory, fear of fear, online therapy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
