Comparison of checking behavior in adults with or without checking symptom of obsessive-compulsive disorder using a novel computer-based measure
Open accessAbstract
Easy to administer behavioral measures of checking are needed to improve the assessment of this hallmark feature of OCD. We recently developed a new computer-based behavioral assessment of OCD in a previous study. As a follow-up experiment for this method, the goal of this study was to examine whether the new computer-based behavioral assessment would be capable of differentiating behaviors in adults with OCD characterized by checking behavior from those without checking behavior. We compared 22 OCD patients with compulsive checking behaviors (OCD checkers), 17 OCD controls without checking behavior (OCD controls), and 31 healthy controls (HCs) on a novel computer-based behavioral measure of checking behavior. Despite similar levels of successfully completed tasks, OCD checkers demonstrated longer duration of checking behaviors than OCD controls or HCs. Interestingly, no differences were found between OCD controls and HCs in any of the dependent variables. Our new behavioral measure offers a novel, objective, and ecologically valid measure of checking behaviors in a sample of adults with OCD.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
VR immersions can elicit anxiety in people with obsessive-compulsive disorder characterized by checking behaviors.
“Studies have demonstrated that, compared to people who do not suffer from an anxiety disorder, immersions in virtual reality (VR) can elicit anxiety in people suffering from specific phobia [5], and from obsessive-compulsive disorder characterized by fear of contamination [6] or by checking behaviors [7].”
From Exposure to a Standardized Catastrophic Scenario in Virtual Reality or a Personalized Scenario in Imagination for Generalized Anxiety Disorder (2019) · cites this paper as [7]
The results were in the same range as those in the Guitard et al. [25] study and studies using VR for other anxiety disorders.
“Results were also in the same range than in the Guitard et al. [25] study, where participants had to imagine the scenarios instead of being exposed to them in VR, and to studies using VR for other anxiety disorders (e.g., [6,7]).”
From Exposure to a Standardized Catastrophic Scenario in Virtual Reality or a Personalized Scenario in Imagination for Generalized Anxiety Disorder (2019) · cites this paper as [7]
Cites
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. B. (2013) · Oxford University Press eBooks · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,841 · see citing works
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032 · see citing works
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139 · see citing works
An inventory for measuring clinical anxiety: Psychometric properties.
Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.6.893 · Cited by 14,407 · see citing works
The Yale-Brown Obsessive Compulsive Scale: I. Development, Use, and Reliability
Goodman, W. K. (1989) · Archives of General Psychiatry · doi:10.1001/archpsyc.1989.01810110048007 · Cited by 7,712 · see citing works
Measuring Presence in Virtual Environments: A Presence Questionnaire
Witmer, B. G., & Singer, M. J. (1998) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474698565686 · Cited by 6,371 · see citing works
Cognitive and emotional influences in anterior cingulate cortex
Bush, G., Luu, P., & Posner, M. I. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01483-2 · Cited by 6,259 · see citing works
The mini international neuropsychiatric interview
Lecrubier, Y., Sheehan, D. V., Hergueta, T., & Weiller, E. (1998) · European Psychiatry · doi:10.1016/s0924-9338(99)80239-9 · Cited by 5,882 · see citing works
Contributions of anterior cingulate cortex to behaviour
Devinsky, O., Morrell, M. J., & Vogt, B. A. (1995) · Brain · doi:10.1093/brain/118.1.279 · Cited by 3,377 · see citing works
Anterior Cingulate Conflict Monitoring and Adjustments in Control
Kerns, J. G., Cohen, J. D., MacDonald, A. W., Cho, R. Y., Stenger, V. A., & Carter, C. S. (2004) · Science · doi:10.1126/science.1089910 · Cited by 2,891 · see citing works
The Yale-Brown Obsessive Compulsive Scale: II. Validity
Goodman, W. K. (1989) · Archives of General Psychiatry · doi:10.1001/archpsyc.1989.01810110054008 · Cited by 2,799 · see citing works
The Yale-Brown Obsessive-Compulsive Scale: Measures of internal consistency
Kim, S. W., Dysken, M. W., Pheley, A. M., & Hoover, K. M. (1994) · Psychiatry Research · doi:10.1016/0165-1781(94)90039-6 · Cited by 2,361 · see citing works
Self-citationEllsworth, P. D. (1980) · American Journal of Occupational Therapy · doi:10.5014/ajot.34.12.819a · Cited by 1,712 · see citing works
WHOQOL Group (1993) · Quality of Life Research · doi:10.1007/bf00435734 · Cited by 1,381 · see citing works
A multidimensional model of obsessive-compulsive disorder
Mataix-Cols, D., do Rosario-Campos, M. C., & Leckman, J. F. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.2.228 · Cited by 1,074 · see citing works
Mataix-Cols, D., Wooderson, S., Lawrence, N., Brammer, M. J., Speckens, A., & Phillips, M. L. (2004) · Archives of General Psychiatry · doi:10.1001/archpsyc.61.6.564 · Cited by 929 · see citing works
Symptoms of obsessive-compulsive disorder
(1997) · American Journal of Psychiatry · doi:10.1176/ajp.154.7.911 · Cited by 766 · see citing works
Mataix-Cols, D., Rauch, S. L., Manzo, P. A., Jenike, M. A., & Baer, L. (1999) · American Journal of Psychiatry · doi:10.1176/ajp.156.9.1409 · Cited by 716 · see citing works
Meta-analysis of the symptom structure of obsessive–compulsive disorder
Bloch, M. H., Landeros-Weisenberger, A., Rosario, M. C., Pittenger, C., & Leckman, J. F. (2008) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.08020320 · Cited by 681 · see citing works
Performance monitoring by the anterior cingulate cortex during saccade countermanding
Ito, S., Stuphorn, V., Brown, J. W., & Schall, J. D. (2003) · Science · doi:10.1126/science.1087847 · Cited by 581 · see citing works
Baer, L. (1994) · PubMed · Cited by 504 · see citing works
Treatment non-response in OCD: methodological issues and operational definitions
Pallanti, S., Hollander, E., Bienstock, C., Koran, L., Leckman, J., Marazziti, D., Pato, M., Stein, D., Zohar, J., & International Treatment Refractory OCD Consortium (2002) · The International Journal of Neuropsychopharmacology · doi:10.1017/s1461145702002900 · Cited by 416 · see citing works
Obsessive-compulsive disorder as a disturbance of security motivation.
Szechtman, H., & Woody, E. (2004) · Psychology Review · doi:10.1037/0033-295x.111.1.111 · Cited by 346 · see citing works
Symptom structure in obsessive-compulsive disorder: a confirmatory factor-analytic study
Summerfeldt, L. J., Richter, M. A., Antony, M. M., & Swinson, R. P. (1999) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(98)00134-x · Cited by 345 · see citing works
Repeated checking causes memory distrust.
van den Hout, M., & Kindt, M. (2003) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(02)00012-8 · Cited by 313 · see citing works
Mataix‐Cols, D., Rauch, S. L., Baer, L., Eisen, J. L., Shera, D. M., Goodman, W. K., Rasmussen, S. A., & Jenike, M. A. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.2.263 · Cited by 279 · see citing works
Reality monitoring in obsessive-compulsive disorder
McNally, R. J., & Kohlbeck, P. A. (1993) · Behaviour Research and Therapy · doi:10.1016/0005-7967(93)90023-n · Cited by 171 · see citing works
Taylor, S. J. (1995) · Clinical Psychology Review · doi:10.1016/0272-7358(95)00015-h · Cited by 160 · see citing works
Mataix-Cols, D., Cullen, S., Lange, K., Zelaya, F., Andrew, C., Amaro, E., Brammer, M. J., Williams, S. C. R., Speckens, A., & Phillips, M. L. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(02)01504-4 · Cited by 152 · see citing works
MacDonald, P. A., Antony, M. M., MacLeod, C. M., & Richter, M. A. (1997) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(97)00013-2 · Cited by 147 · see citing works
Fontenelle, L. F., Mendlowicz, M. V., Marques, C., & Versiani, M. (2004) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2003.12.004 · Cited by 146 · see citing works
Boschen, M. J., & Vuksanovic, D. (2007) · Behaviour Research and Therapy · doi:10.1016/j.brat.2007.03.009 · Cited by 126 · see citing works
Omori, I. M., Murata, Y., Yamanishi, T., Nakaaki, S., Akechi, T., Mikuni, M., & Furukawa, T. A. (2007) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2006.05.005 · Cited by 74 · see citing works
Moritz, S., von Mühlenen, A., Randjbar, S., Fricke, S., & Jelinek, L. (2009) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617709090511 · Cited by 62 · see citing works
A challenging task for assessment of checking behaviors in obsessive–compulsive disorder
Rotgé, J., Clair, A.-H., Jaafari, N., Hantouche, E. G., Pélissolo, A., Goillandeau, M., Pochon, J.-B., Guehl, D., Bioulac, B. H., Burbaud, P., et al. (2008) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2008.01173.x · Cited by 51 · see citing works
Kim, K. K., Kim, S. I., Cha, K. R., Park, J.-Y., Rosenthal, M. Z., Kim, J., Han, K., Kim, I. Y., & Kim, C. (2009) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2008.12.001 · Cited by 48 · see citing works
Self-citationChecking-in on the memory deficit and meta-memory deficit theories of compulsive checking
Cuttler, C., & Graf, P. (2009) · Clinical Psychology Review · doi:10.1016/j.cpr.2009.04.003 · Cited by 48 · see citing works
Nonverbal memory dysfunction in obsessive-compulsive disorder patients with checking compulsions
Cha, K. R., Koo, M.-S., Kim, C.-H., Kim, J. W., Oh, W.-J., Suh, H. S., & Lee, H. S. (2008) · Depression and Anxiety · doi:10.1002/da.20377 · Cited by 36 · see citing works
Self-citationProcess-outcome analysis in computer-aided treatment of obsessive-compulsive disorder
Kirkby, K. C., Berríos, G. E., Daniels, B. A., Menzies, R. G., Clark, A. A., & Romano, A. (2000) · Comprehensive Psychiatry · doi:10.1053/comp.2000.7431 · Cited by 33 · see citing works
Animal behavior as a conceptual framework for the study of obsessive-compulsive disorder (OCD).
Eilam, D., Zor, R., Fineberg, N., & Hermesh, H. (2012) · Behavioural Brain Research · doi:10.1016/j.bbr.2011.06.033 · Cited by 33 · see citing works
Zor, R., Fineberg, N. A., Eilam, D., & Hermesh, H. (2011) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2011.03.006 · Cited by 21 · see citing works
Flagged first, then by citations
1 of the 42 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Virtual reality therapy in mental health
Emmelkamp, P. M. G., & Meyerbröker, K. (2021) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-081219-115923 · Cited by 363 · see citing works
Effects of virtual environment platforms on emotional responses
Kim, K. K., Rosenthal, M. Z., Zielinski, D. J., & Brady, R. B. (2014) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2013.12.024 · Cited by 163 · see citing works
Self-citationLaforest, M., Bouchard, S., Crétu, A.-M., & Mesly, O. (2016) · Frontiers in ICT · doi:10.3389/fict.2016.00018 · Cited by 60 · see citing works
The use of virtual reality in assessment and treatment of anxiety and related disorders
Meyerbröker, K., & Nexhmedin Morina, B. (2021) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2623 · Cited by 60 · see citing works
Mild Uncertainty Promotes Checking Behavior in Subclinical Obsessive-Compulsive Disorder
Toffolo, M. B. J., van den Hout, M., Hooge, I. T. C., Engelhard, I. M., & Cath, D. C. (2013) · Clinical Psychological Science · doi:10.1177/2167702612472487 · Cited by 54 · see citing works
Inozu, M., Çelikcan, U., Akin, B., & Cicek, N. M. (2020) · Journal of Obsessive-Compulsive and Related Disorders · doi:10.1016/j.jocrd.2020.100518 · Cited by 39 · see citing works
Strauss, A. Y., Fradkin, I., McNally, R. J., Linkovski, O., Anholt, G. E., & Huppert, J. D. (2019) · Clinical Psychology Review · doi:10.1016/j.cpr.2019.101807 · Cited by 45 · see citing works
Exposure therapy in a virtual environment: Validation in obsessive compulsive disorder
Cullen, A. J., Dowling, N. L., Segrave, R. A., Carter, A., & Yücel, M. (2021) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2021.102404 · Cited by 43 · see citing works
Guitard, T., Bouchard, S., Bélanger, C., & Berthiaume, M. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm8030309 · Cited by 40 · see citing works
Toffolo, M. B. J., van den Hout, M., Engelhard, I. M., Hooge, I. T. C., & Cath, D. C. (2014) · Journal of Obsessive-Compulsive and Related Disorders · doi:10.1016/j.jocrd.2014.08.004 · Cited by 32 · see citing works
Dehghan, B., Saeidimehr, S., Sayyah, M., & Rahim, F. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.733584 · Cited by 30 · see citing works
Free operant observing in humans: a translational approach to compulsive certainty seeking
Morein‐Zamir, S., Shahper, S., Fineberg, N. A., Eisele, V., Eagle, D. M., Urcelay, G. P., & Robbins, T. W. (2018) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021817737727 · Cited by 18 · see citing works
Joint Attention Virtual Classroom: A Preliminary Study
Seo, S.-H., Kim, E. J., Mundy, P. C., Heo, J., & Kim, K. K. (2019) · Psychiatry Investigation · doi:10.30773/pi.2019.02.08 · Cited by 17 · see citing works
Self-citationVirtual Reality and Other Realities
Botella, C., Baños, R. M., García-Palacios, A., & Quero, S. (2017) · The Science of Cognitive Behavioral Therapy · doi:10.1016/b978-0-12-803457-6.00022-2 · Cited by 16 · see citing works
Anksiyete Bozukluklarında Sanal Gerçeklik
Üzümcü, E., Akın-Sarı, B., Nergız, H., İnözü, M., & Çelikcan, U. (2017) · Psikiyatride Guncel Yaklasimlar - Current Approaches in Psychiatry · doi:10.18863/pgy.336593 · Cited by 16 · see citing works
Toffolo, M. B. J., van den Hout, M., Radomsky, A. S., & Engelhard, I. M. (2015) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2015.09.001 · Cited by 12 · see citing works
Colman, M. D., Millar, J. F. A., Patil, B., Finnegan, D. J., Russell, A., Higson‐Sweeney, N., Aguiar, M. D. S., & Fraser, D. S. (2024) · Journal of Obsessive-Compulsive and Related Disorders · doi:10.1016/j.jocrd.2024.100893 · Cited by 9 · see citing works
Using VR for Obsessive-Compulsive and Related Disorders
Bouchard, S., Laforest, M., Gamito, P. S., & Cárdenas‐López, G. (2019) · Virtual reality technologies for health and clinical applications · doi:10.1007/978-1-4939-9482-3_5 · Cited by 4 · see citing works
A VR Game for Obsessive-Compulsive Disorders Therapy
Torrão, A. R., Natário, J., Carvalho, P. S., Silva, C. M., & Silva, F. G. M. (2021) · International Conference on Graphics and Interaction (ICGI) · doi:10.1109/icgi54032.2021.9655282 · Cited by 4 · see citing works
Shaw, S. L., Oswin, S., Xi, Y., Calandriello, F. M., & Fulmer, R. (2023) · Journal of Technology in Counselor Education and Supervision · doi:10.61888/2692-4129.1095 · Cited by 4 · see citing works
Lohse, L., Jelinek, L., Moritz, S., Blömer, J., Bücker, L., & Miegel, F. S. (2023) · BMC Psychology · doi:10.1186/s40359-023-01116-3 · Cited by 3 · see citing works
Toffolo, M. B. J. (2011) · Utrecht University Repository (Utrecht University) · Cited by 3 · see citing works
Technological Interventions for Obsessive–Compulsive Disorder Management
Borgnis, F., & Pedroli, E. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-818697-8.00096-0 · Cited by 2 · see citing works
Wiederhold, B. K., & Bouchard, S. (2014) · Springer eBooks · doi:10.1007/978-1-4899-8023-6_11 · Cited by 2 · see citing works
A Virtual Reality Game as a Tool for Psychotherapy With OCD Patients
Torrão, A. R., Natário, J., Carvalho, P. S., Silva, C. M., & Silva, F. G. M. (2022) · International Journal of Creative Interfaces and Computer Graphics · doi:10.4018/ijcicg.311834 · Cited by 1 · see citing works
Virtual Reality Assessment for Obsessive Compulsive Disorder: A Review
Baharim, N., Sharip, S., Sarnin, E. F., Mahady, Z. A., & Sharip, Z. (2022) · Medicine & Health · doi:10.17576/mh.2022.1702.02
Virtual Reality in Clinical Mental Health
Stone, J. (2025) · doi:10.1002/9781394278480.ch7
HCAR: Hygiene and Cleanliness Activity Recognition using Smartwatch
Kim, C., Jung, M., Jeon, Y., Moon, J., & Kim, K. K. (2025) · IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) · doi:10.1109/ismar-adjunct68609.2025.00009
Self-citation
- Authors
- Kim, K., Roh, D., Kim, C.-H., Cha, K. R., Rosenthal, M. Z., & Kim, S. I.
- Affiliations
- Duke Medical Center (US)
- Yonsei University (KR)
- Osong Medical Innovation Foundation (KR)
- Corresponding author
- Kim, Sun I.
- Venue
- Computer Methods and Programs in Biomedicine
- Publisher
- Elsevier BV
- Published
- 2012-10
- Volume
- 108
- Issue
- 1
- Pages
- 434-441
- ISSN
- 0169-2607 (ISSN-L)
- OpenAlex
- W2133506828
- Cited by
- 28
- References
- 42
- Citations by year
- 2025: 2 · 2024: 1 · 2023: 2 · 2022: 3 · 2021: 5 · 2020: 1 · 2019: 4 · 2018: 1 · 2017: 2 · 2016: 1 · 2015: 1 · 2014: 3 · 2013: 1
- FWCI
- 1.82
- Type
- journal article
- Language
- en
- Open access
- Licence
- cc-by-nc-nd
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Locations
- Computer Methods and Programs in Biomedicine (publishedVersion)
- PubMed (publishedVersion)
- YUHSpace (Yonsei University Medical Library) (submittedVersion, cc-by-nc-nd)
- Funders
- Korea government (MEST) (2010-0000390)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Obsessive-Compulsive Spectrum Disorders
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Clinical Psychology › Perfectionism, Procrastination, Anxiety Studies
- Keywords
- obsessive-compulsive disorder, checking behavior, compulsive checking, behavioral measures
- MeSH terms
- Computer Simulation, Humans, Obsessive Behavior, User-Computer Interface
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
