The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Who's Up First? Testing for Order Effects in Structured Interviews Using a Counterbalanced Experimental Design
Abstract
A growing body of research suggests that, apart from the wording of specific questions, various aspects of the interview process itself may affect the reliability of information provided by research participants. To examine whether the order of presentation of specific diagnostic modules affects the likelihood of subjects' yes/no responses within the Diagnostic Interview Schedule for Children (DISC), the authors used a counterbalanced design, presenting two DISC diagnostic modules to children and their parents in standard or reversed order. Results indicate that the order of module administration exerts effects on the total numbers of symptoms endorsed, level of impairment, and the likelihood of meeting diagnostic criteria, regardless of whether the information is provided by parent or child respondents. Future child and adult assessment measures should take these difficulties fully into account through novel approaches to instrument design and interview procedures.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Both the sequence of the SC-IATs and the place where the target label first appeared were counterbalanced, to counter sequence effects [26].”
From Explicit and implicit attachment and the outcomes of acceptance and commitment therapy and cognitive behavioral therapy for depression (2020) · cites this paper as [26]
Citations
Cites
The CES-D Scale: A Self-Report Depression Scale for Research in the General Population
Radloff, L. S. (1977) · Applied Psychological Measurement · doi:10.1177/014662167700100306 · Cited by 53,267
KAUFMAN, J., BIRMAHER, B., BRENT, D., RAO, U., FLYNN, C., MORECI, P., WILLIAMSON, D., & RYAN, N. (1997) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199707000-00021 · Cited by 10,148
Pearlin, L. I., & Schooler, C. (1978) · Journal of Health and Social Behavior · doi:10.2307/2136319 · Cited by 7,791 · cited 1×
“These measures included an array of psychosocial functioning variables concerning the parents and child, including the Child Behavior Checklist (Achenbach, 1983), an abbreviated version of the Dyadic Adjustment Scale (Sharpley & Cross, 1982), a modified life event scale (Coddington, 1972), a measure of parental locus…”
MethodPearlin, L. I., & Schooler, C. (1978) · PubMed · Cited by 6,764
(1983) · Medical Entomology and Zoology · Cited by 4,251
SHAFFER, D., FISHER, P., DULCAN, M. K., DAVIES, M., PIACENTINI, J., SCHWAB-STONE, M. E., LAHEY, B. B., BOURDON, K., JENSEN, P. S., BIRD, H. R., et al. (1996) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199607000-00012 · Cited by 1,587
Self-citationCoddington, R. D. (1972) · Journal of Psychosomatic Research · doi:10.1016/0022-3999(72)90045-1 · Cited by 949
DSM-IV field trials for attention deficit hyperactivity disorder in children and adolescents
(1994) · American Journal of Psychiatry · doi:10.1176/ajp.151.11.1673 · Cited by 935
Self-citationShaffer, D., Schwab‐Stone, M., Fisher, P. W., Cohen, P. G., PLACENTINI, J., Davies, M., Conners, C. K., & Regier, D. A. (1993) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199305000-00023 · Cited by 477
Age differences in the reliability of the psychiatric interview of the child
Edelbrock, C., Costello, A. J., Dulcan, M. K., Kalas, R., & Conover, N. C. (1985) · Child Development · doi:10.2307/1130193 · Cited by 474
Flagged first, then by citations
Cited by
Sorted by citations
Considering context, place, and culture: the national Latino and Asian American study
Alegria, M., Takeuchi, D., Canino, G., Duan, N., Shrout, P., Meng, X., Vega, W., Zane, N., Vila, D., Woo, M., et al. (2004) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.178 · Cited by 733
Kessler, R. C., Abelson, J., Demler, O., Escobar, J. I., Gibbon, M., Guyer, M. E., Howes, M. J., Jin, R., Vega, W. A., Walters, E. E., et al. (2004) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.169 · Cited by 489
National Comorbidity Survey Replication Adolescent Supplement (NCS-A): I. Background and Measures
Merikangas, K. R., Avenevoli, S., Costello, E. J., Koretz, D. S., & Kessler, R. C. (2009) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e31819996f1 · Cited by 355
Structure and Etiology of Co-Occurring Internalizing and Externalizing Disorders in Adolescents
Cosgrove, V. E., Rhee, S. H., Gelhorn, H. L., Boeldt, D., Corley, R. C., Ehringer, M. A., Young, S. E., & Hewitt, J. K. (2011) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-010-9444-8 · Cited by 296
Kessler, R. C., Avenevoli, S., Green, J., Gruber, M. J., Guyer, M., He, Y., Jin, R., Kaufman, J., Sampson, N. A., Zaslavsky, A. M., et al. (2009) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e31819a1cbc · Cited by 283
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.010 · Cited by 279
Initial elevation bias in subjective reports
Shrout, P. E., Stadler, G., Lane, S. P., McClure, M. J., Jackson, G. L., Clavél, F. D., Iida, M., Gleason, M. E. J., Xu, J. H., & Bolger, N. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1712277115 · Cited by 190
Evidence-Based Assessment of Conduct Problems in Children and Adolescents
McMahon, R. J., & Frick, P. J. (2005) · Journal of Clinical Child & Adolescent Psychology · doi:10.1207/s15374424jccp3403_6 · Cited by 164
Mental Disorders in Five Year Old Children With or Without Developmental Delay: Focus on ADHD
Baker, B., Neece, C. L., Fenning, R., Crnic, K., & Blacher, J. (2010) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2010.486321 · Cited by 173
Research Design in Clinical Psychology
Kazdin, A. E. (2021) · doi:10.1017/9781108993647 · Cited by 240
Neece, C. L., Baker, B. L., Blacher, J., & Crnic, K. A. (2011) · Journal of Intellectual Disability Research · doi:10.1111/j.1365-2788.2011.01416.x · Cited by 70
Duan, N., Alegria, M. M., CANINO, G. J., McGuire, T. G., & Takeuchi, D. T. (2006) · Health Services Research · doi:10.1111/j.1475-6773.2006.00618.x · Cited by 68
The Effects of Asking Filter Questions in Interleafed Versus Grouped Format
Kreuter, F., McCulloch, S., Presser, S., & Tourangeau, R. (2011) · Sociological Methods & Research · doi:10.1177/0049124110392342 · Cited by 66
Does questionnaire structure influence response in postal surveys?
Dunn, K. M., Jordan, K. P., & Croft, P. R. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(02)00567-x · Cited by 61
Halpern-Manners, A., & Warren, J. R. (2012) · Demography · doi:10.1007/s13524-012-0124-x · Cited by 55
Neece, C. L., Baker, B. L., Crnic, K. A., & Blacher, J. (2012) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-012-9698-4 · Cited by 54
Federer, M. R., Nehm, R. H., Opfer, J. E., & Pearl, D. K. (2014) · Research in Science Education · doi:10.1007/s11165-014-9435-9 · Cited by 43
Features of Interview Questions Associated with Attenuation of Symptom Reports
Lucas, C. P., Fisher, P. W., Piacentini, J. C., Zhang, H., Jensen, P. S., Shaffer, D., Dulcan, M. K., Schwab‐Stone, M., Regier, D. A., & CANINO, G. J. (1999) · Research on Child and Adolescent Psychopathology · doi:10.1023/a:1021975824957 · Cited by 41
Self-citationSingle-case experimental research designs.
Kazdin, A. E. (2015) · Methodological issues and strategies in clinical research (4th ed.). · doi:10.1037/14805-029 · Cited by 39
Order effects in the assessment of quality of life in cancer patients
Cheung, Y., Wong, L.-C., Tay, M. H., Toh, C., Koo, W.-H., Epstein, R. J., & Goh, C. R. (2004) · Quality of Life Research · doi:10.1023/b:qure.0000037499.80080.07 · Cited by 39
Informant-Based Determinants of Symptom Attenuation in Structured Child Psychiatric Interviews
Piacentini, J. C., Roper, M., Jensen, P. S., Lucas, C., Fisher, P. W., Bird, H., Bourdon, K. H., Schwab‐Stone, M., Rubio‐Stipec, M., Davies, M., et al. (1999) · Research on Child and Adolescent Psychopathology · doi:10.1023/a:1021923808118 · Cited by 37
Self-citationMeasuring common mental disorders in women in Ethiopia
Hanlon, C., Medhin, G., Alem, A., Araya, M., Abdulahi, A., Tesfaye, M., Wondimagegn, D., Taha, H., Anbesse, B., Baheretibeb, Y., et al. (2008) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-008-0342-0 · Cited by 28
Yount, S., List, M. A., Du, H., Yost, K. J., Bode, R. K., Brockstein, B., Argiris, A. E., Vokes, E. E., Cohen, E. E. W., Campbell, B. H., et al. (2007) · Quality of Life Research · doi:10.1007/s11136-007-9270-9 · Cited by 28
Child and Adolescent Conduct Problems
Frick, P. J., & McMahon, R. J. (2018) · Oxford University Press eBooks · doi:10.1093/med-psych/9780190492243.003.0005 · Cited by 25
Green, J. G., Avenevoli, S., Gruber, M. J., Kessler, R. C., Lakoma, M. D., Merikangas, K. R., Sampson, N. A., & Zaslavsky, A. M. (2011) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.357 · Cited by 22
Order effects: a randomised study of three major cancer-specific quality of life instruments
Cheung, Y., Lim, C., Goh, C. R., Thumboo, J., & Wee, J. T. S. (2005) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-3-37 · Cited by 19
The Impact of DSM-5 A-Criteria Changes on Parent Ratings of ADHD in Adolescents
Sibley, M. H., & Yegüez, C. E. (2014) · Journal of Attention Disorders · doi:10.1177/1087054714526040 · Cited by 19
Do Interviewers Manipulate Responses to Filter Questions? Evidence from a Multilevel Approach
Kosyakova, Y., Škopek, J., & Eckman, S. (2014) · International Journal of Public Opinion Research · doi:10.1093/ijpor/edu027 · Cited by 17
Selecting Measures for Use in Child Mental Health Services: A Scorecard Approach
Warnick, E. M., Weersing, V. R., Scahill, L. D., & WOOLSTON, J. L. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0203-x · Cited by 17
Level of agreement between self‐administered and interviewer‐administered CPQ8–10 and CPQ11–14
Ramos‐Jorge, M. L., Vieira‐Andrade, R. G., Martins‐Júnior, P. A., Cordeiro, M. M. R., Ramos‐Jorge, J., Paiva, S. M., & Marques, L. S. (2011) · Community Dentistry And Oral Epidemiology · doi:10.1111/j.1600-0528.2011.00652.x · Cited by 16
Assessing the level of agreement between the self‐ and interview‐administered Child‐OIDP
Rosel, E., Tsakos, G., Bernabé, E., Sheiham, A., & Bravo, M. (2010) · Community Dentistry And Oral Epidemiology · doi:10.1111/j.1600-0528.2010.00533.x · Cited by 16
Rat, A., Baumann, C., Klein, S., Lœuille, D., & Guillemin, F. (2007) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2007.07.011 · Cited by 15
Szuła, A., Moskalewicz, M., & Stanghellini, G. (2024) · Journal of Clinical Medicine · doi:10.3390/jcm13154325 · Cited by 14
A-Tjak, J. G. L., Morina, N., Boendermaker, W. J., Topper, M., & Emmelkamp, P. M. G. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02547-7 · Cited by 13
Using Augmented Reality in AEC Tertiary Education: A Collaborative Design Case
Shore, J., Ravindran, A. V., González, V. A., & Giacaman, N. (2022) · Journal of Civil Engineering Education · doi:10.1061/(asce)ei.2643-9115.0000069 · Cited by 12
Bynion, T., Cloutier, R. M., Blumenthal, H., Mischel, E. R., Rojas, S. M., & Leen‐Feldner, E. W. (2018) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-018-1607-x · Cited by 16
Oshri, A., Tubman, J. G., Wagner, E. F., Morris, S. L., & Snyders, J. (2008) · American Journal of Orthopsychiatry · doi:10.1037/a0014326 · Cited by 11
Integrating Gamification and Social Interaction into an AR-Based Gamified Point System
Liu, B., & Tanaka, J. (2020) · Multimodal Technologies and Interaction · doi:10.3390/mti4030051 · Cited by 10
Panel Conditioning in the U.S. Consumer Expenditure Survey
Eckman, S., & Bach, R. L. (2021) · Journal of Official Statistics · doi:10.2478/jos-2021-0003 · Cited by 8
Jensen, P. S., & EDELBROCK, C. S. (1999) · Research on Child and Adolescent Psychopathology · doi:10.1023/a:1021971724048 · Cited by 6
Self-citationAssessing Levels of Agreement between Two Commonly Used Oral Health‐Related Quality of Life Measures
Bernabé, E., de Oliveira, C. M., Sheiham, A., & Tsakos, G. (2009) · Journal of Public Health Dentistry · doi:10.1111/j.1752-7325.2008.00112.x · Cited by 6
Magnus, B. E., & Chen, Y. (2022) · Assessment · doi:10.1177/10731911221133310 · Cited by 3
Methods for measuring utilization of mental health services in two epidemiologic studies
Novins, D. K., Beals, J., Croy, C. D., & Manson, S. M. (2008) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.255 · Cited by 2
Jin, D., Halvari, H., Mæhle, N., & Niemiec, C. P. (2021) · Journal of Customer Behaviour · doi:10.1362/147539221x16206323664340 · Cited by 2
Shillingsburg, M. A., Ragsdale, K., & Sikorski, J. F. (2008) · Graduate Student Journal of Psychology · doi:10.52214/gsjp.v10i.10831 · Cited by 2
Applegate, B. E., & Lahey, B. B. (2025) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-024-10184-7 · Cited by 1
Evidence-Based Methods of Dealing with Social Deficits in Conduct Disorder
Renk, K., White, R., Scott, S., & Middleton, M. (2009) · Springer eBooks · doi:10.1007/978-1-4419-0234-4_10 · Cited by 1
Internal and External Validity
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.003 · Cited by 1
First-interview response patterns of intensive longitudinal psychological and health data
Blozis, S. A. (2024) · Journal of Health Psychology · doi:10.1177/13591053241235751 · Cited by 1
Oh, S., Kim, Y., & Han, J. K. (2024) · Isokinetics and Exercise Science · doi:10.3233/ies-240045 · Cited by 1
An AI-Enabled Low-Cost Wearable to Support Musculoskeletal Rehabilitation: A Proof of Concept
Mumuni, I., Player, D. J., Tehrany, R., & Carlson, T. (2025) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc58623.2025.11253465 · Cited by 1
McBride, B. (2013) · Cited by 1
Aggression and Conduct Disorders
Thornton, L. C., & Frick, P. J. (2018) · Autism and child psychopathology series · doi:10.1007/978-3-319-93542-3_14 · Cited by 1
Case-Control and Cohort Designs
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.008 · Cited by 1
Null Hypothesis Significance Testing
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.014 · Cited by 1
Flow Visualization Study of Bifurcation Aneurysm: Intraaneurysmal Flow and Aspect Ratio (dome/neck)
Ujiié, H., Higa, T., Sasaki, K., YOSHIMOTO, S., & Hori, T. (2004) · Surgery for Cerebral Stroke · doi:10.2335/scs.32.351 · Cited by 1
Constructing Behaviour Profiles for Answer Behaviour Across Surveys.
Bais, F. (2021) · doi:10.33540/538 · Cited by 1
Oshri, A. (2009) · FIU - Digital Commons (Florida International University) · doi:10.25148/etd.fi09082406
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.001
Construct and Data-Evaluation Validity
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.004
Single-Case Experimental Research Designs
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.009
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.007
Cautions, Negative Effects, and Replication
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.016
Selecting Measures for Research
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.011
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.021
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.013
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.022
Ideas that Begin the Research Process
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.005
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.020
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.025
Presenting and Analyzing the Data
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.015
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.024
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.018
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.002
Assessment: Types of Measures and Their Use
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.012
Experimental Research Using Group Designs
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.006
Ethical Issues and Guidelines for Research
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.017
Communication of Research Findings
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.019
Evidence-Based Methods of Dealing with Social Difficulties in Conduct Disorder
Renk, K., Stephenson, J., Khan, M. R., & Cunningham, A. (2017) · Autism and child psychopathology series · doi:10.1007/978-3-319-64592-6_17 · Cited by 1
Doctoroff, G. L., & Theise, R. (2009) · doi:10.1002/9781118269602.ch14
Metadata
- Authors
- Jensen, P. S., Watanabe, H. K., & Richters, J. E.
- Affiliations
- National Institute of Mental Health (US)
- University of Nevada, Reno (US)
- University of Maryland, College Park (US)
- Venue
- Journal of Abnormal Child Psychology
- Published
- 1999-12
- Volume
- 27
- Issue
- 6
- Pages
- 439-445
- ISSN
- 0091-0627 (ISSN-L)
- 1573-2835
- OpenAlex
- W96881188
- Cited by
- 82
- References
- 26
- Citations by year
- 2025: 2 · 2024: 3 · 2022: 2 · 2021: 28 · 2020: 2 · 2018: 3 · 2017: 2 · 2015: 1 · 2014: 3 · 2013: 2 · 2012: 2
- FWCI
- 4.35
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- Research on Child and Adolescent Psychopathology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- U.S. Department of Health and Human Services
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- order effects, structured interviews, Diagnostic Interview Schedule for Children, diagnostic criteria, interview reliability
- MeSH terms
- Adolescent, Mental Disorders, Child, Child Psychiatry, Female, Humans, Interviews as Topic, Male, Research Design, Severity of Illness Index, Time Factors, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review