The registration continuum in clinical science: A guide toward transparent practices

Benning, Stephen D.; Bachrach, Rachel L.; Smith, Edward A.; Freeman, Andrew J.; Wright, Aidan G. C.

doi:10.1037/abn0000451

Cited by 77Meta-analysis and systematic reviewsStatistical Methods in Clinical TrialsEthics in Clinical Research

The registration continuum in clinical science: A guide toward transparent practices

Open access

Benning, Stephen D., Bachrach, Rachel L., Smith, Edward A., Freeman, Andrew J., Wright, Aidan G. C.·2019·Journal of Abnormal Psychology

DOI 10.1037/abn0000451PMC PMC6677163

Open this paper in CoChat — free account

Abstract

Clinical scientists can use a continuum of registration efforts that vary in their disclosure and timing relative to data collection and analysis. Broadly speaking, registration benefits investigators by offering stronger, more powerful tests of theory with particular methods in tandem with better control of long-run false positive error rates. Registration helps clinical researchers in thinking through tensions between bandwidth and fidelity that surround recruiting participants, defining clinical phenotypes, handling comorbidity, treating missing data, and analyzing rich and complex data. In particular, registration helps record and justify the reasons behind specific study design decisions, though it also provides the opportunity to register entire decision trees with specific endpoints. Creating ever more faithful registrations and standard operating procedures may offer alternative methods of judging a clinical investigator's scientific skill and eminence because study registration increases the transparency of clinical researchers' work. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1037/abn0000451

Cites

63 of 64 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Preregistration practices range on a spectrum from preregistration before data collection to co-registration during data collection to postregistration after data collection but before analysis.
“Preregistration practices occur on a spectrum (Benning et al., 2019), ranging from preregistering a study before data collection ever begins (as often occurs on clinicaltrials.gov)to co-registration (registering analyses during data collection) to postregistration (registering specific analyses after the data have been collected but before the data are analyzed).”
From Acceptance and Commitment Therapy Processes and Mediation: Challenges and How to Address Them (2023) · cites this paper as Benning et al., 2019
In “Time of registration relative to data collection and analysis” (page not provided), the paper defines preregistration as occurring before data collection and coregistration as occurring during collection, supporting the first two stages. It defines postregistration as registration after data have previously been analyzed for other research questions, not necessarily before the data are analyzed at all. A postregistration may precede specific follow-up analyses, but the citing sentence omits that distinction. (LLM, conf=0.88)
Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788 · see citing works
Prevalence, Severity, and Comorbidity of 12-Month DSM-IV Disorders in the National Comorbidity Survey Replication
Kessler, R. C., Chiu, W. T., Demler, O., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.617 · Cited by 12,052 · see citing works
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638 · see citing works
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · cited 1× · see citing works
“In a reversal of longstanding problems in the field (Ferguson & Heene, 2012; Rosenthal, 1979), fixing such problems prior to a study makes null results more publishable, as they are less likely to result from an uninterpretable failure to detect meaningful effects.”
Background
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515 · see citing works
The Hierarchical Taxonomy of Psychopathology (HiTOP): A dimensional alternative to traditional nosologies.
Kotov, R., Krueger, R. F., Watson, D., Achenbach, T. M., Althoff, R. R., Bagby, R. M., Brown, T. A., Carpenter, W. T., Caspi, A., Clark, L. A., et al. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000258 · Cited by 3,335 · see citing works
Self-citation
Knowledge and the Speed of the Transfer and Imitation of Organizational Capabilities: An Empirical Test
Zander, U., & Kogut, B. (1995) · Organization Science · doi:10.1287/orsc.6.1.76 · Cited by 3,270 · see citing works
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 1× · see citing works
“This scientific ecology has led to an unfortunate plethora of studies whose findings could not be replicated in psychology (Open Science Collaboration, 2015) and other clinical disciplines (e.g., Begley & Ellis, 2012).”
Background
When and how should multiple imputation be used for handling missing data in randomised clinical trials – a practical guide with flowcharts
Jakobsen, J. C., Gluud, C., Wetterslev, J., & Winkel, P. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0442-1 · Cited by 2,747 · see citing works
Adverse childhood experiences and the risk of depressive disorders in adulthood
Chapman, D. P., Whitfield, C. L., Felitti, V. J., Dube, S. R., Edwards, V. J., & Anda, R. F. (2004) · Journal of Affective Disorders · doi:10.1016/j.jad.2003.12.013 · Cited by 2,267 · see citing works
Misunderstanding analysis of covariance.
Miller, G. A., & Chapman, J. P. (2001) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.110.1.40 · Cited by 2,136 · see citing works
The preregistration revolution
Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708274114 · Cited by 1,998 · see citing works
HARKing: Hypothesizing after the results are known
Kerr, N. L. (1998) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0203_4 · Cited by 1,989 · see citing works
Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology.
Meehl, P. E. (1978) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.46.4.806 · Cited by 1,952 · see citing works
Increases in Depressive Symptoms, Suicide-Related Outcomes, and Suicide Rates Among U.S. Adolescents After 2010 and Links to Increased New Media Screen Time
Twenge, J. M., Joiner, T. E., Rogers, M. L., & Martin, G. N. (2018) · Clinical Psychological Science · doi:10.1177/2167702617723376 · Cited by 1,705 · see citing works
The association between adolescent well-being and digital technology use
Orben, A., & Przybylski, A. K. (2019) · Nature Human Behaviour · doi:10.1038/s41562-018-0506-1 · Cited by 1,500 · cited 1× · see citing works
“Subsequent specification curve analyses on those datasets indicated that these relationships range widely depending on the models tested, with a median effect size accounting for less than 0.1% of the variance shared among those measures (Orben & Przybylski, 2019).”
MethodInfluential
Organizational routines are stored as procedural memory: Evidence from a laboratory study
Cohen, M. D., & Bacdayan, P. (1994) · Organization Science · doi:10.1287/orsc.5.4.554 · Cited by 1,393 · see citing works
Increasing Transparency Through a Multiverse Analysis
Steegen, S., Tuerlinckx, F., Gelman, A., & Vanpaemel, W. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616658637 · Cited by 1,388 · see citing works
The RDoC framework: facilitating transition from ICD/DSM to dimensional approaches that integrate neuroscience and psychopathology: Forum - The Research Domain Criteria Project
Cuthbert, B. N. (2014) · World Psychiatry · doi:10.1002/wps.20087 · Cited by 1,377 · see citing works
An Agenda for Purely Confirmatory Research
Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463078 · Cited by 1,042 · see citing works
Thinking Clearly About Correlations and Causation: Graphical Causal Models for Observational Data
Rohrer, J. M. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245917745629 · Cited by 1,002 · cited 1× · see citing works
“To the extent that researchers view them as nuisance variables, confounds may be treated as covariates in a model to filter out extraneous variability in scores (Rohrer, 2018).”
Background
The Statistical Crisis in Science
Gelman, A., & Loken, E. (2014) · American Scientist · doi:10.1511/2014.111.460 · Cited by 963 · see citing works
A tutorial on sensitivity analyses in clinical trials: the what, why, when and how
Thabane, L., Mbuagbaw, L., Zhang, S., Samaan, Z., Marcucci, M., Ye, C., Thabane, M., Giangregorio, L., Dennis, B., Kosa, D., et al. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-92 · Cited by 893 · see citing works
Adaptive designs in clinical trials: why use them, and how to run and report them
Pallmann, P., Bedding, A. W., Choodari-Oskooei, B., Dimairo, M., Flight, L., Hampson, L. V., Holmes, J., Mander, A. P., Odondi, L., Sydes, M. R., et al. (2018) · BMC Medicine · doi:10.1186/s12916-018-1017-7 · Cited by 829 · see citing works
Degrees of Freedom in Planning, Running, Analyzing, and Reporting Psychological Studies: A Checklist to Avoid p-Hacking
Wicherts, J. M., Veldkamp, C. L. S., Augusteijn, H. E. M., Bakker, M., van Aert, R. C. M., & van Assen, M. A. L. M. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01832 · Cited by 754 · see citing works
Registered Reports: A Method to Increase the Credibility of Published Results
Nosek, B. A., & Lakens, D. (2014) · Social Psychology · doi:10.1027/1864-9335/a000192 · Cited by 716 · see citing works
Committee report: Publication guidelines and recommendations for studies using electroencephalography and magnetoencephalography
Keil, A., Debener, S., Gratton, G., Junghöfer, M., Kappenman, E. S., Luck, S. J., Luu, P., Miller, G. A., & Yee, C. M. (2013) · Psychophysiology · doi:10.1111/psyp.12147 · Cited by 702 · see citing works
A 21 Word Solution
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2012) · doi:10.2139/ssrn.2160588 · Cited by 680 · see citing works
The reliability and validity of discrete and continuous measures of psychopathology: A quantitative review.
Markon, K. E., Chmielewski, M., & Miller, C. J. (2011) · Psychological Bulletin · doi:10.1037/a0023678 · Cited by 656 · see citing works
The 52 symptoms of major depression: lack of content overlap among seven common depression scales
Fried, E. I. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.10.019 · Cited by 649 · see citing works
Major ingredients of fidelity: A review and scientific guide to improving quality of intervention research implementation
Gearing, R. E., El-Bassel, N., Ghesquiere, A., Baldwin, S., Gillies, J., & Ngeow, E. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.09.007 · Cited by 610 · see citing works
A Vast Graveyard of Undead Theories: Publication Bias and Psychological Science’s Aversion to the Null
Ferguson, C. J., & Heene, M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459059 · Cited by 603 · see citing works
Registered Reports: A new publishing initiative at Cortex
Chambers, C. (2012) · Cortex · doi:10.1016/j.cortex.2012.12.016 · Cited by 571 · see citing works
Premorbid IQ in Schizophrenia: A Meta-Analytic Review
Woodberry, K. A., Giuliano, A. J., & Seidman, L. J. (2008) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.07081242 · Cited by 570 · see citing works
Registering Clinical Trials
Dickersin, K. (2003) · JAMA · doi:10.1001/jama.290.4.516 · Cited by 512 · see citing works
Justify your alpha
Lakens, D., Adolfi, F., Albers, C. J., Anvari, F., Apps, M. A. J., Argamon, S., Baguley, T. S., Becker, R. B., Benning, S. D., Bradford, D. E., et al. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0311-x · Cited by 472 · see citing works
Self-citation
Performing high‐powered studies efficiently with sequential analyses
Lakens, D. (2014) · European Journal of Social Psychology · doi:10.1002/ejsp.2023 · Cited by 414 · see citing works
Implications of the Credibility Revolution for Productivity, Creativity, and Progress
Vazire, S. (2018) · Perspectives on Psychological Science · doi:10.1177/1745691617751884 · Cited by 361 · see citing works
Clinical trials recruitment planning: A proposed framework from the Clinical Trials Transformation Initiative
Huang, G. D., Bull, J., Johnston McKee, K., Mahon, E., Harper, B., & Roberts, J. N. (2018) · Contemporary Clinical Trials · doi:10.1016/j.cct.2018.01.003 · Cited by 294 · see citing works
It’s Time to Broaden the Replicability Conversation: Thoughts for and From Clinical Psychological Science
Tackett, J. L., Lilienfeld, S. O., Patrick, C. J., Johnson, S. L., Krueger, R. F., Miller, J. D., Oltmanns, T. F., & Shrout, P. E. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617690042 · Cited by 251 · cited 2× · see citing works
“Clinical research participants can be scarce and challenging to access, which creates barriers to powering studies alongside multiple threats to a study’s sampling strategies (Tackett et al., 2017).”
Background
A Practical Guide for Transparency in Psychological Science
Klein, O., Hardwicke, T. E., Aust, F., Breuer, J., Danielsson, H., Mohr, A. H., IJzerman, H., Nilsonne, G., Vanpaemel, W., & Frank, M. C. (2018) · Collabra Psychology · doi:10.1525/collabra.158 · Cited by 233 · see citing works
COMPare: a prospective cohort study correcting and monitoring 58 misreported trials in real time
Goldacre, B., Drysdale, H., Dale, A., Milosevic, I., Slade, E., Hartley, P., Marston, C., Powell-Smith, A., Heneghan, C., & Mahtani, K. R. (2019) · Trials · doi:10.1186/s13063-019-3173-2 · Cited by 233 · cited 1× · see citing works
“For clinical scientists, registration of a clinical trial does not necessarily prevent misreporting of the clinical trial (Goldacre et al., 2019).”
Background
Recommendations for Increasing the Transparency of Analysis of Preexisting Data Sets
Weston, S. J., Ritchie, S. J., Rohrer, J. M., & Przybylski, A. K. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919848684 · Cited by 206 · see citing works
The Effect of the WHO Surgical Safety Checklist on Complication Rate and Communication
Fudickar, A., Hörle, K., Wiltfang, J., & Bein, B. (2012) · Deutsches Ärzteblatt international · doi:10.3238/arztebl.2012.0695 · Cited by 194 · see citing works
Missing data methods for arbitrary missingness with small samples
McNeish, D. (2017) · Journal of Applied Statistics · doi:10.1080/02664763.2016.1158246 · Cited by 189 · see citing works
Registered Reports: Realigning incentives in scientific publishing
Chambers, C., Dienes, Z. P., McIntosh, R. D., Rotshtein, P., & Willmes, K. (2015) · Cortex · doi:10.1016/j.cortex.2015.03.022 · Cited by 171 · see citing works
Writing the Empirical Journal Article
Bem, D. J. (2021) · Psychology Press eBooks · doi:10.4324/9781315808314-10 · Cited by 168 · see citing works
The effect of pathological narcissism on interpersonal and affective processes in social interactions.
Wright, A. G. C., Stepp, S. D., Scott, L. N., Hallquist, M. N., Beeney, J. E., Lazarus, S. A., & Pilkonis, P. A. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000286 · Cited by 129 · see citing works
Self-citation
Handling Attrition in Longitudinal Studies: The Case for Refreshment Samples
Deng, Y., Hillygus, D. S., Reiter, J. P., Si, Y., & Zheng, S. (2013) · Statistical Science · doi:10.1214/13-sts414 · Cited by 118 · see citing works
Making 'null effects' informative: statistical techniques and inferential frameworks
Harms, C., & Lakens, D. (2018) · Journal of Clinical and Translational Research · doi:10.18053/jctres.03.2017s2.007 · Cited by 118 · see citing works
Data Documentation Initiative: Toward a Standard for the Social Sciences
Vardigan, M., Heus, P., & Thomas, W. L. (2008) · International Journal of Digital Curation · doi:10.2218/ijdc.v3i1.45 · Cited by 112 · see citing works
Making 'Null Effects' Informative: Statistical Techniques and Inferential Frameworks
Harms, C., & Lakens, D. (2018) · Europe PMC (PubMed Central) · doi:10.17605/osf.io/48zca · Cited by 52 · see citing works
Leveraging the Open Science Framework in clinical psychological assessment research.
Tackett, J. L., Brandes, C. M., & Reardon, K. W. (2019) · Psychological Assessment · doi:10.1037/pas0000583 · Cited by 49 · see citing works
Narcissist or narcissistic? Evaluation of the latent structure of narcissistic personality disorder.
Aslinger, E. N., Manuck, S. B., Pilkonis, P. A., Simms, L. J., & Wright, A. G. C. (2018) · Journal of Abnormal Psychology · doi:10.1037/abn0000363 · Cited by 44 · see citing works
Self-citation
Fifteen common mistakes encountered in clinical research
Clark, G. T., & Mulligan, R. (2010) · Journal of Prosthodontic Research · doi:10.1016/j.jpor.2010.09.002 · Cited by 41 · see citing works
The Creative Cycle and the Growth of Psychological Science
Fiedler, K. (2018) · Perspectives on Psychological Science · doi:10.1177/1745691617745651 · Cited by 40 · see citing works
Recommendations for increasing the transparency of analysis of pre-existing datasetsPreprint
Weston, S. J., Ritchie, S. J., Rohrer, J. M., et al. (2018) · doi:10.31234/osf.io/zmt3q · Cited by 38 · see citing works
Planned Hypothesis Tests Are Not Necessarily Exempt From Multiplicity Adjustment
Frane, A. V. (2015) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 33 · see citing works
Writing Empirical Articles: Transparency, Reproducibility, Clarity, and Memorability
Gernsbacher, M. A. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918754485 · Cited by 33 · see citing works
An Evaluation of Four Solutions to the Forking Paths Problem: Adjusted Alpha, Preregistration, Sensitivity Analyses, and Abandoning the Neyman-Pearson Approach
Rubin, M. (2017) · Review of General Psychology · doi:10.1037/gpr0000135 · Cited by 32 · see citing works
Giving Credit Where Credit’s Due
Simonton, D. K. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616660155 · Cited by 17 · see citing works
Sound Inference in Complicated Research: A Multi-Strategy ApproachPreprint
Srivastava, S. (2018) · doi:10.31234/osf.io/bwr48 · Cited by 17 · see citing works
Research site mentoring: A novel approach to improving study recruitment
Johnson, M. R., Kenworthy-Heinige, T., Beck, D. J., Asghar, A., Broussard, E. B., Bratcher, K., Tommessilli, L. M., Antonelli, M., & Planeta, B. M. (2018) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2018.01.011 · Cited by 13 · see citing works
Replication, Registration, and Scientific Creativity
Brainerd, C. J., & Reyna, V. F. (2018) · Perspectives on Psychological Science · doi:10.1177/1745691617739421 · Cited by 10 · see citing works

Flagged first, then by citations

Sorted by citations

Future Directions in Single-Session Youth Mental Health Interventions
Schleider, J. L., Dobias, M. L., Sung, J. Y., & Mullarkey, M. C. (2020) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2019.1683852 · Cited by 335 · see citing works
Making the Black Box Transparent: A Template and Tutorial for Registration of Studies Using Experience-Sampling Methods
Kirtley, O. J., Lafit, G., Achterhof, R., Hiekkaranta, A. P., & Myin‐Germeys, I. (2021) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920924686 · Cited by 130 · see citing works
Best Laid Plans: A Guide to Reporting Preregistration Deviations
Willroth, E. C., & Atherton, O. E. (2024) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231213802 · Cited by 125 · see citing works
Participant carelessness and fraud: Consequences for clinical research and potential solutions.
Chandler, J., Sisso, I., & Shapiro, D. N. (2019) · Journal of Abnormal Psychology · doi:10.1037/abn0000479 · Cited by 121 · see citing works
Open and reproducible neuroimaging: From study inception to publication
Niso, G., Botvinik‐Nezer, R., Appelhoff, S., de la Vega, A. I., Estéban, O., Etzel, J. A., Finc, K., Ganz, M., Gau, R., Halchenko, Y. O., et al. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119623 · Cited by 104 · see citing works
The Impact of COVID‐19 on Adolescents’ Daily Lives: The Role of Parent–Child Relationship Quality
Janssens, J. J., Achterhof, R., Lafit, G., Bamps, E., Hagemann, N., Hiekkaranta, A. P., Hermans, K. S. F. M., Lecei, A., Myin‐Germeys, I., & Kirtley, O. J. (2021) · Journal of Research on Adolescence · doi:10.1111/jora.12657 · Cited by 80 · see citing works
Acceptance and Commitment Therapy Processes and Mediation: Challenges and How to Address Them
Arch, J. J., Fishbein, J. N., Finkelstein, L. B., & Luoma, J. B. (2023) · Behavior Therapy · doi:10.1016/j.beth.2022.07.005 · Cited by 72 · see citing works
Adolescents’ real-time social and affective experiences of online and face-to-face interactions
Achterhof, R., Kirtley, O. J., Schneider, M., Hagemann, N., Hermans, K. S. F. M., Hiekkaranta, A. P., Lecei, A., Lafit, G., & Myin-Germeys, I. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2021.107159 · Cited by 62 · see citing works
Initial cohort characteristics and protocol for SIGMA: An accelerated longitudinal study of environmental factors, inter- and intrapersonal processes, and mental health in adolescencePreprint
Kirtley, O. J., Achterhof, R., Hagemann, N., Hermans, K. S. F. M., Hiekkaranta, A. P., Lecei, A., Boets, B., Henquet, C., Kasanova, Z., Schneider, M., et al. (2021) · doi:10.31234/osf.io/jp2fk · Cited by 41 · see citing works
Emotion regulation in response to daily negative and positive events in youth: The role of event intensity and psychopathology
Hiekkaranta, A. P., Kirtley, O. J., Lafit, G., Decoster, J., Derom, C. A., Binder, M. D., Gülöksüz, S., Jacobs, N., Menne‐Lothmann, C., Rutten, B. P. F., et al. (2021) · Behaviour Research and Therapy · doi:10.1016/j.brat.2021.103916 · Cited by 34 · see citing works
General psychopathology and its social correlates in the daily lives of youth
Achterhof, R., Kirtley, O. J., Schneider, M., Hagemann, N., Hermans, K. S. F. M., Hiekkaranta, A. P., Lecei, A., Decoster, J., Derom, C. A., Binder, M. D., et al. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.04.147 · Cited by 34 · see citing works
Adapting open science and pre‐registration to longitudinal research
Petersen, I. T., Apfelbaum, K. S., & McMurray, B. (2022) · Infant and Child Development · doi:10.1002/icd.2315 · Cited by 28 · see citing works
Introduction to the special section on increasing replicability, transparency, and openness in clinical psychology
Tackett, J. L., & Miller, J. D. (2019) · Journal of Abnormal Psychology · doi:10.1037/abn0000455 · Cited by 32 · see citing works
The relationship between daily positive future thinking and past-week suicidal ideation in youth: An experience sampling study
Kirtley, O. J., Lafit, G., Vaessen, T., Decoster, J., Derom, C. A., Gülöksüz, S., Binder, M. D., Jacobs, N., Menne‐Lothmann, C., Rutten, B. P. F., et al. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.915007 · Cited by 24 · see citing works
Advancing credibility in longitudinal research by implementing open science practices: Opportunities, practical examples, and challenges
Kirtley, O. J. (2022) · Infant and Child Development · doi:10.1002/icd.2302 · Cited by 22 · see citing works
The role of identity in the development of depressive, anxiety, and psychosis symptoms in adolescents exposed to childhood adversity
Samaey, C., Lecei, A., Achterhof, R., Hagemann, N., Hermans, K. S. F. M., Hiekkaranta, A. P., Kirtley, O. J., Reininghaus, U., Boets, B., Myin‐Germeys, I., et al. (2023) · Journal of Adolescence · doi:10.1002/jad.12145 · Cited by 20 · see citing works
Best Laid Plans: A Guide to Reporting Preregistration DeviationsPreprint
Willroth, E. C., & Atherton, O. E. (2023) · doi:10.31234/osf.io/dwx69 · Cited by 20 · see citing works
Open Science in Suicide Research Is Open for Business
Kirtley, O. J., Janssens, J. J., & Kaurin, A. (2022) · Crisis · doi:10.1027/0227-5910/a000859 · Cited by 16 · see citing works
Daily-Life Social Experiences as a Potential Mediator of the Relationship Between Parenting and Psychopathology in Adolescence
Achterhof, R., Kirtley, O. J., Schneider, M., Lafit, G., Hagemann, N., Hermans, K. S. F. M., Hiekkaranta, A. P., Lecei, A., & Myin‐Germeys, I. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.697127 · Cited by 17 · see citing works
A template and tutorial for preregistering studies using passive smartphone measures
Langener, A. M., Siepe, B. S., Elsherif, M. M., Niemeijer, K., Andresen, P. K., Akre, S., Bringmann, L. F., Cohen, Z. D., Choukas, N. R., Drexl, K., et al. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02474-5 · Cited by 15 · see citing works
HabitWalk: A micro‐randomized trial to understand and promote habit formation in physical activity
Baretta, D., Gillmann, N., Edgren, R., & Inauen, J. (2024) · Applied Psychology Health and Well-Being · doi:10.1111/aphw.12605 · Cited by 16 · see citing works
Identifying Clusters of Adolescents Based on Their Daily-Life Social Withdrawal Experience
Bamps, E., Teixeira, A. S., Lafit, G., Achterhof, R., Hagemann, N., Hermans, K. S. F. M., Hiekkaranta, A. P., Lecei, A., Kirtley, O. J., & Myin‐Germeys, I. (2022) · Journal of Youth and Adolescence · doi:10.1007/s10964-021-01558-1 · Cited by 12 · see citing works
Open science practices for eating disorders research
Burke, N. L., Frank, G., Hilbert, A., Hildebrandt, T., Klump, K. L., Thomas, J. J., Wade, T. D., Walsh, B. T., Wang, S. B., & Weissman, R. S. (2021) · International Journal of Eating Disorders · doi:10.1002/eat.23607 · Cited by 12 · see citing works
Objectively measured physical activity and symptoms of psychopathology in general population adolescents from the SIGMA cohort
Hagemann, N., Kirtley, O. J., Lafit, G., Wampers, M., Achterhof, R., Hermans, K. S. F. M., Hiekkaranta, A. P., Lecei, A., Vancampfort, D., & Myin‐Germeys, I. (2021) · Mental health and physical activity · doi:10.1016/j.mhpa.2021.100416 · Cited by 10 · see citing works
Forms, Importance, and Ineffability of Factor Interactions to Define Personality Disorders
Benning, S. D., & Smith, E. A. (2019) · Journal of Personality Disorders · doi:10.1521/pedi.2019.33.5.623 · Cited by 10 · see citing works
Self-citation
COVID-19-related changes in adolescents' daily-life social interactions and psychopathology symptomsPreprint
Achterhof, R., Myin‐Germeys, I., Bamps, E., Hagemann, N., Hermans, K. S. F. M., Hiekkaranta, A. P., Janssens, J. J., Lecei, A., Lafit, G., & Kirtley, O. J. (2021) · doi:10.31234/osf.io/5nfp2 · Cited by 10 · see citing works
The Myriad Forms of p-Hacking
Reis, D., & Friese, M. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_5 · Cited by 10 · see citing works
Two time points poorly capture trajectories of change: A warning for longitudinal neurosciencePreprint
Parsons, S. D., & McCormick, E. M. (2022) · doi:10.31234/osf.io/96ph3 · Cited by 8 · see citing works
Capacity for social contingency detection continues to develop across adolescence
Hermans, K. S. F. M., Kirtley, O. J., Kasanova, Z., Achterhof, R., Hagemann, N., Hiekkaranta, A. P., Lecei, A., Zapata-Fonseca, L. I., Lafit, G., Fossión, R., et al. (2021) · Social Development · doi:10.1111/sode.12567 · Cited by 7 · see citing works
The Effect of Different Construct Operationalizations, Study Duration, and Preprocessing Choices on Power-Based Sample Size Recommendations in Intensive Longitudinal Research
Lafit, G., Revol, J., Cloos, L., Kuppens, P., & Ceulemans, E. (2024) · Assessment · doi:10.1177/10731911241286868 · Cited by 14 · see citing works
Open Science at Clinical Psychological Science : Reflections on Progress, Lessons Learned, and Suggestions for Continued Improvement
Howard, A. L., Neal, T. M. S., Kirtley, O. J., Urry, H. L., & Tackett, J. L. (2024) · Clinical Psychological Science · doi:10.1177/21677026241255882 · Cited by 7 · see citing works
Open-Science Training in American Psychological Association–Accredited Clinical-Psychology Programs: A Registered Report
Til, K. V., Phillips, N. L., Du, T. V., Rose, L., Miller, J. D., & Lynam, D. R. (2025) · Clinical Psychological Science · doi:10.1177/21677026251331550 · Cited by 5 · see citing works
Anticipating future threats: Evidence for association, but not interaction, of childhood adversity and identity development with threat anticipation in adolescence
Samaey, C., Lecei, A., Achterhof, R., Hagemann, N., Hermans, K., Hiekkaranta, A., Kirtley, O., Reininghaus, U., Boets, B., Myin-Germeys, I., et al. (2024) · Early Intervention in Psychiatry · doi:10.1111/eip.13511 · Cited by 2 · see citing works
Autobiographical memory-based clinical interventions:Where are we now and where might we go?
Salmon, K., Jose, P. E., Reese, E., & Bryant, R. A. (2025) · Behaviour Research and Therapy · doi:10.1016/j.brat.2025.104808 · Cited by 4 · see citing works
Changes in adolescents’ daily-life solitary experiences during the COVID-19 pandemic: an experience sampling study
Bamps, E., Achterhof, R., Lafit, G., Teixeira, A., Akcaoglu, Z., Hagemann, N., Hermans, K. S. F. M., Hiekkaranta, A. P., Janssens, J. J., Lecei, A., et al. (2024) · BMC Public Health · doi:10.1186/s12889-024-18458-1 · Cited by 4 · see citing works
The bioinformatics landscape in environmental omics: Lessons from a national ELIXIR survey
Gioti, A., Theodosopoulou, D., Bravakos, P., Magoulas, A., & Kotoulas, G. (2024) · iScience · doi:10.1016/j.isci.2024.110062 · Cited by 4 · see citing works
The temporal trajectories of habit decay in daily life: An intensive longitudinal study on four health‐risk behaviors
Edgren, R., Baretta, D., & Inauen, J. (2024) · Applied Psychology Health and Well-Being · doi:10.1111/aphw.12612 · Cited by 5 · see citing works
Automatic Imitation in Comorbid PTSD & Alcohol Use Disorder and Controls: an RCT of Intranasal Oxytocin
Morrison, T. E., Coster, L. D., Stauffer, C. S., Jin, W., Ahmadi, E., Delucchi, K., O’Donovan, A., & Woolley, J. D. (2020) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2020.104787 · Cited by 5 · see citing works
Time to reappraise or distract? temporal and situational context in emotion regulation in daily life
Hiekkaranta, A. P., Kirtley, O. J., Eisele, G. V., Houben, M., Lafit, G., & Myin‐Germeys, I. (2023) · Current Psychology · doi:10.1007/s12144-023-05233-5 · Cited by 4 · see citing works
The effect of different construct operationalizations, study duration, and preprocessing choices on power-based sample size recommendations in intensive longitudinal researchPreprint
Lafit, G., Revol, J., Cloos, L., Kuppens, P., & Ceulemans, E. (2023) · doi:10.31234/osf.io/7msh6 · Cited by 4 · see citing works
An Investigation of the Temporal Dynamics of Careless Responding Across Different Populations in Experience Sampling Data
Pihlajamäki, M. R., Eisele, G. V., Peeters, L., Kirtley, O. J., Myin‐Germeys, I., & Lafit, G. (2026) · Assessment · doi:10.1177/10731911251410340 · Cited by 3 · see citing works
An Open Science Workflow for More Credible, Rigorous Research
Corker, K. S. (2022) · Cambridge University Press eBooks · doi:10.1017/9781108903264.012 · Cited by 3 · see citing works
Open with care: transparency and data sharing in civically engaged research
Mitra, A. (2025) · Politics Groups and Identities · doi:10.1080/21565503.2025.2492026 · Cited by 2 · see citing works
Feasibility of Collecting and Linking Digital Phenotyping, Clinical, and Genetics Data for Mental Health Research: Pilot Observational Study
Beames, J. R., Dabash, O., Spoelma, M. J., Shvetcov, A., Zheng, W. Y., Slade, A., Han, J., Hoon, L., Kupper, J. F., Parker, R., et al. (2025) · JMIR Formative Research · doi:10.2196/71377 · Cited by 2 · see citing works
Fabla: A voice-based ecological assessment method for securely collecting spoken responses to researcher questions
Kaplan, D. M., Alvarez, S. J. A., Palitsky, R., Choi, H., Clifford, G. D., Crozier, M., Dunlop, B. W., Grant, G. H., Greenleaf, M. N., Johnson, L. M., et al. (2025) · Behavior Research Methods · doi:10.3758/s13428-025-02777-1 · Cited by 2 · see citing works
Determinants and strategies of self-reported habit degradation: an intensive longitudinal study
Edgren, R., & Inauen, J. (2026) · Psychology and Health · doi:10.1080/08870446.2026.2626493 · Cited by 2 · see citing works
The assessment of physical risk taking: Preliminary construct validation of a new behavioral measure
Smith, E. A., & Benning, S. D. (2021) · PLoS ONE · doi:10.1371/journal.pone.0258826 · Cited by 2 · see citing works
Self-citation
Ecological and Convergent Validity of Experimentally and Dynamically Assessed Capacity for Social Contingency Detection Using the Perceptual Crossing Experiment in Adolescence
Hermans, K. S. F. M., Kirtley, O. J., Kasanova, Z., Achterhof, R., Hagemann, N., Hiekkaranta, A. P., Lecei, A., Zapata-Fonseca, L. I., Lafit, G., Fossión, R., et al. (2022) · Assessment · doi:10.1177/10731911221083613 · Cited by 2 · see citing works
COVID-19–Related Changes in Adolescents' Daily-Life Social Interactions and Psychopathology Symptoms
Achterhof, R., Myin‐Germeys, I., Bamps, E., Hagemann, N., Hermans, K. S. F. M., Hiekkaranta, A. P., Janssens, J. J., Lecei, A., Lafit, G., & Kirtley, O. J. (2025) · The Journal of Nervous and Mental Disease · doi:10.1097/nmd.0000000000001826 · Cited by 2 · see citing works
Transparency and Open Science at the Journal of Personality
Wright, A. G. C., Adler, J. M., DeYoung, C. G., Durbin, C. E., Edelstein, R. S., Jordan, C. H., Locke, K. D., Luo, S., Lynam, D. R., von Stumm, S., et al. (2021) · Journal of Personality · doi:10.1111/jopy.12626 · Cited by 2 · see citing works
Self-citation
Interrelationships between Parenting Styles, Daily-life Social Experiences and Psychopathology in AdolescencePreprint
Achterhof, R., Kirtley, O. J., Schneider, M., Lafit, G., Hagemann, N., Hermans, K. S. F. M., Hiekkaranta, A. P., Lecei, A., & Myin‐Germeys, I. (2021) · doi:10.31234/osf.io/bczdg · Cited by 2 · see citing works
Objectively measured sleep duration, sleep quality, and symptoms of psychopathology in the SIGMA cohortPreprint
Hagemann, N., Kirtley, O. J., Lafit, G., Wampers, M., Achterhof, R., Hermans, K. S. F. M., Hiekkaranta, A. P., Lecei, A., Vancampfort, D., & Myin‐Germeys, I. (2021) · doi:10.31234/osf.io/yx2eb · Cited by 2 · see citing works
The temporal trajectories of habit decay in daily life: An intensive longitudinal study on four health-risk behaviorsPreprint
Edgren, R., Baretta, D., & Inauen, J. (2024) · doi:10.31234/osf.io/aqwjs · Cited by 2 · see citing works
HabitWalk: A Micro-Randomized Trial to Understand and Promote Habit Formation in Physical ActivityPreprint
Baretta, D., Gillmann, N., Edgren, R., & Inauen, J. (2024) · doi:10.31219/osf.io/5pbtf · Cited by 2 · see citing works
Incentivizing excellence: Task-based learnings in English language teaching
Paul, M., Ruqsar, S., John, M. Y. A., & Turza, L. T. (2023) · International Journal of Research in English · doi:10.33545/26648717.2023.v5.i2b.142 · Cited by 1 · see citing works
Exploring the Relationship Between Stress-Physiology and Pain in the Daily Life of Patients With Chronic Widespread Pain
Pattyn, E., Thammasan, N., Davidoff, H., Raedt, W. D., Eisele, G. V., van Stiphout, R. G. P. M., Vos, M. D., Kirtley, O. J., Wambeke, P. V., Morlion, B. J., et al. (2025) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2025.3545477 · Cited by 1 · see citing works
The Role of Parent–Child Attachment in the Association Between Loneliness and Self-Harm Thoughts and Behaviors in Daily Life
Janssens, J. J., Lafit, G., Šimsa, B., Bosmans, G., Achterhof, R., Hagemann, N., Myin‐Germeys, I., & Kirtley, O. J. (2025) · Clinical Psychological Science · doi:10.1177/21677026251345451 · Cited by 1 · see citing works
A bibliometric analysis of preprints in traditional, complementary, and integrative medicine research
Ng, J. Y., Lin, B. X., Abdella, S., Abebe, M., Tao, I., & Cramer, H. (2026) · Medicine · doi:10.1097/md.0000000000050024 · Cited by 1 · see citing works
Social processes as the missing link: cross-sectionally testing a conceptual model on social mediators of early psychopathological development
Achterhof, R., Kirtley, O. J., Lafit, G., Hiekkaranta, A. P., Hagemann, N., Hermans, K. S. F. M., Lecei, A., Boets, B., Henquet, C., Schneider, M., et al. (2024) · Psychological Medicine · doi:10.1017/s0033291724001594 · Cited by 1 · see citing works
Open Science and Multicultural Research: Some Data, Considerations, and RecommendationsPreprint
Lui, P. P., Gobrial, S., Pham, S., Giadolor, W., Adams, N., & Rollock, D. (2022) · doi:10.31234/osf.io/vncuz · Cited by 1 · see citing works
Adolescents’ future orientation and anticipatory emotion regulation in daily life during the COVID-19 pandemic: An experience sampling studyPreprint
Hiekkaranta, A. P., Myin‐Germeys, I., Achterhof, R., Bamps, E., Hagemann, N., Janssens, J. J., Akcaoglu, Z., Lafit, G., & Kirtley, O. J. (2023) · doi:10.31234/osf.io/mh7au · Cited by 1 · see citing works
A Template and Tutorial for Preregistering Studies Using Passive Smartphone MeasuresPreprint
Langener, A. M., Siepe, B. S., Elsherif, M. M., Niemeijer, K., Andresen, P. K., Akre, S., Bringmann, L. F., Cohen, Z. D., Choukas, N. R., Drexl, K., et al. (2024) · doi:10.31234/osf.io/p4xf8 · Cited by 1 · see citing works
Time to Get Social: Adaptive Social Processes in the Daily Lives of Youth (Full PhD thesis)Preprint
Achterhof, R. (2022) · doi:10.31234/osf.io/knzms
Informing the Classification of Positive Emotional Experiences: A Multisample Examination of Hierarchical Models of Positive EmotionalityPreprint
Stanton, K. J., McDanal, R., Carlton, C. N., & Emery, N. N. (2020) · doi:10.31219/osf.io/8gq4b
Open Science and Multicultural Research: Some Data, Considerations, and RecommendationsPreprint
Lui, P. P., Gobrial, S., Pham, S., Giadolor, W., Adams, N., & Rollock, D. (2021) · doi:10.31219/osf.io/em9ua
Overcoming Challenges in Preregistration to Improve Statistical Inferences in Clinical SciencePreprint
Eberle, J. W. (2022) · doi:10.31234/osf.io/d5jpw
Differences in Adolescents' Daily-Life Experiences of Social and Non-Social Situations, and Associated Risk and Protective FactorsPreprint
Bamps, E., Achterhof, R., Lafit, G., Hagemann, N., Hermans, K. S. F. M., Hiekkaranta, A. P., Lecei, A., Kirtley, O. J., & Myin‐Germeys, I. (2023) · doi:10.31234/osf.io/45d9w
The devil is in the details: Advancing our collective understanding of naturalistic developmental behavioral interventions
Shire, S. Y. (2023) · Autism Research · doi:10.1002/aur.3048
From Data Streams to Mental Health Predictions: Improving the use of Passive Measures from Digital Devices
Langener, A. M. (2024) · doi:10.33612/diss.1069770227
A Template and Tutorial for Preregistering Studies Using Passive Smartphone MeasuresPreprint
Langener, A. M., Siepe, B. S., Elsherif, M. M., Niemeijer, K., Andresen, P. K., Akre, S., Bringmann, L. F., Cohen, Z. D., Choukas, N. R., Drexl, K., et al. (2024) · doi:10.31234/osf.io/p4xf8_v1
Mental health changes in different adolescent groups from before to throughout the COVID-19 pandemic
Achterhof, R., Kirtley, O. J., Lafit, G., Akcaoglu, Z., Bamps, E., Hiekkaranta, A. P., Hagemann, N., Hermans, K. S. F. M., Janssens, J. J., Lecei, A., et al. (2025) · Psychiatry Research · doi:10.1016/j.psychres.2025.116733
Planned Versus Unplanned Daily Substance Use Among Sexual-Minority Youths: The Moderating Role of Social Norms
Mereish, E. H., Parnes, J. E., Rentería, R., & Miranda, R. (2025) · Clinical Psychological Science · doi:10.1177/21677026251377090
Toward an idiographic understanding of the role of sleep‐mood dynamics in adolescents' internalizing symptoms
Drexl, K., Ranjbar, S., Urben, S., Plessen, K. J., & Glaus, J. (2025) · JCPP Advances · doi:10.1002/jcv2.70082
The emergence of disadvantageous inequity aversion between 2–4 years
Hernandez, F. S., & Hyde, D. C. (2026) · Journal of Experimental Child Psychology · doi:10.1016/j.jecp.2026.106464
Affective Forecasting Accuracy in Everyday Life
Moeck, E. K., Grewal, K. K., Mehta, A., Greenaway, K. H., Koval, P., & Kalokerinos, E. K. (2026) · Affective Science · doi:10.1007/s42761-026-00364-x
The effect of incentive type on data quality and quantity in an experience sampling study in a student population
Pihlajamäki, M. R., Lafit, G., Kirtley, O. J., Myin‐Germeys, I., & Eisele, G. V. (2026) · Behavior Research Methods · doi:10.3758/s13428-026-03164-0
Improving Science Will Require More Than Just Training
King, K. M., Lui, P. P., & Dora, J. (2026) · Clinical Psychological Science · doi:10.1177/21677026251408051

Authors: Benning, S. D., Bachrach, R. L., Smith, E. A., Freeman, A. J., & Wright, A. G. C.
Affiliations: University of Nevada, Las Vegas (US)
VA Pittsburgh Healthcare System (US)
University of Pittsburgh (US)
ORCID: Benning, Stephen D.
Bachrach, Rachel L.
Smith, Edward A.
Freeman, Andrew J.
Wright, Aidan G. C.
Venue: Journal of Abnormal Psychology
Publisher: American Psychological Association (APA)
Published: 2019-08
Volume: 128
Issue: 6
Pages: 528-540
ISSN: 0021-843X (ISSN-L)
1939-1846
DOI: 10.1037/abn0000451
PMC: PMC6677163
OpenAlex: W2956054558
Cited by: 77
References: 61
Citations by year: 2026: 7 · 2025: 11 · 2024: 15 · 2023: 8 · 2022: 15 · 2021: 15 · 2020: 2 · 2019: 4
FWCI: 6.02
Type: journal article
Language: en
Open access: hybrid
doi.org
Licence: other-oa
www.apa.org/pubs/journals/resources/open-access.aspx (am, 365 d)
Locations: Journal of Abnormal Psychology (publishedVersion, other-oa)
PubMed (publishedVersion)
PubMed Central (acceptedVersion)
PsyArXiv (OSF Preprints) (submittedVersion)
PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
Funders: National Institute of Mental Health (L30 MH101760)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics in Clinical Research
Keywords: clinical trial registration, research transparency, false positive rate, participant recruitment, clinical phenotype, comorbidities, missing data, decision tree, standard operating procedures, clinical research
MeSH terms: Humans, Psychology, Clinical, Research Design, Research Personnel, Guidelines as Topic, Disclosure, Biomedical Research

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

The registration continuum in clinical science: A guide toward transparent practices

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Self-check

Cites

Cited by

Related

Record

About these checks