The DOI matches its Crossref record; 355 of the 356 references it cites were found in a registry or an index.
Improving Mental Health Services: A 50-Year Journey from Randomized Experiments to Artificial Intelligence and Precision Mental Health
Open accessAbstract
This conceptual paper describes the current state of mental health services, identifies critical problems, and suggests how to solve them. I focus on the potential contributions of artificial intelligence and precision mental health to improving mental health services. Toward that end, I draw upon my own research, which has changed over the last half century, to highlight the need to transform the way we conduct mental health services research. I identify exemplars from the emerging literature on artificial intelligence and precision approaches to treatment in which there is an attempt to personalize or fit the treatment to the client in order to produce more effective interventions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“their effectiveness is poor, with between a third and two-thirds of those receiving interventions not having symptom reductions. 237”
From The Lancet Psychiatry Commission on youth mental health (2024) · cites this paper as [237]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“the rapid development and adoption of breakthrough technologies including artificial intelligence, natural language processing, virtual and augmented reality, and virtual worlds provides an unprecedented opportunity to use new innovations to address historical problems in youth mental health.”
From The Lancet Psychiatry Commission on youth mental health (2024) · cites this paper as [237]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–356 of 356
Veterans Affairs and the Department of Defense mental health apps: A systematic literature review.
Gould, C. E., Kok, B. C., Vanessa, K., Zapata, A. M. L., Owen, J. E., & Kuhn, E. R. (2018) · Psychological Services · doi:10.1037/ser0000289 · Cited by 77
Molyneaux, E., Turner, A., Candy, B., Landau, S., Johnson, S., & Lloyd-Evans, B. (2019) · BJPsych Open · doi:10.1192/bjo.2019.28 · Cited by 77
Serretti, A. (2018) · Clinical Psychopharmacology and Neuroscience · doi:10.9758/cpn.2018.16.1.1 · Cited by 76
Beyond the laboratory : field research in social psychology
Bickman, L., & Henchy, T. (1972) · McGraw-Hill eBooks · Cited by 76
Self-citationPatient-Centered Assessment in Psychotherapy: A Review of Individualized Tools
Sales, C. M. D., & Alves, P. (2016) · Clinical Psychology Science and Practice · doi:10.1111/cpsp.12162 · Cited by 75
Bickman, L., de Andrade, A. R. V., Athay, M. M., Chen, J. I., Nadai, A. S. D., Jordan-Arthur, B. L., & Karver, M. S. (2012) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-011-0398-0 · Cited by 74
Self-citationMore of What? Issues raised by the Fort Bragg study.
Weisz, J. R., Han, S. S., & Valeri, S. M. (1997) · American Psychologist · doi:10.1037/0003-066x.52.5.541 · Cited by 73
The gap between science and practice: how therapists make their clinical decisions
Gyani, A., Shafran, R., Myles, P., & Rose, S. (2014) · Behavior Therapy · doi:10.1016/j.beth.2013.10.004 · Cited by 73
Modified Causal Forests for Estimating Heterogeneous Causal EffectsPreprint
Lechner, M. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.5242195 · Cited by 72
Berk, M., Mohebbi, M., Dean, O. M., Cotton, S., Chanen, A. M., Dodd, S., Ratheesh, A., Amminger, G. P., Phelan, M., Weller, A., et al. (2020) · BMC Medicine · doi:10.1186/s12916-019-1475-6 · Cited by 72
McGinnis, R. S., McGinnis, E. W., Hruschak, J. L., Lopez‐Duran, N. L., Fitzgerald, K. D., Rosenblum, K. L., & Muzik, M. (2019) · PLoS ONE · doi:10.1371/journal.pone.0210267 · Cited by 71
D’Acunto, G., Nageye, F., Zhang, J., Masi, G., & Cortese, S. (2019) · Journal of Child and Adolescent Psychopharmacology · doi:10.1089/cap.2019.0015 · Cited by 71
Sales, C. M. D., & Alves, P. (2012) · Canadian Psychology/Psychologie canadienne · doi:10.1037/a0028053 · Cited by 70
Pérez‐Rosas, V., Wu, X., Resnicow, K., & Mihalcea, R. F. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1088 · Cited by 70
Using artificial intelligence to assess clinicians’ communication skills
Ryan, P., Luz, S., Albert, P., Vogel, C., Normand, C., & Elwyn, G. (2019) · BMJ · doi:10.1136/bmj.l161 · Cited by 69
Evaluation of a Congressionally Mandated Wraparound Demonstration
Bickman, L., Smith, C. M., Lambert, E., & de Andrade, A. R. V. (2003) · Journal of Child and Family Studies · doi:10.1023/a:1022854614689 · Cited by 67
Self-citationInterpreting nullity: The Fort Bragg experiment--A comparative success or failure?
Hoagwood, K. (1997) · American Psychologist · doi:10.1037/0003-066x.52.5.546 · Cited by 66
The Future of Digital Psychiatry
Hariman, K. W., Ventriglio, A., & Bhugra, D. (2019) · Current Psychiatry Reports · doi:10.1007/s11920-019-1074-4 · Cited by 64
An Introduction to Machine Learning Methods for Survey Researchers
Buskirk, T. D., Kirchner, A., Eck, A., & Signorino, C. S. (2018) · Survey Practice · doi:10.29115/sp-2018-0004 · Cited by 63
Immunopharmacogenomics towards personalized cancer immunotherapy targeting neoantigens
Kiyotani, K., Chan, T., & Nakamura, Y. (2017) · Cancer Science · doi:10.1111/cas.13498 · Cited by 61
Social influence and diffusion of responsibility in an emergency
Bickman, L. (1972) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(72)90069-8 · Cited by 60
Self-citationAugust, G. J., Piehler, T. F., & Bloomquist, M. L. (2014) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2014.945212 · Cited by 60
Psychoneuroimmunology of Stress and Mental Health
Slavich, G. M. (2019) · doi:10.1093/oxfordhb/9780190681777.013.24 · Cited by 60
Duwe, G., & Kim, K. (2015) · Criminal Justice Policy Review · doi:10.1177/0887403415604899 · Cited by 59
Difficulties and challenges in the development of precision medicine
Liu, X., Luo, X., Jiang, C., & Zhao, H. (2019) · Clinical Genetics · doi:10.1111/cge.13511 · Cited by 58
Mohr, D. C., Lattie, E. G., Tomasino, K. N., Kwasny, M. J., Kaiser, S. M., Gray, E. L., Alam, N., Jordan, N., & Schueller, S. M. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.103485 · Cited by 57
Can Machine Learning help us in dealing with treatment resistant depression? A review
Pigoni, A., Delvecchio, G., Madonna, D., Bressi, C., Soares, J. C., & Brambilla, P. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.08.009 · Cited by 57
The technology of measurement feedback systems.
Bickman, L., Kelley, S. D., & Athay, M. M. (2012) · Couple and Family Psychology Research and Practice · doi:10.1037/a0031022 · Cited by 55
Self-citationSupplemental Iodide for Preterm Infants and Developmental Outcomes at 2 Years: An RCT
Williams, F. L. R., Ogston, S. A., Hume, R., Watson, J., Stanbury, K., Willatts, P., Boelen, A., Juszczak, E., Brocklehurst, P., & for the I2S2 Team (2017) · PEDIATRICS · doi:10.1542/peds.2016-3703 · Cited by 55
Bickman, L. (1997) · American Psychologist · doi:10.1037//0003-066x.52.5.562 · Cited by 54
Self-citationvan Ravenhorst, M. B., van der Klis, F. R. M., van Rooijen, D. M., Sanders, E. A. M., & Berbers, G. A. M. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0650-3 · Cited by 53
Leighton, S., Upthegrove, R., Krishnadas, R., Benros, M. E., Broome, M. R., Gkoutos, G. V., Liddle, P. F., Singh, S. P., Everard, L., Jones, P. B., et al. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30121-9 · Cited by 53
Endocrine and immune effects of non-convulsive neurostimulation in depression: A systematic review
Perrin, A. J., & Pariante, C. M. (2020) · Brain Behavior and Immunity · doi:10.1016/j.bbi.2020.02.016 · Cited by 51
Reflections on Randomized Control Trials
Deaton, A., & Cartwright, N. D. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2018.04.046 · Cited by 51
Will artificial intelligence eventually replace psychiatrists?
Brown, C., Story, G. W., Mourão-Miranda, J., & Baker, J. T. (2019) · The British Journal of Psychiatry · doi:10.1192/bjp.2019.245 · Cited by 50
Subramanian, S. V., Kim, R., & Christakis, N. A. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2018.04.027 · Cited by 50
Hassani, H., Huang, X., & Ghodsi, M. (2017) · Annals of Data Science · doi:10.1007/s40745-017-0122-3 · Cited by 48
Predicting major mental illness: ethical and practical considerations
Lawrie, S. M., Fletcher‐Watson, S., Whalley, H. C., & McIntosh, A. M. (2019) · BJPsych Open · doi:10.1192/bjo.2019.11 · Cited by 47
Wu, C., Luedtke, A. R., Sadikova, E., Tsai, H., Liao, S., Liu, C., Gau, S. S., VanderWeele, T. J., & Kessler, R. C. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.21660 · Cited by 46
Li, T. X., Sun, S., Cui, L., Wang, S., Peng, Z., Tan, Q., Hou, W., & Cai, M. (2020) · Neuroscience · doi:10.1016/j.neuroscience.2019.12.025 · Cited by 46
An awakening in medicine: the partnership of humanity and intelligent machines
Celi, L. A., Fine, B., & Stone, D. J. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30127-x · Cited by 45
Cearns, M., Opel, N., Clark, S. R., Flint, C., Thalamuthu, A., Heindel, W. L., Winter, T., Teismann, H., Minnerup, H., Dannlowski, U., et al. (2019) · Translational Psychiatry · doi:10.1038/s41398-019-0615-2 · Cited by 45
Chronic Systemic Inflammation Is Associated With Symptoms of Late-Life Depression: The ARIC Study
Sonsin-Diaz, N., Gottesman, R. F., Fracica, E., Walston, J., Windham, B. G., Knopman, D. S., & Walker, K. A. (2020) · The American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2019.05.011 · Cited by 44 · cited 1×
“In contrast, a major longitudinal study of more than 4600 adults followed over 20 years found that participants who had stable high C-reactive protein levels were more likely to report clinically significant late-life depression symptoms (Sonsin-Diaz et al. 2020).”
BackgroundBickman, L., & Noser, K. (1999) · Applied and Preventive Psychology · doi:10.1016/s0962-1849(05)80039-3 · Cited by 44
Self-citationCrime reporting as a function of bystander encouragement, surveillance, and credibility.
Bickman, L., & Rosenbaum, D. P. (1977) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.35.8.577 · Cited by 43
Self-citationRiemer, M., Athay, M. M., Bickman, L., Breda, C. S., Kelley, S. D., & de Andrade, A. R. V. (2012) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0404-1 · Cited by 43
Self-citationA Framework for Advancing Precision Medicine in Clinical Trials for Mental Disorders
Lenze, E. J., Rodebaugh, T. L., & Nicol, G. E. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.0114 · Cited by 43
Dogma or data: Bragging rights.
SECHREST, L. B., & Walsh, M. C. (1997) · American Psychologist · doi:10.1037//0003-066x.52.5.536 · Cited by 43
Interpreting nullity: The Fort Bragg experiment--A comparative success or failure?
Hoagwood, K. (1997) · American Psychologist · doi:10.1037//0003-066x.52.5.546 · Cited by 43
Current Regulation of Mobile Mental Health Applications.
Armontrout, J. A., Torous, J. B., Cohen, M., McNiel, D. E., & Binder, R. L. (2018) · PubMed · doi:10.29158/jaapl.003748-18 · Cited by 42
Real-World Evidence: Promise and Peril For Medical Product Evaluation.
Dhruva, S. S., Ross, J. S., & Desai, N. R. (2018) · Europe PMC (PubMed Central) · Cited by 42
Coffinier, C., Peredo, J., Russell, M. M., Yano, E. M., Hamilton, A. B., Lerner, B., Provenzale, D., Knight, S. J., Voils, C. I., & Scheuner, M. T. (2018) · Genetics in Medicine · doi:10.1038/s41436-018-0315-y · Cited by 41
Rudin, C. D., & Carlson, D. (2019) · doi:10.1287/educ.2019.0200 · Cited by 41
A technology-assisted life of recovery from psychosis
Ben‐Zeev, D., Buck, B., Kopelovich, S. L., & Meller, S. (2019) · Schizophrenia · doi:10.1038/s41537-019-0083-y · Cited by 41
Exploring the Black Box: Measuring Youth Treatment Process and Progress in Usual Care
Kelley, S. D., de Andrade, A. R. V., Sheffer, E., & Bickman, L. (2010) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0298-8 · Cited by 40
Self-citationWhy Don’t We Have Effective Mental Health Services?
Bickman, L. (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0192-9 · Cited by 39
Self-citationComparing sequencing assays and human-machine analyses in actionable genomics for glioblastoma
Wrzeszczyński, K. O., Frank, M. O., Koyama, T., Rhrissorrakrai, K., Robine, N., Utro, F., Emde, A., Chen, B., Arora, K. S., Shah, M. J., et al. (2017) · Neurology Genetics · doi:10.1212/nxg.0000000000000164 · Cited by 39
The Fort Bragg evaluation: A snapshot in time.
Behar, L. B. (1997) · American Psychologist · doi:10.1037//0003-066x.52.5.557 · Cited by 39
Gual-Montolio, P., Martínez-Borba, V., Bretón-López, J. M., Osma, J., & Suso-Ribera, C. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17093170 · Cited by 38
Clinican reliability and accuracy in judging appropriate level of care.
Bickman, L., Karver, M. S., & Schut, L. J. A. (1997) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.65.3.515 · Cited by 37
Self-citationChallenges of using progress monitoring measures: Insights from practicing clinicians.
Ionita, G., Fitzpatrick, M. R., Tomaro, J., Chen, V. V., & Overington, L. (2015) · Journal of Counseling Psychology · doi:10.1037/cou0000122 · Cited by 37
Krittanawong, C., Johnson, K. W., & Tang, W. H. W. (2019) · Personalized Medicine · doi:10.2217/pme-2018-0130 · Cited by 37
Gibbons, M. B. C., Kurtz, J. E., Thompson, D. L., Mack, R. A., Lee, J. K., Rothbard, A. B., Eisen, S. V., Gallop, R., & Crits-Christoph, P. F. (2015) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0039302 · Cited by 36
In the face of stress: Interpreting individual differences in stress-induced facial expressions
Mayo, L. M., & Heilig, M. A. (2019) · Neurobiology of Stress · doi:10.1016/j.ynstr.2019.100166 · Cited by 36
A Complex Systems Approach to Causal Discovery in Psychiatry
Saxe, G., Statnikov, A., Fenyö, D., Ren, J., Li, Z., Prasad, M., Wall, D. P., Bergman, N., Briggs, E. C., & Aliferis, C. (2016) · PLoS ONE · doi:10.1371/journal.pone.0151174 · Cited by 36
Learning algorithms and discrimination
Packin, N. G., & Lev-Aretz, Y. (2018) · Research Handbook on the Law of Artificial Intelligence · doi:10.4337/9781786439055.00014 · Cited by 36
Tasca, G. A., Angus, L. E., Bonli, R., Drapeau, M., Fitzpatrick, M. R., Hunsley, J. D., & Knoll, M. L. (2019) · Canadian Psychology/Psychologie canadienne · doi:10.1037/cap0000181 · Cited by 36
Obama gives East Room rollout to Precision Medicine Initiative
Kaiser, J. (2015) · Science · doi:10.1126/science.aaa6436 · Cited by 35
Analysis of cause-effect inference by comparing regression errors
Blöbaum, P., Janzing, D., Washio, T., Shimizu, S., & Schölkopf, B. (2019) · PeerJ Computer Science · doi:10.7717/peerj-cs.169 · Cited by 35
Improving Established Statewide Programs
Bickman, L. (1985) · Evaluation Review · doi:10.1177/0193841x8500900206 · Cited by 34
Self-citationWill Machine Learning Enable Us to Finally Cut the Gordian Knot of Schizophrenia
Tandon, N., & Tandon, R. (2018) · Schizophrenia Bulletin · doi:10.1093/schbul/sby101 · Cited by 34
Kasthurirathne, S. N., Biondich, P., Grannis, S. J., Purkayastha, S., Vest, J. R., & Jones, J. (2019) · Journal of Medical Internet Research · doi:10.2196/13809 · Cited by 34
Tuerk, P. W., Schaeffer, C. M., Mcguire, J. F., Larsen, M. A., Capobianco, N. B., & Piacentini, J. C. (2019) · Current Psychiatry Reports · doi:10.1007/s11920-019-1092-2 · Cited by 34
The Research Network on Youth Mental Health, Park, A. L., Chorpita, B. F., Regan, J., & Weisz, J. R. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0559-z · Cited by 34
Methodological advances in statistical prediction.
Garb, H. N., & Wood, J. M. (2019) · Psychological Assessment · doi:10.1037/pas0000673 · Cited by 33
Implementing routine outcome measurement in psychosocial interventions – a systematic review
Mackrill, T., & Sørensen, K. M. (2019) · European Journal of Social Work · doi:10.1080/13691457.2019.1602029 · Cited by 33
Gómez Penedo, J. M., Babl, A. M., grosse Holtforth, M., Hohagen, F., Krieger, T., Lutz, W., Meyer, B., Moritz, S., Klein, J. P., & Berger, T. (2020) · Journal of Medical Internet Research · doi:10.2196/15824 · Cited by 33
Scientific challenges for precision public health
Kee, F., & Taylor-Robinson, D. C. (2020) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2019-213311 · Cited by 33
Jones, P. J., Mair, P., Kuppens, S., & Weisz, J. R. (2019) · Clinical Psychological Science · doi:10.1177/2167702619858424 · Cited by 31 · cited 1×
“In an innovative approach to examining the effectiveness of psychotherapy for youth, Jones et al. (2019) subjected 502 RCTs to a mathematical simulation model that estimated that even if therapy was perfectly implemented, the effect size would be a modest 0.83.”
BackgroundInfluentialThe Ethics of Biomedical ‘Big Data’ Analytics
Mittelstadt, B. (2019) · Philosophy & Technology · doi:10.1007/s13347-019-00344-z · Cited by 31
Psychotherapy Expertise Should Mean Superior Outcomes and Demonstrable Improvement Over Time
Goodyear, R. K., Wampold, B. E., Tracey, T. J. G., & Lichtenberg, J. W. (2017) · The Counseling Psychologist · doi:10.1177/0011000016652691 · Cited by 31
Computational approaches and machine learning for individual-level treatment predictions
Paulus, M. P., & Thompson, W. K. (2019) · Psychopharmacology · doi:10.1007/s00213-019-05282-4 · Cited by 30
Improving Moderator Responsiveness in Online Peer Support Through Automated Triage
Milne, D., McCabe, K., & Calvo, R. A. (2018) · Journal of Medical Internet Research · doi:10.2196/11410 · Cited by 30
Psychotherapists Openness to Routine Naturalistic Idiographic Research?
Sales, C. M. D., Gonçalves, S. F., Fragoeiro, Â., Noronha, S., & Elliott, R. (2007) · Mental Health and Learning Disabilities Research and Practice · doi:10.5920/mhldrp.2007.42145 · Cited by 29
Choudhury, M. D., & Kıcıman, E. (2018) · The AI Magazine · doi:10.1609/aimag.v39i3.2815 · Cited by 29
Clarkson, T., Kang, E., Capriola-Hall, N. N., Lerner, M. D., Jarcho, J. M., & Prinstein, M. J. (2019) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2019.1678167 · Cited by 29
Dyer, K., Hooke, G. R., & Page, A. C. (2014) · Psychotherapy Research · doi:10.1080/10503307.2014.983207 · Cited by 29
Testing moderation in network meta‐analysis with individual participant data
Dagne, G. A., Brown, C. H., Howe, G. W., Kellam, S. G., & Liu, L. (2016) · Statistics in Medicine · doi:10.1002/sim.6883 · Cited by 28
Barriers to the use of program theory
Bickman, L. (1989) · Evaluation and Program Planning · doi:10.1016/0149-7189(89)90056-6 · Cited by 28
Self-citationHandbook of Social Policy Evaluation
Roy, M. J., McHugh, N., & Sinclair, S. (2017) · Edward Elgar Publishing eBooks · doi:10.4337/9781785363245 · Cited by 28
Racing towards a digital paradise or a digital hell?
Wykes, T. (2019) · Journal of Mental Health · doi:10.1080/09638237.2019.1581360 · Cited by 28
Does big data require a methodological change in medical research?
Caliebe, A., Leverkus, F., Antes, G., & Krawczak, M. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0774-0 · Cited by 28
Can interest and enjoyment help to increase use of Internet-delivered interventions?
Crutzen, R., Ruiter, R. A. C., & de Vries, N. K. (2014) · Psychology and Health · doi:10.1080/08870446.2014.921300 · Cited by 27
Berkel, C., Gallo, C. G., Sandler, I. N., Mauricio, A. M., Smith, J. D., & Brown, C. H. (2019) · The Journal of Primary Prevention · doi:10.1007/s10935-018-00534-z · Cited by 27
Developing Machine Learning Models for Behavioral Coding
Carcone, A. I., Hasan, M., Alexander, G., Dong, M., Eggly, S. S., Hartlieb, K. B., Naar, S., MacDonell, K. K., & Kotov, A. (2019) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsy113 · Cited by 27
D’Amour, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.10286 · Cited by 27
Foster, E. M., & Bickman, L. (2000) · Mental Health Services Research · doi:10.1023/a:1010139823791 · Cited by 25
Self-citationFor whom does interpersonal psychotherapy work? A systematic review
Bernecker, S. L., Coyne, A. E., Constantino, M. J., & Ravitz, P. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.07.001 · Cited by 24
Machine Learning for Clinical Psychology and Clinical Neuroscience
Coutanche, M. N., & Hallion, L. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781316995808.041 · Cited by 24
Social roles and uniforms: Clothes make the person
Bickman, L. (1974) · PsycEXTRA Dataset · doi:10.1037/e400592009-005 · Cited by 23
Self-citationSerbanescu, I., Walter, H., Schnell, K., Kessler, H., Weber, B., Drost, S., Groß, M., Neudeck, P., Klein, J. P., Assmann, N., et al. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.103512 · Cited by 21
Computational causal discovery for post-traumatic stress in police officers
Saxe, G., Ma, S., Morales, L. J., Galatzer‐Levy, I. R., Aliferis, C., & Marmar, C. R. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-00910-6 · Cited by 21
The Individualised Patient‐Progress System: A decade of international collaborative networking
Sales, C. M. D., Alves, P., Evans, C., Elliott, R., & On Behalf of Ipha Group (2014) · Counselling and Psychotherapy Research · doi:10.1080/14733145.2014.929417 · Cited by 19
Big Data Analytics and AI in Mental HealthcarePreprint
Rosenfeld, A., Benrimoh, D., Armstrong, C., Mirchi, N., Langlois-Therrien, T., Rollins, C. P. E., Tanguay-Sela, M., Mehltretter, J., Fratila, R., Israel, S., et al. (2019) · arXiv.org · doi:10.48550/arxiv.1903.12071 · Cited by 19
An Artificial Neural Network for Movement Pattern Analysis to Estimate Blood Alcohol Content Level
Gharani, P., Suffoletto, B. P., Chung, T. A., & Karimi, H. A. (2017) · Sensors · doi:10.3390/s17122897 · Cited by 19
Methodology for evaluating mental health case management
Bryant, D. M., & Bickman, L. (1996) · Evaluation and Program Planning · doi:10.1016/0149-7189(96)00003-1 · Cited by 18
Self-citationCohen, A. S. (2019) · Psychological Assessment · doi:10.1037/pas0000694 · Cited by 18
Can Machine Learning Improve Screening for Targeted Delinquency Prevention Programs?
Pelham, W. E., Petras, H., & Pardini, D. A. (2019) · Prevention Science · doi:10.1007/s11121-019-01040-2 · Cited by 18
Would you Follow my Instructions if I was not Human? Examining Obedience towards Virtual Agents
Schneeberger, T., Ehrhardt, S., Anglet, M. S., & Gebhard, P. (2019) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2019.8925501 · Cited by 18
An Introduction to Adaptive Interventions and SMART Designs in Education. NCSER 2020-001.
Nahum-Shani, I. B., & Almirall, D. (2019) · Cited by 18
Alves, P., Sales, C. M. D., & Ashworth, M. J. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-337 · Cited by 17
Rethinking the experiment: necessary (R)evolution
Nadin, M. (2017) · AI & Society · doi:10.1007/s00146-017-0705-8 · Cited by 17
Protecting Human Subjects in the Digital Age: Issues and Best Practices of Data Protection
Jamieson, T. H., & Salinas, G. (2018) · Survey Practice · doi:10.29115/sp-2018-0028 · Cited by 17
Why Can’t Mental Health Services be More Like Modern Baseball?
Bickman, L. (2012) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0409-9 · Cited by 17
Self-citationCallegaro, A., & Tibaldi, F. S. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0687-y · Cited by 17
Human versus machine in medicine: can scientific literature answer the question?
Cook, T. S. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30124-4 · Cited by 16
A Preliminary Precision Treatment Rule for Remission of Suicide Ideation
Kessler, R. C., Chalker, S. A., Luedtke, A. R., Sadikova, E., & Jobes, D. A. (2019) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12609 · Cited by 16
Inflammatory Biomarkers for Mood Disorders - A Brief Narrative Review
Chang, H. H., & Chen, P. S. (2020) · Current Pharmaceutical Design · doi:10.2174/1381612826666200115100726 · Cited by 16
Applying Big Data Methods to Understanding Human Behavior and Health
Moustafa, A. A., Diallo, T., Amoroso, N., Zaki, N., Hassan, M., & Alashwal, H. (2018) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2018.00084 · Cited by 16
Personalising the evaluation of substance misuse treatment: A new approach to outcome measurement
Alves, P., Sales, C. M. D., & Ashworth, M. J. (2014) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2014.11.014 · Cited by 15
The Value of Psychiatric Diagnoses
Heckers, S. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.2250 · Cited by 15
Non-Gaussian Methods for Causal Structure Learning
Shimizu, S. (2018) · Prevention Science · doi:10.1007/s11121-018-0901-x · Cited by 15
A SVM-based classification approach for obsessive compulsive disorder by oxidative stress biomarkers
Shrivastava, A., Tripathy, A. K., & Dalal, P. (2019) · Journal of Computational Science · doi:10.1016/j.jocs.2019.07.010 · Cited by 15
Speculations on the Future of Psychiatric Diagnosis
Rush, A. J., & Ibrahim, H. M. (2018) · The Journal of Nervous and Mental Disease · doi:10.1097/nmd.0000000000000821 · Cited by 14
Boruch, R. F., Yang, R., Hyatt, J. M., & Turner, H. (2017) · Edward Elgar Publishing eBooks · doi:10.4337/9781785363245.00008 · Cited by 14
Personal values and ESP scores.
Schmeidler, G. R. (1952) · Journal of Abnormal & Social Psychology · doi:10.1037/h0054954 · Cited by 14
Randomized Controlled Trials : A Gold Standard or Gold Plated?
Bickman, L., & Reich, S. M. (2015) · Sage eBooks · doi:10.4135/9781483385839.n7 · Cited by 14
Self-citationBakir, V., Feilzer, M., & McStay, A. (2017) · Big Data & Society · doi:10.1177/2053951717698996 · Cited by 14
AI and the Singularity: A Fallacy or a Great Opportunity?
Braga, A. A., & Logan, R. K. (2019) · Information · doi:10.3390/info10020073 · Cited by 14
Commercial Influences on Electronic Health Records and Adverse Effects on Clinical Decision-making
Taitsman, J. K., VanLandingham, A., & Grimm, C. M. (2020) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2020.1318 · Cited by 14
Technology Matters: Mental health apps – separating the wheat from the chaff
Bergin, A., & Davies, E. B. (2019) · Child and Adolescent Mental Health · doi:10.1111/camh.12363 · Cited by 12
Does feedback improve psychotherapy outcomes compared to treatment-as-usual for adults and youth?
Dyason, K. M., Shanley, D. C., O’Donovan, A., & Low‐Choy, S. (2019) · Psychotherapy Research · doi:10.1080/10503307.2019.1620367 · Cited by 12
Hooke, G. R., Sng, A., Cunningham, N. K., & Page, A. C. (2017) · Cognitive Therapy and Research · doi:10.1007/s10608-017-9851-z · Cited by 10
A Tale of Two Deficits: Causality and Care in Medical AI
Chen, M. (2019) · Philosophy & Technology · doi:10.1007/s13347-019-00359-6 · Cited by 9
The Session Report Form (SRF): Are Clinicians Addressing Concerns Reported by Youth and Caregivers?
Kelley, S. D., de Andrade, A. R. V., Bickman, L., & Robin, A. V. (2012) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0415-y · Cited by 9
Self-citationIs There a Future for Therapists?
King, R., & Bickman, L. (2017) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-017-0814-1 · Cited by 8
Self-citationTransparency in Algorithmic Decision Making.
Rauber, A., Trasarti, R., & Giannotti, F. (2019) · ERCIM news/ERCIM news online edition · Cited by 8
Solutions to problems with deep learningPreprint
Wolff, J. G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.05457 · Cited by 7
Rau, H.-H., Wu, Y., Chu, C., Wang, F.-C., Hsu, M., Chang, C., Chen, K., Lee, Y.-L., Kao, S., Chiu, Y., et al. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7944 · Cited by 7
Correction: Effects of taurine on resting-state fMRI activity in spontaneously hypertensive rats
Chen, V. C., Hsu, T., Chen, L., Chou, H.-C., Weng, J., & Tzang, B. (2017) · PLoS ONE · doi:10.1371/journal.pone.0190203 · Cited by 5
Wiedermann, W., Dong, N., & von Eye, A. (2019) · Prevention Science · doi:10.1007/s11121-019-0978-x · Cited by 5
Problems in Using Diagnosis in Child and Adolescent Mental Health Services Research
Krauss, B. (2012) · Journal of Methods and Measurement in the Social Sciences · doi:10.2458/v3i1.16110 · Cited by 4
Single-subject Prediction: A Statistical Paradigm for Precision Psychiatry
Bzdok, D., & Karrer, T. M. (2021) · Springer eBooks · doi:10.1007/978-3-030-59797-9_19 · Cited by 4
Editorial: In the Causal Labyrinth: Finding the Path From Early Trauma to Neurodevelopment
Saxe, G. (2018) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2018.09.442 · Cited by 4
Fonagy, P., & Allison, E. (2017) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12805 · Cited by 3
A constructionist extension of the contextual model: Ritual, charisma, and client fit.
Bacon, S. C. (2019) · Journal of Psychotherapy Integration · doi:10.1037/int0000188 · Cited by 3
Good News: Artificial Intelligence in Psychiatry Is Actually Neither
Simon, G. E., & Yarborough, B. J. H. (2020) · Psychiatric Services · doi:10.1176/appi.ps.201900464 · Cited by 3
Population-Based Primary Care Payment System in Hawaii—Reply
Navathe, A. S., Mugiishi, M. M., & Emanuel, E. (2019) · JAMA · doi:10.1001/jama.2019.16203 · Cited by 3
Improving Machine Learning Prediction Performance for Premature Termination of Psychotherapy
Bohus, M., Gimbel, S., Görg, N., Humm, B. G., Schüller, M., Steffens, M., & Vonderlin, R. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-99344-7_13 · Cited by 2
My life as an applied social psychologist
Bickman, L. (2006) · Current Psychology · doi:10.1007/s12144-006-1005-5 · Cited by 2
Self-citationLibrenza‐Garcia, D. (2019) · Springer eBooks · doi:10.1007/978-3-030-03553-2_9 · Cited by 2
Redefining Disease Using Informatics
Saxe, G. (2019) · Health informatics · doi:10.1007/978-3-030-18626-5_13 · Cited by 1
Consumer participation in personalized psychiatry
Eyre, H. A., Becker, E. R., Blumenthal, M. S., Singh, A., Raji, C. A., Vahabzadeh, A. B. N., Wainer, Z., & Bousman, C. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-813176-3.00006-7 · Cited by 1
32.2 The Complex Etiology of PTSD in Children With Maltreatment
Morales, L. J., Ma, S., Aliferis, C., & Saxe, G. (2018) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2018.07.801 · Cited by 1
Modified Causal Forests for Estimating Heterogeneous Causal Effects
Lechner, M. (2018) · arXiv · doi:10.48550/arxiv.1812.09487
Rudin, C., & Carlson, D. (2019) · arXiv · doi:10.48550/arxiv.1906.01998
Flagged first, then by citations
Research works printed but not linked: 12
- Bickman, L. (1995). The Fort Bragg demonstration project: A managed continuum of care. The Child, Youth, and Family Services Quarterly,18(3), 2–5.
- Bickman, L., & Athay, M. I., (Eds.) (2012). Youth Mental Health Measurement (special issue) Administration and Policy in Mental Health and Mental Health Services Research, 39,1-2. ISSN: 0894-587X (Print) 1573-3289 (Online) · DOI
- Bickman, L., & Rog, D. (Eds.). (2016). The evaluation handbook: An evaluator’s companion. New York: Guilford Press.
- Heflinger, C. A., & Bickman, L. (1996). Family empowerment: A theoretically driven intervention and evaluation. In C. A. Heflinger & C. Nixon (Eds.), Families and mental health services for children and adolescents (pp. 96–116). Thousand Oaks: Sage.
- Institute of Medicine. (2007). IOM Roundtable on evidence-based medicine: The learning healthcare system: Workshop summary. Washington, DC: National Academies Press.
- King, R., & Bickman, L. (2017). Is there a future for therapists? Administration and Policy in Mental Health and Mental Health Services Research,44(5), 595–597. https://doi.org/10.1007/s10488-017-0814-1. · DOI
- Kohler, S. (2018). Precision medicine: Moving away from one-size-fits-all. Quest: Science for South Africa, 14(3). Academy of Science of South Africa (ASSAf)). Available at https://hdl.handle.net/20.500.11911/103
- Riemer, M., & Bickman, L. (2011). Using program theory to link social psychology and program evaluation. In M. M. Mark, S. I. Donaldson, & B. Campbell (Eds.), Social Psychology and Program/Policy Evaluation. New York: Guilford.
- Stroul, B. A., & Friedman, R. (1986). A system of care for children and youth with severe emotional disturbances (Rev ed.). Washington, DC: CASSP Technical Assistance Center, Georgetown University Child Development Center.
- Tan, J., Rollins, C. P. E., Israel, S., & Benrimoh, D. (2019). Primed for psychiatry: The role of artificial intelligence and machine learning in the optimization of depression treatment. University of Toronto Medical Journal,96(1), 43–47.
- An understanding of AI’s limitations is starting to sink in. (2020). Technology Quarterly: Artificial Intelligence and Its Limits, The Economist.
- Vinge, V. (1993). How to survive in the post-human era. In Interdisciplinary Science and Engineering in the Era of Cyberspace, Proceedings of the VISION-21 Symposium. NASA Conference Proceeding 10129. https://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/19940022855.pdf
Cited by
Sorted by citations
The Lancet Psychiatry Commission on youth mental health
McGorry, P. D., Mei, C., Dalal, N., Alvarez-Jimenez, M., Blakemore, S.-J., Browne, V., Dooley, B., Hickie, I. B., Jones, P. B., McDaid, D., et al. (2024) · The Lancet Psychiatry · doi:10.1016/s2215-0366(24)00163-9 · Cited by 663
Modern views of machine learning for precision psychiatry
Chen, Z. S., Kulkarni, P., Galatzer‐Levy, I. R., Bigio, B., Nasca, C., & Zhang, Y. (2022) · Patterns · doi:10.1016/j.patter.2022.100602 · Cited by 247
“However, the amount of precision that can be modeled using ML is far beyond the first level.(181,182) During psychiatric evaluation, psychiatrists may try to build a mental model of what is going on in the patient’s life in about 30 min.”
BackgroundShahzad, M. F., Xu, S., Lim, W. M., Yang, X., & Khan, Q. R. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e29523 · Cited by 205
“AI and social media have woven themselves deeply into the fabric of modern life, redefining paradigms in sectors ranging from education to interpersonal communication [128].”
BackgroundGonzález, P. C., He, A., Lam, E. K. M., Ng, I. M. C., Li, M. W., Hou, R., Chan, J. N.-M., Sahni, Y., Viñas‐Guasch, N., Miller, T., et al. (2025) · Psychological Medicine · doi:10.1017/s0033291724003295 · Cited by 255
Squires, M., Tao, X., Elangovan, S., Gururajan, R., Zhou, X., Acharya, U. R., & Li, Y. (2023) · Brain Informatics · doi:10.1186/s40708-023-00188-6 · Cited by 188
“Thus, unsupervised algorithms can be used to identify groupings that transcend existing diagnostic labels [70].”
BackgroundInfluential
Metadata
- Authors
- Bickman, L.
- Affiliations
- Florida International University (US)
- Corresponding author
- Bickman, Leonard
- ORCID
- Bickman, Leonard
- Venue
- Administration and Policy in Mental Health and Mental Health Services Research
- Published
- 2020-07-26
- Volume
- 47
- Issue
- 5
- Pages
- 795-843
- ISSN
- 0894-587X (ISSN-L)
- 1573-3289
- PMC
- PMC7382706
- OpenAlex
- W3045482196
- Cited by
- 184
- References
- 353
- Citations by year
- 2026: 23 · 2025: 48 · 2024: 36 · 2023: 30 · 2022: 27 · 2021: 14 · 2020: 6
- FWCI
- 17.40
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Administration and Policy in Mental Health and Mental Health Services Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health
- Johns Hopkins Bloomberg School of Public Health
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Keywords
- mental health services, artificial intelligence, precision mental health, personalized treatment, mental health services research, treatment effectiveness
- MeSH terms
- Artificial Intelligence, Health Services Research, Humans, Mental Health Services, Randomized Controlled Trials as Topic, Precision Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review