Assessment of a Digital Symptom Checker Tool's Accuracy in Suggesting Reproductive Health Conditions: Clinical Vignettes Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Reproductive health conditions such as endometriosis, uterine fibroids, and polycystic ovary syndrome (PCOS) affect a large proportion of women and people who menstruate worldwide. Prevalence estimates for these conditions range from 5% to 40% of women of reproductive age. Long diagnostic delays, up to 12 years, are common and contribute to health complications and increased health care costs. Symptom checker apps provide users with information and tools to better understand their symptoms and thus have the potential to reduce the time to diagnosis for reproductive health conditions. OBJECTIVE: This study aimed to evaluate the agreement between clinicians and 3 symptom checkers (developed by Flo Health UK Limited) in assessing symptoms of endometriosis, uterine fibroids, and PCOS using vignettes. We also aimed to present a robust example of vignette case creation, review, and classification in the context of predeployment testing and validation of digital health symptom checker tools. METHODS: Independent general practitioners were recruited to create clinical case vignettes of simulated users for the purpose of testing each condition symptom checker; vignettes created for each condition contained a mixture of condition-positive and condition-negative outcomes. A second panel of general practitioners then reviewed, approved, and modified (if necessary) each vignette. A third group of general practitioners reviewed each vignette case and designated a final classification. Vignettes were then entered into the symptom checkers by a fourth, different group of general practitioners. The outcomes of each symptom checker were then compared with the final classification of each vignette to produce accuracy metrics including percent agreement, sensitivity, specificity, positive predictive value, and negative predictive value. RESULTS: A total of 24 cases were created per condition. Overall, exact matches between the vignette general practitioner classification and the symptom checker outcome were 83% (n=20) for endometriosis, 83% (n=20) for uterine fibroids, and 88% (n=21) for PCOS. For each symptom checker, sensitivity was reported as 81.8% for endometriosis, 84.6% for uterine fibroids, and 100% for PCOS; specificity was reported as 84.6% for endometriosis, 81.8% for uterine fibroids, and 75% for PCOS; positive predictive value was reported as 81.8% for endometriosis, 84.6% for uterine fibroids, 80% for PCOS; and negative predictive value was reported as 84.6% for endometriosis, 81.8% for uterine fibroids, and 100% for PCOS. CONCLUSIONS: The single-condition symptom checkers have high levels of agreement with general practitioner classification for endometriosis, uterine fibroids, and PCOS. Given long delays in diagnosis for many reproductive health conditions, which lead to increased medical costs and potential health complications for individuals and health care providers, innovative health apps and symptom checkers hold the potential to improve care pathways.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Prevalence and Features of the Polycystic Ovary Syndrome in an Unselected Population
Azziz, R., Woods, K. S., Reyna, R., Key, T. J., Knochenhauer, E. S., & Yildiz, B. O. (2004) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2003-032046 · Cited by 2,712
Azziz, R., Carmina, E., Chen, Z., Dunaif, A., Laven, J. S. E., Legro, R. S., Lizneva, D., Natterson-Horowtiz, B., Teede, H. J., & Yildiz, B. O. (2016) · Nature Reviews Disease Primers · doi:10.1038/nrdp.2016.57 · Cited by 2,005
Teede, H. J., Misso, M. L., Costello, M. F., Dokras, A., Laven, J., Moran, L., Piltonen, T., Norman, R. J., & the International PCOS Network (2018) · Clinical Endocrinology · doi:10.1111/cen.13795 · Cited by 1,823
ESHRE guideline: endometriosis
Becker, C. M., Bokor, A., Heikinheimo, O., Horne, A., Jansen, F., Kiesel, L., King, K., Kvaskoff, M., Nap, A., Petersen, K., et al. (2022) · Human Reproduction Open · doi:10.1093/hropen/hoac009 · Cited by 1,712 · cited 1×
“…the accuracy (agreement between clinician and symptom checker) of 3 symptom checkers for endometriosis, uterine fibroids, and PCOS developed using current medical guidelines (Monash, European Society of Human Reproduction and Embryology, and American Academy of Family Physicians) [24,59,60].”
MethodEskenazi, B., & Warner, M. L. (1997) · Obstetrics and Gynecology Clinics of North America · doi:10.1016/s0889-8545(05)70302-8 · Cited by 1,617
Teede, H. J., Misso, M. L., Costello, M. F., Dokras, A., Laven, J., Moran, L., Piltonen, T., Norman, R. J., International PCOS Network, Andersen, M., et al. (2018) · Human Reproduction · doi:10.1093/humrep/dey256 · Cited by 1,593
ESHRE guideline for the diagnosis and treatment of endometriosis
Kennedy, S., Bergqvist, A., Chapron, C., D’Hooghe, T., Dunselman, G., Greb, R., Hummelshoj, L., Prentice, A., & Saridogan, E. (2005) · Human Reproduction · doi:10.1093/humrep/dei135 · Cited by 1,584 · cited 1×
“Endometriosis is a condition where endometrial tissue is found outside of the uterus and is typically characterized by painful periods, abnormal bleeding, and chronic pelvic pain, among other symptoms [5,14,15].”
BackgroundTeede, H., Deeks, A., & Moran, L. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-41 · Cited by 1,565
Bozdag, G., Mumusoglu, S., Zengin, D., Karabulut, E., & Yildiz, B. O. (2016) · Human Reproduction · doi:10.1093/humrep/dew218 · Cited by 1,526
Criteria, Prevalence, and Phenotypes of Polycystic Ovary Syndrome
Lizneva, D., Suturina, L., Walker, W., Brakta, S., Gavrilova-Jordan, L., & Azziz, R. (2016) · Fertility and Sterility · doi:10.1016/j.fertnstert.2016.05.003 · Cited by 1,358
Epidemiology of uterine fibroids: a systematic review
Stewart, E., Cookson, C., Gandolfo, R., & Schulze‐Rath, R. (2017) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.14640 · Cited by 1,100
Simoens, S., Dunselman, G., Dirksen, C., Hummelshoj, L., Bokor, A., Brandes, I., Brodszky, V., Canis, M., Colombo, G. L., DeLeire, T., et al. (2012) · Human Reproduction · doi:10.1093/humrep/des073 · Cited by 1,070
Stewart, E. A. (2001) · The Lancet · doi:10.1016/s0140-6736(00)03622-9 · Cited by 1,031
Evaluating Digital Health Interventions
Murray, E., Hekler, E. B., Andersson, G., Collins, L. M., Doherty, A., Hollis, C., Rivera, D. E., West, R., & Wyatt, J. C. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.06.008 · Cited by 847
Bulletti, C., Coccia, M. E., Battistoni, S., & Borini, A. (2010) · Journal of Assisted Reproduction and Genetics · doi:10.1007/s10815-010-9436-1 · Cited by 758
The Prevalence of Polycystic Ovary Syndrome: A Brief Systematic Review
Pundir, C., Deswal, R., Narwal, V., & Dang, A. (2020) · Journal of Human Reproductive Sciences · doi:10.4103/jhrs.jhrs_95_18 · Cited by 657
Update on PCOS: consequences, challenges, and guiding treatment
Hoeger, K. M., Dokras, A., & Piltonen, T. (2021) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgaa839 · Cited by 610
Digital health: a path to validation
Mathews, S. C., McShea, M. J., Hanley, C. L., Ravitz, A., Labrique, A. B., & Cohen, A. B. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0111-3 · Cited by 508
Diagnostic delay for endometriosis in Austria and Germany: causes and possible consequences
Hudelist, G., Fritzer, N., Thomas, A., Niehues, C., Oppelt, P., Haas, D., Tammaa, A., & Salzer, H. (2012) · Human Reproduction · doi:10.1093/humrep/des316 · Cited by 483
Menstruation: science and society
Critchley, H. O. D., Babayev, E., Bulun, S. E., Clark, S., Garcia-Grau, I., Gregersen, P. K., Kilcoyne, A., Kim, J.-Y. J., Lavender, M., Marsh, E. E., et al. (2020) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2020.06.004 · Cited by 448
Bazot, M., Lafont, C., Rouzier, R., Roseau, G., Thomassin-Naggara, I., & Daraï, E. (2009) · Fertility and Sterility · doi:10.1016/j.fertnstert.2008.09.005 · Cited by 434
Gibson-Helm, M., Teede, H., Dunaif, A., & Dokras, A. (2016) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2016-2963 · Cited by 428 · cited 2×
“A similar study of patients diagnosed with PCOS found that 33.6% of women reported >2 years time to diagnosis, 47.1% visited ≥ 3 health professionals before a diagnosis was established, and 64.8% were dissatisfied with the diagnostic process [66].”
BackgroundInfluentialUterine fibroids: current perspectives
Khan, A., Shehmar, M., & Gupta, J. (2014) · International Journal of Women's Health · doi:10.2147/ijwh.s51083 · Cited by 406
Quality of life and psychological well being in polycystic ovary syndrome
Barnard, L., Ferriday, D., Guenther, N., Strauss, B., Balen, A. H., & Dye, L. (2007) · Human Reproduction · doi:10.1093/humrep/dem108 · Cited by 388
Della Corte, L., Di Filippo, C., Gabrielli, O., Reppuccia, S., La Rosa, V. L., Ragusa, R., Fichera, M., Commodari, E., Bifulco, G., & Giampaolino, P. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17134683 · Cited by 387
Guo, C., Ashrafian, H., Ghafur, S., Fontana, G., Gardner, C., & Prime, M. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00314-2 · Cited by 316
Uterine Fibroids: Diagnosis and Treatment.
de la Cruz, M. S. D., & Buchanan, E. M. (2017) · PubMed · Cited by 309
The impact of uterine leiomyomas: a national survey of affected women
Borah, B. J., Nicholson, W. K., Bradley, L., & Stewart, E. A. (2013) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2013.07.017 · Cited by 304
Adolescent polycystic ovary syndrome according to the international evidence-based guideline
Peña, A. S., Witchel, S. F., Hoeger, K. M., Oberfield, S. E., Vogiatzi, M. G., Misso, M., Garad, R., Dabadghao, P., & Teede, H. (2020) · BMC Medicine · doi:10.1186/s12916-020-01516-x · Cited by 301
Diagnostic delay in women with pain and endometriosis
Husby, G. K., Haugen, R. S., & Moen, M. H. (2003) · Acta Obstetricia et Gynecologica Scandinavica · doi:10.1034/j.1600-0412.2003.00168.x · Cited by 298
The Burden of Uterine Fibroids for African-American Women: Results of a National Survey
Stewart, E. A., Nicholson, W. K., Bradley, L., & Borah, B. J. (2013) · Journal of Women's Health · doi:10.1089/jwh.2013.4334 · Cited by 255
Uterine Fibroids: Burden and Unmet Medical Need
Al-Hendy, A., Myers, E., & Stewart, E. (2017) · Seminars in Reproductive Medicine · doi:10.1055/s-0037-1607264 · Cited by 250
The direct and indirect costs associated with endometriosis: a systematic literature review
Soliman, A. M., Yang, H., Du, E. X., Kelley, C., & Winkel, C. (2016) · Human Reproduction · doi:10.1093/humrep/dev335 · Cited by 239 · cited 1×
“Endometriosis costs an average of US $27,855 per patient annually in the United States alone [40], while overall yearly expenditure for uterine fibroids is estimated to be US $34.4 billion [35].”
BackgroundInfluentialBurden, Prevalence, and Treatment of Uterine Fibroids: A Survey of U.S. Women
Marsh, E. E., Al-Hendy, A., Kappus, D., Galitsky, A., Stewart, E. A., & Kerolous, M. (2018) · Journal of Women's Health · doi:10.1089/jwh.2018.7076 · Cited by 230
Riestenberg, C., Jagasia, A., Markovic, D., Buyalos, R. P., & Azziz, R. (2022) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgab613 · Cited by 210 · cited 1×
“Similarly, the economic costs of PCOS on individuals and health care systems are estimated to be US $8 billion per year [8].”
BackgroundBallweg, M. L. (2004) · Best Practice & Research Clinical Obstetrics & Gynaecology · doi:10.1016/j.bpobgyn.2004.01.003 · Cited by 210 · cited 2×
“…conditions where the time to diagnosis is currently long and contributes to high health care costs [17,26,66,76], an earlier diagnosis can lead to early treatment and thus decrease complications from untreated conditions and decrease health care costs of treating more advanced disease [27,28,39].”
Background(1991) · PubMed · Cited by 202
Diagnosis of endometriosis in the 21st century
Kiesel, L., & Sourouni, M. (2019) · Climacteric · doi:10.1080/13697137.2019.1578743 · Cited by 187
The diagnostic and triage accuracy of digital and online symptom checker tools: a systematic review
Wallace, W., Chan, C., Chidambaram, S., Hanna, L., Iqbal, F. M., Acharya, A., Normahani, P., Ashrafian, H., Markar, S. R., Sounderajah, V., et al. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00667-w · Cited by 186
Gilbert, S., Mehl, A., Baluch, A., Cawley, C., Challiner, J., Fraser, H., Millen, E., Montazeri, M., Multmeier, J., Pick, F., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-040269 · Cited by 183 · cited 2×
“The multicondition symptom checkers evaluated by Gilbert et al [68] and Schmieding et al [69] were assessed using vignette cases that covered both common and less-common conditions seen in primary care practice, conditions that affect all body systems, and conditions that have a range of urgency…”
BackgroundMethodSelf-citationSafety of patient-facing digital symptom checkers
Fraser, H., Coiera, E., & Wong, D. (2018) · The Lancet · doi:10.1016/s0140-6736(18)32819-8 · Cited by 180
Meyer, A. N. D., Giardina, T. D., Spitzmueller, C., Shahid, U., Scott, T. M. T., & Singh, H. (2020) · Journal of Medical Internet Research · doi:10.2196/14679 · Cited by 161
(2003) · Seminars in Reproductive Medicine · doi:10.1055/s-2003-41326 · Cited by 157
Witchel, S. F., Teede, H. J., & Peña, A. S. (2019) · Pediatric Research · doi:10.1038/s41390-019-0615-1 · Cited by 156
Endometriosis Is Undervalued: A Call to Action
Ellis, K., Munro, D., & Clarke, J. (2022) · Frontiers in Global Women's Health · doi:10.3389/fgwh.2022.902371 · Cited by 152
Impact of Endometriosis Diagnostic Delays on Healthcare Resource Utilization and Costs
Surrey, E., Soliman, A. M., Trenz, H., Blauer-Peterson, C., & Sluis, A. (2020) · Advances in Therapy · doi:10.1007/s12325-019-01215-x · Cited by 151
Diagnosis, phenotype, and prevalence of polycystic ovary syndrome
Carmina, E., & Azziz, R. (2006) · Fertility and Sterility · doi:10.1016/j.fertnstert.2006.03.012 · Cited by 136
Jungmann, S. M., Klan, T., Kuhn, S., & Jungmann, F. (2019) · JMIR Formative Research · doi:10.2196/13863 · Cited by 127
Matsuzaki, S., Canis, M. J., Pouly, J. L., Rabischong, B., Botchorishvili, R., & Mage, G. (2006) · Fertility and Sterility · doi:10.1016/j.fertnstert.2006.03.048 · Cited by 124
A design and evaluation framework for digital health interventions
Kowatsch, T., Otto, L., Harperink, S., Cotti, A., & Schlieter, H. (2019) · it - Information Technology · doi:10.1515/itit-2019-0019 · Cited by 116
Robinson, K. M., Christensen, K. B., Ottesen, B., & Krasnik, A. (2011) · Quality of Life Research · doi:10.1007/s11136-011-0077-3 · Cited by 113
Women's experiences of polycystic ovary syndrome diagnosis
Gibson-Helm, M. E., Lucas, I. M., Boyle, J. A., & Teede, H. J. (2014) · Family Practice · doi:10.1093/fampra/cmu028 · Cited by 112
Triage Accuracy of Symptom Checker Apps: 5-Year Follow-up Evaluation
Schmieding, M. L., Kopka, M., Schmidt, K., Schulz-Niethammer, S., Balzer, F., & Feufel, M. A. (2022) · Journal of Medical Internet Research · doi:10.2196/31810 · Cited by 99
Beyond Dr. Google: the evidence on consumer-facing digital tools for diagnosis
Millenson, M. L., Baldwin, J. L., Zipperer, L., & Singh, H. (2018) · Diagnosis · doi:10.1515/dx-2018-0009 · Cited by 91 · cited 3×
“Even though information on their development and validation is limited and its reliability is in question [47,49], trust in symptom checker apps is high among laypersons [57].”
BackgroundThe prevalence of endometriosis in women with infertile partners
Waller, K. G., Lindsay, P., Curtis, P., & Shaw, R. W. (1993) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/0028-2243(93)90254-a · Cited by 81
Diagnostic Accuracy of Web-Based COVID-19 Symptom Checkers: Comparison Study
Munsch, N., Martin, A., Gruarin, S., Nateqi, J., Abdarahmane, I., Weingartner-Ortner, R., & Knapp, B. (2020) · Journal of Medical Internet Research · doi:10.2196/21299 · Cited by 78
Digitizing diagnosis: a review of mobile applications in the diagnostic process
Jutel, A., & Lupton, D. (2015) · Diagnosis · doi:10.1515/dx-2014-0068 · Cited by 71
Ghant, M. S., Sengoba, K. S., Vogelzang, R. L., Lawson, A. K., & Marsh, E. E. (2016) · Journal of Women s Health · doi:10.1089/jwh.2015.5531 · Cited by 70
Yigzaw, K. Y., Wynn, R., Marco-Ruiz, L., Budrionis, A., Oyeyemi, S. O., Fagerlund, A. J., & Bellika, J. G. (2019) · Journal of Medical Internet Research · doi:10.2196/13120 · Cited by 56
Ćirković, A. (2020) · Journal of Medical Internet Research · doi:10.2196/18097 · Cited by 53
Pairon, A., Philips, H., & Verhoeven, V. (2023) · Frontiers in Medicine · doi:10.3389/fmed.2022.1040926 · Cited by 48
Darbyshire, P., & Darbyshire, A. (2010) · Getting StartED with Google Apps · doi:10.1007/978-1-4302-2666-6_6 · Cited by 46
Patient perceptions of misdiagnosis of endometriosis: results from an online national survey
Bontempo, A. C., & Mikesell, L. (2020) · Diagnosis · doi:10.1515/dx-2019-0020 · Cited by 43
Zhaunova, L., Bamford, R., Radović, T., Wickham, A. P., Peven, K., Croft, J., Klepchukova, A., & Ponzo, S. (2023) · JMIR mhealth and uhealth · doi:10.2196/40427 · Cited by 41
Self-citationAccuracy of a Popular Online Symptom Checker for Ophthalmic Diagnoses
Shen, C., Nguyen, M., Gregor, A., Isaza, G., & Beattie, A. (2019) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2019.0571 · Cited by 40
Álvarez-Salvago, F., Lara-Ramos, A., Cantarero-Villanueva, I., Mazheika, M., Mundo-López, A., Galiano-Castillo, N., Fernández-Lao, C., Arroyo-Morales, M., Ocón-Hernández, O., & Artacho-Cordón, F. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17103610 · Cited by 38 · cited 1×
“Both endometriosis and uterine fibroids severely affect quality of life, everyday functioning, and workplace productivity [32-36].”
BackgroundDeterminants of Laypersons’ Trust in Medical Decision Aids: Randomized Controlled Trial
Kopka, M., Schmieding, M. L., Rieger, T., Roesler, E., Balzer, F., & Feufel, M. A. (2022) · JMIR Human Factors · doi:10.2196/35219 · Cited by 37
Closing the digital divide with mmWave extended range for FWA
Ericsson, A., Falconetti, L., Olofsson, H., Edstam, J., & Dahlberg, T. (2022) · Ericsson Technology Review · doi:10.23919/etr.2022.9954447 · Cited by 36
El-Osta, A. A. R., Webber, I., Alaa, A., Bagkeris, E., Mian, S., Sharabiani, M. T. A., & Majeed, A. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-053566 · Cited by 32
Polycystic ovary syndrome: validated questionnaire for use in diagnosis.
Pedersen, S. D., Brar, S., Faris, P., & Corenblum, B. (2007) · PubMed Central · Cited by 31
Online Symptom Checkers: Recommendations for a Vignette-Based Clinical Evaluation Standard
Painter, A., Hayhoe, B. W. J., Sasco, E. R., & El-Osta, A. A. R. (2022) · Journal of Medical Internet Research · doi:10.2196/37408 · Cited by 30
What Do Men Want from a Health Screening Mobile App? A Qualitative Study
Teo, C. H., Ng, C. J., & White, A. (2017) · PLoS ONE · doi:10.1371/journal.pone.0169435 · Cited by 28
Koch, R., Koch, R., Preiser, C., Müller, R., Klemmt, M., Ranisch, R., Ehni, H., Wiesing, U., Rieger, M. A., Henking, T., et al. (2022) · JMIR Research Protocols · doi:10.2196/34026 · Cited by 21
Rodriguez, E. M., Thomas, D., Druet, A., Vlajic-Wheeler, M., Lane, K. J., & Mahalingaiah, S. (2020) · JMIR Formative Research · doi:10.2196/15094 · Cited by 18
Development of an endometriosis self-assessment tool for patient
Cho, H., & Yoon, Y.-S. (2022) · Obstetrics & Gynecology Science · doi:10.5468/ogs.21252 · Cited by 7
Overview of Long-Term Morbidity and Economic Cost of the Polycystic Ovary Syndrome
Azziz, R. (2007) · Humana Press eBooks · doi:10.1007/978-1-59745-179-6_32 · Cited by 7
Avey: An Accurate AI Algorithm for Self-DiagnosisPreprint
Hammoud, M., Douglas, S., Darmach, M., Alawneh, S., Sanyal, S., & Kanbour, Y. (2022) · medRxiv · doi:10.1101/2022.03.08.22272076 · Cited by 6
Head and neck cancer in the digital age: an evaluation of mobile health applications
Fleming, J. C., & Jeannon, J. (2020) · BMJ Innovations · doi:10.1136/bmjinnov-2019-000350 · Cited by 5
Research works printed but not linked: 3
- Rawson, JM, 1991, J Reprod Med, 36, 513
- De La Cruz, MSD, 2017, Am Fam Physician, 95, 100
- Pedersen, SD, 2007, Can Fam Physician, 53, 1042
Cited by
Polycystic Ovary Syndrome and the Internet of Things: A Scoping Review
Graca, S., Alloh, F., Lagojda, L., Dallaway, A., Kyrou, I., Randeva, H. S., & Kite, C. (2024) · Healthcare · doi:10.3390/healthcare12161671 · Cited by 14
Digitale Gesundheits-Apps: Wie gelingt die Integration in die medizinische Versorgung
Widmer, A. (2024) · Die Innere Medizin · doi:10.1007/s00108-024-01774-4 · Cited by 12
Wright, P. J., Burts, C., Harmon, C., & Corbett, C. F. (2025) · JMIR Infodemiology · doi:10.2196/68469 · Cited by 8
“…chronic health conditions [66], engagement diminished over time as women with PCOS sought more common ground than the illness experience, such as life stage (eg, student, mother, and retiree) and, therefore, overall health goal (eg, fertility vs risk reduction of comorbidities) [14,23,26,31,40].”
Wickham, A. P., Hewings-Martin, Y., Goddard, F. G. B., Rodgers, A. K., Cunningham, A. C., Prentice, C., Wilks, O., Kaplan, Y. C., Marhol, A., Meczner, A., et al. (2024) · JMIR Formative Research · doi:10.2196/65469 · Cited by 7
Self-citationC-PATH: Conversational Patient Assistance and Triage in Healthcare System
Shi, Q. F., Han, Q., & Soares, C. (2025) · IEEE International Conference on Digital Health (ICDH) · doi:10.1109/icdh67620.2025.00016 · Cited by 7
Metadata
- Authors
- Peven, K., Wickham, A. P., Wilks, O., Kaplan, Y. C., Marhol, A., Ahmed, S., Bamford, R., Cunningham, A. C., Prentice, C., Meczner, A., Fenech, M., Gilbert, S., Klepchukova, A., Ponzo, S., & Zhaunova, L.
- Affiliations
- Else Kröner Fresenius Center for Digital Health (DE)
- Corresponding author
- Wickham, Aidan P
- ORCID
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2023-12-05
- Volume
- 11
- Pages
- e46718
- ISSN
- 2291-5222 (ISSN-L)
- PMC
- PMC10731551
- OpenAlex
- W4388478893
- Cited by
- 9
- References
- 78
- Citations by year
- 2026: 4 · 2025: 1 · 2024: 4
- FWCI
- 3.19
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR mhealth and uhealth (publishedVersion, cc-by)
- medRxiv (acceptedVersion)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- endometriosis, uterine fibroids, polycystic ovary syndrome, clinical vignettes, diagnostic accuracy, symptom assessment, delayed diagnosis, general practitioners, women's health, menstrual cycle tracking apps, health equity
- MeSH terms
- Endometriosis, Female, Humans, Leiomyoma, Prevalence, Reproductive Health
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.